Changelog

This page will list updates and changes to Krawler.

v1.5.0

• Added: Support for TLDs .es, .it, .fr, .nl, .uk, and .au including backend routing, database integration, and frontend navigation.
• Improved: Dynamic "Check status" WHOIS lookup links now use the official services for each TLD.
• Improved: Navigation tabs for each TLD now dynamically reflect whether a feature like Domain Info or Available Domains is supported.
• Changed: Status page now includes all active TLDs and displays "Online"/"Offline" labels.
• Improved: Status logo link behavior on flat routes like /status or /legal now correctly reloads current path instead of breaking.
• Changed: Removed "Average Domain Age" from statistics pages and cleaned up SQL and template logic accordingly.
• Fixed: Template logic now correctly displays created dates for .nl domains in the "Oldest Domains" section.

v1.4.0

• Improved: All TLDs now strictly enforce availability filtering when using "Link from domain" search.
• Fixed: Collation mismatches across domain-related tables by aligning to utf8mb4_unicode_ci.
• Improved: Replaced GROUP BY logic with subqueries to comply with ONLY_FULL_GROUP_BY mode.
• Fixed: Availability filters now apply consistently even with source domain filters enabled.
• Added: Real-time "Found In" enrichment from domains table for all TLDs.

v1.3.0

• Added: .se TLD crawler, frontend integration, and failover handling.
• Fixed: Prevented .se crawler crashes by skipping large files using HEAD checks.
• Added: Background link status crawler for real-time updates.

v1.2.0

• Added: .de TLD crawler, database, replication, and frontend integration.
• Changed: Reorganized project to support multi-TLD routing and country selection.
• Changed: Refactored legal and changelog pages for dynamic TLD-aware routing.

v1.1.0

• Added: Dedicated frontend for .dk with templates, WHOIS, and search tools.
• Changed: Refactored .dk crawler for more accurate WHOIS parsing.
• Added: Historical snapshot tracking for domain details.
• Added: IP tool to find domains based on IP segments.

v1.0.0

• Added: Production deployment using Gunicorn and Redis-backed Flask caching.
• Added: MySQL performance tuning and read-replica scaling guide.
• Changed: Enabled SEO optimization across all frontend templates.
• Changed: Improved mobile responsiveness with responsive tables and CSS tweaks.
• Security: Secured app credentials using environment variables. Improved error handling and routing.