Features

Auto-Refresh Schedules

Keep your sitemap up to date automatically. Learn how auto-refresh works, how to set a custom schedule, and best practices by site type.

4 min read·Updated June 22, 2026

Pro feature

Auto-refresh is available on the Pro plan only. Free users can trigger a manual crawl at any time from the dashboard. Upgrade to Pro to enable scheduling.

How Auto Refresh Works

Auto-refresh re-crawls your site on a recurring schedule so your sitemap always reflects the latest state of your content — without you having to remember to do it manually. Once a schedule is set, a background job checks whether each site is due for a refresh and kicks off a new crawl automatically.

You manage schedules at /dashboard/auto-refresh. Each site you own can have an independent schedule.

The Default Schedule

Pro users who haven't configured a custom schedule automatically receive a weekly refresh every Monday at 08:00 UTC. This default is a sensible starting point for most sites and ensures your sitemap is never more than a week stale.

You can override the default at any time by setting a custom schedule on the auto-refresh settings page.

Custom Schedules

Custom schedules let you choose exactly when and how often your sitemap is refreshed.

Frequency Options

Three frequencies are available:

Daily — crawls once every 24 hours at your chosen time. Best for sites that publish new content every day.
Weekly — crawls once a week on the day and time you select. The right choice for most content-driven sites.
Monthly — crawls once a month. Suitable for stable sites where content rarely changes.

Weekly is usually enough

Unless your site publishes new content every day, weekly is the right frequency. Over-refreshing doesn't improve your SEO — search engines crawl your site on their own schedule regardless.

Choosing a Time

You can pick any hour of the day (0–23) for the crawl to start.

All times are UTC

Schedule times are stored and evaluated in UTC. If your target hour is 09:00 in London (BST, UTC+1), enter 08:00 in the scheduler.

Pausing a Schedule

You can pause auto-refresh for any site at any time from the auto-refresh settings page. While paused, no automatic crawls will run. Your existing sitemap and health data remain intact. Resume the schedule at any time — the next run will be calculated from the moment you re-enable it.

Best Practices

Match your refresh frequency to how often your content actually changes:

Site type	Recommended frequency	Reason
Blog / editorial	Weekly	New posts are usually published a few times per week at most.
E-commerce	Daily	Product pages are added, removed, or updated frequently.
Documentation / marketing	Monthly	Content is stable; pages rarely change between releases.