Running a crawl¶
- Open the sitemap workstation → Crawl tab
- Click Start crawl
- Monitor progress (updates every 2s): pages crawled, depth, broken links found
- Click Cancel to stop early — results so far are saved
Flowpane identifies as FlowpaneBot/1.0 and respects robots.txt and Crawl-delay.
Rate limits: one crawl per site per hour, max three concurrent crawls.