Keep crawl progress accurate under load
Background crawls recheck shared account capacity before resuming and keep their original job identity when they wait.
Fixes
- Track progress as pages change and keep counts accurate across duplicate writes, replacements, and lost acknowledgments.
- Include preparation and database waits in crawl deadlines while reserving time to publish saved results.