MCP Scraper 1.0: faster tools, 107 new data tools, large sites in parts
MCP Scraper 1.0 is out. A Google search now answers in 6.5 seconds on average, down from 17.5, and Maps and page extraction are faster by similar amounts. 107 new data tools cover Zillow, Amazon, X, LinkedIn and Instagram, and large sites can be collected in parts you control.
Faster across the board
- Google Search: 6.5 seconds, down from 17.5.
- Page extraction: 3.8 seconds, down from 9.3.
- Google Maps search: 7.5 seconds, down from 49.7.
- Google Maps business lookup: 26.9 seconds, down from 79.8.
These are average response times on real customer requests, measured the day before the changes and the day after. 95% of searches now come back within 10 seconds. The day before, 45% did.
Improvements
- 107 new data tools reach five more platforms directly: Zillow (listings, single properties, agents), Amazon (search, products, reviews, offers, bestsellers, deals, sellers), X (profiles, posts, threads, replies, search, trends, communities), LinkedIn (profiles, companies, posts, jobs, ads, comments and reactions) and Instagram (profiles, posts, reels, stories, hashtags, locations, comments).
- Large sites are collected in parts. One request collects up to 1,000 pages, or about eight minutes of crawling, hands you that part's files and tells you how many pages are left. Say continue and the next request picks up where the last one stopped, without collecting anything twice. Each part is charged on its own.
- Real links, not redirects. Google started wrapping result links in a redirect that only unlocks about 50 seconds after the page loads. Results now arrive right away and the real destination links are filled in behind them.
- Real results, not decoys. Google sometimes answers automated requests with a page that looks valid but is not what a person sees. Every search source is tested against the page a person gets and only the ones that match are used. An empty or blocked search page counts as a failed search and is refunded.
- Search snapshots check their place. When you give a US location, a snapshot checks that its results are for that place, repeats the read when they are not, and clearly marks a result that is still for somewhere else. Snapshots also arrive faster and carry the local pack.
- More ways to write a place. “Cincinnati, OH, United States” and “St. Paul, MN” now work, and about 67,000 cities and towns outside the United States are recognised.
Fixes
- Site audits finish reliably. A fault that made some audits fail at the very last step is gone, and the affected jobs were rebuilt at no charge.
- Reddit batches come back in time. A batch returns what it has before your AI gives up waiting, and lists the threads it did not get to so you can fetch them next.