April 22, 2025
Some Experiments into How Google's Crawler works
Why experiment with Googlebot Beyond the fact it is interesting to understand how it works, it is potential useful if you ca...
The Crawl Tool Team
March 10, 2025
•
1 minute read
In the third of our weekly update on new features, we introduce the Public API.
A lot of effort has been put into the user interface of The Crawl Tool to make it easy to use and access the data on your crawled projects. But you might want to create your own little tool or do a simple task programmatically. Now you can with our public API.
At the moment we have 3 functions you can call:
- getProjects - lists all your crawl tool projects
- getReports - lists the reports for a particular project
- getReportRows - lists the rows of data from a particular report.
This is the start of our desire to enable all types of website owners, SEOs, and agencies to improve their sites in whatever way they want. We'll keep working on this. For example, there's a huge backlink project we're working on that we hope to add to the API in the near future.
Ready to find and fix your website's SEO issues?
Start with a free crawl of up to 1,000 URLs and get actionable insights today.
Try The Crawl Tool Free
