Crawler
About SpringboardBot
SpringboardBot is the crawler behind Springboard. It only visits a website after someone submits that website's address on our site, and it reads public pages the way a visitor's browser would, so we can map the site's key pages, calls to action and lead-capture points.
How it behaves
- Identifies itself with the user agent
SpringboardBot/1.0 (+https://springboard.example.com/bot). - Honours
robots.txtdisallow rules and crawl-delay hints. - Stays on the submitted domain, fetches at most a few hundred pages, and limits itself to a handful of concurrent requests with a pause between them.
- Does not log in, submit forms, or read content behind authentication or paywalls.
- Keeps raw page copies for 30 days and page thumbnails while the customer's account is active.
Block it
Add this to your robots.txt and the crawler will skip your site:
User-agent: SpringboardBot
Disallow: /Allow it through bot protection
If your site sits behind a firewall or bot-management service, allow the user agent above. We will publish a fixed list of crawler IP addresses here before launch.
IP allow-list pending: static egress addresses are published once the crawler infrastructure exists.
Questions or takedown
If a scan of your site was requested by someone who does not own it, or you have any question, email support@springboard.example.com.