ThinkHeads Bot Policy
What is the ThinkHeads-AnalystBot?
The ThinkHeads-AnalystBot is a highly constrained, low-volume automated agent operating as part of the thinkheads.ai platform. Its primary purpose is to assist the platform's orchestration system by fetching public information, documentation, and news snippets to answer complex technical queries in real-time.
Our Commitment to Ethical Scraping
This project is designed as an MLOps engineering portfolio piece demonstrating ethical data extraction. We adhere to the following principles:
- Low Volume: The bot is hard-limited to a maximum connection pool and strictly delays requests to prevent burdening upstream servers.
- Transparency: We explicitly identify our bot via the User-Agent string rather than spoofing standard browsers.
- No Paywall Bypassing: The bot does not authenticate or bypass commercial paywalls.
How to Opt Out
We strictly respect the robots.txt protocol. To prevent the ThinkHeads-AnalystBot from accessing your site, simply add the following to your robots.txt file:
User-agent: ThinkHeads-AnalystBot
Disallow: /
Contact
If you notice anomalous behavior or wish to report an issue regarding the bot's access patterns, please reach out to the platform administrator via LinkedIn.