ThinkHeads Bot Policy

What is the ThinkHeads-AnalystBot?

The ThinkHeads-AnalystBot is a highly constrained, low-volume automated agent operating as part of the thinkheads.ai platform. Its primary purpose is to assist the platform's orchestration system by fetching public information, documentation, and news snippets to answer complex technical queries in real-time.

Our Commitment to Ethical Scraping

This project is designed as an MLOps engineering portfolio piece demonstrating ethical data extraction. We adhere to the following principles:

  • Low Volume: The bot is hard-limited to a maximum connection pool and strictly delays requests to prevent burdening upstream servers.
  • Transparency: We explicitly identify our bot via the User-Agent string rather than spoofing standard browsers.
  • No Paywall Bypassing: The bot does not authenticate or bypass commercial paywalls.

How to Opt Out

We strictly respect the robots.txt protocol. To prevent the ThinkHeads-AnalystBot from accessing your site, simply add the following to your robots.txt file:

User-agent: ThinkHeads-AnalystBot
Disallow: /

Contact

If you notice anomalous behavior or wish to report an issue regarding the bot's access patterns, please reach out to the platform administrator via LinkedIn.