`cymetica-crawler`

Category: AI Crawler

Purpose

Indexes AI-agent / prediction-market / Web3 directories to keep our submission state in sync. Read-only HTML/JSON fetches at low rate.

Identification

This agent identifies itself with the User-Agent string:

CymeticaPlatformBot/1.0 (+https://cymetica.com/bots/cymetica-crawler)

Every outbound request is signed with HTTP Message Signatures (RFC 9421) using the Web Bot Auth tag. Verifiers can fetch the public Ed25519 key at /.well-known/http-message-signatures-directory; the Signature-Input header carries the matching keyid.

Behavior

Respects robots.txt.
Does not bypass paywalls, login walls, or rate limits beyond what the target's policy permits for AI agents in our category.
Identifies as a verified Cymetica agent rather than spoofing browsers.
Operates at low aggregate request rate; honors HTTP 429 with backoff.
Does not train AI models on scraped content.

Opt out

To exclude this agent from your site, add the following to your robots.txt:

User-agent: CymeticaPlatformBot
Disallow: /

Or email contact@cymetica.com and we will exclude your domain at the source within one business day.

Contact

Operator: Cymetica
Email: contact@cymetica.com
Website: https://cymetica.com