Skip to Content
TDC Signal

Crawler

TDCSignalBot

TDCSignalBot reads websites for TDC Signal customers so they can see how AI engines describe them.

How to Recognize It

Every request sends this user agent:

Mozilla/5.0 (compatible; TDCSignalBot/1.0; +https://signal.tdccommerce.com/bot)

What It Reads

Your homepage, sitemap, robots.txt, a handful of key pages, and the product feed or store catalog you connect. It never submits forms or logs in.

When It Visits

When a customer adds or rereads a site, audits a page, or refreshes a catalog. Automatic catalog refreshes run at most once a day.

How Much It Fetches

At most 500 sitemap entries and 8 pages per site read, 4 pages at a time. Page audits fetch only the pages a customer selects, one at a time. Each request times out after at most 15s.

How to Allow It on Cloudflare

If Cloudflare challenges TDCSignalBot, add a WAF custom rule that skips bot checks for its user agent.

  1. Open Security, then WAF, then Custom rules, and create a rule.
  2. Match the expression (http.user_agent contains "TDCSignalBot").
  3. Set the action to Skip and select Super Bot Fight Mode, Managed rules, Security Level and Browser Integrity Check.
  4. Deploy the rule and move it to the top of the list.