Skip to Content
TDC Signal

Crawler

TDCSignalBot

TDCSignalBot reads websites for TDC Signal customers so they can see how AI engines describe them.

How to Recognize It

Every request sends this user agent:

Mozilla/5.0 (compatible; TDCSignalBot/1.0; +https://signal.tdccommerce.com/bot)

What It Reads

Your homepage, sitemap, robots.txt, a handful of key pages, and the product pages you add. It never submits forms or logs in.

When It Visits

When a customer adds or rereads a site, audits or improves a page, or adds or refreshes a product page. It also reads product pages again in the day before each scheduled check, at most once a day.

How Much It Fetches

At most 500 sitemap entries and 8 pages per site read, 4 pages at a time. Page audits fetch only the pages a customer selects, one at a time. Product page reads wait up to 20s and read up to 5 MB. Other requests time out after at most 15s.

How to Allow It on Cloudflare

If Cloudflare challenges TDCSignalBot, add a WAF custom rule that skips bot checks for its user agent.

  1. Open Security, then WAF, then Custom rules, and create a rule.
  2. Match the expression (http.user_agent contains "TDCSignalBot").
  3. Set the action to Skip and select Super Bot Fight Mode, Managed rules, Security Level and Browser Integrity Check.
  4. Deploy the rule and move it to the top of the list.