Issues

• Verify Meta's crawlers via AS32934

  datahelp wanted
  daniel63194/crawlerid#11 · Filter by author daniel63194 opened on Oct 11, 2026

• Verify Web Bot Auth signed requests (RFC 9421)

  help wanted
  daniel63194/crawlerid#10 · Filter by author daniel63194 opened on Oct 11, 2026

• Python reader for the registry and IP data

  help wanted
  daniel63194/crawlerid#9 · Filter by author daniel63194 opened on Oct 11, 2026

• Hono and Fastify recipes or adapters

  good first issue
  daniel63194/crawlerid#8 · Filter by author daniel63194 opened on Oct 11, 2026

• Support JSON access logs in crawlerid logs

  good first issue
  daniel63194/crawlerid#7 · Filter by author daniel63194 opened on Oct 11, 2026

• Add crawlers: Baidu, Seznam and Naver

  datagood first issuenew crawler
  daniel63194/crawlerid#6 · Filter by author daniel63194 opened on Oct 11, 2026

• Add crawler: Bytespider (ByteDance)

  datagood first issuenew crawler
  daniel63194/crawlerid#5 · Filter by author daniel63194 opened on Oct 11, 2026

• Add IP verification for DuckDuckBot and DuckAssistBot

  data
  daniel63194/crawlerid#4 · Filter by author daniel63194 opened on Oct 11, 2026

• Verify Amazon's crawlers from their published IP pages

  datagood first issue
  daniel63194/crawlerid#3 · Filter by author daniel63194 opened on Oct 11, 2026