Crawler directory
Search indexesUser agent + IP range

Google

Googlebot

About this crawler

Googlebot is tracked as a search or answer-index crawler from Google.

Usually means: The crawler is discovering or refreshing pages so they can appear in search, answer, or assistant indexes.

User agent

Googlebot

Faurya matches these as user-agent tokens, not full browser strings. Providers may add surrounding version or product text.

IP verification

Verified when user agent and IP range both match

Faurya first matches the crawler user-agent token, then compares the request IP with published ranges from the crawler operator when those ranges exist.

User agent

Request user agent contains Googlebot.

Request IP

Server-side tracking forwards the crawler IP seen by your backend.

Range check

The IP is compared with published CIDR ranges or JSON range endpoints.