You're offline — showing cached data
B BibaMoneypowered by AI OS
Try GOGA demo
BTC $59290.00 ▼-1.61% ETH $1562.34 ▼-3.78% USDT $1.00 ▲+0.01% BNB $553.35 ▼-1.33% USDC $1.00 ▲+0.01% XRP $1.03 ▼-2.92% SOL $66.18 ▼-2.11% TRX $0.32 ▼-1.05% FIGR_HELOC $1.03 ▼-0.49% HYPE $61.83 ▲+3.53% DOGE $0.07 ▼-2.66% USDS $1.00 ▲+0.03%

crawlercheck.com

This tool analyzes if you are blocking search engines or AI crawlers
· crawlercheck.com
Last enriched: 29d ago
Claim this startup Founder? Verify ownership to edit or remove the listing.
Enrichment status: 10% partial
Tvijo
0
Lead
—

About

CrawlerCheck is a tool that solves one specific problem: it tells you if you're accidentally blocking search engines like Google from seeing your website. It's easy to make a mistake in your site's settings that makes a page invisible to bots. Instead of you having to look in three different places, CrawlerCheck checks them all at once. It reads your robots.txt file, finds any robots meta tags in the page's HTML, and inspects the X-Robots-Tag sent by your server. It then shows you exactly which rules apply and if bots are allowed or blocked.

AI summary

🤖

AI summary coming soon

The profile is visible now, but AI-generated synthesis has not been stored for this company yet.

Source: AI OS summary pipeline | Status: Pending

Methodology →

Tech stack hints

Platform✕ Needs enrichment
GitHub✕ Needs enrichment
API docs✕ Needs enrichment

API documentation

empty

No public API documentation matched our discovery patterns yet (pattern matching / AI OS API discovery pipeline is pending or has not stored records for this slug).

Growth signals

empty

Composite score over time (MVP: news-derived mention velocity only).

Growth timeline is waiting for measured AI OS growth scores.

Where this company appears

empty

No mention sources are recorded yet for this startup.

Developer activity

empty

Stack Overflow question counts for the latest stored week. Tags are inferred from this profile’s text (CMS, description, AI notes) — not a full tech stack audit.

No matching tags yet, or the enrichment job has not populated Stack Overflow read models. See tech activity rankings for the global snapshot.

Startup news Rankings Startup API
Public startup endpoint
GET /api/v1/public/startups/crawlercheck

Use the same normalized profile, enrichment coverage, and discovery metadata from this page in your own app.

Try startup API
How this company data works

Each field group is shown only when the public portal has a read model or discovery result for it. Missing blocks stay explicit.

Field Source Updated Status
Profile basics v_portal_companies_v1 2026-05-27 13:49 UTC ✓ OK
Social + GitHub Enrichment snapshot 2026-05-27 13:49 UTC ✕ Missing
API documentation AI OS api-doc discovery Pending ✕ Missing
Growth timeline AI OS growth scores Live relay ✕ Missing
Mentions map AI OS mentions read models Live relay ✕ Missing