Robotstxt-validator
Technical SEO · github.com verified
Fast library to check robots.txt compliance with Google standards
Specifications
- Pricing
- open-source
- Price range
- 0
- Billing
- one-time
- License
- Apache
- Platform
- cli
- Languages
- en
- Target user
- expert
- Company size
- agency, enterprise
- API
- No
- Data export
- No
- Last update
- 2025-08-15
Tags
Related tools
- 🤖 Robots.txt Generator
Creates and validates robots.txt files to manage search engine crawler access
- ⚙️ Web-Check
All-in-one open-source OSINT and technical SEO tool for analyzing infrastructure and headers
- ⚡ Vercel Speed Insights
Real-user monitoring and performance tracking for modern web frameworks and core web vitals
- 📦 Puppeteer
Node library to control headless Chrome for complex SPA SEO rendering tests
- 🪵 Logz.io
Log analysis platform used by SEOs to analyze search engine bot behavior
- 🔧 View Rendered Source
Chrome extension to compare raw HTML and rendered DOM for JavaScript SEO troubleshooting