indexo.dev

spider.es

.es crawl

First seen 2026-04-22 · Last seen 2026-05-15 · ok HTTP/1.1 200 651 ms crawled 2026-05-15

US · 104.21.25.56 · AS13335 Cloudflare, Inc.

Reputation 100/100

Classifying

HTML metadata

Title
Spider.es · Lightning-fast crawler & bot access checker
Description
Audit, in seconds, whether search engines, AI crawlers, SEO tools and scrapers can reach your pages—and pinpoint the directive that stops them.
Language
en
Canonical
https://spider.es/
Translations
  • de
  • en
  • es
  • fr
  • it
  • ja
  • ko
  • pt

Open Graph

url
https://spider.es/
title
Spider.es · Lightning-fast crawler & bot access checker
site name
spider.es
description
Audit, in seconds, whether search engines, AI crawlers, SEO tools and scrapers can reach your pages—and pinpoint the directive that stops them.

Technology

CDN
Cloudflare
Analytics
  • Cloudflare Insights
Ads
  • Google AdSense
Fonts
  • Google Fonts

Third-party hosts loaded (5)

  • pagead2.googlesyndication.com×3
  • fonts.googleapis.com×2
  • a.colorvivo.com×1
  • fonts.gstatic.com×1
  • static.cloudflareinsights.com×1

DNS records live

NS
  • art.ns.cloudflare.com
  • kate.ns.cloudflare.com
TXT
  • google-site-verification=0vTUQPwsNXOyNODlh7sgBHSMrLCSiS18R4x7EHimAQY

Email authentication no MX

SPF
not published
DMARC
not published
DKIM
no key found at common selectors

Certificate (current)

WE1
from 2026-05-14 to 2026-08-12
Expires in 85 days

Full certificate history on crt.sh ↗

HTTP security headers

Header hygiene 50/100 Checked live page: https://spider.es/

present
  • x-frame-options
  • x-content-type-options
findings
  • missing HSTS
  • missing Content Security Policy
  • missing Referrer Policy
  • missing Permissions Policy
Header values
x-frame-options
SAMEORIGIN
x-content-type-options
nosniff

Links to (2)

Linked from (2)