crawlly.ai

.ai crawl

First seen 2026-04-14 · Last seen 2026-05-07 · ok HTTP/1.1 200 1829 ms crawled 2026-05-07

US · 216.198.79.1 · AS16509 Amazon.com, Inc.

Reputation 94/100 dmarc monitor-only

sector tech type homepage

HTML metadata

Title
Crawlly AI - SEO, AEO, GEO and LLM Visibility Audits
Description
Measure SEO, AEO, GEO, and LLM visibility. Get scorecards, prioritized roadmaps, and role-focused actions that improve AI discoverability.
Language
en
Canonical
https://www.crawlly.ai/

Open Graph

url
https://www.crawlly.ai/
title
Crawlly AI - SEO, AEO, GEO and LLM Visibility Audits
site name
Crawlly AI
description
Measure SEO, AEO, GEO, and LLM visibility. Get scorecards, prioritized roadmaps, and role-focused actions that improve AI discoverability.

Technology

CDN
Vercel
Analytics
  • Google Tag Manager
Ads
  • Google Ads (DoubleClick)
Social widgets
  • YouTube Embed
Third-party hosts loaded (11)
  • assets.endorsely.com×1
  • fazier.com×1
  • googleads.g.doubleclick.net×1
  • i.ytimg.com×1
  • peerpush.net×1
  • static.doubleclick.net×1
  • viberank.dev×1
  • www.google.com×1
  • www.googletagmanager.com×1
  • www.nxgntools.com×1
  • www.youtube-nocookie.com×1

Social

Contact

Email

Registration

Registrar
Cloudflare, Inc
Created
2026-02-22
Expires
2028-02-22 644 days left
Updated
2026-02-27
Name servers
  • nelci.ns.cloudflare.com
  • gannon.ns.cloudflare.com

DNS records live

NS
  • gannon.ns.cloudflare.com
  • nelci.ns.cloudflare.com
MX
  • 1 aspmx.l.google.com
  • 10 alt3.aspmx.l.google.com
  • 10 alt4.aspmx.l.google.com
  • 5 alt1.aspmx.l.google.com
  • 5 alt2.aspmx.l.google.com
TXT
  • google-site-verification=eu_TzFIadv07NLXLx7jUQlmddT2GsAfGEx8M_jGwzzU
  • google-site-verification=2ubLdEvfFuot6CvRG-0d5QyHIspyNKFPkdSn5fyfnvk

Email authentication strong

SPF
v=spf1 include:_spf.google.com ~all
softfail (~all)
DMARC
v=DMARC1; p=none;
policy: none (monitoring only)
DKIM
  • google: v=DKIM1;k=rsa;p=MIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAuDS1LdYQmN+SLLGBNJoJVT/aWS9e9bpUBMadxWqgLxJkYgFjB56vFsp0mV+BmSzXTrGlu14sMzdKl8la…
selectors probed

Certificate (current)

R12
from 2026-04-25 to 2026-07-24
Expires in 66 days

HTTP security headers

Header hygiene 90/100 Checked live page: https://www.crawlly.ai/

present
  • strict-transport-security
  • content-security-policy
  • x-frame-options
  • x-content-type-options
  • referrer-policy
  • permissions-policy
findings
  • CSP allows unsafe inline scripts/styles
  • CSP uses wildcard sources
Header values
referrer-policy
strict-origin-when-cross-origin
x-frame-options
DENY
permissions-policy
camera=(), microphone=(), geolocation=()
x-content-type-options
nosniff
content-security-policy
default-src 'self'; script-src 'self' 'sha256-KBahJsXrPcfkfC90yMTtEP9kq3ENRHQUTienbEejCHg=' https://assets.endorsely.com https://www.googletagmanager.com https://challenges.cloudflare.com; style-src 'self' 'unsafe-inline' https://fonts.googleapis.com; connect-src 'self' https://*.supabase.co wss://*.supabase.co https://www.googletagmanager.com https://www.google-analytics.com https://region1.google-analytics.com https://tagassistant.google.com https://www.google.com; img-src 'self' data: https:; font-src 'self' data: https://fonts.gstatic.com; frame-src 'self' https://www.googletagmanager.com https://tagassistant.google.com https://challenges.cloudflare.com https://www.youtube-nocookie.com; base-uri 'self'; frame-ancestors 'none'; form-action 'self'
strict-transport-security
max-age=63072000; includeSubDomains; preload

Links to (5)

Linked from (1)