indexo.dev

anycrawl.dev

.dev crawl

First seen 2026-04-19 · Last seen 2026-04-19 · ok HTTP/1.1 200 3804 ms crawled 2026-05-13

US · 104.21.13.155 · AS13335 Cloudflare, Inc.

Reputation 87/100 weak security headers no dmarc policy

Classifying

HTML metadata

Title
AnyCrawl - Turn Web into AI | AI Web Crawler/Scraping API
Description
Turn web into LLM-ready data. High-performance API that transforms any website into structured, clean data optimized for AI and large language models.
Language
en
Canonical
https://anycrawl.dev

Open Graph

url
https://anycrawl.dev
title
AnyCrawl - AI-Powered Web Scraping API
locale
en_US
site name
AnyCrawl
description
Transform any website into structured, clean data optimized for AI and large language models. Enterprise-grade web scraping API.

Technology

CDN
Cloudflare
CMS
Next.js
Analytics
  • Cloudflare Insights
  • Google Analytics
  • Google Tag Manager
  • Microsoft Clarity
Third-party hosts loaded (7)
  • static.cloudflareinsights.com×2
  • www.googletagmanager.com×2
  • js.stripe.com×1
  • randomuser.me×1
  • umami.nicelab.top×1
  • www.clarity.ms×1
  • www.google-analytics.com×1

DNS records live

NS
  • diva.ns.cloudflare.com
  • zac.ns.cloudflare.com
MX
  • 68 route2.mx.cloudflare.net
  • 90 route3.mx.cloudflare.net
  • 93 route1.mx.cloudflare.net
TXT
  • ahrefs-site-verification_847829367796cc49d3736b27b3181bcda16ff09e3379ad8be8bcba578d6bd71d
  • google-site-verification=0Y6Y8IFffboy6lHFqfQwdqSNvfr-JQBslE9rinfRVdw
  • ahrefs-site-verification_7b350cf650a16ced2f33550b436f77c113681c465b6d6e7805489b3ca761e877

Email authentication weak

SPF
v=spf1 include:_spf.mx.cloudflare.net ~all
softfail (~all)
DMARC
not published
DKIM
no key found at common selectors

Certificate (current)

WE1
from 2026-05-03 to 2026-08-01
Expires in 74 days

Full certificate history on crt.sh ↗

HTTP security headers

Header hygiene 40/100 Checked live page: https://anycrawl.dev/

present
  • x-content-type-options
findings
  • missing HSTS
  • missing Content Security Policy
  • missing frame protection
  • missing Referrer Policy
  • missing Permissions Policy
Header values
x-content-type-options
nosniff

Linked from (1)