crawlbyte.ai

.ai crawl

First seen 2026-05-06 · Last seen 2026-05-13 · ok HTTP/1.1 200 248 ms crawled 2026-05-13

US · 172.67.141.144 · AS13335 Cloudflare, Inc.

Reputation 95/100 weak security headers

sector tech type app saas

HTML metadata

Title
Crawlbyte | Built by Builders for Smarter Web Scraping
Description
Scrape anything, anywhere. Fast, flexible, and built to scale. Crawlbyte delivers clean, structured data from any public website with the reliability and speed.
Language
en
Canonical
https://crawlbyte.ai

Open Graph

url
https://crawlbyte.ai
title
Crawlbyte | Built by Builders for Smarter Web Scraping
locale
en_US
site name
Crawlbyte
description
Scrape anything, anywhere. Fast, flexible, and built to scale. Crawlbyte delivers clean, structured data from any public website with the reliability and speed.

Technology

CDN
Cloudflare
CMS
Next.js
Analytics
  • Google Tag Manager

Third-party hosts loaded (1)

  • www.googletagmanager.com×2

Social

Registration

Registrar
GoDaddy.com, LLC
Created
2025-04-18
Expires
2027-04-18 334 days left
Updated
2025-04-28
Name servers
  • cris.ns.cloudflare.com
  • ligia.ns.cloudflare.com

DNS records live

NS
  • cris.ns.cloudflare.com
  • ligia.ns.cloudflare.com
MX
  • 1 aspmx.l.google.com
  • 10 alt3.aspmx.l.google.com
  • 10 alt4.aspmx.l.google.com
  • 5 alt1.aspmx.l.google.com
  • 5 alt2.aspmx.l.google.com
TXT
  • google-site-verification=BoQ4aWBto6own4afMW6bEqwLCCZrklqBIRcTU0r5VrY
  • google-site-verification=c58t39QvYzoEzJJabdvyuztQCT_2AmRGFvTTAUMSDuo

Email authentication strong

SPF
v=spf1 include:_spf.google.com -all
strict (-all)
DMARC
v=DMARC1; p=reject; adkim=r; aspf=r; rua=mailto:dmarc_rua@onsecureserver.net;
policy: reject (enforced)
DKIM
no key found at common selectors

Certificate (current)

WE1
from 2026-05-05 to 2026-08-03
Expires in 76 days

HTTP security headers

Header hygiene 30/100 Checked live page: https://crawlbyte.ai/

findings
  • missing HSTS
  • missing Content Security Policy
  • missing frame protection
  • missing content type protection
  • missing Referrer Policy
  • missing Permissions Policy

Links to (3)

Linked from (1)