crawlably.com

.com crawl

First seen 2026-04-12 · Last seen 2026-05-05 · ok HTTP/1.1 200 7718 ms crawled 2026-05-05

IN · 139.59.4.114 · AS14061 DigitalOcean, LLC

Reputation 95/100 weak security headers

sector tech type blog

HTML metadata

Title
Serve fully rendered version of your site to bots - Crawlably
Language
en
Generator
Hugo 0.89.4
Canonical
https://www.crawlably.com/

Technology

Server
nginx
CMS
Hugo

Third-party hosts loaded (1)

  • stats.punits.dev×1

Registration

Registrar
NameCheap, Inc.
Created
2025-05-09
Expires
2027-05-09 354 days left
Updated
2026-04-25
Name servers
  • dns1.registrar-servers.com
  • dns2.registrar-servers.com

DNS records live

NS
  • dns1.registrar-servers.com
  • dns2.registrar-servers.com
MX
  • 10 eforward1.registrar-servers.com
  • 10 eforward2.registrar-servers.com
  • 10 eforward3.registrar-servers.com
  • 15 eforward4.registrar-servers.com
  • 20 eforward5.registrar-servers.com
TXT
  • google-site-verification=r_fzJtQG29fq-_eVPTHCRVns10v4J17zC2VmusTWAcU
  • v=spf1 include:spf.efwd.registrar-servers.com ~all

Certificate (current)

R12
from 2026-03-07 to 2026-06-05
Expires in 17 days

HTTP security headers

Header hygiene 30/100 Checked live page: https://www.crawlably.com/

findings
  • missing HSTS
  • missing Content Security Policy
  • missing frame protection
  • missing content type protection
  • missing Referrer Policy
  • missing Permissions Policy

Linked from (1)