CRAWLER POLICY
Legitimate search and AI crawlers may index the public marketing and documentation site. Internal monitoring and administrative routes are excluded and independently protected.
Other agents receive no explicit endorsement. Public pages remain ordinary web resources, while non-public paths stay excluded and protected.
Public marketing, documentation, trust, and contact pages are available for normal indexing. /internal/, API, build-asset, console, and private operational paths are not public content.
robots.txt is advisory. Private endpoints remain authenticated and return no public navigation or sitemap entries.
Server-side operational metrics classify crawler families only from the claimed User-Agent string. K-Shield does not describe that signal as verified identity.