Overview
Katana is a configurable web crawler from ProjectDiscovery. It supports standard and headless crawling modes and can help map routes, links and endpoints that should be reviewed during an application security assessment.
Key features
Web crawling; JavaScript-aware options; scope controls; JSON output; pipeline support.
Install & first run
# Go
go install github.com/projectdiscovery/katana/cmd/katana@latest
export PATH="$PATH:$(go env GOPATH)/bin"
# Crawl a target three levels deep, parsing JavaScript for endpoints
katana -u https://lab.example.com -d 3 -jc
# Store every URL found for later testing
katana -u https://lab.example.com -d 2 -silent -o urls.txt
# Feed a list of hosts instead of one URL
katana -list hosts.txt -silent -d 2
-jc parses JavaScript and -kf all keeps known files such as robots.txt and sitemap.xml. Docs: https://docs.projectdiscovery.io/tools/katana/overview
Real-world example
Crawl a staging application within an approved scope to build a route inventory for manual review and controlled testing.
Common questions
Should every discovered URL be tested automatically?
No. Review scope and avoid state-changing or destructive requests without approval.
Crawling or parsing?
Both in one pass: standard mode follows links found in HTML, -jc also extracts endpoints from inline and external JavaScript.
Why so few results?
The site may be JS-rendered. Add -headless to run a real browser, which is slower but sees what a user sees.
Does it respect scope?
Only what you give it. Use -fs to filter out off-domain URLs so you do not wander outside the engagement scope.
Related tools
dnsx
Resolve and inspect DNS records at scale in a pipeline: A/AAAA/CNAME lookups, wildcard filtering and custom resolvers. Free, open source, Go.
httpx
Turn a host list into live HTTP services: status codes, titles, TLS details, headers and detected tech in one fast pass. Free, Go CLI.
OWASP Amass
Map an organisation's external attack surface with passive DNS, certificate and WHOIS correlation. Free, open source, an OWASP project.
Keep exploring: browse every assessment phase in the Pentest Hub.
Authorized testing only — only ever test systems you own or have explicit written permission to assess.
