Katana logo

Katana

Crawl web applications for URLs and endpoints, parsing JavaScript and known files so you see the routes a user can really reach. Free, Go CLI.

Overview

Katana is a configurable web crawler from ProjectDiscovery. It supports standard and headless crawling modes and can help map routes, links and endpoints that should be reviewed during an application security assessment.

Key features

Web crawling; JavaScript-aware options; scope controls; JSON output; pipeline support.

Install & first run


# Go
go install github.com/projectdiscovery/katana/cmd/katana@latest
export PATH="$PATH:$(go env GOPATH)/bin"

# Crawl a target three levels deep, parsing JavaScript for endpoints
katana -u https://lab.example.com -d 3 -jc

# Store every URL found for later testing
katana -u https://lab.example.com -d 2 -silent -o urls.txt

# Feed a list of hosts instead of one URL
katana -list hosts.txt -silent -d 2

-jc parses JavaScript and -kf all keeps known files such as robots.txt and sitemap.xml. Docs: https://docs.projectdiscovery.io/tools/katana/overview

Real-world example

Crawl a staging application within an approved scope to build a route inventory for manual review and controlled testing.

Common questions

Should every discovered URL be tested automatically?

No. Review scope and avoid state-changing or destructive requests without approval.

Crawling or parsing?

Both in one pass: standard mode follows links found in HTML, -jc also extracts endpoints from inline and external JavaScript.

Why so few results?

The site may be JS-rendered. Add -headless to run a real browser, which is slower but sees what a user sees.

Does it respect scope?

Only what you give it. Use -fs to filter out off-domain URLs so you do not wander outside the engagement scope.

dnsx

Resolve and inspect DNS records at scale in a pipeline: A/AAAA/CNAME lookups, wildcard filtering and custom resolvers. Free, open source, Go.

httpx

Turn a host list into live HTTP services: status codes, titles, TLS details, headers and detected tech in one fast pass. Free, Go CLI.

OWASP Amass

Map an organisation's external attack surface with passive DNS, certificate and WHOIS correlation. Free, open source, an OWASP project.


Keep exploring: browse every assessment phase in the Pentest Hub.

Authorized testing only — only ever test systems you own or have explicit written permission to assess.