Uncage

How to install Uncage

Every step written out. No terminal experience needed. Pick your setup.

README

Uncage is a local website cloner that captures rendered websites (Framer, Webflow, React SPAs, and static sites) into standalone, portable HTML, CSS, and JavaScript bundles. It runs 100% on your machine with zero cloud dependencies, complete with a multi-instance browser UI and a scriptable CLI.

[!IMPORTANT]

Static HTML Pivot

Uncage exclusively outputs clean, standalone Static HTML, CSS, and JavaScript. The experimental React TSX/JSX cloner is paused indefinitely. Read the pivot announcement for full context.

[!WARNING] Only clone sites you own or have permission to capture. Uncage executes target-site JavaScript in a local Playwright browser; exports may still require manual review for complex dynamic application behavior.

Key Features

Full Browser-Grade Capture: Uses Playwright with stealth plugins to execute client-side JavaScript, hydration, and animations before capture.
Local Web UI (localhost:8787): Real-time browser dashboard featuring a responsive 2x2 multi-instance grid with independent live logs.
Concurrent Queue: Export up to 3 websites simultaneously with automatic worker concurrency throttling.
One-Click .ZIP Streaming: Download your complete cloned site as a clean, ready-to-deploy .zip archive on the fly.
Automated Preview Servers: Cloned instances automatically launch their own preview server on ports in the 7000 series (http://localhost:7000, 7001...).
Persistent Sessions: Instances survive browser refreshes and tab switches without losing state.
Polite Crawling Engine: Built-in support for robots.txt, Crawl-delay, sitemap discovery, and configurable depth limits.

Installation

Option 1: Global CLI (Recommended)

npm install -g @nightteye/uncage

# Run anywhere
uncage https://example.com

Option 2: From Source

git clone https://github.com/Nightteye/uncage.git
cd uncage
npm install
npx playwright install chromium

# Launch the Web UI
npm start

Browser Web UI

The browser UI is the fastest way to clone and monitor websites:

[!CAUTION] No Web UI Contributions Accepted The design and functionality of the Web UI are considered final. Please do not submit issues, feature requests, or Pull Requests attempting to redesign, enhance, or alter the Web UI. We are strictly focusing on the core crawler and export pipeline. Any UI-focused PRs will be automatically closed.

Launch the UI:

npm start
# or specify a custom port:
npx @nightteye/uncage --port 9000

Open http://localhost:8787.
Paste the target URL and click Start Export.
Watch live terminal logs inside the instance card.
Click Preview ↗ to view your clone or .ZIP to download the archive.

CLI Reference

Basic Syntax

uncage [url] [options]

(Omit [url] to launch the web UI).

Options Table

Flag	Default	Description
`-o, --output <dir>`	Site hostname	Name of the subfolder under `output/`
`--ui`	`false`	Launch the Web UI even when a URL is supplied
`--port <number>`	`8787`	Port for the Web UI server
`--max-pages <number>`	`50`	Maximum number of pages to crawl
`--max-depth <number>`	Unlimited	Maximum link depth from the seed (0 = seed page only)
`--priority-only`	`false`	Crawl only the seed, navigation, and sitemap pages with priority ≥ 0.5
`--timeout <ms>`	`30000`	Page navigation timeout in milliseconds
`--no-headless`	`false`	Show the Chromium browser window while crawling
`--safe-mode`	`false`	Disable JavaScript execution; faster, but cannot render SPAs
`--skip-deps`	`false`	Skip recursive dynamic JavaScript module scanning
`--max-memory <mb>`	`0` (unlimited)	Memory cap for page buffers
`--allow-url <glob>`	None	Whitelist asset URLs matching pattern (can repeat)
`--block-url <glob>`	None	Blacklist asset URLs matching pattern (can repeat)
`--no-purge`	`false`	Skip PurgeCSS optimization (use if dynamic styles look broken)
`--keep-analytics`	`false`	Keep tracking scripts (Google Analytics, Segment, etc.)
`--ignore-robots`	`false`	Bypass robots.txt rules (use only with permission)

Common CLI Examples

# Clone only the homepage (single page):
uncage https://example.com --max-depth 0

# Clone with a custom output directory:
uncage https://example.com -o my-portfolio

# Watch the browser live during crawl (useful for debugging):
uncage https://example.com --no-headless

# Clone without CSS purging (retains all dynamic CSS classes):
uncage https://example.com --no-purge

Output Structure

All exports are written to output/<folder-name>/:

output/example.com/
├── index.html              # Clean root homepage
├── about.html              # Multi-page static route
├── contact.html            # Multi-page static route
├── assets/                 # Rewritten local assets
│   ├── css/                # Harvested stylesheets
│   ├── js/                 # Bundled scripts & ES modules
│   ├── images/             # Images (svg, png, webp, jpg)
│   ├── fonts/              # Downloaded webfonts (woff2, ttf)
│   └── media/              # Audio & video resources
├── asset-map.json          # Mapping of original remote URLs to local files
├── package.json            # Local preview runner
└── README.md               # Quick instructions for the exported site

Preview & Deployment

Local Preview

cd output/example.com
npm run preview

(If you used the Web UI, an automated preview server is already launched for you).

Deployment

Because the export is 100% static HTML, CSS, and JS, you can deploy the folder directly to any host:

Vercel: vercel output/example.com
Netlify: Drag-and-drop the folder into app.netlify.com/drop
Cloudflare Pages / GitHub Pages / AWS S3 / Nginx / Apache

Polite Crawling & robots.txt

By default, Uncage checks robots.txt before crawling:

Obeys User-agent: * and Uncage rules.
Respects Crawl-delay to prevent server rate limiting.
Automatically discovers sitemaps from robots.txt and /sitemap.xml.
If a seed URL is disallowed, the crawl halts gracefully before browser launch.

Troubleshooting

Styles missing or page looks unstyled: Run with --no-purge. PurgeCSS may have removed classes generated dynamically by client-side scripts.
Missing deeper pages: The default cap is 50 pages. Increase --max-pages 200 or adjust --max-depth.
Crawl is slow: Use --skip-deps to skip deep transitive JS module scanning, or --safe-mode for simple sites.
Port 8787 already in use: Start with --port 9000.
Playwright browser missing: Run npx playwright install chromium.

Documentation & Links

Wiki: Full guides, architecture breakdown, and FAQs
Security Policy: Threat model and vulnerability reporting
Code of Conduct: Community standards and guidelines
npm Package: Official npm registry page

Development

npm run typecheck       # TypeScript checks (strict)
npm test                # Run Vitest test suite (96 tests)
npm run test:coverage   # Coverage report

License

Distributed under the MIT License.

Flag

Default

Description

-o, --output <dir>

Site hostname

Name of the subfolder under output/

--ui

false

Launch the Web UI even when a URL is supplied

--port <number>

8787

Port for the Web UI server

--max-pages <number>

50

Maximum number of pages to crawl

--max-depth <number>

Unlimited

Maximum link depth from the seed (0 = seed page only)

--priority-only

false

Crawl only the seed, navigation, and sitemap pages with priority ≥ 0.5

--timeout <ms>

30000

Page navigation timeout in milliseconds

--no-headless

false

Show the Chromium browser window while crawling

--safe-mode

false

Disable JavaScript execution; faster, but cannot render SPAs

--skip-deps

false

Skip recursive dynamic JavaScript module scanning

--max-memory <mb>

0 (unlimited)

Memory cap for page buffers

--allow-url <glob>

None

Whitelist asset URLs matching pattern (can repeat)

--block-url <glob>

None

Blacklist asset URLs matching pattern (can repeat)

--no-purge

false

Skip PurgeCSS optimization (use if dynamic styles look broken)

--keep-analytics

false

Keep tracking scripts (Google Analytics, Segment, etc.)

--ignore-robots

false

Bypass robots.txt rules (use only with permission)

# Clone only the homepage (single page): uncage https://example.com --max-depth 0 # Clone with a custom output directory: uncage https://example.com -o my-portfolio # Watch the browser live during crawl (useful for debugging): uncage https://example.com --no-headless # Clone without CSS purging (retains all dynamic CSS classes): uncage https://example.com --no-purge

output/example.com/ ├── index.html # Clean root homepage ├── about.html # Multi-page static route ├── contact.html # Multi-page static route ├── assets/ # Rewritten local assets │ ├── css/ # Harvested stylesheets │ ├── js/ # Bundled scripts & ES modules │ ├── images/ # Images (svg, png, webp, jpg) │ ├── fonts/ # Downloaded webfonts (woff2, ttf) │ └── media/ # Audio & video resources ├── asset-map.json # Mapping of original remote URLs to local files ├── package.json # Local preview runner └── README.md # Quick instructions for the exported site