Show HN: Kage – Shadow any website to a single binary for offline viewing

Kage is a new open-source tool that clones websites into a folder with all scripts removed, allowing offline browsing without network calls. It uses headless Chrome to capture the site’s final rendered state, making it ideal for offline access and long-term preservation.

Kage clones a website by opening each page in a headless Chrome browser, waiting for the page to fully load, then capturing the DOM and assets like CSS, images, and fonts. It strips out all JavaScript, ensuring the resulting offline copy looks like the live site but runs no code.

The tool can serve the cloned site locally, pack it into a single ZIM file (a format used by offline content projects like Kiwix), or create a self-contained executable that runs the site independently. It supports various commands for cloning, serving, and packing sites, and can be used via command line or Docker containers.

Kage is designed to address common issues with saving web pages, such as pages that break over time or attempt to phone home, by providing a static, script-free version that is faithful to the original appearance.

Why Offline Website Cloning Matters

Kage’s ability to create reliable, script-free offline copies of websites addresses long-standing issues with web content preservation, especially for educational, archival, or remote use. It ensures that users can access content long after the original site changes or goes offline, which is vital for research, digital preservation, and scenarios with limited internet access.

Additionally, by packing sites into single files or executables, Kage simplifies sharing and distribution, making it easier for individuals and organizations to archive web content securely and portably.

DeskFX Free Audio Effects & Audio Enhancer Software [PC Download]

Transform audio playing via your speakers and headphones

AmazonView Latest Price

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Background on Offline Web Cloning and Preservation

Traditional methods of saving web pages, such as ‘Save As,’ often result in incomplete or non-functional copies over time due to dynamic scripts, tracking, or server dependencies. Existing tools like HTTrack or Wget create static copies but may not fully emulate the live site’s final state, especially if scripts are involved.

Kage builds on the concept of using headless browsers to capture the exact rendered state of a page, addressing issues of dynamic content and scripts. Its development reflects ongoing efforts in digital preservation and offline content accessibility, with a focus on fidelity and simplicity.

“Kage drives a real browser, so it needs Chrome or Chromium on the host. It finds a system install on its own; point it somewhere specific with –chrome or the KAGE_CHROME environment variable.”

— Kage developer (via Hacker News)

Remaining Questions About Kage’s Capabilities

While Kage’s functionality is well-documented, it is not yet clear how well it handles highly dynamic sites or sites with complex JavaScript frameworks. Its effectiveness on modern single-page applications or sites with lazy-loaded content is still being tested, and performance metrics for large sites are not publicly available.

Additionally, the long-term stability of the generated offline copies, especially when packed into executables or ZIM files, remains to be seen as users experiment with different site types and sizes.

Next Steps for Kage Development and Adoption

Developers and users are expected to test Kage on diverse websites to evaluate its fidelity and performance, especially on complex, dynamic sites. Future updates may improve handling of JavaScript-heavy pages and optimize packing formats.

The project’s maintainers plan to expand documentation, add features like incremental updates, and integrate with offline content platforms such as Kiwix. Community feedback will likely shape future development and broader adoption.

Key Questions

Can Kage clone any website?

Kage can clone most websites that can be rendered in Chrome, but its effectiveness may vary with highly dynamic or JavaScript-heavy sites.

Does Kage preserve interactive elements?

No, Kage strips out all scripts, so interactive elements relying on JavaScript will not function in the offline copy.

What formats can Kage pack websites into?

Kage can create ZIM files, which are used for offline Wikipedia and other large content repositories, or generate self-contained executable files that run the site locally.

Is Kage suitable for long-term digital preservation?

Yes, by creating static, script-free copies, Kage offers a reliable method for preserving website content over time.

What are the system requirements to run Kage?

Kage requires Chrome or Chromium on the host system, or can run via a Docker container that includes Chromium.

Source: Hacker News