this post was submitted on 25 Mar 2025
27 points (88.6% liked)

Selfhosted

45467 readers
365 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 2 years ago
MODERATORS
 

For years I've on and off looked for web archiving software that can capture most sites, including ones that are "complex" with lots of AJAX and require logins like Reddit. Which ones have worked best for you?

Ideally I want one that can be started up programatically or via command line, an opens a chromium instance (or any browser), and captures everything shown on the page. I could also open the instance myself and log into sites and install addons like UBlock Origin. (btw, archiveweb.page must be started manually).

you are viewing a single comment's thread
view the rest of the comments
[–] N0x0n@lemmy.ml 5 points 1 week ago (1 children)

For reddit, SingleFile HTML pages can be 20MB per file ! Which is huge for a simple discussion...

To reduce that bloated but still relevant site, redirect to any still working alternative like https://github.com/redlib-org/redlib or old reddit and decrease your file to less than 1MB/file.

[–] klangcola@reddthat.com 2 points 1 week ago (1 children)

SingleFile provides a faithful representation of the original webpage, so bloated webpages are indeed saved as bloated html files.

On the plus side you're getting an exact copy, but on the downside an exact copy may not be necessary and takes a huge amount of space.

[–] N0x0n@lemmy.ml 2 points 1 week ago* (last edited 1 week ago)

You're right ! And because OP want to archive Reddit pages I propose an alternative to reduce that bloated site to a minimum :).

From my tests, it can go from 20MB to 700Bytes. IMO still big for a chat conversation but the readability from the alternative front-end is a + !