ArchiveBox/ArchiveBox v0.8.0-rc

v0.8.0-rc: New site logins setup flow with noNVC, Django 4.2, new RSS & JSON parsers, new config options

on GitHub

WIP pre-release for the upcoming ArchiveBox v0.8.0 release.

Try this release early using docker or pip:

# with docker (pre-built)
docker pull archivebox/archivebox:dev
# with docker (built from source)
docker build -t archivebox:dev https://github.com/ArchiveBox/ArchiveBox.git#dev
# with pip (built from source)
pip install 'git+https://github.com/pirate/ArchiveBox@dev'

To use the new noVNC container to view & control the ArchiveBox browser remotely, grab the updated docker-compose.yml and follow these instructions.

Highlights

• upgrade to Django 4.2 (thanks @jimwins!)
• add new _EXTRA_ARGS options (thanks @benmuth!)
• add new generic_jsonl parser (thanks @jimwins!)
• switch to feedparser for RSS parsing (thanks @jimwins!)
• remember Snapshot detail page header expanded/collapsed state
• allow more restrictive NFS permission coercion on ./data/archive
• check /, /data, and /data/archive in Docker and warn if running low on disk space
• fix /browsers chown on Docker armv7 entrypoint failing
• disable chrome automatic self-updating when running headless
• Add ability to populate is_staff and is_superuser flags during LDAP first auth
• add gitea and other domains to default GIT_DOMAINS list to run git archiving on
• bump yt-dlp and singlefile versions
• fix RESOLUTION being ignored when using Chrome headless in Docker
• fix sorting by Size / Files in the Admin Snapshots list page UI
• fix spinner icon showing on some Snapshots instead of favicon when only a few extractors are enabled
• fix yt-dlp sometimes failing to archive media due to filenames being too long or containing special characters
• fix wget extractor not finding output when :80 or :443 port is present in the original URL
• fix /var/spool/cron/crontabs permissions when mounting it via Docker

• COMING SOON: new sci-dl scientific paper downloader being worked on by @benmuth

What's Changed

• Fallback to not chown'ing ./data/archive dir if it's a network mount that prevents ownership changes by @gnattu in #1312
• Make "DOCS" link in navigation bar open in new tab by @speerer in #1323
• Fixes #1193 Bug: Search sometimes shows the same snapshot twice by @neel-suthar in #1330
• Fix for Bug: Search sometimes shows the same snapshot twice #1193 by @neel-suthar in #1331
• Show the upgrade notification only in specific views by @benmuth in #1314
• ability to populate is_staff and is_superuser flags at LDAP authentication by @vladimirdulov in #1335
• Update README.md by @pirate in #1336
• Fix generic_json parser by @jimwins in #1365
• Make it a little easier to run specific tests by @jimwins in #1371
• Add COOKIES_FILE support for singlefile extractor by @naoph in #1372
• Update README.md Browser Extension link by @rdela in #1374
• Use feedparser for RSS parsing by @jimwins in #1362
• Use COOKIES_FILE to fetch page titles by @benmuth in #1364
• Add _EXTRA_ARGS for various extractors by @benmuth in #1360
• Add generic_jsonl parser by @jimwins in #1370
• Revise md section not formatting properly in html by @n-hebert in #1382
• Update to Django 4.2.x by @jimwins in #1388

New Contributors

• @gnattu made their first contribution in #1312
• @speerer made their first contribution in #1323
• @neel-suthar made their first contribution in #1330
• @jimwins made their first contribution in #1365
• @naoph made their first contribution in #1372
• @rdela made their first contribution in #1374
• @n-hebert made their first contribution in #1382

Full Changelog: v0.7.2...v0.8.0-rc