This release focuses on enhancing security, file integrity, and the robustness of the core ingestion and indexing pipeline. Several key features were added to Open Archiver to meet compliance and security requirements.
Highlights
- File Encryption at Rest: You can now enable AES-256 encryption for all archived data, including email files and attachments, ensuring your data is secure on disk.
- Data Integrity Verification: A new integrity reporting feature allows you to verify that your archived data has not been altered or corrupted since it was ingested.
- Asynchronous Indexing Pipeline: The email indexing process has been completely refactored into a dedicated background job, dramatically improving the speed and reliability of the ingestion process.
- IMAP Connector Stability: The IMAP connector has been overhauled to provide more stable connections and better error handling, ensuring more reliable ingestion from IMAP sources.
New Features
- File Encryption: All archived emails and attachments can now be encrypted at rest using AES-256. This can be enabled via a new environment variable, providing an essential layer of security. #187
- Data Integrity Reporting: Open Archiver now calculates and stores a SHA256 hash for every archived email and attachment. A new API endpoint allows you to trigger a verification process that recalculates these hashes and compares them against the stored values, confirming the integrity of your archive. This feature is also available via the UI. #187
- Deletion Protection: A new instance-wide setting (
ENABLE_DELETIONenvironment variable) can be configured to disable the deletion of emails and ingestion sources. #187 - Background Job Monitoring UI: A web-based dashboard has been added for monitoring and managing background jobs (e.g., ingestion, indexing). This gives administrators better visibility into the system's asynchronous operations and helps with troubleshooting. 42b0f6e
- Option to Archive Junk/Trash: The
ALL_INCLUSIVE_ARCHIVEenvironment variable has been added to allow the archiver to include emails from "Junk" and "Trash" folders, which are skipped by default. #187
Improvements
- IMAP Connector Stability: The IMAP connector has been significantly refactored to improve connection management and error handling. The connector is now more resilient to network issues and will automatically re-establish connections when they become unstable. 7ceb85c
- Scoped Attachment Deduplication: The attachment deduplication logic is now scoped on a per-ingestion-source basis. This ensures that attachments with the same content hash but from different sources are handled correctly, preventing incorrect linking in multi-source environments.
- Responsive UI: The main navigation menu, search results pagination, and the new jobs dashboard have been updated to be fully responsive, improving the user experience on mobile and tablet devices. 6e1ebbb
- CORS Configuration: CORS handling has been simplified with the introduction of the
APP_URLenvironment variable, resolving CORS issues during upload. #52 #120
Bug Fixes
- Fixed an issue where the sync-cycle state was not correctly merged, which could cause errors when no successful jobs were present in a cycle.
Full Changelog: v0.3.4...v0.4.0