ar-io/ar-io-node r63

Release 63

on GitHub

This is an optional release focusing on operator tooling and observability improvements. Key additions include a data retrieval testing tool for gateway validation, separate credentials support for legacy S3 chunk sources, and OTEL-Winston integration for distributed trace correlation in logs.

Added

• CDB64 Extension Support: Accept .cdb64 file extension in addition to .cdb for CDB64 root TX index files

• Data Retrieval Testing Tool: New CLI tool for testing data item retrieval from a gateway using TX/data item IDs from a CSV file (tools/test-data-retrieval)

  • Sequential mode: streams through file line by line
  • Random mode: O(1) random byte seeking, no file scan required
  • Continuous mode: runs indefinitely until Ctrl+C, writes JSON results to file
  • Configurable concurrency for parallel requests
  • Comprehensive statistics: success/failure rates, response time percentiles (p50/p95/p99), cache hit rates, status codes, bytes transferred

• Separate Credentials for Legacy S3 Chunk Source: Add ability to configure separate AWS credentials for the legacy S3 chunk data source, enabling access to S3 buckets in different AWS accounts

  • LEGACY_AWS_S3_ACCESS_KEY_ID: AWS access key for legacy S3 bucket
  • LEGACY_AWS_S3_SECRET_ACCESS_KEY: AWS secret key for legacy S3 bucket
  • LEGACY_AWS_S3_REGION: AWS region (required when using separate credentials)
  • LEGACY_AWS_S3_ENDPOINT: Custom endpoint (optional)

• Docker Compose Environment Variables: Expose additional environment variables in docker-compose.yaml for legacy chunk sources and chunk rebroadcasting

• OTEL Winston Integration for Trace ID Correlation: Automatic injection of OpenTelemetry trace context (trace_id, span_id, trace_flags) into all Winston log entries, enabling correlation of logs with distributed traces

Fixed

• Fix missing parentSpan parameter in handleRangeRequest calls for proper OTEL trace hierarchy in range requests

Docker Images

• ghcr.io/ar-io/ar-io-envoy:4755fa0a2deb258bfaeaa91ba3154f1f7ef41fda
• ghcr.io/ar-io/ar-io-core:11f7b981c02a2d3ac27ee80dda7b06dff2ad904b
• ghcr.io/ar-io/ar-io-clickhouse-auto-import:4512361f3d6bdc0d8a44dd83eb796fd88804a384
• ghcr.io/ar-io/ar-io-litestream:be121fc0ae24a9eb7cdb2b92d01f047039b5f5e8