github iipc/jwarc v0.5.0

latest releases: v0.37.0, v0.36.0, v0.35.0...
7 years ago

New features

  • WarcTool now includes a recorder command which runs a recording proxy server.
  • WarcTool now includes a record command which captures a page using headless Chrome.
  • MessageBody now supports random access (a variant implementing SeekableByteChannel is returned) when the underlying channel does and there's no chunked encoding or compression.
  • HttpResponse now handles chunked encoding.

Bug fixes

  • Percent (%) is now accepted by the parser in URLs (HTTP requests, ARC files).
  • HttpResponse was calculating the body length incorrectly causing it to be truncated.
  • Problem headers are stripped during replay.
  • The rewriting JavaScript is now not injected in proxy mode.

WarcServer and WarcRecorder are still highly experimental and so are currently only available through the command-line tool. I intend to give them a public API in a future version jwarc. If you'd like to use them in the meantime please treat them as examples: copy and paste and modify to suit your needs.

Don't miss a new jwarc release

NewReleases is sending notifications on new releases.