github neilotoole/sq v0.48.3

2 months ago

Small bugfix release.

Fixed

  • #415: The JSON ingester could fail due to a bug when a JSON blob landed on the edge of a buffer.
  • The JSON ingester wasn't able to handle the case where a post-sampling JSON field had a different kind from the kind determined by the sampling process. For example, let's say the sample size was 1000, and the field zip was determined to be of kind int, because values 0-1000 were all parseable as integers. But then the 1001st value was BX123, which obviously is not an integer. sq will now see the non-integer value, and alter the ingest DB schema to a compatible kind, e.g. text. This flexibility is powerful, but it does come at the cost of slower ingest speed. But that's a topic for another release.

Don't miss a new sq release

NewReleases is sending notifications on new releases.