Two small but significant changes to the Datastore API, along with minor housekeeping.
There has been until now a hard limit of 500 rows on any datastore API request. This was overly conservative, and degrades performance on larger CSV downloads. There is no objective, optimal row limit as the tradeoff between performance and load depends on a specific site's server resources and the complexity of individual datasets. The row limit is now completely configurable, and the onus is on the site maintainer to select a limit that will be both performant and safe.
Datastore API responses also include a "schema" object that describes the table(s) being queried. However, the code building these responses was unable to distinguish between different column types in a standard MySQL datastore table. They will now provide the full column information, following the Drupal Schema API. (This standard was the basis for the existing object, and although it is arguably not the best match for this use-case, staying with it ensures backwards-compatibility for the most part.)
Added
Changed
- Remove max from row limit setting, combine forms (#3693)
- Upgrade to latest dkan-tools in CI (#3687)
- Remove preview button for metastore forms (#3520)