This release revamps the way we handle dataset metadata in yente in order to make it easier to load and update non-OpenSanctions datasets. It is a breaking change because it modifies the format of the manifest file (manifest.yml). If you're running yente with the default manifest file, the changes will not affect you.
Updating your manifest.yml
In order to update your custom manifest for yente 3.0.0, you need to change the external section into a catalogs section like this:
schedule: null
# old:
external:
url: "https://data.opensanctions.org/datasets/latest/index.json"
scope: all
# new:
catalogs:
- url: "https://data.opensanctions.org/datasets/latest/index.json"
scope: all
resource_name: entities.ftm.json
datasets: []The cool thing about this is that you can now add extra catalogs. Try putting in https://data.opensanctions.org/contrib/graph/catalog.json and it'll index a bunch of non-OpenSanctions data :)
What's Changed
- Revamp metadata architecture by @pudo in #188
- Bump structlog from 22.1.0 to 22.3.0 by @dependabot in #184
- Bump orjson from 3.8.2 to 3.8.3 by @dependabot in #189
- Bump nomenklatura from 2.7.4 to 2.7.5 by @dependabot in #191
- Bump elasticsearch[async] from 8.5.2 to 8.5.3 by @dependabot in #192
Full Changelog: v2.2.1...v3.0.0