Even though not much in the package itself changed there are major new additions to the database itself, these are the main topics:
EXPANDED METADATA
Added hundreds of thousands of new entries across Equities, ETFs, Funds, Indices, Currencies, and Cryptocurrencies. These are fields such as business summaries, sectors, industry groups, and categories for precise filtering and screening.This goes alongside new company IPOs. There now also exists a delisted flag that indicates whether the company is delisted or not.
DATA QUALITY IMPROVEMENTS
Resolved conflicting company names, refined existing categorizations, and completely re-evaluated existing mappings. This includes adding over 15,000 new ISIN and CUSIP codes to significantly improve database precision. Furthermore, the equities, funds and etfs datasets now have been split up in exchanges (before compression) so PRs are easily reviewable.
IMPROVED ROBUSTNESS
Upgraded the core Python package to handle edge cases and invalid inputs gracefully, ensuring a seamless integration with tools like the Finance Toolkit. Furthermore, there exists now a delisted filter that automatically filters out companies that have the delisted flag set to True.
What's Changed
- Bump fonttools from 4.58.5 to 4.61.0 by @dependabot[bot] in #117
- fix: correct and enrich 229 ISIN codes in equities database by @AlfaStake in #126
- Add ISIN codes for ETFs by @AlfaStake in #124
- Bump pillow from 11.3.0 to 12.1.1 by @dependabot[bot] in #123
- Bump protobuf from 6.31.1 to 6.33.5 by @dependabot[bot] in #121
- Added SCMB by @pettijohn in #135
- Added some missing currencies and names from SEC Data by @pettijohn in #136
- Backfill ~4.5k CUSIP values in equities.csv from SEC 13F filings by @dokson in #138
- Backfill ISIN/CUSIP + fix placeholder names from yfinance by @dokson in #139
- Fix 1,084 placeholder names + 614 country + 35 exchange from yfinance by @dokson in #141
- Replace 725 boilerplate summaries with yfinance longBusinessSummary by @dokson in #142
- ASE exchange fix + ISIN/FIGI backfill from public data by @dokson in #143
- Fill 17,252 empty exchange + market cells in equities.csv by @dokson in #145
- Baseline test improvements: snapshots, local data, docstrings, infra cleanup by @dokson in #140
- Test infra follow-ups #2: library invariants, helpers.py coverage 45→86%, cov in CI by @dokson in #146
- ETFs/Funds data quality + cross-asset invariants + equities country/ISIN backfill + SPAC cleanup + README stats by @dokson in #147
- Add mic_code (ISO 10383 MIC) column by @dokson in #149
- Enrich composite_figi and fill mic on new tickers by @dokson in #150
- Enrich FIGI via OpenFIGI, add 709 tickers (#119), fix README stats workflow by @dokson in #151
- Added delisted column into the database and split up the equities, funds and etfs files by @JerBouma
New Contributors
- @AlfaStake made their first contribution in #126
- @pettijohn made their first contribution in #135
- @dokson made their first contribution in #138
Full Changelog: 2.3.1...2.4.0