superduper-io/superduper 0.1.4 on GitHub

What's Changed

Update README.md by @thgnw in #1464
Update README.md by @thgnw in #1466
Update README.md by @fnikolai in #1467
Update README.md by @fnikolai in #1472
[DOC]: Added missing word in the blog by @Sohaib90 in #1491
Removed release note in README.md by @thgnw in #1501
simplify the testing of sql databases by @fnikolai in #1494
Add public api annotations by @kartik4949 in #1506
Update README.md by @eltociear in #1516
Remove redundant arguments from components using kw_only=True by @blythed in #1495
Minor typo in README.md by @kartik4949 in #1517
Update notebooks, docs. Co-authored-by: Saavrm26 by @fazlulkarimweb in #1523
Add embbed vector_search in uri by @kartik4949 in #1520
Update readme videos by @fnikolai in #1534
Update images of videos on readme by @guerra2fernando in #1535
Localise import for compute in build by @kartik4949 in #1539
Add Monitoring and Logging on the testing environment by @fnikolai in #1530
Append superduperdb folder in cdc tokens by @kartik4949 in #1538
Fix clickhouse and optimize compatibility when using SQL link by @jieguangzhou in #1496
add mysql to db integration by @therohitdas in #1540
Fix bugs in creating stack of functionality by @blythed in #1541
feat: add Jina integration extension by @JoanFM in #1533
indent faq by @fnikolai in #1542
Add Japanese README by @eltociear in #1537
Modified ja readme by @chrono-k in #1567
Feature/additional parameters options predict by @blythed in #1546
Python package references are updated in sql.md by @muralidharand in #1570
Add ray compute by @kartik4949 in #1526
feat: Add Jina AI logos and API integrations by @saahil in #1575
Add ref links in question_the_docs example by @jieguangzhou in #1576
Fix snowflake bugs and create use-case by @blythed in #1579
Fix: Update broken Edit link in the documentation by @Manmit124 in #1582
Chnage What is section in README.md by @thgnw in #1583
Change what is section README.md by @thgnw in #1584
Minor change in what is section in README.md by @thgnw in #1585
Artifacts from URIs and stack refactorings by @blythed in #1586
fix 'Edit this page' URLs by @aarya626 in #1581
update edit link by @fnikolai in #1587
Updated FAQ by @fazlulkarimweb in #1590
Update snowflake-example.md by @fnikolai in #1588
Update intro.md by @fnikolai in #1591
Updating typo by @fazlulkarimweb in #1595
Fix question the docs data link by @jieguangzhou in #1596
Add local mode in ray by @kartik4949 in #1612
Update README_zh.md by @EdwardLi-coder in #1617
Add more docs in vector search by @kartik4949 in #1608
Remove pydantic from config by @kartik4949 in #1621
Minor typo in docstrings by @kartik4949 in #1625
Support LLM Inference (vLLM, OpenAI format interface) by @jieguangzhou in #1607
Add use cases to docs navbar by @Aditya-76 in #1599
Added Mongodb Atlas vector searcher by @kartik4949 in #1624
Ref/changelog update by @kartik4949 in #1633
Document features by @fazlulkarimweb in #1631
Update intro.md by @aj-emerich in #1641
docs: update architecture image location in architecture.md by @worlpaker in #1638
Improve documentation of using LLMs by @jieguangzhou in #1636
Add env injection in test suite by @kartik4949 in #1657
Add fixes for hybrid storage by @blythed in #1659
remove demo from readme by @fnikolai in #1660
Remove vllm dependency when using ray to run vllm by @jieguangzhou in #1637
Fix vector intialize inmemory by @kartik4949 in #1661
Add initial cdc options for sql databases by @kartik4949 in #1643
Ref/build by @kartik4949 in #1663
Fix vLLM local inference by @jieguangzhou in #1670
Add cookbook by @fnikolai in #1665
update examples by @fnikolai in #1674
Feature/multi ids by @blythed in #1645
Extract db_name from data_backed in test confest by @kartik4949 in #1666
Refactor ibis table import path by @kartik4949 in #1677
Support unstructured encoder by @jieguangzhou in #1672
Create nightly-build.yaml by @fnikolai in #1685
Add reinit ignore in ray by @kartik4949 in #1696
Support llm model based on huggingface and Qlora training by @jieguangzhou in #1662
Update what is section in README.md for better understanding by @thgnw in #1700
Move downloads config and add extra options by @blythed in #1702
Change readme order README.md by @thgnw in #1704
Add compute logging and public class annotations by @kartik4949 in #1705
Disable rebuild in cdc by @kartik4949 in #1707
Remove force_set from tasks by @kartik4949 in #1712
Add client kwargs in openai by @kartik4949 in #1708
Update pyproject.toml by @fnikolai in #1716
Limit sqlglot version by @jieguangzhou in #1725
Revert tasks config compute local override by @kartik4949 in #1722
Replace identifier with model in openai models by @kartik4949 in #1720
[LORA] Use SuperDuperDB, ray and deepspeed to run local/remote multi GPU training by @jieguangzhou in #1719
DOC: Updating the Contributing.md and the testing.md files by @anitaokoh in #1728
doc: changes 'packages' to 'host names' in testing.md by @anitaokoh in #1730
Update LLM Finetune documentation by @jieguangzhou in #1734
Add integration tests for LLM finetune by @jieguangzhou in #1732
Replace csv file regex with os basepath by @kartik4949 in #1742
Fix minor bug in openai by @kartik4949 in #1741
Bump Version 0.1.1 by @fnikolai in #1754
Makefile update by @fnikolai in #1755
deprecate demo by @fnikolai in #1767
run testing within the sandbox image by @fnikolai in #1768
Merge Serializer, Datatype and Document by @blythed in #1772
make CI to fail if changelog is not updated by @fnikolai in #1770
Exclude certain files from triggering the ci by @fnikolai in #1781
ignore jsons from triggering the ci by @fnikolai in #1782
Documentation Improvement by @anitaokoh in #1777
[Quick fix] - added the duckdb file to sidebar.js by @anitaokoh in #1784
Make conftest configurable with envs by @kartik4949 in #1787
Refactor predict with multi key support by @kartik4949 in #1776
Fix openai random CI error by @jieguangzhou in #1800
[Fix] typos by @danibene in #1801
[CHORE] Minor adjustments to the documentation by @anitaokoh in #1806
Fixed the bug where select in listener is modified in schedule_jobs by @jieguangzhou in #1802
Feat/llama cpp by @kartik4949 in #1753
Improve _Predictor developer contract by @blythed in #1786
Add easy import decorator by @blythed in #1790
Add ray serve by @kartik4949 in #1775
Add file datatype type to support saving and reading files/folders in artifact_store by @jieguangzhou in #1805
Model decorators by @blythed in #1813
Add DAG model to support graph like execution by @kartik4949 in #1713
Try to fixed the CI error caused by the old openai cassettes by @jieguangzhou in #1820
Lazy model initialization project wide by @blythed in #1817
Add schedule jobs in vector index by @kartik4949 in #1818
[LORA] Optimization (configuration, datasets, etc) and testing by @jieguangzhou in #1823
Add requires function for checking module requirement by @kartik4949 in #1826
Add output dict indexing in graph by @kartik4949 in #1829
Update new brand SuperDuperDB by @guerra2fernando in #1831
Fixed some bugs of rag application by @jieguangzhou in #1827
Add requires for all ext modules by @kartik4949 in #1830
Fixed bug: Multiple concurrent errors in vllm real-time applications by @jieguangzhou in #1835
Fix minor bug in variable set by @kartik4949 in #1837
Refactor model.fit by @blythed in #1832
Support Schema option for MongoDB by @jieguangzhou in #1850
Blog post by @guerra2fernando in #1856
Update Article with Jina AI instructions by @guerra2fernando in #1859
Fix/listener output chain by @kartik4949 in #1853
Fix fine-tuning with new .fit_in_db(db=db) pattern by @jieguangzhou in #1862
Sort out the llm directory structure by @jieguangzhou in #1869
Blog Post - Nomic API Integration with SuperDuperDB by @guerra2fernando in #1871
Added compute_kwargs for job compute by @kartik4949 in #1870
Fixed some bugs of open source RAG Pipeline by @jieguangzhou in #1873
Fix listener with null select in taskworkflow by @kartik4949 in #1885
Fix/graph intermediate mappings by @kartik4949 in #1883
Templates for documentation by @blythed in #1888
Fix a minor typo in models component by @kartik4949 in #1889
Changing the repository of the blog by @guerra2fernando in #1893
Make lance add upsert vectors by @kartik4949 in #1895
Add cache while loading vectors in inmemory by @kartik4949 in #1894
Modify project structure by @blythed in #1892
add nightly (pre-release) image by @fnikolai in #1904
Fixed listener and post-like by @jieguangzhou in #1925
Refactor simple rest server by @blythed in #1930
Added CORS Middleware for integrating with frontend by @fazlulkarimweb in #1932
Adjust the docs of the v0.1 release by @guerra2fernando in #1936
Fix torch fit by @kartik4949 in #1918
Adjust V0.1 of docs + JP and CH readme by @guerra2fernando in #1944
Normalize vectors in advance for cosine by @kartik4949 in #1947
Insert release anouncement in README by @thgnw in #1961
Create local cluster with tmux sessions by @kartik4949 in #1958
Create local cluster with tmux sessions by @kartik4949 in #1970
docs announcement overlay for new docs version. by @archit00sharma in #1974
Nightly by @fnikolai in #1981
fix conftest for database cleanup by @fnikolai in #1988
Fix/vector index reload by @kartik4949 in #1991
Docs/reusable snippets by @blythed in #2002
Make build usecases api return bytes by @kartik4949 in #2007
Fix minor bug with single tab snippet by @kartik4949 in #2008
Update do_insert in MongoDB tab by @Lalith-Sagar-Devagudi in #2011
Fix minor bugs in multimodal usecase by @kartik4949 in #2012
Add flat serialization for UI by @blythed in #2013
Fixed file datatype and and lazy file by @jieguangzhou in #2017
Refactor flat serialization by @blythed in #2018
Notebook generator by @blythed in #2020
Fix paths for notebook generator button by @guerra2fernando in #2022
Fix duplicate artifact save by @kartik4949 in #2023
Edit colab links by @blythed in #2025
Optimized LLM finetuning usage experience by @jieguangzhou in #2024
Fix pandas support by @kartik4949 in #2010
Show the DataLayer configuration by @jieguangzhou in #2040
Updated LLM related documents and use case by @jieguangzhou in #2036
Fix os.uname method not found error in windows (#2033) by @ChandanChainani in #2034
Fixed database permission issues when connecting to mongodb by @jieguangzhou in #2045
Docs/1854 by @kartik4949 in #2035
Auto-infer Schema from data by @jieguangzhou in #2046
Lazy-creation of output tables for ibis to enable auto-inference of o… by @jieguangzhou in #2048
[DOCS0-2] Document all public classes, methods and functions by @jieguangzhou in #2050
improve database deployment and testing by @fnikolai in #2055
improve image builder by @fnikolai in #2058
add testing for oracle by @fnikolai in #2059
Add labeled data and fix broken links by @Lalith-Sagar-Devagudi in #2015
Feature/flatten serialization by @jieguangzhou in #2056
Fix doc-strings after big merge by @blythed in #2078
fix docs builder and redirect by @fnikolai in #2092
Snowflake Integration by @fnikolai in #2081
Auto-create tables and schemas by @jieguangzhou in #2090
Refactor rest server implementation by @blythed in #2091
Fix/remove dead code by @kartik4949 in #2088
Add auto document wrapping in insert query by @kartik4949 in #2097
Updated the RAG use case by @jieguangzhou in #2079
Fix tutorials by @blythed in #2102
Updated the LLM finetuning use case by @jieguangzhou in #2101
Fixed the bugs of multimodal vector search use case by @jieguangzhou in #2111
Fix special character keys serialization support in mongodb by @kartik4949 in #2113
Create components to ship easy to adapt applications by @kartik4949 in #2114
Updated multimodal vector search use case by @jieguangzhou in #2121
Updated the use cases by @jieguangzhou in #2133
Add additional options to local-cluster by @blythed in #2139
Add devkit to dependency installation (#2134) by @klepp0 in #2137
Feat/enhanced print by @blythed in #2140
Revert "Feat/enhanced print" by @blythed in #2141
Feat/enhanced print by @blythed in #2142
Update references to components and artifacts. by @jieguangzhou in #2145
Fix listener cleanup by @kartik4949 in #2138
feat: add metaclass to auto wrap a kw_only dataclass by @blythed in #2144
Some minor updates. by @jieguangzhou in #2152
Fix/2154 by @kartik4949 in #2159
Refactor/document encode by @jieguangzhou in #2160
Change '_leaves' to '_builds' by @jieguangzhou in #2163
Fix empty identifier of Code.from_object by @jieguangzhou in #2167
Docs/refinements 2 by @blythed in #2162
Fixed llm finetuning UT by @jieguangzhou in #2175
Move slash to dot by @blythed in #2178
Fixed Native encodable by @jieguangzhou in #2179
Fix minor bugs in ibis cdc by @kartik4949 in #2176
Fix/snowflake compatibility by @blythed in #2181
Releases by @fnikolai in #2183
Add auto reconnect on token expiry by @kartik4949 in #2180
Simple cronjobs by @blythed in #2184
Fixed 'objectmodel' and 'predict_one' in doc by @jieguangzhou in #2185
Fixed a bug in local cluster by @jieguangzhou in #2187
Fix cdc config by @kartik4949 in #2186
Fixed dependencies of ray jobs by @kartik4949 in #2192
Release 0.2.0 by @fnikolai in #2194
disable wheel checking by @fnikolai in #2195
Fix copy_vectors dependencies by @blythed in #2196
Release 0.1.3 by @fnikolai in #2197
Bump Version 0.1.4 (#2202) by @fnikolai in #2203

New Contributors

@Sohaib90 made their first contribution in #1491
@eltociear made their first contribution in #1516
@therohitdas made their first contribution in #1540
@JoanFM made their first contribution in #1533
@chrono-k made their first contribution in #1567
@muralidharand made their first contribution in #1570
@saahil made their first contribution in #1575
@Manmit124 made their first contribution in #1582
@aarya626 made their first contribution in #1581
@EdwardLi-coder made their first contribution in #1617
@Aditya-76 made their first contribution in #1599
@aj-emerich made their first contribution in #1641
@worlpaker made their first contribution in #1638
@anitaokoh made their first contribution in #1728
@danibene made their first contribution in #1801
@Lalith-Sagar-Devagudi made their first contribution in #2011
@ChandanChainani made their first contribution in #2034
@klepp0 made their first contribution in #2137

Full Changelog: 0.1.0...0.1.4