Changelog
Changelog
All notable changes to this project will be documented in this file.
0.13.0 - 2024-09-26
New features
BREAKING CHANGE: The batch size of batch transformers when indexing is now configured on the batch transformer. If no batch size or default is configured, a configurable default is used from the pipeline. The default batch size is 256.
Bug fixes
BREAKING CHANGE: SupportedLanguages are now non-exhaustive. This means that matching on SupportedLanguages will now require a catch-all arm. This change was made to allow for future languages to be added without breaking changes.
Miscellaneous
Qdrant and FastEmbed now have a default batch size, removing the need to set it manually. The default batch size is 50 and 256 respectively.
Full Changelog: https://github.com/bosun-ai/swiftide/compare/0.12.3…0.13.0
0.12.3 - 2024-09-23
New features
Bug fixes
As learned from [#309](https://github.com/bosun-ai/swiftide/pull/309), test coverage for the refs defs transformer was
not great. There _are_ more tests in code_tree. Turns out, with the
latest treesitter update, javascript broke as it was the only language
not covered at all.
Miscellaneous
Full Changelog: https://github.com/bosun-ai/swiftide/compare/0.12.2…0.12.3
v0.12.2 - 2024-09-20
Docs
- d84814e Fix broken documentation links and other cargo doc warnings (#304) by @tinco
Running `cargo doc --all-features` resulted in a lot of warnings.
Full Changelog: https://github.com/bosun-ai/swiftide/compare/v0.12.1…v0.12.2
v0.12.1 - 2024-09-16
New features
ec227d2 (indexing,query) Add concise info log with transformation name by @timonv
01cf579 (query) Add query_mut for reusable query pipelines by @timonv
081a248 (query) Improve query performance similar to indexing in 0.12 by @timonv
8029926 (query,indexing) Add duration in log output on pipeline completion by @timonv
Bug fixes
39b6ecb (core) Truncate long strings safely when printing debug logs by @timonv
8b8ceb9 (deps) Update redis by @timonv
16e9c74 (openai) Reduce debug verbosity by @timonv
6914d60 (qdrant) Reduce debug verbosity when storing nodes by @timonv
3d13889 (query) Reduce and improve debugging verbosity by @timonv
133cf1d (query) Remove verbose debug and skip self in instrumentation by @timonv
ce17981 Clippy by @timonv
a871c61 Fmt by @timonv
Miscellaneous
- d62b047 (ci) Update testcontainer images and fix tests by @timonv
Full Changelog: https://github.com/bosun-ai/swiftide/compare/v0.12.0…v0.12.1
v0.12.0 - 2024-09-13
New features
- e902cb7 (query) Add support for filters in SimilaritySingleEmbedding (#298) by @timonv
Adds support for filters for Qdrant and Lancedb in
SimilaritySingleEmbedding. Also fixes several small bugs and brings
improved tests.
- f158960 Major performance improvements (#291) by @timonv
Futures that do not yield were not run in parallel properly. With this
futures are spawned on a tokio worker thread by default.
When embedding (fastembed) and storing a 85k row dataset, there's a
~1.35x performance improvement:
<img width="621" alt="image"
src="https://github.com/user-attachments/assets/ba2d4d96-8d4a-44f1-b02d-6ac2af0cedb7">
~~Need to do one more test with IO bound futures as well. Pretty huge,
not that it was slow.~~
With IO bound openai it's 1.5x.
Bug fixes
f8314cc (indexing) Limit logged chunk to max 100 chars (#292) by @timonv
f95f806 (indexing) Debugging nodes should respect utf8 char boundaries by @timonv
8595553 Implement into_stream_boxed for all loaders by @timonv
9464ca1 Bad embed error propagation (#293) by @timonv
- **fix(indexing): Limit logged chunk to max 100 chars**
- **fix: Embed transformers must correctly propagate errors**
Miscellaneous
- 45d8a57 (ci) Use llm-cov preview via nightly and improve test coverage (#289) by @timonv
Fix test coverage in CI. Simplified the trait bounds on the query
pipeline for now to make it all work and fit together, and added more
tests to assert boxed versions of trait objects work in tests.
408f30a (deps) Update testcontainers (#295) by @timonv
37c4bd9 (deps) Update treesitter (#296) by @timonv
8d9e954 Cargo update by @timonv
Full Changelog: https://github.com/bosun-ai/swiftide/compare/v0.11.1…v0.12.0
v0.11.1 - 2024-09-10
New features
- 3c9491b Implemtent traits T for Box