Skip to content
swiftide

Changelog

Changelog

All notable changes to this project will be documented in this file.

0.13.0 - 2024-09-26

New features

  • 7d8a57f (indexing) [breaking] Removed duplication of batch_size (#336)

BREAKING CHANGE: The batch size of batch transformers when indexing is now configured on the batch transformer. If no batch size or default is configured, a configurable default is used from the pipeline. The default batch size is 256.

Bug fixes

  • 23b96e0 (tree-sitter) [breaking] SupportedLanguages are now non-exhaustive (#331)

BREAKING CHANGE: SupportedLanguages are now non-exhaustive. This means that matching on SupportedLanguages will now require a catch-all arm. This change was made to allow for future languages to be added without breaking changes.

Miscellaneous

  • 923a8f0 (fastembed,qdrant) Better batching defaults (#334)
Qdrant and FastEmbed now have a default batch size, removing the need to set it manually. The default batch size is 50 and 256 respectively.

Full Changelog: https://github.com/bosun-ai/swiftide/compare/0.12.3…0.13.0

0.12.3 - 2024-09-23

New features

  • da5df22 (tree-sitter) Implement Serialize and Deserialize for SupportedLanguages (#314)

Bug fixes

  • a756148 (tree-sitter) Fix javascript and improve tests (#313)
As learned from [#309](https://github.com/bosun-ai/swiftide/pull/309), test coverage for the refs defs transformer was
  not great. There _are_ more tests in code_tree. Turns out, with the
  latest treesitter update, javascript broke as it was the only language
  not covered at all.

Miscellaneous

  • e8e9d80 (docs) Add documentation to query module (#276)

Full Changelog: https://github.com/bosun-ai/swiftide/compare/0.12.2…0.12.3

v0.12.2 - 2024-09-20

Docs

  • d84814e Fix broken documentation links and other cargo doc warnings (#304) by @tinco
Running `cargo doc --all-features` resulted in a lot of warnings.

Full Changelog: https://github.com/bosun-ai/swiftide/compare/v0.12.1…v0.12.2

v0.12.1 - 2024-09-16

New features

  • ec227d2 (indexing,query) Add concise info log with transformation name by @timonv

  • 01cf579 (query) Add query_mut for reusable query pipelines by @timonv

  • 081a248 (query) Improve query performance similar to indexing in 0.12 by @timonv

  • 8029926 (query,indexing) Add duration in log output on pipeline completion by @timonv

Bug fixes

  • 39b6ecb (core) Truncate long strings safely when printing debug logs by @timonv

  • 8b8ceb9 (deps) Update redis by @timonv

  • 16e9c74 (openai) Reduce debug verbosity by @timonv

  • 6914d60 (qdrant) Reduce debug verbosity when storing nodes by @timonv

  • 3d13889 (query) Reduce and improve debugging verbosity by @timonv

  • 133cf1d (query) Remove verbose debug and skip self in instrumentation by @timonv

  • ce17981 Clippy by @timonv

  • a871c61 Fmt by @timonv

Miscellaneous

  • d62b047 (ci) Update testcontainer images and fix tests by @timonv

Full Changelog: https://github.com/bosun-ai/swiftide/compare/v0.12.0…v0.12.1

v0.12.0 - 2024-09-13

New features

  • e902cb7 (query) Add support for filters in SimilaritySingleEmbedding (#298) by @timonv
Adds support for filters for Qdrant and Lancedb in
  SimilaritySingleEmbedding. Also fixes several small bugs and brings
  improved tests.
  • f158960 Major performance improvements (#291) by @timonv
Futures that do not yield were not run in parallel properly. With this
  futures are spawned on a tokio worker thread by default.

  When embedding (fastembed) and storing a 85k row dataset, there's a
  ~1.35x performance improvement:
  <img width="621" alt="image"
  src="https://github.com/user-attachments/assets/ba2d4d96-8d4a-44f1-b02d-6ac2af0cedb7">

  ~~Need to do one more test with IO bound futures as well. Pretty huge,
  not that it was slow.~~

  With IO bound openai it's 1.5x.

Bug fixes

  • f8314cc (indexing) Limit logged chunk to max 100 chars (#292) by @timonv

  • f95f806 (indexing) Debugging nodes should respect utf8 char boundaries by @timonv

  • 8595553 Implement into_stream_boxed for all loaders by @timonv

  • 9464ca1 Bad embed error propagation (#293) by @timonv

- **fix(indexing): Limit logged chunk to max 100 chars**
  - **fix: Embed transformers must correctly propagate errors**

Miscellaneous

  • 45d8a57 (ci) Use llm-cov preview via nightly and improve test coverage (#289) by @timonv
Fix test coverage in CI. Simplified the trait bounds on the query
  pipeline for now to make it all work and fit together, and added more
  tests to assert boxed versions of trait objects work in tests.

  • 408f30a (deps) Update testcontainers (#295) by @timonv

  • 37c4bd9 (deps) Update treesitter (#296) by @timonv

  • 8d9e954 Cargo update by @timonv

Full Changelog: https://github.com/bosun-ai/swiftide/compare/v0.11.1…v0.12.0

v0.11.1 - 2024-09-10

New features

  • 3c9491b Implemtent traits T for Box