v0.10.1

v0.10.0

v0.9.2-alpha.2

v0.9.2-alpha.1

Add a scattered kv cache. (#2936)

* Add a scattered kv cache.

* Update some comments.

Bump the crate version to 0.9.0. (#2924)

Rotating kv cache positions (#2901)

* Retrieve the current positions for rotating KV caches.

* Add the function to the kv cache too.

* More testing.

Bump the crate version. (#2895)

Add a cudnn feature to candle-nn/candle-transformers. (#2890)

Add the CSM model. (#2862)

* Add the CSM model.

* Add some code to load the model.

* Load the text tokenizer.

* Add frame generation.

* Get the sampling to work.

* Rope fix.

* Autoregressive generation.

* Generate some audio file.

* Use the actual prompt.

* Support multiple turns.

* Add a very barebone readme.

* Move some of the shared bits to the model.