Adding `blingfire` library as a dependency

Run this command in a terminal, in your project's directory:

cargo add blingfire

To add it manually, edit your project's Cargo.toml file and add to the [dependencies] section:

blingfire = "1.0.0"

The blingfire library will be automatically available globally. Read the blingfire library documentation.

Back to the crate overview.

Readme

BlingFire in Rust

blingfire is a thin Rust wrapper for the BlingFire tokenization library.

Add the library to Cargo.toml to get started

cargo add blingfire

The library exposes two functions text_to_words and text_to_sentences

use blingfire;

fn main() {
    let mut parsed = String::new();

    blingfire::text_to_words("Cat,sat on   the mat.", &mut parsed).unwrap();
    assert_eq!(parsed.as_str(), "Cat , sat on the mat .");

    blingfire::text_to_sentences("Cat sat. Dog barked.", &mut parsed).unwrap();
    assert_eq!(parsed.as_str(), "Cat sat.\nDog barked.");
}

The code is licensed under the MIT License.

Adding blingfire library as a dependency

Adding `blingfire` library as a dependency