The Telegram client planned to be optimized for the Miscrosoft Windows 10 Mobile retro-os one day....
-
Updated
Aug 22, 2025 - C#
#
unigram
Here are 67 public repositories matching this topic...
a probabilistic language identification system that identifies the language of a sentence
-
Updated
Apr 12, 2024 - Python
Python Web Crawler implementing Iterative Deepening Depth Search
-
Updated
Aug 24, 2023 - Python
[FR - Duo] 2023 - 2024 Centrale Méditerranée AI Master | NLP project about Markov models
-
Updated
Jan 27, 2024 - Mask
Word segmentation to create unigrams in Portuguese (pt-br)
-
Updated
Jun 17, 2023 - Python
COMP472 AI MINI PROJECT 3
-
Updated
Dec 6, 2018 - Java
200k-vocab SentencePiece (Unigram) tokenizer for German-primary LLMs — German/English/code, low fertility, byte-fallback, chat-template tokens. From the Auralis/Helix project.
-
Updated
Jun 19, 2026 - Python
-
Updated
May 2, 2022
High-Performance Azerbaijani Tokenizers (30% fewer tokens, 40% faster than multilingual alternatives)
nlp ai tokenizer transformers tokenization unigram bpe huggingface azerbaijani text-tokenization azerbaijani-language azerbaijani-nlp
-
Updated
Aug 19, 2025 - Jupyter Notebook
SentencePiece Tokenizer Wrapper implementation for PLDR-LLM with KV cache and G-cache
machine-learning natural-language-processing deep-learning tokenizer pytorch transformer unigram bpe sentencepiece large-language-models llm pldr-llm
-
Updated
Feb 20, 2025 - Python
Final AI course of CE department at Amirkabir University of Technology (Tehran Polytechnic) - Winter 2020.
-
Updated
Sep 20, 2022 - Python
Assignment on Document Reranking
information-retrieval information-extraction language-model bm25 document-retrieval unigram prf bigram-model bigram unigram-model probablistic-models document-reranking relevance-lm relevance-lm-unigram relevance-lm-bigram
-
Updated
May 23, 2021 - Python
A framework for building Sentencepiece tokenizer from a dataset
machine-learning natural-language-processing deep-learning tensorflow tokenizer keras transformer unigram bpe sentencepiece large-language-models llm pldr-llm
-
Updated
Oct 23, 2024 - Python
This is a small program that takes two lists, zips them, and translates a file after making the translation dictionary.
machine-learning utf-8 python-script translate beginner-friendly python27 translater unigram ngram-language-model
-
Updated
May 8, 2018 - Python
NLP extra project at AUT Artificial Intelligence course (Fall 2020)
-
Updated
Feb 15, 2021 - Python
Add this topic to your repo
To associate your repository with the unigram topic, visit your repo's landing page and select "manage topics."