A tool to Win the week

Build and tokenize your own smart contract factory using Fundi, Openzeppelin, and Chainlink contracts with Foundry framework on Etherum/Base Sepolia

it's a tool, it's a library, it's regular expressions!

finite state machine tokenizer

Developer friendly Natural Language Processing ✨

A Python library for interacting with TI-(e)z80 (82/83/84 series) calculator files

Extracts plain text from Markdown strings. It's useful for Natural Language Processing (NLP) tasks.

A pythonic wrapper for Stanford CoreNLP.

A token based HTML Document parser and minifier written in PHP. Extract attribute values and text using CSS selectors.

Examples scripts that showcase how to use Private AI Text to de-identify, redact, hash, tokenize, mask and synthesize PII in text.

A utility for analyzing text on the web

Transform hypertext strings (e.g., HTML, Markdown) into plain text for natural language processing (NLP) normalization

Tokenize and parse attributes string into meaningful tokens and key-value pairs.

Extracts plain text from an HTML string. It's useful for Natural Language Processing (NLP) tasks.

Generate string from a token array by interpolating values.

A package of basic functions and classes required for the framework to work

Tokenize a string into an array of string parts and format identifier objects.

Python scripts for tokenizing data - from CSV or Postgres - in the Skyflow Privacy Vault.

small, safe, and great commonmark (optionally gfm, mdx) compliant markdown parser

CommonMark compliant markdown parser in Rust with ASTs and extensions