BioSieve

BioSieve is a Python toolkit for preparing biological sequence datasets for machine learning.

It covers two main workflows:

• Redundancy reduction — remove near-duplicate sequences before training using sequence, embedding, descriptor, or structural similarity
• Leakage-aware splitting — partition datasets into train/val/test (or k-folds) with strategies that respect biological structure (homology clusters, sequence distance, groups, time)

BioSieve supports Python 3.11+.

pip install biosieve

Install optional extras as needed:

• minhash for approximate Jaccard-based deduplication (minhash_jaccard strategy)
• faiss for GPU-accelerated embedding similarity search (embedding_cosine strategy)

pip install 'biosieve[minhash]'
pip install 'biosieve[faiss]'

The mmseqs2 reducer and homology_aware splitter require the MMseqs2 binary to be available in PATH.

Remove near-duplicate sequences using k-mer Jaccard similarity:

biosieve reduce \
  -i dataset.csv \
  -o dataset_nr.csv \
  --strategy kmer_jaccard \
  --mapping-output mapping.csv \
  --report-output report.json

Pass parameters via a YAML file:

biosieve reduce \
  -i dataset.csv \
  -o dataset_nr.csv \
  --strategy kmer_jaccard \
  --params params.yaml

# params.yaml
kmer_jaccard:
  threshold: 0.8
  k: 5

Override a single parameter inline without a file:

biosieve reduce -i dataset.csv -o out.csv --strategy kmer_jaccard --set kmer_jaccard.threshold=0.9

Split with a leakage-aware strategy:

biosieve split \
  -i dataset_nr.csv \
  -o splits/ \
  --strategy homology_aware \
  --params params.yaml

# params.yaml
homology_aware:
  mode: precomputed
  clusters_path: clusters.csv
  member_col: id
  cluster_col: cluster_id
  test_size: 0.2

All strategies also support k-fold variants (random_kfold, stratified_kfold, group_kfold, stratified_numeric_kfold, distance_aware_kfold).

Every run produces consistent artefacts:

• Reduced or split CSVs
• Mapping CSV (removed_id, representative_id, cluster_id, score) for reduction runs
• JSON report with strategy name, effective parameters, and reduction/split statistics

• examples/README.md for runnable scripts and config files

If you use BioSieve in your research, please cite:

Fernández Villegas, D.; Álvarez Saravia, D.; Medina-Ortiz, D. BioSieve: Redundancy Reduction and Leakage-Aware Dataset Partitioning for Biological ML. Version 0.1.2, 2026. Zenodo. https://doi.org/10.5281/zenodo.21930919

@software{biosieve2026,
  author    = {Fernández Villegas, Diego and Álvarez Saravia, Diego and Medina-Ortiz, David},
  title     = {{BioSieve}: Redundancy Reduction and Leakage-Aware Dataset Partitioning for Biological ML},
  year      = {2026},
  version   = {0.1.2},
  publisher = {Zenodo},
  doi       = {10.5281/zenodo.21930919},
  url       = {https://doi.org/10.5281/zenodo.21930919}
}

To cite this exact release, use the version DOI 10.5281/zenodo.21930920. Machine-readable metadata lives in CITATION.cff.

MIT. See LICENSE.

Built on top of scikit-learn, polars, NumPy, and optionally datasketch, FAISS, and MMseqs2.

Developed by KREN AI Lab at Universidad de Magallanes, Chile.