Write your pipelines in C# !

A DSL for data-driven computational pipelines

Extensible full DAG streaming computation server with services and jobs for RNA-Seq, Tn-Seq, WG-Seq and Term-Seq.

Cross-platform, customizable ML solutions for live and streaming media.

A set of processes/pipelines for bioinformatics

A pipeline framework for python

Lightweight fast function pipeline (DAG) creation in pure Python for scientific (HPC) workflows 🕸️🧪

A plugin for pipen to handle files in Google Cloud Storage

Draw pipeline diagrams for pipen.

Add a set of useful filters for pipen templates.

The purpose of this personal project was to build-out a streamlined process for tracking, isolating and projecting the validity of 'deals' in the consumer technology space through creating a series of webscrapers, funneled into a cleansed pipeline, hosted on a sql-lite3 database and distributed/displayed on an all-in-one dashboard for analytics..

Machine is a workflow/pipeline library for processing data

boost data pipeline's tangibility, enhance research productivity, reduce work anxiety

PrimeFuncPack Core.Taggeds is a core pack for .NET consisting of fundamental tagged types targeted for use in functional programming: Optional and Result monads, Tagged Union, as well as the convert extensions.

Gokart solves reproducibility, task dependencies, constraints of good code, and ease of use for Machine Learning Pipeline.

OWASP Secure Pipeline Verification Standard

COMP Superscalar (COMPSs) is a framework which aims to ease the development and execution of applications for distributed infrastructures, such as Clusters, Grids and Clouds.

Airflow + dbt + Snowflake + Postgres + Docker + CICD (Postgres‑backed)

Relational data pipelines for the science lab

BatchFlow helps you conveniently work with random or sequential batches of your data and define data processing and machine learning workflows even for datasets that do not fit into memory.