A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

Ongoing research training transformer models at scale

The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.

Holistic job manager on Kubernetes

《面向开发者的 ChatGPT 提示词工程》非官方版中英双语字幕 Unofficial subtitles of "ChatGPT Prompt Engineering for Developers"

Explanation to key concepts in ML

Colossal-AI: A Unified Deep Learning System for Big Model Era

FeatHub - A stream-batch unified feature store for real-time machine learning

Public repo for DeepLearning.AI MLEP Specialization

PyTorch Tutorial for Deep Learning Researchers

The Apache Flink SQL Cookbook is a curated collection of examples, patterns, and use cases of Apache Flink SQL. Many of the recipes are completely self-contained and can be run in Ververica Platfor…

Remote Shuffle Service for Flink

a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.

Dinky is an out of the box one-stop real-time computing platform dedicated to the construction and practice of Unified Batch & Streaming and Unified Data Lake & Data Warehouse. Based on Apache Flin…

EasyNLP: A Comprehensive and Easy-to-use NLP Toolkit

DeepRec is a recommendation engine based on TensorFlow.

🔥 Seata is an easy-to-use, high-performance, open source distributed transaction solution.

Transformers4Rec is a flexible and efficient library for sequential and session-based recommendation, available for both PyTorch and Tensorflow.

OneFlow is a performance-centered and open-source deep learning framework.

A horizontally scalable, highly available, multi-tenant, long term Prometheus.

Distributed Prometheus time series database

Submarine is Cloud Native Machine Learning Platform.

Apache Ignite

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualiz…

Additional utils and helpers to extend TensorFlow when build recommendation systems, contributed and maintained by SIG Recommenders.

A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and bat…

A high-performance distributed deep learning system targeting large-scale and automated distributed training.

Apache Atlas

Pytorch domain library for recommendation systems

Fast scalable time series database