A project to map out the relations between different equational theories of Magmas.

A programming framework for agentic AI. Discord: https://discord.gg/pAbnFJrkgZ

English SDK for Apache Spark

Numbers every LLM developer should know

A curated list of practical guide resources of LLMs (LLMs Tree, Examples, Papers)

Spark DL Inferencing using external frameworks

Databricks Terraform Provider

Reference code base for ML Engineering, Manning Publications

A high performance and generic framework for distributed DNN training

Joblib Apache Spark Backend

Koalas: pandas API on Apache Spark

Julia package to computes statistics on streams of data

Spark Exercise

Intellij Jsonnet Plugin

Spark data source for Salesforce

Rules engine for cloud security, cost optimization, and governance, DSL in yaml for policies to query, filter, and take actions on resources

(Legacy) Command Line Interface for Databricks

Spark package for checking data quality

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Fast, flexible and powerful server providing access to R from many languages and systems

Code for Quartz Scheduler

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discr…

Generic Implementation of Consensus ADMM over Spark

R interface for Apache Spark

A scalable machine learning library on Apache Spark

Apache Superset is a Data Visualization and Data Exploration Platform

[DEPRECATED] Tensorflow wrapper for DataFrames on Apache Spark