#

data-centric

Here are 35 public repositories matching this topic...

ludwig

ludwig-ai / ludwig

Low-code framework for building custom LLMs, neural networks, and other AI models

Updated Oct 28, 2024
Python

lancedb / lance

Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..

python rust data-science machine-learning computer-vision deep-learning embeddings dataops data-analytics data-analysis data-format apache-arrow data-centric mlops duckdb llms

Updated Nov 2, 2024
Rust

data-centric-AI

daochenzha / data-centric-AI

A curated, but incomplete, list of data-centric AI resources.

data-science machine-learning ai artificial-intelligence data-engineering data-quality data-curation data-centric data-centric-ai data-centric-machine-learning

Updated Jun 26, 2024

hkust-nlp / deita

Deita: Data-Efficient Instruction Tuning for Alignment [ICLR2024]

alignment data-centric large-language-models instruction-tuning

Updated May 20, 2024
Python

encord-team / encord-active

The toolkit to test, validate, and evaluate your models and surface, curate, and prioritize the most valuable data for labeling.

python data-science data machine-learning computer-vision deep-learning data-validation annotations ml object-detection data-cleaning active-learning data-quality data-centric mlops noisy-labels model-quality label-errors label-quality

Updated Jun 18, 2024
Python

CLUEbenchmark / DataCLUE

DataCLUE: 数据为中心的NLP基准和工具包

nlp ai chinese classification-algorithm human-in-the-loop data-centric

Updated May 11, 2022
Python

dust-dds

s2e-systems / dust-dds

Rust implementation of the Data Distribution Service (DDS)

rust middleware udp dds dcps data-centric

Updated Oct 26, 2024
Rust

ChandlerBang / GTrans

[ICLR'23] Implementation of "Empowering Graph Representation Learning with Test-Time Graph Transformation"

robustness adversarial-attacks data-centric graph-neural-networks out-of-distribution distribution-shift test-time-adaptation

Updated Jun 23, 2023
Python

Acharya

astutic / Acharya

A Data Centric NER annotation tool for your Named Entity Recognition projects

machine-learning natural-language-processing ai named-entity-recognition datasets annotation-processing ner annotation-tool text-annotation data-quality data-centric mlops data-quality-monitoring data-labeling annota text-annotation-tool data-labeling-tools data-centric-ai

Updated Apr 10, 2024

PrincetonUniversity / muchiSim

Simulator framework for analysis of performance, energy consumption, area and cost of multi-node multi-chiplet tile-based manycore designs

simulator simulation network cost-model pgas execution energy-model manycore multi-chip data-centric data-local performance-modeling-and-analysis multi-chiplet

Updated Jun 30, 2024
C++

vuejs-form

zhorton34 / vuejs-form

Vue Form with Laravel Inspired Validation and Simply Enjoyable Error Messages Api. (Form Api, Validator Api, Rules Api, Error Messages Api)

react javascript vue js reactjs reactivity data-centric

Updated Mar 5, 2022
JavaScript

Maksims / mr-Observer

An observer is a wrapper over JSON data, that provides an interface to know when data is changed, with a focus on performance and memory efficiency.

observer object-proxying data-centric data-proxy json-proxy

Updated Aug 27, 2021
JavaScript

kennethleungty / Data-Centric-AI-Competition

Codes for a Top 5% finish in the Data-Centric AI Competition organized by Andrew Ng and DeepLearning.AI

data-science machine-learning ai deep-learning andrew-ng data-centric data-centric-ai

Updated Oct 18, 2021
Jupyter Notebook

stoney95 / pypely

From local functions to cloud deployed pipelines

data pipeline functional-programming pipe readability testability data-centric mlops

Updated Mar 18, 2023
Python

minnesotanlp / infoVerse

Jaehyung Kim et al's ACL 2023 paper on "infoVerse: A Universal Framework for Dataset Characterization with Multidimensional Meta-information"

nlp active-learning dpp data-annotation data-centric data-pruning

Updated Jun 28, 2023
Python

seedatnabeel / Data-IQ

Data-IQ: Characterizing subgroups with heterogeneous outcomes in tabular data (NeurIPS 2022)

data-science machine-learning deep-learning data-quality data-centric responsible-ai trustworthy-ai data-quality-assessment data-centric-ai data-centric-machine-learning

Updated Mar 20, 2023
Jupyter Notebook

seedatnabeel / Data-SUITE

Data-SUITE: Data-centric identification of in-distribution incongruous examples (ICML 2022)

data-science machine-learning data-quality data-centric data-quality-monitoring responsible-ai trustworthy-machine-learning data-centric-ai data-centric-machine-learning

Updated Mar 8, 2023
Jupyter Notebook

mdbloice / Labeller

Quickly set up an image labelling web application for manually tagging images for machine learning tasks.

machine-learning-library data-centric data-centric-ai

Updated Oct 5, 2023
Python

NileDB / com.niledb.core

Open-source Data Backend written in Java and based on PostgreSQL & GraphQL.

Updated Jul 30, 2018
JavaScript

openlayer-ai / openlayer-python

The official Python library for Openlayer, the Continuous Model Improvement Platform for AI. 📈

machine-learning ai tensorflow ml unbox model-deployment ml-infrastructure synthetic-dataset-generation openlayer data-centric mlops machine-learning-operations model-explainability

Updated Nov 4, 2024
Python

Improve this page

Add a description, image, and links to the data-centric topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the data-centric topic, visit your repo's landing page and select "manage topics."