Skip to content
View p208p2002's full-sized avatar

Organizations

@NCHU-NLP-Lab

Block or report p208p2002

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse

Starred repositories

Showing results

Checkpoint/Restore tool

C 4,076 838 Updated Nov 16, 2026

Sardeenz is a proof-of-concept application that allows you to load more than one model on a given GPU. It allows you to add more and more models onto a GPU, until it is fully utilized.

TypeScript 65 8 Updated Aug 14, 2026

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

Python 2,046 240 Updated Nov 12, 2026

Algorithm powering the For You feed on X

Rust 34,263 5,517 Updated Nov 17, 2026

Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

Python 1,793 294 Updated Nov 16, 2026

A small command line tool to simplify releasing software by updating all version strings in your source code by the correct increment and optionally commit and tag the changes.

Python 637 48 Updated Nov 16, 2026

A collection of examples for the ROCm software stack

C++ 332 106 Updated Nov 16, 2026

Allow torch tensor memory to be released and resumed later

Python 285 80 Updated Nov 15, 2026

My learning notes for ML SYS.

HTML 7,682 533 Updated Oct 21, 2026

Official Code Repository for the paper "Distilling LLM Agent into Small Models with Retrieval and Code Tools"

Python 281 38 Updated Oct 22, 2025

FlashInfer: Kernel Library for LLM Serving

Cuda 6,942 1,765 Updated Nov 17, 2026

Awesome Reasoning LLM Tutorial/Survey/Guide

Python 2,587 175 Updated Sep 5, 2026
Python 1,206 69 Updated Jan 10, 2026

An Open-source book with Modern CUDA learning Notes for Beginners - BF16/FP8/FP4, HGEMM, CuTe, Flash-Attention, etc.

TeX 12,186 1,276 Updated Nov 17, 2026

Minimal example for DeepSpeed Universal Checkpoint

Python 1 Updated Sep 20, 2024
Python 97 12 Updated Nov 6, 2024

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends

Python 2,586 615 Updated Nov 11, 2026

WikiTableSet: A largest publicly available image-based table recognition dataset in three languages built from Wikipedia

Python 33 2 Updated Jun 12, 2025

Automatic GPU+CPU memory profiling, re-use and memory leaks detection using jupyter/ipython experiment containers

Jupyter Notebook 238 14 Updated Dec 15, 2023

Open GenAI Stack

Python 8,466 1,403 Updated Nov 16, 2026

Run PyTorch LLMs locally on servers, desktop and mobile

Python 3,609 248 Updated Sep 10, 2025

We collect papers about "large language models (LLM) for table-related tasks", e.g., using LLM for Table QA task. “表格+LLM”相关论文整理

638 46 Updated Apr 9, 2026

[EMNLP 2023] Enabling Large Language Models to Generate Text with Citations. Paper: https://arxiv.org/abs/2305.14627

Python 532 51 Updated Oct 9, 2024

This project has implemented the RAG function on Jetson and supports TXT and PDF document formats. It uses MLC for 4-bit quantization of the Llama2-7b model, utilizes ChromaDB as the vector databas…

Python 11 1 Updated May 16, 2024

LLM training code for Databricks foundation models

Python 4,460 590 Updated Mar 25, 2026

egui: an easy-to-use immediate mode GUI in Rust that runs on both web and native

Rust 32,332 2,393 Updated Nov 13, 2026

Web Interface for the Docker Registry HTTP API V2

Ruby 702 64 Updated Nov 16, 2026

The simplest and most complete UI for your private docker registry v2 and v3

Riot 3,556 371 Updated Aug 10, 2026

Multiple NVIDIA GPUs or Apple Silicon for Large Language Model Inference?

Jupyter Notebook 1,939 75 Updated May 13, 2024

Source code of "Reasons to Reject? Aligning Language Models with Judgments"

Python 58 5 Updated Feb 29, 2024
Next