Deep Infra
- 122 followers
- United States of America
- https://deepinfra.com
- @DeepInfra
- company/deep-infra
- info@deepinfra.com
Popular repositories Loading
-
deepinfra-node
deepinfra-node PublicOfficial TypeScript wrapper for DeepInfra Inference API
-
text-generation-inference
text-generation-inference PublicForked from huggingface/text-generation-inference
Large Language Model Text Generation Inference
-
langchain
langchain PublicForked from langchain-ai/langchain
⚡ Building applications with LLMs through composability ⚡
Python 1
-
deepinfra-chat
deepinfra-chat PublicSample Next.js ai chat app using Deep Infra inference and Vercel ai sdk
Repositories
- cookbooks Public
A collection of cookbooks, tutorials, and examples for using AI models on DeepInfra. This repository provides practical guides, performance benchmarks, and production-ready code examples to help developers build with AI models efficiently. Each cookbook includes comprehensive Jupyter notebooks, benchmarking suites, and real-world use case examples.
deepinfra/cookbooks’s past year of commit activity - TensorRT-LLM Public Forked from NVIDIA/TensorRT-LLM
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
deepinfra/TensorRT-LLM’s past year of commit activity - docs Public
deepinfra/docs’s past year of commit activity - openbench Public Forked from groq/openbench
Provider-agnostic, open-source evaluation infrastructure for language models
deepinfra/openbench’s past year of commit activity - vllm Public Forked from vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
deepinfra/vllm’s past year of commit activity - sglang Public Forked from sgl-project/sglang
SGLang is a fast serving framework for large language models and vision language models.
deepinfra/sglang’s past year of commit activity - SpecForge Public Forked from sgl-project/SpecForge
Train speculative decoding models effortlessly and port them smoothly to SGLang serving.
deepinfra/SpecForge’s past year of commit activity - Roo-Code Public Forked from RooCodeInc/Roo-Code
Roo Code gives you a whole dev team of AI agents in your code editor.
deepinfra/Roo-Code’s past year of commit activity
People
This organization has no public members. You must be a member to see who’s a part of this organization.
Most used topics
Loading…