-
-
LLaMA-V2-serving-with-Flask Public
LLaMa V2 7B serving on local machine with Flask
HTML UpdatedJan 31, 2024 -
fastertransformer_backend Public
Forked from triton-inference-server/fastertransformer_backendPython BSD 3-Clause "New" or "Revised" License UpdatedNov 20, 2023 -
vllm_test Public
Forked from vllm-project/vllmA high-throughput and memory-efficient inference and serving engine for LLMs
Python Apache License 2.0 UpdatedAug 27, 2023 -
-
-
-
-
{{ message }}