Stars
A high-throughput and memory-efficient inference and serving engine for LLMs
AWS Generative AI CDK Constructs are sample implementations of AWS CDK for common generative AI patterns.
{{ message }}
A high-throughput and memory-efficient inference and serving engine for LLMs
AWS Generative AI CDK Constructs are sample implementations of AWS CDK for common generative AI patterns.