You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
Uh oh!
There was an error while loading. Please reload this page.
the update process hung like this. Not sure what to do, I backed up RDS. Control-C to stop it and rerun?
Thanks!
./deploy.sh --skip-build
us-east-2
Detected existing deployment - ensuring backward compatibility
{
"BucketArn": "arn:aws:s3:::terraform-llm-gateway-poc",
"BucketRegion": "us-east-2",
"AccessPointAlias": false
}
Terraform Bucket terraform-llm-gateway-poc already exists, skipping creation
Certificate Arn:
RECORD_NAME:
HOSTED_ZONE_NAME:
CREATE_PRIVATE_HOSTED_ZONE_IN_EXISTING_VPC: false
OKTA_ISSUER:
OKTA_AUDIENCE: api://default
LiteLLM Version: v1.106.2
Skipping container build: true
Build from source: false
OPENAI_API_KEY: placeholder
AZURE_OPENAI_API_KEY: placeholder
AZURE_API_KEY: placeholder
ANTHROPIC_API_KEY: placeholder
GROQ_API_KEY: placeholder
COHERE_API_KEY: placeholder
CO_API_KEY: placeholder
HF_TOKEN: placeholder
HUGGINGFACE_API_KEY: placeholder
DATABRICKS_API_KEY: placeholder
GEMINI_API_KEY: placeholder
CODESTRAL_API_KEY: placeholder
MISTRAL_API_KEY: placeholder
AZURE_AI_API_KEY: placeholder
NVIDIA_NIM_API_KEY: placeholder
XAI_API_KEY: placeholder
PERPLEXITYAI_API_KEY: placeholder
GITHUB_API_KEY: placeholder
DEEPSEEK_API_KEY: placeholder
AI21_API_KEY: placeholder
LANGSMITH_API_KEY:
LANGSMITH_PROJECT:
LANGSMITH_DEFAULT_RUN_NAME:
DEPLOYMENT_PLATFORM: ECS
EXISTING_EKS_CLUSTER_NAME:
EXISTING_VPC_ID:
DISABLE_OUTBOUND_NETWORK_ACCESS: false
CREATE_VPC_ENDPOINTS_IN_EXISTING_VPC: false
INSTALL_ADD_ONS_IN_EXISTING_EKS_CLUSTER: false
DESIRED_CAPACITY: 2
MIN_CAPACITY: 2
MAX_CAPACITY: 4
ECS_CPU_TARGET_UTILIZATION_PERCENTAGE: 50
ECS_MEMORY_TARGET_UTILIZATION_PERCENTAGE: 40
ECS_VCPUS: 2
EKS_ARM_INSTANCE_TYPE: t4g.medium
EKS_X86_INSTANCE_TYPE: t3.medium
EKS_ARM_AMI_TYPE: AL2_ARM_64
EKS_X86_AMI_TYPE: AL2_x86_64
PUBLIC_LOAD_BALANCER: true
RDS_INSTANCE_CLASS: db.t3.small
RDS_ALLOCATED_STORAGE_GB: 20
REDIS_NODE_TYPE: cache.t3.micro
REDIS_NUM_CACHE_CLUSTERS: 2
DISABLE_SWAGGER_PAGE: false
DISABLE_ADMIN_UI: false
LANGFUSE_PUBLIC_KEY:
LANGFUSE_SECRET_KEY:
LANGFUSE_HOST:
arm
Skipping docker build and deploy step...
Repository middleware already exists, checking tags...
Adding project=llmgateway tag...
arm
linux/arm64
All reactions