Skip to content

Conversation

@yiboyasss
Copy link
Contributor

截屏2025-02-13 11 48 36

@XprobeBot XprobeBot added this to the v1.x milestone Feb 13, 2025
@qinxuye
Copy link
Contributor

qinxuye commented Feb 15, 2025

I tried mlx engine, and the copied content is

xinference launch --model-name qwen2.5-instruct --model-type LLM --model-engine MLX --model-format mlx --model-size-in-billions 7 --quantization 4bit --n-gpu auto --replica 1 --request-limits  --gpu-idx

There is no value set for --gpu-idx and --requests-limit, for those with no value, don't add to command lines.

@qinxuye
Copy link
Contributor

qinxuye commented Feb 15, 2025

And the icons are too small maybe the users would never discover them, you can try to highlight them in some ways.

@qinxuye
Copy link
Contributor

qinxuye commented Feb 17, 2025

It should be --size-in-billions instead of --model-size-in-billions.

@yiboyasss yiboyasss force-pushed the FEAT/copy-to-command-line branch 2 times, most recently from 31f9ac0 to 9f8eab0 Compare February 18, 2025 03:01
@qinxuye
Copy link
Contributor

qinxuye commented Feb 18, 2025

When I paste back the commands, the model size does not work.
image

@yiboyasss yiboyasss force-pushed the FEAT/copy-to-command-line branch from 8e922aa to bca4a5a Compare February 18, 2025 08:36
Copy link
Contributor

@qinxuye qinxuye left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@yiboyasss yiboyasss force-pushed the FEAT/copy-to-command-line branch from de25f7a to 36095bc Compare February 19, 2025 02:38
@qinxuye qinxuye merged commit fc31f92 into xorbitsai:main Feb 19, 2025
13 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants