Skip to content

Conversation

@fengsxy
Copy link
Contributor

@fengsxy fengsxy commented Nov 22, 2023

Fix #612
Add support for verse models. Successfully tested on a local V100 setup for the chat and complentation.

@XprobeBot XprobeBot added this to the v0.6.4 milestone Nov 22, 2023
@ChengjieLi28
Copy link
Contributor

Have you ever tried xverse on your machine? If yes, please paste some screenshots here.

@fengsxy
Copy link
Contributor Author

fengsxy commented Nov 23, 2023

Have you ever tried xverse on your machine? If yes, please paste some screenshots here. Same issue also appear at the baichuan model.

I have tried, they could index the true model on hugging face and modelscope. But after downloading, my machine does not supply for xverse!
image

@ChengjieLi28
Copy link
Contributor

Have you ever tried xverse on your machine? If yes, please paste some screenshots here. Same issue also appear at the baichuan model.

I have tried, they could index the true model on hugging face and modelscope. But after downloading, my machine does not supply for xverse! image

Do not install pytorch mps version. Just install cpu version to test the function. Then paste the results here.

@fengsxy
Copy link
Contributor Author

fengsxy commented Nov 23, 2023

image
Xverse-chat 7b runing scrennshot

@fengsxy
Copy link
Contributor Author

fengsxy commented Nov 23, 2023

image
image
image

xverse

@aresnow1
Copy link
Contributor

Great job, looks good to me.

@aresnow1 aresnow1 merged commit 091cdb6 into xorbitsai:main Nov 24, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

FEAT: XVERSE

4 participants