Skip to content
Snippets Groups Projects
Commit 645ea54b authored by Benoit Favre's avatar Benoit Favre
Browse files

document model picking

parent 80951926
No related branches found
No related tags found
No related merge requests found
#!/bin/bash #!/bin/bash
PORT=8321 PORT=8321
#MODEL=mistralai/Mistral-7B-Instruct-v0.1 # list of supported models: https://docs.vllm.ai/en/latest/models/supported_models.html
MODEL=mistralai/Mistral-7B-Instruct-v0.1
#MODEL=lmsys/vicuna-13b-v1.3 #MODEL=lmsys/vicuna-13b-v1.3
MODEL=microsoft/phi-2 #MODEL=microsoft/phi-2
HOST=`hostname` HOST=`hostname`
SEED=1234 SEED=1234
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Please register or to comment