fastchat.serve.huggingface_api

Usage: python3 -m fastchat.serve.huggingface_api –model ~/model_weights/vicuna-7b/