feat: 多专业小模型+路由模型系统 MVP(mock 全链路 + FastAPI 网关 + 论文调研)
This commit is contained in:
@@ -0,0 +1,11 @@
|
||||
# 可选:接入真实开源小模型(RTX 4060 8GB 可跑 0.5B-4B 量化模型)
|
||||
# 安装:pip install -r requirements-ml.txt
|
||||
torch>=2.2
|
||||
transformers>=4.40
|
||||
accelerate>=0.30
|
||||
peft>=0.11
|
||||
sentencepiece
|
||||
protobuf
|
||||
bitsandbytes
|
||||
# 轻量推理引擎(可选)
|
||||
# llama-cpp-python␍
|
||||
Reference in New Issue
Block a user