feat: 多专业小模型+路由模型系统 MVP(mock 全链路 + FastAPI 网关 + 论文调研)

This commit is contained in:
tzt
2026-08-12 10:40:04 +08:00
commit 1e51167ea5
50 changed files with 49382 additions and 0 deletions
+11
View File
@@ -0,0 +1,11 @@
# 可选:接入真实开源小模型(RTX 4060 8GB 可跑 0.5B-4B 量化模型)
# 安装:pip install -r requirements-ml.txt
torch>=2.2
transformers>=4.40
accelerate>=0.30
peft>=0.11
sentencepiece
protobuf
bitsandbytes
# 轻量推理引擎(可选)
# llama-cpp-python␍