tzt
f783878c02
feat(sense): T-G1 Embedder(int8 量化/降级 fail-closed + /v1/embeddings 透传)
- embedder.py:embed() 调 llama-server /v1/embeddings -> 对称 per-vector
int8 量化(scale=127/max|v|,1024 维余弦扰动 ~1e-4 << 1e-2 验收);
超时/连接/非200/空形状 -> EmbedderDown(D-G4 fail-closed);
quantize_int8/cosine_int8 辅助(int8 直接点积,scale 正标量不改方向)
- routes.py 拆双路由组:/sense 前缀组 + /v1 无前缀组(/v1/embeddings
OpenAI 兼容透传,embedder 不可用 503);build_sense_routers 返回列表,
api.py 逐个 include;build_sense_router 保留向后兼容
- 测试 +6:量化余弦误差 200 组 <1e-2/范围/零向量/int8 余弦/
正常量化/三种 fail-closed/透传端点(503+形状+400),全量 381 passed
- 待真机项:llama-server embedder 端点冒烟(需用户配置 embedder.base_url)
2026-09-05 13:33:58 +08:00
..
2026-09-05 08:29:20 +08:00
2026-08-30 21:00:52 +08:00
2026-08-12 10:40:04 +08:00
2026-08-30 21:00:52 +08:00
2026-08-30 21:08:45 +08:00
2026-09-01 23:12:26 +08:00
2026-09-02 00:02:24 +08:00
2026-08-30 21:06:34 +08:00
2026-08-30 21:20:00 +08:00
2026-09-01 08:31:47 +08:00
2026-09-01 08:31:47 +08:00
2026-09-05 08:28:25 +08:00
2026-09-05 08:28:25 +08:00
2026-09-05 08:28:25 +08:00
2026-09-01 11:45:33 +08:00
2026-08-30 21:00:52 +08:00
2026-09-05 08:28:25 +08:00
2026-09-05 08:28:25 +08:00
2026-09-05 08:28:25 +08:00
2026-08-30 21:00:52 +08:00
2026-09-01 08:51:52 +08:00
2026-09-05 08:28:25 +08:00
2026-08-30 21:12:03 +08:00
2026-09-05 08:28:25 +08:00
2026-08-30 21:16:02 +08:00
2026-09-05 09:05:59 +08:00
2026-09-05 09:05:59 +08:00
2026-09-05 09:40:05 +08:00
2026-09-05 09:18:51 +08:00
2026-09-05 09:35:12 +08:00
2026-09-05 08:35:31 +08:00
2026-09-05 09:14:31 +08:00
2026-08-30 21:12:52 +08:00
2026-09-05 08:28:25 +08:00
2026-09-01 08:31:47 +08:00
2026-09-05 08:28:25 +08:00
2026-09-02 00:01:33 +08:00
2026-09-05 13:33:58 +08:00
2026-09-05 11:07:04 +08:00
2026-08-30 21:58:41 +08:00
2026-08-30 21:17:22 +08:00
2026-09-05 08:28:25 +08:00
2026-09-01 23:41:45 +08:00
2026-09-01 23:12:26 +08:00
2026-08-30 21:15:19 +08:00
2026-08-30 21:08:45 +08:00
2026-08-30 21:03:52 +08:00