Serendipity
832201186d
fix: 修复 11 个代码架构审计问题
...
H1: AppConfig 自定义 __init__ 改用 from_dict() 类方法
H2: list_collections_with_stats 改为从 ChromaDB 直接查询
H3: RateLimiter 过期 key 自动清理, 防止内存泄漏
M1: delete_by_source 区分 ValueError 与真实异常, 记日志
M2: VectorDB 新增 list_collections() 封装方法
M3: _remove_by_source 异常记日志, 不再静默吞掉
M4: CLI 集合回退支持 MD_VECTOR_DB_COLLECTION 环境变量
L1: DEFAULT_CONFIG_PATH 自动从项目根目录解析
L2: ingest 命令内重复 import 移至模块顶部
L3: 新增死循环回归测试 + 密集分隔符分块测试
L4: 统一 logger 名称为 md-vector-db
删除旧版审计文档
测试: 48 passed
2026-07-06 13:16:26 +08:00
Serendipity
b89c6076e1
feat: multi-provider embedder — support OpenAI/DashScope with provider-specific defaults
2026-07-05 01:46:59 +08:00
Serendipity
441ba8ab86
test: add DELETE endpoint tests and ingest integration tests
2026-07-05 01:46:59 +08:00
Serendipity
ad9e5ce449
refactor: strategy-pattern embedder (Local/API), remove global env vars, add batch embedding
2026-07-05 01:46:59 +08:00
Serendipity
2ef0cf4a4e
fix: add path traversal protection to ingest endpoint
2026-07-05 01:46:58 +08:00
Serendipity
5dcf1eed52
fix: remove api_key from config.yaml, read from EMBED_API_KEY env var; unify config path constant
2026-07-05 01:46:58 +08:00
Serendipity
d021390fd3
feat: add FastAPI HTTP API layer
...
- Implement FastAPI server with health, collections, ingest, search, and delete endpoints
- Add Pydantic request models for ingest and search
- Add lazy singleton initialization for DB, embedder, and services
- Support environment variable override for data dir and collection name
- Add integration tests with TestClient and temp directory
- Set TRANSFORMERS_OFFLINE/HF_HUB_OFFLINE for offline model loading in tests
2026-07-05 01:46:44 +08:00
Serendipity
7309b0a437
feat: add semantic search module
...
实现语义检索模块 Searcher 类，支持：
- search(): 向量语义检索，返回格式化结果（含 content、source_file、section_title、heading_level、chunk_index、score 字段）
- get_collection_info(): 获取 collection 统计信息
- list_sources(): 列出已入库源文件
- delete_by_source(): 按源文件删除文档
Co-Authored-By: Claude <noreply@anthropic.com >
2026-07-05 01:46:44 +08:00
Serendipity
757bd8b336
feat: add Markdown splitter and document ingestor
...
- MarkdownSplitter: hybrid splitting by headings then paragraphs
- DocumentIngestor: read MD -> split -> embed -> store with dedup
- All 6 tests passing
2026-07-05 01:46:44 +08:00
Serendipity
f9e5c37d3e
feat: add embedder with local/API dual mode
2026-07-05 01:46:44 +08:00
Serendipity
b756c53e25
feat: add ChromaDB database layer
2026-07-05 01:46:44 +08:00
Serendipity
138c5c1881
feat: add config loading module with YAML support
...
实现应用配置加载模块，支持从 YAML 文件或默认值加载配置。
覆盖 ChromaDB、嵌入模型、文档分块和 HTTP 服务配置。
- src/core/config.py: 配置数据类 (AppConfig/ChromaConfig/EmbedConfig/ChunkConfig/ServerConfig) + load_config 函数
- tests/test_config.py: 5 个单元测试覆盖默认值、API 模式和文件加载
Co-Authored-By: Claude <noreply@anthropic.com >
2026-07-05 01:46:44 +08:00
Serendipity
3eb4b30858
chore: scaffold md-vector-db project structure
2026-07-05 01:46:44 +08:00
Serendipity