diff --git a/.gitignore b/.gitignore index 5335383..f391306 100644 --- a/.gitignore +++ b/.gitignore @@ -13,6 +13,7 @@ storage/uploads/ storage/results/ storage/assets/ output/ +RAG_data/ # IDE / local agent / task notes (keep local only) .idea/ diff --git a/README.md b/README.md index 85023ab..15b1ce1 100644 --- a/README.md +++ b/README.md @@ -428,7 +428,10 @@ hits, n = recall_chunks("login password", result.chunks, top_k=5) ## 后续计划 -- [ ] PDF OCR / 视觉描述增强 +- [ ] **按文档类型提供专用 Chunk 模板**:在现有通用、按行和标识符切分的基础上,为论文、书籍、法律法规、演示文稿、问答和表格等文档提供结构感知的模板,并保留章节路径、页码、内容类型等元数据。 +- [ ] **参考 RAGFlow DeepDoc 完善文档理解层**:在切分前统一完成 OCR、版面分析、表格结构识别、图片/图注关联和文档结构恢复,输出标准化 Block / Document Tree,供不同 Chunk 模板复用。 +- [ ] **完善 OCR 精准识别**:增强扫描 PDF、文档内嵌图片和复杂背景图片的文字识别,补充方向校正、语言检测、置信度过滤与识别结果回填,并建立可量化的准确率评测集。 +- [ ] **引入 Layout Detection 设计**:识别标题、正文、列表、表格、图片、图注、页眉和页脚等版面区域,结合坐标恢复多栏阅读顺序,并保证图片、表格与上下文在切片中的相对位置。 - [ ] 向量召回(Embedding) - [ ] wps 格式支持 diff --git a/自研RAG代表文档/G3SB HK Procedures of CRS v1.3.pdf b/自研RAG代表文档/G3SB HK Procedures of CRS v1.3.pdf deleted file mode 100644 index 6892964..0000000 Binary files a/自研RAG代表文档/G3SB HK Procedures of CRS v1.3.pdf and /dev/null differ diff --git a/自研RAG代表文档/G3SB HK User Guide-Master.docx b/自研RAG代表文档/G3SB HK User Guide-Master.docx deleted file mode 100644 index 43b4915..0000000 Binary files a/自研RAG代表文档/G3SB HK User Guide-Master.docx and /dev/null differ diff --git a/自研RAG代表文档/H5 SMP 5 User Manual_2025_tc.docx b/自研RAG代表文档/H5 SMP 5 User Manual_2025_tc.docx deleted file mode 100644 index 852af0f..0000000 Binary files a/自研RAG代表文档/H5 SMP 5 User Manual_2025_tc.docx and /dev/null differ diff --git a/自研RAG代表文档/Master Bot FAQ2.0 .docx b/自研RAG代表文档/Master Bot FAQ2.0 .docx deleted file mode 100644 index bd1eb60..0000000 Binary files a/自研RAG代表文档/Master Bot FAQ2.0 .docx and /dev/null differ diff --git a/自研RAG代表文档/N2N-TcProGlobal-UM-Advanced Trading-v1.3.doc b/自研RAG代表文档/N2N-TcProGlobal-UM-Advanced Trading-v1.3.doc deleted file mode 100644 index 665e675..0000000 Binary files a/自研RAG代表文档/N2N-TcProGlobal-UM-Advanced Trading-v1.3.doc and /dev/null differ diff --git a/自研RAG代表文档/N2NQuant运营控制操作手册2025028.docx b/自研RAG代表文档/N2NQuant运营控制操作手册2025028.docx deleted file mode 100644 index c4a5e93..0000000 Binary files a/自研RAG代表文档/N2NQuant运营控制操作手册2025028.docx and /dev/null differ diff --git a/自研RAG代表文档/SMP 5 User Manual_2025_tc .docx b/自研RAG代表文档/SMP 5 User Manual_2025_tc .docx deleted file mode 100644 index 5d913ea..0000000 Binary files a/自研RAG代表文档/SMP 5 User Manual_2025_tc .docx and /dev/null differ