Commit Graph

320 Commits

Author SHA1 Message Date
6e808bf367 Add punk library configuration 2026-03-19 22:58:45 +01:00
e0649ebac6 Add on_stream parameter to run_cli and output_or_answer functions 2026-03-19 22:55:30 +01:00
85073ebbad auto-git:
[add] backend/libraries/lkj/indexes/content.index.faiss
 [add] backend/libraries/lkj/indexes/content.meta.jsonl
 [change] backend/libraries/lkj/library.json
2026-03-19 22:44:55 +01:00
aa4d719fb2 auto-git:
[add] backend/libraries/lkj/indexes/shadow.index.faiss
 [add] backend/libraries/lkj/indexes/shadow.meta.jsonl
2026-03-19 22:44:55 +01:00
5cd7702ae8 auto-git:
[add] backend/libraries/lkj/corpus.jsonl
 [add] backend/libraries/lkj/stage/19f1e5d2ceaab5fd1f1dc58ff07422388f156610d16dfdea2bdb35a5b9e70813--GeorgeJordac-TheVoiceOfHumanJustice.pdf
 [change] backend/libraries/lkj/library.json
2026-03-19 22:44:25 +01:00
ac2e48557e auto-git:
[add] backend/libraries/lkj/library.json
2026-03-19 22:44:25 +01:00
a8f985768f Remove library.json from backend/libraries/lkj 2026-03-19 22:44:19 +01:00
ba8232bcef auto-git:
[change] backend/libraries/lkj/library.json
 [unlink] backend/libraries/lkj/corpus.enhanced.jsonl
 [unlink] backend/libraries/lkj/corpus.enrich-input.jsonl
 [unlink] backend/libraries/lkj/corpus.jsonl
 [unlink] backend/libraries/lkj/corpus.shadow.partial.jsonl
 [unlink] backend/libraries/lkj/indexes/content.index.faiss
 [unlink] backend/libraries/lkj/indexes/content.meta.jsonl
 [unlink] backend/libraries/lkj/indexes/shadow.index.faiss
 [unlink] backend/libraries/lkj/indexes/shadow.meta.jsonl
 [unlink] backend/libraries/lkj/stage/19f1e5d2ceaab5fd1f1dc58ff07422388f156610d16dfdea2bdb35a5b9e70813--GeorgeJordac-TheVoiceOfHumanJustice.pdf
2026-03-19 22:44:10 +01:00
8f969d8a44 auto-git:
[change] backend/local_rag.py
2026-03-19 22:44:10 +01:00
db848ca86e Refactor content chunking logic in index_builder.py 2026-03-19 22:43:09 +01:00
dad1e54b34 auto-git:
[change] backend/rag/index_builder.py
2026-03-19 22:42:02 +01:00
51ada7f094 auto-git:
[add] backend/libraries/lkj/corpus.enhanced.jsonl
 [add] backend/libraries/lkj/corpus.enrich-input.jsonl
 [add] backend/libraries/lkj/corpus.shadow.partial.jsonl
 [change] backend/libraries/lkj/library.json
2026-03-19 22:42:02 +01:00
3f5a60a560 auto-git:
[add] backend/libraries/lkj/indexes/content.index.faiss
 [add] backend/libraries/lkj/indexes/content.meta.jsonl
 [change] backend/libraries/lkj/library.json
2026-03-19 22:36:50 +01:00
5e62c8d053 auto-git:
[add] backend/libraries/lkj/indexes/shadow.index.faiss
 [add] backend/libraries/lkj/indexes/shadow.meta.jsonl
2026-03-19 22:36:50 +01:00
f53f3f29b2 auto-git:
[add] backend/libraries/lkj/corpus.jsonl
 [add] backend/libraries/lkj/stage/19f1e5d2ceaab5fd1f1dc58ff07422388f156610d16dfdea2bdb35a5b9e70813--GeorgeJordac-TheVoiceOfHumanJustice.pdf
 [change] backend/libraries/lkj/library.json
2026-03-19 22:36:24 +01:00
727fb2112b auto-git:
[change] backend/libraries/lkj/library.json
 [unlink] backend/libraries/lkj/corpus.jsonl
 [unlink] backend/libraries/lkj/stage/19f1e5d2ceaab5fd1f1dc58ff07422388f156610d16dfdea2bdb35a5b9e70813--GeorgeJordac-TheVoiceOfHumanJustice.pdf
2026-03-19 22:36:17 +01:00
f86989e722 Update library embedding and context handling to use pipeline metadata 2026-03-19 22:35:57 +01:00
b2e487262c Enhance prepare pipeline with embed model options 2026-03-19 22:34:46 +01:00
c462585543 Add embed_model to prepare pipeline response 2026-03-19 22:34:46 +01:00
49f6b14c24 Update embed model handling in local_rag.py 2026-03-19 22:34:46 +01:00
aff44c76b8 Add function to set pipeline embed model in local_rag.py 2026-03-19 22:34:25 +01:00
e8b9a437d5 Update default embedding model and modify request models in local_rag.py and unified_rag.py 2026-03-19 22:34:22 +01:00
dce97b45cb Update index_builder.py to use ollama_embeddings and resolve models 2026-03-19 22:34:16 +01:00
785a46e5a3 Add ollama_embeddings.py for embedding functionality 2026-03-19 22:34:15 +01:00
b05f167b01 auto-git:
[add] backend/libraries/lkj/corpus.jsonl
 [add] backend/libraries/lkj/library.json
 [add] backend/libraries/lkj/stage/19f1e5d2ceaab5fd1f1dc58ff07422388f156610d16dfdea2bdb35a5b9e70813--GeorgeJordac-TheVoiceOfHumanJustice.pdf
 [unlink] backend/libraries/punk/corpus.jsonl
 [unlink] backend/libraries/punk/library.json
 [unlink] backend/libraries/punk/stage/fe1ee500c3ff911e2d19d19271e81067108f898640e409df4b7c0db54752dd0a--backfire-basics-german.pdf
2026-03-19 22:32:36 +01:00
b3c00e3e5c auto-git:
[change] backend/libraries/punk/corpus.jsonl
 [change] backend/libraries/punk/library.json
 [unlink] backend/libraries/punk/stage/259b04f8f364d7dc890f081b366e2c324d3c1ec04ac5d0ca92a5acce70f9e630--Dramatic_structure_-_Wikipedia.pdf
2026-03-19 22:32:36 +01:00
9a92344387 Disable language detection in corpus building process 2026-03-19 22:30:06 +01:00
c5c3209d21 auto-git:
[add] backend/libraries/punk/stage/259b04f8f364d7dc890f081b366e2c324d3c1ec04ac5d0ca92a5acce70f9e630--Dramatic_structure_-_Wikipedia.pdf
 [change] backend/libraries/punk/corpus.jsonl
 [change] backend/libraries/punk/library.json
2026-03-19 22:29:58 +01:00
47299cc4b6 Add new PDF document and update library metadata 2026-03-19 22:27:57 +01:00
fbefbda31f auto-git:
[change] backend/libraries/punk/library.json
 [unlink] backend/libraries/punk/corpus.jsonl
 [unlink] backend/libraries/punk/stage/19f1e5d2ceaab5fd1f1dc58ff07422388f156610d16dfdea2bdb35a5b9e70813--GeorgeJordac-TheVoiceOfHumanJustice.pdf
2026-03-19 22:27:23 +01:00
9f95b68687 auto-git:
[change] backend/libraries/punk/corpus.jsonl
 [change] backend/libraries/punk/library.json
2026-03-19 22:17:31 +01:00
fa7a32d913 Add corpus and update library with new file 2026-03-19 22:17:31 +01:00
1c3a8edfa3 Add punk library configuration 2026-03-19 22:17:31 +01:00
43e90f8162 auto-git:
[add] dist/assets/index-C-Xr4i3b.js
 [add] dist/assets/index-CYvoapyR.css
 [change] dist/index.html
 [unlink] dist/assets/index-BLvuAcau.css
 [unlink] dist/assets/index-T4npynoj.js
2026-03-19 22:16:42 +01:00
da520af8d2 Clarify placeholder text and syncing note in LibraryManager.jsx 2026-03-19 22:16:41 +01:00
70e083f031 Update sync details in LibraryManager.jsx 2026-03-19 22:16:41 +01:00
15f1729772 Add library file mode styles 2026-03-19 22:15:27 +01:00
8accf4f3b9 Add enrichment toggle and update status messages in LibraryManager.jsx 2026-03-19 22:15:24 +01:00
9abf7b25e6 Update corpus_enricher to auto-detect language if summary_lang is 'auto' 2026-03-19 22:15:02 +01:00
8cd785d1ac Update build_library, enrich_library, and embed_library functions in local_rag.py 2026-03-19 22:14:49 +01:00
a95b4c8226 Add file enrichment update endpoint and modify register/remove file methods 2026-03-19 22:14:43 +01:00
0fdebb9100 Rename source_signature to stage_signature in local_rag.py 2026-03-19 22:14:43 +01:00
b079d53841 Update local_rag.py to handle enrichment based on file count and improve progress tracking 2026-03-19 22:14:28 +01:00
10ff10dce6 Add functions for enrichment and shadow corpus building 2026-03-19 22:14:18 +01:00
7012998923 Fix signature check in prepare job handling 2026-03-19 22:14:18 +01:00
d68b3d284e Add enrichment signature and cleanup functions in local_rag.py 2026-03-19 22:13:51 +01:00
b7ab016f8e Add constants and update models in local_rag.py 2026-03-19 22:13:41 +01:00
cfcd0f070e Remove backend/libraries/dsa/library.json 2026-03-19 21:57:40 +01:00
e2abff960f Remove unused files and update library.json 2026-03-19 21:57:29 +01:00
c3ae71ad76 Add new library book and update library.json 2026-03-19 21:52:45 +01:00