Commit Graph

108 Commits

Author SHA1 Message Date
3f5a60a560 auto-git:
[add] backend/libraries/lkj/indexes/content.index.faiss
 [add] backend/libraries/lkj/indexes/content.meta.jsonl
 [change] backend/libraries/lkj/library.json
2026-03-19 22:36:50 +01:00
5e62c8d053 auto-git:
[add] backend/libraries/lkj/indexes/shadow.index.faiss
 [add] backend/libraries/lkj/indexes/shadow.meta.jsonl
2026-03-19 22:36:50 +01:00
f53f3f29b2 auto-git:
[add] backend/libraries/lkj/corpus.jsonl
 [add] backend/libraries/lkj/stage/19f1e5d2ceaab5fd1f1dc58ff07422388f156610d16dfdea2bdb35a5b9e70813--GeorgeJordac-TheVoiceOfHumanJustice.pdf
 [change] backend/libraries/lkj/library.json
2026-03-19 22:36:24 +01:00
727fb2112b auto-git:
[change] backend/libraries/lkj/library.json
 [unlink] backend/libraries/lkj/corpus.jsonl
 [unlink] backend/libraries/lkj/stage/19f1e5d2ceaab5fd1f1dc58ff07422388f156610d16dfdea2bdb35a5b9e70813--GeorgeJordac-TheVoiceOfHumanJustice.pdf
2026-03-19 22:36:17 +01:00
f86989e722 Update library embedding and context handling to use pipeline metadata 2026-03-19 22:35:57 +01:00
b2e487262c Enhance prepare pipeline with embed model options 2026-03-19 22:34:46 +01:00
c462585543 Add embed_model to prepare pipeline response 2026-03-19 22:34:46 +01:00
49f6b14c24 Update embed model handling in local_rag.py 2026-03-19 22:34:46 +01:00
aff44c76b8 Add function to set pipeline embed model in local_rag.py 2026-03-19 22:34:25 +01:00
e8b9a437d5 Update default embedding model and modify request models in local_rag.py and unified_rag.py 2026-03-19 22:34:22 +01:00
dce97b45cb Update index_builder.py to use ollama_embeddings and resolve models 2026-03-19 22:34:16 +01:00
785a46e5a3 Add ollama_embeddings.py for embedding functionality 2026-03-19 22:34:15 +01:00
b05f167b01 auto-git:
[add] backend/libraries/lkj/corpus.jsonl
 [add] backend/libraries/lkj/library.json
 [add] backend/libraries/lkj/stage/19f1e5d2ceaab5fd1f1dc58ff07422388f156610d16dfdea2bdb35a5b9e70813--GeorgeJordac-TheVoiceOfHumanJustice.pdf
 [unlink] backend/libraries/punk/corpus.jsonl
 [unlink] backend/libraries/punk/library.json
 [unlink] backend/libraries/punk/stage/fe1ee500c3ff911e2d19d19271e81067108f898640e409df4b7c0db54752dd0a--backfire-basics-german.pdf
2026-03-19 22:32:36 +01:00
b3c00e3e5c auto-git:
[change] backend/libraries/punk/corpus.jsonl
 [change] backend/libraries/punk/library.json
 [unlink] backend/libraries/punk/stage/259b04f8f364d7dc890f081b366e2c324d3c1ec04ac5d0ca92a5acce70f9e630--Dramatic_structure_-_Wikipedia.pdf
2026-03-19 22:32:36 +01:00
9a92344387 Disable language detection in corpus building process 2026-03-19 22:30:06 +01:00
c5c3209d21 auto-git:
[add] backend/libraries/punk/stage/259b04f8f364d7dc890f081b366e2c324d3c1ec04ac5d0ca92a5acce70f9e630--Dramatic_structure_-_Wikipedia.pdf
 [change] backend/libraries/punk/corpus.jsonl
 [change] backend/libraries/punk/library.json
2026-03-19 22:29:58 +01:00
47299cc4b6 Add new PDF document and update library metadata 2026-03-19 22:27:57 +01:00
fbefbda31f auto-git:
[change] backend/libraries/punk/library.json
 [unlink] backend/libraries/punk/corpus.jsonl
 [unlink] backend/libraries/punk/stage/19f1e5d2ceaab5fd1f1dc58ff07422388f156610d16dfdea2bdb35a5b9e70813--GeorgeJordac-TheVoiceOfHumanJustice.pdf
2026-03-19 22:27:23 +01:00
9f95b68687 auto-git:
[change] backend/libraries/punk/corpus.jsonl
 [change] backend/libraries/punk/library.json
2026-03-19 22:17:31 +01:00
fa7a32d913 Add corpus and update library with new file 2026-03-19 22:17:31 +01:00
1c3a8edfa3 Add punk library configuration 2026-03-19 22:17:31 +01:00
43e90f8162 auto-git:
[add] dist/assets/index-C-Xr4i3b.js
 [add] dist/assets/index-CYvoapyR.css
 [change] dist/index.html
 [unlink] dist/assets/index-BLvuAcau.css
 [unlink] dist/assets/index-T4npynoj.js
2026-03-19 22:16:42 +01:00
da520af8d2 Clarify placeholder text and syncing note in LibraryManager.jsx 2026-03-19 22:16:41 +01:00
70e083f031 Update sync details in LibraryManager.jsx 2026-03-19 22:16:41 +01:00
15f1729772 Add library file mode styles 2026-03-19 22:15:27 +01:00
8accf4f3b9 Add enrichment toggle and update status messages in LibraryManager.jsx 2026-03-19 22:15:24 +01:00
9abf7b25e6 Update corpus_enricher to auto-detect language if summary_lang is 'auto' 2026-03-19 22:15:02 +01:00
8cd785d1ac Update build_library, enrich_library, and embed_library functions in local_rag.py 2026-03-19 22:14:49 +01:00
a95b4c8226 Add file enrichment update endpoint and modify register/remove file methods 2026-03-19 22:14:43 +01:00
0fdebb9100 Rename source_signature to stage_signature in local_rag.py 2026-03-19 22:14:43 +01:00
b079d53841 Update local_rag.py to handle enrichment based on file count and improve progress tracking 2026-03-19 22:14:28 +01:00
10ff10dce6 Add functions for enrichment and shadow corpus building 2026-03-19 22:14:18 +01:00
7012998923 Fix signature check in prepare job handling 2026-03-19 22:14:18 +01:00
d68b3d284e Add enrichment signature and cleanup functions in local_rag.py 2026-03-19 22:13:51 +01:00
b7ab016f8e Add constants and update models in local_rag.py 2026-03-19 22:13:41 +01:00
cfcd0f070e Remove backend/libraries/dsa/library.json 2026-03-19 21:57:40 +01:00
e2abff960f Remove unused files and update library.json 2026-03-19 21:57:29 +01:00
c3ae71ad76 Add new library book and update library.json 2026-03-19 21:52:45 +01:00
6a8bf6f762 Add new corpus files and update library metadata 2026-03-19 21:52:35 +01:00
a3a229d958 Add corpus.jsonl and update library.json with new file details 2026-03-19 21:49:28 +01:00
d4858ad9f1 Add dsa library and remove kjhj library 2026-03-19 21:49:20 +01:00
469f76fda5 Remove corpus.jsonl and associated files from library.json 2026-03-19 21:49:16 +01:00
ade78d6456 auto-git:
[add] backend/libraries/kjhj/corpus.jsonl
 [add] backend/libraries/kjhj/stage/ff8bc28fa4444fd4bf2b3c2f99698a9c5cfc055b215d57190422e044f5e60b00--66_Seduction_Codes.pdf
 [add] dist/assets/index-T4npynoj.js
 [change] backend/libraries/kjhj/library.json
 [change] dist/index.html
 [unlink] backend/libraries/kjhj/stage/87b5e039fa580a8bbb84125fda96570462315b6b65090b43c7392edf53248c0d--assoziierungsabkommen-eu-ukraine--abl-l-161-vom-140529-neu.pdf
 [unlink] dist/assets/index-Bl2Chmww.js
2026-03-19 21:48:28 +01:00
afc6b73015 Add retry sync functionality to LibraryManager.jsx 2026-03-19 21:48:27 +01:00
d28445113c Add tqdm to backend requirements 2026-03-19 21:48:27 +01:00
4ccdfeb9f9 Handle optional tqdm import in index_builder.py 2026-03-19 21:48:27 +01:00
74100a5aaf Add PDF file and update library.json with sync error 2026-03-19 21:47:02 +01:00
33de143501 Add library.json for kjhj 2026-03-19 21:47:02 +01:00
a6be13fd8a Remove Punk library and associated files 2026-03-19 21:46:49 +01:00
cbc9ea42b3 Remove failed sync file and update library.json 2026-03-19 21:46:44 +01:00