Commit Graph

142 Commits

Author SHA1 Message Date
fb37f8cc00 Add binary path resolution and availability checks in corpus_builder.py 2026-03-19 23:22:15 +01:00
7bec9cdc67 Add corpus and update vid library with new file 2026-03-19 23:19:45 +01:00
a924f11f05 Add new vid library 2026-03-19 23:19:45 +01:00
faf4d4e845 Update sync status and error for punk library 2026-03-19 23:19:45 +01:00
fa026991c3 Add new image and update library metadata 2026-03-19 23:18:07 +01:00
2976f30056 Remove unused files and update library.json 2026-03-19 23:16:07 +01:00
c03deca3a7 Update library.json with sync error 2026-03-19 23:15:43 +01:00
1013dd2c86 Remove entry from corpus.jsonl 2026-03-19 23:15:43 +01:00
8e34a7236c Remove unused audio file from library.json and stage directory 2026-03-19 23:14:21 +01:00
2ee1f1caed Add new image and update library.json 2026-03-19 23:13:32 +01:00
9d324120ed Add FAISS indexes and update library.json 2026-03-19 23:09:35 +01:00
7bca943849 Update corpus.jsonl and library.json with new data 2026-03-19 23:09:35 +01:00
92759e41d7 Add corpus.jsonl to backend/libraries/punk 2026-03-19 23:09:35 +01:00
1ba6e3be61 Add new audio file to punk library and update library.json 2026-03-19 23:08:27 +01:00
3e74dd711b Remove failed audio file and update library.json 2026-03-19 23:08:22 +01:00
6000fabfc0 Add openai-whisper to requirements.txt 2026-03-19 23:06:31 +01:00
a25dd93be2 Add new audio file and update library metadata 2026-03-19 23:04:27 +01:00
f2c018d993 Remove unused files and update library.json 2026-03-19 23:04:21 +01:00
b772c4bcc2 Comment out optional dependencies in requirements.txt 2026-03-19 23:02:54 +01:00
09589bf37f Enhance error handling in corpus build process 2026-03-19 23:02:54 +01:00
927f2033bf Add runtime error handling for whisper package in corpus_builder.py 2026-03-19 23:01:47 +01:00
47f1e165da Add new audio file and update library metadata 2026-03-19 22:58:55 +01:00
6e808bf367 Add punk library configuration 2026-03-19 22:58:45 +01:00
e0649ebac6 Add on_stream parameter to run_cli and output_or_answer functions 2026-03-19 22:55:30 +01:00
85073ebbad auto-git:
[add] backend/libraries/lkj/indexes/content.index.faiss
 [add] backend/libraries/lkj/indexes/content.meta.jsonl
 [change] backend/libraries/lkj/library.json
2026-03-19 22:44:55 +01:00
aa4d719fb2 auto-git:
[add] backend/libraries/lkj/indexes/shadow.index.faiss
 [add] backend/libraries/lkj/indexes/shadow.meta.jsonl
2026-03-19 22:44:55 +01:00
5cd7702ae8 auto-git:
[add] backend/libraries/lkj/corpus.jsonl
 [add] backend/libraries/lkj/stage/19f1e5d2ceaab5fd1f1dc58ff07422388f156610d16dfdea2bdb35a5b9e70813--GeorgeJordac-TheVoiceOfHumanJustice.pdf
 [change] backend/libraries/lkj/library.json
2026-03-19 22:44:25 +01:00
ac2e48557e auto-git:
[add] backend/libraries/lkj/library.json
2026-03-19 22:44:25 +01:00
a8f985768f Remove library.json from backend/libraries/lkj 2026-03-19 22:44:19 +01:00
ba8232bcef auto-git:
[change] backend/libraries/lkj/library.json
 [unlink] backend/libraries/lkj/corpus.enhanced.jsonl
 [unlink] backend/libraries/lkj/corpus.enrich-input.jsonl
 [unlink] backend/libraries/lkj/corpus.jsonl
 [unlink] backend/libraries/lkj/corpus.shadow.partial.jsonl
 [unlink] backend/libraries/lkj/indexes/content.index.faiss
 [unlink] backend/libraries/lkj/indexes/content.meta.jsonl
 [unlink] backend/libraries/lkj/indexes/shadow.index.faiss
 [unlink] backend/libraries/lkj/indexes/shadow.meta.jsonl
 [unlink] backend/libraries/lkj/stage/19f1e5d2ceaab5fd1f1dc58ff07422388f156610d16dfdea2bdb35a5b9e70813--GeorgeJordac-TheVoiceOfHumanJustice.pdf
2026-03-19 22:44:10 +01:00
8f969d8a44 auto-git:
[change] backend/local_rag.py
2026-03-19 22:44:10 +01:00
db848ca86e Refactor content chunking logic in index_builder.py 2026-03-19 22:43:09 +01:00
dad1e54b34 auto-git:
[change] backend/rag/index_builder.py
2026-03-19 22:42:02 +01:00
51ada7f094 auto-git:
[add] backend/libraries/lkj/corpus.enhanced.jsonl
 [add] backend/libraries/lkj/corpus.enrich-input.jsonl
 [add] backend/libraries/lkj/corpus.shadow.partial.jsonl
 [change] backend/libraries/lkj/library.json
2026-03-19 22:42:02 +01:00
3f5a60a560 auto-git:
[add] backend/libraries/lkj/indexes/content.index.faiss
 [add] backend/libraries/lkj/indexes/content.meta.jsonl
 [change] backend/libraries/lkj/library.json
2026-03-19 22:36:50 +01:00
5e62c8d053 auto-git:
[add] backend/libraries/lkj/indexes/shadow.index.faiss
 [add] backend/libraries/lkj/indexes/shadow.meta.jsonl
2026-03-19 22:36:50 +01:00
f53f3f29b2 auto-git:
[add] backend/libraries/lkj/corpus.jsonl
 [add] backend/libraries/lkj/stage/19f1e5d2ceaab5fd1f1dc58ff07422388f156610d16dfdea2bdb35a5b9e70813--GeorgeJordac-TheVoiceOfHumanJustice.pdf
 [change] backend/libraries/lkj/library.json
2026-03-19 22:36:24 +01:00
727fb2112b auto-git:
[change] backend/libraries/lkj/library.json
 [unlink] backend/libraries/lkj/corpus.jsonl
 [unlink] backend/libraries/lkj/stage/19f1e5d2ceaab5fd1f1dc58ff07422388f156610d16dfdea2bdb35a5b9e70813--GeorgeJordac-TheVoiceOfHumanJustice.pdf
2026-03-19 22:36:17 +01:00
f86989e722 Update library embedding and context handling to use pipeline metadata 2026-03-19 22:35:57 +01:00
b2e487262c Enhance prepare pipeline with embed model options 2026-03-19 22:34:46 +01:00
c462585543 Add embed_model to prepare pipeline response 2026-03-19 22:34:46 +01:00
49f6b14c24 Update embed model handling in local_rag.py 2026-03-19 22:34:46 +01:00
aff44c76b8 Add function to set pipeline embed model in local_rag.py 2026-03-19 22:34:25 +01:00
e8b9a437d5 Update default embedding model and modify request models in local_rag.py and unified_rag.py 2026-03-19 22:34:22 +01:00
dce97b45cb Update index_builder.py to use ollama_embeddings and resolve models 2026-03-19 22:34:16 +01:00
785a46e5a3 Add ollama_embeddings.py for embedding functionality 2026-03-19 22:34:15 +01:00
b05f167b01 auto-git:
[add] backend/libraries/lkj/corpus.jsonl
 [add] backend/libraries/lkj/library.json
 [add] backend/libraries/lkj/stage/19f1e5d2ceaab5fd1f1dc58ff07422388f156610d16dfdea2bdb35a5b9e70813--GeorgeJordac-TheVoiceOfHumanJustice.pdf
 [unlink] backend/libraries/punk/corpus.jsonl
 [unlink] backend/libraries/punk/library.json
 [unlink] backend/libraries/punk/stage/fe1ee500c3ff911e2d19d19271e81067108f898640e409df4b7c0db54752dd0a--backfire-basics-german.pdf
2026-03-19 22:32:36 +01:00
b3c00e3e5c auto-git:
[change] backend/libraries/punk/corpus.jsonl
 [change] backend/libraries/punk/library.json
 [unlink] backend/libraries/punk/stage/259b04f8f364d7dc890f081b366e2c324d3c1ec04ac5d0ca92a5acce70f9e630--Dramatic_structure_-_Wikipedia.pdf
2026-03-19 22:32:36 +01:00
9a92344387 Disable language detection in corpus building process 2026-03-19 22:30:06 +01:00
c5c3209d21 auto-git:
[add] backend/libraries/punk/stage/259b04f8f364d7dc890f081b366e2c324d3c1ec04ac5d0ca92a5acce70f9e630--Dramatic_structure_-_Wikipedia.pdf
 [change] backend/libraries/punk/corpus.jsonl
 [change] backend/libraries/punk/library.json
2026-03-19 22:29:58 +01:00