Commit Graph

143 Commits

Author SHA1 Message Date
7bbdd1ac6d Refactor title sanitization logic in backend/main.py 2026-03-20 16:26:09 +01:00
55974b90fd Add startup model preparation endpoint and update Whisper handling 2026-03-20 15:43:10 +01:00
13f2fb9306 Update backend/ollama_admin.py to include Whisper model checks and preparation 2026-03-20 15:43:00 +01:00
776a3c11b4 Add backend/whisper_admin.py for managing Whisper models 2026-03-20 15:43:00 +01:00
6be438519c added embedding model selection 2026-03-20 12:00:44 +01:00
fecd101fd0 Add library purge functionality in backend and frontend 2026-03-20 10:33:58 +01:00
d24ea89ed1 Add app settings management and update API URL handling 2026-03-20 08:16:40 +01:00
5923dd002a auto-git:
[unlink] backend/libraries/lkj/corpus.jsonl
 [unlink] backend/libraries/lkj/indexes/content.index.faiss
 [unlink] backend/libraries/lkj/indexes/content.meta.jsonl
 [unlink] backend/libraries/lkj/indexes/shadow.index.faiss
 [unlink] backend/libraries/lkj/indexes/shadow.meta.jsonl
 [unlink] backend/libraries/lkj/library.json
 [unlink] backend/libraries/lkj/stage/19f1e5d2ceaab5fd1f1dc58ff07422388f156610d16dfdea2bdb35a5b9e70813--GeorgeJordac-TheVoiceOfHumanJustice.pdf
 [unlink] backend/libraries/punk/corpus.jsonl
 [unlink] backend/libraries/punk/indexes/content.index.faiss
 [unlink] backend/libraries/punk/indexes/content.meta.jsonl
 [unlink] backend/libraries/punk/indexes/shadow.index.faiss
 [unlink] backend/libraries/punk/indexes/shadow.meta.jsonl
 [unlink] backend/libraries/punk/library.json
 [unlink] backend/libraries/punk/stage/87b5e039fa580a8bbb84125fda96570462315b6b65090b43c7392edf53248c0d--assoziierungsabkommen-eu-ukraine--abl-l-161-vom-140529-neu.pdf
 [unlink] backend/libraries/vid/corpus.jsonl
 [unlink] backend/libraries/vid/indexes/content.index.faiss
 [unlink] backend/libraries/vid/indexes/content.meta.jsonl
 [unlink] backend/libraries/vid/indexes/shadow.index.faiss
 [unlink] backend/libraries/vid/indexes/shadow.meta.jsonl
 [unlink] backend/libraries/vid/library.json
 [unlink] backend/libraries/vid/stage/bd0f618ae2c977bda2ea78bfa45dfae8a5e93b77e1fbd5d1bde44691a1ec1bb0--3_Meter_Processor_Unit_shorts.mp4
2026-03-20 00:38:03 +01:00
5b76f56a54 auto-git:
[add] backend/libraries/punk/indexes/content.index.faiss
 [add] backend/libraries/punk/indexes/content.meta.jsonl
 [change] backend/libraries/punk/library.json
2026-03-20 00:04:08 +01:00
d994a67b9c auto-git:
[add] backend/libraries/punk/indexes/shadow.index.faiss
 [add] backend/libraries/punk/indexes/shadow.meta.jsonl
 [change] backend/libraries/punk/corpus.jsonl
 [change] backend/libraries/punk/library.json
2026-03-20 00:02:48 +01:00
c4ce39d78b Add new PDF document and update library metadata 2026-03-20 00:01:45 +01:00
6464d54ca4 Remove failed entry and associated file from library.json 2026-03-19 23:52:17 +01:00
fe97d634fe Update sync status and add error message in library.json 2026-03-19 23:52:17 +01:00
8e283afb7d Add script and update library files 2026-03-19 23:51:16 +01:00
ec7bc4f626 Update video library with new content and metadata 2026-03-19 23:50:26 +01:00
eaad1362cf Remove outdated video entries and associated files 2026-03-19 23:50:07 +01:00
a35e7bc8a6 Index and update content for new videos 2026-03-19 23:47:13 +01:00
3111b37dc5 Update video library with new entries 2026-03-19 23:47:13 +01:00
e384af86dc Add new video file and update library.json 2026-03-19 23:46:35 +01:00
65d0ee9132 Remove failed sync entry and associated symlink in library.json 2026-03-19 23:46:09 +01:00
908d720d8b Update sync status and error message in library.json 2026-03-19 23:45:35 +01:00
8846b94634 Add new audio file and update library metadata 2026-03-19 23:44:02 +01:00
304ebb7698 auto-git:
[change] backend/libraries/vid/corpus.jsonl
 [change] backend/libraries/vid/indexes/content.index.faiss
 [change] backend/libraries/vid/indexes/content.meta.jsonl
 [change] backend/libraries/vid/indexes/shadow.index.faiss
 [change] backend/libraries/vid/indexes/shadow.meta.jsonl
 [change] backend/libraries/vid/library.json
2026-03-19 23:41:12 +01:00
ceffe6fd0c Remove a PDF file from library.json and stage directory 2026-03-19 23:41:11 +01:00
9426e83fa6 Update sync status and add error message for a video file 2026-03-19 23:41:11 +01:00
25ae774ec3 auto-git:
[add] backend/libraries/vid/stage/bd0f618ae2c977bda2ea78bfa45dfae8a5e93b77e1fbd5d1bde44691a1ec1bb0--3_Meter_Processor_Unit_shorts.mp4
 [change] backend/libraries/vid/corpus.jsonl
 [change] backend/libraries/vid/library.json
2026-03-19 23:40:41 +01:00
88fec4ffdb Remove failed corpus and associated files from punk library 2026-03-19 23:40:36 +01:00
01d90cfb2c Remove video test files and indexes from backend libraries 2026-03-19 23:39:08 +01:00
ea1aec1250 Update corpus and library with processed video data and indexes 2026-03-19 23:38:13 +01:00
97e627221c Add initial video test files and library setup 2026-03-19 23:38:13 +01:00
7c02044f4d Set default whisper device to 'auto' in corpus_builder.py 2026-03-19 23:38:13 +01:00
e58b466b2c Add FAISS indexes and update library metadata 2026-03-19 23:37:13 +01:00
6260f5082e Update corpus and library with transcription data 2026-03-19 23:37:13 +01:00
c5afab85ae Add initial video test files and library configuration 2026-03-19 23:37:13 +01:00
0935a41174 Change multiprocessing context to 'spawn' in corpus_builder.py 2026-03-19 23:35:25 +01:00
1cacc6e119 Refactor Whisper and Torch imports for lazy loading in corpus_builder.py 2026-03-19 23:33:42 +01:00
1e50fcedac auto-git:
[add] backend/libraries/vid/indexes/content.index.faiss
 [add] backend/libraries/vid/indexes/content.meta.jsonl
 [change] backend/libraries/vid/library.json
2026-03-19 23:30:23 +01:00
0a9b90d44e auto-git:
[add] backend/libraries/vid/indexes/shadow.index.faiss
 [add] backend/libraries/vid/indexes/shadow.meta.jsonl
2026-03-19 23:29:12 +01:00
1bd5f669ec auto-git:
[add] backend/libraries/vid/corpus.jsonl
 [change] backend/libraries/vid/library.json
2026-03-19 23:29:12 +01:00
dbd245ca6c Add and update library.json with new PDF file 2026-03-19 23:28:10 +01:00
6c149172cc Remove failed video file and update library.json 2026-03-19 23:27:58 +01:00
e03f5d469e Update library.json with sync error details 2026-03-19 23:27:40 +01:00
e045d9e64f Add corpus.jsonl to backend/libraries/vid 2026-03-19 23:27:40 +01:00
171bf21084 Add new video file and update library.json 2026-03-19 23:26:32 +01:00
f03b64d91b Remove unused files and update library.json 2026-03-19 23:26:26 +01:00
6685814ddb Update ffmpeg and ffprobe path resolution in corpus_builder.py 2026-03-19 23:23:27 +01:00
fb37f8cc00 Add binary path resolution and availability checks in corpus_builder.py 2026-03-19 23:22:15 +01:00
7bec9cdc67 Add corpus and update vid library with new file 2026-03-19 23:19:45 +01:00
a924f11f05 Add new vid library 2026-03-19 23:19:45 +01:00
faf4d4e845 Update sync status and error for punk library 2026-03-19 23:19:45 +01:00