Commit Graph

  • 88fec4ffdb Remove failed corpus and associated files from punk library Victor Giers 2026-03-19 23:40:28 +01:00
  • 01d90cfb2c Remove video test files and indexes from backend libraries Victor Giers 2026-03-19 23:38:32 +01:00
  • ea1aec1250 Update corpus and library with processed video data and indexes Victor Giers 2026-03-19 23:37:50 +01:00
  • 97e627221c Add initial video test files and library setup Victor Giers 2026-03-19 23:37:42 +01:00
  • 7c02044f4d Set default whisper device to 'auto' in corpus_builder.py Victor Giers 2026-03-19 23:37:24 +01:00
  • e58b466b2c Add FAISS indexes and update library metadata Victor Giers 2026-03-19 23:36:47 +01:00
  • 6260f5082e Update corpus and library with transcription data Victor Giers 2026-03-19 23:36:42 +01:00
  • c5afab85ae Add initial video test files and library configuration Victor Giers 2026-03-19 23:36:34 +01:00
  • 0935a41174 Change multiprocessing context to 'spawn' in corpus_builder.py Victor Giers 2026-03-19 23:34:08 +01:00
  • 1cacc6e119 Refactor Whisper and Torch imports for lazy loading in corpus_builder.py Victor Giers 2026-03-19 23:33:31 +01:00
  • 1e50fcedac auto-git: [add] backend/libraries/vid/indexes/content.index.faiss [add] backend/libraries/vid/indexes/content.meta.jsonl [change] backend/libraries/vid/library.json Victor Giers 2026-03-19 23:30:23 +01:00
  • 0a9b90d44e auto-git: [add] backend/libraries/vid/indexes/shadow.index.faiss [add] backend/libraries/vid/indexes/shadow.meta.jsonl Victor Giers 2026-03-19 23:28:12 +01:00
  • 1bd5f669ec auto-git: [add] backend/libraries/vid/corpus.jsonl [change] backend/libraries/vid/library.json Victor Giers 2026-03-19 23:28:10 +01:00
  • dbd245ca6c Add and update library.json with new PDF file Victor Giers 2026-03-19 23:28:04 +01:00
  • 6c149172cc Remove failed video file and update library.json Victor Giers 2026-03-19 23:27:53 +01:00
  • e03f5d469e Update library.json with sync error details Victor Giers 2026-03-19 23:26:34 +01:00
  • e045d9e64f Add corpus.jsonl to backend/libraries/vid Victor Giers 2026-03-19 23:26:32 +01:00
  • 171bf21084 Add new video file and update library.json Victor Giers 2026-03-19 23:26:26 +01:00
  • f03b64d91b Remove unused files and update library.json Victor Giers 2026-03-19 23:26:20 +01:00
  • 0fe4eaae0c Update ffmpeg-static version Victor Giers 2026-03-19 23:23:53 +01:00
  • 76f8774d28 Add ffmpeg-static and ffprobe-static to dependencies Victor Giers 2026-03-19 23:23:40 +01:00
  • 4af35c04d7 Change dev:backend script to use run-backend.cjs Victor Giers 2026-03-19 23:22:22 +01:00
  • aaf6e3560e Add run-backend.cjs script for starting the backend Victor Giers 2026-03-19 23:22:19 +01:00
  • 6685814ddb Update ffmpeg and ffprobe path resolution in corpus_builder.py Victor Giers 2026-03-19 23:22:15 +01:00
  • fb37f8cc00 Add binary path resolution and availability checks in corpus_builder.py Victor Giers 2026-03-19 23:22:07 +01:00
  • 7bec9cdc67 Add corpus and update vid library with new file Victor Giers 2026-03-19 23:19:18 +01:00
  • a924f11f05 Add new vid library Victor Giers 2026-03-19 23:19:07 +01:00
  • faf4d4e845 Update sync status and error for punk library Victor Giers 2026-03-19 23:18:37 +01:00
  • fa026991c3 Add new image and update library metadata Victor Giers 2026-03-19 23:18:01 +01:00
  • 2976f30056 Remove unused files and update library.json Victor Giers 2026-03-19 23:15:54 +01:00
  • c03deca3a7 Update library.json with sync error Victor Giers 2026-03-19 23:14:41 +01:00
  • 1013dd2c86 Remove entry from corpus.jsonl Victor Giers 2026-03-19 23:14:21 +01:00
  • 8e34a7236c Remove unused audio file from library.json and stage directory Victor Giers 2026-03-19 23:14:13 +01:00
  • 2ee1f1caed Add new image and update library.json Victor Giers 2026-03-19 23:13:17 +01:00
  • 9d324120ed Add FAISS indexes and update library.json Victor Giers 2026-03-19 23:09:13 +01:00
  • 7bca943849 Update corpus.jsonl and library.json with new data Victor Giers 2026-03-19 23:09:09 +01:00
  • 92759e41d7 Add corpus.jsonl to backend/libraries/punk Victor Giers 2026-03-19 23:08:35 +01:00
  • 1ba6e3be61 Add new audio file to punk library and update library.json Victor Giers 2026-03-19 23:08:22 +01:00
  • 3e74dd711b Remove failed audio file and update library.json Victor Giers 2026-03-19 23:08:14 +01:00
  • 6000fabfc0 Add openai-whisper to requirements.txt Victor Giers 2026-03-19 23:05:27 +01:00
  • a25dd93be2 Add new audio file and update library metadata Victor Giers 2026-03-19 23:04:22 +01:00
  • f2c018d993 Remove unused files and update library.json Victor Giers 2026-03-19 23:04:14 +01:00
  • b772c4bcc2 Comment out optional dependencies in requirements.txt Victor Giers 2026-03-19 23:02:45 +01:00
  • 09589bf37f Enhance error handling in corpus build process Victor Giers 2026-03-19 23:01:47 +01:00
  • 927f2033bf Add runtime error handling for whisper package in corpus_builder.py Victor Giers 2026-03-19 23:01:42 +01:00
  • 47f1e165da Add new audio file and update library metadata Victor Giers 2026-03-19 22:58:49 +01:00
  • 6e808bf367 Add punk library configuration Victor Giers 2026-03-19 22:57:32 +01:00
  • e0649ebac6 Add on_stream parameter to run_cli and output_or_answer functions Victor Giers 2026-03-19 22:54:07 +01:00
  • 85073ebbad auto-git: [add] backend/libraries/lkj/indexes/content.index.faiss [add] backend/libraries/lkj/indexes/content.meta.jsonl [change] backend/libraries/lkj/library.json Victor Giers 2026-03-19 22:44:55 +01:00
  • aa4d719fb2 auto-git: [add] backend/libraries/lkj/indexes/shadow.index.faiss [add] backend/libraries/lkj/indexes/shadow.meta.jsonl Victor Giers 2026-03-19 22:44:29 +01:00
  • 5cd7702ae8 auto-git: [add] backend/libraries/lkj/corpus.jsonl [add] backend/libraries/lkj/stage/19f1e5d2ceaab5fd1f1dc58ff07422388f156610d16dfdea2bdb35a5b9e70813--GeorgeJordac-TheVoiceOfHumanJustice.pdf [change] backend/libraries/lkj/library.json Victor Giers 2026-03-19 22:44:25 +01:00
  • ac2e48557e auto-git: [add] backend/libraries/lkj/library.json Victor Giers 2026-03-19 22:44:20 +01:00
  • a8f985768f Remove library.json from backend/libraries/lkj Victor Giers 2026-03-19 22:44:15 +01:00
  • ba8232bcef auto-git: [change] backend/libraries/lkj/library.json [unlink] backend/libraries/lkj/corpus.enhanced.jsonl [unlink] backend/libraries/lkj/corpus.enrich-input.jsonl [unlink] backend/libraries/lkj/corpus.jsonl [unlink] backend/libraries/lkj/corpus.shadow.partial.jsonl [unlink] backend/libraries/lkj/indexes/content.index.faiss [unlink] backend/libraries/lkj/indexes/content.meta.jsonl [unlink] backend/libraries/lkj/indexes/shadow.index.faiss [unlink] backend/libraries/lkj/indexes/shadow.meta.jsonl [unlink] backend/libraries/lkj/stage/19f1e5d2ceaab5fd1f1dc58ff07422388f156610d16dfdea2bdb35a5b9e70813--GeorgeJordac-TheVoiceOfHumanJustice.pdf Victor Giers 2026-03-19 22:44:10 +01:00
  • 8f969d8a44 auto-git: [change] backend/local_rag.py Victor Giers 2026-03-19 22:43:25 +01:00
  • db848ca86e Refactor content chunking logic in index_builder.py Victor Giers 2026-03-19 22:42:45 +01:00
  • dad1e54b34 auto-git: [change] backend/rag/index_builder.py Victor Giers 2026-03-19 22:42:02 +01:00
  • 51ada7f094 auto-git: [add] backend/libraries/lkj/corpus.enhanced.jsonl [add] backend/libraries/lkj/corpus.enrich-input.jsonl [add] backend/libraries/lkj/corpus.shadow.partial.jsonl [change] backend/libraries/lkj/library.json Victor Giers 2026-03-19 22:41:19 +01:00
  • 3f5a60a560 auto-git: [add] backend/libraries/lkj/indexes/content.index.faiss [add] backend/libraries/lkj/indexes/content.meta.jsonl [change] backend/libraries/lkj/library.json Victor Giers 2026-03-19 22:36:49 +01:00
  • 5e62c8d053 auto-git: [add] backend/libraries/lkj/indexes/shadow.index.faiss [add] backend/libraries/lkj/indexes/shadow.meta.jsonl Victor Giers 2026-03-19 22:36:24 +01:00
  • f53f3f29b2 auto-git: [add] backend/libraries/lkj/corpus.jsonl [add] backend/libraries/lkj/stage/19f1e5d2ceaab5fd1f1dc58ff07422388f156610d16dfdea2bdb35a5b9e70813--GeorgeJordac-TheVoiceOfHumanJustice.pdf [change] backend/libraries/lkj/library.json Victor Giers 2026-03-19 22:36:23 +01:00
  • 727fb2112b auto-git: [change] backend/libraries/lkj/library.json [unlink] backend/libraries/lkj/corpus.jsonl [unlink] backend/libraries/lkj/stage/19f1e5d2ceaab5fd1f1dc58ff07422388f156610d16dfdea2bdb35a5b9e70813--GeorgeJordac-TheVoiceOfHumanJustice.pdf Victor Giers 2026-03-19 22:36:16 +01:00
  • f86989e722 Update library embedding and context handling to use pipeline metadata Victor Giers 2026-03-19 22:34:47 +01:00
  • b2e487262c Enhance prepare pipeline with embed model options Victor Giers 2026-03-19 22:34:38 +01:00
  • c462585543 Add embed_model to prepare pipeline response Victor Giers 2026-03-19 22:34:29 +01:00
  • 49f6b14c24 Update embed model handling in local_rag.py Victor Giers 2026-03-19 22:34:26 +01:00
  • aff44c76b8 Add function to set pipeline embed model in local_rag.py Victor Giers 2026-03-19 22:34:22 +01:00
  • e8b9a437d5 Update default embedding model and modify request models in local_rag.py and unified_rag.py Victor Giers 2026-03-19 22:34:16 +01:00
  • dce97b45cb Update index_builder.py to use ollama_embeddings and resolve models Victor Giers 2026-03-19 22:34:00 +01:00
  • 785a46e5a3 Add ollama_embeddings.py for embedding functionality Victor Giers 2026-03-19 22:33:41 +01:00
  • b05f167b01 auto-git: [add] backend/libraries/lkj/corpus.jsonl [add] backend/libraries/lkj/library.json [add] backend/libraries/lkj/stage/19f1e5d2ceaab5fd1f1dc58ff07422388f156610d16dfdea2bdb35a5b9e70813--GeorgeJordac-TheVoiceOfHumanJustice.pdf [unlink] backend/libraries/punk/corpus.jsonl [unlink] backend/libraries/punk/library.json [unlink] backend/libraries/punk/stage/fe1ee500c3ff911e2d19d19271e81067108f898640e409df4b7c0db54752dd0a--backfire-basics-german.pdf Victor Giers 2026-03-19 22:32:36 +01:00
  • b3c00e3e5c auto-git: [change] backend/libraries/punk/corpus.jsonl [change] backend/libraries/punk/library.json [unlink] backend/libraries/punk/stage/259b04f8f364d7dc890f081b366e2c324d3c1ec04ac5d0ca92a5acce70f9e630--Dramatic_structure_-_Wikipedia.pdf Victor Giers 2026-03-19 22:30:35 +01:00
  • 9a92344387 Disable language detection in corpus building process Victor Giers 2026-03-19 22:29:58 +01:00
  • c5c3209d21 auto-git: [add] backend/libraries/punk/stage/259b04f8f364d7dc890f081b366e2c324d3c1ec04ac5d0ca92a5acce70f9e630--Dramatic_structure_-_Wikipedia.pdf [change] backend/libraries/punk/corpus.jsonl [change] backend/libraries/punk/library.json Victor Giers 2026-03-19 22:27:57 +01:00
  • 47299cc4b6 Add new PDF document and update library metadata Victor Giers 2026-03-19 22:27:30 +01:00
  • fbefbda31f auto-git: [change] backend/libraries/punk/library.json [unlink] backend/libraries/punk/corpus.jsonl [unlink] backend/libraries/punk/stage/19f1e5d2ceaab5fd1f1dc58ff07422388f156610d16dfdea2bdb35a5b9e70813--GeorgeJordac-TheVoiceOfHumanJustice.pdf Victor Giers 2026-03-19 22:27:23 +01:00
  • 9f95b68687 auto-git: [change] backend/libraries/punk/corpus.jsonl [change] backend/libraries/punk/library.json Victor Giers 2026-03-19 22:17:31 +01:00
  • fa7a32d913 Add corpus and update library with new file Victor Giers 2026-03-19 22:17:23 +01:00
  • 1c3a8edfa3 Add punk library configuration Victor Giers 2026-03-19 22:16:55 +01:00
  • 43e90f8162 auto-git: [add] dist/assets/index-C-Xr4i3b.js [add] dist/assets/index-CYvoapyR.css [change] dist/index.html [unlink] dist/assets/index-BLvuAcau.css [unlink] dist/assets/index-T4npynoj.js Victor Giers 2026-03-19 22:16:42 +01:00
  • da520af8d2 Clarify placeholder text and syncing note in LibraryManager.jsx Victor Giers 2026-03-19 22:15:39 +01:00
  • 70e083f031 Update sync details in LibraryManager.jsx Victor Giers 2026-03-19 22:15:34 +01:00
  • 15f1729772 Add library file mode styles Victor Giers 2026-03-19 22:15:24 +01:00
  • 8accf4f3b9 Add enrichment toggle and update status messages in LibraryManager.jsx Victor Giers 2026-03-19 22:15:16 +01:00
  • 9abf7b25e6 Update corpus_enricher to auto-detect language if summary_lang is 'auto' Victor Giers 2026-03-19 22:14:55 +01:00
  • 8cd785d1ac Update build_library, enrich_library, and embed_library functions in local_rag.py Victor Giers 2026-03-19 22:14:44 +01:00
  • a95b4c8226 Add file enrichment update endpoint and modify register/remove file methods Victor Giers 2026-03-19 22:14:34 +01:00
  • 0fdebb9100 Rename source_signature to stage_signature in local_rag.py Victor Giers 2026-03-19 22:14:28 +01:00
  • b079d53841 Update local_rag.py to handle enrichment based on file count and improve progress tracking Victor Giers 2026-03-19 22:14:19 +01:00
  • 10ff10dce6 Add functions for enrichment and shadow corpus building Victor Giers 2026-03-19 22:14:06 +01:00
  • 7012998923 Fix signature check in prepare job handling Victor Giers 2026-03-19 22:13:51 +01:00
  • d68b3d284e Add enrichment signature and cleanup functions in local_rag.py Victor Giers 2026-03-19 22:13:42 +01:00
  • b7ab016f8e Add constants and update models in local_rag.py Victor Giers 2026-03-19 22:13:21 +01:00
  • cfcd0f070e Remove backend/libraries/dsa/library.json Victor Giers 2026-03-19 21:57:29 +01:00
  • e2abff960f Remove unused files and update library.json Victor Giers 2026-03-19 21:55:29 +01:00
  • c3ae71ad76 Add new library book and update library.json Victor Giers 2026-03-19 21:52:35 +01:00
  • 6a8bf6f762 Add new corpus files and update library metadata Victor Giers 2026-03-19 21:49:28 +01:00
  • a3a229d958 Add corpus.jsonl and update library.json with new file details Victor Giers 2026-03-19 21:49:22 +01:00
  • d4858ad9f1 Add dsa library and remove kjhj library Victor Giers 2026-03-19 21:49:16 +01:00
  • 469f76fda5 Remove corpus.jsonl and associated files from library.json Victor Giers 2026-03-19 21:49:09 +01:00