Commit Graph

487 Commits

Author SHA1 Message Date
bb2e0c08e2 Feat(video): Implement full video ingestion pipeline using yt-dlp, Whisper transcription, and LLM summarization; updates Ollama client to support options. 2026-06-15 06:13:06 +02:00
912c63468b Refactor: Clean up formatting for autoDeepEnrichment variable assignment 2026-06-15 04:42:51 +02:00
88c4a5b0d4 Feat: Add automatic deep enrichment feature
Implements logic and UI for automatically queuing deep enrichment (Q&A generation) after content indexing, updating settings across backend, frontend, and desktop layers.
2026-06-15 04:41:31 +02:00
36b6b84129 Fix KMP duplicate lib error on macOS for dependencies (PyTorch/FAISS) 2026-06-15 04:07:37 +02:00
4db6fde9be Feature: Implement knowledge base saving for chat messages
Adds functionality to save selected chat messages into an external knowledge database, including new dialog components, state management in App.jsx, updated history syncing, and necessary UI/UX improvements.
2026-06-15 03:53:44 +02:00
d0e5c9300c Feature: Add full support for handling, indexing, and saving chat message content to the knowledge base. 2026-06-15 03:51:56 +02:00
937cd3c6f4 Refactor: Simplify formatting for model setting definitions across default, migration, and normalization functions 2026-06-15 02:43:34 +02:00
c4956fa69e Introduce metadata versioning and upgrade logic for local library reading 2026-06-15 02:43:17 +02:00
d3c4f45501 Feature: Implement Knowledge Metadata Model and enhance library item display with rich metadata (Q&A, model details) 2026-06-15 02:42:47 +02:00
bfb7f870c6 Feat: Add and integrate enrichment model support across backend and frontend 2026-06-15 02:42:18 +02:00
26ef19f4c6 Clear query locks during library purge and deletion 2026-06-15 02:18:13 +02:00
730c6be2cb Implement query locking for local RAG context retrieval 2026-06-15 02:16:07 +02:00
7b42e25135 Enhance RAG corpus enrichment: Update prompt version, improve response validation, increase token limits, and refactor data normalization logic. 2026-06-15 02:11:20 +02:00
90a994f72e Display metadata generation error when status is 'failed' 2026-06-15 02:09:55 +02:00
74958a5336 Improve metadata status tracking and failure handling in local RAG pipeline 2026-06-15 02:08:36 +02:00
32112ddbb6 Only mark text as short if QA enrichment is disabled 2026-06-15 02:08:36 +02:00
55a4e7ce28 Enhance metadata display and refine item readiness status in LibraryManager 2026-06-15 02:05:35 +02:00
d7cf6f3fc4 Feat(Library): Enhance metadata handling and display
Improves search filtering to include summary, headline, keywords, and entities from item metadata.
Adds comprehensive metadata display (summary, chips, entities) on content cards.
Introduces deep enrichment status indicators and adds functionality to trigger metadata generation.
2026-06-15 02:05:22 +02:00
d98bd71a5d Refactor RAG payload generation to use explicit metadata tracking and initialize metadata status in library functions 2026-06-15 02:04:03 +02:00
973e8ba219 Enhance RAG pipeline by implementing robust metadata persistence, extracting detailed information (summary, keywords, entities) into the enhanced corpus record. 2026-06-15 02:03:48 +02:00
1758a27a31 Improve RAG prompt instructions for Q&A and refine processing levels in cache 2026-06-15 02:03:07 +02:00
1c7e5f0691 Feat(RAG): Make QA generation optional and support 'deep' source paths for enrichment 2026-06-15 02:02:53 +02:00
e1f3aaeec1 Manage content preview state by clearing selected/edited item from previews and collapsing expansion view. 2026-06-15 01:26:59 +02:00
7edccc90a3 Reset expanded item and content preview state when library details change 2026-06-15 01:26:46 +02:00
4a624d2d30 Feat: Implement detailed content previews for library items
Adds functionality to display rich content previews (including truncated or extracted RAG text) when viewing a library item, updating backend indexing and frontend rendering accordingly.
2026-06-15 01:25:34 +02:00
9c84076a85 Update prepare job condition to check for indexed status in payload 2026-06-15 01:24:04 +02:00
b05562a2de Simplify job state checks for marking files ready and triggering preparation steps 2026-06-15 01:22:53 +02:00
b45117c52d Improve source URI handling in local RAG context by deduplicating sources 2026-06-15 01:22:53 +02:00
fd84748450 Improve RAG index building and local rag processing
- Implement robust chunking for oversized text in index_builder.
- Prevent job preparation in local_rag if source data contains failed sync items.
2026-06-15 01:21:19 +02:00
cbe30c6ccb Refactor list_libraries to async and ensure background preparation jobs are running before listing libraries 2026-06-15 01:19:17 +02:00
a5142e6dd0 Refactor local_rag to conditionally include item metadata (item_id, kind, title, url) only for managed or text/website content types 2026-06-15 01:17:03 +02:00
ec08af4640 Improve change detection and enhance content extraction logic 2026-06-15 01:15:42 +02:00
9a4f4c7c2b Feat: Overhaul LibraryManager to support diverse content types (text, websites) and implement a unified search/display grid. 2026-06-15 01:14:47 +02:00
3e35ea96ec Add httpx dependency to backend/local_rag.py 2026-06-15 01:14:09 +02:00
c7f904ed01 Implement API endpoints and utilities for managing text and website content within the local RAG system, including web snapshot fetching and metadata updates. 2026-06-15 01:13:00 +02:00
2254a2b7d6 Update Tauri migration documentation for packaged builds, detailing macOS sidecar setup and production readiness steps. 2026-05-06 07:06:00 +02:00
b9d59f531d Refine backend architecture for packaged builds and sidecar deployment 2026-05-06 07:05:47 +02:00
e4fb6a38eb Update README with detailed local macOS packaging guide and adjust file structure for sidecar and scripts 2026-05-06 07:05:17 +02:00
ce3a216242 Implement graceful shutdown for backend sidecar on exit 2026-05-06 07:03:35 +02:00
45ea3f64ab Implement robust cleanup and process tree termination for backend sidecar 2026-05-06 07:03:26 +02:00
c918e61946 Make ffmpeg and ffprobe bundling mandatory and robust 2026-05-06 06:57:53 +02:00
161d0c12aa Improve cross-platform path resolution for bundled executables 2026-05-06 06:52:08 +02:00
0ab5011c22 Add heimgeist-ffprobe to external binaries list 2026-05-06 06:52:08 +02:00
b65f82b48d Format logging message for backend sidecar check 2026-05-06 06:50:09 +02:00
20fd5ddc4b Implement backend sidecar management and health checks 2026-05-06 06:47:19 +02:00
caaf7e6c79 Integrate backend sidecar process and external binaries into the Tauri build 2026-05-06 06:46:27 +02:00
dc8df4a8ab Docs: Centralize and document data path management for packaged builds 2026-05-06 06:14:23 +02:00
ef1ecd463b Refactor path management and configuration utilities 2026-05-06 06:13:56 +02:00
0f0a82b798 Improve exit handling when already shutting down 2026-05-06 06:04:16 +02:00
17ab1fc236 Update diagnostic setting description in InterfaceSettings 2026-05-06 06:02:18 +02:00