Commit Graph

14 Commits

Author SHA1 Message Date
charles 49127d695a Small changes 2026-05-28 22:08:00 -07:00
charles 2363cde160 Refactor LLM processor and improve async handling
Move contextual information handling from noise filtering to extraction
and centralize LLM call logic. Wrap blocking transcription and state
update calls in asyncio.to_thread to prevent event loop blocking.
Update transcriber model size to base.
2026-05-28 18:54:09 -07:00
charles afa8d17f10 Mostly working 2026-05-28 00:08:52 -07:00
charles 1cfba3a0ae Add LLM input logging and UI log pane
- Add log_queue to PipelineOrchestrator and log LLM inputs to UI
- Use entity_name for lore update logs instead of topic
- Pass log_queue into ConfirmationApp to display logs in UI
- Introduce a log pane and left/right pane layout in the UI
- Poll and render log messages via a new poll_log_updates worker
- Run log polling with Textual workers to avoid GC issues
- Fix ListView insertion by wrapping ListItem in a list
- Relax RAG similarity threshold from 0.7 to 0.5
2026-05-27 23:09:11 -07:00
charles 1098bdb2f9 Stable state 2026-05-27 22:30:20 -07:00
charles b25f82cefc Implement RAG summarization and context pipeline
- Add ContextPipeline for async RAG lookups
- Implement RAG result summarization via LLMProcessor
- Add CLI flag for PDF ingestion
- Strip markdown code blocks from LLM responses
- Update TUI context display to use ListItems
2026-05-27 00:17:47 -07:00
charles b83d9b5e6a Update UI and prompts 2026-05-26 23:25:53 -07:00
charles 679eca3fef fix: suppress whisperx.asr warnings 2026-05-26 22:17:50 -07:00
charles 954f2f50d8 feat: implement RAG capabilities and Context Pane integration
- Add RAG capabilities using LlamaIndex and ChromaDB
- Implement RAGManager for PHB indexing and retrieval
- Integrate RAG pipeline into orchestrator to trigger queries based on extracted entities
- Update TUI to include a 3-column layout with a real-time Context Pane
- Define ContextUpdate data models in src/llm/models.py
- Update requirements.txt with new dependencies
2026-05-26 22:07:12 -07:00
charles f4c98fb2b9 Migrate to WhisperX for speaker diarization
Implement a sliding window audio buffer and update the transcriber to
use WhisperX for transcription, alignment, and speaker identification.
Update the pipeline to handle and store speaker-attributed transcripts.

Additionally, update the LLM processor's reasoning parameter to
"enable_thinking".
2026-05-26 21:48:30 -07:00
charles d0fcdfab01 Improvements 2026-05-26 21:07:58 -07:00
charles 58bab75bb5 Improve audio capture and LLM integration
- Implement Silero VAD for dynamic audio chunking
- Add support for Ollama and vLLM backends
- Harden extraction prompts for strict JSON output
- Refactor TUI worker to handle proposals asynchronously
2026-05-26 19:51:48 -07:00
charles 60e170e777 Temp 2026-05-25 22:50:09 -07:00
charles 685586318f feat: implement core D&D helpers logic and system architecture 2026-05-25 22:14:58 -07:00