Jinke
8b04f8475a
fix: encoding error after brand new installation ( #654 ) #none
...
fix: encoding error after brand new installation
2025-02-14 21:32:39 +07:00
Varun Sharma
e3921f7704
fix: selecting search all does not work on LightRAG / NanoGraphRAG ( #627 ) #none
...
* fix: base path
* fix: select all doesn't work
* fix: adding new documents should update the existing index within the file collection instead of creating new one #561
* fix linter issues
* feat: update NanoGraphRAG with global collection search
---------
Co-authored-by: Tadashi <tadashi@cinnamon.is>
2025-02-14 21:13:39 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
0b090896fd
feat: add support for reasoning llm with thought visualization ( #652 ) bump:patch
...
* fix: lanceDB query with empty file_ids
* feat: add thinking display
* feat: add low request mode for local llm
2025-02-05 13:45:12 +07:00
Hideyuki Kagami
f5b2200ffa
fix: update parameter name in AzureAIDocumentIntelligenceLoader ( #593 ) bump:patch
2025-02-03 08:10:10 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
756f46893f
fix: lightrag settings ( #649 ) #none
...
* Update lightrag_pipelines.py
* Update nano_pipelines.py
* fix: lightrag setting prompts
---------
Co-authored-by: RoadToNowhereX <37441177+RoadToNowhereX@users.noreply.github.com>
2025-02-03 08:07:53 +07:00
Tadashi
3b87945ab0
fix: plotly requirements #none
2025-02-02 18:58:37 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
3bd3830b8d
feat: sso login, demo mode & new mindmap support ( #644 ) bump:minor
...
* fix: update .env.example
* feat: add SSO login
* fix: update flowsetting
* fix: add requirement
* fix: refine UI
* fix: update group id-based operation
* fix: improve citation logics
* fix: UI enhancement
* fix: user_id to string in models
* fix: improve chat suggestion UI and flow
* fix: improve group id handling
* fix: improve chat suggestion
* fix: secure download for single file
* fix: file limiting in docstore
* fix: improve chat suggestion logics & language conform
* feat: add markmap and select text to highlight function
* fix: update Dockerfile
* fix: user id auto generate
* fix: default user id
* feat: add demo mode
* fix: update flowsetting
* fix: revise default params for demo
* feat: sso_app alternative
* feat: sso login demo
* feat: demo specific customization
* feat: add login using API key
* fix: disable key-based login
* fix: optimize duplicate upload
* fix: gradio routing
* fix: disable arm build for demo
* fix: revise full-text search js logic
* feat: add rate limit
* fix: update Dockerfile with new launch script
* fix: update Dockerfile
* fix: update Dockerignore
* fix: update ratelimit logic
* fix: user_id in user management page
* fix: rename conv logic
* feat: update demo hint
* fix: minor fix
* fix: highlight on long PDF load
* feat: add HF paper list
* fix: update HF papers load logic
* feat: fly config
* fix: update fly config
* fix: update paper list pull api
* fix: minor update root routing
* fix: minor update root routing
* fix: simplify login flow & paper list UI
* feat: add paper recommendation
* fix: update Dockerfile
* fix: update Dockerfile
* fix: update default model
* feat: add long context Ollama through LCOllama
* feat: espose Gradio share to env
* fix: revert customized changes
* fix: list group at app load
* fix: relocate share conv button
* fix: update launch script
* fix: update Docker CI
* feat: add Ollama model selection at first setup
* docs: update README
2025-02-02 15:19:48 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
5343d0d3ee
fix: openai async ( #585 ) bump:patch
2024-12-24 09:45:15 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
95191f53d9
feat: add web search ( #580 ) bump:patch
...
* feat: add web search
* feat: update requirements
2024-12-23 09:28:24 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
4fe080737a
fix: improve citation logic ( #578 ) bump:patch
2024-12-18 20:27:53 +07:00
Tadashi
3bd19f399f
fix: tei_fast_rerank logic bump:patch
2024-12-17 17:33:47 +07:00
Elias Judin
54320d08df
feat(loader): implement markdown parsing in MathpixPDFReader ( #498 )
...
* ✨ feat(loader): implement markdown parsing in MathpixPDFReader
Add functionality to properly handle PDF content:
- Add parse_markdown_text_to_tables method to separate tables and text
- Fix load_data implementation to properly process documents
- Fix lazy_load_data method
- Improve document metadata handling for tables and text sections
The loader now correctly processes PDFs through Mathpix API and converts content to proper Document objects.
* fix(loader): remove super() calls blocking MathpixPDFReader implementation
Remove early returns using super() in load_data and lazy_load_data methods that were preventing the actual implementation from being executed. This fixes the "not implemented" error while maintaining the full PDF reader functionality.
2024-12-17 17:30:17 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
cd87a7e35f
fix: UI tab name and reranking process for TeiFastReranking ( #576 )
...
* fix: update user-management.md
* fix: reranking process when TeiFastReranking is specified.
---------
Co-authored-by: Ryuichi Takano <45957617+tknrych@users.noreply.github.com>
Co-authored-by: Ryuichi Takano <ryuichi.takano@jp.ricoh.com>
2024-12-17 17:23:54 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
9039b4f32b
fix: using a base path breaks file preview ( #575 )
...
* fix: using a base path breaks file preview
* fix: comfort precommit
---------
Co-authored-by: Varun Sharma <contactvarun27@gmail.com>
2024-12-17 17:12:27 +07:00
eddprogrammer
a8b8fcea32
fix: add retry to lightrag llm_func call ( #572 )
...
* add retry to lightrag llm_func call
* fix: update logic for nanographrag
---------
Co-authored-by: Song Lin <song.lin@kirkland.com>
Co-authored-by: Tadashi <tadashi@cinnamon.is>
2024-12-17 17:02:06 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
1d3c4f4433
feat: add graphrag modes ( #574 ) #none
...
* feat: add support for retrieval modes in LightRAG & NanoGraphRAG
* feat: expose custom prompts in LightRAG & NanoGraphRAG
* fix: optimize setting UI
* fix: update non local mode in LightRAG
* fix: update graphRAG mode
2024-12-17 16:49:37 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
7a02cb72af
feat: add URL indexing directly from chat input ( #571 ) bump:patch
...
* feat: enable lightrag by default and add graphrag key check
* feat: add URL indexing from chatbox
2024-12-15 23:13:52 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
a0c9a6e8de
feat: add quick setting for follow up chat suggestions & add more common languages ( #556 ) bump:patch
...
* feat: add chat suggestion quick setting
* feat: add more common languages
* fix: minor fixes
2024-12-07 09:19:21 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
6650b15c64
feat: add citation style quick setting ( #554 ) bump:patch
2024-12-05 19:55:59 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
b016a84b97
feat: add Google embedding support & update setup ( #550 ) bump:patch
2024-12-04 11:09:57 +07:00
Pedro Lima
159f4da7c9
fix: Remove Collections from all index names ( #473 )
...
Co-authored-by: Tadashi <tadashi@cinnamon.is>
2024-12-04 09:40:46 +07:00
Tran Huu Hoang
32732c35de
feat: set user being able to set chunk size and overlap for indices ( #524 )
...
* use tzlocal to get the local time
* delete tmp folder
* update date_created and date_updated with current timezone
* pass precommit
* update date_created field default by local time
* add chunk size and chunk overlap param for indices
* refactor code to pass pre-commit
* fix: minor update logics
---------
Co-authored-by: Tadashi <tadashi@cinnamon.is>
2024-12-04 09:04:50 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
a1fecfac45
feat: add toggle for conversation control sidebar ( #546 ) #none
2024-12-04 07:53:28 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
ab6b3fc529
feat: add quick file selection upon tagging on Chat input ( #533 ) bump:patch
...
* fix: improve inline citation logics without rag
* fix: improve explanation for citation options
* feat: add quick file selection on Chat input
2024-11-28 21:12:56 +07:00
Tadashi
f15abdbb23
fix: improve inline citation parsing bump:patch
2024-11-26 20:52:03 +07:00
Tadashi
f3a2a293f2
fix: remove debug print #none
2024-11-25 16:07:56 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
7e34e4343b
feat: add inline citation style ( #523 ) bump:minor
...
* feat: add URL quick index, export mindmap, refine UI & animation
* fix: inject multimodal mode from env var
* fix: minor update css
* feat: add citation inline mode
* fix: minor update citation inline pipeline
* feat: add citation quick setting
* fix: minor update
* fix: minor update
2024-11-25 12:07:02 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
013f6f4103
fix: code block overflow in chat ( #509 ) bump:patch
2024-11-20 16:08:31 +07:00
Tadashi
747bff8ee0
fix: minor update bump:patch
2024-11-19 13:39:04 +07:00
Tadashi
8b454db888
fix: Gradio table display with Firefox
2024-11-19 13:35:47 +07:00
Tadashi
db2737d309
fix: relocate information panel expand button bump:patch
2024-11-18 16:45:08 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
74124323e8
feat: refine UI and add go to chat btn ( #500 ) bump:minor
2024-11-18 14:48:15 +07:00
Quang (Albert)
56c40f1c05
feat: integrate with docling ( #471 ) bump:patch
...
* feat: add docling reader implementation
* feat: expose docling to UI
* fix: improve docling output parsing
* docs: update README
---------
Co-authored-by: Tadashi <tadashi@cinnamon.is>
2024-11-16 10:04:57 +07:00
cin-cris
5b828c213c
fix: fix Application UI using UTC time ( #472 ) bump:patch
...
* use tzlocal to get the local time
* delete tmp folder
* update date_created and date_updated with current timezone
* pass precommit
* update date_created field default by local time
2024-11-11 16:51:38 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
6a81c77dd8
fix: update Docker file for graphrag ( #477 ) #none
2024-11-08 17:00:51 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
aeace96c48
feat: add lightrag support ( #474 ) bump:patch
...
* feat: add lightrag support
* docs: update README
2024-11-07 17:22:41 +07:00
Pedro Lima
908452cc18
allow chunk_overlap with zero value ( #457 ) #none
...
Co-authored-by: Tadashi <tadashi@cinnamon.is>
2024-11-05 14:12:52 +07:00
KennyWu
d127fec9f7
feat: support for visualizing citation results (via embeddings) ( #461 )
...
* feat:support for visualizing citation results (via embeddings)
Signed-off-by: Kennywu <jdlow@live.cn>
* fix: remove ktem dependency in visualize_cited
* fix: limit onnx version for fastembed
* fix: test case of indexing
* fix: minor update
* fix: chroma req
* fix: chroma req
---------
Signed-off-by: Kennywu <jdlow@live.cn>
Co-authored-by: Tadashi <tadashi@cinnamon.is>
2024-11-05 14:02:57 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
bd2490bef1
fix: clean chatUI and simplify regen logic ( #452 ) bump:patch
2024-11-02 17:19:10 +07:00
Tadashi
fb241a467c
fix: nano-graphrag import when not installed
2024-10-31 09:22:55 +07:00
Tadashi
cce3639074
fix: update pymupdf version in requirements
2024-10-31 08:32:16 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
280f0d58ce
fix: rewoo citation ( #441 ) #none
2024-10-30 16:20:21 +07:00
cin-klein
66e565649e
feat: integrate nano-graphrag ( #433 )
...
* add nano graph-rag
* ignore entities for relevant context reference
* refactor and add local model as default nano-graphrag
* feat: add kotaemon llm & embedding integration with nanographrag
* fix: add env var for nano GraphRAG
---------
Co-authored-by: Tadashi <tadashi@cinnamon.is>
2024-10-30 15:32:30 +07:00
Khoi-Nguyen Nguyen-Ngoc
19b386b51e
fix: pin python-multipart version to avoid yanking issues with micropip ( #436 )
2024-10-28 15:13:47 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
f2f192ed72
feat: add toggle dark mode button on main Chat UI ( #423 )
...
* feat: add toggle dark mode button on main UI
* docs: update docs
2024-10-22 18:48:18 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
764fe595f4
feat: add file grouping feature ( #416 ) bump:patch
2024-10-21 12:47:18 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
e6fa1af404
feat: add mindmap visualization ( #405 ) bump:minor
2024-10-17 14:35:28 +07:00
a652
4764b0e82a
fix: update adobe_loader ( #399 ) bump:patch
...
* Update adobe_loader.py
fix:When initializing the Document, extra_info was not added to the metadata.
* Update adobe_loader.py
Change the method of checking whether extra_info is None.
2024-10-16 11:01:55 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
b113efc855
feat: add web URL loader & refine indexing logics ( #397 )
...
* feat: add web URL loader & refine indexing logics
* fix: comfort mypy
2024-10-15 22:42:24 +07:00
ronchengang
8188760f32
feat: allow to use customized GraphRAG settings.yaml ( #387 ) bump:patch
...
* allow to use customized GraphRAG settings.yaml
* adjust import style
* fix typo
* Added GraphRAG original documentation reference.
* feat: allow to use customized GraphRAG settings.yaml
(#387 )
---------
Co-authored-by: Chen, Ron Gang <git@git.com>
2024-10-14 21:18:34 +07:00
