Public/kotaemon
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
262 Commits 1 Branch 0 Tags 15 MiB
74124323e8
Commit Graph

138 Commits

Author SHA1 Message Date
Tuan Anh Nguyen Dang (Tadashi_Cin)
74124323e8
feat: refine UI and add go to chat btn (#500) bump:minor 2024-11-18 14:48:15 +07:00
Quang (Albert)
56c40f1c05
feat: integrate with docling (#471) bump:patch 
* feat: add docling reader implementation

* feat: expose docling to UI

* fix: improve docling output parsing

* docs: update README

---------

Co-authored-by: Tadashi <tadashi@cinnamon.is>
 2024-11-16 10:04:57 +07:00
cin-cris
5b828c213c
fix: fix Application UI using UTC time (#472) bump:patch 
* use tzlocal to get the local time

* delete tmp folder

* update date_created and date_updated with current timezone

* pass precommit

* update date_created field default by local time
 2024-11-11 16:51:38 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
6a81c77dd8
fix: update Docker file for graphrag (#477) #none 2024-11-08 17:00:51 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
aeace96c48
feat: add lightrag support (#474) bump:patch 
* feat: add lightrag support

* docs: update README
 2024-11-07 17:22:41 +07:00
Pedro Lima
908452cc18
allow chunk_overlap with zero value (#457) #none 
Co-authored-by: Tadashi <tadashi@cinnamon.is>
 2024-11-05 14:12:52 +07:00
KennyWu
d127fec9f7
feat: support for visualizing citation results (via embeddings) (#461) 
* feat:support for visualizing citation results (via embeddings)

Signed-off-by: Kennywu <jdlow@live.cn>

* fix: remove ktem dependency in visualize_cited

* fix: limit onnx version for fastembed

* fix: test case of indexing

* fix: minor update

* fix: chroma req

* fix: chroma req

---------

Signed-off-by: Kennywu <jdlow@live.cn>
Co-authored-by: Tadashi <tadashi@cinnamon.is>
 2024-11-05 14:02:57 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
bd2490bef1
fix: clean chatUI and simplify regen logic (#452) bump:patch 2024-11-02 17:19:10 +07:00
Tadashi
fb241a467c
fix: nano-graphrag import when not installed 2024-10-31 09:22:55 +07:00
Tadashi
cce3639074
fix: update pymupdf version in requirements 2024-10-31 08:32:16 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
280f0d58ce
fix: rewoo citation (#441) #none 2024-10-30 16:20:21 +07:00
cin-klein
66e565649e
feat: integrate nano-graphrag (#433) 
* add nano graph-rag

* ignore entities for relevant context reference

* refactor and add local model as default nano-graphrag

* feat: add kotaemon llm & embedding integration with nanographrag

* fix: add env var for nano GraphRAG

---------

Co-authored-by: Tadashi <tadashi@cinnamon.is>
 2024-10-30 15:32:30 +07:00
Khoi-Nguyen Nguyen-Ngoc
19b386b51e
fix: pin python-multipart version to avoid yanking issues with micropip (#436) 2024-10-28 15:13:47 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
f2f192ed72
feat: add toggle dark mode button on main Chat UI (#423) 
* feat: add toggle dark mode button on main UI

* docs: update docs
 2024-10-22 18:48:18 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
764fe595f4
feat: add file grouping feature (#416) bump:patch 2024-10-21 12:47:18 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
e6fa1af404
feat: add mindmap visualization (#405) bump:minor 2024-10-17 14:35:28 +07:00
a652
4764b0e82a
fix: update adobe_loader (#399) bump:patch 
* Update adobe_loader.py

fix:When initializing the Document, extra_info was not added to the metadata.

* Update adobe_loader.py

Change the method of checking whether extra_info is None.
 2024-10-16 11:01:55 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
b113efc855
feat: add web URL loader & refine indexing logics (#397) 
* feat: add web URL loader & refine indexing logics

* fix: comfort mypy
 2024-10-15 22:42:24 +07:00
ronchengang
8188760f32
feat: allow to use customized GraphRAG settings.yaml (#387) bump:patch 
* allow to use customized GraphRAG settings.yaml

* adjust import style

* fix typo

* Added GraphRAG original documentation reference.

* feat: allow to use customized GraphRAG settings.yaml
(#387)

---------

Co-authored-by: Chen, Ron Gang <git@git.com>
 2024-10-14 21:18:34 +07:00
Tadashi
f0f3b4b23e
docs: update README #none 2024-10-14 10:16:43 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
15c7916ad8
fix: improve GRAPHRAG key passing (#384) #none 2024-10-11 12:01:06 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
6da9db489f
fix: add optional graphrag toggle in dockerfile (#377) 
* fix: toggle graphrag install in Docker build

* fix: update Dockerfile

* fix: remove unused logics in chat_fn

* fix: disable duckduckgo test due to API limit
 2024-10-10 16:09:57 +07:00
Tadashi
3ff6af8acf
fix: optimize chat suggestion logic 2024-10-10 14:44:50 +07:00
ronchengang
ad34395d0b
update output path logic since GraphRAG has changed the storage config value in the latest release (#374) bump:patch 
Co-authored-by: Chen, Ron Gang <git@git.com>
 2024-10-10 11:20:02 +07:00
KennyWu
49a083fd9f
feat: tweak the 'Chat suggestion' feature to tie it to conversations (#341) #none 
Signed-off-by: Kennywu <jdlow@live.cn>
 2024-10-10 11:02:04 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
dfd00fe752
fix: vastly improve chat UI responsiveness by reordering Gradio events (#360) bump:patch 2024-10-04 17:15:49 +07:00
taprosoft
76ab3fdd90 fix: check empty Cohere key in rerank 2024-10-01 09:37:09 +00:00
Tadashi
a424a630f2
fix: pass .env.example to Docker and release package bump:patch 2024-10-01 14:49:57 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
7ac8f0329a
fix: improve Download UI bump:minor (#352) 
* fix: rerank test ui

* fix: improve download all UI
 2024-10-01 12:03:19 +07:00
KennyWu
53530e296f
feat: support TEI embedding service, configurable reranking model (#287) 
* feat: add support for TEI embedding service, allow reranking model to be configurable.

Signed-off-by: Kennywu <jdlow@live.cn>

* fix: add cohere default reranking model

* fix: comfort pre-commit

---------

Signed-off-by: Kennywu <jdlow@live.cn>
Co-authored-by: wujiaye <wujiaye@bluemoon.com.cn>
Co-authored-by: Tadashi <tadashi@cinnamon.is>
 2024-09-30 22:00:00 +07:00
Mikhail Khludnev
2e3c17b256
fix: convert graphrag input path to str (#237) #none 
I noticed type cast error in pycharm debug (it intercept forking programs). Anyway, this change obeys types. Although, this conversions happens implicitly.

Co-authored-by: Tadashi <tadashi@cinnamon.is>
 2024-09-29 23:02:23 +07:00
Pedro Lima
aac6233412
feat: button to delete all files in index (#320) #none 
* button to delete all files in index

* code formatting

---------

Co-authored-by: Tadashi <tadashi@cinnamon.is>
 2024-09-29 22:55:51 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
b7e81e61dd
fix: remove duplicated deps (#344) #none 2024-09-29 22:38:02 +07:00
Ben Dykstra
f7b6f313b5
fix: update setup instructions (#144) #none 
* activate directory to gitignore

* add my custom env to gitignore, will have to change that

* add unstructured to kotaemon pyproject.toml

* add .env to gitignore

* remove .env from tracking

* make changes to the run_macos script, update readme with more detailed instructions

* remove my personal changes from gitignore

* remove line from run_macos script

* remove option for not installing miniconda for non technical users, mark docker dependency as optional

* docs: update demo URL

* gitignore changes

* merge .env.example

* revert changes to run_macos.sh

* unstructured to advanced dependencies

* add link to unstructured system dependencies

* remove api key

* fix: skip tests when unstructured pdf not installed

* chore: loosen unstructured package version in pyproject.toml

* chore: correct syntax

---------

Co-authored-by: Tadashi <tadashi@cinnamon.is>
Co-authored-by: cin-albert <albert@cinnamon.is>
 2024-09-29 22:26:02 +07:00
taprosoft
00df123309 fix: fix vectorstore tests #none 2024-09-27 04:18:11 +00:00
saidmukhamad
94cc3a96c2
fix: add langchain google dependency (#329) 
* add-gemini-deps

* uncomment gemeni flow settings
 2024-09-27 11:15:42 +07:00
Tadashi
79b309396b
fix: update default cohere embedding models bump:patch 2024-09-25 11:10:09 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
88d577b0cc
feat: add first setup screen for LLM & Embedding models (#314) (bump:minor) 
* fix: utf-8 txt reader

* fix: revise vectorstore import and make it optional

* feat: add cohere chat model with tool call support

* fix: simplify citation pipeline

* fix: improve citation logic

* fix: improve decompose func call

* fix: revise question rewrite prompt

* fix: revise chat box default placeholder

* fix: add key from ktem to cohere rerank

* fix: conv name suggestion

* fix: ignore default key cohere rerank

* fix: improve test connection UI

* fix: reorder requirements

* feat: add first setup screen

* fix: update requirements

* fix: vectorstore tests

* fix: update cohere version

* fix: relax langchain core version

* fix: add demo mode

* fix: update flowsettings

* fix: typo

* fix: fix bool env passing
 2024-09-22 16:32:23 +07:00
Khoi-Nguyen Nguyen-Ngoc
a865e2b095
feat: modify base dependencies + remove unnecessary packages in lite docker (#310) 
* feat: update base/adv dependencies

* feat: update Dockerfile

* ci: update free disk for docker build
 2024-09-21 12:11:58 +07:00
Quang (Albert)
7762190d05
feat: add local theme (#288) 
* feat: add local theme instead of from hub

* chore: add credit

* fix: typo
 2024-09-17 19:03:39 +07:00
Anush
e2bd78e9c4
feat: Qdrant vectorstore support (#260) 
* feat: Qdrant vectorstore support

* chore: review changes

* docs: Updated README.md
 2024-09-16 04:17:36 +07:00
kan_cin
d3fd75297f
feat: add multi-stages docker and support platform arm (#274) 
* feat: add multi-stages docker and support platform arm

* refactor: pre-commit

* fix: raise ImportError (fastembed) instead of auto install

* feat: add dependencies for local llm

* feat: free disk

* feat: update README

* feat: update README

* chore: fix typo

---------

Co-authored-by: cin-niko <niko@cinnamon.is>
 2024-09-12 20:25:03 +07:00
mst
73a476979e
fix: change column type to string for relation_type (#272) #none 2024-09-11 20:47:03 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
96d2086017
fix: add guidance parameters for LC wrapper models (#255) 
* fix: add docstring to LC wrapper models

* fix: fix metadata passing with LC embedding wrapper
 2024-09-09 14:15:34 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
b06c4777a3
fix: add PDFJS download to Windows setup (#249) 2024-09-08 21:22:01 +07:00
kan_cin
dbb6bb275f
feat: add test connection for edit spec (#239) 2024-09-08 10:55:13 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
069f0f3c83
feat: expose Cohere and HF embedding support on UI (#236) 2024-09-06 18:18:19 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
ef7e91fcae
fix: update requirements (#230) 2024-09-06 09:36:21 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
e2ed3564ce
fix: limit fastapi version (#229) 2024-09-06 09:23:26 +07:00
Tadashi
318895b287
fix: disable default install for anthropic 2024-09-05 23:18:53 +07:00