Public/kotaemon
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
313 Commits 1 Branch 0 Tags 15 MiB
a3e2e20735
Commit Graph

35 Commits

Author SHA1 Message Date
Tadashi
276bf56225
fix: docker CI parallel build 2025-02-02 19:03:12 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
3bd3830b8d
feat: sso login, demo mode & new mindmap support (#644) bump:minor 
* fix: update .env.example

* feat: add SSO login

* fix: update flowsetting

* fix: add requirement

* fix: refine UI

* fix: update group id-based operation

* fix: improve citation logics

* fix: UI enhancement

* fix: user_id to string in models

* fix: improve chat suggestion UI and flow

* fix: improve group id handling

* fix: improve chat suggestion

* fix: secure download for single file

* fix: file limiting in docstore

* fix: improve chat suggestion logics & language conform

* feat: add markmap and select text to highlight function

* fix: update Dockerfile

* fix: user id auto generate

* fix: default user id

* feat: add demo mode

* fix: update flowsetting

* fix: revise default params for demo

* feat: sso_app alternative

* feat: sso login demo

* feat: demo specific customization

* feat: add login using API key

* fix: disable key-based login

* fix: optimize duplicate upload

* fix: gradio routing

* fix: disable arm build for demo

* fix: revise full-text search js logic

* feat: add rate limit

* fix: update Dockerfile with new launch script

* fix: update Dockerfile

* fix: update Dockerignore

* fix: update ratelimit logic

* fix: user_id in user management page

* fix: rename conv logic

* feat: update demo hint

* fix: minor fix

* fix: highlight on long PDF load

* feat: add HF paper list

* fix: update HF papers load logic

* feat: fly config

* fix: update fly config

* fix: update paper list pull api

* fix: minor update root routing

* fix: minor update root routing

* fix: simplify login flow & paper list UI

* feat: add paper recommendation

* fix: update Dockerfile

* fix: update Dockerfile

* fix: update default model

* feat: add long context Ollama through LCOllama

* feat: espose Gradio share to env

* fix: revert customized changes

* fix: list group at app load

* fix: relocate share conv button

* fix: update launch script

* fix: update Docker CI

* feat: add Ollama model selection at first setup

* docs: update README
 2025-02-02 15:19:48 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
497cb40aaf
fix: docker multiplatform (#383) 
* fix: multiplatform build

* fix: test build
 2024-10-11 10:30:21 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
6da9db489f
fix: add optional graphrag toggle in dockerfile (#377) 
* fix: toggle graphrag install in Docker build

* fix: update Dockerfile

* fix: remove unused logics in chat_fn

* fix: disable duckduckgo test due to API limit
 2024-10-10 16:09:57 +07:00
Khoi-Nguyen Nguyen-Ngoc
96f58a445a
docs: add contributing guidelines (#359) #none 
Co-authored-by: Tadashi <tadashi@cinnamon.is>
 2024-10-06 18:12:51 +07:00
Tadashi
a424a630f2
fix: pass .env.example to Docker and release package bump:patch 2024-10-01 14:49:57 +07:00
taprosoft
89785f5be8 ci: fix release .env 2024-10-01 06:04:11 +00:00
Khoi-Nguyen Nguyen-Ngoc
a865e2b095
feat: modify base dependencies + remove unnecessary packages in lite docker (#310) 
* feat: update base/adv dependencies

* feat: update Dockerfile

* ci: update free disk for docker build
 2024-09-21 12:11:58 +07:00
Quang (Albert)
d6a9510441
fix: turn off commitlint job (#304) 2024-09-18 09:48:54 +07:00
kan_cin
d3fd75297f
feat: add multi-stages docker and support platform arm (#274) 
* feat: add multi-stages docker and support platform arm

* refactor: pre-commit

* fix: raise ImportError (fastembed) instead of auto install

* feat: add dependencies for local llm

* feat: free disk

* feat: update README

* feat: update README

* chore: fix typo

---------

Co-authored-by: cin-niko <niko@cinnamon.is>
 2024-09-12 20:25:03 +07:00
Tadashi
ce489725d8
ci: revert GH env var 2024-09-08 21:39:16 +07:00
kan_cin
855f3df75f
fix: change github token (#235) #none 2024-09-08 10:55:45 +07:00
kan_cin
4b0b28227d
fix: update on release event build push docker (#228) #none 
* fix: update on release event build push docker

* refactor: comfort pre-commit
 2024-09-05 23:44:54 +07:00
kan_cin
8be8a4a9d0
feat: add github action to build docker for release (#168) #none 
* feat: update build push docker action

* feat: remove tag trigger

* feat: remove manual trigger

* fix: update workflow

* feat: update build-push-docker.yaml

* fix: update workflow

* fix: update workflow

* fix: update workflow

* refactor: comfort pre-commit

* feat: update permission

* feat: update docker support pdfjs

* refactor: comfort pre-commit
 2024-09-05 15:02:23 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
76f2652d2a
fix: re-enable tests and fix legacy test interface (#208) 
* fix: re-enable tests and fix legacy test interface

* fix: skip llamacpp based on installed status

* fix: minor fix
 2024-09-04 12:37:39 +07:00
Le Minh Duc
4d5f9ba39c
ci: add commitlint (#170) 2024-09-01 23:10:03 +07:00
Tadashi
c1e8c37e5e
fix: update packaging script (bump:patch) 2024-08-31 07:07:28 +07:00
Quang (Albert)
fcefb80fa6
feat: Add contribution templates (#none) (#139) 
* feat: Add PR template

* feat: Add issue templates

* style: Comfort pre-commit

* style: Comfort pre-commit
 2024-08-28 17:18:50 +07:00
ian
5946fd33de
change default bump to patch, don't create release if there is no bump (#126) 2024-08-28 06:30:53 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
bb56ef4f8e
chore: update workflow (#124) 2024-08-26 09:52:16 +07:00
ian_Cin
bd34facddc
(bump:patch) force push with set upstream (#67) 2024-05-15 18:15:03 +07:00
ian_Cin
a122dc0a94
(bump:patch) Fix: llama-cpp-python security bug and setup local latest branch in github action (#66) 
* update llama-cpp-python version in response to https://github.com/Cinnamon/kotaemon/security/dependabot/1

* setup local latest branch in github action
 2024-05-15 17:57:37 +07:00
ian_Cin
fc35f9f918
(bump:patch) push latest branch after update pointer (#64) 
* push latest branch after update pointer

* force push update latest pointer

* update docs
 2024-05-15 17:22:41 +07:00
ian_Cin
654501e01c
(bump:minor) Feat: Add mechanism for user-site update and auto creating releases (#56) 
* move flowsettings.py and launch.py to root

* update docs

* sync sub package versions

* rename launch.py to app.py and make run scripts work with installation package

* add update scripts

* auto version for root package

* rename authors and update doc dir

* Update auto-bump-and-release.yaml to trigger on push to main branch

* latest as branch instead of tag

* pin deps versions

* cache the changelogs
 2024-05-15 16:34:50 +07:00
Duc Nguyen (john)
e75354d410
Enable fastembed as a local embedding vendor (#12) 
* Prepend all Langchain-based embeddings with LC

* Provide vanilla OpenAI embeddings

* Add test for AzureOpenAIEmbeddings and OpenAIEmbeddings

* Incorporate fastembed

---------

Co-authored-by: ian_Cin <ian@cinnamon.is>
 2024-04-09 01:44:34 +07:00
ian_Cin
d22ae88c7a make default installation faster (#2) 
* remove cohere as default

* refractor dependencies

* use llama-index pdf reader as default (pypdf)

* fix some lazy docstring

* update install scripts

* minor fix
 2024-03-21 22:48:20 +07:00
Duc Nguyen (john)
65852b7d71 Add docx + html reader (#139) 2024-01-31 19:21:30 +07:00
Duc Nguyen (john)
2dd531114f Make ktem official (#134) 
* Move kotaemon and ktem into same folder

* Update docs

* Update CI

* Resolve mypy, isorts

* Re-allow test pdf files
 2024-01-23 10:54:18 +07:00
ian_Cin
797df5a69c refractor agents (#100) 
* refractor agents

* minor cosmetic, add terminal ui for cli

* pump to 0.3.4

* Add temporary path

* fix unclose files in tests

---------

Co-authored-by: trducng <trungduc1992@gmail.com>
 2023-12-06 17:06:29 +07:00
ian_Cin
4256030b4f Adopt pyproject.toml (#89) 
* ditching setup.py in favour of pyproject.toml; bump to 0.3.2

* bump to 0.3.3
 2023-11-29 14:58:35 +07:00
Nguyen Trung Duc (john)
693ed39de4 Move prompts into LLMs module (#70) 
Since the only usage of prompt is within LLMs, it is reasonable to keep it within the LLM module. This way, it would be easier to discover module, and make the code base less complicated.

Changes:

* Move prompt components into llms
* Bump version 0.3.1
* Make pip install dependencies in eager mode

---------

Co-authored-by: ian <ian@cinnamon.is>
 2023-11-14 16:00:10 +07:00
Nguyen Trung Duc (john)
d79b3744cb Simplify the BaseComponent inteface (#64) 
This change remove `BaseComponent`'s:

- run_raw
- run_batch_raw
- run_document
- run_batch_document
- is_document
- is_batch

Each component is expected to support multiple types of inputs and a single type of output. Since we want the component to work out-of-the-box with both standardized and customized use cases, supporting multiple types of inputs are expected. At the same time, to reduce the complexity of understanding how to use a component, we restrict a component to only have a single output type.

To accommodate these changes, we also refactor some components to remove their run_raw, run_batch_raw... methods, and to decide the common output interface for those components.

Tests are updated accordingly.

Commit changes:

* Add kwargs to vector store's query
* Simplify the BaseComponent
* Update tests
* Remove support for Python 3.8 and 3.9
* Bump version 0.3.0
* Fix github PR caching still use old environment after bumping version

---------

Co-authored-by: ian <ian@cinnamon.is>
 2023-11-13 15:10:18 +07:00
ian_Cin
2b779926c6 Directly caching the python instead of creating virtual env; add option to ignore caching (#45) 
- Directly caching the python instead of creating virtual env
- add option to ignore caching using `[ignore catch]` in the commit message
 2023-10-16 15:27:14 +07:00
ian_Cin
533fffa6db Enable caching for github actions (#43) 2023-10-12 13:52:19 +07:00
ian_Cin
5241edbc46 [AUR-361] Setup pre-commit, pytest, GitHub actions, ssh-secret (#3) 
Co-authored-by: trducng <trungduc1992@gmail.com>
 2023-08-30 07:22:01 +07:00