Files
kotaemon/libs/ktem
ian_Cin df12dec732 Feat/local endpoint llm (#148)
* serve local model in a different process from the app
---------

Co-authored-by: albert <albert@cinnamon.is>
Co-authored-by: trducng <trungduc1992@gmail.com>
2024-03-15 16:17:33 +07:00
..
2024-01-30 18:50:17 +07:00
2024-03-15 16:17:33 +07:00
2024-01-23 10:54:18 +07:00
2024-03-15 16:17:33 +07:00
2024-03-15 16:17:33 +07:00
2024-01-23 10:54:18 +07:00
2024-01-23 10:54:18 +07:00

Example of MVP pipeline for example

Prerequisite

To run the system out-of-the-box, please supply the following environment variables:

OPENAI_API_KEY=
OPENAI_API_BASE=
OPENAI_API_VERSION=
SERPAPI_API_KEY=
COHERE_API_KEY=
OPENAI_API_KEY_EMBEDDING=

# optional
KH_APP_NAME=

Run

gradio launch.py