README.md

Integrate Llamaindex, ChromaDB, Chainlit to build an advanced chatbot (an upgrade version of my MicroGPT repo)

Sample Qeustion you can ask:

• FAQ

• General Questions

Please note that if changing a topic, refresh the page or click 'New Chat' button on the top right.

Get the Repo

git clone https://github.com/ChungYujoyce/rag-chatbot.git

Go to link and download the folders, place them in the repo.

• chroma_db_v1
• chroma_db_v1_ds
• csvtest
• SOURCE_DOCUMENTS

Llama3 8B vLLM Server

docker pull docker.io/jj0122/microgpt:vllmv0.4.1

docker run -it --network my_network --name vllm jj0122/microgpt:vllmv0.4.1  /bin/bash

In the docker, run below commands to start the server

cd rag-chatbot/server
bash 1_start_server_vllm.sh

ChatBot Client

docker pull docker.io/jj0122/rag_app:0522

docker run -it --network my_network --name index jj0122/rag_app:0522   /bin/bash

In the docker, run below commands to start the client (the port number in the bash file should be changed to an appplicable one)

cd rag-chatbot/
bash run-test.sh

Stop the Client

bash clean.sh