Ollama + chromadb run error

[chunji96]

i want to run vanna ai local and run the follow code

%pip install 'vanna[chromadb]'
class MyVanna(ChromaDB_VectorStore, Ollama):
    def __init__(self, config=None):
        ChromaDB_VectorStore.__init__(self, config=config)
        Ollama.__init__(self, config=config)

vn = MyVanna(config={'model': 'mistral'})
from vanna.ollama import Ollama
from vanna.chromadb.chromadb_vector import ChromaDB_VectorStore
vn.ask(question='count all from my-table')

and then cause an error

the text

Number of requested results 10 is greater than number of elements in index 5, updating n_results = 5
Number of requested results 10 is greater than number of elements in index 1, updating n_results = 1
[{'role': 'system', 'content': 'The user provides a question and you provide SQL. You will only respond with SQL code and not with any explanations.\n\nRespond with only SQL code. Do not answer with any explanations -- just the code.\n\nYou may use the following DDL statements as a reference for what tables might be available. Use responses to past questions also to guide you:\n\n\n    CREATE TABLE IF NOT EXISTS my-table (\n        id INT PRIMARY KEY,\n        name VARCHAR(100),\n        age INT\n    )\n\n\n\n    CREATE TABLE IF NOT EXISTS my-table (\n        id INT PRIMARY KEY,\n        name VARCHAR(100),\n        age INT\n    )\n\n\n\n    CREATE TABLE IF NOT EXISTS my-table (\n        id INT PRIMARY KEY,\n        name VARCHAR(100),\n        age INT\n    )\n\n\n\n    CREATE TABLE IF NOT EXISTS my-table (\n        id INT PRIMARY KEY,\n        name VARCHAR(100),\n        age INT\n    )\n\n\n\n    CREATE TABLE IF NOT EXISTS my-table (\n        id INT PRIMARY KEY,\n        name VARCHAR(100),\n        age INT\n    )\n\n\n\nYou may use the following documentation as a reference for what tables might be available. Use responses to past questions also to guide you:\n\nOur business defines OTIF score as the percentage of orders that are delivered on time and in full\n\n'}, {'role': 'user', 'content': 'count all from my-table'}]
HTTPConnectionPool(host='localhost', port=11434): Max retries exceeded with url: /api/chat (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7faf6f0fb640>: Failed to establish a new connection: [Errno 61] Connection refused'))

I dont understand why request to port 11434 and any body known where is my problem ? wait for you ,thank you !

[chunji96]

@zainhoda hi zainhoda, do you know where is my code problem

[andreped]

Hello, @chunji96! :]

Hmm, don't you need to connect to a database before you can start asking questions?
Please, refer to this notebook.

Also, it looks like the issue you are having is related to Ollama (see here).
You first need to setup a running instance of Ollama that you can access, maybe that's what you tried to do by creating the endpoint /api/chat?
https://github.com/ollama/ollama/blob/main/examples/jupyter-notebook/ollama.ipynb

[zainhoda]

@andreped is correct -- @chunji96 it looks like you don't have Ollama running so the Ollama endpoint (localhost:11434) is unreachable

[chunji96]

Thank you for all @andreped @zainhoda ,i thought vanna will start the ollama service,it's a mistake.