Custom Data and Internet Connectivity with BakLLaVA

[oscarzhou511]

Hello,
I’m looking into connecting multimodal LLMs to some custom data or possibly connecting it to the internet. This does not needed to be incorporated into the visual aspect - only the LLM itself, so tools like LLaMaIndex and Langchain should be enough.

I’m interested in connecting the BakLLaVA model, but any open source models should do the job. Any type of assistance would be greatly appreciated.

Thank you so much for reading this issue.

Oscar Zhou