Demo of Tanzu platform and SpringAI

This repository contains artifacts necessary to build and run generative AI applications using Spring Boot and Tanzu Platform. The instructions below cover setup for both Cloud Foundry (cf) and Kubernetes (k8s) environments.

Architecture

Prerequisites

• Ensure you have the latest version of the Tanzu CLI installed.
• Access to a Route53 domain and necessary AWS permissions.
• Configured egress settings (closed by default) to connect to external services.

Running the Demo

Preperations

• Update the parameters in demo.sh according to your TPCF configurations

• cf runtime

cf login -u admin -p YOUR_CF_ADMIN_PASSWORD
cf target -o YOUR_ORG -s YOUR_SPACE //this space musy have acces to postgres and genai services

• k8s runtime

tanzu build config --build-plan-source-type=file  --build-plan-source [FULL PATH TO spring-metal folder]/.tanzu/build-plan.yml
./demo.sh prepare-k8s [YOUR REGISTERY at harbor.vmtanzu.com]

Deployment

• cf runtime

cf login -u admin -p YOUR_CF_ADMIN_PASSWORD
cf target -o YOUR_ORG -s YOUR_SPACE
./demo.sh deploy-cf

• k8s runtime

tanzu login
tanzu context use <my-context>
tanzu project use <my-project>
tanzu space use <my-space>
tanzu deploy

note: AI and db external services are bound as part of the deployment. You can bind to on-cluster services by using tanzu service create

Cleanup

./demo.sh cleanup

Troubleshooting

Issue: Application deployment fails, or stuck in 'deploying'

• Solution: In AppsMan->YOUR_SPACE->services->vector db instance->settings: manually enter "svc_gw_enable":true in the json area and redeploy

Contributing

Contributions to this project are welcome. Please ensure to follow the existing coding style and add unit tests for any new or changed functionality.