Skip to content

Commit

Permalink
test
Browse files Browse the repository at this point in the history
  • Loading branch information
bmd1905 committed Aug 27, 2024
1 parent b4bfbeb commit c09bf4b
Showing 1 changed file with 18 additions and 9 deletions.
27 changes: 18 additions & 9 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -137,6 +137,9 @@ cd iac/terraform
terraform init
```

![Hehe](https://ff65bbd2a2a9ab52b05e88a29640d5ff2d8835f97b8a1afd527181e-apidata.googleusercontent.com/download/storage/v1/b/promptalchemy/o/videos%2F1-init-cluster.mp4?jk=AXZI6Jzk4HwlH_W6g7ceqRQMKVqQB7GN7B89XWlidRelIXxkGM7cTBpZIkq-UqmhM7p3JWA8mC0bZNBN0pHY4FVTbdqvnvTH9vQVXAksqzYex_i14jaJDuM83L5v9XIq1L6bQgE83bijPBgHPC_mUDcNatU-gGsVvQ6zA9Vkj_2Wp-nAnkaP6x7p1Tlp8BMgj6ZVXRVi9or16U9iKbiPyzizd3nxx_3_e4Ptl55vR48anl4Ctl23EmCxTPyYUtKknFAiobU6tubdhGLj5rz2u_z0atWJJUyBWCy10vjoaNaZwQXFQWZ5aD8Txc-G_7WdNzbwW1i6ZjDnzIafhwhyrLx1y5P8ikm4ghLjtNWmXDbx9wzFyiRQFpG8tAa2LZzhkMEUWUvcD8yLMvENRDs5uu9kYuf63u379qGAfGYjml_s3IXUubS2VGwG9HsPDtaF_LZEM4jaTe6umMpRgH4djdQ57c0C39oAZGKSB7RQcYVSgAw7ozs5Orr9VntelI_Ac8ZnUbCS4oTi_JFI-k9ui3_iM2beVyhIKIDrdkhnx31sJI-hyZNxNT8u5RC5plLGmJ37B3Ue6S8Xu0dggh01DV3UFg1APskwpllAlXvQzjfWrsQunmPSZgrOHHaV_n8kBB1dzYJZd9RVbWfdhTfaKTnd2USkjMBiIJ0bjgl1jYoZBhZ6ebIRIqFr5zlAhwupVvh0LPPfvzU7irmZy8lPFvqo_EwzmHl8s3gNah3cGAhLH-eHz93MeaWXd6hiAaHkWW3P2S_fBmHYaaiAzKbeQAd5DKIuoo1ykZ_KN5wfnZqxsXlWFkwf-VubZUU74MoeJP_8ZzmoXWursbiSh5xPiXh80xoafyu7Mk_OtepEjTGlaCyA8BHWsQXVd0IivR3sootaRvHruUCyRj3WPF5dSiikGNuJYgxFWeeEGnj2ISXNmRitiMaqQFkRnVOHAqxnU1j-5RgTpcCWNhXfWJXGZDwC3NusQoGhqwUvANl0pEUZnv52qmVs85GKbFPclYNvTcVuO01tCMrWGRd-gSmf3UV-MUd51ZQlJrlfdAR6r_9wyhCTwFGTqC0WlqfMXElShyS64QqSTIKL1AK4tIGdfoYW9jEiaNWTEZrKaGJ5CFJVN2A9nZV-OgfE9-h8GHioWcR_qVKrHXBS6rkbfMXR3tDRnmGmTY6zm-3Hd0ZMZHNC7dUHn7rgDBHjn5mPW9-GKGYu5N8L5r__41SpH8R-UVzRyYMryTCyP5y2RaYkr_s9lwWyNQN-S6F1s_6DOhCPp9HjBHNYHCy4MklpAKRQHcI&isca=1)


**Plan and Apply Configuration:**

Generate an execution plan to verify the resources that Terraform will create or modify, and then apply the configuration to set up the cluster:
Expand Down Expand Up @@ -170,6 +173,8 @@ kubens nginx-system
helm upgrade --install nginx-ingress ./deployments/nginx-ingress
```

Please story the Nginx Ingress Controller's IP address, as you'll need it later.

**2. Configure API Key Secret:**

Store your environment variables, such as API keys, securely in Kubernetes secrets. Create a namespace for model serving and create a secret from your `.env` file:
Expand All @@ -192,7 +197,16 @@ kubectl apply -f role.yaml
kubectl apply -f rolebinding.yaml
```

**4. Deploy LiteLLM:**
**4. Deploy caching service using Redis:**

Now, deploy the semantic caching service using Redis:
```bash
cd ./deployments/redis
helm dependency build
helm upgrade --install redis .
```

**5. Deploy LiteLLM:**

Deploy the [LiteLLM](https://github.com/BerriAI/litellm) service:

Expand All @@ -201,7 +215,7 @@ kubens model-serving
helm upgrade --install litellm ./deployments/litellm
```

**5. Deploy the Open WebUI:**
**6. Deploy the Open WebUI:**

Next, Deploy the web UI to your GKE cluster:

Expand All @@ -211,14 +225,9 @@ kubens model-serving
kubectl apply -f ./kubernetes/manifest/base
```

**6. Deploy semantic caching service using Redis:**
**7. Play around with the Application:**

Now, deploy the semantic caching service using Redis:
```bash
cd ./deployments/redis
helm dependency build
helm upgrade --install redis .
```
Open browser and navigate to the URL of your GKE cluster (e.g. `http://172.0.0.0` in step 1) to interact with the application.

### Continuous Integration/Continuous Deployment (CI/CD) with Jenkins and Ansible

Expand Down

0 comments on commit c09bf4b

Please sign in to comment.