Merge branch 'main' of https://github.com/nogibjj/rust-mlops-template

nogibjj · Mar 22, 2023 · a471bbe · a471bbe
2 parents b2b0671 + 1326135
commit a471bbe
Show file tree

Hide file tree

Showing 5 changed files with 44 additions and 0 deletions.
diff --git a/README.md b/README.md
@@ -1107,6 +1107,12 @@ Code here:  https://github.com/nogibjj/assimilate-openai/tree/main/rust-curl-ope
 {"id":"cmpl-6rDd8mzOtMx7kKobqV0isiC7TkqU4","object":"text_completion","created":1678141798,"model":"text-davinci-003","choices":[{"text":"\n\nJupiter is the fifth planet from the Sun and the biggest one in our Solar System. It is very bright and can be seen in the night sky. It is named after the Roman god Jupiter. It is usually the third brightest thing you can see in the night sky after the Moon and Venus.","index":0,"logprobs":null,"finish_reason":"stop"}],"usage":{"prompt_tokens":151,"completion_tokens":62,"total_tokens":213}}
 ```
 
+#### GCP Cloud Run
+
+* Verified GCP Cloud Run works, code here:  https://github.com/nogibjj/rust-mlops-template/tree/main/webdocker 
+![Screenshot 2023-03-07 at 4 31 02 PM](https://user-images.githubusercontent.com/58792/223558711-efedd835-0ddf-4727-854c-1928bb0a57de.png)
+
+
 #### References
 
 * [Notes for Rust Docker Container](https://hub.docker.com/_/rust)
@@ -1222,6 +1228,7 @@ One goal is to reduce using Notebooks in favor of lightweight markdown tools (i.
 * [onnxruntime for Rust](https://docs.rs/onnxruntime/latest/onnxruntime/)
 * [Build standalone executables with Rust and ONNX](https://github.com/sonos/tract)
 * [Hugging Face discussion on Rust](https://discuss.huggingface.co/t/rust-applications/23060)
+* [ort - ONNX Runtime Rust bindings](https://github.com/BloopAI/ort)
 
 ### Static Web
 
@@ -1242,6 +1249,11 @@ https://able.bio/haixuanTao/deep-learning-in-rust-with-gpu--26c53a7f
 * [polars benchmark vs pandas and dask](https://www.pola.rs/benchmarks.html)
 * [Python vs Rust in AWS Lambda for a Data Guy](https://www.confessionsofadataguy.com/aws-lambdas-python-vs-rust-performance-and-cost-savings/)
 
+### Delta Lake
+
+* [Delta Lake Rust](https://github.com/delta-io/delta-rs)
+* [Saving 10X or more using Rust versus Spark talk](https://www.youtube.com/watch?v=do4jsxeKfd4&t=998s)
+
 ### Testing Tools
 
 * [Fuzz Testing Rust](https://github.com/loiclec/fuzzcheck-rs)
@@ -1265,6 +1277,14 @@ https://able.bio/haixuanTao/deep-learning-in-rust-with-gpu--26c53a7f
 * [influxdb-rust](https://github.com/influxdb-rs/influxdb-rust)
 * [Time Series Polars Rust](https://stackoverflow.com/questions/74668242/resample-time-series-using-polars-in-rust)
 
+### Linux and GCC
+
+* [GNU GCC and Rust](https://thenewstack.io/rust-support-is-being-built-into-the-gnu-gcc-compiler/)
+
+### GTP4 Code Search
+
+* [Bloop AI-GTP4 Code Search ](https://github.com/BloopAI/bloop)
+
 ### C++ vs Rust
 
 * [C++ vs Rust](https://www.risingwave-labs.com/blog/building-a-cloud-database-from-scratch-why-we-moved-from-cpp-to-rust/)
@@ -1277,6 +1297,10 @@ https://able.bio/haixuanTao/deep-learning-in-rust-with-gpu--26c53a7f
 
 * [rust worlds fastest growing language](https://www.technologyreview.com/2023/02/14/1067869/rust-worlds-fastest-growing-programming-language/)
 
+### Copilots effect on Programming
+
+* [End of programming?](https://thenewstack.io/coding-sucks-anyway-matt-welsh-on-the-end-of-programming/) *I believe instead of end of coding it means level up*
+
 ### Rewrite Python to Rust
 
 * [Oxidizing bmap-tools: rewriting a Python project in Rust](https://www.collabora.com/news-and-blog/blog/2023/03/03/oxidizing-bmap-tools-rewriting-a-python-project-in-rust/)

diff --git a/async-lambda-s3/README.md b/async-lambda-s3/README.md
@@ -1,5 +1,7 @@
 ## A lambda function that async summarizes every object in every bucket
 
+[YouTube AWS Lambda Walkthrough](https://youtu.be/IhEMgX9Aeo4)
+
 It requires you to deploy with a role that can access S3.
 Then do `make invoke`
 

diff --git a/onnx-efs-lambda/README.md b/onnx-efs-lambda/README.md
@@ -1,5 +1,8 @@
 ## Notes
 
+
+[Video Walkthrough](https://youtu.be/HsU873c0B-c)
+
 ![Screenshot 2023-02-12 at 4 04 15 PM](https://user-images.githubusercontent.com/58792/218337046-e240d0e4-0406-4920-8c07-429cde193741.png)
 
 To replicate:

diff --git a/step-functions-rust/README.md b/step-functions-rust/README.md
@@ -24,3 +24,7 @@ cargo lambda invoke --remote \
 ![Screenshot 2023-03-07 at 12 06 12 PM](https://user-images.githubusercontent.com/58792/223496628-e6e6e221-68e4-4930-b1bd-001ebbbb4235.png)
 
 ![Screenshot 2023-03-07 at 12 08 48 PM](https://user-images.githubusercontent.com/58792/223496705-08ead2cb-70a0-47da-8fad-e558c3769217.png)
+
+<iframe width="560" height="315" src="https://www.youtube.com/embed/2UktR8XSCE0" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" allowfullscreen></iframe>
+
+Walkthrough:  https://www.youtube.com/watch?v=2UktR8XSCE0
diff --git a/webdocker/README.md b/webdocker/README.md
@@ -0,0 +1,11 @@
+## Deploy targets
+
+* AWS App Runner (verified this works)
+
+* Google App Engine
+
+* Google Cloud Run
+
+![Screenshot 2023-03-07 at 4 31 02 PM](https://user-images.githubusercontent.com/58792/223558498-592b3190-499b-4c5c-951c-9c11f6ad1a24.png)
+
+![2 0-cloud-run-rust](https://user-images.githubusercontent.com/58792/224507130-958a9da2-55e8-424b-bd66-4b13f522e30b.png)