Skip to content
This repository has been archived by the owner on May 24, 2024. It is now read-only.

Commit

Permalink
Merge pull request #5416 from pathwaycom/olivier/examples
Browse files Browse the repository at this point in the history
README examples

GitOrigin-RevId: a459bb0af77a8d7728ea7a938128440ba8c18918
  • Loading branch information
olruas authored and Manul from Pathway committed Jan 11, 2024
1 parent 0c7120c commit 92b9c04
Show file tree
Hide file tree
Showing 2 changed files with 524 additions and 6 deletions.
16 changes: 10 additions & 6 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -25,10 +25,14 @@

This repository contains examples of data processing using [Pathway](https://pathway.com/developers/documentation/introduction/welcome), the Python-based programming framework for easy building of realtime and reactive data products.

The directories of this repository contain a number of standalone examples with their own README files. Examples involving multiple files and components are usually launched through the provided Docker setup. Examples consisting of single Python files are usually run on a local machine or in Google Colab. To run the examples on a local machine you may first want to install the Pathway package on your Python installation.
```
pip install -U pathway
```
(for more information and troubleshooting, see the [main repo of the Pathway package](https://github.com/pathwaycom/pathway)).
For a quick start, here is a handpicked selection of examples that illustrate how Pathway can be used in your streaming projects:
- Working with live data streams in Jupyter (short version [GitHub](https://github.com/pathwaycom/pathway-examples/blob/main/showcases/live-data-jupyter.ipynb) and [Colab](https://colab.research.google.com/github/pathwaycom/pathway-examples/blob/main/showcases/live-data-jupyter.ipynb) | [long version GitHub](https://github.com/pathwaycom/pathway-examples/tree/main/documentation/from_jupyter_to_deploy)).
- Realtime Server Log Monitoring with Pathway ([Filebeat+Slack version](https://github.com/pathwaycom/pathway-examples/tree/main/examples/realtime-log-monitoring/filebeat-pathway-slack) | [Logstash+Elastick version](https://github.com/pathwaycom/pathway-examples/tree/main/examples/realtime-log-monitoring/logstash-pathway-elastic)).
- Always up-to-date data indexing pipeline ([GitHub](https://github.com/pathwaycom/pathway-examples/blob/main/showcases/live_vector_indexing_pipeline.ipynb) | [Colab](https://colab.research.google.com/github/pathwaycom/pathway-examples/blob/main/showcases/live_vector_indexing_pipeline.ipynb)).
- Detecting suspicious user activity with Tumbling Window group-by ([GitHub](https://github.com/pathwaycom/pathway-examples/blob/main/tutorials/suspicious_user_activity.ipynb) | [Colab](https://colab.research.google.com/github/pathwaycom/pathway-examples/blob/main/tutorials/suspicious_user_activity.ipynb)).
- Build an LLM App with Pathway ([GitHub](https://github.com/pathwaycom/llm-app/tree/main)).
- Realtime Twitter Analysis App with Pathway ([GitHub](https://github.com/pathwaycom/pathway-examples/tree/main/showcases/twitter)).
- Upsampling your Signal Processing Data: transforming multiple data streams ([GitHub](https://github.com/pathwaycom/pathway-examples/blob/main/tutorials/upsampling.ipynb) | [Colab](https://colab.research.google.com/github/pathwaycom/pathway-examples/blob/main/tutorials/upsampling.ipynb)).
- Computing PageRank ([GitHub](https://github.com/pathwaycom/pathway-examples/blob/main/tutorials/pagerank.ipynb) | [Colab](https://colab.research.google.com/github/pathwaycom/pathway-examples/blob/main/tutorials/pagerank.ipynb)).

For a quick start, you may want to check out, for instance, our [Pagerank implementation](tutorials/pagerank.ipynb) prepared as a Jupyter notebook, runnable directly from [Google Colab](https://colab.research.google.com/github/pathwaycom/pathway-examples/blob/main/tutorials/pagerank.ipynb).
Don't hesitate to look for help on [our website](pathway.com/developers/user-guide/development/get-help/) or directly on the [main repo of the Pathway package](https://github.com/pathwaycom/pathway).
Loading

0 comments on commit 92b9c04

Please sign in to comment.