Skip to content

Commit

Permalink
Create docker-compose-dataprepper.yaml (opensearch-project#4756)
Browse files Browse the repository at this point in the history
* Create docker-compose-dataprepper.yaml

Signed-off-by: Jayesh Parmar <[email protected]>
Signed-off-by: jayeshjeh <[email protected]>

* Necessary chnages made

Signed-off-by: jayeshjeh <[email protected]>

---------

Signed-off-by: Jayesh Parmar <[email protected]>
Signed-off-by: jayeshjeh <[email protected]>
  • Loading branch information
jayeshjeh authored Aug 12, 2024
1 parent 176d828 commit 0e00df6
Show file tree
Hide file tree
Showing 5 changed files with 27 additions and 2 deletions.
6 changes: 6 additions & 0 deletions examples/log-ingestion/data-prepper-config.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
ssl: false
serverPort: 4900
authentication:
http_basic:
username: admin
password: admin
16 changes: 16 additions & 0 deletions examples/log-ingestion/docker-compose-dataprepper.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,16 @@
version: '3.7'
services:
data-prepper:
image: opensearchproject/data-prepper:2
container_name: data-prepper
volumes:
- ./log_pipeline.yaml:/usr/share/data-prepper/pipelines/log_pipeline.yaml
- ./data-prepper-config.yaml:/usr/share/data-prepper/config/data-prepper-config.yaml
ports:
- 2021:2021
networks:
- opensearch-net

networks:
opensearch-net:
driver: bridge
1 change: 1 addition & 0 deletions examples/log-ingestion/docker-compose.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -15,6 +15,7 @@ services:
- discovery.type=single-node
- bootstrap.memory_lock=true # along with the memlock settings below, disables swapping
- "OPENSEARCH_JAVA_OPTS=-Xms512m -Xmx512m" # minimum and maximum Java heap size, recommend setting both to 50% of system RAM
- "OPENSEARCH_INITIAL_ADMIN_PASSWORD=Developer@123"
ulimits:
memlock:
soft: -1
Expand Down
4 changes: 3 additions & 1 deletion examples/log-ingestion/fluent-bit.conf
Original file line number Diff line number Diff line change
Expand Up @@ -10,4 +10,6 @@
Host data-prepper
Port 2021
URI /log/ingest
Format json
Format json
HTTP_User admin
HTTP_Passwd admin
2 changes: 1 addition & 1 deletion examples/log-ingestion/log_pipeline.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -11,5 +11,5 @@ log-pipeline:
hosts: [ "https://opensearch:9200" ]
insecure: true
username: admin
password: admin
password: Developer@123
index: apache_logs

0 comments on commit 0e00df6

Please sign in to comment.