Skip to content
Back to pull request #8952

feat(ingest/unity): Use ThreadPoolExecutor for CLL #14550

Sign in to view logs

feat(ingest/unity): Use ThreadPoolExecutor for CLL

feat(ingest/unity): Use ThreadPoolExecutor for CLL #14550

Triggered via pull request October 6, 2023 03:28
@asikowitzasikowitz
synchronize #8952
asikowitz:databricks-optimize-cll
Status Success
Total duration 1h 33m 13s
Artifacts 13

docker-unified.yml

on: pull_request
setup
8s
setup
Build and Push DataHub Ingestion (Base) Docker Image
10s
Build and Push DataHub Ingestion (Base) Docker Image
Build and Push DataHub Upgrade Docker Image
10m 38s
Build and Push DataHub Upgrade Docker Image
Build and Push DataHub Frontend Docker Image
20m 30s
Build and Push DataHub Frontend Docker Image
Build and Push DataHub GMS Docker Image
10m 24s
Build and Push DataHub GMS Docker Image
Build and Push DataHub MAE Consumer Docker Image
10m 2s
Build and Push DataHub MAE Consumer Docker Image
Build and Push DataHub MCE Consumer Docker Image
7m 34s
Build and Push DataHub MCE Consumer Docker Image
Build and Push DataHub Kafka Setup Docker Image
3m 5s
Build and Push DataHub Kafka Setup Docker Image
Build and Push DataHub MySQL Setup Docker Image
53s
Build and Push DataHub MySQL Setup Docker Image
Build and Push DataHub Elasticsearch Setup Docker Image
48s
Build and Push DataHub Elasticsearch Setup Docker Image
Build and Push DataHub Ingestion (Base-Full) Docker Image
10s
Build and Push DataHub Ingestion (Base-Full) Docker Image
Build and Push DataHub Ingestion (Base-Slim) Docker Image
10s
Build and Push DataHub Ingestion (Base-Slim) Docker Image
[Monitoring] Scan DataHub Upgrade images for vulnerabilities
1m 0s
[Monitoring] Scan DataHub Upgrade images for vulnerabilities
[Monitoring] Scan Frontend images for vulnerabilities
1m 23s
[Monitoring] Scan Frontend images for vulnerabilities
[Monitoring] Scan GMS images for vulnerabilities
6m 15s
[Monitoring] Scan GMS images for vulnerabilities
[Monitoring] Scan MAE consumer images for vulnerabilities
1m 5s
[Monitoring] Scan MAE consumer images for vulnerabilities
[Monitoring] Scan MCE consumer images for vulnerabilities
51s
[Monitoring] Scan MCE consumer images for vulnerabilities
Build and Push DataHub Ingestion (Full) Docker Images
15m 57s
Build and Push DataHub Ingestion (Full) Docker Images
Build and Push DataHub Ingestion Docker Images
12m 3s
Build and Push DataHub Ingestion Docker Images
[Monitoring] Scan Datahub Ingestion images for vulnerabilities
2m 2s
[Monitoring] Scan Datahub Ingestion images for vulnerabilities
[Monitoring] Scan Datahub Ingestion Slim images for vulnerabilities
1m 22s
[Monitoring] Scan Datahub Ingestion Slim images for vulnerabilities
Matrix: Run Smoke Tests
Fit to window
Zoom out
Zoom in

Annotations

50 warnings
Build and Push DataHub Elasticsearch Setup Docker Image
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build and Push DataHub Elasticsearch Setup Docker Image
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build and Push DataHub Elasticsearch Setup Docker Image
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build and Push DataHub Elasticsearch Setup Docker Image
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build and Push DataHub Elasticsearch Setup Docker Image
The following actions uses node12 which is deprecated and will be forced to run on node16: crazy-max/ghaction-docker-meta@v1. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Build and Push DataHub MySQL Setup Docker Image
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build and Push DataHub MySQL Setup Docker Image
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build and Push DataHub MySQL Setup Docker Image
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build and Push DataHub MySQL Setup Docker Image
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build and Push DataHub MySQL Setup Docker Image
The following actions uses node12 which is deprecated and will be forced to run on node16: crazy-max/ghaction-docker-meta@v1. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Build and Push DataHub Kafka Setup Docker Image
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build and Push DataHub Kafka Setup Docker Image
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build and Push DataHub Kafka Setup Docker Image
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build and Push DataHub Kafka Setup Docker Image
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build and Push DataHub Kafka Setup Docker Image
The following actions uses node12 which is deprecated and will be forced to run on node16: crazy-max/ghaction-docker-meta@v1. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Build and Push DataHub GMS Docker Image
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build and Push DataHub GMS Docker Image
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build and Push DataHub GMS Docker Image
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build and Push DataHub GMS Docker Image
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build and Push DataHub GMS Docker Image
The following actions uses node12 which is deprecated and will be forced to run on node16: crazy-max/ghaction-docker-meta@v1. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Build and Push DataHub MAE Consumer Docker Image
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build and Push DataHub MAE Consumer Docker Image
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build and Push DataHub MAE Consumer Docker Image
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build and Push DataHub MAE Consumer Docker Image
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build and Push DataHub MAE Consumer Docker Image
The following actions uses node12 which is deprecated and will be forced to run on node16: crazy-max/ghaction-docker-meta@v1. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Build and Push DataHub MCE Consumer Docker Image
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build and Push DataHub MCE Consumer Docker Image
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build and Push DataHub MCE Consumer Docker Image
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build and Push DataHub MCE Consumer Docker Image
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build and Push DataHub MCE Consumer Docker Image
The following actions uses node12 which is deprecated and will be forced to run on node16: crazy-max/ghaction-docker-meta@v1. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Build and Push DataHub Upgrade Docker Image
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build and Push DataHub Upgrade Docker Image
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build and Push DataHub Upgrade Docker Image
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build and Push DataHub Upgrade Docker Image
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build and Push DataHub Upgrade Docker Image
The following actions uses node12 which is deprecated and will be forced to run on node16: crazy-max/ghaction-docker-meta@v1. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Build and Push DataHub Ingestion Docker Images
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build and Push DataHub Ingestion Docker Images
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build and Push DataHub Ingestion Docker Images
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build and Push DataHub Ingestion Docker Images
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build and Push DataHub Ingestion Docker Images
The following actions uses node12 which is deprecated and will be forced to run on node16: crazy-max/ghaction-docker-meta@v1. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Build and Push DataHub Frontend Docker Image
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build and Push DataHub Frontend Docker Image
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build and Push DataHub Frontend Docker Image
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build and Push DataHub Frontend Docker Image
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build and Push DataHub Frontend Docker Image
The following actions uses node12 which is deprecated and will be forced to run on node16: crazy-max/ghaction-docker-meta@v1. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Build and Push DataHub Ingestion (Full) Docker Images
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build and Push DataHub Ingestion (Full) Docker Images
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build and Push DataHub Ingestion (Full) Docker Images
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build and Push DataHub Ingestion (Full) Docker Images
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build and Push DataHub Ingestion (Full) Docker Images
The following actions uses node12 which is deprecated and will be forced to run on node16: crazy-max/ghaction-docker-meta@v1. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/

Artifacts

Produced during runtime
Name Size
Test Results (smoke tests) cypress_rest Expired
318 Bytes
Test Results (smoke tests) cypress_suite1 Expired
320 Bytes
Test Results (smoke tests) no_cypress Expired
14.1 KB
action_image_artifact_acryldata_datahub-ingestion_pr8952 Expired
3.1 GB
action_image_artifact_acryldata_datahub-ingestion_pr8952-slim Expired
2.62 GB
action_image_artifact_acryldata_datahub-mysql-setup_pr8952 Expired
94.2 MB
action_image_artifact_acryldata_datahub-upgrade_pr8952 Expired
503 MB
action_image_artifact_linkedin_datahub-elasticsearch-setup_pr8952 Expired
24.9 MB
action_image_artifact_linkedin_datahub-frontend-react_pr8952 Expired
871 MB
action_image_artifact_linkedin_datahub-gms_pr8952 Expired
437 MB
action_image_artifact_linkedin_datahub-kafka-setup_pr8952 Expired
546 MB
action_image_artifact_linkedin_datahub-mae-consumer_pr8952 Expired
443 MB
action_image_artifact_linkedin_datahub-mce-consumer_pr8952 Expired
446 MB