feat(datahub-ingestion): refactor slim image to add vs remove pyspark… #20826

Job	Run time
build (./gradlew build -x :metadata-ingestion:build -x :metadata-ingestion:check -x docs-website:...	16m 43s
build (./gradlew build -x :metadata-ingestion:build -x :metadata-ingestion:check -x docs-website:...	15m 30s
build (./gradlew :datahub-frontend:build :datahub-web-react:build --parallel, UTC)	22m 37s
build (./gradlew :datahub-frontend:build :datahub-web-react:build --parallel, America/New_York)	28m 6s
build (./gradlew :metadata-ingestion-modules:airflow-plugin:build --parallel, UTC)	11m 1s
build (./gradlew :metadata-ingestion-modules:airflow-plugin:build --parallel, America/New_York)	12m 0s
event-file	2s
quickstart-compose-validation	25s
	1h 46m 24s

Provide feedback