feat(datahub-ingestion): refactor slim image to add vs remove pyspark… #20790

Job	Run time
event-file	2s
build (./gradlew build -x :metadata-ingestion:build -x :metadata-ingestion:check -x docs-website:...	15m 50s
build (./gradlew build -x :metadata-ingestion:build -x :metadata-ingestion:check -x docs-website:...	20m 53s
build (./gradlew :datahub-frontend:build :datahub-web-react:build --parallel, UTC)	22m 0s
build (./gradlew :datahub-frontend:build :datahub-web-react:build --parallel, America/New_York)	22m 21s
build (./gradlew :metadata-ingestion-modules:airflow-plugin:build --parallel, UTC)	9m 51s
build (./gradlew :metadata-ingestion-modules:airflow-plugin:build --parallel, America/New_York)	8m 31s
quickstart-compose-validation	22s
	1h 39m 50s

Provide feedback