feat(datahub-ingestion): refactor slim image to add vs remove pyspark… #20792

Job	Run time
quickstart-compose-validation	21s
event-file	3s
build (./gradlew build -x :metadata-ingestion:build -x :metadata-ingestion:check -x docs-website:...	15m 38s
build (./gradlew build -x :metadata-ingestion:build -x :metadata-ingestion:check -x docs-website:...	18m 27s
build (./gradlew :datahub-frontend:build :datahub-web-react:build --parallel, UTC)	26m 2s
build (./gradlew :datahub-frontend:build :datahub-web-react:build --parallel, America/New_York)	27m 50s
build (./gradlew :metadata-ingestion-modules:airflow-plugin:build --parallel, UTC)	9m 41s
build (./gradlew :metadata-ingestion-modules:airflow-plugin:build --parallel, America/New_York)	8m 16s
	1h 46m 18s

Provide feedback