fix(spark-test): upgrade gradle and fix spark smoke test #22000

Job	Run time
build (./gradlew build -x :metadata-ingestion:build -x :metadata-ingestion:check -x docs-website:...	19m 26s
build (./gradlew build -x :metadata-ingestion:build -x :metadata-ingestion:check -x docs-website:...	13m 47s
build (./gradlew :datahub-frontend:build :datahub-web-react:build --parallel, UTC)	18m 45s
build (./gradlew :datahub-frontend:build :datahub-web-react:build --parallel, America/New_York)	18m 27s
build (./gradlew :metadata-ingestion-modules:airflow-plugin:build --parallel, UTC)	6m 56s
build (./gradlew :metadata-ingestion-modules:airflow-plugin:build --parallel, America/New_York)	6m 57s
quickstart-compose-validation	19s
event-file	3s
	1h 24m 40s

Provide feedback