[FEA][Audit] [follow-up] Default values in schema caused Spark RAPIDS faliure #12031
Labels
audit_4.0.0
Audit related tasks for 4.0.0
feature request
New feature or request
P2
Not required for release
Is your feature request related to a problem? Please describe.
Apache Spark posted a commit commit to fix a bug related to default values in schema. Currently Spark-Rapids does not support default values in schema, so this kind of bug does not occur in Spark-Rapids. This issue is just a follow-up in case Spark-Rapids supports default values in schema in future.
Mark P2 priority for this issue, because currently Spark-Rapids does not trigger the bug.
How to trigger the bug on Spark without Spark-Rapids:
spark.conf.set("spark.rapids.sql.enabled", false)
Reports:
Currently Spark-Rapids does not support default value
spark.conf.set("spark.rapids.sql.enabled", true)
// run the above code
Reports:
Describe the solution you'd like
Do not require any fix/develop currently.
When support default values in schema in future, should add this case as regression test to check the behavior of GPU .
The text was updated successfully, but these errors were encountered: