[BUG] Databricks is not able to recognize complex datatypes (struct
, map
, array
)
#10808
Labels
bug
Bugs bugs bugs!
struct
, map
, array
)
#10808
Describe the bug
Currently the databricks sql connector is not able to expose a
STRUCT()
,MAP()
, orARRAY()
type. This means if there is anARRAY
ofSTRING
values, then GX will read in the column as aSTRING
. Although this sort of casting will allow for Expectations that depend on types (likeExpectColumnToBeOfType
) to run, the casting of the complex types can cause confusion.This is already an issue in the
databricks-sql-python
repo here, and we will monitor this ticket until it is resolvedTo Reproduce
Please include your great_expectations.yml config, the code you’re executing that causes the issue, and the full stack trace of any error(s).
Expected behavior
Environment (please complete the following information):
Additional context
The text was updated successfully, but these errors were encountered: