You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
A clear and concise description of what the bug is. What command did you run? What happened?
Array inside struct not working throught DBT
Steps To Reproduce
In as much detail as possible, please provide steps to reproduce the issue. Sample data that triggers the issue, example model code, etc is all very helpful here.
This query works fine when in directly run it into databricks but not from dbt macro run_query
select col1, col2, col3, named_struct( 'K1',col3, 'K2', col2 ) map from table --col2 is an Array , col3 is string
It throws this error Object of type ndarray is not JSON serializable> in macro run_query (macros\etc\statement.sql)
Expected behavior
A clear and concise description of what you expected to happen.
If this query runs well in databricks why it is not working throught DBT
Screenshots and log output
If applicable, add screenshots or log output to help explain your problem.
System information
The output of dbt --version:
Core:
- installed: 1.6.6
The latest version of dbt-core could not be determined!
Make sure that the following URL is accessible:
https://pypi.org/pypi/dbt-core/json
Plugins:
- databricks: 1.6.6 - Update available!
- spark: 1.6.1 - Update available!
The operating system you're using:
Windows 11
The output of python --version:
Python 3.10.6
Additional context
Add any other context about the problem here.
I downgraded from 1.7 to 1.6 because slowness issue in 1.7
The text was updated successfully, but these errors were encountered:
This issue has been marked as Stale because it has been open for 180 days with no activity. If you would like the issue to remain open, please remove the stale label or comment on the issue.
Describe the bug
A clear and concise description of what the bug is. What command did you run? What happened?
Array inside struct not working throught DBT
Steps To Reproduce
In as much detail as possible, please provide steps to reproduce the issue. Sample data that triggers the issue, example model code, etc is all very helpful here.
This query works fine when in directly run it into databricks but not from dbt macro run_query
select col1, col2, col3, named_struct( 'K1',col3, 'K2', col2 ) map from table --col2 is an Array , col3 is string
It throws this error
Object of type ndarray is not JSON serializable> in macro run_query (macros\etc\statement.sql)
Expected behavior
A clear and concise description of what you expected to happen.
If this query runs well in databricks why it is not working throught DBT
Screenshots and log output
If applicable, add screenshots or log output to help explain your problem.
System information
The output of
dbt --version
:The operating system you're using:
Windows 11
The output of
python --version
:Python 3.10.6
Additional context
Add any other context about the problem here.
I downgraded from 1.7 to 1.6 because slowness issue in 1.7
The text was updated successfully, but these errors were encountered: