You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We should have a way to set a table's target split size for the Iceberg connector in Presto. The current default is 128MB and in some cases generates too much overhead. We should be able to set the target split size in order to tune the performance of some or all queries.
Expected Behavior or Use Case
We should be able to set the target split size either via table properties or session properties.
Presto Component, Service, or Connector
Iceberg connector.
Possible Implementation
Add session property to configure split size for all queries in a session (overrides table property)
Add support for target split size in ALTER TABLE ... SET PROPERTIES statement
Context
During table scan planning within the Iceberg connector, we generate splits based on the iceberg table's read.split.target-size property. For while there was no easy way to set table properties. However #21495 introduced this feature, but still doesn't allow setting arbitrary properties unless we update the set of supported table properties in IcebergAbstractMetadata#setTableProperties.
We should introduce support for setting the table property size to allow tuning this parameter on Iceberg tables.
The text was updated successfully, but these errors were encountered:
We should have a way to set a table's target split size for the Iceberg connector in Presto. The current default is 128MB and in some cases generates too much overhead. We should be able to set the target split size in order to tune the performance of some or all queries.
Expected Behavior or Use Case
We should be able to set the target split size either via table properties or session properties.
Presto Component, Service, or Connector
Iceberg connector.
Possible Implementation
ALTER TABLE ... SET PROPERTIES
statementContext
During table scan planning within the Iceberg connector, we generate splits based on the iceberg table's
read.split.target-size
property. For while there was no easy way to set table properties. However #21495 introduced this feature, but still doesn't allow setting arbitrary properties unless we update the set of supported table properties inIcebergAbstractMetadata#setTableProperties
.We should introduce support for setting the table property size to allow tuning this parameter on Iceberg tables.
The text was updated successfully, but these errors were encountered: