Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update parquet-avro, parquet-hadoop to 1.14.0 #967

Merged
merged 2 commits into from
May 16, 2024
Merged

Update parquet-avro, parquet-hadoop to 1.14.0 #967

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
5ce567f
Update parquet-avro, parquet-hadoop to 1.14.0
scala-steward May 8, 2024
5901ab2
WIP
RustedBones May 15, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion build.sbt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -35,7 +35,7 @@ val jodaTimeVersion = "2.12.7"
val munitVersion = "0.7.29"
val neo4jDriverVersion = "4.4.12"
val paigesVersion = "0.4.3"
val parquetVersion = "1.13.1"
val parquetVersion = "1.14.0"
val protobufVersion = "3.25.2"
val refinedVersion = "0.11.1"
val scalaCollectionCompatVersion = "2.12.0"
Expand Down
7 changes: 5 additions & 2 deletions parquet/src/main/scala/magnolify/parquet/ParquetType.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -32,6 +32,7 @@ import org.apache.parquet.io.api._
import org.apache.parquet.io.{InputFile, OutputFile}
import org.apache.parquet.schema.MessageType
import org.slf4j.LoggerFactory
import org.typelevel.scalaccompat.annotation.nowarn

sealed trait ParquetArray

Expand Down Expand Up @@ -126,8 +127,10 @@ object ParquetType {

override def init(context: hadoop.InitContext): hadoop.ReadSupport.ReadContext = {
if (parquetType == null) {
parquetType =
SerializationUtils.fromBase64[ParquetType[T]](context.getConfiguration.get(ReadTypeKey))
// Use deprecated getConfiguration
// Recommended getParquetConfiguration is only available for parquet 1.14+
val readKeyType = context.getConfiguration.get(ReadTypeKey): @nowarn("cat=deprecation")
parquetType = SerializationUtils.fromBase64[ParquetType[T]](readKeyType)
}

val metadata = context.getKeyValueMetadata
Expand Down
2 changes: 1 addition & 1 deletion scalafix/build.sbt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -60,7 +60,7 @@ def magnolify(version: String): List[ModuleID] = {
"com.google.cloud.datastore" % "datastore-v1-proto-client" % "2.18.4",
"com.google.guava" % "guava" % "33.1.0-jre",
"org.neo4j.driver" % "neo4j-java-driver" % "4.4.12",
"org.apache.parquet" % "parquet-hadoop" % "1.13.1",
"org.apache.parquet" % "parquet-hadoop" % "1.14.0",
"com.google.protobuf" % "protobuf-java" % "3.25.3",
"eu.timepit" %% "refined" % "0.11.1",
"org.scalacheck" %% "scalacheck" % "1.17.1",
Expand Down
Loading