Skip to content

Latest commit

 

History

History
42 lines (30 loc) · 2.37 KB

spark-sql-Expression-StaticInvoke.adoc

File metadata and controls

42 lines (30 loc) · 2.37 KB

StaticInvoke Non-SQL Expression

StaticInvoke is an expression with no SQL representation that represents a static method call in Scala or Java.

StaticInvoke supports Java code generation (aka whole-stage codegen) to evaluate itself.

StaticInvoke is created when:

  • ScalaReflection is requested for the deserializer or serializer for a Scala type

  • RowEncoder is requested for deserializerFor or serializer for a Scala type

  • JavaTypeInference is requested for deserializerFor or serializerFor

import org.apache.spark.sql.types.StructType
val schema = new StructType()
  .add($"id".long.copy(nullable = false))
  .add($"name".string.copy(nullable = false))

import org.apache.spark.sql.catalyst.encoders.RowEncoder
val encoder = RowEncoder(schema)
scala> println(encoder.serializer(0).numberedTreeString)
00 validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 0, id), LongType) AS id#1640L
01 +- validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 0, id), LongType)
02    +- getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 0, id)
03       +- assertnotnull(input[0, org.apache.spark.sql.Row, true])
04          +- input[0, org.apache.spark.sql.Row, true]
Note
 StaticInvoke is similar to CallMethodViaReflection expression.

Creating StaticInvoke Instance

StaticInvoke takes the following when created:

  • Target object of the static call

  • Data type of the return value of the method

  • Name of the method to call on the static object

  • Optional expressions to pass as input arguments to the function

  • Flag to control whether to propagate nulls or not (enabled by default). If any of the arguments is null, null is returned instead of calling the function