pyspark.sql.UDFRegistration.registerJavaUDAF

UDFRegistration.registerJavaUDAF(name: str, javaClassName: str) → None[source]

Register a Java user-defined aggregate function as a SQL function.

New in version 2.3.0.

Changed in version 3.4.0: Supports Spark Connect.

namestr

name of the user-defined aggregate function

javaClassNamestr

fully qualified name of java class

Examples

>>> spark.udf.registerJavaUDAF("javaUDAF", "test.org.apache.spark.sql.MyDoubleAvg")
... 
>>> df = spark.createDataFrame([(1, "a"),(2, "b"), (3, "a")],["id", "name"])
>>> df.createOrReplaceTempView("df")
>>> q = "SELECT name, javaUDAF(id) as avg from df group by name order by name desc"
>>> spark.sql(q).collect()  
[Row(name='b', avg=102.0), Row(name='a', avg=102.0)]
pyspark.sql.UDFRegistration.registerJavaFunction Protobuf