Packages

t

org.apache.spark.sql.sedona_sql.expressions

DataframePhysicalFunction

trait DataframePhysicalFunction extends Expression with PhysicalFunction

DataframePhysicalFunctions are Functions that will be replaced with a Physical Node for their evaluation.

The physical node will transform the input dataframe into the output dataframe. execute handles conversion of the RDD[InternalRow] to a DataFrame and back. Each DataframePhysicalFunction should implement transformDataframe. The output dataframe should have the same schema as the input dataframe, except for the resultAttrs which should be added to the output dataframe.

Linear Supertypes
PhysicalFunction, Serializable, Serializable, Unevaluable, ImplicitCastInputTypes, ExpectsInputTypes, Expression, TreeNode[Expression], TreePatternBits, Product, Equals, AnyRef, Any
Known Subclasses
ST_BinaryDistanceBandColumn, ST_DBSCAN, ST_GLocal, ST_LocalOutlierFactor, ST_WeightedDistanceBandColumn
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. DataframePhysicalFunction
  2. PhysicalFunction
  3. Serializable
  4. Serializable
  5. Unevaluable
  6. ImplicitCastInputTypes
  7. ExpectsInputTypes
  8. Expression
  9. TreeNode
  10. TreePatternBits
  11. Product
  12. Equals
  13. AnyRef
  14. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Abstract Value Members

  1. abstract def canEqual(that: Any): Boolean
    Definition Classes
    Equals
  2. abstract def children: Seq[Expression]
    Definition Classes
    TreeNode
  3. abstract def dataType: DataType
    Definition Classes
    Expression
  4. abstract def inputTypes: Seq[AbstractDataType]
    Definition Classes
    ExpectsInputTypes
  5. abstract def productArity: Int
    Definition Classes
    Product
  6. abstract def productElement(n: Int): Any
    Definition Classes
    Product
  7. abstract def transformDataframe(dataframe: DataFrame, resultAttrs: Seq[Attribute]): DataFrame
    Attributes
    protected
  8. abstract def withNewChildrenInternal(newChildren: IndexedSeq[Expression]): Expression
    Attributes
    protected
    Definition Classes
    TreeNode

Concrete Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. def apply(number: Int): TreeNode[_]
    Definition Classes
    TreeNode
  5. def argString(maxFields: Int): String
    Definition Classes
    TreeNode
  6. def asCode: String
    Definition Classes
    TreeNode
  7. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  8. lazy val canonicalized: Expression
    Definition Classes
    Expression
  9. def checkInputDataTypes(): TypeCheckResult
    Definition Classes
    ExpectsInputTypes → Expression
  10. def childrenResolved: Boolean
    Definition Classes
    Expression
  11. def clone(): Expression
    Definition Classes
    TreeNode → AnyRef
  12. def collect[B](pf: PartialFunction[Expression, B]): Seq[B]
    Definition Classes
    TreeNode
  13. def collectFirst[B](pf: PartialFunction[Expression, B]): Option[B]
    Definition Classes
    TreeNode
  14. def collectLeaves(): Seq[Expression]
    Definition Classes
    TreeNode
  15. final def containsAllPatterns(patterns: TreePattern*): Boolean
    Definition Classes
    TreePatternBits
  16. final def containsAnyPattern(patterns: TreePattern*): Boolean
    Definition Classes
    TreePatternBits
  17. lazy val containsChild: Set[TreeNode[_]]
    Definition Classes
    TreeNode
  18. final def containsPattern(t: TreePattern): Boolean
    Definition Classes
    TreePatternBits
    Annotations
    @inline()
  19. def copyTagsFrom(other: Expression): Unit
    Definition Classes
    TreeNode
  20. final lazy val deterministic: Boolean
    Definition Classes
    PhysicalFunction → Expression
  21. final def doGenCode(ctx: CodegenContext, ev: ExprCode): ExprCode
    Attributes
    protected
    Definition Classes
    Unevaluable → Expression
  22. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  23. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  24. final def eval(input: InternalRow): Any
    Definition Classes
    Unevaluable → Expression
  25. def execute(plan: SparkPlan, resultAttrs: Seq[Attribute]): RDD[InternalRow]
    Definition Classes
    DataframePhysicalFunction → PhysicalFunction
  26. def exists(f: (Expression) ⇒ Boolean): Boolean
    Definition Classes
    TreeNode
  27. def fastEquals(other: TreeNode[_]): Boolean
    Definition Classes
    TreeNode
  28. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  29. def find(f: (Expression) ⇒ Boolean): Option[Expression]
    Definition Classes
    TreeNode
  30. def flatArguments: Iterator[Any]
    Attributes
    protected
    Definition Classes
    Expression
  31. def flatMap[A](f: (Expression) ⇒ TraversableOnce[A]): Seq[A]
    Definition Classes
    TreeNode
  32. final def foldable: Boolean
    Definition Classes
    Unevaluable → Expression
  33. def foreach(f: (Expression) ⇒ Unit): Unit
    Definition Classes
    TreeNode
  34. def foreachUp(f: (Expression) ⇒ Unit): Unit
    Definition Classes
    TreeNode
  35. def genCode(ctx: CodegenContext): ExprCode
    Definition Classes
    Expression
  36. def generateTreeString(depth: Int, lastChildren: Seq[Boolean], append: (String) ⇒ Unit, verbose: Boolean, prefix: String, addSuffix: Boolean, maxFields: Int, printNodeId: Boolean, indent: Int): Unit
    Definition Classes
    TreeNode
  37. final lazy val geometryColumnName: String
    Attributes
    protected
    Definition Classes
    PhysicalFunction
  38. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  39. def getDefaultTreePatternBits: BitSet
    Attributes
    protected
    Definition Classes
    TreeNode
  40. def getInputName(i: Int, fieldName: String): String
    Attributes
    protected
    Definition Classes
    PhysicalFunction
  41. def getInputNames(i: Int, fieldName: String): Seq[String]
    Attributes
    protected
    Definition Classes
    PhysicalFunction
  42. def getResultName(resultAttrs: Seq[Attribute]): String
    Attributes
    protected
    Definition Classes
    PhysicalFunction
  43. def getScalarValue[T](i: Int, name: String)(implicit ct: ClassTag[T]): T
    Attributes
    protected
    Definition Classes
    PhysicalFunction
  44. def getTagValue[T](tag: TreeNodeTag[T]): Option[T]
    Definition Classes
    TreeNode
  45. def hashCode(): Int
    Definition Classes
    TreeNode → AnyRef → Any
  46. def innerChildren: Seq[TreeNode[_]]
    Definition Classes
    TreeNode
  47. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  48. def isRuleIneffective(ruleId: RuleId): Boolean
    Attributes
    protected
    Definition Classes
    TreeNode
  49. def jsonFields: List[JField]
    Attributes
    protected
    Definition Classes
    TreeNode
  50. final def legacyWithNewChildren(newChildren: Seq[Expression]): Expression
    Attributes
    protected
    Definition Classes
    TreeNode
  51. def makeCopy(newArgs: Array[AnyRef]): Expression
    Definition Classes
    TreeNode
  52. def map[A](f: (Expression) ⇒ A): Seq[A]
    Definition Classes
    TreeNode
  53. def mapChildren(f: (Expression) ⇒ Expression): Expression
    Definition Classes
    TreeNode
  54. def mapProductIterator[B](f: (Any) ⇒ B)(implicit arg0: ClassTag[B]): Array[B]
    Attributes
    protected
    Definition Classes
    TreeNode
  55. def markRuleAsIneffective(ruleId: RuleId): Unit
    Attributes
    protected
    Definition Classes
    TreeNode
  56. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  57. def nodeName: String
    Definition Classes
    TreeNode
  58. val nodePatterns: Seq[TreePattern]
    Attributes
    protected
    Definition Classes
    TreeNode
  59. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  60. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  61. def nullable: Boolean
    Definition Classes
    PhysicalFunction → Expression
  62. def numberedTreeString: String
    Definition Classes
    TreeNode
  63. val origin: Origin
    Definition Classes
    TreeNode
  64. def otherCopyArgs: Seq[AnyRef]
    Attributes
    protected
    Definition Classes
    TreeNode
  65. def p(number: Int): Expression
    Definition Classes
    TreeNode
  66. lazy val preCanonicalized: Expression
    Definition Classes
    Expression
  67. def prettyJson: String
    Definition Classes
    TreeNode
  68. def prettyName: String
    Definition Classes
    Expression
  69. def productIterator: Iterator[Any]
    Definition Classes
    Product
  70. def productPrefix: String
    Definition Classes
    Product
  71. def references: AttributeSet
    Definition Classes
    Expression
  72. lazy val resolved: Boolean
    Definition Classes
    Expression
  73. final def semanticEquals(other: Expression): Boolean
    Definition Classes
    Expression
  74. def semanticHash(): Int
    Definition Classes
    Expression
  75. def setTagValue[T](tag: TreeNodeTag[T], value: T): Unit
    Definition Classes
    TreeNode
  76. def simpleString(maxFields: Int): String
    Definition Classes
    Expression → TreeNode
  77. def simpleStringWithNodeId(): String
    Definition Classes
    Expression → TreeNode
  78. final lazy val sparkSession: SparkSession
    Attributes
    protected
    Definition Classes
    PhysicalFunction
  79. def sql: String
    Definition Classes
    Expression
  80. def stringArgs: Iterator[Any]
    Attributes
    protected
    Definition Classes
    TreeNode
  81. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  82. def toJSON: String
    Definition Classes
    TreeNode
  83. def toString(): String
    Definition Classes
    Expression → TreeNode → AnyRef → Any
  84. def transform(rule: PartialFunction[Expression, Expression]): Expression
    Definition Classes
    TreeNode
  85. def transformDown(rule: PartialFunction[Expression, Expression]): Expression
    Definition Classes
    TreeNode
  86. def transformDownWithPruning(cond: (TreePatternBits) ⇒ Boolean, ruleId: RuleId)(rule: PartialFunction[Expression, Expression]): Expression
    Definition Classes
    TreeNode
  87. def transformUp(rule: PartialFunction[Expression, Expression]): Expression
    Definition Classes
    TreeNode
  88. def transformUpWithBeforeAndAfterRuleOnChildren(cond: (Expression) ⇒ Boolean, ruleId: RuleId)(rule: PartialFunction[(Expression, Expression), Expression]): Expression
    Definition Classes
    TreeNode
  89. def transformUpWithPruning(cond: (TreePatternBits) ⇒ Boolean, ruleId: RuleId)(rule: PartialFunction[Expression, Expression]): Expression
    Definition Classes
    TreeNode
  90. def transformWithPruning(cond: (TreePatternBits) ⇒ Boolean, ruleId: RuleId)(rule: PartialFunction[Expression, Expression]): Expression
    Definition Classes
    TreeNode
  91. lazy val treePatternBits: BitSet
    Definition Classes
    TreeNode → TreePatternBits
  92. def treeString(append: (String) ⇒ Unit, verbose: Boolean, addSuffix: Boolean, maxFields: Int, printOperatorId: Boolean): Unit
    Definition Classes
    TreeNode
  93. final def treeString(verbose: Boolean, addSuffix: Boolean, maxFields: Int, printOperatorId: Boolean): String
    Definition Classes
    TreeNode
  94. final def treeString: String
    Definition Classes
    TreeNode
  95. def typeSuffix: String
    Attributes
    protected
    Definition Classes
    Expression
  96. def unsetTagValue[T](tag: TreeNodeTag[T]): Unit
    Definition Classes
    TreeNode
  97. final def verboseString(maxFields: Int): String
    Definition Classes
    Expression → TreeNode
  98. def verboseStringWithSuffix(maxFields: Int): String
    Definition Classes
    TreeNode
  99. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  100. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  101. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  102. final def withNewChildren(newChildren: Seq[Expression]): Expression
    Definition Classes
    TreeNode

Inherited from PhysicalFunction

Inherited from Serializable

Inherited from Serializable

Inherited from Unevaluable

Inherited from ImplicitCastInputTypes

Inherited from ExpectsInputTypes

Inherited from Expression

Inherited from TreeNode[Expression]

Inherited from TreePatternBits

Inherited from Product

Inherited from Equals

Inherited from AnyRef

Inherited from Any

Ungrouped