I am working with a script in which there is a join of two dataframes with many columns each, the first is given an alias "A" and the second "B", the same for the columns of each one. Additional columns are created for the result of the join that are conditionally filled and made inside a select to avoid the use of withColumn and thus make the process more efficient.
I've tried something like this
val correctionDF = clientsDF.alias ("A" join (dataDF.alias ("B"), condition, "full"). select ("*", when (col ("B.entity"). isNull, col ("A.entity")). otherwise (col ("B.entity")). alias ("correctionEntity"))
But I get:
Name: Syntax Error. Message: StackTrace: