Spark SQL Join
We use Join in spark to combine records from two data frame based on joining condition.
Join Types
Inner Join :
Output of Inner join will have
- matched records from both data frame.
Left Join :
Output of Left join will have
- matched records from both data frame
- un-matched from left data frame
(For such records columns from right data frame will have "null" value)
Right Join :
Output of Right join will have
- matched records from both data frame
- un-matched from right data frame
(For such records columns from left data frame will have "null" value)
Outer Join :
Output of Outer join will have
- matched records from both data frame
- un-matched from left data frame
(For such records columns from right data frame will have "null" value)
- un-matched from right data frame
(For such records columns from left data frame will have "null" value)
Left Anti Join :
Output of Left Anti join will have
- un-matched from left data frame
#pyspark #spark #python #sparksql #dataframe #join #inner #outer #left #right #leftanti
Download
0 formats
No download links available.
PySpark Examples - How to join DataFrames (inner, left, right, outer, anti) - Spark SQL | NatokHD