Need an advise as I am new to spark.
I have a dataframe with the following content -
admission year | city | subject | class| average marks
A typical data sample would be as below -
2024 | Los Angeles | Physics | 7 |97
2024 | Chicago | Physics | 7 | 95
The output columns desired is as below -
2024 Los Angeles Physics 7 | 2024 Chicago Physics 7 | .....
97 | 95 | .....
Any suggestion on the most performant solution for this transformation will be appreciated.