When I use ibis-framework to generate SQL with pyspark dialect, I got this SQL:
SELECT
`t2`.`did`,
`t2`.`location_timestamp`,
EXPLODE(FROM_JSON(`t2`.`devices`, 'Array<String>')) AS `device`
FROM `devices` AS `t2`
but the right hive SQL is:
SELECT
`t2`.`did`,
`t2`.`location_timestamp`,
`device`,
FROM `devices` AS `t2`
LATERAL VIEW EXPLODE(FROM_JSON(`t2`.`devices`, 'Array<String>')) AS `device`
I want to know how to generate the right SQL.