最新消息:雨落星辰是一个专注网站SEO优化、网站SEO诊断、搜索引擎研究、网络营销推广、网站策划运营及站长类的自媒体原创博客

pyspark - Can ibis-frame trans expr to hive SQL with lateral view explode? - Stack Overflow

programmeradmin2浏览0评论

When I use ibis-framework to generate SQL with pyspark dialect, I got this SQL:

SELECT
    `t2`.`did`,
    `t2`.`location_timestamp`,
    EXPLODE(FROM_JSON(`t2`.`devices`, 'Array<String>')) AS `device`
FROM `devices` AS `t2`

but the right hive SQL is:

SELECT
    `t2`.`did`,
    `t2`.`location_timestamp`,
    `device`,
FROM `devices` AS `t2`
LATERAL VIEW EXPLODE(FROM_JSON(`t2`.`devices`, 'Array<String>')) AS `device`

I want to know how to generate the right SQL.

发布评论

评论列表(0)

  1. 暂无评论