Is it possible to directly export a Snowpark DataFrame to Databricks, or must the DataFrame first be exported to an external cloud storage (e.g. S3 as parquet) before Databricks can access it?
Is it possible to directly export a Snowpark DataFrame to Databricks, or must the DataFrame first be exported to an external cloud storage (e.g. S3 as parquet) before Databricks can access it?
Share Improve this question asked Jan 20 at 18:06 gobigorgobaldgobigorgobald 253 bronze badges1 Answer
Reset to default 0Snowpark does not have an integration to directly export a DataFrame to Databricks. However, as you mentioned, you can export or save the DataFrame to external cloud storage and then read the data into a DataFrame in Databricks.
As of now, Snowpark cannot write to Databricks Delta tables, so using external cloud storage seems to be the only viable option for exchanging data or DataFrames between Snowpark and Databricks.