最新消息:雨落星辰是一个专注网站SEO优化、网站SEO诊断、搜索引擎研究、网络营销推广、网站策划运营及站长类的自媒体原创博客

azure - Data Factory to Snowflake copy task Fails with Failed to open the database error - Stack Overflow

programmeradmin2浏览0评论

We are copying data from an ODBC source to snowflake using azure storage for the staging area. The linked service is a blob linked service using a SAS token. The data sets connect just fine and pull through the meta data for the snowflake connection but when i run the copy I get the following error:

ErrorCode=GenericAdoNetConnectionOpenError,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Failed to open the database connection.,Source=Microsoft.DataTransfer.Connectors.GenericAdoNet,''Type=Apache.Arrow.Adbc.AdbcException,Message=[Snowflake] Post ":443/session/v1/login-request?databaseName=OUR_DB&requestId=0de84404-17f7-4379-7b69-cb4e98a46f50&request_guid=05486636-80a0-4ccc-6172-e55102d87ae8&roleName=snowflake_data_factory_dev_role&warehouse=OUR_WH": context deadline exceeded (Client.Timeout exceeded while awaiting headers),Source=Apache.Arrow.Adbc,'

The weird part is that the datasets connect to Snowflake just fine and are able to pull back the meta data. Calling stored procedures also works just fine. The only thing that doesnt work is the copy task step from azure storage to Snowflake.

Here is the service integration called out and the stage settings.

this was working in our original data factory in a different subscription before we tore it down and recreated it in the new/correct subscription. I dont understand why I can get the meta data just fine but cant connect in the copy.

We are copying data from an ODBC source to snowflake using azure storage for the staging area. The linked service is a blob linked service using a SAS token. The data sets connect just fine and pull through the meta data for the snowflake connection but when i run the copy I get the following error:

ErrorCode=GenericAdoNetConnectionOpenError,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Failed to open the database connection.,Source=Microsoft.DataTransfer.Connectors.GenericAdoNet,''Type=Apache.Arrow.Adbc.AdbcException,Message=[Snowflake] Post "https://OurAccount.snowflakecomputing:443/session/v1/login-request?databaseName=OUR_DB&requestId=0de84404-17f7-4379-7b69-cb4e98a46f50&request_guid=05486636-80a0-4ccc-6172-e55102d87ae8&roleName=snowflake_data_factory_dev_role&warehouse=OUR_WH": context deadline exceeded (Client.Timeout exceeded while awaiting headers),Source=Apache.Arrow.Adbc,'

The weird part is that the datasets connect to Snowflake just fine and are able to pull back the meta data. Calling stored procedures also works just fine. The only thing that doesnt work is the copy task step from azure storage to Snowflake.

Here is the service integration called out and the stage settings.

this was working in our original data factory in a different subscription before we tore it down and recreated it in the new/correct subscription. I dont understand why I can get the meta data just fine but cant connect in the copy.

Share Improve this question edited Jan 20 at 16:47 lem asked Jan 17 at 20:35 lemlem 1171 silver badge11 bronze badges 1
  • have you paseed correct credentials? – Pratik Lad Commented Jan 20 at 3:24
Add a comment  | 

1 Answer 1

Reset to default 0

The solution was to change the integration runtime of the blob storage account, used to stage the snowflake data, from the self hosted agent used in the source to an azure managed integration runtime.

发布评论

评论列表(0)

  1. 暂无评论