最新消息:雨落星辰是一个专注网站SEO优化、网站SEO诊断、搜索引擎研究、网络营销推广、网站策划运营及站长类的自媒体原创博客

airbyte connection host managing when airflow is on container docker and airbyte on the loacl machine - Stack Overflow

programmeradmin2浏览0评论

I'm working in a project including modern data stack like airflow, airbyte and dbt. My airbyte tool is installed on local and airflow in a docker, I struggle to find the best host to set when adding a new airbyte connection from airflow. Localhost is not right because in this case it concerned the docker itself and when I use the IP address of airbyte this approach doens't satisfy my goal.

I expect a succeeded connection to my airbyte (4.0.0) I have tried the two existing type of connection as Http and Airbyte, I have the right client_id and client_secret but there is error as :

[2025-01-21, 14:40:08 UTC] {taskinstance.py:3311} ERROR - Task failed with exception
Traceback (most recent call last):
  File "/root/.cache/pypoetry/virtualenvs/airbyte-deployment-BsnH11MF-py3.8/lib/python3.8/site-packages/airflow/providers/airbyte/hooks/airbyte.py", line 157, in submit_sync_connection
    res = self.airbyte_api.jobs.create_job(
  File "/root/.cache/pypoetry/virtualenvs/airbyte-deployment-BsnH11MF-py3.8/lib/python3.8/site-packages/airbyte_api/jobs.py", line 100, in create_job
    raise e
  File "/root/.cache/pypoetry/virtualenvs/airbyte-deployment-BsnH11MF-py3.8/lib/python3.8/site-packages/airbyte_api/jobs.py", line 95, in create_job
    req = self.sdk_configuration.get_hooks().before_request(BeforeRequestContext(hook_ctx), req)
  File "/root/.cache/pypoetry/virtualenvs/airbyte-deployment-BsnH11MF-py3.8/lib/python3.8/site-packages/airbyte_api/_hooks/sdkhooks.py", line 41, in before_request
    out = hook.before_request(hook_ctx, request)
  File "/root/.cache/pypoetry/virtualenvs/airbyte-deployment-BsnH11MF-py3.8/lib/python3.8/site-packages/airbyte_api/_hooks/clientcredentials.py", line 59, in before_request
    sess = self.do_token_request(credentials, self.get_scopes(
  File "/root/.cache/pypoetry/virtualenvs/airbyte-deployment-BsnH11MF-py3.8/lib/python3.8/site-packages/airbyte_api/_hooks/clientcredentials.py", line 122, in do_token_request
    raise Exception(
Exception: Unexpected status code 401 from token endpoint
During handling of the above exception, another exception occurred:

与本文相关的文章

发布评论

评论列表(0)

  1. 暂无评论