I'm working in a project including modern data stack like airflow, airbyte and dbt. My airbyte tool is installed on local and airflow in a docker, I struggle to find the best host to set when adding a new airbyte connection from airflow. Localhost is not right because in this case it concerned the docker itself and when I use the IP address of airbyte this approach doens't satisfy my goal.
I expect a succeeded connection to my airbyte (4.0.0) I have tried the two existing type of connection as Http and Airbyte, I have the right client_id and client_secret but there is error as :
[2025-01-21, 14:40:08 UTC] {taskinstance.py:3311} ERROR - Task failed with exception
Traceback (most recent call last):
File "/root/.cache/pypoetry/virtualenvs/airbyte-deployment-BsnH11MF-py3.8/lib/python3.8/site-packages/airflow/providers/airbyte/hooks/airbyte.py", line 157, in submit_sync_connection
res = self.airbyte_api.jobs.create_job(
File "/root/.cache/pypoetry/virtualenvs/airbyte-deployment-BsnH11MF-py3.8/lib/python3.8/site-packages/airbyte_api/jobs.py", line 100, in create_job
raise e
File "/root/.cache/pypoetry/virtualenvs/airbyte-deployment-BsnH11MF-py3.8/lib/python3.8/site-packages/airbyte_api/jobs.py", line 95, in create_job
req = self.sdk_configuration.get_hooks().before_request(BeforeRequestContext(hook_ctx), req)
File "/root/.cache/pypoetry/virtualenvs/airbyte-deployment-BsnH11MF-py3.8/lib/python3.8/site-packages/airbyte_api/_hooks/sdkhooks.py", line 41, in before_request
out = hook.before_request(hook_ctx, request)
File "/root/.cache/pypoetry/virtualenvs/airbyte-deployment-BsnH11MF-py3.8/lib/python3.8/site-packages/airbyte_api/_hooks/clientcredentials.py", line 59, in before_request
sess = self.do_token_request(credentials, self.get_scopes(
File "/root/.cache/pypoetry/virtualenvs/airbyte-deployment-BsnH11MF-py3.8/lib/python3.8/site-packages/airbyte_api/_hooks/clientcredentials.py", line 122, in do_token_request
raise Exception(
Exception: Unexpected status code 401 from token endpoint
During handling of the above exception, another exception occurred: