最新消息:雨落星辰是一个专注网站SEO优化、网站SEO诊断、搜索引擎研究、网络营销推广、网站策划运营及站长类的自媒体原创博客

google cloud platform - Airflow SSH Operator bash commands are failing Intermittently - Stack Overflow

programmeradmin1浏览0评论

We are currently running multiple bash commands through Airflow 2.7.3 version under Google Cloud Composer.

from airflow.providers.ssh.operators.ssh import SSHOperator

task_exec = SSHOperator(
    task_id='additonal_info',
    command="ksh -x execute.ksh paramter1",
    ssh_conn_id="SSH_CONNECTION",
    conn_timeout=432000,       
)

Sometimes command runs for 1 hour , sometime to 8 hours and sometimes with in 30-40 minutes commands fails with returning no error at the bottom of Airflow task but it will be failed state in Airflow.

Could any one pls suggest what can be done to fix this issue

发布评论

评论列表(0)

  1. 暂无评论