Looking for some help regarding the issue I'm facing after migrating from Airflow 1.10.11 to 2.2.3. I'm unable to execute the DAGs from UI as the task is going into queued state. I created the pod_template_file as suggested in the migration steps but still getting the below error:
"airflow.exceptions.AirflowException: Dag 'xxxxxxx' could not be found; either it does not exist or it failed to parse"
But I could see the DAGs inside the webserver and scheduler in the exact location where the task is trying to read from which is "/opt/airflow/dags/repo/". Surprisingly, I'm able to trigger the DAG from webserver's command line and the DAG is completing successfully. Any help please?
Hi All, Looking for some help in troubleshooting my airflow setup
I have setup the airflow in in Azure Cloud (Azure Container Apps) and attached an Azure File Share as an external mount/volume
airflow.cfgand 'webserver_config.py' file in the AIRFLOW_HOME (/opt/airflow), which is actually an azure mounted file system
airflow-webserver.pidfile in the AIRFLOW_HOME (/opt/airflow), which is actually an azure mounted file system
PermissionError: [Errno 1] Operation not permitted: '/opt/airflow/airflow-webserver.pid'
Attached screenshot for reference