Get alerts on specific Dataform job failure from multiple files in a workflow

[pra_pancholi]

Hi all,

I am using Google Cloud Logging and monitoring to create alerts on my Dataform workflow failures. Is it possible to get failure alerts on a specific file which failed from a workflow execution which contains multiple files? 

Additionally, the current setup waits for all other files to complete before sending a alert, is it possible to get it as soon as the job fails and other files continue running in the same workflow execution?

Please let me know if anyone has found better ways to monitor Dataform job failures

Thank you! 

Best,
Prashant Pancholi

[cassandramae]

Hi @pra_pancholi,

Welcome to Google Cloud Community!

Upon checking, this specific use case is not yet available. With this, it would be great to file this a feature request. Please note that I can't provide any details or timelines at this moment. Once submitted, you may check it from time to time for any updates or visit the following release notes:

• Dataform release notes
• Cloud Logging release notes
• Cloud Monitoring release notes

Hope it helps.