About valentiniacov

valentiniacov

Hello Community,I have the following scenario: We need to consume PubSub messages using a Push Subscription and a Cloud Run App.We have a PubSub topic, a Push Subscription and a Cloud Run Service deployed in GCP. The flow between the PubSub and Cloud...

valentiniacov · 08-26-2024

Hello Community,I have the following situation: At some moment in time one Dataform Action fails. We have a code segment like this:BEGIN SQL Code that may fail ExceptionENDAlthough we have the Exception block where we log the error by catching the er...

valentiniacov · 08-22-2024

Hello Community,I have the following situation in our project.We are using Dataform to transform some data that we ingest in our BQ datasets and to further expose those data as views and event payloads to our customers,We do have 3 GCP Environments: ...

valentiniacov · 08-05-2024

Hello Community,We need in our project, from a Dataform Workflow to trigger a Cloud Run Workflow via an end point.For this we decided to use a BigQuery Remote Function and call it from our Dataform Workflow.The BQ remote function looks like this:CREA...

valentiniacov · 05-17-2024

Hello Community,I have the following situation:In our project we have some config type: operations scripts that get executed every day.They are merge scripts like the following: config { type: "operations", dependencies: ["dependecy1", "dependecy2"],...

valentiniacov · 08-27-2024

Hello Community,I was able to find a solution for this issue: please see the code: EXCEPTION-- Handle Exception WHEN ERROR THEN ROLLBACK TRANSACTION; RAISE USING message = FORMAT("Execution of %s %s line, caused the error: %s.", @@error.statement_tex...

valentiniacov · 08-06-2024

Hello @mongaa,Thank you for the response. Can you please provide an example in Terraform where you create the remote function? Like I mentioned above we need a remote function that triggers a cloud run end point.Thank you!

valentiniacov · 05-18-2024

Thank you very much for the provided solution.

valentiniacov · 04-19-2024

Hello @ms4446,I have kept the same tag name but I have added the Logica l Dependencies as you suggested.By using the proposed workaround I am able to set up the order of execution between workflows that have the same tag name.Thank you for the provid...

valentiniacov · 04-18-2024

Hello @ms4446 ,Thank you very much for the detailed explanations and for the proposed solutions. Your kindness is much appreciated!

My Stats

valentiniacov's Bio

Badges valentiniacov Earned

Recent Activity

Consuming PubSub Message via Push Subscription and Cloud Run

Automatic failure of a Dataform Action

Dynamically assign a "defaultDatabase" in the dataform.json file

Creating a remote function from Dataform

Silent exit from a Dataform Workflow

Re: Automatic failure of a Dataform Action

Re: Creating a remote function from Dataform

Re: Silent exit from a Dataform Workflow

Re: Execution order of Dataform workflows with the same tag name.

Re: Execution order of Dataform workflows with the same tag name.