Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Forum Posts
Define list of string form query results to use in loop operation
Hi, I wanted to do this looping in dataform .sqlx file: js { const tables = [ 'table1', 'table2', 'table3' ]; ...
Dataform Merge Statement
I keep facing this issue where dataform highlights an error pertaining the use of the "MERGE" within the works...
Exceeded rate limits: too many table dml insert operations for this table
I have a workflow which contain more than 100 actions (type: operations) that will insert/update data into a t...
Dataform: Exceeded rate limits: too many updates for this routine.
Hello All,Im running a dataform workflow with about 35 actions, majority of them has no dependency between eac...
Dataform run - twice
Hi @ms4446 I have a DAG running through Composer and my tasks are configured as below:[task_a, task_b]>> run_d...
Dataform: "Procedure is not found" error occurring more frequently
Hi all,I'm running multiple Dataform workflows across projects for many months now. But over the last week or ...
Get alerts on specific Dataform job failure from multiple files in a workflow
Hi all,I am using Google Cloud Logging and monitoring to create alerts on my Dataform workflow failures. Is it...
DATAFORM/TERRAFORM - terraform can't destroy google_dataform_repository resource
Hello wonderful people! I'm using Terraform to implement IaC for a project. I'm running my .tf files in Cloud ...
Dataform connection to GitHub showing "computation of the authentication status" error
I'm having some issues setting up Dataform for the first time and connecting to a GitHub repo via SSH. I've fo...
Dataform generally unstable lately
Hey folks-Has anyone else experienced general instability and transient errors with dataform lately? Lots of r...
Error 403 - Permission denied on 'locations' when using Workflow for Dataform
Hey I followed the steps from the schedule-executions-workflows tutorial from Google's documentation but it ...
Google Sheet to Dataform
I want to create a model in Dataform that is a live connection to a google sheet that is stored in google driv...
Dataform Javascript Operate Tags
I publish a few tables that require "execute immediate" so they're publish via "operations". I do this using t...
How to get execution tag in Dataform
Hello everyone,I'm just learning Dataform, and I need to log in a table the tag used to excecute the dataform ...
Dataform: Error using @dataform/cli when running with "--dry-run" argument
Hi there!I'm working on a Dataform project using the @dataform/cli (https://cloud.google.com/dataform/docs/use...
Dataform Declaration Aliases
Say you are trying to declare some data sources, but you have an ugly table name. E.g: config { type: "declara...
Passing Parameters to Dataform
Hi @ms4446 I have the following use case and shall b grateful if you can help.a) I have an Airflow DAG which I...
Dataform: Exceeded rate limits: too many dataset metadata update operations for this dataset.
Hi,When I run all the actions in my Dataform workspace, some actions fail if the dataset does not already exis...
I was wondering if there is a way to run a file incrementally in Dataform and use UUID to generate p
I was wondering if there is a way to run a file incrementally in Dataform and use UUID to generate primary key...
Dataform Post Operation - Auth views
Hi Team,How to manage Auth view access management via Dataform post operations section? I can add a code in ja...
override defaultLocation in dataform.json
Hi Team,Is there any way to override "defaultLocation" value in dataform.json through dataform UI release/work...
How to use an installed public package in Dataform?
I installed this package in dataform successfullyhttps://www.npmjs.com/package/libphonenumber-jsThis is how it...
Dataform .gitignore not working
In a standard initialized dataform workspace, I have a .gitignore file. I want to utilize it to exclude files ...
Custom Function Syntax error Unexpected keyword MERGE
Below is the scd_utils.js code which is used for scd type 2 operation. // includes/scd_utils.js /** * Generate...
Declare sources dynamically
Hi,I was wondering whether there is a way to declare sources in separate file (sources.js) dynamically.For exa...
Automatic failure of a Dataform Action
Hello Community,I have the following situation: At some moment in time one Dataform Action fails. We have a co...
Dataform CLI Compile Fails with ReferenceError.
Hi,I have a dataform project which compiles successfully in the gcp UI.However, when I try to run `dataform co...
Dynamically assign a "defaultDatabase" in the dataform.json file
Hello Community,I have the following situation in our project.We are using Dataform to transform some data tha...
Dataform Location Error
Hi all,I have the configuration below in my dataform.json file{ "defaultSchema": "datalake_analytics", "assert...
Start time workflow execution
Hi all, someone who has an explanation/solution for this? Dataform is running all my tables directly after eac...