Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Data Analytics
Want more from your data? Have questions about products like BigQuery, Dataflow, or Pub/Sub? You're in the right place. Join conversations around data warehouse modernization, streaming analytics, business intelligence, and more.
Focused on Looker? Engage with the Looker Community here.
Focused on Looker? Engage with the Looker Community here.
Forum Posts
CAST function
Hello All, I am wondering if something changed with the format clause for the CAST function in BQ as I have ru...
How to write failed records while writing to bigquery using Apache python operator writetobigquery.
How to write failed records while writing to bigquery using Apache beam python operator.beam.io.WriteToBigQuer...
Dataplex - Publish data scan result to BigqueryUI
Hello,I'm automating the creation of datascans through the dataplex python sdk but can't create it with this o...
GA4 -> Bigquery Export Bug
GA4-Export intraday-Table had complete data, but the batch load of that day only includes partially that data....
Define list of string form query results to use in loop operation
Hi, I wanted to do this looping in dataform .sqlx file: js { const tables = [ 'table1', 'table2', 'table3' ]; ...
Dataproc variants - Pros / Cons and Usecases
There are 3 Dataproc optionsDataproc on GCEDataproc with GKEDataproc ServerlessWhat are the pros/cons of each,...
BQ Stored procedure to to get the SP name
Hi,I have stored procedure running in scheduled basis and i need to capture the running SP name to store in th...
Is it possible to get BigQuery Lineage using Lineage REST API
I have been able to access Lineage for tables both upstream and downstream from the BQ UI.I was curious if we ...
Try Looker Studio Pro at no cost for 30 days
Hello,I'd like to try Looker Studio Pro. On the Looker Studio page, it states that we can try Looker Studio Pr...
Calculate Dataproc Cost
I am trying to calculate the Cost of Dataproc and then Display on Looker Report and also trying to automate th...
Dataform Merge Statement
I keep facing this issue where dataform highlights an error pertaining the use of the "MERGE" within the works...
Datastream: Column exclusion does not work with Backfilling
Hello,I have excluded certain columns from certain tables from replication from Postgres to BigQuery.However, ...
Incompatible data schema
We are dumping multiple CSV files to the sources bucket for a datazone with the same number of columns and sam...
BigQuery "Quota exceeded" when using Redash
Hi all, I have a question about BigQuery errors.I am currently using a BI tool called Redash to access BigQuer...
Exceeded rate limits: too many table dml insert operations for this table
I have a workflow which contain more than 100 actions (type: operations) that will insert/update data into a t...
Dataform: Exceeded rate limits: too many updates for this routine.
Hello All,Im running a dataform workflow with about 35 actions, majority of them has no dependency between eac...
TVF not found!
I have created a Table Valued Function in BigQuery. It is in a dataset set for the location EU. When i try to ...
bq load. Do not create table if does not exist.
I would like to load data in to a table from a file in GCS using the bq load command. However, if the target t...
Dataform run - twice
Hi @ms4446 I have a DAG running through Composer and my tasks are configured as below:[task_a, task_b]>> run_d...
Understanding data catalog and dataplex catalog
Hi there,I am trying to understand the difference between `data catalog` and `dataplex catalog`, and which one...
Storing a list of lists in a pandas dataframe to Big Query from a CSV file
I have stored a Pandas dataframe as a cvs file of which some of the columns are list of lists like [['Dog', 13...
Dataform: "Procedure is not found" error occurring more frequently
Hi all,I'm running multiple Dataform workflows across projects for many months now. But over the last week or ...
Create Looker Instance: You do not have quota available for this option
When creating looker instance, I face with the issues, "You do not have quota available for this option "Howev...
Get alerts on specific Dataform job failure from multiple files in a workflow
Hi all,I am using Google Cloud Logging and monitoring to create alerts on my Dataform workflow failures. Is it...
DATAFORM/TERRAFORM - terraform can't destroy google_dataform_repository resource
Hello wonderful people! I'm using Terraform to implement IaC for a project. I'm running my .tf files in Cloud ...
Incremental table for last 120 days - remove data older than that and add current date
Hello,I'm trying to create a table which stores all the events from two other table with some aggregations for...
[BigQuery] Regarding Conversion String to Date Type Issue
Hi there ,I have column which contains timestamp and it is String DatatypeI want cast has Date Data type Used ...
Dataproc serverless batch job failing with below error
from last 7 days Dataproc serverless batch job failing with below errorConfiguring index-url as 'https://us-py...
Dataform connection to GitHub showing "computation of the authentication status" error
I'm having some issues setting up Dataform for the first time and connecting to a GitHub repo via SSH. I've fo...
BQ pricing calculator results- Is regional storage expensive than multi-region?
From the new Google Cloud pricing calculator it seems like regional storage is more expensive than multi-regio...
Articles from Product Experts and Googlers
NLP2SQL using dynamic RAG based few-shot examples
This is a second part of NLP2SQL blog series that explores into a specific approach and reference architecture showcasing the transformative power of Generative AI in revolutionizing database interaction.
Generate SQL from questions in natural language using NLP2SQL
This is a first part of NLP2SQL blog series that explores the overview design guide & best practices related to transformation brought about by Generative AI in the traditional method of database interaction.
Creating a signed embedded Looker iFrame for testing
Learn how to use Looker’s signed iFrame URLs to embed content (Dashboards/Looks) or Explores within customer facing applications.
