Category "google-bigquery"

Why does my table join return values I didn't specify?

I am attempting to join two tables to create a visualization that shows the relationship between weight, BMI, and total steps using the following code: SELECT

Power BI: Add bigquery service account key file

I am trying to add a service account key file to access a bigquery data set in power bi. I am selecting service account login during the set up process. I added

how to generate n rows based on a value in a column in Big Query? [duplicate]

I have following table. I need to transform this input as you can see in below output example: If you have any ideas please share. Thank you

BigQueryInsertJobOperator dryRun is returning success instead of failure on composer (airflow)

When using BigQueryInsertJobOperator and setting the configuration to perform a dry run on a faulty .sql file/ a hardcoded query, the task succeeds even though

BigQuery Lead/Lag Analytical Function

I have a table like below: I want to sort the port and value and then apply lead function on eventDateTime like below: I'm able to sort the port and value tog

Documentation on __TABLES__ and __TABLES_SUMMARY__ and other double underscore metadata (bigquery)

I'm diving into metadata available on datasets and tables in BigQuery. There is enough documentation on INFORMATION_SCHEMA:https://cloud.google.com/bigquery/doc

How to fix 'User does not have permission to query table XYZ.' in BigQuery?

I want to do a BQ query via the bq command. Here is my command: bq query --application_default_credential_file $GOOGLE_APPLICATION_CREDENTIALS --nouse_

Is there any reason or advantage to specify string column length in BigQuery?

I am new to BQ and experienced in OLTP RDBMS, I found the data in BQ for my company are mostly in STRING type while it was VARCHAR(255) or even less in the OLTP

How do you extract a specific field from a JSON array in Big Query?

I currently have a JSON array that looks like this in Big Query: [{"name":"","username":null},{"name":"Jimmy Dean","username":"iamjc"},{"name":"Ben Simmons","us

BigQuery query review for session based attribution

I've been struggling for a while to get a query to return the number of sessions and users per source/campaign/medium/content, based on the current session of t

GCP Cloud Function to write data to BigQuery runs with success but data doesn't appear in BigQuery table

I am running the following cloud function. It runs with success and indicates data was loaded to the table. But when I query the BigQuery no data has been added

Save BigQuery results to array

I have a query that looks like this SELECT ids FROM `table_name` The results set is as follows | ids | |-----| | 1 | | 2 | | 3 | I need to save this res

Issues streaming data from Pub/Sub into BigQuery using Dataflow and Apache Beam (Python)

currently I am facing issues getting my beam pipeline running on Dataflow to write data from Pub/Sub into BigQuery. I've looked through the various steps and al

How to retrieve Performance MAX campaigns Google Ads into Google Big Query

I am using a third-party tool that use the Adwords Reporting https://developers.google.com/adwords/api/docs/appendix/reports/all-reports to retrieve data. At th

How to explicitly split data for training and evaluation with BigQuery ML?

I understand there's already another post, but it's a bit old and it doesn't really answer the question. I understand that we can use the parameter DATA_SPLIT_

Schedule a bq command line in GCP with Cloud Pub/Sub topic

I have a command line that I execute to select data from view and exporting to a staging table in BigQuery: bq mk --transfer_config --headless=true --project_i

Loading data from BigQuery to Salesforce

I have two datasources - Salesforce(SF) and BigQuery(BQ). All the data from SF is available in BQ. So my question is can we load data from BQ to SF?. Here's w

bq load command to load parquet file from GCS to BigQuery with column name start with number

I am loading parquet file into BigQuery using bq load command, my parquet file contains column name start with number (e.g. 00_abc, 01_xyz). since BigQuery don'

How do I use the BigQueryDate class in the BigQuery nodejs client library?

I have a BigQuery table with a column of type "DATE". When I query the table with the nodejs client library as per below, the date elements in the data are obje

How is a binary/bytes column sorted in sql?

The following query sorts a binary column in BigQuery: with tbl as ( select B'123' as col union all select B'234' ) select * from tbl order by col; ----------