I have a transaction table which contains date, transaction_id and category (it is a sales table of clothes). It looks like this: ndate transaction_id category
I'm trying to load CSV from Cloud Storage to Big Query with a Cloud Function. The file has newlines in some of the strings. When I load from Cloud Shell it load
I'm stuck on a query regarding dates in Big Query using SQL. I have a table that consists of customer_id (int), date_purchase (date), sales (int). The query is
I want to load BigTable data into BigQuery with direct way. Till now I am loading BigTable data into CSV file using Python and then loading csv file into BigQue
I am very new to Big query. I am trying to load data from a Big query table to pandas dataframe. I followed the syntax given in the documentation here. Unfortun
I am copying a CSV into a new BQ table using the GCSToBigQueryOperator task in Airflow. Is there a way to add a table expiration to this table within this task?
When trying to perform a simple query in BigQuery I am getting this error: Access Denied: BigQuery BigQuery: Permission denied while opening file. I am using a
There is a BQ table which has multiple data load/update/delete jobs scheduled in. Since this is automated jobs many of it are failing due to concurrent update i
I am able to perform a task of join and aggregation using both Big Query Script and BigQuery Stored Procedure, which is better , which one should be my first ch
I am working on creating an automated script to download files from a FTP and store them into BigQuery. Problem is that BigQuery accepts only .csv files. For t
Sorry, I'm new to this. I read a few sources including some google documentation guides but still don't quiet understand: Every time GA4 streams data into bigqu
I have the following table One client has two purchases in one session. My goal is to assign a order counter to each row of the table. To reach this goal I am
If we have an on-prem sources like SQL-Server and Oracle. Data from it has to be ingested periodically in batch mode in Big Query. What shud be the architecture
There are >100 datasets in one of my project and I want to get the Table_id * No_of_rows of each table lying in these 50 datasets. I can get the metadata o
I'm creating tables via the Big Query command-line utility, but occasionally ad-hoc querying with the new web UI. After creating a table via the CLI, how do I
I have BigQuery Data Transfer Service for Campaign Manager setup in dataset A in GCP project A. I would like to move this to dataset B located in project B. How
In the left panel of BigQuery, the dataset bigquery-public-data is nowhere to be found. I have no idea how it disappeared. Does anyone have a solution to integ
I have followed this post pyspark error reading bigquery: java.lang.ClassNotFoundException: org.apache.spark.internal.Logging$class and followed the resolution
I have a quite huge existing partitioned table in bigquery. I want to make the table clustered, at least for the new partition. From the documentation: https:/
To create a default bigquery client I use: from google.cloud import bigquery client = bigquery.Client() This uses the (default) credentials available in the en