'Having issue with special characters when converting files from BQ to GCS CSV using BigQueryToCloudStorageOperator Airflow
We have created and airflow dag where we are reading a BigQuery table using a sql query and storing it into a transient table, then using the BigQueryToCloudStorageOperator Airflow operator converting it to a CSV file. We are having an issue with the special characters which are being converting it to junk in the file. eg :-hermès is being converted to hermès. I cannot find any options to provide encoding types while using BigQueryToCloudStorageOperator. Need a solution for this. Thanks for the help
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
| Solution | Source |
|---|