Jun 29BigQuery: Easily manage dataset access permissions with DCLAs we all know one of the biggest challenges of managing a data warehouse is permission to access data. Often this can be challenging to keep on top off, and even more so when you have specific dataset level permissions. Luckily BigQuery has recently released Data Control Language functionality, which…Bigquery3 min read
Jun 11BigQuery: A greener way to warehouseNowadays it’s incredibly easy to upload, store query and edit data, however, how often do we consider the carbon (and other) footprints in doing so. I attended an eye-opening conference hosted by Silicon Brighton which triggered how can I make my warehouses more sustainable. I am not an expert in…6 min read
May 19Google Analytics and BigQuery: setting up your projectWith the onset of Universal Analytics sunsetting, and the fab Google Analytics 4 dataset, there has been a considerable uplift in users needing to set up BigQuery Projects to Stream their BigQuery data. In this post, I will walk you through step by step of setting up a Google Cloud…Google Cloud Platform7 min read
Apr 22BigQuery: Using Audit logs to assess your consumptionOften Google Cloud Platforms billing dashboard suffices to capture and manage how much you are spending on the platform each month. …Google Cloud Platform5 min read
Apr 20BigQuery: Asserting your data is viable for your codeHow often have you taken a peek at a report only to be thrown by really odd figures? This could be down to many reasons, but often if the code has been running well for some time, it’s likely to be the underlying data or dependent tables. Many programmers would…Bigquery3 min read
Mar 29BigQuery: Importing your data with SQL from Google cloud and drive storageHow often have you been asked to upload a google sheet or CSV into BigQuery, especially for a sheet which updates regularly? Well, the great news is that there is inbuilt functionality within BigQuery DDL (Data Definition Language) to enable you to do this without upskilling on other Google Cloud…Bigquery3 min read
Mar 29BigQuery: The art of unnesting google analytics 4 event parametersWhen you first catch a glimpse of the BigQuery Google Analytics or Firebase BigQuery tables, you may be instantly taken aback by the structure of these. Fear not, the data is nested (arrayed) and is incredibly powerful in storing huge volumes of data in a highly accessible format. Once you…Google Cloud Platform4 min read
Mar 28Google BigQuery automation and Google Analytics 4 daily filesAs you may already know, Firebase and Google Analytics 4 both have a great feature in that they provide the daily event data in BigQuery tables. If you have selected the streaming option you will see an intraday table for today, and stacked daily event tables. …Bigquery5 min read
Mar 5BigQuery: Soundex function and UTMs reducing hardcoding on spelling errorsWorking with marketing data from Google Analytics is a fab way of assessing your digital marketing performance very quickly, but how often have you come across issues with spellings or deviations of source and medium names. …Bigquery4 min read
Jan 11How to time-travel with BigQuery and undelete tablesOne of my favourite things is working on data warehouses using BigQuery; in fact, BigQuery provides a wealth of tools to automate and process data to build a robust ETL. As you may know, BigQuery has some super powerful features, which allow us to build, manipulate and even run machine…Bigquery3 min read