KPI Partners Blog

BigQuery Best Practices to Optimize Cost and Performance

Posted by KPI Partners News Team on Mon, Aug 24, 2020 @ 07:46 AM

by Pushkar Reddipalli

BigQuery Best Practices to Optimize Cost and Performance

BigQuery is Google's fully managed, petabyte scale, low cost analytics data warehouse. It allows you to execute terabyte-scale queries, get results in seconds, and gives you the benefits of being a fully managed solution. BigQuery and other Google Cloud Platform (GCP) services offer "pay per use" pricing. If you know how to write SQL Queries, you already know how to query it. In fact, there are plenty of interesting public data sets shared in BigQuery, ready to be queried by you.

In this blog post, I will guide you through best practices to implement Google BigQuery to control costs and optimize performance regardless of the level of development experience you have. To start working with BigQuery, you must first upload your data, which means that you will also use it as storage, then verify this data in some way to create your models or create reports. In the next section, we will analyze best practices for these main actions of loading, querying and storing.

Read More

Tags: Blog, Data Warehouse, BigQuery, BigQuery to optimize cost and performance, Pushkar Reddipalli, BigQuery Best Practices

How does Synapse Analytics improve over Azure SQL DW Gen 2 and Gen 1

Posted by KPI Partners News Team on Mon, Aug 24, 2020 @ 07:42 AM

by Gaurav Gupta

How does Synapse Analytics improve over Azure SQL DW Gen 2 and Gen 1

Introduction

If you are not familiar with Synapse Analytics (formerly Microsoft Azure SQL Data Warehouse), it is known as a massively parallel processing system (MPP). MPP systems have been around for a long time, but traditionally they have been very expensive and large hardware investments. Some providers in this space include Teradata, Netezza, and Microsoft, with their analysis platform system offer. In this model, the data in the tables is distributed between the nodes and the results are joined in the main or control node. It is a model that is fully optimized for large-scale data loading, as well as for reports.

Read More

Tags: Blog, Data Warehouse, Gaurav Gupta, Azure SQL Data Warehouse Gen2, Gen2 Over Gen1, Azure SQL DW,  Analytics Platform System, Microsoft Azure partner, Synapse Analytics, Azure Synapse Analytics