How to perform Azure SQL database Import/Export operations using PowerShell

January 14, 2021 by Prashanth Jayaram

In Azure, the Import/Export operation of the Azure SQL database is a vital part of the database migration methods. It is important to choose the most viable option as per the database migration strategy and business requirements. In addition, the applications that are configured with Azure SQL PaaS databases, the migration specialist could decide and identify several common scenarios where Azure PaaS database are scripted, copied, migrated, moved or backed up.

How to access an Azure SQL database from Azure Data Lake Analytics

January 14, 2021 by Rahul Mehta

In this article, we will see how we can access data from an Azure SQL database from Azure Data Lake Analytics.

Power BI: Conditional formatting and data colors in action

January 14, 2021 by Ben Richardson

This article shows you how to use Power BI conditional formatting and apply different color schemes to reports in the Reports View of Power BI desktop. The same process can be applied for Power BI conditional formatting in the cloud.

Getting started with Azure Analysis Services

January 13, 2021 by Gauri Mahajan

This article will describe how to get started with Azure Analysis Services and help you understand the configuration and pricing options to create our first Analysis Services instance.

An overview of AWS IAM

January 13, 2021 by Aveek Das

In this article, I am going to introduce the concept of AWS IAM, also known as Identity and Access Management in AWS. In any cloud service, controlling who has access to the services and how each of the services accesses the other services is an important task. If we do not control the access or restrict then there might be cases of a security breach within the services and we might not be able to track those as well. So as a best practice to restrict or control access within the AWS, there is a special service called IAM that can be used to manage and control almost everything in AWS. It is the permission control system that controls access to the various AWS resources and services.

Clustering in Azure Machine Learning

January 13, 2021 by Dinesh Asanka

Introduction

In this article, we will be discussing Clustering in Azure Machine Learning which is another machine learning technique such as Regression analysis, Classification analysis. During this article series, we have discussed the basic cleaning techniques, feature selection techniques and Principal component analysis, Comparing Models and Cross-Validation until today. We will introduce further few techniques that were not discussed before in this article as well. Previously, we have discussed how to perform clustering in SQL Server during the SQL Server Data Mining series.

Power BI: Importing data from SQL Server and MySQL

January 12, 2021 by Ben Richardson

Microsoft Power BI is a data analytics and visualization tool that can be used to visualize data in the form of different types of reports, without writing a single line of code.

Using Source Control in Azure Data Factory

January 12, 2021 by Ahmad Yaseen

In this article, we will show how to use the GIT repository during the pipeline development phase in Azure Data Factory, to save the changes incrementally before publishing it completely to the Data Factory production environment.

Processing file sets with U-SQL in Azure Data Lake Analytics

January 11, 2021 by Rahul Mehta

This article will help you process file sets with U-SQL in Azure Data Lake Analytics.

Database Cloning in Amazon Aurora

January 11, 2021 by Rajendra Gupta

Amazon Aurora provides a MySQL and PostgreSQL compatible relation database with performance and feature enhancements over the existing databases. In the previous articles, we discussed the following features. You can refer to ToC at the bottom.

Backtrack
Global Database
Amazon Aurora Serverless

In this article, we will cover fast database cloning and its usage for aurora databases.

Learn MySQL: The Basics of MySQL Stored Procedures

January 8, 2021 by Nisarg Upadhyay

In this article, we are going to learn about the stored procedures in MySQL. In this article, I am covering the basics of the stored procedure that includes the following

Using Templates in Azure Data Factory

January 8, 2021 by Ahmad Yaseen

In the previous articles of this Azure Data Factory series, we showed different scenarios in which we can take advantage of the Azure Data Factory in copying data from variant data stores and optionally transform the data before loading it to the destination datastore. In all examples that are provided in the previous articles, we created a new pipeline from scratch to achieve the required functionality.

Advanced Usages of SQL Server Agent

January 8, 2021 by Aveek Das

In this article, I am going to introduce some advanced usages of the SQL Server Agent service in Microsoft SQL Server. In my previous article, Introduction to SQL Server Agent, I have discussed in detail how to use the service and the various components related to the service. To recap briefly, the SQL Server Agent is a job scheduler service within SQL Server and allows us to schedule T-SQL scripts, SSIS jobs, automate database backups and other tasks etc. In the last article, I have shown how to schedule a simple T-SQL script using the SQL Server Agent. This article will focus more on advanced concepts like scheduling a package in SSIS and processing an OLAP cube.

Best author award in 2020

January 5, 2021 by SQLShack

2020 is finally over – and who’s not thankful for that? We most definitely are. Although 2020 was a total bummer ever since the COVID-19 outbreak, it was a great year for the SQLShack community. We’ve published a ton of great articles written by SQL Server professionals and community members.

We’d like to thank all of the authors for their contribution to spreading the knowledge around the SQL community. We couldn’t have done it without you all!

SQL Server ORDER BY performance tips

January 5, 2021 by Esat Erkec

In this article, we will explore how the ORDER BY statement affects the query performance and we will also learn some performance tips related to sorting operations in SQL Server.

Implement an Amazon Aurora Serverless cluster

January 4, 2021 by Rajendra Gupta

In this 4^th article for the Amazon Aurora series, we will discuss and implement an Amazon Aurora Serverless cluster.

Cross Validation in Azure Machine Learning

January 4, 2021 by Dinesh Asanka

Introduction

After discussing a few algorithms and techniques and comparison of models with Azure Machine Learning, let us discuss a validation technique, which is Cross-Validation in Azure Machine Learning in this article. During this series of articles, we have learned the basic cleaning techniques, feature selection techniques and Principal component analysis etc. After discussing Regression analysis, Classification analysis and comparing models, let us focus now on performing Cross-Validation in Azure Machine Learning in order to evaluate models.

Dependencies in Azure Data Factory

December 30, 2020 by Ahmad Yaseen

In the previous articles of this series, we showed how to create Azure Data Factory pipelines that consist of multiple activities to perform different actions, where the activities will be executed sequentially. This means that the next activity will not be executed until the previous activity is executed successfully without any issue.

Creating database objects in Azure Data Lake Analytics using U-SQL

December 30, 2020 by Rahul Mehta

This article will help you create database objects in Azure Data Lake Analytics using U-SQL.

How to Debug a Pipeline in Azure Data Factory

December 30, 2020 by Ahmad Yaseen

In the previous article, How to schedule Azure Data Factory pipeline executions using Triggers, we discussed the three main types of the Azure Data Factory triggers, how to configure it then use it to schedule a pipeline.

Logging messages from Azure Functions to Azure SQL Database

December 25, 2020 by Aveek Das

In this article, I am going to explain how to create a serverless application using Azure Functions and use Azure SQL Database to log messages generated by the function. In this world of cloud-based applications, it is very important that you are aware of how to create and design serverless applications. An important aspect while designing any application is to generate log messages at every key step or operation that is being performed. This helps us to understand the workflow whenever there are some issues and need debugging at some later point in time.

Build a Google BigQuery report with Google Data Studio

December 25, 2020 by Frank Solomon

Introduction

In the two-part SQL Shack article, Build a Google BigQuery Resource, I showed how to build a Google BigQuery resource, and then link it to an Azure SQL Server resource. This article will expand on that first part, showing how to build a BigQuery report with Google Data Studio.

Import data from MongoDB to SQL Server using SSIS

December 25, 2020 by Hadi Fadlallah

In this article, we will explain how to install MongoDB on the Windows operating system, how to install and configure the ODBC driver and connector that allows us to import data from MongoDB to SQL Server using SSIS.

Introduction to the Power BI Service

December 24, 2020 by Ben Richardson

Microsoft Power BI is a data analytics tool available in two flavors: Power BI Desktop and a Power BI Service.

T-SQL scripts to update statistics based on the row modification

December 24, 2020 by Nisarg Upadhyay

In this article, we are going to learn how we can develop a T-SQL script to update statistics of tables based on the row modification. It is always a challenging task to perform maintenance on a table that has billions of rows. During the early years of my professional career, I was assigned a project and one of our clients had performance issues. The initial analysis showed that due to frequent data modifications, a specific table’s statistics become outdated.