Aveek Das
Adding optional arguments for demonstration - databases in python

Exploring databases in Python using Pandas

August 24, 2020 by

In this article, I am going to cover in detail about working with databases in Python using Pandas and SQLAlchemy. This is a part of the series “Learn Pandas in Python” where I talk about the various techniques to work with the Pandas module in Python.

Read more »
Rajendra Gupta
Copy file using the xp_cmdhell

T-SQL scripts to copy or remove files from a directory in SQL Server 2019

August 21, 2020 by

Sometimes database professionals need to perform specific tasks at the operating system level. These tasks can be like copying, moving, deleting files and folders. A use case of these tasks might be removing the old backup files or copying backup files to a specific directory after a particular time. In SQL Server, we can use xp_cmdshell extended stored procedure to execute commands directly in the Windows command prompt(CMD). You need a sysadmin role or proxy account configured to use this extended procedure. We can also use the SSIS package for the file transfer, but it also requires you to build a package with the relevant tasks.

Read more »
Aveek Das
Selecting data from table

Introduction to SQLAlchemy in Pandas Dataframe

August 20, 2020 by

In this article, I am going to demonstrate how to connect to databases using a pandas dataframe object. Pandas in Python uses a module known as SQLAlchemy to connect to various databases and perform database operations. In the previous article in this series “Learn Pandas in Python”, I have explained how to get up and running with the dataframe object in pandas. Using the dataframe object, you can easily start working with your structured datasets in a similar way that of relational tables. I would suggest you have a look at that article in case you are new to pandas and want to learn more about the dataframe object.

Read more »
Aveek Das
Virtual Environment created

Working with Pandas Dataframes in Python

August 19, 2020 by

In this article, I am going to explain in detail the Pandas Dataframe objects in python. In the previous article in this series Learn Pandas in Python, I have explained what pandas are and how can we install the same in our development machines. I have also explained the use of pandas along with other important libraries for the purpose of analyzing data with more ease. Pandas provides a dataframe object which makes it relatively easier to consider working with the data as it provides a tabular interface for the data in it. People who are already familiar in working with relational databases, they can really find similarities between a table in the database and the dataframe object in pandas.

Read more »
Aveek Das
Deploying the serverless application

Deploy serverless applications using the AWS SAM CLI

August 18, 2020 by

In this article, we are going to learn to deploy serverless applications to the AWS Cloud using the AWS SAM CLI. This article is a part of the three-article series “Develop and Deploy Serverless Applications with AWS SAM CLI”. If you have some idea about how to develop and test your serverless applications locally using the AWS SAM CLI, then you might proceed with this article. However, if you want to learn more about developing and running your code locally, I would strongly recommend reading the previous articles of this series, Getting started with the AWS SAM CLI and Set up a local serverless environment using the AWS SAM CLI, which explains in detail the various configurations required to start and run the serverless functions on your local.

Read more »
Aveek Das
Opening serverless app in VS Code

Set up a local serverless environment using the AWS SAM CLI

August 18, 2020 by

In this article, we are going to work on setting up your local development environment for creating serverless applications using the AWS SAM CLI. This article is a part of the three-article series “Develop and Deploy Serverless Applications with AWS SAM CLI”. If you already know about the working principle of the AWS SAM CLI, you may proceed with this; otherwise, I would highly recommend reading my previous article on the series, Getting started with the AWS SAM CLI, where I talk about the introduction to the AWS Serverless Application Model and its workflow.

Read more »
Ben Richardson
A bar chart which is the output of applying the advanced filter

Power BI Visuals: Working with Filters

August 18, 2020 by

Power BI is a data analytics tool that can be used to analyze data with the help of Power BI visuals.

Power BI is a Microsoft application and is available as a desktop application as well as a cloud service. It comes with a variety of visual and filtering options that can be used to create Power BI visuals.

Read more »
Nisarg Upadhyay
create and drop temp table: create a new temp table using select query.

Learn MySQL: Create and drop temp tables

August 18, 2020 by

In this article, we are going to learn how to create a temp table and further drop these tables. The temporary tables are session-specific tables that are created within the session. When the session closes, the table is dropped by itself. A temporary table exists within a session only; therefore, a table created by one session is not visible to another session. For example, Session ID 501 has created a temporary table then session ID 502 cannot access it or manipulate it. Two different sessions can have a temporary table with the same name.

Read more »
Esat Erkec
Measuring disk latency with Perfmon for SQL Server troubleshooting

SQL Server troubleshooting: Disk I/O problems

August 17, 2020 by

In this article, we will discuss how to resolve I/O problems that is a very important point for the SQL Server troubleshooting. The storage subsystem is one of the significant performance factors for the databases. Detecting and identifying I/O problems in SQL Server can be a tough task for the database administrators (DBAs). Generally, the underlying reasons for the I/O problems can be:

Read more »
Prashanth Jayaram

IT Cloud Automation using PowerShell

August 17, 2020 by

Using PowerShell automation, one could easily automate the most common tasks. The future for PowerShell as the automation framework is bright. Shipping PowerShell core on the hybrid platform has opened up new markets, new customers, and new opportunities for Microsoft. At the same time, we still strongly believe in Powershell on Windows Server, Linux and macOS as a great combination for automation.

Read more »
Aveek Das
AWS SAM Workflow

Getting started with the AWS SAM CLI

August 17, 2020 by

In this article, we will learn the concept of the AWS SAM CLI. This is a part of the three-article series “Develop and Deploy Serverless Applications with AWS SAM CLI”. SAM, abbreviated for Serverless Application Model is a framework provided by Amazon Web Services, which can be leveraged to build applications on the local machine and deploy those to the AWS Lambdas directly.

Read more »
Aveek Das
Notebook

Getting started with Jupyter Notebooks

August 14, 2020 by

In this article, I am going to explain what Jupyter Notebooks are and how to install the same on your machine. Further, I will demonstrate how to use these notebooks using Visual Studio Code and perform data analysis and other development activities. It is an open-source platform using which you can create and share documents that contain live code, equations, and visualizations along with the formatted text. Most importantly, these notebooks can be run on the web browser by just starting a server and using it. This open-source project is maintained by the team at Project Jupyter.

Read more »
Ahmad Yaseen

Data Engineer Interview Questions and Answers: SQL Workload Migration to Microsoft Azure Database Platforms

August 13, 2020 by

In this article, we will discuss a number of questions that you may face when being interviewed to a Microsoft Azure Data Engineer position. These questions will focus on the process of migrating the SQL Server databases from the on-premises instances to the Microsoft Azure database services.

Read more »
Prashanth Jayaram
SQL Server Java file

Java Language Extensions in SQL Server 2019

August 13, 2020 by

In this article, we will discuss SQL Server 2019 new feature—Java Language Extensions. With the advent of SQL Server 2019, Microsoft always strives to expand its footprint on the capabilities of MLS (Machine Learning Services). It builds a deeper integration between the data-platform and data science under the data science umbrella. The Microsoft SQL Server 2019 MLS extensibility framework provides a solid base for allowing extensions in R, Python, and now Java.

Read more »