Dinesh Asanka
Recommender System in Azure Machine Learning.

Designing Recommender Systems in Azure Machine Learning

April 13, 2021 by

In this article, we will be discussing how to design a Recommender System in Azure Machine learning which is the next article in the Azure Machine Learning series. During this lengthy article series on Azure Machine Learning, we have discussed multiple machine learning techniques such as Regression analysis, Classification Analysis, Clustering and Anomaly detection of Time Series. Further, we have discussed the basic cleaning techniques, feature selection techniques and Principal component analysis, Comparing Models and Cross-Validation and Hyper Tune parameters in this article series to date.

What are Recommender Systems?

If you are buying some goods from Amazon.com, you would have noticed that there are recommendations for you to buy more related items. In most commercial websites, recommendations are provided in order to increase revenue as well as customer satisfaction.

There are two types of recommender systems that is Content-Based and Collaborative filtering. In the content-based approach, both user properties, and item properties will be considered for recommendations. In the collaborative filtering approach, transactions and user ratings are taking into account. In Azure Machine Learning, Matchbox recommender is introduced which has a combination of content-based and collaborative filtering recommenders. Therefore, Matchbox recommender can be considered as a Hybrid recommender system to design a recommender system in Azure Machine Learning.

Let us see how to use Matchbox recommender to develop recommender systems.

Matchbox Recommender in Recommender Systems in Azure Machine Learning

First of all, let us use the existing data set of Restaurant data set in Azure Machine Learning which is shown in the below image.

Existing data set of Restaurant data set in Azure Machine Learning

The restaurant ratings data set has ratings by users for the given restaurant while the restaurant feature data set has the features of data. Restaurant customer data set consists of user profile data.

Let us see the experiment first and then let us examine the configurations. This experiment is available at https://gallery.cortanaintelligence.com/Experiment/Recommender-Systems-Restaurant and the following is the screenshot of the entire experiment.

Recommender System in Azure Machine Learning.

Though this is a much complex experiment than the previous examples, let us look at each control individually. Restaurant ratings data set contains userID, PlaceID, and ratings. Please note that the Match Box recommender needs columns in that the same order of user, place, or item and ratings. If you don’t have ratings, you need to derive ratings from existing attributes which we will look at in a different scenario. Like we did in Classification, we need to split data for training and evaluating which is done by the Split Data control with the Recommender Split as the splitting mode.

Then, the first output of the data split is connected to the Train Matchbox Recommender control. In the Train Matchbox Recommender controller, the second port should have the user or customer data while the third or the last port should have data input from items. In this scenario, it is the restaurant data.

Let us see what the configurations for the Train Matchbox Recommender are as shown in the following figure.

Configurations for the Train Matchbox Recommender

The number of traits configuration decides how many attributes from the user and item data streams are considered for the recommender system in which the default is 10. In this configuration, the number of recommendation algorithms iteration is 5. Typically, if you have a higher value for this parameter, higher accuracy can be achieved but more resources are utilized.

The next important control is the Score Matchbox Recommender controller. This is the most important configuration in the Recommender system in Azure Machine Learning.

Configuration in the Recommender system in Azure Machine Learning

In the Recommender prediction kind option, there are four options such as Rating Prediction, Item Recommendation, Related Users and Related Items. In this scenario, we are looking at item recommendations so that the relevant option is selected. As you can see from the options, you have the options of selecting related users and related items as well as performing the rating predictions for the unrated data.

Similarly, item selections can be done for the rated items as well as for the unrated items. By configuring 3 for the Maximum number of items to recommend to a user option, we have limited the number of recommendations to 3.

In the Score Matchbox Recommender controller, there are five ports, and, in this example, we are using four ports. The first port is coming from the Score Matchbox Recommender controller while the second port is for the data coming from the second output of the Data split control. The next two ports are for customer and restaurant data respectively.

Now You are ready for the output which can be seen in the following figure.

Recommended Restaurent IDs for each customer.

This means that the users are provided with recommendations with a maximum of three items. Since we are using PlaceID, the recommendation will be in the form of PlaceID. However, we can join the dataset to the Restaurant data set and by filtering unnecessary columns, you can view the Restaurant names instead of their ids.

Resturant Names for each user

Next is the evaluation of the recommender system in Azure Machine learning for which Evaluate Recommender controller is used. For this control, the output of the split data set and Score Matchbox Recommender controller is used. Normalized Discounted Cumulative Gain (NDCG) is the parameter that is considered for the accuracy of the recommended model. When you have a higher value for the NDCG parameter, the recommender system is believed to be a higher accuracy model. In this scenario, NDCG has a value of 0.8873 or 88%.

Scenario 2

After designing a recommender system in Azure machine learning for a restaurant, let us use the typical Adventureworks database for a different recommender system.

First, we need to find the queries for transactions, users, and items.

The following is the T-SQL script for the user transactions. We need CustomerID and ProductID as well as the ratings. In this example, we have used transaction count as the ratings. If the count is more than 5, it will be replaced with 5 later in the experiment by using the Clip Values control.

The next script is to extract customer details. We have used the CONCAT function to combine the customer name columns and bucketized the Sales amount as shown in the below script.

The final query is to extract Product details as shown below.

Now let us build the Recommender System in Azure Machine Learning with the above data. Like we did before, the following is the experiment that is published in the azure machine learning gallery.


The following figure shows the entire experiment in Azure Machine Learning:

Recommender System for data in a Azure SQL Database.

In this experiment, we are extracting data from Azure SQL Database. Import Data control is used for that purpose and with the following configuration.

Azure SQL Database configuration to extract data to the Azure Machine Learning Experiment.

You need to provide the standard connection details of Azure SQL Database with the relevant query and Use cached results option is selected in order to improve the performance. Similarly, customer and product details are extracted using the same configurations.

Select Columns in Dataset is used to choose only the data that is relevant to the recommender system in Azure Machine Learning. However, attributes such as Customer Names and Product Names will be used later to display them in the final output.

The next controls and their configurations are the same controls that we used in the previous experiment, so no additional explanations are necessary. However, in this experiment, we have configured five product recommendations for each customer.

After the recommendations are completed, one join is performed to get the customer details and five more joins are done to receive recommended Products details. The following is the final output of the Recommender System in Azure Machine Learning for each customer and the Product Names.

Final output of the Recommender System


Recommender Systems in Azure Machine Learning is one of the most useful Machine Learning techniques. In Azure Machine Learning, the Matchbox recommender is used to recommend products for customers depending on the customer and product properties. Though this is the most common use case in recommendation systems, there are other features such as finding similar customers and products in the Matchbox recommender.


Table of contents

Introduction to Azure Machine Learning using Azure ML Studio
Data Cleansing in Azure Machine Learning
Prediction in Azure Machine Learning
Feature Selection in Azure Machine Learning
Data Reduction Technique: Principal Component Analysis in Azure Machine Learning
Prediction with Regression in Azure Machine Learning
Prediction with Classification in Azure Machine Learning
Comparing models in Azure Machine Learning
Cross Validation in Azure Machine Learning
Clustering in Azure Machine Learning
Tune Model Hyperparameters for Azure Machine Learning models
Time Series Anomaly Detection in Azure Machine Learning
Designing Recommender Systems in Azure Machine Learning
Language Detection in Azure Machine Learning with basic Text Analytics Techniques
Azure Machine Learning: Named Entity Recognition in Text Analytics
Filter based Feature Selection in Text Analytics
Latent Dirichlet Allocation in Text Analytics
Recommender Systems for Customer Reviews
AutoML in Azure Machine Learning
AutoML in Azure Machine Learning for Regression and Time Series
Building Ensemble Classifiers in Azure Machine Learning
Text Classification in Azure Machine Learning using Word Vectors
Dinesh Asanka