Movies Based Gender Prediction

Background

Movie streaming applications have drastically changed the entertainment market and made all of our cinematic entertainment available wherever we are and whenever we want.The primary driving force behind the popularity of movie streaming applications is the convenience of watching movies and other content directly on a mobile screen and on other connected smart devices.The majority of the top streaming platforms for movies offer a variety of ways for users to customize the content they see. Video streaming apps always present material that consumers are more likely to prefer by examining user behavior and past preferences of the users.Personalized recommendations uses various techniques and algorithms that can make suggestions to users about related content. A wide range of methods, such as matrix factorization, are used to forecast future behavior using historical data.There can be thousands of options available for each particular genre. Recommendations aid in personalizing a platform and aid users in discovering content they enjoy.To suggest the most well-liked stuff is the quickest and simplest technique to accomplish this. We use specialized recommender systems, though, to actually improve the user experience through tailored recommendations.From a business perspective, user engagement increases with the amount of relevant material they find on the application thereby boosting platform income.Internet users' demographic features, such as their gender and age, offer valuable data for marketing, personalization, and user behavior study.

Objective

This usecase attempts to predict the gender of users based on their movie viewing habits. We use a classification-based approach to the issue and look at a number of features that are obtained from their watch history.

Relevance of Xceed Analytics

Xceed Analytics provides a single integrated data and AI platform that reduces friction in bring data and building machine models rapidly. It further empowers everyone including Citizen Data Engineers/Scientist to bring data together and build and delivery data and ml usecases rapidly. It's Low code/No code visual designer and model builder can be leveraged to bridge the gap and expand the availability of key data science and engineering skills.

This usecase showcases how to create, train/test, and deploy a movies based gender prediction classification model. The dataset is obtained from the UC Irvine machine learning repository.MovieLens data set dataset is used for this purpose .Xceed will provide a NO-CODE environment for the end-to-end implementation of this project, starting with the uploading of datasets from numerous sources to the deployment of the model at the end point. All of these steps are built using Visual Workflow Designer, from analyzing the data to constructing a model and deploying it.

Data Requirements

The dataset that is used here includes :

• Movies Users dataset : contains detailed information about the customers.

Columns of interest in the dataset

Model Objective

Understanding trends in the user data and predicting the gender of the user by analysing the underlying data, constructing a classification machine learning model, and implementing it after defining the model's major features.

Steps followed to develop and deploy the model

1. Upload the data to Xceed Analytics and create a dataset
2. Create the Workflow for the experiment
3. Perform initial exploration of data columns.
4. Perform Cleanup and Tranform operations
5. Build/Train a classification model
6. Review the model output and Evaluate the model
7. Improve on the metrics which will be useful for the productionizing
8. Deploy/Publish the model

Upload the data to Xceed Analytcs and Create the dataset

• From the Data Connections Page, upload the the dataset to Xceed Analytics. For more information on Data Connections refer to Data Connections

• Create a dataset for each dataset from the uploaded datasource in the data catalogue. Refer to Data Catalogue for more information on how to generate a dataset.

Create the Workflow for the experiment

• Create a Workflow by going to the Workflows Tab in the Navigation.Refer Create Workflow for more information.

• You will see entry on the workflow's page listing our workflow once it's been created.

To navigate to the workflow Details Page, double-click on the Workflow List Item and then click Design Workflow. Visit the Workflow Designer Main Page for additional information.

• By clicking on + icon you can add the Input Dataset to the step view. The input step will be added to the Step View.

Perform initial exploration of data columns.

• Examine the output view with Header Profile, paying special attention to the column datatypes. for more information refer to output window

• Column Statistics Tab (Refer to Column Statistics for more details on individual KPI)

Perform Cleanup and Transform Operations

1. Join Movies and Movies Base.

2. Join Actors.

3. Join Directors.

4. Join Actors and Directors.

5. Join Movies and Actors, Directors

6. Final Join Users

7. Select Columns

8. Update Datatype

Build/Train a classification Model

• You have a dataset to work with in order to create a classification model. Some of the actions to take before developing a model are listed below.

1. Feature Selection
2. Feature Encoding
3. Choose the algorithm and train the model.

Feature Selection

1. Go to the Column Profile View and select Multi-variate profile to construct a correlation matrix to manually identify the features of interest. The peason correlation is shown by Xceed Analytics. Select all of the columns that are strongly correlating to the target feature.

2. Some of the features to choose that can explain the target variable based on the observed correlation are:

• rating
• year
• runningtime
• age etc.

Feature Encoding

• Take all of the categorical columns and encode them based on the frequency with which they occur. for more infomation on this processor, refer to Feature Encoding

Choose the algorithm and train the model.

• You are estimating a categorical variable- u_gender for the prediction model. From the Transformer View, select Classification(auto pilot) andfill in the relevant information.

Review the model output and Evaluate the model

After you finish building the model, it is time to review the model output. Look at the output window to first review your predicted results .You will get a new column in the view like the one below.

When you finish building your model you will see another tab in the view called Ml explainer . Click on that to evaluate your model.

• The first view you see when you click on ML explainer is the Summary view

• The second view under Ml explainer is configuration view

The configuration view will give you the information about the step you filled in the Classification step . The view would look like the one below.

The third view under Ml explainer is Performance View . You can see confusion matrix ,ROC Curve, Precision vs Recall and Cumulative Gain Curve. Look at the built charts and decide if the charts are good enough for your model. The confusion matrix is a good indicator to understand how well your model was trained.

• The fourth view under Ml explainer is Leaderboard . In this view you can see the number of algorithms trained and all the feature engineering done on the algorithms used with ranking system to rank the best algorithm trained.

• The last view you see under ML explainer is Interpretability . In this view you will be able to interpret your model in simple terms where you will be getting results pertaining to feature importance , PDP Plots , Sub Population Analysis , Independant Explanation , Interactive Scoring . for more infomation on these results , refer to Interpretability . The Interpretability tab and the results under this tab would look like the one below.

Conclusion