Data Science

In this article, we will study some important data preprocessing methods. It is a very important step to visualize the data and make it in a suitable form so that the estimators (algorithm) fit well with good accuracy.

Topics to be covered:

1. Standardization
2. Scaling with sparse data and outliers
3. Normalization
4. Categorical Encoding
5. Imputation

Standardization

Standardization is a process that deals with the mean and standard deviation of the data points. As raw data, the values are varying from very low to very high. So, to avoid the low performance in the model we use standardization. …

Deep Learning

Perceptron

The World has witnessed an explosion in machine and deep learning technology in the last decade from a personalized world to professional activities everywhere. With these technologies, I am sure that you had heard or read the term “Perceptron” in the neural networks which is the first concept one will probably start to learn neural network. Therefore through this article, my emphasis is to show what is a perceptron and its working.

An American Scientist Rosenblatt was very much inspired by the biological neuron and its ability to learn and the term perceptron was introduced by him around 1957…

Statistics

Introduction

When we talk of chi-square tests, basically we study two types:

• Chi-square for independence
• Chi-square for the goodness of fit

Both of them are non-parametric tests (that do not have a continuous scale for measurement and are assumption-free)

The first one helps determine any association between qualitative variables, and the second one tells whether a sample follows the same distribution as a sample or not.

Chi-square for independence

This test helps determine any association between two categorical values of qualitative data. It is only applicable to the Categorical data.

Machine Learning

What is MLOps?

If we break down the word itself, it is a combination of 2 words, machine learning, and operations. Where machine learning stands for model development or any kind of code development and operations means production and deployment of code.

A more technical definition of MLOps is a set of principles and practices to standardize and streamline the machine learning lifecycle management.

Well, it is not a new technology or tool but rather a culture with a set of principles, guidelines defined in a machine learning world to seamlessly integrate/automate the development phase with the operational development phase.

…

In this article, we will do CRUD operation in the database using python language in the jupyter notebook. The python language becomes versatile in numerous filed all over the globe. To automate the whole project pipeline, we need also to get a connection between python and the database system.

If some of the people do not know the CRUD meaning, then it is Create, Read, Update, and Delete operations.

Here, we are using MySQL workbench 8.0 and python 3.7 versions. …

In this article, we will try to make a visualization chart in streamlit with matplotlib and seaborn library. The streamlit is a new generation web framework for data science and machine learning enthusiasts.

What is streamlit?

It is an open-source web framework to make customizable apps in the field of machine learning and data science.

Topics to be covered

1. Matplotlib
   a. Bar chart
   b. Histogram 2. Seaborn
   a. Count plot
   b. Violin plot

Visualization with Matplotlib library in streamlit

Here, we will make a bar chart and histogram with streamlit functionalities. Visualization is an important part of the analysis…

Predictive Analytics

As we know the importance of features in the machine learning algorithms are playing a very crucial role in prediction analysis in any field.

When the data features become very complex then there are very high chances to get a multi-collinearity situation or high correlation between two and more features. This situation strikes badly on the training of data and it might go over-fitting or under-fitting of the data.

There are some methods to select and remove features as shown below:

Feature Selection Methods
1. Uni-variate Selection
2. Selecting from ModelFeature removing Methods
1. Low variance method
2. …

Programming

Exception Handling

The concept of exception is simple. An exception takes place only when the normal flow of a program is interrupted by an error. If the program cannot handle the particular operation, it raises an exception. An exception is nothing but a python object that represents an error. Once the python script raises an exception, it has to be dealt with immediately. If not, the program will get terminated.

Try and except in Python

In python, a try-except statement first runs the program under the try statement. If the program does not execute successfully, it stops where an error…