Lets explore logisitic regression code done in python today. We have a dataset available for sample telecom provided where we have data of its customer who may or may not churn.
We have to make a prediction on the data set as accurately as possible.
Lets see how we can do that !
Here is another easy to follow code for Multiple Linear regression code on housing data !
Here is sample code for Simple Regression that you can easily follow !
Github link : https://github.com/jeswinaugustine/machine_learning_code/blob/master/Linear%20regression/Simple_Linear_Regression.ipynb
In the previous post, you saw some common interview questions asked on linear regression. The questions in that segment were mostly related to the essence of linear regression and focused on general concepts related to linear regression. This section extensively covers the common interview questions asked related to the concepts learnt in multiple linear regression.
Q1. What is Multicollinearity? How does it affect the linear regression? How can you deal with it?
Multicollinearity occurs when some of the independent variables are highly correlated (positively or negatively) with each other. This multicollinearity causes a problem as it is against the basic assumption of linear regression. The presence of multicollinearity does not affect the predictive capability of the model. So, if you just want predictions, the presence of multicollinearity does not affect your output. However, if you want to draw some insights from the model and apply them in, let’s say, some business model, it may cause problems.
Read More…It is a common practice to test data science aspirants on linear regression as it is the first algorithm that almost everyone studies in Data Science/Machine Learning. Aspirants are expected to possess an in-depth knowledge of these algorithms. We consulted hiring managers and data scientists from various organisations to know about the typical Linear Regression questions which they ask in an interview. Based on their extensive feedback a set of question and answers were prepared to help students in their conversations.
Q1. What is linear regression?
In simple terms, linear regression is a method of finding the best straight line fitting to the given data, i.e. finding the best linear relationship between the independent and dependent variables.
Read More…Q1. What is accuracy?
Accuracy is the number of correct predictions out of all predictions made.
Accuracy=True Positives+True NegativesTotal Number of Predictions
Q2. Why is accuracy not a good measure for classification problems?
Accuracy
is not a good measure for classification problems because it gives
equal importance to both false positives and false negatives. However,
this may not be the case in most business problems. For example, in the
case of cancer prediction, declaring cancer as benign is more serious
than wrongly informing the patient that he is suffering from cancer.
Accuracy gives equal importance to both cases and cannot differentiate
between them.
Q1. What is the Maximum Likelihood Estimator (MLE)?
The
MLE chooses those sets of unknown parameters (estimator) that maximise
the likelihood function. The method to find the MLE is to use calculus
and setting the derivative of the logistic function with respect to an
unknown parameter to zero, and solving it will give the MLE. For a
binomial model, this will be easy, but for a logistic model, the
calculations are complex. Computer programs are used for deriving MLE
for logistic models.
(Here’s another approach to answering the question.)
Read More…Q1. What is a logistic function? What is the range of values of a logistic function?
The logistic function is as defined below:
f(z)=1(1+e−z)
The values of a logistic function will range from 0 to 1. The values of Z will vary from −∞ to +∞.
Read More…
You now know two types of SQL commands, namely:
The Data Definition Language (DDL) is used to create and modify the schema of the database. Commands like CREATE, ALTER and DROP are part of this language.
As a data analyst, you would always be actively involved in data retrieval activities. Here, the Data Manipulation Language (DML) commands would come in handy, e.g. the DML command SELECT, its purpose, various clauses and filtering operations.
The SQL ORDER BY clause is used to sort the data in ascending or descending order, based on one or more columns. Some databases sort the query results in an ascending order by default.
The basic syntax of the ORDER BY clause is as follows −
SELECT column-list FROM table_name [WHERE condition] [ORDER BY column1, column2, .. columnN] [ASC | DESC];
The order in which it appears is “select * from table where some_variable = x order by some_variable”.
Read More…
A data warehouse would be a central repository of the data of the entire enterprise.
A data warehouse is a collection of data. It exhibits the following properties:
One of the primary methods of designing a data warehouse is called dimensional modelling.
The two key elements of dimensional modelling are facts and dimensions, which are basically different types of variables used to design a warehouse. They are arranged together in a specific way known as a schema diagram.
Online Analytical Processing, a category of software tools which provide analysis of data for business decisions. OLAP systems allow users to analyze database information from multiple database systems at one time.
The primary objective is data analysis and not data processing.
Online transaction processing shortly known as OLTP supports transaction-oriented applications in a 3-tier architecture. OLTP administers day to day transaction of an organization.
The primary objective is data processing and not data analysis
Any Datawarehouse system is an OLAP system. Uses of OLAP are as follows
An example of OLTP system is ATM center. Assume that a couple has a joint account with a bank. One day both simultaneously reach different ATM centers at precisely the same time and want to withdraw total amount present in their bank account.
However, the person that completes authentication process first will be able to get money. In this case, OLTP system makes sure that withdrawn amount will be never more than the amount present in the bank. The key to note here is that OLTP systems are optimized for transactional superiority instead data analysis.
Other examples of OLTP system are:
Facts and dimensions are the two key elements of dimension modelling. A typical problem might involve multiple databases with many different variables and we may not be interested in all the variables. Hence, only some facts and dimensions are combined in a specific manner to create the structure of data warehouse. This structure is called as a schema diagram.
A schema is an outline of the entire data warehouse. It shows how different data sets are connected and the different attributes of each data being used for the data warehouse.
You learnt about what a data warehouse is and the difference between a data warehouse and a transactional database. You learnt that OLAP systems are Subject-oriented, Integrated, Non-volatile and Time variant.
You learnt that the data warehouse gives an integrated view of the entire organisation and the data is organised for efficiently carrying out analysis. You also learnt the difference between a data warehouse and a transactional database.
You also learnt about facts and dimensions. You also learnt how to arrange facts and dimensions to design a data warehouse. You saw how dimension tables act as the metadata that is the data about data and they enhance the facts table to enhance insights about the data.
