Why correlation matrix is over-used and why you need a non-linear correlation matrix — Even though there are uncountable data science techniques and algorithms, sometimes you still have the feeling that something is missing. One such thing which is missing or not much talked about is a non-linear correlation matrix. We are used to the famous correlation matrix. However, in this article, you will…

Data, creativity, and tactic will make you climb the leaderboard — This may sound counter-intuitive. But the key skill which will give you an edge over others in machine learning competitions like Kaggle may not be machine-learning. Your knowledge of machine-learning algorithms is just the base skill that you need in Kaggle. Applying different algorithms, ensemble, and hyperparameter optimization is of…

Top 5 Pro-tips for solving the most common problem in data science — Missing value replacement may sound trivial, but it may be the most important step in the machine learning process. The way in which you do it can have a big impact on your machine learning model. In addition, as you will be creating some new data, you have some essential…

How to analyze and interpret KNN results with cutting-edge visuals — The unsupervised K- Nearest Neighbour (KNN) algorithm is perhaps the most straightforward machine learning algorithm. However, a simple algorithm does not mean that analyzing the results is equally simple. As per my research, there are not many documented approaches to analyzing the results of the KNN algorithm. …

On spotlights, radar charts, and how to make sense of your clusters — Understanding the meaning of clusters is maybe more important than making the clusters. The process of making clusters is more mathematically oriented, however, interpreting clusters is not straightforward. In this story, you will see a visual approach to interpreting clusters. The visual approach described here uses two visual techniques —…

How I made a big jump with minimum effort in the Kaggle Titanic challenge leaderboard using micro-outlier removal — I experienced something amazing. I climbed 8000 ranks on the Kaggle Titanic competition leaderboard in just a few attempts and in 10 minutes. And here is more amazing news. I did it with minimum effort. I did not do feature engineering. I did not fill in the missing values. I…

Get started with limitless possibilities of stacked data exploration — “Innovation is taking things that exist and using them in a new way” — Tom Freston, Co-founder of MTV In this story, let me introduce you to stacked data exploration, which is a new and advanced way to explore your data. As per my research, the term stacked data exploration…

Top 5 techniques to analyze words — No matter what anybody tells you, words and ideas can change the world.” -John Keating Words are the building blocks of any text or document, and analyzing these building blocks gives you insights into the text. In this story, I will demonstrate top word analytic techniques. …

Ways to automatically select the number of bins — The old-fashioned way to create histograms is to specify the number of bins manually. The intelligent way is to use an estimator or algorithms to select the number of bins automatically for you. There are various techniques to automate the number of bins. In this article, I will list the…