9 Bizarre and Surprising Insights from Data Science

The petabytes of information currently available to analysts amounts to a boundless playing field of possible truths. Originally published by Scientific American. Credit: LANGLEY RESEARCH CENTER NASA, Public Domain Data is the world’s most potent, flourishing unnatural resource. Accumulated in large part as the byproduct of routine tasks, it is the unsalted, flavorless residue deposited en masse as organizations churn away. Surprise! This heap…
Original Post: 9 Bizarre and Surprising Insights from Data Science

The Fallacy of Seeing Patterns

Previous post Next post            Tweet Tags: Analysis, Bias, CleverTap, Correlation, Overfitting, Sampling Analysts are often on the lookout for patterns, often relying on spurious patterns. This post looks at some spurious patterns in univariate, bivariate & multivariate analysis. By Jacob Joseph, CleverTap. Human beings try to find patterns to explain the reason behind almost every phenomenon, but…
Original Post: The Fallacy of Seeing Patterns

How to Compare Apples and Oranges – Part 1

           Tweet Previous post Next post Tags: CleverTap, Correlation, Statistics, Variance We are always told that apples and oranges can’t be compared, they are completely different things. Learn as an analyst, how you deal with such difference and make sense of it on a daily basis. By Jacob Joseph, CleverTap. How often have you come across the idiom “Comparing…
Original Post: How to Compare Apples and Oranges – Part 1

Eugenics – journey to the dark side at the dawn of statistics

Previous post Next post            Tweet Tags: Correlation, Eugenics, Karl Pearson, Statistics Today is the 80th anniversary of the death of Karl Pearson, one of the founding father of statistics (correlation coefficient, principal components, the p-value, and much more). He was also deeply involved with eugenics, a jarring reminder that truth often comes bundled with a measure of…
Original Post: Eugenics – journey to the dark side at the dawn of statistics

Regression & Correlation for Military Promotion: A Tutorial

Previous post            Tweet Tags: Correlation, Regression A clear and well-written tutorial covering the concepts of regression and correlation, focusing on military commander promotion as a use case. By Annalyn Ng, Ministry of Defence of Singapore. The Problem The strength of a military depends on its commanders. While there are commanders who risk their lives to save others,…
Original Post: Regression & Correlation for Military Promotion: A Tutorial

Data scientists keep forgetting the one rule

Previous post Next post            Tweet Tags: Bias, Correlation, Eric Siegel, Healthcare, Overfitting “Correlation does not imply causation”. Yet data scientists often confuse the two, succumbing to the temptation to over-interpret. And that can lead us to make some really bad decisions from data. comments By Eric Siegel, Founder, Predictive Analytics World. The results are in: Skipping breakfast…
Original Post: Data scientists keep forgetting the one rule