Overview of TDDA in Predictive Analytics Times
We have an overview piece in Predictive Analytics Times this week.
You can find it here.
Continue readingAnomaly Detection
Posted on Tue 01 December 2015 in TDDA • Tagged with tdda, components
The Broader Process: Anomaly detection and Alerting.
The fourth major area we will focus on as we develop the ideas of test-driven data analysis is the correctness of the broader process. This relates partly to some of the ideas about consistency checking discussed earlier, but goes further.
A common situation …
Continue readingUnit Testing
Posted on Sat 28 November 2015 in TDDA • Tagged with tdda, components
Systematic Unit Tests, System Tests and Reference Tests
The third major idea in test-driven data analysis is the one most directly taken from test-driven development, namely systematically developing both unit tests for small components of the analytical process and carefully constructed, specific tests for the whole system or larger components …
Continue readingConstraints and Assertions
Posted on Thu 26 November 2015 in TDDA • Tagged with tdda, components
Consistency Checking of Inputs, Outputs and Intermediates
While the idea of regression testing comes straight from test-driven development, the next idea we want to discuss is associated more with general defensive progamming than TDD. The idea is consistency checking, i.e. verifying that what might otherwise be implicit assumptions are …
Continue readingHow is this Misleading Data Misleading Me?
Posted on Fri 13 November 2015 in TDDA • Tagged with tdda, implementation, interpretation, correctness
"Why is this lying bastard lying to me?"
Louis Heren,1 often attributed to Jeremy Paxman.
In a previous post, we made a distinction between two kinds of errors—implementation errors and errors of interpretation. I want to amplify that today, focusing specifically on interpretation.
The most important question to …
Continue reading