Tests Are Not Specifications

https://paedubucher.ch/articles/2021-05-02-tests-are-not-specifications.html

by paedubucher • 5 years ago

3 4 5 years ago

Who would actually write tests like this in real life? Does anyone out there actually test their polynomials with a random sample of input values?

Yes, in a technical sense they are tests. But they are bad tests precisely because they barely fulfill the purpose to clarify the behavior of the function.

I’m not convinced.

paedubucher2• 5 years ago

This (my) little rant is of course hyperbolic, but I tried to make two points:

1. The actual specification is sometimes better reflected by the implementation than by some test cases. 2. Some test cases don't help you understanding what's supposed to be computed.

Of course, counterexamples could be made. Imagine a board game with a test function testing specific moves. Those test cases will help you understand the implementation a lot.

dschuessler2• 5 years ago

I agree with both of your statements. They are definitely important points to make about your observation. But your post seems to argue against Martin's standpoint and for the assertion that „Tests are not specifications.“

From the fact that there are some tests out there that are barely specifying anything, it does neither follow that tests are not supposed to be specifications nor that tests are not specifications in general.

I think these are important distinctions to make.

Tests Are Not Specifications

Related Stories