Hacker News new | ask | show | jobs
by jacquesm 6101 days ago
Very interesting stuff. I did notice that this bug was due to a broken test procedure, a simple test loop during the initial write would have brought this problem out instantly.

If your code has an integer range of several 10's of thousands of input possibilities and it costs you next to nothing to run it why not exhaustively test that function?

That way your confidence goes up tremendously, just a couple of edge cases vs the whole range, I know which one I'd pick.

The run output would simply be two columns of integers, very easy to scan for errors. (the output should be equal or monotonous increase from day by day, and should not hang...).

Of course that's after the fact, but there is really no routine so trivial that you can get away without really testing if it does what you intended.

1 comments

That's an excellent point - if you have a finite range, why not test all of it? - and I know software testing researchers who look into just that. The difficulty to keep in mind is that in a large code base, there are going to be many small pieces that have a different finite range.
You might try something like CUTE:

http://osl.cs.uiuc.edu/~ksen/cute/