use Perl

• Re: Tests are a binary issue (Score:1)

  by Adrian (66)

  I don't like the change myself. I'm bright enough to figure out that anything less than 100% pass is bad when developing.
  
  When using other peoples test suites seeing, for example, 99% ok tells me something very different from seeing 3% ok. For me the difference between "nearly there apart form this bit of functionality that I don't care about" and "completely f**ked" is useful. Yes I can figure it out from the test/pass numbers - but the percentage gives me a handy overview. Math is hard! :-)
  
  Not something I
• Re: Tests are a binary issue (Score:2)

  by dws (341)

  An implied question when I do a test run is "Did I screw up something fundamental, or just some edge case?" Numbers help me get that answer.
  • Re: Tests are a binary issue (Score:2)

    by petdance (2468)

    You get the numbers. You just don't get the percentages.

    There's no difference between blowing 3 tests out of 100, or 3 out of 10,000. So 97% is no worse than 99.97%.

    --
    

    --
    xoa
    • Re: Tests are a binary issue (Score:2)

      by dws (341)

      As an alternative, how about replacing the percentages with some pithy text?

      "You missed one."
      "A pair slipped by."
      "You've got a few problems."
      "Uh, oh. Not good."
      "Hands up, and back away from that keyboard."
      • Re: Tests are a binary issue (Score:1)

        by Aristotle (5147)

        Maybe if Coy [cpan.org] is loaded?
• Computers are binary, humans aren't (Score:2)

  by brian_d_foy (44)

  I use the percentages to track progress, and it's something I can point customers to.
  
  Was there some other reason for this change?
  • Re:Computers are binary, humans aren't (Score:2)

    by petdance (2468)

    Other than removing extra code, and not wanting to support the "correctness" of that percentage, no. I had a ticket in RT where 99.994% rendered as 100%, which was misleading. But mostly it was because it just doesn't make sense to talk about tests in a way other than pass/fail. The whole end-of-the-run reporting system is on my short list to overhaul anyway.

    --
    

    --
    xoa
• Makes sense to me (Score:2)

  by grantm (164)

  Given that you are still reporting the number of failed tests, not displaying the fairly meaningless percentage is no loss at all.