Stories
Slash Boxes
Comments
NOTE: use Perl; is on undef hiatus. You can read content, but you can't post it. More info will be forthcoming forthcomingly.

All the Perl that's Practical to Extract and Report

use Perl Log In

Log In

[ Create a new account ]

mpeters (5802)

mpeters
  (email not shown publicly)
http://petersfamily.org/
AOL IM: michael00peters (Add Buddy, Send Message)

Technorati Profile [technorati.com]

Journal of mpeters (5802)

Saturday March 04, 2006
02:02 PM

where there's smoke....

[ #28874 ]
In my last big project we had a nice, large test suite and the team was really good about always running it before most commits. But there were always problems with things that passed on one developer's machine and not the others (usually becuase of some files or changes that were not checked in). So I setup an automated smoke test that ran every night and emailed the results to the developers. I even made it nice and pretty using Test::TAP::HTMLMatrix (mentioned here - http://use.perl.org/~mpeters/journal/25612). This worked pretty well, but as always, it could be improved. These are some areas that needed improvement:
  1. It sent emails whether the test suite passed or not. While I like this (it let me know that the automated tests were still running) other developers just wanted to see the report when tests failed
  2. The report could be very, very large (5000+ tests and over 500k of HTML).
  3. There wasn't an easy way for developers to share test reports between themselves without pasting large chunks of test output into emails
  4. It was very tied to that specific project

This is why Smolder was born. It solves the above problems in the following ways

  1. Developers choose when they want to receive emails. Either a) All the time b) just when there are failures, or even c) never.
  2. Developers can also choose what format their email comes in. It can either be the full HTML, or just a summary, or even just a link to the full report. Smolder contains the full report so it can always be viewed at any time.
  3. Test reports can be uploaded by either an autormated test setup, or individually by developers (in either XML or YAML using either Test::TAP::XML or YAML + Test::TAP::Model)
  4. It's a standalone server that's project agnostic. Plus one smolder install can host several projects. The only thing that needs to be adjusted for each project is to add Test::TAP::XML to the test harness.

Screen shots are available if you want to see it (just to make sure it's not too ugly).

Please try it out, give some feedback and request features. It's just at version 0.01 so it's future is very flexible.

The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
 Full
 Abbreviated
 Hidden
More | Login | Reply
Loading... please wait.
  • I downloaded smolder and tried to get it running without root privledges. Is there a doc somewhere that tells how to do this?
    • You have to have at least sudo privilege if you're running on a system privileged port. If you already have it installed, try editing your smolder.conf to change the ApachePort to something high, like 8080.

      Currently you still need root MySQL privileges, but that's being changed as well.