As it stands now, and someone correct me if I'm wrong, if I sign up as a cpan tester, I will get an email notification for *every* new module uploaded to PAUSE. This would annoy me because it would be too many emails, and I wouldn't be inclinded to test most modules.
What I would *like* to see is the ability to sign up as a tester for *specific modules*. You would click on the "CPAN Testers" link and there would be a "sign up as a tester for module X" link. Then, you would provide your information, such as name, platform, etc (or perhaps it could use stored PAUSE information). Whenever a new upload of module X is uploaded, you receive an email and send in the test results (platform, pass/fail, etc).
Now, I *think* you can do this via CPANPLUS or CPAN::Test::Reporter, but I haven't looked at either module yet. In any case, I think adding something like that to cpan.org would be nice.