Stories
Slash Boxes
Comments

NOTE: use Perl; is on undef hiatus. You can read content, but you can't post it. More info will be forthcoming forthcomingly.

use Perl

All the Perl that's Practical to Extract and Report

use Perl Log In

[ Create a new account ]

petdance (2468)

petdance
andy@petdance.com
http://www.perlbuzz.com/
AOL IM: petdance (Add Buddy, Send Message)
Yahoo! ID: petdance (Add User, Send Message)
Jabber: petdance@gmail.com

I'm Andy Lester, and I like to test stuff. I also write for the Perl Journal, and do tech edits on books. Sometimes I write code, too.

Journal of petdance (2468)

Tuesday May 22, 2007

02:45 PM

Help test WWW::Mechanize and its encoding fixes

[ #33338 ]

Kevin Falcone and I have been working on encoding problems with Mechanize. As many people as can test the darn thing would be appreciated.

Also, suggestions on getting rid of the warnings in the test suite are welcome as well.

Thanks,
xoxo,
Andy
(and Kevin)

Download at $CPAN/authors/id/P/PE/PETDANCE/WWW-Mechanize-1.29_01.tar.gz

Here's what goes wrong: t/live/wikipedia.........ok 5/15Parsing of undecoded UTF-8 will give garbage when decoding entities at /Library/Perl/5.8.6/darwin-thread-multi-2level/HTML/PullParser.pm line 83. Parsing of undecoded UTF-8 will give garbage when decoding entities at /Library/Perl/5.8.6/darwin-thread-multi-2level/HTML/PullParser.pm line 83. Parsing of undecoded UTF-8 will give garbage when decoding entities at /Library/Perl/5.8.6/darwin-thread-multi-2level/HTML/PullParser.pm line 83. Parsing of undecoded UTF-8 will give garbage when decoding entities at /Library/Perl/5.8.6/darwin-thread-multi-2level/HTML/PullParser.pm line 83. Parsing of undecoded UTF-8 will give garbage when decoding entities at /Library/Perl/5.8.6/darwin-thread-multi-2level/HTML/PullParser.pm line 83. Parsing of undecoded UTF-8 will give garbage when decoding entities at /Library/Perl/5.8.6/darwin-thread-multi-2level/HTML/PullParser.pm line 83. t/live/wikipedia.........ok 10/15Parsing of undecoded UTF-8 will give garbage when decoding entities at /Library/Perl/5.8.6/darwin-thread-multi-2level/HTML/PullParser.pm line 83. Parsing of undecoded UTF-8 will give garbage when decoding entities at /Library/Perl/5.8.6/darwin-thread-multi-2level/HTML/PullParser.pm line 83. Parsing of undecoded UTF-8 will give garbage when decoding entities at /Library/Perl/5.8.6/darwin-thread-multi-2level/HTML/PullParser.pm line 83. t/live/wikipedia.........ok

List all Journal entries

Help test WWW::Mechanize and its encoding fixes More | Login | Reply

The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.

Without JavaScript enabled, you might want to use the classic discussion system instead. If you login, you can remember this preference.

relevant links (Score:2)

by petdance (2468)
Relevant links:
- http://www.nntp.perl.org/group/perl.libwww/2006/08/msg6801.html [perl.org]
- http://www.nntp.perl.org/group/perl.libwww/2007/02/msg6967.html [perl.org]
--
--
xoa
My solution (Score:1)

by ChrisDolan (2855)

Here's the solution I employ in my own hacked copy of Test::WWW::Mechanize::Catalyst, which I submitted to RT [cpan.org].
if ($response->header('Content-Type') && $response->header('Content-Type') =~ m/charset=(\S+)/xms) { my $encoding = $1; $response->content(Encode::decode($encoding, $response->content)); }

So far, that's worked great fo
- Re: (Score:2)
  
  by grantm (164)
  
  Wouldn't it be better to just use the decoded_content method of the HTTP::Message (Response) object? Or is there some problem with that?
  - Re: (Score:1)
    
    by ChrisDolan (2855)
    
    Oh, uh, yeah... The significant problem with the function is my ignorance of its existence. :-/
  - Re: (Score:1)
    
    by jibsheet (3205)
    
    unfortunately, that makes t/local/nonascii.t break, and that has been a test that worked with mech for years. (it is derived from a number of tests in the RT testsuite)

Get More Comments

Reply

use Perl

All the Perl that's Practical to Extract and Report

Navigation

use Perl Log In

petdance (2468)

Journal of petdance (2468)

Help test WWW::Mechanize and its encoding fixes

Help test WWW::Mechanize and its encoding fixes 5 Comments More | Login | Reply /

Please Log In to Continue

relevant links (Score:2)

My solution (Score:1)

Re: (Score:2)

Re: (Score:1)

Re: (Score:1)