Stories
Slash Boxes
Comments
NOTE: use Perl; is on undef hiatus. You can read content, but you can't post it. More info will be forthcoming forthcomingly.

All the Perl that's Practical to Extract and Report

use Perl Log In

Log In

[ Create a new account ]

acme (189)

acme
  (email not shown publicly)
http://www.astray.com/

Leon Brocard (aka acme) is an orange-loving Perl eurohacker with many varied contributions to the Perl community, including the GraphViz module on the CPAN. YAPC::Europe was all his fault. He is still looking for a Perl Monger group he can start which begins with the letter 'D'.

Journal of acme (189)

Tuesday May 30, 2006
11:14 AM

Flickr search stemming

[ #29756 ]
Flickr has recently undergone a redesign. The search page was previouusly very hard to find (it obviously had performance issues) and one of the highlights of the new design for me is the fact that every page now has a search box. This is excellent. I can now easily search for photos of orange, cute lambs and sichuan food. The search results for those searches are wonderful and on-topic. I was looking for photos of yawning things for a presentation recently and I searched for tired - but all I get are pictures of tires! What's going on is that Flickr is stemming the search terms. Both "tired" and "tires" stem to "tire", so I get round things instead of yawning things. Stemming is often used when searching collections - it generally improves accuracy - but in this case it confused me greatly. See what happens when you search for stemming: handle bars, plant stems, stem cells and a "Stem Restaurant" sign. And no diagrams of how stemming systems work...
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
 Full
 Abbreviated
 Hidden
More | Login | Reply
Loading... please wait.
  • Several of our web sites at $WORK are just going through the process of being de-stemmed at the moment. On some reference sites, it's a really bad idea. We also had to thin out the stop word list significantly.

    -Dom

  • The problem here is not stemming, but illiterate people mis-spelling 'tyre'.