Stories
Slash Boxes
Comments
NOTE: use Perl; is on undef hiatus. You can read content, but you can't post it. More info will be forthcoming forthcomingly.

All the Perl that's Practical to Extract and Report

The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
 Full
 Abbreviated
 Hidden
More | Login | Reply
Loading... please wait.
  • Someone from Yahoo was at OSCON, giving a talk called "How to serve a billion pages a day with Perl" or something similar to that.

    He gave a great overview of all the different methods you can use to scale the application. Which ones work, which ones don't. And which order to persue them in. ... pause...

    actually, I managed to find the overview

    When: 7:30 PM, Wednesday, July 20th, 2005

    Where: ActiveState/Sophos, 580 Granville Street, Vancouver, BC

    Speaker: Kevin Scaldeferri

    Topic: How to Serve a Billion Requests a Day with Perl

    This presentation discusses the challenges of building complex services
    that can handle very high query rates with low latency and high
    availability. Overture, the sponsored search division of Yahoo!, has
    developed a number of systems that have successfully scaled over several
    orders of magnitude in both data volume and query rate, and Scaldeferri
    will discuss the ideas behind some of these. General topics covered will
    include:

            * Caching using local and distributed caches
            * When and how to distribute your application across multiple
                machines
            * Use of asynchronous communication techniques to increase
                throughput and ensure acceptable response times

    Scaldeferri also discusses the interplay between different levels of
    abstraction, from high-level business logic, to practical Perl
    programming, to low-level OS and hardware behavior, and how all of these
    affect the design and architecture of such systems.

    Bio: Kevin Scaldeferri is a lead developer at Yahoo!'s sponsored search
    division, Overture, where he has spent the last three years taming an
    ever-growing Perl code base that currently serves over one billion web
    requests a day. His professional interests include programming languages
    and software development practices. Outside work, he enjoys cooking,
    reading, modern art, and "challenging" music.
    • I was unable to attend OSCON this year but when I looked at the speaker summaries, this was one of the talks that jumped out at me. I'd really like to attend it at some point, or peruse a written copy. Thanks for the tip on that.