Stories
Slash Boxes
Comments
NOTE: use Perl; is on undef hiatus. You can read content, but you can't post it. More info will be forthcoming forthcomingly.

All the Perl that's Practical to Extract and Report

use Perl Log In

Log In

[ Create a new account ]

Matts (1087)

Matts
  (email not shown publicly)
I work for MessageLabs [messagelabs.com] in Toronto, ON, Canada. I write spam filters, MTA software, high performance network software, string matching algorithms, and other cool stuff mostly in Perl and C.

Journal of Matts (1087)

Wednesday February 16, 2005
03:38 PM

Settling in and KQueue

[ #23219 ]

Spent last week and this weekend settling in to the new house. Heather has done most of the unpacking, and I'm immensely grateful to her for that. This has allowed me to just get on with work while the chaos continues around me.

Today I've mostly been writing a perl module for calling the BSD/MacOSX kqueue() system call. I thought at first to try just using perl's syscall() command to do it, but I'm not entirely convinced that is possible due to requiring memory allocation and so forth. So instead I wrote a simple XS wrapper called IO::KQueue (I'm sure the module naming overlords will shoot me for that).

If anyone would like to test it please email me - I'd like to at least know it works on FreeBSD before uploading to CPAN. It requires perl 5.8 though (for ExtUtils::Constant).

The reason I've been doing this is that I've been working on highly scalable/parallel clients again. There's some modules for doing this kind of work (POE, Event, IO::Select, IO::Multiplex, etc) but none are really simple enough to achieve the kind of scalability I require. Instead I've been building on Brad Fitzpatrick's Danga::Socket code which he uses in perlbal - his perl based load balancer. Danga::Socket will transparently use epoll() if it's on your system, or poll() if not. I'll now be working on making it do kqueue() if it's available. Should be fairly simple to make that work, and then I'll be able to test my code on OSX that much easier.


List all Journal entries
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.

Settling in and KQueue 5 Comments More | Login | Reply /

 Full
 Abbreviated
 Hidden
More | Login | Reply
Loading... please wait.

  • It requires perl 5.8 though (for ExtUtils::Constant).

    Why so? If ExtUtils::Constant isn't buggy, then I thought that it worked safely as far back as 5.005. You ship a pair of source files to fall back on if the user doesn't have it installed (which means that they can't tweak the list of defined cosntants) but anyone who does have it installed can tweak to their hearts content. Well, that was the plan. See Time-HiRes [cpan.org] for an example of the fallback mechanism.

    • Just laziness. I do this stuff for work rather than for the benefit of the community now. Looks like a simple work around though.

      I should also send you some doc patches for ExtUtils::Constant - the docs suck :-)
  • I think it's great that you're working on IO::KQueue (and I think the name is fine, in the vein of IO::Select and IO::Poll).

    I've been quite happy with Event::Lib as a wrapper around various IO polling mechanisms (and although I don't use a system that supports kqueue, I hear libevent doesn't mind using it).

    Was there something keeping you from using Event::Lib? The external library dependancy? I'm just curious, and like to hear about the selection process from others.

    Congrats on settling in, I've been d
    • It's a number of things really - primarily that libevent is just more stuff than I need, and my code all integrates with Danga::Socket which uses low level calls to epoll/poll (and now kqueue) rather than going through another abstraction layer.

      Also I know some people more knowledgeable than I am about this stuff who don't have high opinions of libevent :-)
Stories, comments, journals, and other submissions on use Perl; are Copyright 1998-2006, their respective owners.