Stories
Slash Boxes
Comments
NOTE: use Perl; is on undef hiatus. You can read content, but you can't post it. More info will be forthcoming forthcomingly.

All the Perl that's Practical to Extract and Report

use Perl Log In

Log In

[ Create a new account ]

james (1129)

james
  (email not shown publicly)
http://whoot.org/
...

Journal of james (1129)

Tuesday February 19, 2002
12:56 PM

Pipelines

[ #2960 ]

As more and more people have been looking at openframe the big thing everybody seems to be getting from it is that pipelines are a really nice way of doing things. We've known that at fotango for quite a while, which is why we wrote OpenFrame the way we did.

Anyway, lots of the feedback we've been getting around OpenFrame is that it seems like a really nice way to do things but its a bit heavy on the CPAN usage - so the first requirement for the rewrite is that we remove lots of the dependencies by bundling it differently, we don't want to change the fact that we don't reinvent the wheel, but we would like to make it a bit more convenient.

The second thing we want to do is come up with a generic pipeline module that people can easily used for different purposes.

I've spent most of the afternoon looking at the problem, and I figure that I've got the guts of it solved, and that the parts that are unsolvable, well, I won't try to solve them.

There is a very early version in the same repository as OpenFrame in the 'pipeline' module. If people are interested of course. And, if you don't know where the OpenFrame repository is, have a look at the website.


List all Journal entries
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.

Pipelines 5 Comments More | Login | Reply /

 Full
 Abbreviated
 Hidden
More | Login | Reply
Loading... please wait.

  • You're not alone thinking that pipelines are very neat :-) Perhaps we should have an OpenFrame-AxKit-AxKitB2B-SAX::Machines-Tessera-etc get together to talk about just how far we can get pipeline abstraction into a single reusable module? All of the above use different variations on the same principle, and not all can probably take advantage of common code (eg XML::SAX::Machines is probably too different) but I'm sure that something could come out of it.

    And hey, we're on the same IRC server, it sho

    --

    -- Robin Berjon [berjon.com]

    • Absolutly. I'm 100% in favour of this. As I've said in several places, ABW and I are quite a long way down defining a system for generic pipelines - the pipeline isn't the real problem, its the agreement on how to pass data along the pipe. But, I'm in favour in having a pipeline townhall. Have a look at the pipeline code that I've got going now, I'm pretty sure its generic, and I'm trying to add (right now) mechanisms to it so that pipelines and pipe segments can indicate what they can and cannot do, bu
  • Why is it a bad thing to have a number of CPAN dependencies? To me the CPAN shell makes this a non-issue. So the question may be: should we modify modules to have fewer dependencies or show people how to use the CPAN shell more effectively? (And for those modules that don't properly declare their prereqs, a polite email to the module author is usually sufficient to prompt a change.)
    • I completely agree - I'm all in favour of having module dependencies - it means CPAN is working, right? But regardless, I've had more complaints about the dependencies than compliments, so I'd rather unbundle core of OpenFrame from all the slots, and that way people can either get the whole shebang, or the parts they require.
      • I completely agree - I'm all in favour of having module dependencies - it means CPAN is working, right?

        Yeah, but some people are stuck behind firewalls and can't use the shell (even though it seems I ought to be able to). Two other people have tried and failed to get by it as well.

        You can always create a bundle.

        Personally, I don't mind taking the time to go and get the modules off CPAN directly if I have to. I just start with Net::SSH::Perl with ssh1 and ssh2 support - that way, I've probably downlo

Stories, comments, journals, and other submissions on use Perl; are Copyright 1998-2006, their respective owners.