use Perl

• Skip a Step (Score:1)

  by chromatic (983)

  If you avoid glomming all of those lines together in a single text file, you can avoid having to scan that file sequentially before you can parallelize. This can be handy if you need to process logfiles in parallel.
  • Re: (Score:1)

    by Aristotle (5147)

    Dan Bernstein was onto something in more ways than one, obviously.
    • Re: (Score:1)

      by chromatic (983)

      I had in mind mod_log_sql or whatever it is, but special syslog magic could also apply.
      • Re: (Score:1)

        by Aristotle (5147)

        Oh, I wasn’t just talking about logfiles. Same’s true for any structured data.
  • Re: (Score:1)

    by Mark Leighton Fisher (4252)

    Too true. But sometimes we still have text files to deal with – I didn't mean to exclude sidestepping the ordered-bit problem by storing the data in random-access fashion.
• what are you implying... (Score:1)

  by rjbs (4671)

  Concurrency will continue to become more important, since it is getting cheaper to add more CPUs to a chip than to speed up the chip. (After all, we don't have one big, fast neuron in our brains.)

  Are you trying to say that our brains work the way they do because God is a cheapskate? Given the erratic behavior I observe in people, I'd think of Him more as an overclocker.

  --
  rjbs