Stories
Slash Boxes
Comments

All the Perl that's Practical to Extract and Report

use Perl Log In

Log In

[ Create a new account ]

Alias (5735)

Alias
  (email not shown publicly)
http://ali.as/

Journal of Alias (5735)

Tuesday May 06, 2008
11:48 PM

Seeking recommendations for a better file delivery mechanism

[ #36344 ]
Dear Lazyweb.

I've had some complaints that the strawberry binaries download rather slowly, particularly in some parts of the world.

So I need some suggestions on a better distribution mechanism, something better than just "serve it all from strawberryperl.com". (Note: I'm not looking for a better cpan.strawberryperl.com, just the main distro download).

Here's my criteria, in order...

1. Reliability

If I create a link to a download, and I test it on my computer in Australia (and it works) then it HAS to also work everywhere else.

This rules out distribution via CPAN and linking to the search.cpan.org multiplexor (as different mirrors sync non-deterministically and at different rates).

2. Statistics

Call it vanity, call it anything you like, but I insist on having at least SOME idea of the number of downloads. This gets more important later, once the number of variations starts to get higher, so I can get feedback on which variations are more popular. XP vs Vista, 32 vs 64 bit, exe vs msi vs zip, Vanilla vs Strawberry vs Chocolate etc.

This also rules out CPAN. I've got no way of knowing the number of downloads or installs, short of making the installer phone home.

I don't necesarily want the download figures to be public, but I can live with that if I have to.

3. Size

Currently, the production set of 5 release variants (1 Vanilla, 4 Strawberry) is around 100 meg. Assuming the next release gets Portable support, that grows to 7 variants. When the chocolate betas arrive, that grows to 13 variants, and if we end up needing a separate 64 bit release, or separate Vista releases, that could double of quadruple.

So the distribution mechanism has to be able to handle around a gig of downloadable files, possible up to 3 gig.

Again, this also rules out CPAN. It abuses the hospitality of the mirror operators in my opinion.

4. Speed

Downloads should ideally be fast. I'm assuming this probably means some mirror-based network that has at the very least a server in America and Europe, ideally a few more.

5. Usability

Currently, to download Strawberry you click on a single link on the front page.

I like that simplicity.

I really hate Sourceforge, because it makes downloading a pain. You have a releases list, you have to find the version you want, then you need to select a mirror, all on pages covered in SourceForge chrome and distractions.

Ideally, I want a one-click download process.

I can live with 2 clicks, if it involves almost no reading.

But no more than 2 clicks.

So, can anyone suggest something that meets all my criteria?

List all Journal entries
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.

Seeking recommendations for a better file delivery mechanism  Comments More | Login | Reply /

 Full
 Abbreviated
 Hidden
More | Login | Reply
Loading... please wait.
  • By the end of June, if not before, I'll know for sure about my move to VPS:
    http://www.quadrahosting.com.au/vps/linux-vps.html [quadrahosting.com.au]

    Quadra is already my web host. WestNet is my ISP.

    I'll go for the standard or pro option. I could then handle that sort of traffic.

    I
    • I can handle the traffic now, easily... it's just that any single point is likely to be slow from a single point on the internet to all arbitrary points on the internet.
  • Have you considered torrents as one of many options? I suppose you'll lose the download statistics.

    Also, I'd be happy to set up a North American mirror, which means actually that I give you an account and you set up a North American mirror however you like
    • Torrents probably aren't worth it for a 17MB file.

      However, once we get some notional "Perl and CPAN on a Stick" 800MB package, then torrenting is absolutely the option I need.

      Maybe even for Chocolate, but I really hope it is no bigger than 50MB.
  • If you need a mirror in Europe (located in Germany), you can use the Vienna.pm server... OTOH I guess you're not really looking for diskspace/bandwidth, but for a smart distribution mechanism...

  • Yes, the SourceForge file upload mechanisms are a diabolical mess. Yes the raw user interface for downloading files is a diabolical mess. BUT they do have a network of geographically distributed mirrors and they do give you stats on downloads. So all yo

    • That would mean though, writing my own multiplexor... which I'd like to avoid if at all possible.
    • WRT SourceForge this is the problem "Yes the raw user interface for downloading files is a diabolical mess".

      Strawberry's website is so simple and pain free, that going from that to the aformenting diabolical mess is something I really don't want.
  • just reply to yesterday. i hope chocolate is not just for noobs but also about having all the tool bundeled together to be highly productive.

  • How about the Coral Content Distribution Network [coralcdn.org]? All you need to do is append .nyud.net to the hostname in your link and they’ll fetch the original address, cache it, and deliver it through whichever of the currently 260 participating servers is nea

    • Curiously, Coral's home page is blocked by my corporate porn/gambling/social-network/etc filter...

      This is an excellent idea though, I should investigate further.
  • use http://geo.bitnames.com/ [bitnames.com] and some mirrors for something like download.strawberryperl.com. the other option is of course on the download page just give a main link and then some text saying if you think this is too slow please to be using one of our mi
    • "saying if you think this is too slow please to be using one of our mirrors and link to a mirrors page."

      This isn't a good enough solution. Making people read/think is not an option! :)

      I also don't really want to have to set up my own mirror pool for someth
  • I'd be willing to host a country-based redirection service, as used on cpan.uwinnipeg.ca/cpan [uwinnipeg.ca] and mirror.ctan.org [ctan.org] for, respectively, CPAN and CTAN. Also, if you need a Canadian mirror, cpan.uwinnipeg.ca [uwinnipeg.ca] is available.
Stories, comments, journals, and other submissions on use Perl; are Copyright 1998-2006, their respective owners.