nluug.nl has dropped us

I have just realised that nluug.nl has dropped all Puppy/Wary/Quirky hosting.

That's a shame. I have no idea why.

See:
http://ftp.nluug.nl/ftp/pub/os/Linux/distr/

I will have to modify Woof and PPM, take out the nluug.nl URLs.


Posted on 22 Feb 2011, 9:47


Comments:

Posted on 22 Feb 2011, 10:07 by BarryK
Few Wary mirrors
It looks like we have a crisis situation with hosting of Wary and Quirky files.

I can only find one mirror of ibiblio.org that has Wary 5.1:

http://ftp.cc.uoc.gr/mirrors/linux/quirky/

Over the last year or two, a few people have approached me offering hosting, but I have not taken up the offers as I was complacent, thinking that ibiblio.org is serving us well.

Yes, ibiblio is great, but the mirror sites are very selective in what they mirror. We need to lobby some of these mirrors to please add Wary/Quirky.

And/or, anyone who can add their site as a mirror of ibiblio and host Wary/Quirky, that would be great.



Posted on 22 Feb 2011, 14:57 by russoodle
mirrors and hosting
Hi Barry,
I'm so sorry to read of that, it's very disappointing, not to mention inconvenient.

I've just been looking through the Puppy dir. on Internode, which has a great archive of Puppy files, however i didn't see any Quirky- or Wary-specific directories, except for Wary packages. How are the files uploaded to Internode?

While i'd very much like to help you out with this, i don't have the server-space on my VPS to mirror ibiblio - good grief! - so the best i can do is manually upload individual files for hosting.

Regards,
russoodle


Posted on 22 Feb 2011, 15:27 by Terryphi
Potential Wary Mirrors
It would help individuals thinking of offering use of a mirror on their sites if you detail the technical requirements and the syncing procedure.

On the academic front, as pointed out by Aitch on the forum, the University of Kent UK Mirror Service looks promising.

http://www.mirrorservice.org/Help/Contact_Us


Posted on 22 Feb 2011, 15:35 by Terryphi
Potential Wary Mirrors 2
The University of Kent request form for a mirror seems to assume the request is coming from a student or academic. Please step forward UK students and academics. Wary needs you!


Posted on 22 Feb 2011, 17:33 by BarryK
Re how to mirror ibiblio
It would help individuals thinking of offering use of a mirror on their sites if you detail the technical requirements and the syncing procedure.

...I don't, have never done it myself. I presume that you just use rsync or something to track a particular URL.

Here is the ibiblio mirrors intro page:
http://www.ibiblio.org/software/distributions/

And the Wary/Quirky URL:
http://distro.ibiblio.org/quirky/



Posted on 22 Feb 2011, 18:13 by Bert
Nluug
Hi Barry,

I've just witten to nluug (in Dutch), asking politely about the situation.

It was one of the best mirror sites, hope it'll be back!


Posted on 22 Feb 2011, 19:59 by mavrothal
mirrors
It would appear that during the move of ibiblio to the new servers the sync process also changed.
I know this because ftp.cc.uoc.gr was not updating puppy/quiky after the move (is fixed now).
Maybe this change resulted in dropping pyppy/quircky in other mirrors and all the admins should be notified.


Posted on 23 Feb 2011, 4:07 by Aitch
Kent mirror
Barry,
Following terryphi's earlier post
I have posted in my local Kent Hackspace for assistance from Students with getting PuppyLinux mirrored at Kent Uni
...copied to your gmail
see http://murga-linux.com/puppy/viewtopic.php?t=64859

Aitch :)


Posted on 23 Feb 2011, 8:33 by CLAM01
Hosting-mirroring
In May, last year (2010), I queried osuosl, the Oregon State University Open Source Lab, about hosting puppies, because osuosl.

They responded positively, saying the developer contact them.

I would suggest doing this. osu is a tech oriented university and osuosl is research/development/experiment oriented. And it attracts substantial bandwidth donations, so has quite a lot. Puppy should fit with osuosl interests, especially in wary and quirky iterations, and appeal to its "customer" base.

I suggest you contact http://www.osuosl.org to enquire.

You might want to look at an interview in regard to developments being made in mirroring with a system called 'puppet' at http://osuosl.org/about/mike-on-mirrors . It includes a chart that may be of interest.


Posted on 23 Feb 2011, 9:00 by Joan in Reno
Another Mirror Possible
Hello Barry,

I contacted Reno LUG, here's their reply:

I've never used puppy linux but I would be cool with hosting a mirror on our server. Can you get the details on what needs to be done to make that happen?
- Show quoted text -
- Hide quoted text -
Good morning,

I saw on Barry's Blog that he lost his fastest mirror, just thought I'd mention it. I know I've used his Live CDs in my Tool Kit for years.

Thanks,
Joan in Reno
--
You received this message because you are subscribed to the Google Groups "Reno Linux Users Group" group.
To post to this group, send email to renolug@googlegroups.com.
To unsubscribe from this group, send email to renolug+unsubscribe@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/renolug?hl=en.

--

Please feel free to contact them with the details, they recently agreed to host Finnix Linux, too, since he's in Reno.

Joan in Reno




Posted on 23 Feb 2011, 14:25 by BarryK
nluug.nl removed
Ok, I have removed nluug.nl from Woof and PPM.



Posted on 23 Feb 2011, 15:11 by 01micko
nluug
Hmmmm..
I think nluug.nl should be given a chance to at least explain... it may have been an ibiblio cockup from the server upgrade, you never know. At the very least wait for an response from Bert.. and I still think a couple of well worded emails to internode (which is not listed as an official repo but has all puppy files though not quirky/wary http://mirror.internode.on.net/pub/puppylinux/ ) and http://mirror.aarnet.edu.au/pub/puppylinux/ AARNet. These guys should be jumping out of their skins to support an active Aussie, top 10 distro.


Posted on 23 Feb 2011, 15:55 by BarryK
Re nluug.nl
01micko,
I removed nluug.nl because release of Wary 5.1.1 is imminent, maybe tomorrow. Current situation is PPM is partly broken because of nluug.nl not having any PETs.

It is easy enough to restore nluug.nl.



Posted on 23 Feb 2011, 19:52 by Michalis
NTUA Mirror
Hello Barry, if you want I can contact NTUA (National Technical University of Athens) in order to host all the puppies, woof etc.

It hosts many linux projects and distros as you can see here. It is extremely fast as it has 10Gbit internet access and I think they are updating it to 100Gbit and unlimited hosting size. Moreover they state that if there is anything opensourse that someone wants and they don't host to inform them in order to host it.

So tell me if you are interested in order to contact them.


Posted on 23 Feb 2011, 22:03 by Joan in Reno
Perhaps in California, too
Here's the reply I got from him:

--- In linux@yahoogroups.com, Joan Leach <jleach728@...> wrote:
>
> I saw on his Blog that he lost his fastest mirror...I thought it might be good to know.
>
> Joan in Reno

I'm mirroring two websites right now:

<http://thadlabs.com/MAPUG/

<http://thadlabs.com/Rolamite/

How much space would they need and what's the approximate load? I "might" be able to help since my site has a fast connection but I don't have an infinite amount of disk space:

thadlabs bash 69071/69073> date
Wed Feb 23 02:12:25 PST 2011
thadlabs bash 69071/69073> uptime
2:12AM up 947 days, 5:21, 3 users, load averages: 0.15, 0.03, 0.01
thadlabs bash 69071/69073> df
Filesystem 1K-blocks Used Avail Capacity Mounted on
/dev/aacd0a 492863 40258 413176 9% /
/dev/aacd0e 273417193 206289263 50722898 80% /usr
procfs 4 4 0 100% /proc
/dev/aacd1a 492863 40257 413176 9% /backup
/dev/aacd1e 265365585 206142489 37993849 84% /backup/usr
thadlabs bash 69071/69073>



Posted on 24 Feb 2011, 7:20 by BarryK
nluug email address
From Bert, email address obfuscated:

Hi Barry,

I received a reply from NLUUG.
I'll translate it here from Dutch:

<<
Hi, the reason of this problem is indeed the move Ibiblio has made.
We mirror some Linux distributions directly from source (like Fedora, opensuse, knoppix)and some others come with the Ibiblio archive.
If you can show me a source where I can mirror Puppy Linux from, it would be my pleasure to install a mirror for it.

Jan Christiaan Van Winkel,
Archive management ftp.nluug.nl >>

His email address is STARTsecretarisATnluugDOTnlEND
nluug email address
I gave you the wrong email address, I'm afraid.
The one to Jan Christiaan directly is STARTjcATnluugDOTnlEND




Posted on 24 Feb 2011, 7:25 by BarryK
nluug.nl contacted
Bert,
Thanks for that, I have sent Jan an email, content:

Jan,
One of our Puppy Linux fans has contacted you about Puppy Linux and Quirky mirroring from ibiblio.org disappearing from your site.

I was alarmed when I saw that a couple of days ago, as Quirky is only mirrored by a couple of other sites.

It would be great if you could restore the mirroring. Here are the URLs:

http://distro.ibiblio.org/quirky/
http://distro.ibiblio.org/puppylinux/

Note that Quirky is a variant of Puppy Linux that is a test bed for experimental ideas. Wary Puppy, which is hosted on the Quirky site, is a variant of Puppy that targets excellent support for older hardware.

All of these are 100% free open source, non-commercial.

I am the founder and lead developer of Puppy Linux and Quirky.

Regards,
Barry Kauler
http://bkhome.org/blog/




Posted on 24 Feb 2011, 7:27 by BarryK
Re NTUA
Michalis,
Yes, that would be great if you could contact them!



Posted on 24 Feb 2011, 20:35 by Michalis
NTUA
I contacted them asking them to mirror puppy linux and quirky linux directories from ibiblio.org. Now I am waiting for a response When I'll have any news I'll write back here.

By the way I hadn't noticed the mirror in your first comment which is in the university of Crete, which unfortunately I didn't knew it was existing. This server as in a university is also connected with a very fast link of at least 10Gbit. Is also connected throughout the European university network extremely fast to all over Europe.

If you want my opinion you should add it in your scripts and for south east Europe, middle east and Africa (which are both linked to Europe also through Crete) you should direct them to this mirror.


Posted on 25 Feb 2011, 21:00 by Michalis
Response
They responded me and told me that they are interested to mirror puppy and quirky. But for the time being ibiblio.org has some hardware problems and for the time being isn't reliable source for mirroring. Moreover it doesn't have rsync modules for these distros but that will be able to overcome it.

So the answer is yes but not now. They will inform me when they will start mirroring.

By the way university of Crete is already mirroring wary 511


Posted on 27 Feb 2011, 13:45 by 01micko
AARnet issue
It seems AARnet are having issues too.

I sent them a friendly email:

To whom it may concern,

I am a developer with Puppy Linux.

As you may know Ibiblio did a major restructure and upgrade of servers earlier in the year. That upgrade has had a detrimental effect on Puppy Linux files through all mirrors, AARnet included.
Barry Kauler, the founder and lead developer of Puppy linux first noted the issue when it seemed that nluug.nl had dropped Puppy Linux and sister distro Qurky Linux from service. However it seems that is not the case, but a problem with Ibiblio's new setup is the culprit. I refer you to this link on Barry's Blog http://bkhome.org/blog/?viewDetailed=02153.

Recently I noted that files are not being synced. If you check the files at http://distro.ibiblio.org/pub/linux/distributions/puppylinux/pet-packages-lucid/ you will notice they are not in sync with http://mirror.aarnet.edu.au/pub/puppylinux/pet-packages-lucid/ .

With this in mind, and presuming a fix is possible and not too difficult, would it be possible for your service to mirror Quirky Linux from Ibiblio as well? Address: http://distro.ibiblio.org/pub/linux/distributions/quirky/

Puppy and Quirky Linux are an innovative Australian open source initiative.

Thank you for your time,

Regards,

Michael Amadio.


Well... it's short and to the point!
Cheers

PS, other mirrors are having trouble too, including internode. Some are gone completely, others just haven't synced. :(


Posted on 28 Feb 2011, 8:25 by BarryK
Contacted ibiblio
01micko,
Thanks for the clarification, I have sent an email to ibiblio.



Posted on 28 Feb 2011, 8:30 by 01micko
great
Um, I made a mistake and posted the phone numbers in my previous post, can you edit/delete?
Thanks


Posted on 28 Feb 2011, 19:33 by Michalis
rsync
If ibiblio enable rsync for puppy and quirky then definitely NTUA will mirror them.

Also I contacted a friend of mine who is a university teacher in another university and he told me that will contact the administrator in order to mirror puppy and quirky. Of course it will be easier if ibiblio enable rsync.


Posted on 1 Mar 2011, 19:04 by BarryK
rsync delay
I contacted ibiblio, so did Jan from nluug.nl, and we both got the reply that ibiblio.org is still in the process of moving to new servers and setting up rsync for puppylinux and quirky could be 1 or 2 weeks away.
So, we have to be patient.



Posted on 1 Mar 2011, 22:34 by mavrothal
rsync
Indeed rsync is not working for individual distributions in ibiblio. The uoc.gr mirror is using ftp to mirror puppy and quirky.


Posted on 2 Mar 2011, 20:39 by Michalis
metalink
I'm not sure whether it is possible but I wonder if in your scripts instead of pointing to particular servers to point to a metalink file in ibiblio (since is the major server). With a metalink file you don't mind whether a mirror is down since it will automatically download what it needs from any server it finds online. Moreover it will find the fastest/closest server to download from. All you need to use a metalink is Aria2 which is small and lightweight.


You can also provide metalinks for the isos. Moreover since you the directory structure is known you can add all the servers that generally mirror puppy even if they haven't update the mirroring yet. Another plus is that it automatically checks the file using md5sum, sha and you can also use a signature in the file (pgp).

Actually I'm wondering why metalinks aren't broadly used all over the Internet?


Posted on 3 Mar 2011, 19:46 by BarryK
nluug.nl working again
We are back in business!

See blog post:
http://bkhome.org/blog/?viewDetailed=02167