[Imc-aotearoa-tech] Re: [TechFed] Re: [IMC-Tech] Re: Archive tidying for IMC-Aotearoa list

Will Doherty doherty at onlinepolicy.org
Thu, 27 Feb 2003 09:23:03 -0800


Funny you should ask Evan.

We are just finishing a "Yahoo scraper" that pulls the
email messages out from a Yahoo Group into mbox format.

Let me know if you need it.

One Internet with Equal Access for All,

Will Doherty
Online Policy Group, Inc.
http://www.onlinepolicy.org
-------

At 11:04 AM 2/27/2003 -0500, evan wrote:
>I'm forwarding this to the techfed list. Some of the folks from Online 
>Policy Group are there and i know they and others have a lot of experience 
>with yahoo groups refugees.
>
>If anybody knows how to extract the archives of a good lefty group from 
>the evil clutches of yahoo then they do. Also i'm pretty damned sure that 
>any perl hacker could write you a bot which did it, perhaps such a beast 
>has already been written.
>
>in solidarity,
>evan
>
>On Tuesday, February 25, 2003, at 06:31  AM, Danyl Strype wrote:
>
>>Tena koe Finn,
>>
>>U wrote:
>>
>>>>I don't think that there is any way [to suck out
>>archives from YahooGroups and put them into an open source
>>database]<<
>>
>>A guy going by the handle Albamuth <the_teddie@yahoo.com>
>>managed it for a YahooClub called the Anarchist Commune.
>>Here's what he said:
>>
>>"We used PostNuke which is a packaged PHP/MySQL opensource
>>website. However, I really didn't like having to deal with
>>all of it's interface issues and would rather design it all
>>myself."
>>
>>I asked:
>>
>>>>will it still work with the new integrated YahooGripes
>>format? <<
>>
>>he replied:
>>
>>"It would not work with the new format, no, but in
>>principle it would work. All it does is use PHP
>>to open a HTTP connection to Yahoo and store the
>>messages in a MySQL database. It would need to be
>>tweaked to accomodate the new Yahoo format, but
>>that isn't hard, since it only took me two bored
>>days at my old desk job to do in the first place."
>>
>>U wrote:
>>>>I actually kinda like the yahoogroups archives becasue
>>they are searchable. <<
>>
>>In theory sure, but I can seldom find what I'm looking for.
>>I have an easier job using Google to seach the plain text
>>mailman archives.
>>
>>RnB,
>>Strypey
>>
>>=====
>>"The world as a whole produces more than enough food for everyone. People 
>>go hungry because they lack the money to buy it."
>>- David Concar, "New Scientist" - 14 Dec 2002
>>
>>Aotearoa Independent Media: http://www.indymedia.org.nz/
>>Indymedia Alternatives: 
>>http://phillyimc.org/article.pl?sid=01/11/23/0039242&mode=thread
>>
>>__________________________________________________
>>Do you Yahoo!?
>>Yahoo! Tax Center - forms, calculators, tips, more
>>http://taxes.yahoo.com/
>>
>>_______________________________________________
>>imc-tech mailing list
>>imc-tech@lists.indymedia.org
>>http://lists.indymedia.org/mailman/listinfo/imc-tech
>>
>
>
>_______________________________________________
>TechFed mailing list
>TechFed@lists.techfed.net
>http://lists.techfed.net/mailman/listinfo/techfed