CODfiles (Filefront) Closes

[CaptainSlow]

I had another look at this and I don't see an easy way of scraping either gamershell or gamefront. Both use an unique key which is generated for each download request, making automatic scraping impossible as far as I can see

[kung foo man]

IzNoGoD just had some problem some days ago, he wanted e.g. to download: http://www.gamefront.com/files/5125790

You do the initial http request:

printf "GET /files/5125790 HTTP/1.0\r\nHost: www.gamefront.com\r\n\r\n" | netcat gamefront.com 80 > 1.txt

Check 1.txt, you gotta rip two lines:

Set-Cookie: PHPSESSID=1mcbhc3hv5h4iid1rddfr7vqk6; path=/
<a href="http://www.gamefront.com/files/service/thankyou?id=5125790" class="downloadNow premium-content" id="downloadLink">

Second request will use this data:

printf "GET /files/service/thankyou?id=5125790 HTTP/1.0\r\nHost: www.gamefront.com\r\nCookie: PHPSESSID=1mcbhc3hv5h4iid1rddfr7vqk6\r\n\r\n" | netcat gamefront.com 80 > 2.txt

Check 2.txt, you gotta rip this:

        var downloadUrl = 'http://media1.gamefront.com/pub2/Call_of_Duty_2/Official_Patches/v13/CallofDuty2Patchv1_3.exe?b17f4b620c6cf1393ffa644f10eea151c975f3a1042cbd46c310d68acbb5e5807a00095c2e30b1cb0c60fa18dc133ad4f7284fffc0c0ac5c176306165711ed57a1f1c14a5ba52be7c140b96bd330899e88548e2ad06cffb08c39eacc6099c1645c43ab564e08f60dcf20027ac61c264fb1df6e4510e4ff7a9dfbd6fc381ea077a55203a8dda6aba141b1&ext=.exe';

And just download it:

wget http://media1.gamefront.com/pub2/Call_of_Duty_2/Official_Patches/v13/CallofDuty2Patchv1_3.exe?b17f4b620c6cf1393ffa644f10eea151c975f3a1042cbd46c310d68acbb5e5807a00095c2e30b1cb0c60fa18dc133ad4f7284fffc0c0ac5c176306165711ed57a1f1c14a5ba52be7c140b96bd330899e88548e2ad06cffb08c39eacc6099c1645c43ab564e08f60dcf20027ac61c264fb1df6e4510e4ff7a9dfbd6fc381ea077a55203a8dda6aba141b1&ext=.exe > CallofDuty2Patchv1_3.exe

Would probably be nice just to reconstruct the file structure based on "Call_of_Duty_2/Official_Patches/v13/CallofDuty2Patchv1_3.exe" in final dl link.

[CaptainSlow]

Thanks, I'll look into it.

Also, about the total filesize, I wouldn't worry too much. According to the latest archived version (11 Aug) of codfiles.com by archive.org, these were the statistics on their webpage:

Site Statistics
Files: 5862
Archive Size: 71.85 GB

Should be easy

[Tally]

Thanks, I'll look into it.

Also, about the total filesize, I wouldn't worry too much. According to the latest archived version (11 Aug) of codfiles.com by archive.org, these were the statistics on their webpage:

Site Statistics
Files: 5862
Archive Size: 71.85 GB

Should be easy

LOL that is so wrong. I was a staff member of Filefront for over 8 years, working on adding/removing COD mod files, and I can tell you now, the cache size of CODFiles is nearer 5 Tb of data. It's one of the reasons the site broke - the database was just too big. And so it wouldn't parse properly.

[CaptainSlow]

LOL that is so wrong. I was a staff member of Filefront for over 8 years, working on adding/removing COD mod files, and I can tell you now, the cache size of CODFiles is nearer 5 Tb of data. It's one of the reasons the site broke - the database was just too big. And so it wouldn't parse properly.

Oh lol didn't know. 5TB should still fit on my NAS though.

[IzNoGoD]

Well, initial indexing of the filefront cod2 files shows approx 1600 files. Assuming the same average size-per-file as the archive.org reported, that should come to around 25gb.

Havent checked cod1/4/5/6/7/8/9/10/11 etc

[Tally]

Well, initial indexing of the filefront cod2 files shows approx 1600 files. Assuming the same average size-per-file as the archive.org reported, that should come to around 25gb.

Havent checked cod1/4/5/6/7/8/9/10/11 etc

Yeah, but whatever you do - don't believe a word I say, because I just make it up as I go along.

I'm done here.

[IzNoGoD]

Yeah, but whatever you do - don't believe a word I say, because I just make it up as I go along.

I'm done here.

Just telling you what i see. codfiles might have contained a lot more (or redundant copies of everything infinite times over - i dont know), but the initial fetch of the filefront cod2 files shows 1648 files present in that category.