PDA

View Full Version : CODfiles (Filefront) Closes



Tally
23rd September 2015, 11:57
CODfiles (Filefront) has officially closed as of 21st September. The site was a good resource for older mods for the Call of Duty series, going right back to 2003. I saw some of my old mods in there for COD1 and UO, dating from 2004.

Thus ends another era.

php
23rd September 2015, 14:51
Another one bites the dust.
Noo where will I get my patch files now when I reinstalled my OS again.

Mitch
23rd September 2015, 18:35
Another one bites the dust.
Noo where will I get my patch files now when I reinstalled my OS again.

You can still download some files that were added to GamersHell.com.

http://www.gamershell.com/pc/call_of_duty_4_modern_warfare/
http://www.gamershell.com/pc/call_of_duty_2/
http://www.gamershell.com/pc/call_of_duty/

CaptainSlow
24th September 2015, 01:27
So sad.


You can still download some files that were added to GamersHell.com.

http://www.gamershell.com/pc/call_of_duty_4_modern_warfare/
http://www.gamershell.com/pc/call_of_duty_2/
http://www.gamershell.com/pc/call_of_duty/

Maybe I need to scrape all those files and put them on my FTP in case they go down as well. Space is not an issue

php
24th September 2015, 08:50
So sad.



Maybe I need to scrape all those files and put them on my FTP in case they go down as well. Space is not an issue

Was thinking the same thing, also for the tutorial(s) which I'm afraid of will vanish eventually when all sites atm go down.

Tally
24th September 2015, 09:00
The thing is, whatever you put on your FTP site, it has to be there for years and years. I have old links to FTP sites that once hosted the patches, but they have been dead for many, many years.

Ni3ls
24th September 2015, 11:53
Yeah if you can host the tutorials?

kung foo man
24th September 2015, 13:04
As long we make us dependent on centralized servers/services, we will always be vulnerable to single point of failures.

Solution might be something out of this: https://www.google.com/search?q=bittorrent+decentralized+backup

So everybody could join the "backup network" and as soon somebody adds a file, the others will backup/sync it too.

Though that might introduce some problems:
- collecting files
- sync scripts
- managing of illegal files
- malicious backup providers in general
- collecting of backup ip:port's
- categorizing of data to give a nice user interface for normal users

Maybe the only thing needed at first is some trust and 2-3 ppl who sync each other with some simple rsync script and http-dir-listing for users. When somebody kills his root coz > reasons, it's no big deal.

Would be nice if Filefront would rsync the CoD files to one of our servers... but I guess that won't happen.

Mitch
24th September 2015, 17:13
As long we make us dependent on centralized servers/services, we will always be vulnerable to single point of failures.

Solution might be something out of this: https://www.google.com/search?q=bittorrent+decentralized+backup

So everybody could join the "backup network" and as soon somebody adds a file, the others will backup/sync it too.
Maybe the only thing needed at first is some trust and 2-3 ppl who sync each other with some simple rsync script and http-dir-listing for users. When somebody kills his root coz > reasons, it's no big deal.


Maybe a shared folder on Dropbox or related services?


Would be nice if Filefront would rsync the CoD files to one of our servers... but I guess that won't happen.
It couldn't hurt to ask. But i don't think i have enough free space for that on my VPS. Maybe on my own drives.

I don't think file front closed entirely they just stopped their front end sites and moved them all to gamefront.

See: http://www.gamefront.com/files/listing/pub2/Call_of_Duty_2/

Edit: http://forums.filefront.com/announcements/459284-network-sites-now-permanently-offline.html

CaptainSlow
25th September 2015, 00:52
The thing is, whatever you put on your FTP site, it has to be there for years and years. I have old links to FTP sites that once hosted the patches, but they have been dead for many, many years.

True, very true and I do realize that. A big plus is that the server I use as file mirror, is also my own personal storage server for documents and pictures. This way I won't let it go down that quickly, else I lose my own personal data as well ;)


As long we make us dependent on centralized servers/services, we will always be vulnerable to single point of failures.

Solution might be something out of this: https://www.google.com/search?q=bittorrent+decentralized+backup

So everybody could join the "backup network" and as soon somebody adds a file, the others will backup/sync it too.

Though that might introduce some problems:
- collecting files
- sync scripts
- managing of illegal files
- malicious backup providers in general
- collecting of backup ip:port's
- categorizing of data to give a nice user interface for normal users

Maybe the only thing needed at first is some trust and 2-3 ppl who sync each other with some simple rsync script and http-dir-listing for users. When somebody kills his root coz > reasons, it's no big deal.

Would be nice if Filefront would rsync the CoD files to one of our servers... but I guess that won't happen.

The solution you pose is indeed robust but also comes with some drawbacks, some of which are easier to overcome than others. For some problems in your list I have a solution in mind, for others I do not have a quick solution at hand.
Bittorrent Sync might be an option to sync between backup hosts, as an easy alternative to rsync. Drawback is that it's still beta software in my opinion. I've been using Bittorrent Sync for about a year now to sync my files between my computers and my server. Often files remain locked for no reason and won't be synced which is really annoying. Also, it uses a lot of RAM.
That still leaves us with the other issues on your list, for example a directory listing. In order to know which files can be downloaded and be able to download the files, you first must download and install BTSync and get access to the folder using the secret key. Of course I could install BTSync and have it sync into a IIS inetpub folder with directory listing enabled, but it ain't pretty.


Maybe a shared folder on Dropbox or related services?


It couldn't hurt to ask. But i don't think i have enough free space for that on my VPS. Maybe on my own drives.

I don't think file front closed entirely they just stopped their front end sites and moved them all to gamefront.

See: http://www.gamefront.com/files/listing/pub2/Call_of_Duty_2/

Edit: http://forums.filefront.com/announcements/459284-network-sites-now-permanently-offline.html

MEGA is a Dropbox alternative/clone and gives 50GB of free storage, the most you can get for free at any cloud sharing service. Another option is to buy Office365 for a year, you'll get 1TB of OneDrive for free. Both still have the same issue when it comes to indexing.

Anyway, currently I have 6.18TB (that's 6180GB) free on my server. I think that should suffice for now.
http://i.imgur.com/KL29TSc.png
Background info: 2 years ago I bought a Synology RS814+ with 4x3TB in RAID10 and co-located it in a datacenter. It's connected using 1Gbps and I have a bandwidth allowance of 5TB (5000GB) every month.I got rid of all cloud services and use it as my personal file storage server. Using BTSync I sync my files. Additionally it automatically downloads my favorite TV shows etc. It's pretty much overkill but hey, never can have enough space!

Let me know if you guys are interested, maybe we can work something out.

CaptainSlow
1st October 2015, 00:41
I had another look at this and I don't see an easy way of scraping either gamershell or gamefront. Both use an unique key which is generated for each download request, making automatic scraping impossible as far as I can see :(

kung foo man
1st October 2015, 04:19
IzNoGoD just had some problem some days ago, he wanted e.g. to download: http://www.gamefront.com/files/5125790

You do the initial http request:



printf "GET /files/5125790 HTTP/1.0\r\nHost: www.gamefront.com\r\n\r\n" | netcat gamefront.com 80 > 1.txt


Check 1.txt, you gotta rip two lines:



Set-Cookie: PHPSESSID=1mcbhc3hv5h4iid1rddfr7vqk6; path=/
<a href="http://www.gamefront.com/files/service/thankyou?id=5125790" class="downloadNow premium-content" id="downloadLink">


Second request will use this data:



printf "GET /files/service/thankyou?id=5125790 HTTP/1.0\r\nHost: www.gamefront.com\r\nCookie: PHPSESSID=1mcbhc3hv5h4iid1rddfr7vqk6\r\n\r\n" | netcat gamefront.com 80 > 2.txt


Check 2.txt, you gotta rip this:



var downloadUrl = 'http://media1.gamefront.com/pub2/Call_of_Duty_2/Official_Patches/v13/CallofDuty2Patchv1_3.exe?b17f4b620c6cf1393ffa644f1 0eea151c975f3a1042cbd46c310d68acbb5e5807a00095c2e3 0b1cb0c60fa18dc133ad4f7284fffc0c0ac5c176306165711e d57a1f1c14a5ba52be7c140b96bd330899e88548e2ad06cffb 08c39eacc6099c1645c43ab564e08f60dcf20027ac61c264fb 1df6e4510e4ff7a9dfbd6fc381ea077a55203a8dda6aba141b 1&ext=.exe';


And just download it:



wget http://media1.gamefront.com/pub2/Call_of_Duty_2/Official_Patches/v13/CallofDuty2Patchv1_3.exe?b17f4b620c6cf1393ffa644f1 0eea151c975f3a1042cbd46c310d68acbb5e5807a00095c2e3 0b1cb0c60fa18dc133ad4f7284fffc0c0ac5c176306165711e d57a1f1c14a5ba52be7c140b96bd330899e88548e2ad06cffb 08c39eacc6099c1645c43ab564e08f60dcf20027ac61c264fb 1df6e4510e4ff7a9dfbd6fc381ea077a55203a8dda6aba141b 1&ext=.exe > CallofDuty2Patchv1_3.exe

Would probably be nice just to reconstruct the file structure based on "Call_of_Duty_2/Official_Patches/v13/CallofDuty2Patchv1_3.exe" in final dl link.

CaptainSlow
1st October 2015, 20:39
Thanks, I'll look into it.

Also, about the total filesize, I wouldn't worry too much. According to the latest archived version (11 Aug) of codfiles.com by archive.org, these were the statistics on their webpage:

Site Statistics
Files: 5862
Archive Size: 71.85 GB

Should be easy ;)

Tally
1st October 2015, 21:04
Thanks, I'll look into it.

Also, about the total filesize, I wouldn't worry too much. According to the latest archived version (11 Aug) of codfiles.com by archive.org, these were the statistics on their webpage:

Site Statistics
Files: 5862
Archive Size: 71.85 GB

Should be easy ;)

LOL that is so wrong. I was a staff member of Filefront for over 8 years, working on adding/removing COD mod files, and I can tell you now, the cache size of CODFiles is nearer 5 Tb of data. It's one of the reasons the site broke - the database was just too big. And so it wouldn't parse properly.

CaptainSlow
1st October 2015, 21:33
LOL that is so wrong. I was a staff member of Filefront for over 8 years, working on adding/removing COD mod files, and I can tell you now, the cache size of CODFiles is nearer 5 Tb of data. It's one of the reasons the site broke - the database was just too big. And so it wouldn't parse properly.

Oh lol didn't know. 5TB should still fit on my NAS though.

IzNoGoD
1st October 2015, 22:04
Well, initial indexing of the filefront cod2 files shows approx 1600 files. Assuming the same average size-per-file as the archive.org reported, that should come to around 25gb.

Havent checked cod1/4/5/6/7/8/9/10/11 etc

Tally
1st October 2015, 22:06
Well, initial indexing of the filefront cod2 files shows approx 1600 files. Assuming the same average size-per-file as the archive.org reported, that should come to around 25gb.

Havent checked cod1/4/5/6/7/8/9/10/11 etc

Yeah, but whatever you do - don't believe a word I say, because I just make it up as I go along.

I'm done here.

IzNoGoD
2nd October 2015, 00:24
Yeah, but whatever you do - don't believe a word I say, because I just make it up as I go along.

I'm done here.
Just telling you what i see. codfiles might have contained a lot more (or redundant copies of everything infinite times over - i dont know), but the initial fetch of the filefront cod2 files shows 1648 files present in that category.