savagegrant Posted March 13, 2018 Have you ever wanted to download the entire /idgames archive (or even just a major section of it) without the hassle of trying to download and verify tens of thousands of files individually with an FTP client? Well, now you can! The /idgames archive currently holds 37187 files, which totals 39.9 gigabytes of data. This includes the /idstuff folder, which does contain 21.5 gigabytes of official idtech2+ engine content. I've stored all of the /idgames archive (except the idtech2+ /idstuff content) in seven self-contained zip files so that you can have the option of only downloading the sections you want... STORED ZIP FILE #1 CONTENTS: /docs /graphics /historic /idstuff (idtech1 only) /incoming /lmps /misc /music /newstuff /prefabs /roguestuff /skins /sounds /source /utils Download link - http://www.mediafire.com/file/5nouju7tt4bj5v8/idgms-s1.zip (2.56 gigabytes) STORED ZIP FILE #2 CONTENTS: /levels/doom /levels/doom2 (except /Ports) /levels/hacx /levels/heretic /levels/hexen /levels/reviews /levels/strife Download link - http://www.mediafire.com/file/jcq34njk6348jx8/idgms-s2.zip (3.06 gigabytes) STORED ZIP FILE #3 CONTENTS: /levels/doom2/Ports/megawads Download link - http://www.mediafire.com/file/t6c82i7k39rne88/idgms-s3.zip (2.53 gigabytes) STORED ZIP FILE #4 CONTENTS: /levels/doom2/Ports/0-9 /levels/doom2/Ports/a-c /levels/doom2/Ports/d-f Download link - http://www.mediafire.com/file/hledbnbl2m6mpux/idgms-s4.zip (2.40 gigabytes) STORED ZIP FILE #5 CONTENTS: /levels/doom2/Ports/g-i /levels/doom2/Ports/j-l /levels/doom2/Ports/m-o /levels/doom2/Ports/p-r Download link - http://www.mediafire.com/file/8bcnzisbr1zb22e/idgms-s5.zip (2.53 gigabytes) STORED ZIP FILE #6 CONTENTS: /deathmatch /levels/doom2/Ports/s-u /levels/doom2/Ports/v-z Download link - http://www.mediafire.com/file/gc7i29lmj3tts11/idgms-s6.zip (2.57 gigabytes) STORED ZIP FILE #7 CONTENTS: /combos /themes Download link - http://www.mediafire.com/file/7y5zozd4m3o6pls/idgms-s7.zip (2.73 gigabytes) I've also stored all the idtech2+ /idstuff content in nine self-contained zip files... IDTECH2+ /IDSTUFF ZIP FILE #1 CONTENTS: /et /hexen2 /macquake /quake /quake2 /quakeworld /unsup /wolf3d Download link - http://www.mediafire.com/file/hrlr0yyxud2r0gx/idstuff1.zip (2.19 gigabytes) IDTECH2+ /IDSTUFF ZIP FILE #2 CONTENTS: /doom3 /quake3 /teamarena Download link - http://www.mediafire.com/file/okfpk85skm2ayp6/idstuff2.zip (2.60 gigabytes) IDTECH2+ /IDSTUFF ZIP FILE #3 CONTENTS: /qeradiant /wolf Download link - http://www.mediafire.com/file/oizv729m45kq4d6/idstuff3.zip (2.36 gigabytes) IDTECH2+ /IDSTUFF ZIP FILE #4 CONTENTS: /etqw (7 files) Download link - http://www.mediafire.com/file/dk13ba0occk2401/idstuff4.zip (2.52 gigabytes) IDTECH2+ /IDSTUFF ZIP FILE #5 CONTENTS: /etqw (7 files) /etqw/old (1 file) Download link - http://www.mediafire.com/file/8nodaakf9lp6s4p/idstuff5.zip (2.38 gigabytes) IDTECH2+ /IDSTUFF ZIP FILE #6 CONTENTS: /etqw/old (17 files) Download link - http://www.mediafire.com/file/0t9lr26u0rm3cwk/idstuff6.zip (2.56 gigabytes) IDTECH2+ /IDSTUFF ZIP FILE #7 CONTENTS: /etqw/old (5 files) /quake4/demo Download link - http://www.mediafire.com/file/e8peqooeb2f4m5w/idstuff7.zip (2.37 gigabytes) IDTECH2+ /IDSTUFF ZIP FILE #8 CONTENTS: /quake4/linux /quake4/source Download link - http://www.mediafire.com/file/9zdpwkfeibay9od/idstuff8.zip (2.51 gigabytes) IDTECH2+ /IDSTUFF ZIP FILE #9 CONTENTS: /quake4/mac /quake4/win32 Download link - http://www.mediafire.com/file/fth6s0sp0zvbln2/idstuff9.zip (2.04 gigabytes) *** Download and extract all 16 zip files to the same folder to have a perfect copy of the /idgames archive *** If you require smaller downloads then about 3.5 gigabytes in total can be saved by downloading the following 7-Zip files instead of the seven stored zip files... Compressed 7-Zip file #1: http://www.mediafire.com/file/01j9qhgsqh9uj0h/idgames1.7z (2.02 gigabytes)Compressed 7-Zip file #2: http://www.mediafire.com/file/qc2jejqp3gd351x/idgames2.7z (2.16 gigabytes)Compressed 7-Zip file #3: http://www.mediafire.com/file/rrsn6ultl5z06a0/idgames3.7z (2.08 gigabytes)Compressed 7-Zip file #4: http://www.mediafire.com/file/twmz47nq463y3ba/idgames4.7z (2.01 gigabytes)Compressed 7-Zip file #5: http://www.mediafire.com/file/ir27ultdsd620wk/idgames5.7z (2.15 gigabytes)Compressed 7-Zip file #6: http://www.mediafire.com/file/lndtcurtryvzo3o/idgames6.7z (2.21 gigabytes)Compressed 7-Zip file #7: http://www.mediafire.com/file/rnb0ov7v66m1cx4/idgames7.7z (2.15 gigabytes) *** The contents lists for these files are the same as the stored zip files *** Stored file pros: Takes less time to extract stored files Extracted stored files will take up less space than the extracted compressed files All of the original /idgames zip files are left untouched Stored file cons: Bigger and slower download Takes up more space than the compressed files WAD and PK3 files may require unzipping before use Compressed file pros: Smaller and quicker download Takes up less space when kept compressed WAD and PK3 files do not require to be unzipped before use Compressed file cons: Takes longer to extract compressed files Uncompressed files will take up more space than the stored files Most of the original /idgames zip files have been extracted *** MediaFire is a reasonably fast host that allows simultaneous and resumable downloads, which means you can double, triple, quadruple, ..., your transfer speed by downloading more than one file at a time, or with the assistance of a download manager, download multiple chunks of a file at the same time *** If anyone knows of other suitable hosts for these files then please let me know and I will mirror the content. 10 Quote Share this post Link to post
fraggle Posted March 13, 2018 This is already on archive.org which is arguably a more appropriate place for it. I don't have a lot of confidence in sites like Mediafire.com to preserve things. However, I uploaded that snapshot back in 2013 so it's probably about time I updated it. 6 Quote Share this post Link to post
savagegrant Posted March 13, 2018 The preservation of the archive is already in good hands, the aim here is to just provide fast, convenient and flexible downloads of it (archive.org's download speeds aren't the best). If the interest is there, I may upload update files periodically to keep the downloads up-to-date and relevant. 0 Quote Share this post Link to post
DoomGater Posted March 13, 2018 Oops, THAT takes me back....I've dl'd a copy, too. But it was back in the 90's and the whole shebang fits on ONE DVD :-)) BTW: are there any estimations about the qualitz, maybe based on Doomworld's ratings? I have the bad feeling, that 80-90% is just digital rubbish.... 1 Quote Share this post Link to post
Jon Posted March 13, 2018 Archive.org provide torrents though, so if there are seeders the speed *can* be good, it depends on the item. 1 Quote Share this post Link to post
Reisal Posted March 13, 2018 Why ZIP format? Why not use 7Z as it has a better compression ratio? 0 Quote Share this post Link to post
Tolwyn Posted March 13, 2018 Because most old people like me might be more comfortable or accustomed to ZIP over 7z, rar, etc. That's why. Not every old fart cares to know or understand or want to download 7z (or WinRar). Sometimes we just want "simple" or "comfortable." C'mon, Glaice, you are like... late 30s, early 40s... You know how this works! (I'm downloading the 7z files, but I'm just making a point). I have a DVD of idgames from 2005 or so. I'll be grabbing this as well, since I now have a 6TB storage array. 2 Quote Share this post Link to post
Tolwyn Posted March 13, 2018 ^^^ the above post is a tongue-in-cheek poke at old people like me. 2 Quote Share this post Link to post
Reisal Posted March 13, 2018 38 minutes ago, Tolwyn said: C'mon, Glaice, you are like... late 30s, early 40s... You know how this works! I'm 35 going on 36 next month :) But yeah, 7-Zip opens up ZIP files as well. I honestly don't get why 7z is a format welcomed on /idgames/, maybe for consistency? 0 Quote Share this post Link to post
Grazza Posted March 13, 2018 (edited) Why fucken' comrpess it at all? Dos every1 have sh1t internet or sommat? Seriously, if you want a local copy of the idgames archive, what's the objection to using an FTP client? Set it to download the lot, and come back later and it's done. Then you can update it any time you want by just asking it to download new or changed files. Simples. Edited March 13, 2018 by Grazza 0 Quote Share this post Link to post
Jon Posted March 13, 2018 7z offers better compression at a far higher time and space cost, both for compressing and decompressing. For the average size of an idgames upload I'm not sure it's worth it. 0 Quote Share this post Link to post
xvertigox Posted March 13, 2018 (edited) 5 hours ago, fraggle said: This is already on archive.org which is arguably a more appropriate place for it. I don't have a lot of confidence in sites like Mediafire.com to preserve things. However, I uploaded that snapshot back in 2013 so it's probably about time I updated it. If you update it I'd be happy to seed the torrent indefinitely. I've got 500Mb upload so should be extremely easy/fast. Edit: Forgot to mention, nice work @savagegrant. The more diversity in mirrors the better. Edited March 13, 2018 by xvertigox 0 Quote Share this post Link to post
fraggle Posted March 13, 2018 2 hours ago, Glaice said: Why ZIP format? Why not use 7Z as it has a better compression ratio? The compression ratio in this case is irrelevant because the contents (a collection of .zip files) are already compressed. 0 Quote Share this post Link to post
Xaser Posted March 13, 2018 I'm all for proper archiving (e.g. archive.org), but I'm not quite sure what the real use case for this one is. As fraggle mentioned, re-zipping a zip isn't going make the result any smaller, and the contents of these mediafire "mirrors" are going to become outdated starting yesterday. 0 Quote Share this post Link to post
Reisal Posted March 14, 2018 I didn't say compressing the archive itself, I meant compressing the original archive file's contents. 0 Quote Share this post Link to post
kb1 Posted March 14, 2018 @savagegrant Well, I happen to appreciate it. Nothing wrong with an easy-to-grab snapshot. I've got to ask for something though - 2 things, actually: Any chance you can zip up all the files for one complete massive download? Honestly that would be the easiest, most convenient method. Mediafire likes to be slightly difficult and rude, and I'd like the whole archive, even if you just zip the (23?) files you linked into one massive zip. Please? Suggestion: I'd suggest always naming such files by including the date you extracted them, like 2018-03-13_idStuff1.zip. It's best to use yyyy-mm-dd date format, and placing that at the beginning of the name. That forces proper sort order by date, then by type. And, it's good because the archive changes each day: Using the date in the name suggests "This is the idStuff1 archive as of 2018-03-13". It also avoids reliance on the file's date/time stamp, which can get changed at times you might not expect. Anyway, there's nothing wrong with having another backup, and some people will find this method to be easier. 2 hours ago, Xaser said: I'm all for proper archiving (e.g. archive.org), but I'm not quite sure what the real use case for this one is. As fraggle mentioned, re-zipping a zip isn't going make the result any smaller, and the contents of these mediafire "mirrors" are going to become outdated starting yesterday. Re-zipping zip files with a better compressor like 7-zip *may* make the archive a little bit smaller. Usually it makes it a little bit bigger :) Glaice's idea would do a lot better - the archive contains a lot of uncompressed content, like text files, which compress really well. But it still ain't gonna be much better - maybe 10% or so. The *real* benefit of compressing everything is that you end up with a single file, which speed up lots of stuff. FTP is great, but downloading a single compressed file and locally decompressing it is *way* faster, almost always. The exception, of course is if you already have most of the archive, and, as Grazza suggests, your FTP program can do differentials and download and update changes. Even just pulling new files based on date is better than nothing, and it would get all new stuff, but miss deleted archive entries. So, maybe for people without any files, the plan is to use the zips to populate local storage, and then set up an FTP client to run every week or so for updates. This is probably the fastest way to start from scratch, making the zip files a very useful resource! Thanks, savagegrant! 0 Quote Share this post Link to post
savagegrant Posted March 14, 2018 4 hours ago, Grazza said: Seriously, if you want a local copy of the idgames archive, what's the objection to using an FTP client? Set it to download the lot, and come back later and it's done. Then you can update it any time you want by just asking it to download new or changed files. Simples. Setting an FTP client to download 37000+ files and having it done completely without errors isn't always that simple. You can always download these 16 zip files, extract the lot and then keep it updated with your FTP client. :P 2 hours ago, Xaser said: I'm all for proper archiving (e.g. archive.org), but I'm not quite sure what the real use case for this one is. As fraggle mentioned, re-zipping a zip isn't going make the result any smaller, and the contents of these mediafire "mirrors" are going to become outdated starting yesterday. The re-zipping is just for the convenience of only needing to download 16 files and not 37000+ files. The files are stored in the zip files, there's no attempt to further compress them. Once you've got the archive, you can then keep it updated with your FTP client. :P 2 hours ago, Glaice said: I didn't say compressing the archive itself, I meant compressing the original archive file's contents. The 7-Zip alternate downloads do exactly that. Most of the archive's zip files were decompressed before being compressed with 7-Zip. I don't feel that the 3.5 gigabytes that are saved are worth no longer getting to keep the archive's original zip files but the download option is there if it's needed. 0 Quote Share this post Link to post
savagegrant Posted March 14, 2018 4 minutes ago, kb1 said: Any chance you can zip up all the files for one complete massive download? Honestly that would be the easiest, most convenient method. Mediafire likes to be slightly difficult and rude, and I'd like the whole archive, even if you just zip the (23?) files you linked into one massive zip. Please? Sure. I can combine the contents of the 16 zip files into one big 39.9 gigabyte zip file if you know of a fast and free host for the file. 0 Quote Share this post Link to post
WadArchive Posted March 14, 2018 10 hours ago, Glaice said: Why ZIP format? Why not use 7Z as it has a better compression ratio? ZIP also has much more support natively 4 hours ago, savagegrant said: Setting an FTP client to download 37000+ files and having it done completely without errors isn't always that simple. You can always download these 16 zip files, extract the lot and then keep it updated with your FTP client. :P I have done it a few times, never an issue. Whatever application you are using to download it all should support retrying/resuming 0 Quote Share this post Link to post
joshthenesnerd Posted March 14, 2018 i think it might be kinda cool to have the entire archive on one's hard drive. except for those 2 parts of the themes section.... you know the two... you know... 2 Quote Share this post Link to post
savagegrant Posted March 14, 2018 3 hours ago, joshthenesnerd said: i think it might be kinda cool to have the entire archive on one's hard drive. except for those 2 parts of the themes section.... you know the two... you know... Yeah. Barney and Star Trek. ;P *giggles* 0 Quote Share this post Link to post
joshthenesnerd Posted March 14, 2018 58 minutes ago, savagegrant said: Yeah. Barney and Star Trek. ;P *giggles* i meant terrys and x-rated. 0 Quote Share this post Link to post
joshthenesnerd Posted March 14, 2018 dude, there's no way i'm putting those 2 parts of the tree on my hard drive lol 0 Quote Share this post Link to post
Dragonfly Posted March 14, 2018 You could just delete them after downloading the archives. "Oh no the computer police found pictures of boobies hidden inside of my WAD files.". Nobody will know the files were there and I highly doubt anyone would care lmao. 1 Quote Share this post Link to post
CDexWard Posted March 14, 2018 Why is this a thing? FTP clients can download entire folders with their subfolders. I grab the entire archive every couple of months, it's just two clicks after connecting to one of the servers with ftp access. Most FTP clients also show you which downloads failed so you can right-click them and retry, which eliminates the risk of corrupted downloads. Downloading the archive and uploading it anywhere is completely unnecessary unless all mirrors are no longer maintained. 0 Quote Share this post Link to post
savagegrant Posted March 14, 2018 Your face is a thing. ;P The only thing that's completely unnecessary is bagging a perfectly legitimate way to download something just because it's not your chosen way. 2 Quote Share this post Link to post
Dragonfly Posted March 14, 2018 38 minutes ago, CDexWard said: Downloading the archive and uploading it anywhere is completely unnecessary unless all mirrors are no longer maintained. Actually you'd want to do this BEFORE all other mirrors became unmaintained / disappear. 0 Quote Share this post Link to post
joshthenesnerd Posted March 14, 2018 2 hours ago, Dragonfly said: Actually you'd want to do this BEFORE all other mirrors became unmaintained / disappear. what would happen if they disappear? where will we put our wads? :O 0 Quote Share this post Link to post
Dragonfly Posted March 14, 2018 That's exactly what I'm saying. Savagegrant's package serves as yet another mirror in case shit hit the fan. 0 Quote Share this post Link to post
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.