WadCheck by ketmar - use BEFORE uploading to idgames! (detect duplicate lumps from iwads)

[Doomkid]

4 minutes ago, Doomkid said:

I really should have made a thread about this ages ago but there's always so much to do and so little time!

 

https://doomshack.org/~doomkid/Utilities/wadcheck_gui.zip

 

You can use this to create a database of your Doom.wad, Doom2.wad and final Doom wads, then you can check your PWAD against your generated database. It will easily spit out a list of duplicates that it finds, which you can save as a text, then just slightly modify every resource it detects. Very simple way to make sure your wad is idgames ready!

Edited October 28, 2020 by Doomkid

[URROVA]

Ok so... how i use it

I tried opening it directly, dropping a pwad, an iwad, etc. It simply opens and closes.

[SilverMiner]

3 minutes ago, URROVA said:

Ok so... how i use it

I tried opening it directly, dropping a pwad, an iwad, etc. It simply opens and closes.

Maybe you should run it with cmd.exe?

EDIT:

It really doesn't work at least for me (I'm on W7 64 bit)

Edited October 28, 2020 by SilverMiner

[Doomkid]

This is a Windows program, are you in Windows? Does it just close the instant you open it? Tested on Windows 7 64 bit and it works fine but haven't tested on my Win 10 pc yet..

[URROVA]

Yes, im on Win10 x64, really does nothing. I tried running on cmd, and on git bash, and it doesnt show a gui, or a text message or nothing :/

[Doomkid]

Hey @ketmar, I know I haven't spoken to you about this util in ages... but looks like we have some bug reports coming in :)

 

Very strange to hear it isn't working, not sure what could be wrong. Hopefully ketmar might have some suggestions when he sees this. I think the concept behind this tool is really important, since I know so many people get their files rejected from idgames for using unmodified resources.

[URROVA]

Offtopic qstion: the Doom 1 textures for Doom 2 texture pack on realm667 counts as unmodified ID resources? If yes i have to replace various textures from my wip mod :/

[Doomkid]

Yep, you'll have to modify them since they use the same patches.

 

Also just for future reference, DOOM1-2.WAD is the best "Doom 1 textures for Doom 2" wad, since it doesn't contain any flats or modifications, and doesn't crash older ports: https://doomshack.org/uploads/DOOM1-2.WAD

[mxrgan]

Looks pretty damn useful. I dont think I need it right now, but im downloading it just in case.

[JadingTsunami]

I created a small program to do this too.

 

It is written in python (so, cross-platform) and will detect duplicated IWAD lumps from across common Doom-engine games (Doom, Strife, Heretic, Hexen, etc.). You do not need to supply any IWADs.

 

Is there interest in this? If someone would be willing to test it out and finds it useful, I could probably add a small GUI to make it easier to use. Right now it only works from a shell or command prompt.

 

(edit)

Here is an example of what it does:

python wadtest.py test.wad
Found IWAD duplicated lump: D_ADRIAN is a duplicate of D_THE_DA from tnt (size: 00004309)
Found IWAD duplicated lump: D_MESSG2 is a duplicate of D_COUNTD from tnt (size: 00021848)

 

Edited October 29, 2020 by JadingTsunami

[Doomkid]

I personally would get plenty of use out of such a thing, Jading. Like with Slade and XWE, or Doom Builder and Eureka, or so many other examples, having different options for tools that do essentially the same thing is always a good idea, in my book.

[Buckshot]

So it is technically a thin provisioning via deduplication optimizer?

 

[URROVA]

7 hours ago, JadingTsunami said:

I created a small program to do this too.

 

It is written in python (so, cross-platform) and will detect duplicated IWAD lumps from across common Doom-engine games (Doom, Strife, Heretic, Hexen, etc.). You do not need to supply any IWADs.

 

Is there interest in this? If someone would be willing to test it out and finds it useful, I could probably add a small GUI to make it easier to use. Right now it only works from a shell or command prompt.

 

(edit)

Here is an example of what it does:

python wadtest.py test.wad
Found IWAD duplicated lump: D_ADRIAN is a duplicate of D_THE_DA from tnt (size: 00004309)
Found IWAD duplicated lump: D_MESSG2 is a duplicate of D_COUNTD from tnt (size: 00021848)

 

I have python (3) so i can run it :)

If you can publish it will be good

[JadingTsunami]

Thanks. Since there is interest I will try to work on cleaning it up so it can be published.

 

I'll post another thread when I have something. It may be a little while since I have other projects I'm working on too.

[ketmar]

On 10/28/2020 at 4:43 PM, URROVA said:

Yes, im on Win10 x64, really does nothing. I tried running on cmd, and on git bash, and it doesnt show a gui, or a text message or nothing

can't it be blocked by your av?

 

On 10/28/2020 at 4:47 PM, Doomkid said:

Hopefully ketmar might have some suggestions when he sees this.

sadly, i haven't the slightest idea. the thing does absolutely nothing "smart", it is a straightforward winapi app (as can be seen in the source, which is in k8vavoom repo). the only thing i can blame (except some hidden bug i cannot see with Wine) is some antivirus -- they're so special these days that they can be triggered by almost anything.

Edited November 1, 2020 by ketmar

[ketmar]

ah, and please, make sure that it is started from some folder it can write into. preferably without spaces and non-ascii chars (they should be fine, but it's better to play safe here). it still should start and show it's window even if something is very wrong, tho, but it won't hurt to make its life slightly easier. ;-)

Edited November 1, 2020 by ketmar

[smeghammer]

@Doomkid, that tool seems to run fine. I have Avast AV, and it checked OK the exe no problems. On Windows 10 you will need to confirm running the file and also ensure the database gets created first (it falls over if you try to analyse a WAD with no database file present) Any chance a pre-built, empty DB could be included with this? 

[Doomkid]

Good idea - I'll generate a database and put it in the zip shortly.

[ketmar]

On 11/2/2020 at 6:06 PM, smeghammer said:

it falls over if you try to analyse a WAD with no database file present

sure, that's the idea -- you can build database over any set of wads, and even have different databases for different checks.

 

but i guess that most people will use it to check against IWADs, so yeah, including prebuilt db for iwads looks like a good idea.

Edited November 4, 2020 by ketmar