SofaUnZip bug report thread

Prophet (2436)

25-10-2015, 15:59

Please post your bug reports for SofaUnZip here. The tool can be downloaded here: Louhtrax MSX game room, a news post should be available soon.

By Manuel

Ascended (19300)

25-10-2015, 16:10

Fantastic So, we have the choice between 2 unzip tools for MSX! Who would have thought?

By Louthrax

Prophet (2436)

25-10-2015, 16:21

Next step (who knows ?), maybe a zipper with directories support for our machines
Not planning to work on it immediately (have to integrate zip support in SofaRun first), but that would be a nice challenge (even with an average compression rate) !

By Prodatron

Paragon (1839)

10-11-2015, 14:39

Quote:

ZIP files containing end of file comments are not supported (you'll get a "bad signature" error).

I am currently wondering how this is implemented in a good way in other software.
IMHO it's a bad design of the ZIP format: You always have to start at the end of the file, but as the length of the comment is flexible and can be up to 65535 chars you have no idea where to find the "End of central directory record" exactly. So in theory you have to search for its signature anywhere within the last 64K of a file - I wonder if most implementations are really doing this. Or maybe I missed something.
I was thinking about just reading the last 512 bytes and do a search for the signature here. I wonder, which tools may/can add end of file comments, and what is the typical maximum size of such a comment.

By Louthrax

Prophet (2436)

10-11-2015, 14:46

Yes, the design of this also looked super inconsistent to me. I think I won't implement it, I have very few memory left for the code in SofaUnZip, and that would also slow down the app startup. Wondering how much ZIP files are commented that way, on the web, or for usual ROM archives. Some other "modern" unzippers also do not support those EOF comments...

By Louthrax

Prophet (2436)

22-08-2016, 13:43

SofaUnZip v1.1 has just been released (I already released it as part of SofaRun but the individual package is now available). You can get it on my website.

Changes since v1.0:

Added decimals for file size display
Faster & non recursive wildcard match function
Reduced memory usage
/B option to set readbuffer size

By gdx

Enlighted (6104)

23-08-2016, 15:14

Manuel wrote:

Fantastic So, we have the choice between 2 unzip tools for MSX! Who would have thought?

GUNZIP? TuNzIp?

GUNZIP uncompress GZIP achives and TuNzIp is very basic.

By Pac

Scribe (6960)

17-01-2017, 10:06

Hi Louthrax, great tool beforehand . Not sure if this has been reported previously, just in case... I've realized that certain ZIP files are not decompressed to the end. The behaviour is always the same, when extracting a ZIP file and during decompression of an specific file, MSX freezes showing 100% and CRC OK. You can check this with SOFARUN.ZIP file itself.

By Louthrax

Prophet (2436)

17-01-2017, 12:30

Hi PAC,

Thanks for reporting that. I have not been able to reproduce that here with the latest versions of SUZ.COM and SOFARUN.ZIP that are on my website now.

But this has to be fixed! Can you give me more details:

Do you launch SUZ.COM using SofaRun or manually (which command are you typing)?
Which MSX-DOS version are you using?
Does the freeze happen on the last file extracted (VHELP.TXT for SOFARUN.ZIP)?

By Pac

Scribe (6960)

18-01-2017, 01:27

Sorry for not giving you more details earlier. Tonight I downloaded again both files from your website just to make sure and the result is the same, MSX froze decompressing GMASTER1.ROM (always the same file inside SOFARUN.ZIP). This is the behaviour I have been experiencing since I started to use SofaUnZIP (very recently) with just a few ZIP files.

But... doing more testings, I finally could extract the file using SofaRun and after that I did it manually (command line) and worked!! Now I can't reproduce the problem, I don't know what to say... The only explanation I have for this is that something happens with my MSX configuration, but it's really weird.

If helps, I launched the program with a MegaFlashROM + SD + 512KB using Nextor 2.0.1.

By Louthrax

Prophet (2436)

18-01-2017, 01:52

Thanks for the details PAC. Darn, I hate this kind of random reproducing bugs!

The main "root of evil" so far with SofaUnzip is the "pre-allocation" step when creating a new file (the hang is not happening at the end of a file extraction, but during the pre-allocation of the next one). This pre-allocation step gives a huge speed-improvement on crowded SD-cards, but this calls MSX-DOS2 in a way that's not commonly used and tested (still respecting the standard though).

One MSX-DOS2 implementation that was not handling that well was IDECDEX, for which I provided a patch on my WebSite.

On Nextor, it looks different: the hang seems (not 100% sure) to be linked to the use of the "stdout" device to print text and the use of MSX-DOS2 "fflush" function required after the pre-allocating step...

Anyway, the latest version of SofaUnzip should have fixed that. My hope here is that maybe you still had an old version of SUZ.COM and that extracting SOFARUN.ZIP did overwrite it with the new version...

Last question: do you have 1 or 2 SD cards in you MegaFlashROM (if yes did you extract to the 2nd one)?