Page 1 of 2
M1 Mac Excessive Memory usage on Batch Convert
Posted: Thu Oct 28, 2021 7:42 pm
by John_Matthews
Upon performing a Batch Convert of some 500 images, I noticed excessive usage of memory. If I convert too many images, I eventually get a message asking to force quit an app to create more memory. Below is an screenshot of the memory usage:
Re: M1 Mac Excessive Memory usage on Batch Convert
Posted: Thu Oct 28, 2021 7:44 pm
by John_Matthews
I should have added that it ended up using 34GB of memory and the ONLY way to lower the memory usage was to quit the app.
Re: M1 Mac Excessive Memory usage on Batch Convert
Posted: Fri Oct 29, 2021 5:29 am
by xnview
which formats in input and output?
Re: M1 Mac Excessive Memory usage on Batch Convert
Posted: Fri Oct 29, 2021 7:22 am
by John_Matthews
There were multiple formats: ORF, RW2, jpg
Outputs were all jpg
Xnview was successful, just with a limited number of batch converts and I had to quit to liberate that memory.
I'm fairly confident you can recreate this on any M1 mac running Big Sur.
Re: M1 Mac Excessive Memory usage on Batch Convert
Posted: Mon Nov 01, 2021 10:41 am
by xnview
I can't reproduce, do you use multi core? If you convert jpg into jpg, same problem?
Re: M1 Mac Excessive Memory usage on Batch Convert
Posted: Mon Nov 01, 2021 1:25 pm
by John_Matthews
Hello Pierre,
I think this happens only with RAW files. I tried with only jpg and was unable to reproduce it (multicore selected).
Here are my exact settings for the RAW export:
Re: M1 Mac Excessive Memory usage on Batch Convert
Posted: Mon Nov 01, 2021 1:54 pm
by John_Matthews
I just retested with multicore unselected and batch convert exhibited the same behavior. My thought is that somehow the loop is not clearing memory after each save. The end result is a memory creep that never clears unless xnview is closed. After converting enough files, OSX will prompt "Force quit" to free up resources. This is what happened to me after converting about 1000 raw files.
Another behavior questionable behavior is that when you manipulated images in the "Actions" tab, there's also a memory creep problem, slowly taking up more and more memory after about 20 minutes of manipulating raw files. Perhaps, it's related?
Attached is a screen shot result of having only 1 core doing the work. I stopped the processing after about 20 minutes. Even after stopping it, Activity Monitor is show xnview taking considerable memory and never releasing it.

Re: M1 Mac Excessive Memory usage on Batch Convert
Posted: Mon Nov 01, 2021 2:05 pm
by xnview
John_Matthews wrote: Mon Nov 01, 2021 1:54 pm
I just retested with multicore unselected and batch convert exhibited the same behavior. My thought is that somehow the loop is not clearing memory after each save. The end result is a memory creep that never clears unless xnview is closed. After converting enough files, OSX will prompt "Force quit" to free up resources. This is what happened to me after converting about 1000 raw files.
Is it possible to send me a raw file?
Re: M1 Mac Excessive Memory usage on Batch Convert
Posted: Mon Nov 01, 2021 2:31 pm
by John_Matthews
Well, I have thousands of RAW files... which one? I really don't think it's a specific type of RAW file.
Anyway, here's a link to some RAW ORF files on dpreview:
https://www.dpreview.com/sample-galleri ... e-gallery/
Look on the right-hand side and you'll see a way to download the RAW image of the selected image.
Re: M1 Mac Excessive Memory usage on Batch Convert
Posted: Mon Nov 01, 2021 2:48 pm
by xnview
is it the 1.94 version?
and what do you have in 'load format settings' > RAW?
Re: M1 Mac Excessive Memory usage on Batch Convert
Posted: Mon Nov 01, 2021 3:26 pm
by John_Matthews
I have:
XnView MP MacOSX
Version 0.99.1 64bits (Sep 23 2021)
Libformat version 7.95
I could not find "Load format settings".
Re: M1 Mac Excessive Memory usage on Batch Convert
Posted: Mon Nov 01, 2021 3:28 pm
by xnview
John_Matthews wrote: Mon Nov 01, 2021 3:26 pm
I could not find "Load format settings".
So it's in Settings>Formats
Re: M1 Mac Excessive Memory usage on Batch Convert
Posted: Mon Nov 01, 2021 3:38 pm
by John_Matthews
Here are my setting > Formats:
Re: M1 Mac Excessive Memory usage on Batch Convert
Posted: Tue Nov 02, 2021 3:28 pm
by xnview
i can't reproduce, are you able to reproduce with ORF (from link)? With 50 of your RAWs?
Re: M1 Mac Excessive Memory usage on Batch Convert
Posted: Tue Nov 02, 2021 3:45 pm
by John_Matthews
I don't think it'll make much of a difference if I use the ORF files from the link or ORF files from my drive. The problem isn't really visible with 50 ORF files. It's more like 500 ORF files. Memory management is different on M1 machines. Are you using a M1 mac? Maybe that's it.
I can make a screen cast of the problem but first I might do a reinstall of xnview... making sure it's vanilla as possible. I want this to work. I'm certain I can't be the only one have this problem. What could it be on my machine with ONLY this app?