M1 Mac Excessive Memory usage on Batch Convert
Moderators: helmut, XnTriq, xnview, Dreamer
-
- Posts: 14
- Joined: Wed Oct 27, 2021 3:27 am
M1 Mac Excessive Memory usage on Batch Convert
Upon performing a Batch Convert of some 500 images, I noticed excessive usage of memory. If I convert too many images, I eventually get a message asking to force quit an app to create more memory. Below is an screenshot of the memory usage:
Last edited by John_Matthews on Thu Oct 28, 2021 7:44 pm, edited 1 time in total.
-
- Posts: 14
- Joined: Wed Oct 27, 2021 3:27 am
Re: M1 Mac Excessive Memory usage on Batch Convert
I should have added that it ended up using 34GB of memory and the ONLY way to lower the memory usage was to quit the app.
-
- Posts: 14
- Joined: Wed Oct 27, 2021 3:27 am
Re: M1 Mac Excessive Memory usage on Batch Convert
There were multiple formats: ORF, RW2, jpg
Outputs were all jpg
Xnview was successful, just with a limited number of batch converts and I had to quit to liberate that memory.
I'm fairly confident you can recreate this on any M1 mac running Big Sur.
Outputs were all jpg
Xnview was successful, just with a limited number of batch converts and I had to quit to liberate that memory.
I'm fairly confident you can recreate this on any M1 mac running Big Sur.
Re: M1 Mac Excessive Memory usage on Batch Convert
I can't reproduce, do you use multi core? If you convert jpg into jpg, same problem?
Pierre.
-
- Posts: 14
- Joined: Wed Oct 27, 2021 3:27 am
Re: M1 Mac Excessive Memory usage on Batch Convert
Hello Pierre,
I think this happens only with RAW files. I tried with only jpg and was unable to reproduce it (multicore selected).
Here are my exact settings for the RAW export:
I think this happens only with RAW files. I tried with only jpg and was unable to reproduce it (multicore selected).
Here are my exact settings for the RAW export:
-
- Posts: 14
- Joined: Wed Oct 27, 2021 3:27 am
Re: M1 Mac Excessive Memory usage on Batch Convert
I just retested with multicore unselected and batch convert exhibited the same behavior. My thought is that somehow the loop is not clearing memory after each save. The end result is a memory creep that never clears unless xnview is closed. After converting enough files, OSX will prompt "Force quit" to free up resources. This is what happened to me after converting about 1000 raw files.
Another behavior questionable behavior is that when you manipulated images in the "Actions" tab, there's also a memory creep problem, slowly taking up more and more memory after about 20 minutes of manipulating raw files. Perhaps, it's related?
Attached is a screen shot result of having only 1 core doing the work. I stopped the processing after about 20 minutes. Even after stopping it, Activity Monitor is show xnview taking considerable memory and never releasing it.
Another behavior questionable behavior is that when you manipulated images in the "Actions" tab, there's also a memory creep problem, slowly taking up more and more memory after about 20 minutes of manipulating raw files. Perhaps, it's related?
Attached is a screen shot result of having only 1 core doing the work. I stopped the processing after about 20 minutes. Even after stopping it, Activity Monitor is show xnview taking considerable memory and never releasing it.

Re: M1 Mac Excessive Memory usage on Batch Convert
Is it possible to send me a raw file?John_Matthews wrote: Mon Nov 01, 2021 1:54 pm I just retested with multicore unselected and batch convert exhibited the same behavior. My thought is that somehow the loop is not clearing memory after each save. The end result is a memory creep that never clears unless xnview is closed. After converting enough files, OSX will prompt "Force quit" to free up resources. This is what happened to me after converting about 1000 raw files.
Pierre.
-
- Posts: 14
- Joined: Wed Oct 27, 2021 3:27 am
Re: M1 Mac Excessive Memory usage on Batch Convert
Well, I have thousands of RAW files... which one? I really don't think it's a specific type of RAW file.
Anyway, here's a link to some RAW ORF files on dpreview:
https://www.dpreview.com/sample-galleri ... e-gallery/
Look on the right-hand side and you'll see a way to download the RAW image of the selected image.
Anyway, here's a link to some RAW ORF files on dpreview:
https://www.dpreview.com/sample-galleri ... e-gallery/
Look on the right-hand side and you'll see a way to download the RAW image of the selected image.
Re: M1 Mac Excessive Memory usage on Batch Convert
is it the 1.94 version?
and what do you have in 'load format settings' > RAW?
and what do you have in 'load format settings' > RAW?
Pierre.
-
- Posts: 14
- Joined: Wed Oct 27, 2021 3:27 am
Re: M1 Mac Excessive Memory usage on Batch Convert
I have:
XnView MP MacOSX
Version 0.99.1 64bits (Sep 23 2021)
Libformat version 7.95
I could not find "Load format settings".
XnView MP MacOSX
Version 0.99.1 64bits (Sep 23 2021)
Libformat version 7.95
I could not find "Load format settings".
-
- Posts: 14
- Joined: Wed Oct 27, 2021 3:27 am
Re: M1 Mac Excessive Memory usage on Batch Convert
i can't reproduce, are you able to reproduce with ORF (from link)? With 50 of your RAWs?
Pierre.
-
- Posts: 14
- Joined: Wed Oct 27, 2021 3:27 am
Re: M1 Mac Excessive Memory usage on Batch Convert
I don't think it'll make much of a difference if I use the ORF files from the link or ORF files from my drive. The problem isn't really visible with 50 ORF files. It's more like 500 ORF files. Memory management is different on M1 machines. Are you using a M1 mac? Maybe that's it.
I can make a screen cast of the problem but first I might do a reinstall of xnview... making sure it's vanilla as possible. I want this to work. I'm certain I can't be the only one have this problem. What could it be on my machine with ONLY this app?
I can make a screen cast of the problem but first I might do a reinstall of xnview... making sure it's vanilla as possible. I want this to work. I'm certain I can't be the only one have this problem. What could it be on my machine with ONLY this app?