Page 3 of 4
Re: Out of memory when recursive viewing 20.000+ videos
Posted: Tue Nov 08, 2016 8:52 am
by xnview
jadO wrote:
yes it's normal if you have 'create for whole folder'
Why is this normal? I don't see a reason for loading all thumbnails until everything crashes.
But please explain me why you can't disabled 'create for whole folder' setting?
Edit: Also my findings showed, that simple scrolling through a large number of thumbnails increases the memory dramatically. Memory management seems to be absent.
There should be strict memory control. I only see 2 reasons to load a thumbnail: When it gets displayed or processed. When it does not get displayed anymore its memory should get freed and after it has been processed it should free its memory too.
On old computer, this can be slow, but this can be an enhancement when 'create for whole folder' setting is OFF
Re: Out of memory when recursive viewing 20.000+ videos
Posted: Fri Nov 11, 2016 9:02 am
by jadO
It seems like the only working solution is as follows:
1. Open folder
2. Eventually select recursive folder option
3. Select all files
4. Select rebuilt thumbnails from the menu
This seems to go through all files, creates thumbnails for them and keeps a low memory footprint about 300 mb in my case.
Basically this is what I would have expected from the 'create for whole folder' setting.
I still don't see a point in loading as many thumbnails to crash XnView MP.
Re: Out of memory when recursive viewing 20.000+ videos
Posted: Fri Nov 11, 2016 12:38 pm
by xnview
jadO wrote:
4. Select rebuilt thumbnails from the menu
This seems to go through all files, creates thumbnails for them and keeps a low memory footprint about 300 mb in my case.
'create for whole folder' is OFF?
Re: Out of memory when recursive viewing 20.000+ videos
Posted: Fri Nov 11, 2016 1:52 pm
by jadO
xnview wrote:'create for whole folder' is OFF?
Yes, but I don't know if the result is what I want.
I had it running now for a couple of hours and it seemed like it was creating thumgbnails for each files. But now when I scrolled through them I see a lot of maybe most of them not being created.
I don't know what this thing is doing.
Re: Out of memory when recursive viewing 20.000+ videos
Posted: Mon Nov 14, 2016 9:17 pm
by Kaminari
helmut wrote:I don't know anyone except you who has 20.000 or more video files on his computer. So I still don't see that this is a standard use case. What's is your use case to scroll through 20.000 or more videos?
The memory leak problem doesn't only affect video files, but also pictures.
I work with professional photographers and one of my folders contains more than 50.000 files (let me spell that: FIFTY THOUSANDS), not even counting subfolders. That's a pretty much standard use case for my job.
Recursive thumbnail creation litterally kills the OS. On the fly ("on demand") thumbnail creation is slow and for my needs is not an option. Creating thousands of thumbnails in one pass doesn't necessarily mean having to store all of them simultaneously in RAM. Obviously there should be a better way to implement such a feature. Directory Opus can do it without hogging the whole memory.
Re: Out of memory when recursive viewing 20.000+ videos
Posted: Tue Nov 15, 2016 3:26 pm
by xnview
Kaminari wrote:helmut wrote:I don't know anyone except you who has 20.000 or more video files on his computer. So I still don't see that this is a standard use case. What's is your use case to scroll through 20.000 or more videos?
The memory leak problem doesn't only affect video files, but also pictures.
Memory leak or out of memory?
On the fly ("on demand") thumbnail creation is slow and for my needs is not an option.
Even if thumbnails is stored in catalog?
Re: Out of memory when recursive viewing 20.000+ videos
Posted: Wed Nov 30, 2016 9:44 pm
by jadO
Kaminari wrote:The memory leak problem doesn't only affect video files, but also pictures.
I work with professional photographers and one of my folders contains more than 50.000 files (let me spell that: FIFTY THOUSANDS), not even counting subfolders. That's a pretty much standard use case for my job.
Recursive thumbnail creation litterally kills the OS. On the fly ("on demand") thumbnail creation is slow and for my needs is not an option. Creating thousands of thumbnails in one pass doesn't necessarily mean having to store all of them simultaneously in RAM. Obviously there should be a better way to implement such a feature. Directory Opus can do it without hogging the whole memory.
Thank you for your confirmation of this issue.
Re: Out of memory when recursive viewing 20.000+ videos
Posted: Mon Jan 16, 2017 11:45 pm
by XnTriq
Hi jadO. Can you confirm that this is resolved in v0.84?
Re: Out of memory when recursive viewing 20.000+ videos
Posted: Wed Jan 18, 2017 8:46 pm
by jadO
XnTriq wrote:Hi jadO. Can you confirm that this is resolved in v0.84?
No, it is not resolved. Beta 4 shows same problem.
Re: Out of memory when recursive viewing 20.000+ videos
Posted: Wed Jan 18, 2017 8:50 pm
by XnTriq
jadO wrote:XnTriq wrote:No, it is not resolved. Beta 4 shows same problem.

And the
final release, too?
Possibly related:
Re: Out of memory when recursive viewing 20.000+ videos
Posted: Wed Jan 18, 2017 11:05 pm
by jadO
Re: Out of memory when recursive viewing 20.000+ videos
Posted: Wed Jan 18, 2017 11:30 pm
by XnTriq
OK. Thanks for reporting back, jadO.
Re: Out of memory when recursive viewing 20.000+ videos
Posted: Thu Jan 19, 2017 5:48 am
by jadO
XnTriq wrote:
OK. Thanks for reporting back, jadO.
No problem. I hope my answer was clear that the issue persists even in 0.84 RC. The links you have posted seem to address the very same issue.
Re: Out of memory when recursive viewing 20.000+ videos
Posted: Thu Jan 19, 2017 9:39 am
by xnview
it's only for create catalog in settings
Re: Out of memory when recursive viewing 20.000+ videos
Posted: Fri Jan 20, 2017 6:44 pm
by jadO
xnview wrote:
it's only for create catalog in settings
I don't understand what you are trying to say.