Out of memory when recursive viewing 20.000+ videos

Ask for help and post your question on how to use XnView MP.

Moderators: XnTriq, helmut, xnview

User avatar
XnTriq
Moderator & Librarian
Posts: 6336
Joined: Sun Sep 25, 2005 3:00 am
Location: Ref Desk

Re: Out of memory when recursive viewing 20.000+ videos

Post by XnTriq »

jadO wrote:
xnview wrote:it's only for create catalog in settings
I don't understand what you are trying to say.
I had been wondering if the fixed leaks were also causing the OOM issues reported by you, jadO.
Thanks for clarifying, Pierre.
User avatar
xnview
Author of XnView
Posts: 43441
Joined: Mon Oct 13, 2003 7:31 am
Location: France
Contact:

Re: Out of memory when recursive viewing 20.000+ videos

Post by xnview »

jadO wrote:I don't understand what you are trying to say.
The problem fixed is when you 'add folder' in catalog setting
Pierre.
jadO
Posts: 490
Joined: Wed Apr 29, 2015 6:36 am

Re: Out of memory when recursive viewing 20.000+ videos

Post by jadO »

This seems to be still an issue. It seems that memory consumption is growing more slowly now, but still it keeps growing and growing and growing.

Edit: It is now using appr. 1GB. But stays at that for some time now. Has that issue been fixed?

Edit 2: It remained at about 1GB for a while but started to grow again after some time causing XnviewMP to crash.
jadO
Posts: 490
Joined: Wed Apr 29, 2015 6:36 am

Re: Out of memory when recursive viewing 20.000+ videos

Post by jadO »

Still memory leaking.
User avatar
xnview
Author of XnView
Posts: 43441
Joined: Mon Oct 13, 2003 7:31 am
Location: France
Contact:

Re: Out of memory when recursive viewing 20.000+ videos

Post by xnview »

jadO wrote:Still memory leaking.
how do you have this memory leak? do you use internal codec or ffmpeg?
Pierre.
jadO
Posts: 490
Joined: Wed Apr 29, 2015 6:36 am

Re: Out of memory when recursive viewing 20.000+ videos

Post by jadO »

xnview wrote:
jadO wrote:Still memory leaking.
how do you have this memory leak? do you use internal codec or ffmpeg?
Ffmpeg.
User avatar
xnview
Author of XnView
Posts: 43441
Joined: Mon Oct 13, 2003 7:31 am
Location: France
Contact:

Re: Out of memory when recursive viewing 20.000+ videos

Post by xnview »

jadO wrote:
xnview wrote:
jadO wrote:Still memory leaking.
how do you have this memory leak? do you use internal codec or ffmpeg?
Ffmpeg.
but which function do you use?
Pierre.
jadO
Posts: 490
Joined: Wed Apr 29, 2015 6:36 am

Re: Out of memory when recursive viewing 20.000+ videos

Post by jadO »

xnview wrote:
jadO wrote:
xnview wrote: how do you have this memory leak? do you use internal codec or ffmpeg?
Ffmpeg.
but which function do you use?
Browser view with setting thumbnailing for entire folder.
jadO
Posts: 490
Joined: Wed Apr 29, 2015 6:36 am

Re: Out of memory when recursive viewing 20.000+ videos

Post by jadO »

Just in case you don't remember: The problem is, that XnviewMP tries to load every file into memory to create thumbnails.
This attempt must fail as XnviewMP has no idea how many files exist and keeps loading and loading until it runs of memory and crashes.
When I use browser view and scroll through the files, XnviewMP creates thumbnails one after another without running out of memory.
So to create thumbnails for whole folder, XnviewMP has to simulate that process: Load files into memory but release them after thumbnail has been created to load new files.

Edit: In fact thumbnailing should be a lightweight background process.
jadO
Posts: 490
Joined: Wed Apr 29, 2015 6:36 am

Re: Out of memory when recursive viewing 20.000+ videos

Post by jadO »

jadO wrote:Just in case you don't remember: The problem is, that XnviewMP tries to load every file into memory to create thumbnails.
This attempt must fail as XnviewMP has no idea how many files exist and keeps loading and loading until it runs of memory and crashes.
When I use browser view and scroll through the files, XnviewMP creates thumbnails one after another without running out of memory.
So to create thumbnails for whole folder, XnviewMP has to simulate that process: Load files into memory but release them after thumbnail has been created to load new files.

Edit: In fact thumbnailing should be a lightweight background process.

Any news on this?
User avatar
xnview
Author of XnView
Posts: 43441
Joined: Mon Oct 13, 2003 7:31 am
Location: France
Contact:

Re: Out of memory when recursive viewing 20.000+ videos

Post by xnview »

jadO wrote:Just in case you don't remember: The problem is, that XnviewMP tries to load every file into memory to create thumbnails.
This attempt must fail as XnviewMP has no idea how many files exist and keeps loading and loading until it runs of memory and crashes.
When I use browser view and scroll through the files, XnviewMP creates thumbnails one after another without running out of memory.
So to create thumbnails for whole folder, XnviewMP has to simulate that process: Load files into memory but release them after thumbnail has been created to load new files.
It's not a memory leak like previous problem, only that all thumbnails take all memory because currently they are ALL in memory...
Pierre.
jadO
Posts: 490
Joined: Wed Apr 29, 2015 6:36 am

Re: Out of memory when recursive viewing 20.000+ videos

Post by jadO »

xnview wrote:It's not a memory leak like previous problem, only that all thumbnails take all memory because currently they are ALL in memory...
So it is a memory leak by design? How can this be changed? I mean first of all I don't see any sense in loading all files/thumbnails into memore. This MUST result in memory issues. Also a good design for thumbnailing whole folder would be a background process with low cpu and memory footprint so that XnviewMP still can be used at the same time.
Post Reply