Find Similar Files suggestions

Ideas for improvements and requests for new features in XnView Classic

Moderators: XnTriq, xnview

sajman99
Posts: 3
Joined: Thu Dec 17, 2009 6:37 pm

Re: Find Similar Files suggestions

Post by sajman99 » Sun Jan 03, 2010 9:30 pm

Glad to see I'm not the only person confused. XnView's "Find similar files" algorithm is excellent (both its accuracy and speed), and I'm also grateful for this quality freeware. However, I've never been comfortable with the current "reference" terminology regarding similar images.

I hope others who would prefer a more intuitive "Find similar files" GUI will take a moment to post and provide their 2 cents. Happy New Year to all.

User avatar
xnview
Author of XnView
Posts: 33489
Joined: Mon Oct 13, 2003 7:31 am
Location: France
Contact:

Re: Find Similar Files suggestions

Post by xnview » Fri Apr 01, 2011 12:57 pm

Please check here
Pierre.

gapsf
Posts: 4
Joined: Fri Sep 23, 2011 9:50 am

Re: Find Similar Files suggestions

Post by gapsf » Fri Sep 23, 2011 10:24 am

First of all, thanks for the useful image viewer with a clean, customizable and "thin" interface.
I recently used XnView (and try XnViewMP's variant of "Find similar files") to organize and to find similar images on 12 GB set (~20000 files).
I selected the best images from similar with highest resolution and file size.
Based on this experience, I want to share my vision of how to do a search UI for similar images more easier and productive.

"Find similar images" should combine four functions in a convenient way.
1. Setting the search options and search itself.
2. A graphic visualization of search results.
3. A detailed visual comparison of two similar images.
4. Manipulation of the found files.

Non-blocking UI and tabs.
First of all "Find similar images" UI should be non-blocking: search results and
visual comparison of two similar images should be not in modal (blocking) window.
Search results should displayed in separate tab as thumbnails visually identical
to "Browser mode" and with identical customizing options: thumbnails labeling, size, spacing, background color and etc.
The main visual difference between "Browser mode" and "Similar files results mode"
is the presence of a separator between groups of similar images - for example,
a thin horizontal line with extra vertical spacing.
Different browsing, sorting options and actions accessed via pop-up menu to free up space for images.
User can simultaneously have several tabs with differrent modes:
"Similar files results", "Image View", "Browser", "Side-by-side image compare".
And user can switch between them in any moment.
Tab with "Similar files results mode" should have additional panes (with splitters)
to preview two similar files and information about them.
User should be able to manually select pair of similar images to side by side preview on top of the screen.
Left-right side-by-side preview should be selectable so user be able manipulate them with the keyboard (delete for ex.)
My vision of UI is provided as sketch in attachment.

Visual comparison of two similar images.
After XnView find similar pictures, user examines the search results and has two choices:
do something with the some files immediately, or compare two images more closely to make a decision.
To inspect two images more closely user press button or hotkey and side-by-side comparison appears in new non-modal tab
with maximum screen room dedicated for two images.
Tab splitted vertically or horisontally (customizable).
Initially images are displayed centered always, not left-top corners (customizable?).
User should be able to zoom/scroll both images with keyboard and/or mouse
synchronously
where possible (same resolution or maybe even proportional moving when dimensions diffs).
Esc key close side-by-side comparision mode and return user to corresponding "Find similar files" tab.

Sketch of the side-by-side comparision UI , I'll do later.

Hopefully, this will be useful.
Attachments
Find_similar_ui.png
Find_similar_ui.png (96.3 KiB) Viewed 14403 times

User avatar
XnTriq
Moderator & Librarian
Posts: 5575
Joined: Sun Sep 25, 2005 3:00 am
Location: Ref Desk

Re: Find Similar Files suggestions

Post by XnTriq » Mon Nov 28, 2011 11:30 pm

Excellent post, gapsf!

There's only one request I'd like to add: Delta (diff) comparison.

User avatar
JohnFredC
XnThusiast
Posts: 2010
Joined: Wed Mar 17, 2004 8:33 pm
Location: Sarasota Florida

Re: Find Similar Files suggestions

Post by JohnFredC » Tue Nov 29, 2011 5:00 pm

I somehow missed this post earlier and want to very strongly concur with XnTriq.

gapsf's proposal is an excellent way to properly use MP's tabbed interface and continue to move away from the restrictions of modal dialog boxes.
John

User avatar
budz45
XnThusiast
Posts: 1597
Joined: Sun Jun 03, 2007 6:05 pm
Location: UK

Re: Find Similar Files suggestions

Post by budz45 » Fri Dec 02, 2011 4:48 pm

Cool feature this "Search similar files" is. I've been testing it XnView MP with a folder containing icon files.
JohnFredC wrote:MP's tabbed interface and continue to move away from the restrictions of modal dialog boxes.
yes and Yes, an experimental option to open this dialog as a tab just like 'Compare' or 'Batch Convert' in XnView MP :)
All My Topics || my 'MP' Topics
My own Bookmarked topics--->for me only

Vapavite123
Posts: 215
Joined: Sat Jul 02, 2011 7:03 am

Re: Find Similar Files suggestions

Post by Vapavite123 » Fri Dec 02, 2011 8:41 pm

Bonjour, Hello,


English (Google)


Show: http://newsgroup.xnview.com/viewtopic.php?f=60&t=24443

Search similar files

Options: Settings / DB Cache: Tab Thumbnail nothing box. Tab Excluded / Included, excluded all!

The number of step does not seem to correspond to reality when analyzing large file. Indeed, while it indicates that the program is already in the last step 2 / 2, it is in fact only an intermediate phase and then to use the terminal phase of analysis.
For large files which undergo a first analysis of these steps can be very long (which is normal) and the fact that this indication is not correct is misleading (gives the impression that the program running on empty. Slow Bar of progress and return to zero of it for the final step in what was then already indicated 2 / 2!

Other suggestions

- Differentiate one way or the other the first column "Files of reference for comparison." For example, by a vertical line or a different shade of the column!

- In the small drop-down menu, indicate the choice of automatically default sort to open the window and / or backup the selected type of sort.

NB: Delete (the) image (s) in the first column would not be a problem but automatically replace a (of) image (s) (s) designated as similar research makes obsolete as it is presented in basis of a sort order that reflects their location in the files:!:

- Add Full Screen button

- Indicate in the viewing window of found files, the number of files found on the total number of files analyzed (12/2000). The first number corresponding to the first column of thumbnails of files

- Limit the time of analysis

Previously suggested but may be difficult to achieve: Limit analysis of a file from one or more other files!

Example:

A folder: contains 10 new images
File B: contains 1000 images. The contents of this file is known and should not be analyzed by "internal".

I would only know if the images folder have similarities (%) with images contained in the file B!
In other words, I want to compare file A with B without (re) analysis of B is known and whose internal analysis (re) take a long time given its weight.

PS: At the moment the analysis is done for the entire selected folders and files based on name regardless of the folder to which they belong. In the example this would, on one hand, a complete analysis of 1010 images and on the other hand, if the names of files in the 1000 B starts with the letter "a" and 10 files from the B letter "z" above those included in the final analysis.


Voir : http://newsgroup.xnview.com/viewtopic.php?f=60&t=24443

Recherche fichiers similaires

Options : Paramètres/Cache DB : Onglet Vignette rien de cocher. Onglet Exclu/Inclus, tout exclu !

Le nombre d'étape ne semble pas correspondre à la réalité lors de l'analyse de gros dossier. En effet; alors qu'il indique que le programme se trouve déjà dans la dernière étape 2/2, il n'est en fait que dans une phase intermédiaire pour reprendre ensuite la phase terminale d'analyse.
Pour des gros dossiers qui subissent une première analyse ces étapes peuvent être très longues (ce qui est normal) et le fait que cette indication ne soit pas correcte porte à confusion (donne l'impression que le programme tourne à vide. Lenteur de la barre d'état d'avancement et retour à zéro de celle-ci pour l'étape final alors qu’était déjà indiqué 2/2 !

Autres suggestions

- Différencier d’une manière ou l’autre la première colonne « Fichiers de référence pour la comparaison ». Par exemple, par un trait vertical ou une teinte différente de la colonne !

- Dans le petit menu déroulant, indiquer d’office le choix de tri par défaut à l’ouverture de la fenêtre et/ou sauvegarde du type de tri choisis.

NB : Supprimer une (des) image (s) dans la première colonne ne poserait pas de problème mais la remplacer automatiquement par une (des) image (s) désigné (s) comme similaire rend la recherche caduque car celle-ci est présentée sous base d'un ordre de tri qui tient compte de leurs emplacement dans les dossiers :!:

- Ajouter bouton de Plein Ecran

- Indiquer dans la fenêtre de visualisation des fichiers trouvés, le nombre de fichiers trouvés sur le nombre de fichiers total analysé ( 12/2000 ). Le premier nombre correspondant à la première colonne des miniatures des fichiers

- Limiter les temps d’analyses

Déjà suggéré mais peut être difficile à réaliser : Limiter l’analyse d’un dossier par rapport à un ou plusieurs autres dossiers !

Exemple :

Dossier A : contient 10 nouvelles images
Dossier B : contient 1000 images. Le contenu de ce dossier est connu et ne devrait plus être analysé en « interne ».

Je voudrais uniquement savoir si des images du dossier A auraient des similitudes (%) avec des images qui figurent dans le dossier B !
En d’autres termes, je souhaite comparer le dossier A avec B sans pour autant (ré)analyser B qui est connu et dont l’analyse interne (re)prendrait beaucoup de temps vu son poids.

PS : Pour le moment l’analyse se fait pour l'intégralité des dossiers choisis et en fonction du nom des fichiers sans tenir compte du dossier auxquels ils appartiennent. Dans l’exemple cité cela donnerait, d’une part, une analyse complètes des 1010 images et d’autre part, si le nom des 1000 fichiers du dossier B commence par la lettre « a » et les 10 fichiers du dossier B par la lettre « z » ceux ci figureront en fin d’analyse.

gapsf
Posts: 4
Joined: Fri Sep 23, 2011 9:50 am

Re: Find Similar Files suggestions

Post by gapsf » Thu Jan 12, 2012 9:16 am

Hi to all!
I have slightly redesigned the "Find similar files" UI. Here's the result.
All three types of tabs have unified and consistent interface.
They share common controls and layout.
As previously mentioned interface should be non blocking.
After XnView finds similar images, the search results displayed to the user in a separate "Find similar" tab.

1. "Find similar" tab.
find_similar_ui.png
find_similar_ui.png (236.2 KiB) Viewed 14213 times
find_similar_ui_marks.png
find_similar_ui_marks.png (236.37 KiB) Viewed 14213 times
Tab should have its own settings independent from settings of tab of other types.
Pane #2 contains the search results.

Pane #1 allows the user to visually compare two images and their metadata.
And here:
Mouse wheel - zoom both images synchronously.
Left mouse button - move images synchronously.
Right mouse button - call context menu with different, rarely used, actions on left/right image.
Ctrl + mouse wheel - zoom each image independently.
Ctrl + left mouse button - move each image independently.
Double-click opens "Compare images" tab with both images centered on click point with 100% (should be customizable) zoom.
"Deferred actions" - postpones the actual deletion, copying and moving images until user close search tab (see below).
"Compare" button opens "Compare images (side by side)" tab with both images centered with 100% (should be customizable) zoom.
"Overlaid compare" button opens "Overlaid compare " tab with both images centered with 100% (should be customizable) zoom.

"Delta diff" button opens "Delta difference" tab.

Status bar #3 shows the current sorting mode.

Status bar #4 shows the number of found files and the number of groups of similar files.

Pane #14 shows metadata information about compared images. All information (fields) on pane #14 should be customizable by user. It should be possible to set the vertical dividers (useful with monospaced fonts) and various info from file's metadata into one string. File size should be always in the same units (left in KB and right in KB, left in MB and right in MB...) for easy comparison.

Customization of pane #14 may looks like this (explanation below):
{"Filename:",15em,left} | Filename
{"Folder:",15em,left} | Filepath
{"Size:",15em,left} | {Filesize,15em,left} | {"EXIF: ",EXIF.exists,100px,left} | "Date modified: " {EXIF.date_modified}
{"Dimensions:",15em,left} | {Dimensions,15em,left} | {"IPTC: ",IPTC.exists,100px,left} |



2. "Compare images (side by side)" tab.
compare_ui.jpg
compare_ui.jpg (180.21 KiB) Viewed 14213 times
Tab should have its own settings independent from settings of tab of other types.

We get UI of "Compare images (side by side)" tab from "Find similar" simply by removing
the pane #2 and the replacing "Compare" button with "Overlaid compare"
button.
All actions, like panning and zooming, is absolutely identical to a Pane #1 on "Find similar" tab.
In this tab "Deferred actions" applies to operations on the files displayed
on this tab only, but not to all search results.
"Overlaid compare" button opens "Overlaid compare" tab with left image first and
the current position and scale equal to those on the "Compare images" tab.
Pane with metadata should have its own settings independent from "Find similar"'s settings.
Esc - close tab and returns the user back to the calling tab.

3. "Overlaid compare" tab.
Please, download GIF to view animation:

Image

Tab should have its own settings independent from settings of tab of other types.
On this tab the user has the ability to quickly switch between the two compared images,
the position and scale of which is synchronized like in "Compare images" tab.
All actions, like panning and zooming, the image is absolutely identical to a
Pane #1 on "Find similar" tab.
Buttons "Left image" and "Right image" should work like a switch.
Pressing the "Left image" shows the left image and left image metadata.
Pressing the "Right image" shows the right image and right image metadata.
Spacebar could be a image switch on the keyboard.
In this tab "Deferred actions" is the same checkbox as in corresponding "Compare images" tab if tab called from corresponding "Compare images" tab.
If otherwise, the checkbox is independent and option applies only to operations on the files in this tab.
Esc - close tab and returns the user back to the calling tab.

4. Deferred actions.

Image

If a user deletes, moves or copies files while "Deferred actions" option is enabled,
the operation on files is not performed immediately, but deferred until the close
"Find similar" tab.
Postponed actions are "accumulated" and displayed on "Find similar" tab in the form of
some icons over of found files thumbnails.
Before closing the tab the user can verify and confirm their actions or selectively cancel
some of them using context menu on thumbnails.

5. Search by sample(s).

Suppose I have several sample images in directory named "samples".
Now I want to check whether exist these or similar images in the 10Gb directory "my_collection".
I add both directories in the "Find Similar" dialog.
And XnView begins to search for similar images among whole 10Gb collection too, that is superfluous in this case.
So, it's impossible not search for similar images within a dir and subdir.
Propose to introduce an option for each directory in the "Find Similar" dialog, which would mean that XnView must not search for similar images within this directory.
So, with option like "Do not search for similar among the files in this directory" enabled for "samples" and "my_collection" dirs, XnView compares the images from "samples" and "my_collection" only, but does not compare images to each other within the directory "samples", as well as within the directory "my_collection".

6. Proposed syntax for metadata description in EBNF.

metadata_string = item , { whitespace , item } ;
item = string | identifier | format | vertical_bar ;
string = '"' , unicode_chars , '"';
identifier = Filesize | Filename | Filepath | EXIF.exists | EXIF.date_modified | ? and all other reserved words ? ;
format = "{" , string | identifier , { string | identifier } , [ "," , number , units , [ "," , alignment ] ] , "}" ;
vertical_bar = "|" ;
number = digit , { digit } ;
units = "em" | "px" ;
alignment = "left" | "right" | "center" ;
digit = "0" | "1" | "2" | "3" | "4" | "5" | "6" | "7" | "8" | "9" ;
unicode_chars = ? all Unicode characters ? - whitespace;
whitespace = " " ;
Last edited by gapsf on Fri Jan 13, 2012 9:10 am, edited 1 time in total.

eL_PuSHeR
Posts: 267
Joined: Sat Apr 25, 2009 9:23 am

Re: Find Similar Files suggestions

Post by eL_PuSHeR » Fri Jan 13, 2012 8:14 am

This looks awesome.
Intel i7 5960X
Gigabye GA-X99-Gaming 5
8 GB DDR4 (2100)
GeForce GTX 970 (Gigabyte)

User avatar
budz45
XnThusiast
Posts: 1597
Joined: Sun Jun 03, 2007 6:05 pm
Location: UK

Re: Find Similar Files suggestions

Post by budz45 » Fri Jan 13, 2012 3:28 pm

Excellent mock-ups gapsf :D Although IMO such a tabbed display would be for XnView MP and not standard Xnview.
All My Topics || my 'MP' Topics
My own Bookmarked topics--->for me only

gapsf
Posts: 4
Joined: Fri Sep 23, 2011 9:50 am

Re: Find Similar Files suggestions

Post by gapsf » Fri Jan 13, 2012 4:22 pm

budz45 wrote:Excellent mock-ups gapsf :D Although IMO such a tabbed display would be for XnView MP and not standard Xnview.
Sure, it's primarily for the new version.
The post is here because XnView visually closer to what I like and there is no equivalent thread for XnViewXP.
Sorry if it's my fault.
P.S.
I'm still convinced that the XnView interface is more elegant then XnViewMP.
Last edited by gapsf on Sat Jan 14, 2012 10:28 am, edited 1 time in total.

User avatar
budz45
XnThusiast
Posts: 1597
Joined: Sun Jun 03, 2007 6:05 pm
Location: UK

Re: Find Similar Files suggestions

Post by budz45 » Fri Jan 13, 2012 5:04 pm

gapsf wrote: I'm still convinced that the XnView interface is more elegant then XnViewMP.
Replace "elegant" with 'outdated' :mrgreen:

XnView MP is the future and the future is here!
All My Topics || my 'MP' Topics
My own Bookmarked topics--->for me only

User avatar
JohnFredC
XnThusiast
Posts: 2010
Joined: Wed Mar 17, 2004 8:33 pm
Location: Sarasota Florida

Re: Find Similar Files suggestions

Post by JohnFredC » Fri Jan 13, 2012 6:11 pm

The legacy interface evolved over years of forum interaction... I remember several different approaches that Pierre offered and we critiqued. He listened closely and responded, which is why XnView works so incredibly well now. That same iterative process has now started in the MP forums, so we can expect continued refinement to occur there, as well.

There are a few efficiencies in XnView Legacy (I like the splitter bar buttons) but for the most part, IMO MP is already superior. It builds on the legacy GUI and moves toward a less modal, more flexible interface.

Now if we could just have two complete browsers side-by-side in a single tab... 8)

Or...

Now if we could just combine named thumb styles with named layouts... 8)

Or...

(fill in the blank here)
John

User avatar
JohnFredC
XnThusiast
Posts: 2010
Joined: Wed Mar 17, 2004 8:33 pm
Location: Sarasota Florida

Re: Find Similar Files suggestions

Post by JohnFredC » Fri Jan 13, 2012 6:36 pm

BTW I want to repeat that it is great to have such a precisely defined proposal for the duplicate files functionality. It shows considerable thought about the ideal image similarity workflow.

One thing that occurs to me (and to generalize a bit) is that any place in MP that compares two images side-by-side should benefit from a full set of comparison tools. For instance, the functionality mentioned in this post would be useful in the similar files panel.

Another thought is that the similar files dialog makes extensive use of thumbnails. IMO the same features available for thumbs in the browser should be extended to any thumb panel anywhere in the interface, including the similar files thumbs components. This is mentioned in the proposal, but I want to pull it out and highlight its importance.

Modularity of functionality should be a key for MP. It simplifies the development effort (only one compare panel has to be coded, for instance) and the user benefits enormously.
John

Post Reply