I just found a feature that would help me : checking the photo I want to move insted of selecting them and loose them each time i forgot to press "Ctrl" again...
So the first time Xnview asked me if I wanted to use selected photos or checked photos...i didn't understood on the first ...