Indeed, based on the sorting of images in gallery views, you are naturally proposed all the images for which the annotation and the prediction don't match. Those are the images you should look at in priority, as there may be an annotation error and you may want to modify it to improve your overall performance.