Different Photo Viewer App for Mac

This is what I want:

Double click image file (like a .jpg or whatever) in Finder

Opens the image in a viewer

I can click a "right arrow" or "left arrow" in the viewer to view the next image file in that folder

And also move through the images in the folder using the right and left arrow keys

I can click "delete" to delete that image from the hard drive if I want to.

From what I see, the Preview app does not do either one of these.

What can I use (for free) to do this instead?

I don't want to use the built in Photos app either. (I want full manual control over my photos folders, names and backups, etc).

Is there a free software I can use for this?