How are you deleting? If you select the image and use the key combination of ⌘+Delete the photo will be moved to the Recently Deleted album and you'll be lest in the same location (This is in the Library/All Items view while viewing thumbnails). If I'm viewing the full sized version and use that key combination the next image in the library appears in the window.
If you're doing essentially what I've described try the following in order as needed:
1 - As a test launch Photos with the Option key held down and create a new, test library. Import some photos and test to see if the same problem persists. Does it? This tells us if the problem is limited to your current library or is more wide spread. Close the test library and reopen your current library and text it again.
2 - boot into Safe Mode according to How to use safe mode on your Mac and test to see if the problem persists. Reboot normally and test again.
NOTE 1: Safe Mode boot can take up to 3 - 5 minutes as it's doing the following;
• Verifies your startup disk and attempts to repair directory issues, if needed
• Loads only required kernel extensions (prevents 3rd party kernel/extensions from loading)
• Prevents Startup Items and Login Items from opening automatically
• Disables user-installed fonts
• Deletes font caches, kernel cache, and other system cache files
NOTE 2: if you have a wireless keyboard with rechargeable batteries connect it with its charging cable before booting into Safe Mode. This makes it act as a wired keyboard as will insure a successful boot into Safe Mode.