Cannot alt tab to full screen Chrome window

Ever since upgrading to El Capitan, I am running into a very frustrating issue. Any time I open a page in full screen in a browser, I will alt tab out to switch to another app. When I alt tab back to the browser, it does not go to the full screen window, but rather another non-full screen window. Here's a concrete example: go to a Youtube video in Chrome, open in full screen. Alt tab to any other application. Alt tab back, and you will NOT be at that same full screen window.

This "feature" of El Capitan is a productivity killer. How can I fix this functionality to allow me to alt tab to full screen windows?