I got bitten by this yesterday. I recognized it was Ask You from its behavior (and how I got it), but it was not called Ask You in the settings. Instead, it was called "SYSTEM NOTIFICATIONS", and had an icon that looked similar to the one for System Preferences (like a "gear", though with an added small "alert" badge). It was confusing trying to find it, because at first blush, the notifications looked like they were coming from System Preferences. It was only by observing its behavior, and researching it (a Malwarebytes forum discussion on it was very helpful) that I recognized, and found out how to get rid of it:
Go into Safari, go to Settings>Notifications, select it in the list (whatever it's called), and press the Remove button. That solved the problem for me.
Not sure why, but trying to change its setting to Deny (from Allow) caused Safari to lock up. Using Remove did the job.
If you're wondering which notification entry is causing the problem (if it's not called something obvious, like Ask You, as in my case), try going into Notifications in System Preferences, selecting some notification that you're not sure about, and change its setting to None. If that stops the annoying notifications from Ask You from coming on the screen (except when you click on the clock on the far-right side of the menu bar), you've found it. The notification setting for this adware will show up as the same name in Safari's Notifications listing.