You can brush adjustments in and out, this works fine for individual adjustments but in the case of an effect that is applying multiple adjustments I don;t think there is a way to have one brush that affects all the adjustments applied.
You'd have to brush away each individual adjustment.