Inconsistent trackpad gestures swipe/scroll between pages

I have a brand new rMBP 15" mid 2015 fully maxed out, 1TB SSD with 16GB memory. This is my second rMBP mid 2015 and both exhibited this behavior.

Basically anytime you're in Chrome or Safari and you attempt to "scroll between pages" with two fingers or "swipe between pages" with either 2 or 3 fingers I get inconsistently behavior where sometimes the page will scroll back and sometimes it does not scroll back and I have to attempt it a few times before it will go. If I switch it to swipe between pages with 3 fingers it seems to keep it much more consistent.

Does anyone else have this problem?