After I get it set to work as I want, and then exit OBS and restart it, the tracking wont start until I uncheck and recheck the Tracking (Zoom, Follow) Options box.
This also causes the Detect Tracking filter in the list to disappear and then reappear at the end of the filter list messing up the framing my PAN ZOOM ROTATE filter has been set to.