Ok I found it after trial and error.
View > Local Global Options > uncheck Resize Window on Connect.
Again this language did not make it clear to me this was what needed to be checked off.
Not sure what triggers a resize, but with Smart Sizing you really don't need 1:1 pixel mapping. My main monitor is 1920x1200 and my secondary is 1280x1024.