Amid rising trade tensions, boycotts and travel advisories, Canadians appear to be foregoing trips to the U.S.