To be clear, this is not an additional 3.5%, this is the same (or similar) fee that you pay when you take out dollars over the counter at the bank, or from most forex counters. Generally the fee, which is hidden in the rate spread, at forex counters is similar or higher. I just checked the current counter rate at TD and it is roughly 2.6% this afternoon (I have seen the spot rate spread over 3%). So yes, using your bank card in the US is going to cost about 1% more than getting cash at the bank today. But then what price for convenience and peace of mind not carrying a ton of money that you exchanged in Canada.
Note that the wording on the TD disclosure is that they charge 3.5% for Visa branded bank cards after Visa converts, and they still add the 0.035 to the exchange rate on non-Visa branded bank cards (which is also 3.5%) just like they always have. There is a subtle difference because of when the fee is calculated, and it is in the bank's favor, but it is a very small fraction of a percentage.