DL:
French Market - this place in QS but it doesn't feel like it, especially if you can arrange your mealtime to coincide with a performance by the Royal Street Bachelors!
Daisy's Diner - I love the chef's salad! Beware, there's not a lot of seating available, but if you snag a table, the people (and character) watching is hard to beat.
CA:
Flo's V8 Cafe - we like to get there for Early Entry and then have a hearty "second breakfast" around 9:30am. Love the breakfasts here!