Actually, Yonge Street begins (or ends) at Queens Quay, one block south of Lakeshore Blvd.
Any further south and you would be in Toronto harbour.