There are a few threads on hotels discussing keycard elevator access. See the search function.
Based on my personal experience (mostly staying there myself occasionally visiting) Yorkville Marriott, HI express on Carlton, Chelsea, Toronto Hilton, doubletree, Sheraton centre (except maybe club floors) intercontinental, Park Hyatt, Westin Harbourcastle all do not have keycard access to elevators. Cosmopolitan, royal York, ritz Carlton are the only ones I’ve stayed at downtown with keycard access to elevators. All of these are acceptable places to stay, that span the price range. I’ve been to all of these places within the last 5 years, and most within the last 2.