Efforts to start work on the site of a historic York building have prompted calls to save it for public use.