Chris Patten should stop giving personal opinions on the city's affairs because he "inflicted wounds on Hong Kong" during his tenure as the city's last governor, a former Beijing official says.