Banks hit out at call to axe rate agreement