The resignation or removal of any officer shall not, nor shall the appointment or election of another to the office, exonerate such officer or his sureties from any liability incurred by him or them.