Whenever any new sheriff shall be elected in the place of any other, or upon the expiration of any sheriff's office, and shall have qualified and given the security required by law, the clerk of the county shall grant a certificate, under the seal of the circuit court for the county, that the person so elected has qualified and given such security.