Each standby officer shall take the oath of office required for the officer occupying the office for which he stands by. Persons appointed as standby officers shall serve in their posts as standby officers at the pleasure of the governing body appointing them and may be removed and replaced at any time with or without cause.