The Controller shall keep an account between the State and the Treasurer and charge the Treasurer with the balance in the treasury when he comes into office and with all money received by him, and credit him with all warrants drawn on and paid by him.