The district board shall have the power to change the boundaries of territory proposed to be annexed to an improvement district, but shall not include any territory which, in its judgment, will not be benefited by inclusion within the improvement district, nor shall it exclude any territory which it finds would be benefited by inclusion within the improvement district.