Red faces for the Lib Dems as constituency chairman defects to the Brexit Party