Labour panics as remain voters switch to Liberal Democrats