Labour has already conceded too much ground in battle for free speech