Conservative Party Leader Pierre Poilievre says he lost his riding of Carleton in the federal election due to an “aggressive” campaign by public sector unions after he was honest about wanting to cut federal worker jobs.