Prime Minister Justin Trudeau says there was an "erosion of trust" between his office and former justice minister Jody Wilson-Raybould over the SNC-Lavalin case.