Judge Jed Rakoff said the proposed $285 million settlement over the sale of toxic mortgage debt was “neither fair, nor adequate, nor in the public interest” and ordered a trial.