Alleged child abuser died before trial. His accusers are now being blamed