Anthony was going to give Elijah the benefit of the doubt here, in that he'll trust him. And he definitely understood where he was coming from, but he wasn't sure whether he could completely agree. "When I was a child I was sure as hell dreaming about something like that happening to me," it never happened, though. And it made him feel all the more worse, knowing that James would be going back to a potentially abusive family. After saying that, though, he stayed silent and watched Elijah as he spoke to James.