Anthony wanted to know whether he was doing something wrong or whatever, but he didn't want to actually communicate with Elijah about this. So all he could really do was brood by himself, hoping that sooner or later the truth comes out. This might as well have been Anthony's first actually healthy relationship, and he was so clueless and confused about what he's supposed to do or say. Most of all he just hoped Elijah wasn't mad at him, though.