Edward and the house are all he can lash out. Logically he knows that, logically he's very aware of everything Carlisle is thinking and feeling.

But logic has nothing on the scowl the back of Carlisle's head gets. He has to follow Carlisle regardless, trying to hang back a few feet.

"Then maybe I should be asking someone else."

It's flippant though on the fact there are others older.