Hello Dan,
Thank you for your message.
Yes, Agents count against your license as well, as in terms of licensing Agents are no different from Hosts. However, since Agents are mostly meant for spontaneous attended remote sessions, you can simply remove Agent from your address book if you do not plan connecting to the same Agent again.
Please let me know if you have more questions.