Chat answers from your company's data in UDP, with your access. It only sees the properties and the kinds of data you can see, so two colleagues can get different answers to the same question.
Chat can also read:
files you attach to a question,
your Outlook email and calendar, if you connected them in Integrations.
Chat doesn't see your colleagues' conversations, and they don't see yours.