I have direct perception of my thoughts, but I have no direct perception of other people’s thoughts. I only have their physical being and actions to judge their thoughts by. I can only assume that other beings have thoughts like my own.

I do not think it is unreasonable to make this assumption. We see an apple, we assume it tastes like the other apples we have eaten. We judge from past experiences.

Memory plays a large role in our understanding of reality. We must however ask what assumptions are we making about things, about the reality. Are we, without realizing it, skipping steps to get to some of our conclusions?