I think the people who fail to consider someone's status as autistic (once it's confirmed for them, by the person) are generally just uneducated and uninformed about the diversity-within-the-neurodiversity-community, if that makes any sense. Either that, or they're afraid to ask us additional questions (through which they'd learn more) out of fear that they'll seem intrusive to the autistic person?
Yes, we are very much about craving/understanding logic, as well as deciphering whether someone means something literally or figuratively...which is why we dissect statements, and then neurotypical people react to that as (from their perspectives) "bizarre."
Apparently, everyone expects us to be mind-readers.
I don't defend autistic or otherwise-disabled people who weaponize their identity to defend bad behavior. On the other hand, neurotypical people often don't seem to realize the privilege they possess due to being the ones who get to set the standard for what is considered "normal" behavior by society.