Agreed. One of the reasons why I believe that autistic people tend to get along so well with one another is because, broadly speaking, we understand how our own community is so prolific -- precisely BECAUSE we're each already accustomed to being "different from" (and "othered by") neurotypical culture.
Whenever I meet another person with autism (when they've chosen to disclose their diagnosis, that is), I pay close attention to her/his speech and mannerisms. I compare and contrast them to my own, and have almost instant empathy...even when their behaviors aren't necessarily identical to mine.