And even people of Indigenous descent are "from" somewhere else, too...since many ancestors of modern-day Tribal Nations migrated to North America from other continents. (I plan to write a piece dealing with this "Who-was-really-born-here?" fallacy, in a matter of weeks)
Take the example that I wrote about in my article, when I recalled my ex-boyfriend asking about my ethnic heritage on our first date. The context there was important. He and I were actively trying to get to know each other better, so I had no reason to take offense to his question.
It was a much different context from if, say, a stranger in the supermarket had just randomly asked me about my ethnic heritage.