I guess it's important to keep in mind time/manner/place.

If you're asking a stranger "Where are you from?" -- why not say "What's your hometown?" if you're mainly interested in their geographic upbringing.

If it's a friend or acquaintance and you're trying to learn more about them -- why not ask "Where did you live when you were a kid or a teenager?"