It’s kind of wild to me how many really small towns there are in the US. About 32% of towns in the U.S. have less than 500 residents.
For comparison, here in Brazil I lived most of my life in a town with ~35K residents and it was already considered a small rural town. Some of my family lives in a neighboring town with ~11K residents, and even in my hometown people joke about how small it is, and that there’s basically nothing going on there. 1288 of towns in Brazil have less than 5K residents, or about 23.1%, and there are no towns with less than 500 residents. Meanwhile in the US 76% of towns have less than 5K residents.
Again, it’s just kind of wild to me. I remember playing (reading?) the Echo VN and thinking “Man, a dying town with only 50 people? That doesn’t sound realistic,” but apparently that’s way more common than I thought.
It’s a known problem - though of course, because these companies are trying to push AI into everything and oversell it to build hype and please investors, they usually try to avoid recognizing its limitations.
Frankly I think that now they should focus on making these models smaller and more efficient instead of just throwing more compute at the wall, and actually train them to completion so they’ll generalize properly and be more useful.