I don't think anyone is assuming it will stay at its current efficiency and there will be zero improvements. A lot of the everyday AI use cases will likely be pushed to someone's personal device aka your phone. In the same way a lot of Uber and Spotify is handled by your personal device today. What we've seen for years now is the development of these gargantuan models that are then condensed down into much smaller models with 90%+ of the same effectiveness. Simultaneously we will see and are seeing devices sold with better NPU's for edge compute for AI the same we've seen the push for more edge compute to manage other services such as Uber and Spotify.
Across this thread and others there's like this implicit assumption AI will never progress beyond where it is right now in spite of the evidence of its almost exponential growth. It's really interesting.
Some places it's warranted and in others it's not. I would say most places in the US where people behave that way it doesn't seem warranted. Its funny, I live mostly in a third world country these days and even I had fear and trepidation about my first time coming here years ago but honestly it's safer than places I've lived in the US and in some ways far more free. Want to live off grid? Have a well, be off the electrical grid? Cool no problem. Want to build a structure? No permits needed if you own the land.