There are use cases for everything. Cheaper electricity during the night - schedule the dryer to sync with that. Disabled and can't reach the AC or light controls easily? Do it through your phone.
The real problem IMO is that these are implemented poorly, insecurely* and often through closed ecosystems, remote servers and million apps.
If this was done well, users like you could ignore the features, and others could make use of them. When you can't turn a fan on because your Fast Fans app logged you out, then I'd just rather not...
If your chatbot is shitting code, don't contribute to anything important. LLM is a navigation, you're the one behind the wheel, and ultimately responsible for where you end up.