Scary indeed. Even more so because "everyone would adjust their lifestyles to match" is simply not possible. As we are very much locked in a encompassing system that is built and driven entirely by the paradigm of cheap and abundant energy and fertilizers. Take these paradigms away and the entire spatial and social structure comes down.
The good news is that we only need an average energy consumption of 79 GJ per person* to allow everyone on Earth to realize 95% or more of maximum performance across all nine metrics (life expectancy, infant mortality, happiness, food supply, access to basic sanitation services and air quality). But that would mean transitioning to different spatial and social structures....now we still have some time left to adapt somewhat gently. But we are not. So it's clear that we are heading towards a tribal showdown. Time to hedge your chances.
*https://esajournals.onlinelibrary.wiley.com/doi/10.1002/ecs2.3978