While the move to remote work during the COVID-19 pandemic may have made them mainstream, they are not without issues and more and more people are now opting out.