Freedom is the ability to swim in any direction you want, so go ahead. Do whatever you want. The map of your possible options already exists and the institutions are just one or many worthwhile places to visit. When people do whatever they want it quite often ends up on a place on the map where there is a lot of hedonism and not much in the way of higher meaning or valuable aims.

As a dispassionate observer it is my inclination to suggest that people will take the argument for more free time off work in the favour of church and family as an easier argument to make, given it's connection to a higher meaning and relatable values. A boss will likely see anything connected to 'wants' as room for more work.