Pursuit, pushing yourself, engaging voluntarily with stress, regularly doing that which you are hesitant to do: these things might be the most important actions. They might be what keep you sane, what keep you healthy, what keep you alive.
If you don't regularly challenge yourself, life will challenge you. If you won't control yourself, you'll find someone to rule over you.
If you won't take responsibility, eventually your freedom will be taken from you - eventually someone will force you to take responsibility against your will.
That's how you lose your freedom - by not being worthy of it.