Why is it so hard to follow God?

Life is hard enough, but why is it that following God can sometimes make it feel even harder? Of course we know the journey is worth it, but what do we do when it gets hard?