Running a business is not easy nor does it leave a lot of leisure time for business owners. Typically they must work long hours regardless of whether or not they have a family.
In fact, some days they may struggle just to keep up with tasks at home and family activities. That makes trying to fit in extra things, even if important, more difficult.
