How old are you wolfman?
Even at my age (29) I started playing golf seriously far too late in life imo. I started hacking around without any lessons or membership about four years ago for a friendly comp with family and friends and then finally took the plunge last year and had lessons and joined a club. I play off 18 now but it's massively inconsistent. I'm a product of my age, it's virtually impossible to eradicated years of muscle memory and I play a lot compared to other people who are much better than I am.
My point is, if you took it up later in life, you really need to practice, practice, play and practice to improve.
I'm lucky(?) that I'm single and can do what I like. You have a family to think about.