Jen, my hopes are that he will read this thread and start to communicate with you. I commend you for taking this action. Perhaps he has some untreated depression as I did that makes you draw away.
You are being brave and I really am hoping that things will change.
I have had counselling together with my ex and had we done it a couple of years earlier we may have been able to have averted the pain we both caused each other. The things that came to light with a neutral and trained person brought many things to light that we would never had said face to face alone.

For the sake of the innocent children who will be hurt I cannot stress enough that you give every avenue a fair try. Also it is extremely painful for the two people involved. I know all about it through experience.

So hubby whoever you are, please communicate and get this out in the open. you never will know what will happen if you don't try.