Sexual desire and erection. Me advise.

Im 36 year old male, married since 2 years ago. I have 1 child. When i first got married i was sexually aroused to my wife to have sex with her. After she got pregnant i lost the desire slowly, no feelings to have sex with her anymore. Even after she gave birth. However i have feelings for other strange women. Means my female colleagues at work or women i meet on social occasions. I also have weak erection maybe around 70% hardness when erected. Complete erection only when near ejaculation. I sometimes muster-bate to satisfy myself instead of sex with my wife. Doctor told me to check my serum testosterone and it was 11.0 doctor said its ok level for libido. He said to take clomid 50 mg for 2 months and Cialis20mg for erection. But i stopped taking the clomid because i dont need to increase my testoesterone levels for more desire. I have anxiety and panic attacks. But still my desire to have sex is good, but not with my wife. Please give me advise. Thanks&Regards,,