Low sperm count and erections problem.

I m a married man about 4years. After marriage we planned for kids. After few months I was diagnosed with low sperm count.. After consulting a lot with different doctors I m now taking Homeo meditions.. Now since last 4weeks I started feeling my male organ is not erecting normally.. No doubt I have a bit more stress in last couple of months.. Still when ever I m in bed with my wife.. I try my best to get away from those things.. But now we both are worried as the situation as erection became a problem now for me. I m not sure do I really need to visit a doctor personalty or not.. Can any one suggest what could be the issue for my erection problem.. As in last 4 Weeks only once I was with my wife.. Rest of days I could not able to... I m seriously worried about it.