Can we recover certain memories. Time.

My husband and I have been fighting for some time now where he is accusing me of so me things(4-5 years back) which I don't remember. He says you are lying but I don't remember anything. I do remember my behavior which was not very good towards him but can't remember why I did that. Can a psychiatrist or psychologist help me in remembering instances happened 4-6 years back. If I am at mistake I will be happy to apologise but if nothing happened or my behavior was bad because of some reason,I want to tell him. He is accusing me of having an extramarital affair saying he saw me with someone on his bike. I don't remember sitting next to anyone and I surely wasnt involved with any other man. He says I was not paying attention to his touch/sexual needs which I remember. But I can't remember why I did that. May be we had a fight, may be I was ill, may be I had some other problem or may be I was wrong and just didn't want to address him. I want to remember that time.