Pregnancy after breast cancer. Dileema!

I was diagnosed with infiltrating ductal carcinoma T2N0M0, hormone receptor strongly positive in sept 2018.I had 6 cycles of FEC chemotherapy and presently I am on tamoxifen 20mg OD. I am also BRCA 2 positive.Since i have completed 3 years on tamoxifen, my oncologist said that I can try for pregnancy through IVF and also go for PGT test for embryo. I am in dileema regarding pregnancy as i fear of the cancer reoccurence.I met infertility expert and she said it is the best time to try for pregnancy.I had Transvaginal.scan and had 5 follicles in my left and 3 in my right ovary.My uterous and other structures are normal. I am.unable to decide further.Shall i wait for 2 more years for the completion of 5 years or can try now for pregnancy. Kindly also suggest whether I can try for natural conception or not as I dont want to suffer more in repeated cycles of IVF