I have heard that infertility can be a subconscious belief that one or both of you have, from your past that doesn't either want a child or in some way is working against your conscious desire for one. I would suggest meditating and reviewing your past and see if there are any parts of yourself that this may be true for. Once you find that part of you, find resolve and get it on board. Hope this helps. Good luck!