First of all its very difficult to understand what you are writing here but as a guy my experience and those of my mates is that we tend to forgive and forget quite easily but for girls, its quite the opposite. Again, girls tend to take guys as liars no matter how genuine the guy might be. However there are different types of guys and different types of girls so I can't make judgement by taking few examples. There's a saying that Men are from Mars and Women are from Venus i.e. We have completely different natures. I think there is just a misunderstanding between you two, what you think he has come back for might be completely differnt to what he actually came back for. Discuss and find some concrete evidence before coming to a conclusion.

I think you guys are perfect married couple. Just don't worry about it. Whatever happening is part of your married life. It goes on. As incredible told, try to forgive and try to forget small mistakes, worries.
I think there are always small issues going on between wife and husband. Try to live with it. This is how homo sapiens has come a long way since thousands of years.
If any one of you expect your spouse to be 100% perfect and want him/her think or feel exactly like you then go for gay or lesbian marriage. If man and woman are there then there is always love and fight. Live with it, sort out the problems, try putting love more than fight. In the long run you will enjoy your life and feel good about yourself and your family.