Aw hun im so sorry your going thro this, it was such a hard decision for you to take OH back (I remember you weren't sure for ages) I would expect him to be trying a bit harder tbh.
With regards to him accusing you, this is common when the person has cheated, they get it into their heads that you will do the same or that if the temptation ever came, you would think...why not, he did! He'll have that in his head constantly because of what he's did, he could possibly be feeling immense feelings of guilt on top of that. My ex cheated on me & we got back, so I know about all the arguing & stuff. Plus I was never allowed to bring it up at all or he'd storm off, its so difficult.
I think you really need to have a good long chat with OH, tell him your ready for walking. I know you didn't want ur Oh to see you crying but sometimes you just need to let them, so they can witness it & think about it more.
Hope today is a better day for you & hope you get on ok at the doc's
xxxxxxxxxx