Luckily I haven't been in the situation you are in, but I've actually not met my midwife either, the day I went to see the midwife, the one I was meant to see was off ill. I can understand you worrying about having the stresses of moving and having no midwife, but I'm sure that somewhere along the line, I've heard you can contact the midwife's at the local hospital if you need too.
Some days I feel like I'm not pregnant as well, I've got most of the symptoms, but not the bump yet or the kicking or anything like. Fortunately or Unfortunately, depends how you see it, I had to have an emergency scan 2 weeks ago due to the hospital suspecting a Ectopic pregnancy, but they soon discovered the baby was in the right place.
I suppose the advice I would give you, and there are probably more experienced ladies on here who might be able to give you better advice, would be to see if you can chat to the midwife's at the local hospital, they might even book you in for your 12 week scan as well. I don't think it's fair that you can't get any midwife support just because you are moving either, but try the hospital they might also be able to point you in the right direction. Just don't get over anxious about moving, the best thing is, so I keep getting told is to stay calm, not easy from what you have put, but you have to try.