Question About Final Stage of Healing a Broken Leg

I broke my fibula 47 days ago.
Two weeks ago my doctor put me in a walking cast and I got along just fine and no longer needed my crutches.
Today he took off my cast.
He took X-rays and said there is no sign of new bone growth.
He asked me to walk around the room a little to see how I did. Of course I had a difficult time, the same as I did when I first got the walking cast.
He told me to use my crutches for two full weeks and not to put any weight on my bad leg. Come back in two weeks.
I feel that this is a step back as I was getting along so well in my walking cast and now I have to use crutches again. Does this sound right?
It seems strange to go from a cast to nothing in less than seven weeks.
I also wonder why he had me walk on it in his office and now tells me to keep my weight off of it. Any advice please?