dislocated toe

I dislocated my fifth toe on my left foot last week.
Went to the emergency room, it was xrayed, manipulated, x-rayed again and it was still dislocated.
They manipulated it again and said it should be ok.
It is still dislocated.
I went to my family physician today and he said that he won’t re-locate it because it won’t stay and for me just to buddy tape it and have it xrayed in a week.
He says it will go back on its own.
Sound strange to you?
Should I see an Orthopedist?