broken-er pinkie toe

i broke my pinkie toe for the first time a few years ago and since then I have broken it about 6 or 7 times. in the past, once I ice and elevate it, it feels right again in about 3 or 4 days.just a few weeks ago, I broke it again, and stupidly did not ice and elevate it in the first 24 hours. it’s been three weeks now, and it still pains me and swells from time to time. could this be caused by my neglicence? does this have anything to do with a weakend immune system?
thank you!