Is there necessarily bruising/swelling in a broken foot?

Last Friday after my workout, I noticed that there were sharp pains along the outside of my foot whenever I walked. Initially, I figured that it was just a sore muscle, but as it has been four weeks and the pain level is exactly the same as it was on Friday, I’m paranoid that it’s more than just soreness. The pain is there only when I walk, but when I’m on my feet for more than 10 minutes, it gets considerably more painful and I start to limp.
The problem though is that there is no swelling or bruising whatsoever, so I feel kind of dumb going to the doctor since it doesn’t seem all that serious to me. So my question is, do bruising and swelling come hand in hand with a broken bone in the foot? Any help would be appreciated. Thanks.