I never suggest people put anything in with their marijuana. It's just asking for trouble. And orange peels are usually coated with numerous chemicals to retard spoilage. Perhaps the peel you put in was organic, since it obviously didn't have the usual antifungal chemicals they usually spray on such fruit. So it seems you put in a moist piece of organic fruit. Still not a good idea.
The best way to store cannabis is in dark container, preferrably glass, vacuum packed. Then store it in the fridge so it will last longer.
As far as smoking your pot, I'd remove the moldy parts very carefully. Then dry out the pot by leaving it exposed to the air in a warm dry place for a couple of days. Then follow my storage instructions above. Hopefully the mold won't spread any further.
You can smoke moldy pot, but it tastes like shit. I doubt you'll get any other side effects, but there's no guarantee. Burning the mold will destroy the spores, which aren't likely to like your lungs anyway. But you could have an allergy. Again you never know. So minimize the risk and only smoke the unmoldy pot.
And consider this a lesson...
Peace,
The Old Hippy
The Old Hippy does not advocate breaking any laws. Know the law where you live!