Hi everyone - I am somewhat new to this forum.
Being sore is great! This means that you actually did something. Most people tend to think to stop if you are sore. I have to agree with Steve and of course dependant upon "how" sore you actually are, you should take a light jog or even a walk to stretch your muscles.
You feel all the better. However if you are using weights, you should rest at least 2 days between each muscle workout. Meaning if you workout your arms and back, don't work them out again until 2-3 days later, this will also help the muscle grow so that when you go back to do another workout on those muscles specifically, you will attain even more results.
All the best - Adria