It does if it sits for any period of time, but there are only like 14 2Tbl servings in a jar. So when I'm on a peanut butter kick, I'll go through a jar in 2-3 weeks, and only the bottom inch or so stiffens up.
I can down a jar in four days to a week.