There is no "why", because it does. But the frequency of the sound is too low for your ear to detect. If you build a pendulum short enough that it makes more than 30 or 40 complete swings every second, then you will perceive the sound that it produces.
