Why does silence feel so loud when I try to meditate?

Every time I sit down to just be still, the quiet gets weirdly intense, like my own heartbeat becomes the whole room. Does anyone else get that, or am I just not relaxing enough?