Does anyone else feel like compatibility is more about rhythm than shared interests?

I keep noticing that the people I click with aren't the ones who like the same books or music, but the ones who pause the same way in conversation or get excited at the same odd moments. Is that something you look for too, or am I overthinking it?