Do you ever feel like your dual is actually exhausting at first?

I keep reading that duality is supposed to feel natural and easy, but the few times I've been around my supposed dual, I felt weirdly overstimulated. Is that just me being mistyped, or does the comfort take a while to kick in?