Have you ever walked past a janitor or security person and heard their keys rattling? I don’t think I have, and they typically have a lot of keys. Unless they’re bumping into something, they should all swing as a single unit. It shouldn’t really be an issue.