Yep. You can have multiple headsets all using the same account at the same time. The game library is attached to the account, so they all get the same games (just have to install them).
The potential issue is multiplayer games. A lot won't let you run the same game on the same account multiple times at the same time. Some can though (Half+Half and Rec Room for example).
But single player games, or multiplayer if you only use them on a single headset at a time, are fine.