Portals Rendertexture Issue

I am trying to get a portal system working. I'm using Barkleys tutorial on YouTube(https://www.youtube.com/watch?v=cuQao3hEKfs). I'm a little confused how to get the render textures to be correct for each eye. I currently have one camera in each room that is supposed to mirror the rotation of the center camera. This causes the preview of the center camera to be correct but the left and right eye anchors have the wrong fov for the texture since the render texture camera's fov is switched to the same number as the center camera. I can get the left and right eye anchors to look correct if I manually switch them in the editor but the headset still has rotational issues. I was thinking I could use two separate render textures and cameras and have them mirror the anchors but that still leaves me with the issue of the fov being too high for each eye. Any suggestions on how to do this would be much appreciated as I'm at a loss for how to get this working correctly.