SYN_Vander BENCHMARK v6 to measure IL-2 performance in monitor & VR

[chiliwili69]

I have been searching a bit for tools to record properly CPU and GPU frametimes in VR, and the only "user friendly" tool is fpsVR. The only problem is that it is not free, it cost 3$. I bought it some years ago, so I have give it a try to record frametimes with the SYN_VANDER mission in VR with the BSB2.

 

Instead of using the CPU Test settings from the instructions of this thread (which are thought just to stress only CPU), I have used my usual VR settings which are more realistic to what a typical VR user like me would use in their regular play game:

 

 

Then, fpsVR can be configured to reset the statistic when pressing a HotKey, so I have selected the key "P" (which is also the game pause/unpause).

But fpsVR can not be configured to stop the stats after a given time, so I have just pressed again P after the benchmark show 60 seconds in the right upper corner.

 

Firstly, I have run my BSB2 at 75Hz with 100% SteamVR SS, which is about 25.35 million pixels to render.

Secondly, also at 75Hz, I have increased to 200% SteamVR, which is about 50.7 million pixels to render, just the double.

 

Later, I have used the fpsVR History Viewer app to visualize the diferent stats files generated (having a fpsVR Report and a nice histogram!).

I think fpsVR is a nice tool to run teh benchmark in VR, but it is not free.  😞 

 

Test 25.35 Million pixels

fpsVR Report:
App: Il-2 HMD: Beyond (75.000 Hz, IPD 64.0)
GPU: NVIDIA GeForce RTX 5080 (32.0.15.8115, Tavg 69.1, Tmax 74)
CPU: AMD Ryzen 7 7800X3D 8-Core Processor (Tavg 0.0, Tmax 0)

Delivered fps: 74.81  Duration: 0.9min. Headset was active: 100%
GPU Frametimes:
Median: 9.3 ms
99th percentile: 12 ms
99.9th percentile: 12.5 ms
frametime <13.3ms(vsync): 99.9%
CPU frametime:
Median: 9.3 ms
99th percentile: 13.5 ms
99.9th percentile: 17.5 ms
frametime <13.3ms(vsync): 99%

Reprojection Ratio: 0.3%
Max. SteamVR SS during the session: 100%
Render resolution per eye: 3560x3560(by SteamVR settings, Max. during the session)
HMD driver recommended resolution (default for SteamVR at 100%): 3562x3562)

 

 

 

Test 50.7 Million pixels

fpsVR Report:
App: Il-2 HMD: Beyond (75.000 Hz, IPD 64.0)
GPU: NVIDIA GeForce RTX 5080 (32.0.15.8115, Tavg 68.4, Tmax 73)
CPU: AMD Ryzen 7 7800X3D 8-Core Processor (Tavg 0.0, Tmax 0)

Delivered fps: 37.47  Duration: 0.9min. Headset was active: 100%
GPU Frametimes:
Median: 16.7 ms
99th percentile: 21.6 ms
99.9th percentile: 21.9 ms
frametime <13.3ms(vsync): 0%
CPU frametime:
Median: 10.3 ms
99th percentile: 14.1 ms
99.9th percentile: 19.6 ms
frametime <13.3ms(vsync): 98.5%

Reprojection Ratio: 50.0%
Max. SteamVR SS during the session: 200%
Render resolution per eye: 5036x5036(by SteamVR settings, Max. during the session)
HMD driver recommended resolution (default for SteamVR at 100%): 3562x3562)

 

Overall for this SYN_VANDER Benchmark I think that to do the CPU Test and GPU Test the tool Fraps is enough (simpler to use than any other and useful along this previous years), so I will leave the CPU Test and GPU Test as we were doing before. This will give useful info for future CPUs and GPUs for IL-2.

 

And for VR, it doesn´t make sense to use tools which are based in Presentmon service like FrameView, OCAT or CapFramex since they don´t  capture CPU and GPU frametimes as they should be captured. So, I think I will modify the instructions for the optional VR tests to use fpsVR and run just two tests, one with 25 millions pixels and anpother with 50 millions. I know fpsVR is not free, but 3$ is nothing comparing to the cost of a VR headset... 😉 

[Qcumber]

Thanks. I will try this out. I have been using XRFrametools for DCS but I guess this will not work for IL-2 as it is open VR. 

 

Edited 11 hours ago by Qcumber