Using Voice Dictation for In-Game Chatting with VoiceAttack & Google

[Wazoo-VR]

Hey all,

 

I've recently jumped into the multiplayer server world and am, so far, really enjoying it... although identifying aircraft in VR without labels remains my biggest challenge.  I found that most people are not using voice comms but communicate mainly in the in-game chat.  Flying with a VR helmet on and, to be completely honest, being an old man who needs to see a keyboard to type, this has really lessened my enjoyment.

 

VoiceAttack, of course, is an excellent resource for us VR flyers.  I started trying to solve this problem using the built-in DICTATION functionality, but the recognition using Windows' built-in voice recognition was so spotty as to be kinda useless (I'll say "I need help in sector 1411. A pair of 109s just bounced me" and it comes out in-chat as "Feed sheep set core 411. Apart 1 oh 9 just round me.")

 

Google however, in my experience, has excellent voice recognition abilities.  The problem, of course, is there is no built-in way for VoiceAttack to use Google.  So.... I starting experimenting and hit on a way to do it that, granted, is a bit of a kludge, but actually works quite well for me with a greater than 95% accuracy rate in my limited experimentation.

 

So... I figured I'd share it and hopefully others find it works for them too.

 

How It Works

 

To access the Google speech recognition engine, I use a blank Google Docs document.  When you say, for example, SEND FRIENDLY CHAT, VA opens an in-game chat box and then switches focus to the Google Doc titled to the default "Untitled document" you created and left open in your Chrome browser prior to launching IL-2. VA then tells you it is "Ready" for you to start your dictation.  VA then activates the microphone for voice transcription within the Google Doc.  You dictate your chat and say SEND NOW to end your dictation and send the text message.  VA then erases "Send Now" from your text, copies the entire message to the clipboard, deletes the text from the document and then switches back focus to IL-2.  It then pastes in the text into the chat channel and sends it either globally or just to the friendly side.

 

Surprisingly, although when I write out the process it seems cumbersome, it actually is a pretty seamless process when inside your VR headset.

 

Setup

 

1.  Import the .vap file I've uploaded.
2.  Open a new Google Doc document within Chrome (only tested with Chrome) and leave it titled to the default "Untitled document".  You can then minimize the document or, if you have multi-monitors, leave it open on another screen.
3. Test and make sure you can transcribe to Google Docs using your headset microphone.  Under the Tools section of Google Docs there is an option to turn on Voice Typing (Ctrl-Shift-S).
4. Launch IL-2 in VR.

 

Operation

 

1. To send a message, push and hold the joystick button (currently set to Joystick #1, Button #1 but easily changeable within VA). 
2. Say SEND FRIENDLY/GLOBAL CHAT/TEXT (saying SEND is optional)
3. Wait for VA to say "Ready" and then start your dictation. 
4. When done, say SEND NOW and release the joystick button.  
5. During dictation (i.e. while holding down the button), you will have NO control over IL-2 as the Google Doc window will have focus. If you need to control the aircraft, release the button. This will return control to IL-2.  Re-pressing the button will allow you to continue your dictation where you left off. End dictation with SEND NOW while holding down the button.

 

Caveats

 

I am *far* from a VA expert, so YMMV on your particular system, but it is working really well for me so I hope it does for you.  Please offer any suggestions or optimizations and I'd love to improve on it in any way possible to make my VR flying in MP more enjoyable... or at least less horrible as I spin to my death.

 

Cheers!

 

wazooda

 

UPDATE 2.0 - 5/17/2020 - Changelog

 

Learning more and more about VoiceAttack has enabled me to figure out both how to condense this into one command and also easily regain control of the sim and then continue dictating your message when able.

 

1. Variable voice activation commands - Saying SEND is now optional - [Send][Friendly/Global][Chat/Text]
2. Switch between sim and dictation with Joystick Button - Holding down the button will put you in dictation mode and all verbal statements will be transcribed. Releasing the button will switch control back to the sim.  Re-pressing and holding the button will allow you to continuing dictating where you left off.  Just say SEND NOW while holding the button to send the text.  NOTE: Once the dictation command is started, no other VoiceAttack verbal commands will be recognized until you end the dictation with SEND NOW.
3. Dictation command condensed into one command file.

 

 

IL-2 Google Chat v2.0-Profile.rar

Edited May 17, 2020 by wazooda
Updated to 2.0

[Charlo-VRde]

This is pretty darned clever and I plan to try it out soon!

[SIA_Sp00k]

I think you’ll find in MMP that most are on voice chat when in a pair or larger.  There are many Discord servers, some large and open for public use, some Squadron orientated and some smaller ones for the small group of friends type.

 

Some servers attracts the larger. Discord or TS voice Comms servers more than others.  A search around theforum here should provide you want you want in much easier terms than the method you are trying to employ. Unless you want your Comms to come out in text?

 

Also, I have a Warthog HOTAS.  I never need to touch the keyboard for anything unless I cant help myself and have to type something which is rare.

Edited May 15, 2020 by TWC_Sp00k

[Wazoo-VR]

52 minutes ago, TWC_Sp00k said:

I think you’ll find in MMP that most are on voice chat when in a pair or larger.  There are many Discord servers, some large and open for public use, some Squadron orientated and some smaller ones for the small group of friends type.

 

Some servers attracts the larger. Discord or TS voice Comms servers more than others.  A search around theforum here should provide you want you want in much easier terms than the method you are trying to employ. Unless you want your Comms to come out in text?

 

Also, I have a Warthog HOTAS.  I never need to touch the keyboard for anything unless I cant help myself and have to type something which is rare.

I agree that voice comms are best. But sometimes I find that only a minority are on voice comms and there is lots of activity on the in-game friendly chat about the battle that I'd like to contribute to.  Being able to give enemy position reports in friendly chat seems like something I've observed others doing and I want to participate.  This allows me to do that easily in VR.

 

I mute my Discord when I send a chat message so the people on Discord don't have to hear me dictating. 

[TCW_Brzi_Joe]

I tried before google dictating in chat in one android game. I remember it was great on cellphone. Now I tried to dictate a few usual IL-2 messages in google docs, but that was not good enough for me.

Maybe it counts that english is not my mother language, even if I speak to other people without problem...

[zhihengcao]

After much of tinkering, I finally got this to work more reliably, especially when speaker instead of headphone used (thus the mic picks up the words spoken by the computer itself) 

No need to say "send now" which can get recognized incorrectly, and often appear in final chat message.  Just release the joystick button and the chat message will be sent. Also this can be done without the full version of Voice attack ($10).  Windows voice recog is very unreliable to recognize multi-syllable words like "send friendly" but I found it can recognize shorter words like "Fred" or "Global" reliably.  So just say either word then press the joystick button, a sound will notify you google doc is activated, start dictating, then release the joystick button.  "Sending" will be heard to confirm.  Works every time for me now. 

[453=castro_]

Thanks Wazoo! made some improvements, joystick was freezing while voice recording so made some tweaks