Using Fluid with Hand Tracking
Getting Started with Hands
When using Fluid with Hand tracking a cursor is attached to one of your hands. To switch the cursor to a specific hand, double pinch your index and thumb. A ray will appear for that hand which points to a cursor visual. Interacting with the cursor should feel similar to the system level hand tracking interactions. Fluid also supports direct touch interactions. Your cursor will disappear when your hand is close enough for you to directly poke/scroll windows and the Omnibox with your index finger.
Turning hands on or off
To switch from controllers to hands, set your controllers down on a solid surface. The app will switch to hand mode after a couple seconds.
To toggle the hand visual on or off, look directly at your hand and double pinch with your index finger and thumb.
Navigating the Web
To click on buttons or links, point your cursor at them and pinch your index and thumb. To scroll pages, point your cursor at the page, pinch and drag in the direction you want to scroll. To type in Fluid when using hand only (e.g. when not using a Bluetooth keyboard), you can open the virtual keyboard by pressing into the Keyboard button in the Omnibox bottom right corner.
To right click, pinch with your middle finger and thumb.
Interacting with the Omnibox
To interact with the Omnibox, you can physically press buttons with your index finger. To move the Omnibox, you can grab it's movement bar beneath it.
Moving and Closing Windows
When your cursor is pointed anywhere at a window, you can make a fist with your hands to grab and move it. You can bring it closer or move it farther away by moving your hand further or closer to you while in move mode. You can also move windows by pinching and holding at the white bar beneath any window. To close a window, click the "X" button to the right of the move bar which appears when you hover over the dot to the right of the bar.
Reset your position
To reset your position in the virtual room, or bring your workspace back to yourself when you put the headset back on, trigger the Oculus/Meta button on your right hand. To do this, open your right hand, look at it then pinch and hold with your index finger and thumb.
"Type what I say" (e.g. speech to text)
When your cursor is hovered over a text input, pinching your fingers and holding them activates "speech to text" and Fluid will type whatever you say. You can use this for domain names ("Youtube dot com" will become `youtube.com`) or for regular sentences like sending a Discord message with "Hey, have you tried Fluid yet? Go download it!". When this mode is active, a big pulsing red dot appears near the cursor.
Last updated