Cast Your Sign!

A fun immersive way to learn sign language in VR.

What is Cast Your Sign!?

As part of a final year undergraduate project, 'Cast Your Sign!' is a game developed to offer a fun learning experience for sign language in virtual reality (VR).

Use your hands to unlock the 'magic' of signs as you embark on a journey to restore Sign Kingdom!

Note:
As this is still in early stages of development, lessons are limited to fingerspelling a set of letters in the American Sign Language (ASL).

Interested in taking part? Head over to the download section for more details!

IMPORTANT: Participant Information

If you wish to take part in playtesting and send feedback, please access the questionnaire below:

All responses are anonymised and will not be used to identify you.

Estimated participation time: ~1 hour (30 mins gameplay + 20 mins questionnaire)

DOWNLOAD

Please make sure you read the setup instructions below.


Requirements:

  • VR Headset with hand-tracking feature (preferably Meta Quest 2 or 3).
    (app was tested on a Meta Quest 2, cannot guarantee it will work on other devices!)

  • SideQuest software
    (needed to install the .apk file onto your headset)

SETUP INSTRUCTIONS:

Note: Setup based on Meta Quest 2, may be different for other devices!

  1. To install the app into the headset, download SideQuest first:
    https://sidequestvr.com/setup-howto
    (ignore if you already have it)
  2. Under Advanced Installer, download the option suitable for your platform.
  3. Once installed, you should see this window. Make sure your VR headset is connected and allow USB debugging when prompted on your headset. You should see a green icon with your device name at the top left corner if it’s successfully connected.
  4. On the right, click on this icon and select the APK file from the location you saved at.
  5. The APK file should then be installed onto your headset after a few minutes.
  6. To access the app in the headset, go to Library > Unknown Sources and select Cast Your Sign!
  7. Important: To play the game, you must have hand-tracking enabled on your device. For Meta Quest 2 headsets, enable them in Settings > Movement Tracking as follows:

How to Play?

  1. Place your controllers down, and wave your hands in front.
  2. Perform a thumbs up with your DOMINANT hand to navigate through the game/dialogues.
  3. You can set your hand preference when prompted by this screen.
  4. Copy the signs according to the images with your hands.
  5. Start the challenge and try to remember the signs for each letter!
  6. Note: Gesture detection may not always work, please adjust hand position/orientation until detected

Known issues

  • Hand detection may not always work accurately
    (this is still being refined, please try adjusting hand orientation/position as you perform the sign)
  • There may be overlaps with some letters when performing signs
  • Possible confusion for left-handed players due to images catering for right-handed players. (will fix in a future release!)
  • Issues with feedback detection for some letters in Realm of Courage. (will fix in a future release!)

Contact

For any questions or concerns, please reach out to:
n.a.shaikh@se20.qmul.ac.uk

Thank you very much for checking this project out! I really appreciate it :'>