This project is a mixed reality (MR) prototype for Meta Quest 3 inspired by Ben 10, allowing users to interact with an Omnitrix-style watch with their hands, chose and transform into aliens, and use gesture-based abilities in their real-world environment.
- Built using MetaXR Interaction SDK.
- Functional watch with theree interactive buttons one for activation/deactivation, one for confirming alien to transform, one for turning back to human.
- Rotatable watch face to change alien selected.
- based on number of aliens in
UAliensDataAssetit divides circumference of the omnitrix face circle equally.
- Data-driven using
UAliensDataAsset(stores:- Alien names
- Static meshes
- Materials
- Abilities)
- Delegates for interaction flow:
OnAlienChanged: Triggers UI/SFX feedback.OnAlienConfirmed: Broadcasts final alien choice (e.g., smashing the watch).
- Each alien has unique gesture-triggered abilities (e.g.,
High5RtriggersFireBeam). - Abilities linked via a
TMap<FString, TSubclassOf<UGameplayAbility>>insideFAliens. - On alien confirmation:
- Abilities are granted to the pawn.
- Activated using
TryActivateAbilityByClass()by gesture recognition.
- Uses
FHandPosestruct (includes pose name, encoded data, confidence thresholds). - Abilities mapped per alien via TMap in
AliensDataAsset. - Gesture detection runs on tick and triggers abilities dynamically.
- Abilities are granted and removed using a custom
UBenAbilitySystemComponentBase. - Abilities update dynamically in Blueprint when
OnAlienConfirmedis fired.
- Uses MRUK and passthrough-compatible "Sky Dome" setup.
- Custom version of
PokeAHolematerial for realistic dome effect. - Destructible walls added for interaction and Sky dome is showen after Breaking the walls.
- Gameplay Abilities System (GAS)
- MetaXRInteraction v74.0.0
- UnrealMetaXRPlugin v74.0
- OculusHandTools
Currently due to collisions and the way of spawning it has bug
switching in and back from Aliens and Using Omnitrix (Omnitrix detach from player arm due fixing problem with hand tracking when one hand co 757C ver parts or fully of another hands, it's transformation will fall off)
Using FireBeal and CrystalProjectile for Heatblast and Diamondhead Alien
Special thanks to the creators of the following 3D assets used in this project:
- Main Omnitrix
- Omnitrix Spaceship
- Omnitrix Badge (used for human transformation)
- Omnitrix Cylinder Part
- Diamondhead Crystal (used for projectile ability)
Huge thanks to the amazing artists who shared their work on Sketchfab!