In the ever-evolving landscape of technology, Augmented Reality (AR) and Mixed Reality (MR) have emerged as groundbreaking innovations, transforming the way we interact with the digital world and our physical surroundings. Both technologies enrich our experiences by seamlessly blending virtual elements with reality. However, they possess distinct characteristics and applications. In this article, we will delve into the fascinating realm of AR and MR, exploring their differences, use cases, and current state of adoption.

Augmented Reality, as the name suggests, enhances reality by adding a layer of digital content over the user's view of the physical world, usually through the camera of a mobile or web application. This digital layer can encompass a wide range of media, including 3D models, images, videos, and interactive elements. AR leverages the possibilities of mobile devices, such as smartphones and tablets, making it easily accessible to a vast audience.

AR finds diverse applications across various industries, but it particularly prevails in education. It provides an invaluable tool for students to visualize complex concepts that may otherwise be challenging to comprehend. For instance, biology students can examine virtual 3D models of organs, and history students can explore ancient artifacts from the comfort of their classrooms.

Image source: https://medium.com/startux-net/the-differences-between-vr-ar-mr-27012ea1c5 

Despite its popularity, AR glasses and dedicated MR devices have yet to achieve widespread adoption. Cost remains a significant barrier, making these devices less accessible to the average consumer. However, it is worth noting that most individuals already possess an AR-capable device in the form of their smartphones, which mitigates the need for dedicated hardware.

Mixed Reality takes AR a step further by seamlessly blending the digital layer with the real world, allowing for interactive experiences between virtual and physical objects. This means that digital elements not only coexist but can also interact with the user's surroundings. Unlike AR, MR devices enable users to manipulate virtual objects within their real environment.

The potential applications for MR are vast and span various domains. From industrial design, where engineers can visualize and test prototypes in a real-world setting, to architecture, where clients can walk through virtual representations of buildings, MR holds the promise of revolutionizing multiple industries.

While MR is undoubtedly a compelling technology, its adoption faces several challenges. Limited availability and high costs are significant factors that currently hinder widespread usage. Microsoft Hololens and Varjo are one of the few MR devices available on the market, and as technology advances, we can expect more options to become accessible to consumers.

The line between AR and MR can be blurry, leading to confusion among users. The fundamental distinction lies in how the digital layer interacts with the real world. In AR, the digital content overlays reality but remains distinct and separate from physical objects. On the other hand, MR merges digital and real elements, enabling virtual objects to interact with the user's surroundings, creating a more immersive experience. Certain headset manufacturers exploit this vague distinction to promote their products as MR-capable devices, even though they are, in reality, AR devices.*

Augmented Reality and Mixed Reality have brought about transformative changes, enhancing the way we perceive and interact with the world around us. While AR enriches reality with an additional digital layer, MR takes it a step further, enabling digital objects to interact with the physical environment. Both technologies hold immense promise in various fields, including education, entertainment, and industry. As technology continues to advance and become more accessible, we can expect AR and MR to find even more practical applications and touch the lives of people worldwide. The journey of these immersive technologies is only beginning, and the future is bound to be filled with even more astonishing possibilities.

* Some devices were not tested, and the conclusion was derived from usage videos.

Unravel the differences and applications of Augmented Reality (AR) and Mixed Reality (MR) in this transformative comparison article.

This blog post provides an in-depth comparison between Augmented Reality (AR) and Mixed Reality (MR), two groundbreaking technologies that have transformed our interaction with the digital and physical worlds. The article discusses their applications, challenges, and current state of adoption.

AR vs MR - Unraveling the World of Augmented and Mixed Reality

The unveiling of Apple's latest product, Vision Pro, has created significant buzz in the tech industry. Per Apple, this headset aims to “seamlessly blend digital content with your physical space.” While they haven't announced (almost) anything we haven't seen before, it showcased Apple's deeply ingrained values and evoked memories of their iconic slogan, "Think different." Someone was quick to notice that during the WWDC presentation, Apple CEO Tim Cook and other speakers made no mention of the buzzword "metaverse”. Interestingly, words like virtual reality, mixed reality or XR also were nowhere to be found. Instead, they focused on the concept of "spatial computing," leaving us with a compelling question: What exactly is spatial computing? 

Spatial computing was first defined in 2003 by MIT researcher Simon Greenwold in his graduate thesis as “human interaction with a machine in which the machine retains and manipulates referents to real objects and spaces. It is an essential component for making our machines fuller partners in our work and play.” At its core, spatial computing enables us to merge the digital and physical worlds, creating an immersive and interactive experience that goes beyond augmented and virtual reality technologies. It allows machines to understand and interact with real objects and spaces, becoming fuller partners in our work and play.

Spatial computing opens up a realm of possibilities for seamless integration and interaction between the digital and physical realms. It goes beyond the mere overlaying of digital information onto our surroundings, enabling us to manipulate and interact with the physical world in conjunction with digital content. This immersive and natural experience has far-reaching implications across various industries and aspects of our daily lives.

Exploring the Applications of Spatial Computing in Various Industries

One of the applications that instantly comes to mind when speaking of spatial computing is design and architecture. Imagine being an architect, able to visualize your designs in their intended location, interacting with virtual elements, and making real-time adjustments. Spatial computing empowers architects and designers to walk through virtual structures, experiencing the scale, proportions, and aesthetics before construction even begins. This level of immersion and interactivity enhances the design process, enabling more informed decision-making and fostering a deeper understanding of the final product. The same can be applied when designing a car for instance.

Education and training also stand to benefit significantly from spatial computing. Traditional teaching methods usually rely on static textbooks and two-dimensional content, limiting the comprehension and engagement of students. With spatial computing, complex concepts can be brought to life through interactive virtual models, immersive simulations, and hands-on experiences. Students can engage with the subject matter in a tangible way, fostering deeper understanding and enhancing learning outcomes. 

The impact of spatial computing extends far beyond design and education. Industries such as healthcare, manufacturing, and logistics are leveraging this technology to revolutionize their processes and improve outcomes. In healthcare, surgeons can utilize spatial computing to visualize and manipulate medical imaging data in real-time during surgeries, enhancing precision and patient safety. In manufacturing, workers equipped with spatial computing headsets can access real-time instructions, collaborate with remote experts, and streamline production processes. In logistics, spatial computing optimizes warehouse operations by providing workers with augmented reality overlays, guiding them to efficiently locate items and fulfill orders.

The Role of Hand Tracking in Spatial Computing

Hand tracking is a vital component of spatial computing as it enhances the user's ability to interact naturally with the digital environment. By accurately tracking the movements and gestures of the user's hands, spatial computing systems can enable intuitive and immersive interactions, further blurring the line between the physical and digital world. 

Traditionally, user interactions with digital content were limited to mouse clicks, keyboard inputs, or touch-based interactions on screens. However, with the advancement of spatial computing, hand tracking is emerging as a powerful technology that enables users to manipulate virtual objects, navigate menus, and perform various actions using natural hand movements.

Hand tracking also enables more precise and nuanced interactions. Users can grab, move, rotate, and resize virtual objects with natural hand movements, providing a level of dexterity and control that was previously limited in traditional input methods. This opens up possibilities for intricate design work or even virtual training scenarios where precise hand movements are crucial. 

Moreover, hand tracking enhances social and collaborative experiences in spatial computing. Users can communicate and gesture with each other using their hands, fostering a sense of connection and presence within shared virtual spaces. Collaboration becomes more natural and fluid as participants can point, gesture, and interact with virtual objects as if they were physically present. 

In addition to these user-centric benefits, hand tracking also has implications for accessibility. Traditional input methods may present barriers for individuals with physical limitations or disabilities. By leveraging hand tracking technology, spatial computing experiences can be more inclusive, allowing users to engage with digital content and environments without the need for specialized hardware or complex gestures.

Overcoming Challenges in the Adoption of Spatial Computing Technology

Adoption of spatial computing does come with its share of challenges. Integration with existing infrastructure and workflows poses a significant hurdle for businesses looking to embrace this technology. It requires a reevaluation of processes, investment in compatible hardware and software solutions, and comprehensive training programs for employees. Addressing concerns related to privacy, security, and data management is also crucial to ensure user trust and compliance with regulations.

Luckily, Apple has taken privacy-by-design extremely seriously, aiming to ensure that your future devices work solely for your benefit, without compromising your privacy to unseen parties.

As we embark on this spatial computing revolution, it is essential to consider the ethical and societal implications. Responsible development and deployment of spatial computing solutions require collaboration between technology companies, researchers, policymakers, and users. Together, we can ensure that spatial computing aligns with our values and contributes to a more immersive, connected, and inclusive future. 

Spatial computing enables us to merge the digital and physical worlds, creating an immersive and interactive experience that goes beyond AR and VR technologies.

In this blog post, we explore the fascinating realm of spatial computing, inspired by Apple's groundbreaking Vision Pro headset. Discover the concept of spatial computing, its diverse applications across industries, the role of hand tracking in enhancing user experiences, and the challenges that lie ahead. Join us on this journey as we unravel the potential of this immersive technology and its seamless integration of the digital and physical worlds, propelling us into a new era of interactive possibilities.

In today's rapidly evolving technological landscape, virtual reality and hand tracking technology have emerged as powerful tools in the field of rehabilitation and therapy. At SpectreXR, we are at the forefront of this transformative movement, leveraging the potential of VR and the OctoXR interaction framework to revolutionize the way we approach rehabilitation and therapy. In the following article, we will explore the numerous benefits of VR and hand tracking technology and how they can be applied in a wide range of therapy and rehabilitation use cases.

Virtual reality provides a unique opportunity to create immersive and engaging therapy experiences. By transporting individuals into realistic virtual environments, therapists can simulate real-life scenarios and activities, enhancing the sense of presence and promoting active participation. The combination of VR and hand tracking technology allows for natural and intuitive interactions, enabling users to manipulate objects and perform therapeutic exercises with precision and accuracy.

Hand tracking technology plays a crucial role in motor skills rehabilitation, particularly in cases of hand injuries or conditions affecting hand functionality. Through precise and real-time tracking of hand movements, VR therapy applications enable therapists to design customized rehabilitation programs that focus on improving hand mobility, strength, dexterity, and hand-eye coordination. This technology allows therapists to monitor progress and provide instant feedback, facilitating faster and more effective recovery outcomes.

This kind of solutions extend beyond physical rehabilitation and can significantly benefit individuals with cognitive impairments. By creating interactive and stimulating environments, these applications can engage users in cognitive exercises that target memory, attention, problem-solving, and other cognitive functions. OctoXR's hand tracking technology further enhances these exercises by enabling users to manipulate objects and interact with their virtual surroundings, promoting cognitive stimulation and improvement.

Hand Therapy App: Experience the Power of VR Rehabilitation 

At SpectreXR, we have developed a demo hand therapy app that exemplifies the transformative potential of VR rehabilitation. Our app integrates the immersive capabilities of virtual reality with the precision of hand tracking technology, offering a comprehensive and engaging therapy experience.

Designed with the needs of individuals recovering from hand injuries or conditions in mind, our demo app provides a small range of interactive exercises and activities tailored to enhance hand mobility, strength, and dexterity. Through intuitive hand gestures and natural interactions, users can perform virtual tasks that mimic real-life movements, promoting muscle activation, coordination, and sensory reintegration.

What sets our hand therapy app apart is the utilization of the OctoXR interaction framework, which enables realistic physics-based interactions. This ensures that users can grasp, manipulate, and interact with virtual objects in a way that closely resembles their natural hand motions.

By leveraging the immersive power of VR and the advanced capabilities of hand tracking technology, applications like this aim to accelerate the rehabilitation process, improve patient outcomes, and empower individuals on their journey to recovery. 

We invite you to explore our demo hand therapy app and witness firsthand how the combination of VR, hand tracking technology, and the OctoXR interaction framework can elevate the rehabilitation experience to new heights.

The potential applications of VR and hand tracking technology in rehabilitation and therapy are vast. Beyond hand therapy, these technologies can be utilized in various domains such as stroke rehabilitation, balance and gait training, pain management, stress reduction, and more. The versatility of VR allows therapists and healthcare professionals to design tailored therapy experiences that cater to the unique needs of their patients, optimizing treatment outcomes and improving quality of life.

As leaders in the field of VR and hand tracking technology for rehabilitation and therapy, SpectreXR is dedicated to empowering therapists, healthcare professionals, and VR developers to create impactful applications that transform the lives of patients. With our expertise in utilizing the OctoXR interaction framework, we can assist you in developing customized VR therapy applications that align with your specific goals and requirements. 

Virtual reality and hand tracking technology have revolutionized the field of rehabilitation and therapy, offering new possibilities for immersive and effective interventions. By harnessing the power of VR and the OctoXR interaction framework, therapists and healthcare professionals can unlock the potential of these technologies to enhance motor skills rehabilitation, improve cognitive function, and address various therapy needs. Embrace the future of rehabilitation and partner with SpectreXR to leverage VR and hand tracking technology for transformative therapy experiences.

Discover how SpectreXR is revolutionizing rehabilitation and therapy through immersive VR and hand tracking technology.

We explored the transformative potential of immersive virtual reality and hand tracking technology in the field of rehabilitation and therapy. Discover how SpectreXR is leveraging these technologies to enhance motor skills rehabilitation, and improve cognitive function. Experience the future of therapy and unlock new possibilities for patient care.

Revolutionizing Rehabilitation and Therapy with Immersive VR and Hand Tracking Technology

Are you an indie developer looking for a platform to showcase your VR applications? Look no further than Sidequest! With Sidequest, you can distribute your VR content and reach a wider audience outside of the official Oculus Store. And now, publishing on Sidequest is easier than ever before.

Recently, we released two VR demo applications on Sidequest that showcase what you can develop with the OctoXR interaction framework. Both apps utilize hand tracking and have realistic interactions, offering engaging and effective tools for aiding in recovery and improving cognitive function.

The first app, Dementia Brain Exercises, is an interactive brain exercise program designed for people with dementia. The application aims to enhance cognitive function and delay the progression of the disease through brain exercises. The app is specifically designed to be easy to use and accessible to people with varying levels of cognitive ability.

The second app, Hand Therapy, is a digital program designed to assist individuals who are recovering from hand injuries or suffering from hand-related conditions. The application utilizes VR technology to create immersive experiences that simulate various hand exercises and activities.

So, how did we get these apps on Sidequest? It's easy! Here are the steps:

Step 1: Register as a Sidequest developer To start publishing your app on Sidequest, you need to register as a developer on the platform. Go to the Sidequest developer portal at https://dashboard.sidequestvr.com/login and sign up for an account. Once you've created an account, you'll be able to access the developer dashboard, where you can submit and manage your apps.

Step 2: Create your app listing To submit an app to Sidequest, you need to create a listing for it on the platform. In the developer dashboard, click on the "Apps" tab and then select "Create App". 

Choose a banner image for the top of your app listing page. A good size for the image is 2048px X 370px. The image can be cropped on smaller screens, so keep anything important within the middle 500px X 300px.

Select an icon image for your app - this image will be displayed in search results and on the app listing page if you don't have a video added to your listing. A good size for this image is 580px X 470px.

Fill out your app name, package name, summary, and description. Your package name must be unique and should look something like this: com.example.myapp.

Enter tags to help users find your app when searching. These tags also decide which app categories you appear in on the apps page.

Enter the current version code (integer) and version name (friendly name i.e 1.0.1). When you update your app, you must increment your version code to trigger automatic updates for your app.

In order for users to be able to access your app, you must supply a direct download URL for any APK or OBB files required.

You can add several URL types to your listing, including social links and links to your apps store listing on other stores.

SideQuest can integrate with Github releases to make deployment of your app easier and can also handle updates.

Enable Private Listing to be able to control who has access to your app.

Enable early access of your app to only allow a limited audience to see the app.

Add several screenshots to your app listing.

Select which devices your application supports. SideQuest supports any android-based devices.

Select which license option you want to use. Paid and Pre-Release - Paid will appear under the paid filter on the apps page

Select whether your app is a seated experience only. 

Step 3: Test your app Before submitting your app to Sidequest, it's important to test it thoroughly to ensure that it works correctly on Oculus Quest and Quest 2 devices. You can use the Sidequest App Launcher to install your app on your device for testing. You'll need to enable developer mode on your device first, which you can do by following the instructions on the Oculus Developer website.

Step 4: Submit your app for review Once you're satisfied that your app is working correctly, you can submit it for review on Sidequest. In the developer dashboard, click on the "Apps" tab and then select your app. Click on the "Submit for Review" button to start the review process. Sidequest will review your app to ensure that it meets their content guidelines and is safe for users to install. If your app passes the review, it will be published on the Sidequest app store.

Step 5: Manage your app Once your app is published on Sidequest, you can use the developer dashboard to manage it. You can track downloads and ratings, update the app's details, and even publish new versions of the app. If you want to remove your app from Sidequest, you can do so from the developer dashboard.

So, what are you waiting for? Start developing your VR applications today and get them published on Sidequest! With a platform like that, you can reach a wider audience and share your creative and innovative ideas with the world.

Learn how to easily publish your VR applications on Sidequest and reach a wider audience with this step-by-step guide.

The blog post provides a guide for indie VR developers on how to publish their VR applications on Sidequest, a platform for distributing VR content outside of the official Oculus Store, with detailed steps on how to register as a developer, create an app listing, test the app, submit for review, and manage the app after publication.

How to Publish Your VR Apps on Sidequest: A Step-by-Step Guide for Indie Developers

Hand tracking in virtual reality has been a game changer in recent years. This technology allows users to interact with the VR environment using only their hands, making the experience more immersive and natural. With both hardware and software advancements from VR vendors in recent years, it's no surprise that the demand for hand tracking technology in VR is on the rise, especially in business use cases like VR training. In this blog post, we will discuss the increase in devices supporting hand tracking in VR and the price decrease of VR headsets that support this technology.

According to the data provided by VRcompare, the percentage of VR devices supporting hand tracking has increased significantly over the last two years. In 2021, out of a total of 19 VR devices that entered the market, only 4 of them supported hand tracking, representing a 21% support rate. However, in 2022, out of 15 VR devices, 7 of them supported hand tracking, resulting in a 46% support rate, a 119% increase compared to the previous year. Moreover, out of the last 5 VR devices (HTC Vive XR Elite, PlayStation VR2, Pico 4 Enterprise, Lynx R1, Meta Quest Pro) that entered the market, 4 of them supported hand tracking, with only PlayStation VR2 not supporting it for obvious reasons - losing your tracking while gaming is just not an option. It's interesting to note that all of them are major VR players so the standard, at least in our eyes, is set for the future.

This trend shows that the demand for hand tracking technology in VR is increasing, and manufacturers are responding to this demand by integrating this feature into their devices. The ability to interact with virtual objects using natural hand movements makes the VR experience more immersive and intuitive, making it an essential feature for VR enthusiasts.

Another notable trend is the decrease in the average price of VR headsets, especially those that support hand tracking. In 2021, the average price of a VR device was $3,330, while in 2022, it dropped to $2,210, representing a 33% price drop. The average price of a VR device that supports hand tracking in 2021 was $12,122, while in 2022, it dropped to $745, a staggering 93% price drop.

However, it is essential to note that the $38,500 price of one VR device in 2021 significantly raised the average. If we exclude this device, the average price of a VR device supporting hand tracking in 2021 was $3,330, which is still 77% higher than the average price in 2022. The decrease in the average price of VR headsets that support hand tracking makes them more accessible to a wider audience, allowing more people to experience the benefits of hand tracking technology in VR.

The combination of increasing support for hand tracking in VR devices and the decreasing price of VR headsets that support this technology is significant news for VR enthusiasts. Hand tracking technology provides a more immersive and intuitive way of interacting with virtual objects, and the decreasing price of VR headsets makes it more accessible to a wider audience. These trends are set to continue in the coming years, making hand tracking in VR an indispensable feature for an immersive and natural VR experience.

If you're interested in implementing hand tracking interactions in your VR application or looking for ways to speed up your development process, don't hesitate to contact us.

Disclaimer: The data used in this blog post was provided by https://vr-compare.com/vr, a trusted source for comparing VR devices and their features. We acknowledge that the accuracy and reliability of the data are solely the responsibility of the source.

Explore the rise of hand tracking technology in VR, with an analysis of the increasing number of devices that support it and the significant price drop in VR headsets that offer this feature.

Hand tracking technology in virtual reality has become a game changer, providing a more natural and immersive way of interacting with virtual objects. The number of VR devices supporting hand tracking has increased by 119% from 2021 to 2022, and the average price of VR headsets that support hand tracking has dropped by 93%. This trend is set to continue, making hand tracking in VR more accessible and affordable for everyone.

VR Hand Tracking: More Immersive and Accessible Than Ever

As virtual reality (VR) technology continues to advance, hand interactions are becoming increasingly important for creating immersive and engaging experiences. This technology allows for highly realistic hand interactions in VR, which has a number of benefits for training and other use cases. In order to optimize hand interactions in VR, it is important to consider factors such as usability, naturalness, and performance.

1. Use realistic and intuitive hand models 
One of the key aspects of creating effective hand interactions in VR is using hand models that are realistic and intuitive for users. This means using high-quality 3D models that accurately represent the shape and movements of the human hand, and designing the interactions in a way that is natural and easy to understand.

2. Consider the context of the VR experience 
Another important factor to consider when optimizing hand interactions in VR is the context in which they will be used. For example, a VR game may require more complex and dynamic hand interactions than a VR training application. By understanding the specific needs and requirements of the VR experience, you can design hand interactions that are tailored to the intended use.

3. Take advantage of existing hand tracking technology
There are a number of hand tracking technologies available today that can be used to improve the accuracy and responsiveness of hand interactions in VR. These include optical tracking, inertial tracking, and electromyography (EMG) sensors. By incorporating these technologies into your VR experience, you can provide users with more realistic and responsive hand interactions.

4. Invest in user testing and feedback
One of the best ways to optimize hand interactions in VR is to conduct user testing and gather feedback from real users. This can help you identify any issues or challenges with the hand interactions, and make adjustments to improve the user experience.

5. Use haptic feedback to enhance realism
Haptic feedback, or the use of touch sensations to communicate information, can be a powerful tool for improving hand interactions in VR. By incorporating haptic feedback into the VR experience, you can make the hand interactions feel more realistic and immersive for users.

6. Provide clear and concise instructions
In order for users to effectively interact with their hands in VR, it is important to provide clear and concise instructions on how to do so. This can include on-screen prompts, tutorials, or other forms of guidance that help users understand the hand interactions and how to use them.

7. Create a smooth and natural hand movement system
In order to create realistic and engaging hand interactions in VR, it is important to design a movement system that is smooth and natural. This means avoiding jerky or unnatural movements, and using motion capture or other techniques to accurately reproduce the movements of the human hand.

8. Use hand interactions to enhance immersion
One of the key benefits of hand interactions in VR is that they can help to enhance the immersion of the VR experience. By designing hand interactions that are intuitive and engaging, you can help users feel more connected to the VR environment and the content they are experiencing.

9. Avoid overloading the user with too many hand interactions
While hand interactions can be a powerful tool for enhancing VR experiences, it is important to avoid overloading the user with too many interactions. This can lead to confusion and frustration, and may detract from the overall user experience.

10. Continuously refine and improve the hand interactions
Finally, it is important to continuously refine and improve the hand interactions in VR in order to provide the best possible user experience. This can include implementing new technologies, gathering user feedback, and making ongoing adjustments to the hand interactions based on user needs and preferences.

By following these tips, you can optimize the hand interactions in your VR experience and provide users with a more engaging and immersive experience. And if you are looking to simplify your development process, you should consider using OctoXR. 

If you are interested in working with us or just want to chat, contact us by email or join our Discord. 

Learn how to enhance the user experience and take your VR application to the next level with our 10 tips for optimizing hand interactions in VR

Virtual reality (VR) technology is constantly evolving, and hand interactions are becoming increasingly important for creating immersive and engaging experiences. In this blog post, we will share 10 tips for optimizing hand interactions in VR. From using realistic hand models to incorporating haptic feedback, these tips will help you enhance the user experience and take your VR application to the next level.

10 Tips For Optimizing Hand Interactions In VR

The Collaboration between SpectreXR and Crunchfish continues to thrive! The new amazing version of Crunchfish’s XR Skeleton has successfully been integrated into the latest version of Spectre’s hand interaction framework – OctoXR. This integration highlights the ease and efficiency of enchancing augmented reality experiences on standard mobile devices.

Combining Crunchfish’s robust hand tracking solution and Spectre’s interaction framework we have created a demo to showcase the potential of this technology for the e-commerce market, improving the quality by offering a more immersive digital shopping experience.

The most exciting thing about using hands in augmented reality is that it allows the user to interact with the virtual world just like in real life. Our solution simulates real physical interaction with virtual objects, making it a more natural experience. The demo application shows how a sneaker can be picked up and turned around for the user to get a closer look before making a purchase.

Crunchfish’s and Spectre’s software can now be used together to make an integrated solution that makes it much faster to make interactive augmented and virtual reality applications for e-shopping, live video shopping, Virtual-Try-Ons, etc.

“Using Crunchfish’s hand tracking technology in AR, we can use the full potential of our OctoXR to give users a full AR experience by interacting with the digital content using just their hands, not touching the screen.” says Ivan Rajkovic, CEO of SpectreXR

This information was provided by the contact person above for publication 8 February 2023 at 10:00 CET.

SpectreXR and Crunchfish collaboration regarding hand tracking and interactions in AR continues to thrive!

SpectreXR and Crunchfish's collaboration continues to yield positive results with the integration of Crunchfish's XR Skeleton into SpectreXR's OctoXR hand interaction framework. This integration has made it easier to enhance AR experiences on standard mobile devices. The two companies have created a demo to showcase the potential of this technology for the e-commerce market, offering a more immersive digital shopping experience. The use of hand gestures in AR allows for a more natural interaction with the virtual world, as demonstrated in the demo app where a sneaker can be picked up and turned for a closer look. This integrated solution makes it faster to create interactive AR apps for e-shopping, live video shopping, and virtual try-ons. According to Ivan Rajkovic, CEO of SpectreXR, hand tracking technology from Crunchfish can be used to maximize the full potential of OctoXR, enabling users to interact with digital content using just their hands without touching the screen. 

SpectreXR and Crunchfish Betting Big on Hand Interactions in AR

Hand interactions in virtual reality play a crucial role in immersing users in the digital world, but achieving natural and seamless interactions can be challenging. Hand tracking and interactions in VR can still be clunky and difficult to use. In this blog post, we'll explore some techniques and best practices for improving hand interactions in virtual reality.

Use a high-quality hand tracking device
One of the most important factors in hand interactions in VR is the quality of the hand tracking device. A high-quality device will provide more accurate and responsive tracking, which will result in a more immersive and natural experience. Look for devices that use advanced tracking technology, such as optical or inertial sensors. In our experience, the best standalone VR device with integrated hand tracking is Oculus Quest 2 because losing hand tracking doesn’t happen that often (assuming your hands are in front of your device), it has a solid occlusion and it predicts well the position and behavior of the fingers it cannot see. As for other VR headsets we recommend using additional hardware such as Ultraleap. 


Optimize hand models and animations
The way that hands are represented in VR can have a big impact on the overall hand interactions. A good hand model should be anatomically correct, and the animation should be smooth and natural. Pay attention to the details like finger movement, hand gestures and physics-based interactions to make it more believable.


Provide clear visual feedback
Another important aspect of hand interactions in VR is providing clear visual feedback. This means displaying information about the state of the hand interactions, such as when the hand is gripping or pointing. This can be done through visual cues, such as changes in the color or shape of the hand model, or if possible, through haptic feedback.


Allow for customization
One size does not fit all when it comes to hand interactions in VR. Different users have different preferences and comfort levels, so it's important to allow for customization. This can include things like sensitivity settings, grip strength, and the ability to adjust the size and position of the hand model.


Test and iterate
Finally, it's important to remember that hand interactions in VR are an ongoing process. The best way to improve hand interactions is to test and iterate. Gather feedback from users and use that feedback to make adjustments and improvements.

Improving hand interactions in virtual reality is a complex task, but by using high-quality tracking devices, optimizing hand models and animations, providing clear visual feedback, allowing for customization and testing and iterating, you can create a more immersive and natural experience for your users.

Various techniques and best practices for enhancing hand interactions in virtual reality.

This blog post covers various techniques and best practices for enhancing hand interactions in virtual reality. The post highlights the importance of using high-quality hand tracking devices, optimizing hand models and animations, providing clear visual feedback, allowing for customization, and testing and iterating. By following these tips, businesses and developers can create more immersive and natural hand interactions in VR, which can improve the overall user experience. 

How to Improve Hand Interactions in Virtual Reality

Virtual reality has the power to transport users to entirely new worlds, but it's the interactions within those worlds that truly immerse users and make the experience feel real. Interactions in virtual reality are what allow users to engage with the virtual environment and make it feel like a real, living space. Without them, the experience would be limited and lack the feeling of immersion. This is why interactions play a crucial role in enhancing the user experience in virtual reality.

One of the key elements of interactions in virtual reality is realism. Users expect to be able to interact with virtual objects in a way that feels natural and intuitive, just as they would in the real world. This is where hand tracking and gesture recognition come into play. These technologies allow for the detection of hand and finger movements, enabling developers to create interactive VR experiences that respond to natural hand gestures. This eliminates the need for complex coding and allows for faster development times. 

Another important aspect of interactions in virtual reality is the ability to manipulate virtual objects. This can range from simple actions like picking up and moving an object, to more complex actions like assembling a virtual puzzle. Hand tracking technology allows for the detection of hand position and movement, enabling developers to create realistic and intuitive interactions within the virtual world. This includes grasping, reaching, and manipulating virtual objects.

In addition to these features, pre-built interactions such as button presses, sliders, and toggle switches, can be easily integrated into VR environments. This eliminates the need for developers to start from scratch and allows them to focus on creating unique and engaging VR experiences. 

As explained, interactions play a vital role in enhancing the user experience in virtual reality. They allow users to engage with the virtual environment in a natural and intuitive way and make the experience feel more real. As VR technology continues to evolve, we can expect to see even more advanced and realistic interactions being developed, further immersing users in virtual worlds. 

At SpectreXR, we understand the importance of interactions in virtual reality and strive to provide developers with the tools they need to create the most immersive and engaging virtual reality experiences. If you're a developer or a VR enthusiast interested in enhancing the user experience in virtual reality, we encourage you to check out our OctoXR at https://spectrexr.io/octo-xr.  

Interactions in virtual reality are what allow users to engage with the virtual environment and make it feel like a real, living space. 

Interactions in VR are important because they allow users to interact with and manipulate virtual environments in a natural and intuitive way. This can enhance the sense of immersion and make the experience more engaging and realistic. Interactions also allow users to perform tasks and accomplish goals within the virtual world, which can be useful for education, training, and entertainment. Additionally, interactions in VR can provide opportunities for social interaction and communication, allowing users to collaborate and connect with others in a shared virtual space.

The Importance of Interactions in Virtual Reality: Enhancing User Experience

The Oculus Quest is a revolutionary virtual reality headset that allows users to experience immersive games and apps without the need for a PC or external sensors. It’s a high-quality VR headset that’s easy to use, that offers a wide range of content, and it comes at relatively low price. One of the most exciting features of the Quest is its ability to track your hands and fingers using its onboard cameras, allowing for a more intuitive and natural VR experience. This feature was released on December 10, 2019, and since then it was used in many interesting VR solutions. In this article we decided to cover the 5 best hand tracking games that are available on Oculus Quest. It’s important to say that we tested these games only on Oculus Quest 2 so some experiences might be different on the original Quest. 

If you're looking for the best hand tracking games on the Oculus Quest 2, you can't go wrong with Cubism, Hand Physics Lab, Unplugged, Vacation Simulator and Elixir. These games all showcase the incredible potential of hand tracking in VR and provide hours of entertainment and fun. 

Cubism is a puzzle game that challenges players to manipulate 3D objects using their hands. The game's intuitive controls make it easy to pick up and play, and its colorful, minimalist art style is a joy to behold. It’s important to mention that Cubism has a passthrough mode which lets you solve the puzzles while still completely aware of your surroundings. Whether you're a seasoned VR veteran or a newcomer to the world of hand tracking, you'll love the challenge and satisfaction of solving Cubism's increasingly complex puzzles. 

Hand Physics Lab is a physics-based sandbox game that lets players experiment with a wide variety of objects and materials. From building structures and machines to creating intricate Rube Goldberg contraptions, Hand Physics Lab offers endless possibilities for creativity and exploration. Its intuitive hand tracking controls make it easy to interact with objects and experiment with different materials, making it a must-play for anyone looking to unleash their inner scientist in VR. It’s also a great game for the first time users of hand tracking.

It's a Guitar Hero but in VR. We think that’s the best description for Unplugged: Air Guitar. Players use their hands to simulate playing a guitar, following along with on-screen prompts to hit notes and strum chords. The game includes a variety of different songs and difficulty levels, and of course, tracks your progress and scores. It’s a fun and immersive way to experience playing a guitar. And don’t worry, you don't have to have any musical experience or a guitar. Unplugged is a great choice for music enthusiasts or anyone looking for a unique and entertaining VR experience.

Vacation Simulator is a lighthearted VR game that lets players explore a colorful, fantastical world filled with interesting characters and activities. From lounging on the beach to playing mini-games and exploring hidden secrets, Vacation Simulator will offer you a relaxing and enjoyable VR experience that's perfect for unwinding after a long day. Its intuitive hand tracking controls make it easy to interact with the game's vibrant world, making it a must-play for fans of casual VR games.

Elixir is a game that utilizes hand tracking to allow players to experience the sensation of casting spells, mixing chemicals, and transforming their fingers into other objects. The game is set in a surreal world where players follow the guidance of a sorceress as they navigate dangerous and magical situations in order to land a job in a magical laboratory. The use of hand tracking helps to create a sense of presence and allows players to safely experiment with scenarios that might be uncomfortable in real life. The game includes a variety of interactive elements, including poking monsters in the eye, rubbing a dragon's belly, snuffing out candle flames, and punching giant fireflies out of the sky.

In conclusion, the Oculus Quest's hand tracking capabilities open up a world of possibilities for immersive and intuitive VR experiences. Whether you're looking for a challenging puzzle game, a physics-based sandbox, an escape room adventure, or a rhythm game, there's a hand tracking game on the Oculus Quest that's sure to appeal to you. So why not try out one of these amazing hand tracking games today and discover the magic of VR for yourself!

5 best VR games that showcase the potential of hand tracking and provide hours of entertainment and fun. 

The Oculus Quest is a virtual reality headset that allows users to experience immersive games and apps without the need for a PC or external sensors. Its hand tracking feature, released in December 2019, allows for a more intuitive and natural VR experience. In this article, we cover the 5 best hand tracking games on the Oculus Quest 2: Cubism, Hand Physics Lab, Unplugged: Air Guitar, Vacation Simulator, and Elixir. These games showcase the potential of hand tracking in VR and provide hours of entertainment and fun. 

The 5 Best Hand Tracking VR Games on Oculus Quest

Crunchfish and SpectreXR have joined forces to provide a complete solution for the AR/VR market. The incorporation of Crunchfish's XR Skeleton into SpectreXR's OctoXR product enables users to interact with virtual objects in a realistic manner by utilizing hand-tracking technology and advanced software developed by both parties. This collaboration reduces the time and complexity involved in developing interactive AR software systems and apps, and it marks an important step forward in incorporating hand interactions into AR technology. 

While OctoXR allows users to add interactions with virtual elements quickly, Crunchfish XR Skeleton adds hand-tracking capabilities to AR/VR devices by analyzing the image stream from the camera sensor(s) and then tracking 21 points on each hand with high precision. This set of 42 coordinates is then used to interact with virtual objects. 

It is very complex to design and develop virtual objects in AR/VR. The objects appear in three dimensions and must look and feel as real as possible, which necessitates advanced software and very specific skills.

"One of our most important long-term goals has always been to bring OctoXR into AR technology, and when Crunchfish introduced their XR Skeleton, we knew that this integration was a big step towards that," said Ivan Rajkovic, CEO at SpectreXR. 

“I was very impressed by how fast XR Skeleton could be integrated into OctoXR and get to a working demo. The combination of Crunchfish’s XR Skeleton and OctoXR enables a powerful solution that may shorten the time to market for many of our customers”, says Joakim Nydemark, CEO at Crunchfish Gesture Interaction.

For more information on how to work with us, please contact:

Ivan Rajković, CEO of SpectreXR
+385 98 9858 830
ivan@spectrexr.io

Joakim Nydemark, CEO of Crunchfish Gesture Interaction AB
+46 706 35 16 09
joakim.nydemark@crunchfish.com

SpectreXR and Crunchfish have partnered to offer a comprehensive solution for the AR/VR market that enables users to interact with virtual objects in a realistic way using hand tracking technology.

The integration of Crunchfish's XR Skeleton into SpectreXR's OctoXR allows for seamless interaction with virtual objects in AR/VR, making it possible to enable any AR/VR device with a powerful object interaction solution in a short amount of time. This partnership will significantly reduce the time and complexity involved in developing interactive AR/VR software systems and apps, bringing hand interactions into AR technology.

Bringing Hand Tracking and Interactions into AR: SpectreXR partners with Crunchfish

Virtual Reality (VR) technology has come a long way in recent years, and one of the most impressive developments has been the ability to track hand movements in real-time. This technology allows for highly realistic hand interactions in VR, which has a number of benefits for training and other use cases.

One of the key benefits of VR training with hand interactions is the increased realism. When using VR controllers, there is a disconnect between the user's real hands and the virtual hands being controlled. This can make it difficult to fully engage with the VR environment and can even lead to discomfort.

However, with hand tracking technology, users can see their own hands in the VR environment and interact with virtual objects in a natural and intuitive way. This makes the experience much more immersive and engaging, which can help to improve the effectiveness of training programs.

There are a number of different use cases for VR training with hand interactions. For example, it can be used to train surgeons on new techniques, or to simulate complex industrial processes for workers. It can also be used in the military to train soldiers for combat situations, or in the aviation industry to train pilots on emergency procedures.

In addition to these more traditional use cases, VR training with hand interactions is also being used by a number of big companies in creative ways. For instance, Walmart is using VR technology to train its employees on customer service and other skills. By using VR to simulate real-life situations, Walmart is able to provide its employees with a more engaging and effective training experience.

Another example is the use of VR technology by the car manufacturer Audi. Audi is using VR to train its assembly line workers on new processes and procedures, which has helped to increase efficiency and reduce errors. This demonstrates the potential of VR training with hand interactions to improve the effectiveness of employee training across a wide range of industries.

In conclusion, the ability to track hand movements in real-time has opened up a whole new world of possibilities for VR technology. The increased realism of hand interactions in VR has a number of benefits for training and other use cases, and is already being embraced by a number of big companies. As VR technology continues to evolve, we can expect to see even more innovative uses for hand tracking in the future.

VR technology that tracks hand movements in real-time allows for more realistic training experiences, improving the effectiveness of training and has a number of benefits for various use cases.

Virtual reality (VR) technology has made significant advancements in recent years, including the ability to track hand movements in real-time. This technology allows for realistic hand interactions in VR, which can improve the effectiveness of training programs and has a number of benefits for various use cases. Some examples include training surgeons, simulating industrial processes for workers, and training pilots on emergency procedures. In addition, big companies such as Walmart and Audi are using VR to train employees on customer service and new processes, respectively, in an effort to increase efficiency and reduce errors. Overall, the potential of VR training with hand interactions to improve employee training across industries is significant.

The Benefits and Use Cases of VR Training with Hand Interactions

As more and more companies begin to adopt virtual reality (VR) technology, the need for realistic and intuitive hand interactions within VR environments has become increasingly important. That's why hand tracking is one of the key areas of development. From optical tracking to electromyography (EMG) sensors, there are a number of technologies and techniques being used to improve the accuracy and responsiveness of hand tracking in VR. This technology has the potential to greatly enhance the VR experience, allowing users to interact with virtual objects in a more natural and intuitive way. In this blog post, we will explore some of the latest advances in hand tracking for VR and how they are helping to enhance the user experience.

One of the main challenges with hand tracking in VR is the need for accurate and real-time tracking of the user's hand movements and gestures. Traditional VR controllers, while effective for some tasks, can be awkward and unnatural to use, limiting the immersion of the VR experience. By using advanced sensors and algorithms, hand tracking technology is able to accurately capture the movements of the user's hands and translate them into virtual actions. In order for hand interactions in VR to feel natural and intuitive, the VR system must be able to accurately and quickly detect and respond to the user's hand movements. This requires sophisticated tracking algorithms and hardware, and is an area where ongoing research and development is needed.

While researching the latest advances in hand tracking for VR one thing was popping out - electromyography (EMG) sensors. EMG sensors are small sensors that can be placed on the user's skin to detect the electrical signals generated by the muscles in the hand. By using EMG sensors, VR systems can accurately track the user's hand movements and gestures in real-time, providing a more natural and responsive hand tracking experience.

Another emerging technology that is being used to improve hand tracking in VR is optical tracking. Optical tracking involves the use of cameras or other sensors to detect the movement and position of the user's hands. This can be done using markers placed on the user's hands, or by using advanced computer vision algorithms to track the movement of the hands in the 3D space. Optical tracking can provide high-precision hand tracking, and is an important technology for improving the accuracy and responsiveness of hand interactions in VR.

In addition to these technologies, there are also a number of other advances in hand tracking for VR that are worth exploring. For example, there are new algorithms and techniques being developed for improving the accuracy and reliability of hand tracking, as well as new hardware devices and sensors that are being designed specifically for VR applications.

A company that is at the forefront of this technology is Leap Motion. They have developed a hand tracking system that uses a combination of infrared cameras and LED lights to capture the movements of the user's hands. This system is able to track the position, orientation, and movement of the user's hands with incredible accuracy, allowing them to interact with virtual objects in a natural and intuitive way.

Another company, Manus VR, has developed a hand tracking system that uses sensors mounted on the user's wrists and fingers to capture the movements of their hands. This system is able to track the movements of the user's fingers individually, allowing for even more precise and realistic interactions with virtual objects.

Although it should be noted, having your hands tracked in VR is just a half of the business. The second part is to add realistic interactions and that's where OctoXR shines the best. But that's a topic we'll cover in another blog post.

Overall, the future of hand tracking in VR looks bright, and there are a number of exciting advances on the horizon. By continuing to push the boundaries of hand tracking technology, we can create more realistic and immersive VR experiences that provide users with a truly interactive and engaging virtual world.

Get the inside scoop on the latest advances in VR hand tracking, from cutting-edge technologies to real-world applications.

In this blog post, we delve into the exciting world of virtual reality hand tracking. From cutting-edge technologies to real-world applications, we cover the latest advances in this rapidly-evolving field. Discover how hand tracking is revolutionizing VR experiences and learn about the companies and researchers driving these innovations. Get ready to immerse yourself in the future of VR hand tracking!

Exploring the Latest Advances in Hand Tracking for VR

Virtual reality (VR) technology is rapidly advancing, and with it, the ability to interact with virtual environments using your hands. This has opened up a world of possibilities for VR applications, from gaming to medical training and beyond. If you're a developer interested in creating VR applications with hand interactions, this beginner's guide is for you.

First, let's define what we mean by hand interactions in VR. Hand interactions refer to the ability for users to manipulate virtual objects and environments using only their hands, in a natural and intuitive way. This can be achieved through the use of VR headsets that are equipped with sensors and cameras that track the movement and position of the user's hands. These sensors send data to the VR system, which then translates the hand gestures into appropriate actions in the virtual environment.

To develop hand interactions for VR applications, you'll need to have a solid understanding of VR technology and its underlying principles. This will involve learning about VR hardware, such as headsets and controllers, as well as the software tools and platforms used to create VR experiences. Additionally, you'll need to have some familiarity with programming languages and frameworks commonly used for VR development, such as C++, C#, Unity, and Unreal Engine. In this guide, we’ll focus on Unity. Unity is a popular game engine that provides a powerful and versatile platform for creating VR experiences. It offers a range of tools and features specifically designed for VR development, including support for hand interactions. 

Once you have a basic understanding of Unity and VR technology, you can begin to focus on developing hand interactions specifically. Unity provides a range of tools and features that can help with this, including support for different types of VR hardware and sensors, and the ability to customize and fine-tune hand interactions.

One key aspect of developing hand interactions using Unity is the use of scripts. These are small programs written in C# that control the behavior of your VR application, including how it responds to hand gestures and movements. To create hand interactions, you'll need to write scripts that interpret data from the VR hardware, and use that data to generate appropriate responses in the virtual environment. This can involve complex algorithms and systems, but Unity and its ecosystem provide a range of tools and resources that can help make the process easier. One of these tools is definitely OctoXR, a no-code/low-code plugin for Unity that lets you create most realistic hand interactions in just a few steps.  

Another important aspect of developing hand interactions using Unity is testing and debugging. As with any software development project, it's important to test your VR application thoroughly, to ensure that it works as expected and provides a seamless and enjoyable experience for users. Unity provides a range of tools and features that can help with this, including the ability to test your VR application in real-time, and to identify and fix any issues or bugs that may arise.

Although OctoXR solves most of the challenges of hand interactions, we will mention a few. One of the challenges is ensuring that the virtual environment responds to the user's hand gestures in a realistic and believable way. This requires a deep understanding of both the hardware and software aspects of VR development, as well as an ability to design and implement complex algorithms and systems.

Another challenge is the need to optimize the VR experience for different users and devices. VR hand interactions can be computationally intensive, and may require significant processing power to run smoothly. As a result, you'll need to ensure that your VR application is optimized for a range of different devices and hardware configurations, in order to provide a seamless and enjoyable experience for all users.

Overall, developing hand interactions for VR applications is a complex and challenging task, but one that can provide a wealth of opportunities for innovation and creativity. By mastering the skills and technologies involved, you can create immersive and engaging VR experiences that allow users to interact with virtual environments in a natural and intuitive way. Whether you're interested in gaming, medical training, or any other application, VR hand interactions offer endless possibilities for exploration and discovery.

A guide on how to create realistic hand interactions for virtual reality applications in Unity

A beginner's guide to developing hand interactions for VR applications. In this blog post, we will provide a guide on how to create realistic hand interactions for virtual reality applications in Unity. Whether you are a VR developer looking to improve your skills or a complete beginner interested in learning about VR development, this guide is for you. Follow along as we explore the key concepts and techniques for creating immersive and intuitive hand interactions for VR applications.

A Beginner's Guide to Developing Hand Interactions for VR Applications

The history of hand tracking in virtual reality (VR) goes back several decades, with early efforts dating back to the 1980s and 1990s. At that time, VR was still in its infancy, and the technology to accurately track hand movements in real-time was not yet available.

One of the first notable attempts at hand tracking in VR was the DataGlove, developed by VPL Research in the late 1980s. The DataGlove used sensors and motion-capture technology to track the movement of the user's hand and fingers, allowing them to interact with virtual objects in a limited way. However, the technology was still primitive and the DataGlove was not widely adopted.

As VR technology continued to evolve, so did hand tracking. In the 2000s, companies like Ultraleap and Sixense began developing their own hand-tracking systems, using a combination of sensors and machine learning algorithms to achieve more accurate and responsive tracking. In recent years, hand tracking has become an increasingly important part of VR technology, with the Oculus Quest including the ability to track hand movements without additional sensors.

Since the Oculus Quest first added hand tracking as a feature, many users have been impressed by the accuracy and responsiveness of the system. It allows them to interact with virtual objects and environments in a more natural and intuitive way, without the need for any additional sensors or equipment. The Oculus hand tracking got even better with the newer version of the device. 

One of the biggest advantages of Oculus Quest hand tracking is that it opens up new possibilities for VR experiences. For example, instead of using a traditional game controller, users can simply use their hands to play games or navigate menus. This can make the VR experience more immersive and engaging, as it feels more like you're actually interacting with the virtual world.

In addition to gaming, hand tracking on the Oculus Quest has also been used for other purposes, such as education and virtual reality training. For example, it can be used to teach people how to perform certain tasks in a virtual environment, allowing them to practice and learn without the need for costly and time-consuming physical simulations.

Overall, Oculus Quest 2 hand tracking has been well-received by users and has the potential to revolutionize the way we use VR. It's still a relatively new technology, so there may be some limitations and bugs, but it's an exciting development that has the potential to greatly enhance the VR experience.

Apart from Oculus there are now numerous devices that support hand tracking like Pico 4 or Varjo XR-3, VR-3 and VR-2. As the technology continues to advance, we can expect to see even more impressive and immersive hand tracking capabilities in VR headsets and other devices. Hand tracking in VR offers a more intuitive and immersive experience, making it an important aspect of the future of virtual reality technology.

Learn about the history of hand tracking in virtual reality, from the early days of the DataGlove to the latest developments like Oculus Quest hand tracking. 

Explore the history of hand tracking in virtual reality, from the early days of the DataGlove to the latest developments in VR technology. Learn about the key players and milestones in the evolution of hand tracking, and discover the potential of this exciting technology for the future of VR.

 Brief History of Hand Tracking in Virtual Reality

To better understand the tool that we developed, reader needs to understand the concept of hand tracking technology, what preceded it, and why is it a more immersive and realistic way of interaction in VR, at least in our humble opinion.

Hand tracking is slowly but surely becoming an integral feature of recent generations of immersive virtual reality devices. It allows users to interact with all sorts of virtual elements without the need to use controllers. Sensors and cameras on VR headsets track users' hands and then use the data they gather to create a real-time virtual embodiment of them. 

Croatia For Everyone

About the project

Funding

Related articles

What is spatial computing?

Revolutionizing Rehabilitation and Therapy with Immersive VR and Hand Tracking Technology