Breaking News
light_mode
Trending Tags
Beranda » Software » The Future of Mixed Reality: Blending the Virtual and the Real

The Future of Mixed Reality: Blending the Virtual and the Real

  • account_circle Lili Cheng
  • calendar_month Selasa, 28 Jan 2025
  • visibility 917
  • comment 0 komentar

At Microsoft Ignite 2023, we are announcing Copilot in Microsoft Dynamics 365 Guides, which combines the power of generative AI with mixed reality to help frontline workers complete complex tasks and resolve issues faster with less disruption to the flow of work.

Copilot in Dynamics 365 Guides assists workers in industrial settings who deal with complex equipment and processes. New technicians need to ramp up quickly while learning how to operate and service that equipment. When equipment stops functioning, workers must act quickly to diagnose the problem, implement a fix, and then document their work. Instead of workers needing to search through volumes of digital documents or paper manuals, Copilot enables workers to ask for relevant information using natural language and human gestures, such as looking and pointing. Copilot uses generative AI to search for information from technical documentation, service records, training content, and any other data sources that customers curate. Copilot then summarizes the information to provide interactive guidance through content and holograms overlaid on the equipment in operation or maintenance.

Mixed reality together with AI presents a human-first interface that promises to transform real-world operations. Now, Copilot can assist industrial workers in real-time with speech and holograms.

Copilot in Dynamics 365 Guides capabilities

Here are the capabilities we plan to unlock with Copilot in Dynamics 365 Guides:

Point and Ask Guidance

Humans have always learned from and interacted with their environment in a hands-on manner, asking questions of others as they work. Copilot in Dynamics 365 Guides builds on that natural way of interacting to help workers better understand the world around them. Workers can point to a component on an asset and ask Copilot questions, such as “What is the torque limit for these bolts?” New workers can ask general questions, such as “What is the function of this component?” without needing to interrupt a more experienced coworker. Copilot recognizes what the user is pointing at and provides answers. 3D models and spatial maps provide the foundation for the technology to identify what the worker is looking at and then project a hologram to show instructions. Workers can ask more complex questions, such as “Which direction does this part fit?” or “Show me where the sensor module is on this machine,” and Copilot will display holograms to show where the part belongs.

Spatial Content Generation

Copilot in Dynamics 365 Guides accelerates the out-of-the-box value of mixed reality by significantly reducing the upfront investment needed to create spatial content. Copilot simplifies the creation, management, and delivery of mixed reality content using customer-defined data sources, enabling companies to adopt mixed reality much faster.

Step-by-Step Assistance

Powered by Microsoft Azure OpenAI Service, large language models allow Copilot in Dynamics 365 Guides to do far more than answer one-off questions. Workers can have progressive conversations, such as “Walk me through the steps to disassemble this filtration unit,” or “I disconnected the motor, what’s next?” Copilot follows along with the process and conversation using customer’s curated knowledge base to articulate answers with speech, text, or 3D holograms, eliminating ambiguity and reducing the need for rework.

Rekomendasi Untuk Anda

  • Design Transcended: When Art Meets Technology in Gadgetry

    Design Transcended: When Art Meets Technology in Gadgetry

    • calendar_month Jumat, 2 Feb 2024
    • visibility 284
    • 0Komentar

    Exploring the Tech-Savvy WondersThe delineation between digital and physical continues to blur, weaving a fabric of reality that resonates with the beats of progress. Within this exciting nexus, entrepreneurs and tech aficionados find a fertile ground to cultivate, explore, and thrive. As we navigate through the myriad of gadget-driven narratives, there are key trends and […]

  • Konsolidasi Akbar Tim Pemenangan Fadly Amran – Maigus Nasir

    Konsolidasi Akbar Tim Pemenangan Fadly Amran – Maigus Nasir

    • calendar_month Senin, 21 Okt 2024
    • visibility 17
    • 0Komentar

    Pasangan Calon Wali Kota dan Wakil Walikota Padang nomor 1, mengadakan acara Konsolidasi Akbar Tim Pemenangan pada Minggu (20/10) di ZHM Premier Hotel yang di hadiri semua Tim Pemenangan baik dari 10 Partai Politik, Tokoh Masyarakat dan Relawan. “Kami ingin masyarakat tahu apa yang menjadi visi dan misi kami, bukan hanya tahu dengan diri kami […]

  • Streamlining Tasks: Automation Gadgets Revolutionizing Everyday Work

    Streamlining Tasks: Automation Gadgets Revolutionizing Everyday Work

    • calendar_month Rabu, 17 Jan 2024
    • visibility 347
    • 0Komentar

    As the timeline of technology perpetually accelerates, 2023 emerges as a testament to human creativity and ingenuity. The realm of gadgets is no longer restricted to mere utility; it’s about amplifying human potential and redefining boundaries. With each passing day, these handheld marvels become an even more integrated part of our daily lives, intertwining with […]

  • Next-Gen Consoles and Accessories for the Ultimate Experience

    Next-Gen Consoles and Accessories for the Ultimate Experience

    • calendar_month Minggu, 7 Jan 2024
    • visibility 291
    • 0Komentar

    Exploring the Tech-Savvy WondersThe delineation between digital and physical continues to blur, weaving a fabric of reality that resonates with the beats of progress. Within this exciting nexus, entrepreneurs and tech aficionados find a fertile ground to cultivate, explore, and thrive. As we navigate through the myriad of gadget-driven narratives, there are key trends and […]

  • Will Cristiano Ronaldo Play Tonight in Al-Nassr vs Al-Ettifaq Saudi Pro League 2024-25 Match? 12.39 Play Button

    Will Cristiano Ronaldo Play Tonight in Al-Nassr vs Al-Ettifaq Saudi Pro League 2024-25 Match?

    • calendar_month Minggu, 23 Feb 2025
    • visibility 45
    • 0Komentar

    Al Nassr failed to win major title with Cristiano Ronaldo in the squad. The Portuguese superstar has been incredible in front of the goal and led the league in goals scored in both his full seasons. Currently the side at the third position in the Saudi Pro League 2024-25 standings, with just 14 games remaining. […]

  • Messi has two assists as Inter Miami plays NYCFC to draw in MLS season opener: Highlights 07.09 Play Button

    Messi has two assists as Inter Miami plays NYCFC to draw in MLS season opener: Highlights

    • calendar_month Senin, 20 Jan 2025
    • visibility 14
    • 0Komentar

    All it took was five minutes for Lionel Messi to make his mark at the start of Inter Miami’s 2025 Major League Soccer season. About 95 minutes later, Messi shined again, saving Inter Miami’s night. Messi found new teammate Telasco Segovia, trailing on his right side, and delivered his second assist of the game in […]

expand_less