[go: up one dir, main page]

WO2022056036A3 - Methods for manipulating objects in an environment - Google Patents

Methods for manipulating objects in an environment Download PDF

Info

Publication number
WO2022056036A3
WO2022056036A3 PCT/US2021/049520 US2021049520W WO2022056036A3 WO 2022056036 A3 WO2022056036 A3 WO 2022056036A3 US 2021049520 W US2021049520 W US 2021049520W WO 2022056036 A3 WO2022056036 A3 WO 2022056036A3
Authority
WO
WIPO (PCT)
Prior art keywords
electronic device
environment
methods
manipulating objects
dimensional environment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2021/049520
Other languages
French (fr)
Other versions
WO2022056036A2 (en
Inventor
William D. Lindmeier
Matan Stauber
Stephen O. Lemay
Matthew J. Sundstrom
Madeleine CORDIER
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Apple Inc
Original Assignee
Apple Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Apple Inc filed Critical Apple Inc
Priority to CN202310680857.1A priority Critical patent/CN116719413A/en
Priority to EP25174955.2A priority patent/EP4575742A3/en
Priority to EP21794036.0A priority patent/EP4211661A2/en
Priority to CN202180066218.5A priority patent/CN116324680A/en
Publication of WO2022056036A2 publication Critical patent/WO2022056036A2/en
Publication of WO2022056036A3 publication Critical patent/WO2022056036A3/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842—Selection of displayed objects or displayed text elements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G06T2200/24—Indexing scheme for image data processing or generation, in general involving graphical user interfaces [GUIs]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/20—Indexing scheme for editing of 3D models
    • G06T2219/2016—Rotation, translation, scaling

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • Geometry (AREA)
  • Architecture (AREA)
  • User Interface Of Digital Computer (AREA)
  • Position Input By Displaying (AREA)

Abstract

In some embodiments, an electronic device enhances a two-dimensional drawing. In some embodiments, an electronic device manipulates an object in a three-dimensional environment. In some embodiments, an electronic device displays a contextual menu or moving an object in a three-dimensional environment. In some embodiments, an electronic device moves an object in a three-dimensional environment by an amount based on the distance of the object from the user. In some embodiments, an electronic device scans a real world object. In some embodiments, an electronic device manipulates a distant object.
PCT/US2021/049520 2020-09-11 2021-09-08 Methods for manipulating objects in an environment Ceased WO2022056036A2 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
CN202310680857.1A CN116719413A (en) 2020-09-11 2021-09-08 Methods for manipulating objects in the environment
EP25174955.2A EP4575742A3 (en) 2020-09-11 2021-09-08 Methods for manipulating objects in an environment
EP21794036.0A EP4211661A2 (en) 2020-09-11 2021-09-08 Methods for manipulating objects in an environment
CN202180066218.5A CN116324680A (en) 2020-09-11 2021-09-08 Methods for manipulating objects in the environment

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US202063077521P 2020-09-11 2020-09-11
US63/077,521 2020-09-11

Publications (2)

Publication Number Publication Date
WO2022056036A2 WO2022056036A2 (en) 2022-03-17
WO2022056036A3 true WO2022056036A3 (en) 2022-05-05

Family

ID=78212613

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2021/049520 Ceased WO2022056036A2 (en) 2020-09-11 2021-09-08 Methods for manipulating objects in an environment

Country Status (4)

Country Link
US (2) US12307580B2 (en)
EP (2) EP4575742A3 (en)
CN (2) CN116719413A (en)
WO (1) WO2022056036A2 (en)

Families Citing this family (94)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI439960B (en) 2010-04-07 2014-06-01 蘋果公司 Virtual user editing environment
US12511840B2 (en) * 2016-01-07 2025-12-30 Northwest Instrument Inc. Intelligent interface based on augmented reality
CN109791702B (en) 2016-09-23 2023-09-29 苹果公司 Avatar creation and editing
US11722764B2 (en) 2018-05-07 2023-08-08 Apple Inc. Creative camera
US12033296B2 (en) 2018-05-07 2024-07-09 Apple Inc. Avatar creation user interface
US11107261B2 (en) 2019-01-18 2021-08-31 Apple Inc. Virtual avatar animation based on facial feature movement
WO2020242047A1 (en) * 2019-05-30 2020-12-03 Samsung Electronics Co., Ltd. Method and apparatus for acquiring virtual object data in augmented reality
US10890983B2 (en) 2019-06-07 2021-01-12 Facebook Technologies, Llc Artificial reality system having a sliding menu
US11307647B2 (en) 2019-09-11 2022-04-19 Facebook Technologies, Llc Artificial reality triggered by physical object
DK202070624A1 (en) 2020-05-11 2022-01-04 Apple Inc User interfaces related to time
US11921998B2 (en) 2020-05-11 2024-03-05 Apple Inc. Editing features of an avatar
US11227445B1 (en) 2020-08-31 2022-01-18 Facebook Technologies, Llc Artificial reality augments and surfaces
US11176755B1 (en) 2020-08-31 2021-11-16 Facebook Technologies, Llc Artificial reality augments and surfaces
US12236546B1 (en) 2020-09-24 2025-02-25 Apple Inc. Object manipulations with a pointing device
EP3992936B1 (en) * 2020-11-02 2023-09-13 Axis AB A method of activating an object-specific action when tracking a moving object
US11113893B1 (en) * 2020-11-17 2021-09-07 Facebook Technologies, Llc Artificial reality environment with glints displayed by an extra reality device
JP2022087700A (en) * 2020-12-01 2022-06-13 京セラドキュメントソリューションズ株式会社 Electronic equipment and image forming equipment
US11409405B1 (en) 2020-12-22 2022-08-09 Facebook Technologies, Llc Augment orchestration in an artificial reality environment
US20220229535A1 (en) * 2021-01-19 2022-07-21 Samsung Electronics Company, Ltd. Systems and Methods for Manipulating Views and Shared Objects in XR Space
EP4295314A4 (en) 2021-02-08 2025-04-16 Sightful Computers Ltd AUGMENTED REALITY CONTENT SHARING
EP4288950A4 (en) 2021-02-08 2024-12-25 Sightful Computers Ltd User interactions in extended reality
JP7663915B2 (en) 2021-02-08 2025-04-17 サイトフル コンピューターズ リミテッド Extended Reality for Productivity
US11995230B2 (en) 2021-02-11 2024-05-28 Apple Inc. Methods for presenting and sharing content in an environment
US12125149B2 (en) 2021-02-16 2024-10-22 Apple Inc. Interfaces for presenting avatars in three-dimensional environments
WO2022204657A1 (en) 2021-03-22 2022-09-29 Apple Inc. Methods for manipulating objects in an environment
US12069209B2 (en) * 2021-04-15 2024-08-20 Canon Kabushiki Kaisha Information processing apparatus, information processing method, and storage medium that determine whether a current value of a non-position attribute value on which an operation of changing is being performed is within a predefined range
US11676348B2 (en) 2021-06-02 2023-06-13 Meta Platforms Technologies, Llc Dynamic mixed reality content in virtual reality
US11847793B2 (en) * 2021-06-18 2023-12-19 Qualcomm Incorporated Collaborative tracking
US11762952B2 (en) 2021-06-28 2023-09-19 Meta Platforms Technologies, Llc Artificial reality application lifecycle
US12141423B2 (en) 2021-06-29 2024-11-12 Apple Inc. Techniques for manipulating computer graphical objects
US12141914B2 (en) 2021-06-29 2024-11-12 Apple Inc. Techniques for manipulating computer graphical light sources
US11521361B1 (en) 2021-07-01 2022-12-06 Meta Platforms Technologies, Llc Environment model with surfaces and per-surface volumes
US12008717B2 (en) 2021-07-07 2024-06-11 Meta Platforms Technologies, Llc Artificial reality environment control through an artificial reality environment schema
US12242706B2 (en) 2021-07-28 2025-03-04 Apple Inc. Devices, methods and graphical user interfaces for three-dimensional preview of objects
WO2023009580A2 (en) * 2021-07-28 2023-02-02 Multinarity Ltd Using an extended reality appliance for productivity
US12236515B2 (en) 2021-07-28 2025-02-25 Apple Inc. System and method for interactive three- dimensional preview
US12056268B2 (en) 2021-08-17 2024-08-06 Meta Platforms Technologies, Llc Platformization of mixed reality objects in virtual reality environments
US12314480B2 (en) * 2021-08-17 2025-05-27 Sony Interactive Entertainment Inc. Information processing apparatus, information processing method, and program
US12293473B2 (en) * 2021-09-03 2025-05-06 Jiecong Lu Interactive augmented reality display
JP2023042128A (en) * 2021-09-14 2023-03-27 セイコーエプソン株式会社 Image editing support method and image editing support device
US20250004622A1 (en) * 2021-09-24 2025-01-02 Apple Inc. Object Manipulation in Graphical Environment
US12131429B2 (en) 2021-09-24 2024-10-29 Apple Inc. Devices, methods, and graphical user interfaces for displaying a representation of a user in an extended reality environment
US11748944B2 (en) 2021-10-27 2023-09-05 Meta Platforms Technologies, Llc Virtual object structures and interrelationships
US11798247B2 (en) 2021-10-27 2023-10-24 Meta Platforms Technologies, Llc Virtual object structures and interrelationships
TW202324172A (en) 2021-11-10 2023-06-16 美商元平台技術有限公司 Automatic artificial reality world creation
US11783555B2 (en) * 2021-11-16 2023-10-10 Peer Inc System and method for transferring content from one virtual environment to another
US12456271B1 (en) 2021-11-19 2025-10-28 Apple Inc. System and method of three-dimensional object cleanup and text annotation
US12153427B2 (en) * 2021-12-21 2024-11-26 Waymo Llc Systems, methods, and apparatus for using remote assistance to annotate images of an environment
EP4457595A4 (en) * 2021-12-29 2025-11-26 Voyetra Turtle Beach Inc WIRELESS KEYBOARD
WO2023137402A1 (en) 2022-01-12 2023-07-20 Apple Inc. Methods for displaying, selecting and moving objects and containers in an environment
US12093447B2 (en) 2022-01-13 2024-09-17 Meta Platforms Technologies, Llc Ephemeral artificial reality experiences
WO2023141535A1 (en) 2022-01-19 2023-07-27 Apple Inc. Methods for displaying and repositioning objects in an environment
US11948263B1 (en) 2023-03-14 2024-04-02 Sightful Computers Ltd Recording the complete physical and extended reality environments of a user
US12175614B2 (en) 2022-01-25 2024-12-24 Sightful Computers Ltd Recording the complete physical and extended reality environments of a user
US12380238B2 (en) 2022-01-25 2025-08-05 Sightful Computers Ltd Dual mode presentation of user interface elements
US12067688B2 (en) 2022-02-14 2024-08-20 Meta Platforms Technologies, Llc Coordination of interactions of virtual objects
US20230260239A1 (en) * 2022-02-14 2023-08-17 Meta Platforms, Inc. Turning a Two-Dimensional Image into a Skybox
US12541280B2 (en) 2022-02-28 2026-02-03 Apple Inc. System and method of three-dimensional placement and refinement in multi-user communication sessions
US11868607B2 (en) * 2022-03-10 2024-01-09 Ricoh Company, Ltd. Display apparatus, display method, and non-transitory recording medium
TWI851973B (en) * 2022-03-11 2024-08-11 緯創資通股份有限公司 Virtual window configuration device, virtual window configuration method and virtual window configuration system
US12307613B2 (en) 2022-04-05 2025-05-20 Apple Inc. Devices, methods, and graphical user interfaces for modifying avatars in three-dimensional environments
US20230326144A1 (en) * 2022-04-08 2023-10-12 Meta Platforms Technologies, Llc Triggering Field Transitions for Artificial Reality Objects
US12026527B2 (en) 2022-05-10 2024-07-02 Meta Platforms Technologies, Llc World-controlled and application-controlled augments in an artificial-reality environment
US12283020B2 (en) 2022-05-17 2025-04-22 Apple Inc. Systems, methods, and user interfaces for generating a three-dimensional virtual representation of an object
EP4303697A1 (en) * 2022-07-05 2024-01-10 Deutsche Telekom AG Virtually activated interaction of a user with a physical object
US12111973B2 (en) * 2022-07-06 2024-10-08 Shopify Inc. System and method to manipulate virtual model based on physical parameters of gesture input
US12423926B2 (en) * 2022-07-28 2025-09-23 Ntt Docomo, Inc. XR multi-window control
EP4492206A4 (en) * 2022-08-04 2025-06-04 Samsung Electronics Co., Ltd WEARABLE ELECTRONIC DEVICE FOR DISPLAYING A VIRTUAL OBJECT, AND METHOD FOR CONTROLLING SAME
US20240054730A1 (en) * 2022-08-15 2024-02-15 Zebra Technologies Corporation Phased Capture Assessment and Feedback for Mobile Dimensioning
CN120315591A (en) * 2022-08-16 2025-07-15 苹果公司 Device and method for improving accessibility of interaction with a three-dimensional environment
US12287913B2 (en) * 2022-09-06 2025-04-29 Apple Inc. Devices, methods, and graphical user interfaces for controlling avatars within three-dimensional environments
US12112011B2 (en) 2022-09-16 2024-10-08 Apple Inc. System and method of application-based three-dimensional refinement in multi-user communication sessions
EP4591144A1 (en) 2022-09-23 2025-07-30 Apple Inc. Methods for manipulating a virtual object
US12524956B2 (en) 2022-09-24 2026-01-13 Apple Inc. Methods for time of day adjustments for environments and environment presentation during communication sessions
CN120266077A (en) 2022-09-24 2025-07-04 苹果公司 Methods for controlling and interacting with a three-dimensional environment
US12536762B2 (en) 2022-09-24 2026-01-27 Apple Inc. Systems and methods of creating and editing virtual objects using voxels
EP4595015A1 (en) 2022-09-30 2025-08-06 Sightful Computers Ltd Adaptive extended reality content presentation in multiple physical environments
JP2024055033A (en) * 2022-10-06 2024-04-18 キヤノン株式会社 Information processing device, information processing method, and program
US12444152B1 (en) 2022-10-21 2025-10-14 Meta Platforms Technologies, Llc Application multitasking in a three-dimensional environment
US20240161419A1 (en) * 2022-11-14 2024-05-16 Rockwell Automation Technologies, Inc. Virtual object interaction in augmented reality
US11947862B1 (en) 2022-12-30 2024-04-02 Meta Platforms Technologies, Llc Streaming native application content to artificial reality devices
JP2024098440A (en) * 2023-01-10 2024-07-23 株式会社東芝 Image Processing Device
CN120813918A (en) 2023-01-30 2025-10-17 苹果公司 Devices, methods, and graphical user interfaces for displaying multiple sets of controls in response to gaze and/or gesture input
US12400414B2 (en) 2023-02-08 2025-08-26 Meta Platforms Technologies, Llc Facilitating system user interface (UI) interactions in an artificial reality (XR) environment
US12387449B1 (en) 2023-02-08 2025-08-12 Meta Platforms Technologies, Llc Facilitating system user interface (UI) interactions in an artificial reality (XR) environment
DE102023105342A1 (en) * 2023-03-03 2024-09-05 Syncreality GmbH Scanning a room for VR/AR experiences
DE102023105347A1 (en) * 2023-03-03 2024-09-05 Syncreality GmbH Enrichment of classified objects in room scans with real-time data through radio and optical trackers
KR20240151533A (en) * 2023-04-11 2024-10-18 현대모비스 주식회사 Mouse control method and apparatus using gaze recognition
CN116400811A (en) * 2023-04-17 2023-07-07 北京字跳网络技术有限公司 Human-computer interaction method, device, storage medium and system for XR system
US20250272924A1 (en) * 2023-05-15 2025-08-28 Apple Inc. Head mountable display
CN121187445A (en) 2023-06-04 2025-12-23 苹果公司 Method for managing overlapping windows and applying visual effects
US20250110571A1 (en) * 2023-09-29 2025-04-03 Apple Inc. Devices, Methods, and Graphical User Interfaces for Providing Feedback Relating to Real-World Objects
JP2025066520A (en) * 2023-10-11 2025-04-23 株式会社東芝 Cross reality device, processing device, generation method, processing method, program, and storage medium
US20250308158A1 (en) * 2024-04-01 2025-10-02 William James Eaton, JR. Interactive Container Placement in a Map Module

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050062738A1 (en) * 1998-07-17 2005-03-24 Sensable Technologies, Inc. Systems and methods for creating virtual objects in a sketch mode in a haptic virtual reality environment
US20140104206A1 (en) * 2012-03-29 2014-04-17 Glen J. Anderson Creation of three-dimensional graphics using gestures
GB2540791A (en) * 2015-07-28 2017-02-01 Dexter Consulting Uk Ltd Apparatus, methods, computer programs and non-transitory computer-readable storage media for generating a three-dimensional model of an object
US20170221264A1 (en) * 2016-01-28 2017-08-03 Sony Computer Entertainment America Llc Methods and Systems for Navigation within Virtual Reality Space using Head Mounted Display
US20180348986A1 (en) * 2017-05-31 2018-12-06 Colopl, Inc. Method executed on computer for providing virtual space, program and information processing apparatus therefor
US20190018479A1 (en) * 2017-05-26 2019-01-17 Colopl, Inc. Program for providing virtual space, information processing apparatus for executing the program, and method for providing virtual space
US20190050062A1 (en) * 2017-08-10 2019-02-14 Google Llc Context-sensitive hand interaction
US20190164340A1 (en) * 2017-11-24 2019-05-30 Frederic Bavastro Augmented reality method and system for design
US20200128227A1 (en) * 2018-04-06 2020-04-23 Zspace, Inc. Replacing 2D Images with 3D Images

Family Cites Families (196)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5015188A (en) 1988-05-03 1991-05-14 The United States Of America As Represented By The Secretary Of The Air Force Three dimensional tactical element situation (3DTES) display
EP0661620B1 (en) * 1993-12-30 2001-03-21 Xerox Corporation Apparatus and method for executing multiple concatenated command gestures in a gesture based input system
US6426745B1 (en) 1997-04-28 2002-07-30 Computer Associates Think, Inc. Manipulating graphic objects in 3D scenes
CA2297971A1 (en) 1997-08-01 1999-02-11 Muse Technologies, Inc. Shared multi-user interface for multi-dimensional synthetic environments
US7844914B2 (en) 2004-07-30 2010-11-30 Apple Inc. Activating virtual keys of a touch-screen virtual keyboard
US7663607B2 (en) 2004-05-06 2010-02-16 Apple Inc. Multipoint touchscreen
US20060033724A1 (en) 2004-07-30 2006-02-16 Apple Computer, Inc. Virtual input device placement on a touch screen user interface
KR100595924B1 (en) 1998-01-26 2006-07-05 웨인 웨스터만 Method and apparatus for integrating manual input
US8479122B2 (en) 2004-07-30 2013-07-02 Apple Inc. Gestures for touch sensitive input devices
US7614008B2 (en) 2004-07-30 2009-11-03 Apple Inc. Operation of a computer with touch screen interface
US6295069B1 (en) 1998-08-18 2001-09-25 Alventive, Inc. Three dimensional computer graphics tool facilitating movement of displayed object
US6750873B1 (en) 2000-06-27 2004-06-15 International Business Machines Corporation High quality texture reconstruction from multiple scans
EP1189171A2 (en) * 2000-09-08 2002-03-20 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Method and apparatus for generating picture in a virtual studio
US7218226B2 (en) 2004-03-01 2007-05-15 Apple Inc. Acceleration-based theft detection system for portable electronic devices
US7688306B2 (en) 2000-10-02 2010-03-30 Apple Inc. Methods and apparatuses for operating a portable device based on an accelerometer
US6677932B1 (en) 2001-01-28 2004-01-13 Finger Works, Inc. System and method for recognizing touch typing under limited tactile feedback conditions
US6570557B1 (en) 2001-02-10 2003-05-27 Finger Works, Inc. Multi-touch system and method for emulating modifier keys via fingertip chords
US11275405B2 (en) 2005-03-04 2022-03-15 Apple Inc. Multi-functional hand-held device
ES2343964T3 (en) 2003-11-20 2010-08-13 Philips Solid-State Lighting Solutions, Inc. LIGHT SYSTEM MANAGER.
US7721226B2 (en) 2004-02-18 2010-05-18 Microsoft Corporation Glom widget
DE602005014239D1 (en) 2004-07-23 2009-06-10 3Shape As ADAPTIVE 3D SCANNING
US7653883B2 (en) 2004-07-30 2010-01-26 Apple Inc. Proximity detector in handheld device
US8381135B2 (en) 2004-07-30 2013-02-19 Apple Inc. Proximity detector in handheld device
JP4297442B2 (en) 2004-11-30 2009-07-15 富士通株式会社 Handwritten information input device
US7298370B1 (en) 2005-04-16 2007-11-20 Apple Inc. Depth ordering of planes and displaying interconnects having an appearance indicating data characteristics
US7580576B2 (en) 2005-06-02 2009-08-25 Microsoft Corporation Stroke localization and binding to electronic document
US7633076B2 (en) 2005-09-30 2009-12-15 Apple Inc. Automated response to and sensing of user activity in portable devices
US7657849B2 (en) 2005-12-23 2010-02-02 Apple Inc. Unlocking a device by performing gestures on an unlock image
US8279180B2 (en) 2006-05-02 2012-10-02 Apple Inc. Multipoint touch surface controller
US8006002B2 (en) 2006-12-12 2011-08-23 Apple Inc. Methods and systems for automatic configuration of peripherals
US7957762B2 (en) 2007-01-07 2011-06-07 Apple Inc. Using ambient light sensor to augment proximity sensor output
US20080310707A1 (en) 2007-06-15 2008-12-18 Microsoft Corporation Virtual reality enhancement using real world data
US9933937B2 (en) 2007-06-20 2018-04-03 Apple Inc. Portable multifunction device, method, and graphical user interface for playing online videos
US8948496B2 (en) 2008-08-29 2015-02-03 Koninklijke Philips N.V. Dynamic transfer of three-dimensional image data
US20100185949A1 (en) 2008-12-09 2010-07-22 Denny Jaeger Method for using gesture objects for computer control
US9383823B2 (en) 2009-05-29 2016-07-05 Microsoft Technology Licensing, Llc Combining gestures beyond skeletal
US9070206B2 (en) 2009-05-30 2015-06-30 Apple Inc. Providing a visible light source in an interactive three-dimensional compositing application
JP2011221604A (en) 2010-04-05 2011-11-04 Konica Minolta Business Technologies Inc Handwriting data management system, handwriting data management program, and handwriting data management method
EP2393056A1 (en) 2010-06-02 2011-12-07 Layar B.V. Acquiring, ranking and displaying points of interest for use in an augmented reality service provisioning system and graphical user interface for displaying such ranked points of interests
KR20120000663A (en) 2010-06-28 2012-01-04 주식회사 팬택 3D object processing device
US9619104B2 (en) 2010-10-01 2017-04-11 Smart Technologies Ulc Interactive input system having a 3D input space
US20120113223A1 (en) 2010-11-05 2012-05-10 Microsoft Corporation User Interaction in Augmented Reality
KR101758163B1 (en) 2010-12-31 2017-07-14 엘지전자 주식회사 Mobile terminal and hologram controlling method thereof
US9298334B1 (en) 2011-02-18 2016-03-29 Marvell International Ltd. Method and apparatus for providing a user interface having a guided task flow among a plurality of devices
WO2012135546A1 (en) 2011-03-29 2012-10-04 Qualcomm Incorporated Anchoring virtual images to real world surfaces in augmented reality systems
US9396580B1 (en) 2011-06-10 2016-07-19 Disney Enterprises, Inc. Programmable system for artistic volumetric lighting
EP2748795A1 (en) 2011-09-30 2014-07-02 Layar B.V. Feedback to user for indicating augmentability of an image
US9183672B1 (en) 2011-11-11 2015-11-10 Google Inc. Embeddable three-dimensional (3D) image viewer
US9513793B2 (en) 2012-02-24 2016-12-06 Blackberry Limited Method and apparatus for interconnected devices
GB2501471A (en) 2012-04-18 2013-10-30 Barco Nv Electronic conference arrangement
WO2013169849A2 (en) 2012-05-09 2013-11-14 Industries Llc Yknots Device, method, and graphical user interface for displaying user interface objects corresponding to an application
US9116666B2 (en) 2012-06-01 2015-08-25 Microsoft Technology Licensing, Llc Gesture based region identification for holograms
US20130332890A1 (en) 2012-06-06 2013-12-12 Google Inc. System and method for providing content for a point of interest
US9214137B2 (en) 2012-06-18 2015-12-15 Xerox Corporation Methods and systems for realistic rendering of digital objects in augmented reality
JP6271858B2 (en) 2012-07-04 2018-01-31 キヤノン株式会社 Display device and control method thereof
CN105378593B (en) * 2012-07-13 2019-03-01 索尼深度传感解决方案股份有限公司 Method and system for human-computer synchronous interaction based on gestures using singular interest points on the hand
US20140040832A1 (en) 2012-08-02 2014-02-06 Stephen Regelous Systems and methods for a modeless 3-d graphics manipulator
US9466121B2 (en) 2012-09-11 2016-10-11 Qualcomm Incorporated Devices and methods for augmented reality applications
US9378592B2 (en) 2012-09-14 2016-06-28 Lg Electronics Inc. Apparatus and method of providing user interface on head mounted display and head mounted display thereof
EP3435220B1 (en) 2012-12-29 2020-09-16 Apple Inc. Device, method and graphical user interface for transitioning between touch input to display output relationships
KR101494805B1 (en) 2013-01-28 2015-02-24 주식회사 위피엔피 System for producing three-dimensional content and method therefor
US9791921B2 (en) 2013-02-19 2017-10-17 Microsoft Technology Licensing, Llc Context-aware augmented reality object commands
US9294757B1 (en) 2013-03-15 2016-03-22 Google Inc. 3-dimensional videos of objects
US9234742B2 (en) 2013-05-01 2016-01-12 Faro Technologies, Inc. Method and apparatus for using gestures to control a laser tracker
US9245388B2 (en) * 2013-05-13 2016-01-26 Microsoft Technology Licensing, Llc Interactions of virtual objects with surfaces
US9495620B2 (en) 2013-06-09 2016-11-15 Apple Inc. Multi-script handwriting recognition using a universal recognizer
US9338440B2 (en) 2013-06-17 2016-05-10 Microsoft Technology Licensing, Llc User interface for three-dimensional modeling
KR20150026336A (en) 2013-09-02 2015-03-11 엘지전자 주식회사 Wearable display device and method of outputting content thereof
US20150123901A1 (en) 2013-11-04 2015-05-07 Microsoft Corporation Gesture disambiguation using orientation information
US9519999B1 (en) 2013-12-10 2016-12-13 Google Inc. Methods and systems for providing a preloader animation for image viewers
US9361732B2 (en) 2014-05-01 2016-06-07 Microsoft Technology Licensing, Llc Transitions between body-locked and world-locked augmented reality
US10579207B2 (en) 2014-05-14 2020-03-03 Purdue Research Foundation Manipulating virtual environment using non-instrumented physical object
US10416760B2 (en) 2014-07-25 2019-09-17 Microsoft Technology Licensing, Llc Gaze-based object placement within a virtual reality environment
KR102337682B1 (en) 2014-10-01 2021-12-09 삼성전자주식회사 Display apparatus and Method for controlling thereof
US9728010B2 (en) * 2014-12-30 2017-08-08 Microsoft Technology Licensing, Llc Virtual representations of real-world objects
US10284794B1 (en) 2015-01-07 2019-05-07 Car360 Inc. Three-dimensional stabilized 360-degree composite image capture
CN107209565B (en) 2015-01-20 2020-05-05 微软技术许可有限责任公司 Method and system for displaying fixed size augmented reality objects
US9779512B2 (en) 2015-01-29 2017-10-03 Microsoft Technology Licensing, Llc Automatic generation of virtual materials from real-world materials
US9911232B2 (en) 2015-02-27 2018-03-06 Microsoft Technology Licensing, Llc Molding and anchoring physically constrained virtual environments to real-world environments
WO2016164342A1 (en) 2015-04-06 2016-10-13 Scope Technologies Us Inc. Methods and apparatus for augmented reality applications
CN107787497B (en) 2015-06-10 2021-06-22 维塔驰有限公司 Method and apparatus for detecting gestures in a user-based spatial coordinate system
WO2016203282A1 (en) 2015-06-18 2016-12-22 The Nielsen Company (Us), Llc Methods and apparatus to capture photographs using mobile devices
EP3118722B1 (en) 2015-07-14 2020-07-01 Nokia Technologies Oy Mediated reality
US20170053383A1 (en) 2015-08-17 2017-02-23 Dae Hoon Heo Apparatus and method for providing 3d content and recording medium
US10007352B2 (en) 2015-08-21 2018-06-26 Microsoft Technology Licensing, Llc Holographic display system with undo functionality
US11217009B2 (en) 2015-11-30 2022-01-04 Photopotech LLC Methods for collecting and processing image information to produce digital assets
US10008028B2 (en) 2015-12-16 2018-06-26 Aquifi, Inc. 3D scanning apparatus including scanning sensor detachable from screen
US9978180B2 (en) 2016-01-25 2018-05-22 Microsoft Technology Licensing, Llc Frame projection for augmented reality environments
US10373380B2 (en) 2016-02-18 2019-08-06 Intel Corporation 3-dimensional scene analysis for augmented reality operations
JP6836042B2 (en) 2016-02-29 2021-02-24 パックサイズ，リミティド ライアビリティ カンパニー 3D scanning support system and method
US10176641B2 (en) * 2016-03-21 2019-01-08 Microsoft Technology Licensing, Llc Displaying three-dimensional virtual objects based on field of view
US20170287215A1 (en) 2016-03-29 2017-10-05 Google Inc. Pass-through camera user interface elements for virtual reality
US10373381B2 (en) 2016-03-30 2019-08-06 Microsoft Technology Licensing, Llc Virtual object manipulation within physical environment
KR102551198B1 (en) * 2016-03-31 2023-07-03 매직 립, 인코포레이티드 Interactions with 3d virtual objects using poses and multiple-dof controllers
US11003345B2 (en) 2016-05-16 2021-05-11 Google Llc Control-article-based control of a user interface
US10254546B2 (en) 2016-06-06 2019-04-09 Microsoft Technology Licensing, Llc Optically augmenting electromagnetic tracking in mixed reality
US10467814B2 (en) 2016-06-10 2019-11-05 Dirtt Environmental Solutions, Ltd. Mixed-reality architectural design environment
US10019839B2 (en) * 2016-06-30 2018-07-10 Microsoft Technology Licensing, Llc Three-dimensional object scanning feedback
WO2018012206A1 (en) 2016-07-12 2018-01-18 富士フイルム株式会社 Image display system, control device for head-mounted display, and operating method and operating program for operating same
US10627625B2 (en) 2016-08-11 2020-04-21 Magic Leap, Inc. Automatic placement of a virtual object in a three-dimensional space
DK179471B1 (en) 2016-09-23 2018-11-26 Apple Inc. Image data for enhanced user interactions
US10341568B2 (en) 2016-10-10 2019-07-02 Qualcomm Incorporated User interface to assist three dimensional scanning of objects
US10809808B2 (en) 2016-10-14 2020-10-20 Intel Corporation Gesture-controlled virtual reality systems and methods of controlling the same
US10515479B2 (en) 2016-11-01 2019-12-24 Purdue Research Foundation Collaborative 3D modeling system
US10204448B2 (en) 2016-11-04 2019-02-12 Aquifi, Inc. System and method for portable active 3D scanning
EP3324204B1 (en) 2016-11-21 2020-12-23 HTC Corporation Body posture detection system, suit and method
US20180143693A1 (en) * 2016-11-21 2018-05-24 David J. Calabrese Virtual object manipulation
EP3336805A1 (en) 2016-12-15 2018-06-20 Thomson Licensing Method and device for a placement of a virtual object of an augmented or mixed reality application in a real-world 3d environment
US10474336B2 (en) 2016-12-20 2019-11-12 Adobe Inc. Providing a user experience with virtual reality content and user-selected, real world objects
CN108885533B (en) 2016-12-21 2021-05-07 杰创科科技有限公司 Combining virtual and augmented reality
US10692287B2 (en) 2017-04-17 2020-06-23 Microsoft Technology Licensing, Llc Multi-step placement of virtual objects
US10339714B2 (en) 2017-05-09 2019-07-02 A9.Com, Inc. Markerless image analysis for augmented reality
US11262885B1 (en) 2017-06-27 2022-03-01 William Martin Burckel Multi-gesture context chaining
US10521020B2 (en) 2017-07-12 2019-12-31 Unity IPR ApS Methods and systems for displaying UI elements in mixed reality environments
US11989835B2 (en) 2017-09-26 2024-05-21 Toyota Research Institute, Inc. Augmented reality overlay
KR102668725B1 (en) 2017-10-27 2024-05-29 매직 립, 인코포레이티드 Virtual reticle for augmented reality systems
US10732826B2 (en) * 2017-11-22 2020-08-04 Microsoft Technology Licensing, Llc Dynamic device interaction adaptation based on user engagement
US10026209B1 (en) 2017-12-21 2018-07-17 Capital One Services, Llc Ground plane detection for placement of augmented reality objects
US10685225B2 (en) 2017-12-29 2020-06-16 Wipro Limited Method and system for detecting text in digital engineering drawings
WO2019147699A2 (en) 2018-01-24 2019-08-01 Apple, Inc. Devices, methods, and graphical user interfaces for system-wide behavior for 3d models
DK201870349A1 (en) 2018-01-24 2019-10-23 Apple Inc. Devices, Methods, and Graphical User Interfaces for System-Wide Behavior for 3D Models
US10540941B2 (en) * 2018-01-30 2020-01-21 Magic Leap, Inc. Eclipse cursor for mixed reality displays
WO2019172678A1 (en) 2018-03-07 2019-09-12 Samsung Electronics Co., Ltd. System and method for augmented reality interaction
KR20200135496A (en) 2018-04-24 2020-12-02 애플 인크. Multi-device editing of 3D models
US11380067B2 (en) 2018-04-30 2022-07-05 Campfire 3D, Inc. System and method for presenting virtual content in an interactive space
US10650610B2 (en) 2018-05-04 2020-05-12 Microsoft Technology Licensing, Llc Seamless switching between an authoring view and a consumption view of a three-dimensional scene
US11595637B2 (en) * 2018-05-14 2023-02-28 Dell Products, L.P. Systems and methods for using peripheral vision in virtual, augmented, and mixed reality (xR) applications
JP2018200688A (en) * 2018-05-15 2018-12-20 株式会社コロプラ Program for providing virtual space, information processing apparatus for executing the program, and method for providing virtual space
EP3797345A4 (en) 2018-05-22 2022-03-09 Magic Leap, Inc. TRANSMODAL INPUT FUSION FOR PORTABLE SYSTEM
US11169613B2 (en) 2018-05-30 2021-11-09 Atheer, Inc. Augmented reality task flow optimization systems
US10783712B2 (en) 2018-06-27 2020-09-22 Facebook Technologies, Llc Visual flairs for emphasizing gestures in artificial-reality environments
WO2020033606A1 (en) 2018-08-07 2020-02-13 Levi Strauss & Co. Laser finishing design tool
KR102582863B1 (en) 2018-09-07 2023-09-27 삼성전자주식회사 Electronic device and method for recognizing user gestures based on user intention
JP2020086939A (en) 2018-11-26 2020-06-04 ソニー株式会社 Information processing device, information processing method, and program
US10776933B2 (en) 2018-12-06 2020-09-15 Microsoft Technology Licensing, Llc Enhanced techniques for tracking the movement of real-world objects for improved positioning of virtual objects
WO2020146249A1 (en) 2019-01-07 2020-07-16 Butterfly Network, Inc. Methods and apparatuses for tele-medicine
US10740960B2 (en) 2019-01-11 2020-08-11 Microsoft Technology Licensing, Llc Virtual object placement for augmented reality
US20220083145A1 (en) 2019-02-19 2022-03-17 Ntt Docomo, Inc. Information display apparatus using line of sight and gestures
US11137875B2 (en) 2019-02-22 2021-10-05 Microsoft Technology Licensing, Llc Mixed reality intelligent tether for dynamic attention direction
US10964122B2 (en) * 2019-03-06 2021-03-30 Microsofttechnology Licensing, Llc Snapping virtual object to target surface
US10762716B1 (en) 2019-05-06 2020-09-01 Apple Inc. Devices, methods, and graphical user interfaces for displaying objects in 3D contexts
US11182044B2 (en) 2019-06-01 2021-11-23 Apple Inc. Device, method, and graphical user interface for manipulating 3D objects on a 2D screen
CN113574849B (en) 2019-07-29 2025-01-14 苹果公司 Object scanning for subsequent object detection
KR20190098110A (en) 2019-08-02 2019-08-21 엘지전자 주식회사 Intelligent Presentation Method
US11340756B2 (en) 2019-09-27 2022-05-24 Apple Inc. Devices, methods, and graphical user interfaces for interacting with three-dimensional environments
US11204678B1 (en) 2019-12-11 2021-12-21 Amazon Technologies, Inc. User interfaces for object exploration in virtual reality environments
US11922580B2 (en) 2020-01-17 2024-03-05 Apple Inc. Floorplan generation based on room scanning
US11157086B2 (en) 2020-01-28 2021-10-26 Pison Technology, Inc. Determining a geographical location based on human gestures
US11080879B1 (en) 2020-02-03 2021-08-03 Apple Inc. Systems, methods, and graphical user interfaces for annotating, measuring, and modeling environments
US11983326B2 (en) 2020-02-26 2024-05-14 Magic Leap, Inc. Hand gesture input for wearable system
KR20210110068A (en) 2020-02-28 2021-09-07 삼성전자주식회사 Method for editing video based on gesture recognition and electronic device supporting the same
CN115244494A (en) 2020-03-02 2022-10-25 苹果公司 System and method for processing scanned objects
KR102346294B1 (en) 2020-03-03 2022-01-04 주식회사 브이터치 Method, system and non-transitory computer-readable recording medium for estimating user's gesture from 2d images
US20210279967A1 (en) 2020-03-06 2021-09-09 Apple Inc. Object centric scanning
US11727650B2 (en) 2020-03-17 2023-08-15 Apple Inc. Systems, methods, and graphical user interfaces for displaying and manipulating virtual objects in augmented reality environments
FR3109041A1 (en) 2020-04-01 2021-10-08 Orange Acquisition of temporary rights by near-field radio wave transmission
US11641460B1 (en) 2020-04-27 2023-05-02 Apple Inc. Generating a volumetric representation of a capture region
US12072962B2 (en) 2020-05-26 2024-08-27 Sony Semiconductor Solutions Corporation Method, computer program and system for authenticating a user and respective methods and systems for setting up an authentication
EP4160530B1 (en) 2020-06-01 2025-03-19 National Institute Of Advanced Industrial Science and Technology Gesture recognition device, system, and program for same
US11989965B2 (en) 2020-06-24 2024-05-21 AR & NS Investment, LLC Cross-correlation system and method for spatial detection using a network of RF repeaters
US11899845B2 (en) 2020-08-04 2024-02-13 Samsung Electronics Co., Ltd. Electronic device for recognizing gesture and method for operating the same
CN116457883A (en) 2020-09-14 2023-07-18 苹果公司 Content playback and modification in a 3D environment
US12032803B2 (en) 2020-09-23 2024-07-09 Apple Inc. Devices, methods, and graphical user interfaces for interacting with three-dimensional environments
US11615596B2 (en) 2020-09-24 2023-03-28 Apple Inc. Devices, methods, and graphical user interfaces for interacting with three-dimensional environments
CN116719452A (en) 2020-09-25 2023-09-08 苹果公司 Method for interacting with virtual controls and/or affordances for moving virtual objects in a virtual environment
JP7624510B2 (en) 2020-09-25 2025-01-30 アップル インコーポレイテッド Method for manipulating objects in an environment - Patents.com
US11568620B2 (en) 2020-10-28 2023-01-31 Shopify Inc. Augmented reality-assisted methods and apparatus for assessing fit of physical objects in three-dimensional bounded spaces
WO2022098710A1 (en) 2020-11-03 2022-05-12 Light Wand LLC Systems and methods for controlling secondary devices using mixed, virtual or augmented reality
US11615586B2 (en) 2020-11-06 2023-03-28 Adobe Inc. Modifying light sources within three-dimensional environments by utilizing control models based on three-dimensional interaction primitives
US11249556B1 (en) 2020-11-30 2022-02-15 Microsoft Technology Licensing, Llc Single-handed microgesture inputs
US11928263B2 (en) 2020-12-07 2024-03-12 Samsung Electronics Co., Ltd. Electronic device for processing user input and method thereof
US11402634B2 (en) 2020-12-30 2022-08-02 Facebook Technologies, Llc. Hand-locked rendering of virtual objects in artificial reality
WO2022147146A1 (en) 2021-01-04 2022-07-07 Apple Inc. Devices, methods, and graphical user interfaces for interacting with three-dimensional environments
US12493353B2 (en) 2021-01-26 2025-12-09 Beijing Boe Technology Development Co., Ltd. Control method, electronic device, and storage medium
US11995230B2 (en) 2021-02-11 2024-05-28 Apple Inc. Methods for presenting and sharing content in an environment
US11531402B1 (en) 2021-02-25 2022-12-20 Snap Inc. Bimanual gestures for controlling virtual and graphical elements
WO2022204657A1 (en) 2021-03-22 2022-09-29 Apple Inc. Methods for manipulating objects in an environment
CN112927341B (en) 2021-04-02 2025-01-10 腾讯科技（深圳）有限公司 Lighting rendering method, device, computer equipment and storage medium
JP7713533B2 (en) 2021-04-13 2025-07-25 アップル インコーポレイテッド Methods for providing an immersive experience within an environment
US11941764B2 (en) 2021-04-18 2024-03-26 Apple Inc. Systems, methods, and graphical user interfaces for adding effects in augmented reality environments
CN117242497A (en) 2021-05-05 2023-12-15 苹果公司 Environment sharing
US12141914B2 (en) 2021-06-29 2024-11-12 Apple Inc. Techniques for manipulating computer graphical light sources
US12141423B2 (en) 2021-06-29 2024-11-12 Apple Inc. Techniques for manipulating computer graphical objects
US12242706B2 (en) 2021-07-28 2025-03-04 Apple Inc. Devices, methods and graphical user interfaces for three-dimensional preview of objects
US12236515B2 (en) 2021-07-28 2025-02-25 Apple Inc. System and method for interactive three- dimensional preview
CN117918024A (en) 2021-09-10 2024-04-23 苹果公司 Environment Capture and Rendering
US12131429B2 (en) 2021-09-24 2024-10-29 Apple Inc. Devices, methods, and graphical user interfaces for displaying a representation of a user in an extended reality environment
WO2023049670A1 (en) 2021-09-25 2023-03-30 Apple Inc. Devices, methods, and graphical user interfaces for presenting virtual objects in virtual environments
US11847748B2 (en) 2021-10-04 2023-12-19 Snap Inc. Transferring objects from 2D video to 3D AR
US12067159B2 (en) 2021-11-04 2024-08-20 Microsoft Technology Licensing, Llc. Multi-factor intention determination for augmented reality (AR) environment control
US11768544B2 (en) 2022-02-01 2023-09-26 Microsoft Technology Licensing, Llc Gesture recognition based on likelihood of interaction
US12154236B1 (en) 2022-03-11 2024-11-26 Apple Inc. Assisted drawing and writing in extended reality
US20230377299A1 (en) 2022-05-17 2023-11-23 Apple Inc. Systems, methods, and user interfaces for generating a three-dimensional virtual representation of an object
US12283020B2 (en) 2022-05-17 2025-04-22 Apple Inc. Systems, methods, and user interfaces for generating a three-dimensional virtual representation of an object
EP4591144A1 (en) 2022-09-23 2025-07-30 Apple Inc. Methods for manipulating a virtual object
US12536762B2 (en) 2022-09-24 2026-01-27 Apple Inc. Systems and methods of creating and editing virtual objects using voxels

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050062738A1 (en) * 1998-07-17 2005-03-24 Sensable Technologies, Inc. Systems and methods for creating virtual objects in a sketch mode in a haptic virtual reality environment
US20140104206A1 (en) * 2012-03-29 2014-04-17 Glen J. Anderson Creation of three-dimensional graphics using gestures
GB2540791A (en) * 2015-07-28 2017-02-01 Dexter Consulting Uk Ltd Apparatus, methods, computer programs and non-transitory computer-readable storage media for generating a three-dimensional model of an object
US20170221264A1 (en) * 2016-01-28 2017-08-03 Sony Computer Entertainment America Llc Methods and Systems for Navigation within Virtual Reality Space using Head Mounted Display
US20190018479A1 (en) * 2017-05-26 2019-01-17 Colopl, Inc. Program for providing virtual space, information processing apparatus for executing the program, and method for providing virtual space
US20180348986A1 (en) * 2017-05-31 2018-12-06 Colopl, Inc. Method executed on computer for providing virtual space, program and information processing apparatus therefor
US20190050062A1 (en) * 2017-08-10 2019-02-14 Google Llc Context-sensitive hand interaction
US20190164340A1 (en) * 2017-11-24 2019-05-30 Frederic Bavastro Augmented reality method and system for design
US20200128227A1 (en) * 2018-04-06 2020-04-23 Zspace, Inc. Replacing 2D Images with 3D Images

Also Published As

Publication number Publication date
EP4575742A2 (en) 2025-06-25
US20250157136A1 (en) 2025-05-15
EP4211661A2 (en) 2023-07-19
CN116324680A (en) 2023-06-23
US20220084279A1 (en) 2022-03-17
WO2022056036A2 (en) 2022-03-17
CN116719413A (en) 2023-09-08
EP4575742A3 (en) 2025-07-23
US12307580B2 (en) 2025-05-20

Similar Documents

Publication Publication Date Title
WO2022056036A3 (en) Methods for manipulating objects in an environment
EP4636558A3 (en) Methods for interacting with virtual controls and/or an affordance for moving virtual objects in virtual environments
EP4478312A3 (en) Reality capture with a laser scanner and a camera
WO2023028231A3 (en) Capturing environmental features using 2d and 3d scans
CN113205549B (en) Depth estimation method and device, electronic equipment and storage medium
US9685005B2 (en) Virtual lasers for interacting with augmented reality environments
US20140071044A1 (en) Device and method for user interfacing, and terminal using the same
WO2012018497A3 (en) ENHANCED SITUATIONAL AWARENESS AND TARGETING (eSAT) SYSTEM
EP3559789B1 (en) Magnetic interference detection and correction
EP2458880A3 (en) Mobile terminal and operation control method thereof
MX2018000441A (en) Method and apparatus for providing haptic feedback and interactivity based on user haptic space (hapspace).
RU2013154098A (en) WORLD OF MASS SIMULTANEOUS REMOTE DIGITAL PRESENCE
WO2018105955A3 (en) Method for displaying object and electronic device thereof
GB201201585D0 (en) Automated lighting control system allowing three dimensional control and user interface gesture recognition
WO2011102656A3 (en) Apparatus and method for providing user interface
WO2012088285A3 (en) Three-dimensional tracking of a user control device in a volume
CN101866243A (en) Three-dimensional space touch control operation method and hand gestures thereof
GB201116959D0 (en) Vehicle localisation with 2d laser scanner and 3d prior scans
US11010051B2 (en) Virtual sound mixing environment
US20190227693A1 (en) Virtual space positioning method and apparatus
CN104620201A (en) Apparatus for obtaining virtual 3d object information without requiring pointer
EP2781997A8 (en) Method for controlling electronic form on handheld touch device
MX2021008745A (en) Robot gamification for improvement of operator performance.
US10558267B2 (en) Systems and methods for long-range interactions for virtual reality
CN104951064A (en) Efficient free-space finger recognition

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21794036

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2021794036

Country of ref document: EP

Effective date: 20230411

WWW Wipo information: withdrawn in national office

Ref document number: 2021794036

Country of ref document: EP