WO2024186838A2 - A system for an independent recursive virtual world with a voice controlled interface - Google Patents
A system for an independent recursive virtual world with a voice controlled interface Download PDFInfo
- Publication number
- WO2024186838A2 WO2024186838A2 PCT/US2024/018556 US2024018556W WO2024186838A2 WO 2024186838 A2 WO2024186838 A2 WO 2024186838A2 US 2024018556 W US2024018556 W US 2024018556W WO 2024186838 A2 WO2024186838 A2 WO 2024186838A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- virtual world
- recursive
- participant
- original
- virtual
- Prior art date
Links
- 238000000034 method Methods 0.000 claims abstract description 27
- 238000013461 design Methods 0.000 claims abstract description 20
- 230000003993 interaction Effects 0.000 claims abstract description 18
- 238000012360 testing method Methods 0.000 claims description 19
- 238000012544 monitoring process Methods 0.000 claims description 12
- 230000009471 action Effects 0.000 claims description 9
- 238000004891 communication Methods 0.000 claims description 6
- 238000010276 construction Methods 0.000 claims description 5
- 238000011156 evaluation Methods 0.000 claims description 5
- 230000001360 synchronised effect Effects 0.000 claims description 5
- 230000004308 accommodation Effects 0.000 claims description 4
- 230000033228 biological regulation Effects 0.000 claims description 4
- 230000000694 effects Effects 0.000 claims description 4
- 239000000463 material Substances 0.000 claims description 4
- 230000002085 persistent effect Effects 0.000 claims description 4
- 238000010200 validation analysis Methods 0.000 claims description 4
- 230000004931 aggregating effect Effects 0.000 claims description 3
- 230000001815 facial effect Effects 0.000 claims description 3
- 230000002452 interceptive effect Effects 0.000 claims description 3
- 238000002955 isolation Methods 0.000 claims description 3
- 238000010801 machine learning Methods 0.000 claims description 3
- 238000003909 pattern recognition Methods 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 52
- 230000006870 function Effects 0.000 description 16
- 238000003860 storage Methods 0.000 description 9
- 230000008569 process Effects 0.000 description 7
- 230000008859 change Effects 0.000 description 4
- 238000007689 inspection Methods 0.000 description 4
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000010521 absorption reaction Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 238000005266 casting Methods 0.000 description 2
- 230000033001 locomotion Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000010422 painting Methods 0.000 description 2
- 235000012736 patent blue V Nutrition 0.000 description 2
- 201000004569 Blindness Diseases 0.000 description 1
- 206010011878 Deafness Diseases 0.000 description 1
- 239000000654 additive Substances 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 238000013475 authorization Methods 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 230000001276 controlling effect Effects 0.000 description 1
- 231100000895 deafness Toxicity 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 230000004438 eyesight Effects 0.000 description 1
- 238000009408 flooring Methods 0.000 description 1
- 208000016354 hearing loss disease Diseases 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000014759 maintenance of location Effects 0.000 description 1
- 239000003973 paint Substances 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000005945 translocation Effects 0.000 description 1
- 210000000707 wrist Anatomy 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
Definitions
- the present invention is in the technical field of virtual reality and more particularly to a system for an independent recursive virtual world with a voice controlled interface.
- the system overcomes the limitations of the prior art by providing a computer implemented system for one or more than one recursive virtual world with a voice controlled interface.
- the system has a server selected from the group consisting of a computer, a headset, a smart phone, a smart device, a smart tablet, and a smart display.
- a database is operably connected to the server.
- Participants are operably connected to the server and one or more than one original virtual world and one or more than one recursive virtual world (collectively “the virtual worlds”) using a headset, a display device, or both a headset and a display device to to view and navigate through the virtual worlds.
- the independent recursive virtual world comprises virtual elements; providing a command set to the virtual elements in the virtual worlds; creating a design tool set and teamwork tools usable by the participants; storing and analyzing interactions of the participants to create predictive models to continuously update and dynamically adjust the virtual worlds in real time; and translating the command set, the design tools and the teamwork tools into different languages automatically and in real time for multinational participants.
- the system further comprises instructions for virtual operations management and monitoring of real world physical object.
- the instructions are for: receiving, aggregating, and displaying in a plurality of adjustable, extensible, optimized formats and information from a plurality of sensors that provide real-time continuous monitoring of a system, a building, a master-plan construction site, an assembly, a structure, a wind turbine tower, a theme park attraction, etc.
- detecting application categories comprising structural integrity, public safety, wind load, isolation, and a plurality of capacity or load monitoring, including power line fluctuations, logging all data and tagging the data appropriately using machine learning methods to effect pattern recognition for the building or the facility for operations management; analyzing sensor metrics and their permutations, along with external contextual data to provide real-time analytics reporting, and predictive analytics reporting; displaying information to the one or more than one participant wearing one or more than one headset that are immersed in the original virtual world and the one or more than one recursive virtual world; the participants can see each others avatars, and can converse and interact spatially with the other avatars using a system wide communications module connected to the one or more than one headset microphone, or one or more than one external microphone; The participants that have an interactive participant role, can interact with the virtual worlds by using the command set and the system wide communications module.
- the database stores incrementally accumulated data for the virtual worlds, including all virtual body and object collisions can be logged, played back and otherwise managed for evaluation in the database, for future use by participants.
- the one or more than one participant can speak to and interact with any other participants in the virtual worlds.
- the virtual worlds can have virtual elements that correspond to actual, real world, physical objects.
- the virtual worlds are also persistent and updateable for the participants to virtually enter and manipulate the original virtual worlds, depending on access rights of the participants.
- the participants are physically local to the server, physically remote to the server or both physically local and physically remote to the server.
- the command set to manipulate the virtual worlds comprise: voice commands, gestures, hardware controller commands, gaze commands; a virtual audio-visual command interface, and a virtual audio-visual control interface.
- the command set is used for installing, viewing, evaluating, adjusting, altering, replacing, designing, and redesigning virtual elements of the virtual worlds.
- the system also has real-time logging, reporting and monitoring of the virtual worlds.
- the command set also includes instructions operable on the one or more than one server to interpret the command set in multiple languages.
- the smart devices used in the system also have instructions to install, view, evaluate, adjust, alter, replace, design and redesign various elements of the virtual worlds.
- the avatars comprise a plurality or categories: a general avatar, an actor avatar, and a a third party avatar.
- the actor avatar is used for specific testing, relevant to the one or more than one participant’s preferences or to a physically challenged participant where accommodation requirements, such as the American’s with Disabilities Act (ADA) and other laws and regulations that apply to that participant; wherein the actor avatar comprises the same access and assistance as the one or more than one participant would require in the physical world.
- the third party avatars are created or purchased, but have to conform to system requirements. The participants in the original virtual world will see other participant’s avatars, in the one or more than one recursive virtual world, moving proportionally to the elements in the recursive virtual world.
- the participants can see and hear avatars the original virtual world and the avatars in the recursive virtual world, depending on the participant’s role.
- the participants and the avatar can view additional recursive virtual worlds from an external point relative to the original virtual world.
- the participant’s avatar is selected from the group consisting of a basic avatar, an advanced avatar, or a participant avatar.
- the avatars are customizable by each participant based on the participant’s role, and is selected from the group comprising: avatar selection, name, profile, facial features, hair, body, and clothing.
- the avatars have the following interaction capabilities: opening doors and drawers, toggling light and lamp switches, opening and closing drapes; moving objects, like a chair, desk, etc., wherein all move actions are logged and optionally pinned and stored in the database; displaying different positions, superimposed, of a specific object by all participants across a defined time duration; changing, removing or adding new virtual elements or the virtual element’s materials and finishes; setting a time of day and a season to control a virtual sun direction; and using and recording the results from a point to point measuring tape.
- the gesture commands comprise: selecting and moving virtual elements in a vertical plane, selecting and moving virtual elements in a horizontal plane, a combination gesture for selecting and scaling virtual elements in the virtual worlds, selecting and moving virtual elements in any other planar and curvilinear manner, rotating and tilting virtual elements in the virtual worlds, selecting an option from a virtual menu, selecting virtual elements to alter the size, shape, location, or other property of the virtual element in the virtual worlds, using a tap and hold gesture on virtual elements in the virtual worlds, using a combination select and action command on one or more than one element in the original virtual world, the one or more than one recursive virtual world, or both the original virtual world and the one or more than one recursive virtual world, moving a visibility plane in any spatial orientation horizontally or vertically through one or more than one virtual element in the original virtual world, the one or more than one recursive virtual world, or both the original virtual world and the one or more than one recursive virtual world, and manipulating virtual elements using raycasting in the virtual world
- a method of using a system for one or more than one recursive virtual world with a voice controlled interface comprising the steps of, first entering an original virtual world as an avatar by one or more than one participant. Then, synchronizing participants, regardless of physical location, spatially and audibly in three dimensions and scaled 1 : 1 in both the original virtual world and the one or more than one recursive virtual world. Next, moving the one or more than one participant’s avatar at will to and from the original virtual world or the one or more than one recursive virtual world using a command set. Then, beginning a session with one or more than one participant appearing as avatars in the original virtual world and the one or more than one recursive virtual world.
- a computer implemented system for one or more than one recursive virtual world with a voice controlled interface having one or more than one server; one or more than one database operably connected to the one or more than one server; one or more than one participant operably connected to the one or more than one server and one or more than one original virtual world and one or more than one recursive virtual world using a headset, a display device, or both a headset and a display device to to view and navigate through an original virtual world, one or more than one recursive virtual world, or both the original virtual world and the one or more than one recursive virtual world, instructions operable on the one or more than one server for the original virtual world and the virtual worlds for first, creating the one or more than one original virtual world comprises one or more than one virtual element.
- the present invention overcomes the limitations of the prior art by providing a system 100 for an independent recursive virtual world with a voice controlled interface.
- FIG. l is a diagram of a system for an independent recursive virtual world with a voice controlled interface, according to one embodiment of the present invention.
- FIG. 2 is a diagram showing one or more than one participant in an original virtual world and one or more than one recursive virtual world created in the system of FIG. 1;
- FIG. 3 is a diagram of a perspective view of a recursive virtual world of the system of FIG. 1;
- FIG. 4 is a diagram of a perspective view of one or more than one participant avatars in the original virtual world viewing one or more than one participant avatar in the one or more than one recursive virtual world in the system of FIG. 1;
- FIG. 5 is a diagram of a participant using one or more than one gesture for selecting and moving one or more than one virtual element in a plane in the recursive virtual world of the system of FIG. 1;
- FIG. 6 is a diagram of a participant selecting and moving one or more than one virtual element in a horizontal plane in the recursive virtual world of the system of FIG. 1;
- FIG. 7 is a diagram of a participant using a combination gesture for selecting and scaling one or more than one virtual element in the recursive virtual world of the system of FIG. 1;
- FIG. 8 is a diagram of a participant performing a gaze with a single hand gesture combination command for rotating and tilting one or more than one virtual element in the recursive virtual world of the system of FIG. 1;
- FIG. 9 is a diagram of a participant using a gesture for performing virtual menu selection in the system of FIG. 1;
- FIG. 10 is a diagram of a participant using a single hand gesture for bringing up a virtual menu to select one or more than one virtual item to alter its size, shape, location, or other features in the system of FIG. 1;
- FIG. 11 is a diagram of a participant single tap gesture for selection of one or more than one virtual element using an action command, in the system of FIG. 1;
- FIG. 12 is a diagram of a participant using a tap and hold gesture in the system of FIG. 1;
- FIG. 13 is a diagram of a participant using a combination select and action command useful in the system of FIG. 1;
- FIG. 14 is a diagram of a participant’s avatar view from inside the recursive virtual world of the system of FIG. 1;
- FIG. 15 is a diagram of a participant using a gesture to move a virtual element horizontally with a visibility plane in in the recursive virtual world of the system of FIG. 1;
- FIG. 16 is diagram of a participant using a gesture to move a virtual element vertically with a visibility plane in the recursive virtual world of the system of FIG. 1;
- FIG. 17 is a diagram of a participant using ray casting to manipulate one or more than one virtual element in the recursive virtual world of the system of FIG. 1;
- FIG. 18 is a diagram of an exterior view of the recursive virtual world, with weather and audio in the recursive virtual world of the system of FIG. 1;
- FIG. 19 is a diagram of a participant using a one or more than one voice and gesture command to manipulate one or more than one virtual element in the recursive virtual world of the system of FIG. 1;
- FIG. 20 is a diagram of a participant using a one or more than one voice command, gesture command and a virtual controller to manipulate one or more than one virtual element in the recursive virtual world of the system of FIG. 1;
- FIG. 21 is a flowchart diagram of some steps of a method for participants using the system of FIG. 1;
- FIG. 22 is a flowchart diagram of some steps of a method for using the system of FIG. 1.
- the present invention overcomes the limitations of the prior art by providing an independent recursive virtual world with voice controlled interface.
- each block in the flowchart or block diagrams can represent a module, segment, or portion of code, that can comprise one or more executable instructions for implementing the specified logical functions. It should also be noted that, in some alternative implementations, the functions noted in the blocks may occur out of the order noted in the figures.
- a flowchart may describe the operations as a sequential process, many of the operations can be performed in parallel or concurrently. In addition, the order of the operations can be rearranged.
- a process is terminated when its operations are completed.
- a process may correspond to a method, a function, a procedure, a subroutine, a subprogram, etc.
- a process corresponds to a function
- its termination corresponds to a return of the function to the calling function or the main function.
- each block of the block diagrams and, or flowchart illustration, and combinations of blocks in the block diagrams and, or flowchart illustration can be implemented by special purpose hardware based system 100s that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
- a storage may represent one or more devices for storing data, including read only memory ROM, random access memory RAM, magnetic disk storage mediums, optical storage mediums, flash memory devices and, or other non transitory machine readable mediums for storing information.
- machine readable medium includes, but is not limited to portable or fixed storage devices, optical storage devices, Internet or “cloud” storage, wireless channels and various other non transitory mediums capable of storing, comprising, containing, executing or carrying instructions and, or data.
- embodiments can be implemented by hardware, software, firmware, middleware, microcode, or a combination thereof.
- the program code or code segments to perform the necessary tasks can be stored in a machine readable medium such as a storage medium or other storages.
- One or more than one processor may perform the necessary tasks in series, distributed, concurrently or in parallel.
- a code segment may represent a procedure, a function, a subprogram, a program, a routine, a subroutine, a module, a software package, a class, or a combination of instructions, data structures, or program statements.
- a code segment can be coupled to another code segment or a hardware circuit by passing and, or receiving information, data, arguments, parameters, or memory contents.
- Information, arguments, parameters, data, etc. can be passed, forwarded, or transmitted through a suitable means including memory sharing, message passing, token passing, network transmission, etc. and are also referred to as an interface, where the interface is the point of interaction with software, or computer hardware, or with peripheral devices.
- virtual environment refers to any two dimensional or three dimensional virtual environment (VR), extended reality (XR) environment, or a mixed reality (MR) environment.
- VR virtual environment
- XR extended reality
- MR mixed reality
- smart device refers to any monitor, VR headset, XR headset, tablet, smart device or other computing device that can be used to view and enter instructions to control a VR or XR environment.
- avatar refers to an icon or figure representing a particular person.
- headset refers to any VR, XR or MR headset, a head mounted display
- HMD head-worn computing
- Meta Quest a Meta Quest
- Apple Vision Pro for viewing and interacting with VR, XR or MR content.
- feature set refers to a separable set of instructions operable on one or more than one processor, where each set of instructions perform specific tasks.
- command set refers to a voice command, a gesture command, a gaze command, a VR hardware controller, or any combination thereof.
- element refers to discrete parts of a virtual world, individually or grouped together, such as a building, a wall in the building, a room in the building, a door in the room, or a nail in the door.
- original virtual world refers to a top level virtual world for accessing recursive virtual worlds operably connected to it.
- recursive virtual world refers to other virtual worlds or elements directly connected to an original virtual world that expand, extend or are lined to the original virtual world.
- Various embodiments provide a system for an independent recursive virtual world with a voice controlled interface.
- One embodiment of the present invention provides a system for an independent recursive virtual world with a voice controlled interface.
- FIG. 1 there is shown a diagram of a system 100 for one or more than one recursive virtual world 206 with a voice controlled interface 132, according to one embodiment of the present invention.
- the system 100 comprises one or more than one server 102 operably connected to one or more than one database 122 for storing instructions and data for all elements of the one or more than on original virtual world 204 and 206.
- One or more than one participant 104, 106, 108, 110, 112, and 120 is operably connected to the one or more than one server 102 through one or more than one original virtual world 204 and an independent one or more than one recursive virtual world 206, using one or more than one headset 106, 108, 110, 116, 118 and/or one or more than on smart device 138, discussed in detail below.
- the system 100 also comprises instructions operable on the one or more than one server 102 for the one or more than one participant 104-124 to manipulate the original virtual world 204, the one or more than one recursive virtual world 206 or both the original virtual world 204 and the one or more than one recursive virtual world 206 using a command set 126, 128, 130, 132, 134 and 140.
- the command set comprise one or more than one voice command 132, one or more than one gesture command 126 and 128, one or more than one gaze command 134, and one or more than one controller command 113, 114 and 130, according to one embodiment of the present invention.
- set command set 126-134 further comprises a design tool set and one or more than one teamwork tool.
- the system 100 comprises instructions executable on a processor for creating and using a design tool set and teamwork tools for the original virtual world 204 that is persistent and updatable and the one or more than one recursive virtual world 206.
- the design tools set and the teamwork tools are extremely useful in the system 100 and are available across a plurality of industries, skill sets, markets, goals, and use cases.
- the system 100 creates one or more than one recursive virtual world 206 that is persistent and updateable inside the original virtual world 204 for the one or more than one participant 104-124 to virtually enter and manipulate both the original virtual world 204 and the one or more than one recursive virtual world 206, depending on the one or more than participant’s 104-124 access rights in the system 100.
- the one or more than one participant 104-124 is provided tools in the system 100 to manipulate elements in both the original virtual world 204 and the one or more than one recursive virtual world 206.
- the system 100 comprises instruction for one or more than on smart device 138, to install, view, evaluate, adjust, alter, replace, design and redesign various elements of the original virtual world 204 and the one or more than one recursive virtual world 206.
- complex projects that use one or more than one original virtual world 204 and one or more than one recursive virtual world 206, are able to be integrated with each other recursively so that all the elements of all the virtual worlds, including buildings, land area developments, facility and area master plans, and processes, can be viewed independently or cooperatively during the life of the project.
- the examples herein are not meant to be limiting. Any physical and virtual world elements from games, construction, interior design and coding can be entered into the system 100 for expanded capabilities not found in the prior art.
- the system 100 provides instructions for viewing, inspection, annotation, modification, original concept design stages, and subsequent project stages, by the one or more than one participant 104-124 in the original virtual world 204 and the one or more than one recursive virtual world 206.
- evaluation and testing can be performed virtually, thereby alleviating the need for travel to the actual physical building.
- One or more than one virtual version 205 of the physical site is also known as a ‘digital twin.’ This efficiency improvement alone will save time, money, resources, and speed up completion of the task related to the actual physical site.
- acceptance inspections and post-completion operations management that includes ongoing as-built updates to the one or more than one virtual version 205 of the physical site, can be reviewed virtually using the system 100.
- the system 100 also comprises instructions for an operations dashboard 140 that can be used in conjunction with the design tools set and the teamwork tools to issue commands.
- the operations dashboard 140 can be used to continuously monitor all data feeds from a plurality of sensors in a physical, real world facility.
- the data is stored in the database 122 and used by the server 102 to create a digital twin of the facility and the present an actual state of the facility to the one or more than one participant 104-124.
- the actual state of the facility is shown in real-time in the real world facility in the original virtual world 204 and the one or more than one recursive virtual world 206.
- infrastructure services, systems performance, interior air flow and quality, real-time occupancy, usage, and an arbitrary set of additional dimensions, among others can be displayed on the dashboard.
- the real-time reporting and monitoring of the original virtual world 204 and the one or more than one recursive virtual world 206 can be used as an emergency warning system.
- the system 100 can be programmed to optimize for early warning detection.
- operations management and monitoring tool contemplated here includes:
- Machine learning methods are used to effect pattern recognition for the building or the facility for operations management.
- Sensor metrics and their permutations, along with external contextual data, such as, for example, humidity and temperature are analyzed by the system to provide real-time analytics reporting, and predictive analytics reporting.
- the one or more than one participant 104-124 can see each others avatars 208, 210 and 212 and can converse and interact spatially with the one or more than one avatar 208, 210 and 212 using a system 100 wide communications module connected to the one or more than one headset 106 - 118 microphone, or one or more than one external microphone (not shown).
- the one or more than one participant 104-124 can interact with the original virtual world 204 and the one or more than one recursive virtual world 206 by using the command set 126-134 and the system wide communications module.
- the one or more than one participant 104-124 can use one or more than on smart device 138 to view and navigate through the original virtual world 204 and the one or more than one recursive virtual world 206. This is similar to a portable window.
- the one or more than on smart device 138 has equivalent functionality to that experienced by the one or more than one participant 104-124 using one or more than one headset 106-118. Any of the one or more than one participant 104-124 using the one or more than on smart device 138 can speak and interact with the other participants in the original virtual world 204 and the one or more than one recursive virtual world 206.
- the one or more than one server 102 also comprises instructions for a validation and/or permission scheme to limit the one or more than one participant 104-124 entrance into the one or more than one recursive virtual world 206 and functionality that each of the one or more than one participant 104-124 is permitted in the one or more than one recursive virtual world 206.
- the validation and/or permission schemes are managed and administered by staff.
- the system 100 also comprises instructions for an incremental, role-based administration for the original virtual world 204 and the one or more than one recursive virtual world 206 for each of the one or more than one participant 104-124.
- the increments of functionality, or participant levels, are controlled by an experienced participant.
- the experienced participant is also know as a guide, a manager, a chair, a presenter, and a superuser.
- the experienced participant role has a full set of participant functionality that does not include administration functions.
- An advanced interaction role comprises a command set 126-134 that is extensive, adjustable, and defined as needed in the system 100.
- the advanced interaction role does not have specific administration permissions nor experienced participant permissions.
- Other participant roles include a passive role.
- the passive role has no interaction voice for conversation with other participants, but asking questions is an optional functionality for the passive role and is controlled by the experienced participant role.
- One or more than one avatar 208-212 for the passive role or its point of view (POV) are also controlled by the experienced participant.
- the passive role is useful for one or more than one participant 104-124 visiting the original virtual world 204 and the one or more than one recursive virtual world 206 that have no need to manipulate any virtual elements.
- There is also a basic interaction role that has a command set 126-134 that is adjustable and includes opening doors, operating light switches, avatar locomotion within elements, and changing certain elements of the original virtual world 204 and the one or more than one recursive virtual world 206.
- the one or more than one avatar 208-212 for the basic interaction role is controlled by the command set 126-134 or one or more than one smart device 138.
- a dashboard 140 can be shown by the system 100 when one or more than one participant 104-124 uses one or more than one pre-defined voice command 132 or one or more than one pre-defined gesture command 126 and 128, such as, ⁇ ‘looks at watch. ’>.
- the dashboard 140 is set by an administrator of the system 100 to appear and remain in a convenient location and orientation. For example, an arbitrary but typical location for the dashboard 140 is on a virtual laptop display, or a location centered on a line between the one or more than one participant’s 104-124 wrist and face.
- the dashboard 140 is always oriented perpendicularly to the one or more than one participant’s 104-124 face, until dismissed by the one or more than one participant 104-124 using the command set 126-134.
- the position and orientation of the dashboard 140 supports readability and remains constant relative to the one or more than one avatar 208-212 during any kind of translocation.
- the dashboard 140 is represented by a window that is repositionable and resizable by the one or more than one participant 104-124 using the command set 126-134 or by using a built in microphone for any participant using one or more than on smart device 138, or an external microphone operably connected to the system 100 or the one or more than on smart device 138.
- the basic command set 126-132 for the original virtual world 204 and the one or more than one recursive virtual world 206 comprises:
- adjusting an arbitrary feature of the element using a widget such as, for example, color, saturation, brightness, orientation, size, texture, reflectance, light transmission, acoustic absorption and acoustic reflection.
- interactions in a virtual building interior 402 include:
- FIG. 2 there is shown a diagram showing one or more than one participant 104-124 in an original virtual world 204 and one or more than one recursive virtual world 206 created in the system 100.
- a one or more than one recursive virtual world 206 session begins with one or more than one remote participant 202, one or more than one local participant 204 or both one or more than one remote participant 202 and one or more than one local participant 204 entering the one or more than one recursive virtual world 206.
- the one or more than one participant 202 and 204 appear as one or more than one avatar 208, 210 and 212 in the one or more than one recursive virtual world 206.
- the system 100 comprises instructions to create the one or more than one recursive virtual world 206 that has a virtual replica of a physical project or an element along with one or more than one avatar 208-212 of the one or more than one participant 104-124 inside the one or more than one recursive virtual world 206.
- the one or more than one participant 202 and 204 is able to change elements in the one or more than one recursive virtual world 206 by using the command set 126-134, or by invoking the dashboard 140 to show various options for a given virtual element of the one or more than one recursive virtual world 206.
- the one or more than one participant 202 and 204 that enter the one or more than one recursive virtual world 206 is represented, visually, to any other participants in the original virtual world 204, as one or more than one avatar 208-212.
- the one or more than one avatar 208-212 is a miniature version of avatars of the one or more than one participant 104-124 in the original virtual world 204. However, the one or more than one participant 104-124 see, speak and interact with each other in 1 : 1 scale in the original virtual world 204. Optionally, the one or more than one avatar 208-212 can see outside the one or more than one recursive virtual world 206 and can view the original virtual world 204 and any of the avatars in the original virtual world 204. [0076] In the one or more than one recursive virtual world 206 participants with the appropriate role privileges can use the command set to manipulate elements of the one or more than one recursive virtual world 206.
- the command set includes instructions operable on the one or more than one server 102 to interpret the command set.
- the one or more than one participant 104-124 can run usability testing with their avatar to place elements in a room, test for choke points in a building or hallway, examine body and object collisions in a scenario, such as an emergency situation. All the body and object collisions can be logged, played back and otherwise managed for evaluation in the database 122.
- participant avatar 208 can inhabit, with the proper role permissions, any virtual world in the system 100 at will.
- a general avatar 208 is used to represent a basic participant. This category is available in various sizes and other specifications.
- an actor avatar 210 is used for specific testing, relevant to the one or more than one participant’s 104-124 preferences or to a physically challenged participant where accommodation requirements, such as the American’s with Disabilities Act (ADA) and other laws and regulations that apply to that participant.
- the avatar for a physically challenged participant constitute a plurality of instances of avatars that require the same level of access and assistance as they would in the physical world.
- the physically challenged avatars in the original virtual world 204, the one or more than one recursive virtual world 206 or both the original virtual world 204 and the one or more than one recursive virtual world 206 assist in testing space designs, ease of access, such as, for example, hallway and door widths.
- the system supports ADA or similar local jurisdiction compliance considerations but may not function as a tool to confirm compliance without authorization and certification from a responsible authority.
- a third party avatar created or purchased by one or more than one participant 104-124 is permitted to enter into the system 100 under certain circumstances.
- the third party avatar must conform to the system 100 requirements for the one or more than one original virtual world 204 and for the one or more than one recursive virtual world 206.
- the third party avatar must also conform to an articulation specification and must be tested and approved by a system 100 administration prior to use.
- FIG. 3 there is shown a diagram of a perspective view 300 of original virtual world 204 of the system 100.
- the one or more than one participant 304, 306, 308 and 310 is inside the original virtual world 204.
- the original virtual world 204 comprises virtual space for one or more than one avatar 208, 210 and 212 that are local, remote, or both local and remote to congregate with each other, and a virtual building 310, various virtual elements, or any other form that can be imported, created and displayed in the system 100.
- the one or more than one participant 302, 304, 306 and 308 is physically local, physically remote or both physically local and physically remote.
- the system 100 comprises instructions to create the original virtual world 204 and provide the command set 126-134 to the one or more than one participant 302-308 based on their defined role in the system 100.
- a 'chair’ or ‘presenter’ role 302 is chosen by one or more than one participant 302-308 to manage the original virtual world 204.
- the chair role 302 has specific permissions in the system 100 that enable the chair role 302 to select one or more than one recursive virtual world 206 or one or more than one element to view and manipulate.
- the selected element is adjustable and scalable in size relative to the original virtual world 204 by the one or more than one participant 302-308 in the original virtual world 204.
- the one or more than one participant 302-308 in the original virtual world 204 can view and interact with elements in the original virtual world 204.
- the degree and type of interaction depends on each of the one or more than one participant’s 302-308 role command set 126-134.
- the one or more than one participant 302-308 can enter a 1 : 1 scale version of the one or more than one recursive virtual world 206 using one or more than one avatar 208-212 for inspection, modification, and testing of the space regardless of the one or more than one participant’s 302-308 actual physical location.
- the one or more than one participant 302, 306 and 308 remaining in the original virtual world 204 will see, hear and speak with the other participant’s 304 avatar 402 moving proportionally in the one or more than one recursive virtual world 206.
- FIG. 4 there is shown a diagram of a perspective view 400 of one or more than one participant 302, 306 and 308 avatar in the original virtual world 204 viewing one or more than one participant 402 avatar in the one or more than one recursive virtual world 206.
- one or more than one participant 302, 306 and 308 can, depending on the one or more than one participant’s 302, 306 and 308 role, see the original virtual world 204 and the one or more than one avatar 402 in the one or more than one recursive virtual world 206. Additionally, the one or more than one participant 302, 306 and 308 can look into additional recursive virtual worlds from an external point relative to the original virtual world 204.
- the system 100 provides the one or more than one participant 302-308 with software executable command set 126-134 to arbitrarily turn off and on elements of original virtual world 204 and/or elements of the one or more than one recursive virtual world 206 for better examination by the one or more than one participant 302, 306 and 308.
- a roof, walls and other elements of the virtual building 310 have been turned off so that the one or more than one participant 302, 306 and 308 can see inside the virtual building 310 and also see and converse with the one or more than one avatar 402, that is a recursive avatar of the one or more than one participant 306, as it moves around in the one or more than one recursive virtual world 206.
- the one or more than one participant 302, 306 and 308 in the original virtual world 204 can observe other participants’ 402 behavior at 1 : 1 scale within the one or more than one recursive virtual world 206, interacting with and optionally modifying the one or more than one recursive virtual world 206 in a plurality of ways.
- the one or more than one avatar 402 is also able to interact and converse with the one or more than one participant 302, 306 and 308 that did not enter the one or more than one recursive virtual world 206 of the system 100.
- one or more than one avatar 402 has entered into one or more than one recursive virtual world 206.
- the avatar 402 is no longer in the viewing group of the one or more than one participant 302, 306 and 308 that have only entered the original virtual world 204 to experience it at full 1 : 1 scale.
- One or more than one participant 304 has entered the one or more than one recursive virtual world 206 and the one or more than one avatar 402 is displayed as small human silhouette.
- Activity of the one or more than one avatar 402 is depicted in real time in both the original virtual world 204 and the one or more than one recursive virtual world 206.
- Avatars comprise a selection of general avatars that are available to the one or more than one participant 302-308.
- General avatar features are customizable by each participant. Customizable options are selected from the group comprising: avatar selection, name, profile, facial features, hair, body, and clothing.
- special or ADA avatars are a subset of the general avatars available to participants. This subset serves arbitrarily unique participant requirements, or ADA type requirements, or other human factors testing functions.
- the special avatars are relatively accurate versions of approved dimension and approved articulation ‘crash test dummies’ but are not warranted as regulatory compliant. Visually, their heads are nearly featureless, like crash test dummies.
- the avatars are examples of human participants that are in some way(s) outside the standard range of ergonomic design, or otherwise fall under accommodation provisions of ADA or other applicable regulations. Examples of the space design issues to be evaluated with this set include: reach, view, collisions, physical danger, and choke points.
- Examples of avatar types for this design and testing function comprise:
- Participants may optionally provide their own avatars if compliant with the system 100, or create their own avatars per system 100 specifications and submit it for testing and approval.
- Avatars can be ‘characters,’ like ‘tall man,’ ‘toddler,’ etc.
- participant avatars may instead represent specific participant requirements for demographic or cultural cases not driven by differently abled or ‘ADA’ requirements.
- Avatars have the following interaction capabilities:
- FIG. 5 there is shown a diagram 500 of a participant using one or more than one gesture 502 for selecting and moving one or more than one virtual element in a plane 506 in the original virtual world 204, the one or more than one recursive virtual world 206 or both the original virtual world 204 and the one or more than one recursive virtual world 206 of the system 100.
- FIG. 6 there is shown a diagram 600 of a participant selecting and moving 602 one or more than one virtual element 604 in a horizontal plane 606 in the original virtual world 204, the one or more than one recursive virtual world 206 or both the original virtual world 204 and the one or more than one recursive virtual world 206 of the system 100.
- FIG. 7 there is shown a diagram 700 of a participant using a combination gesture 702 for selecting and scaling 704 one or more than one virtual element 706 in the original virtual world 204, the one or more than one recursive virtual world 206 or both the original virtual world 204 and the one or more than one recursive virtual world 206 of the system 100.
- FIG. 8 there is shown a diagram 800 of a participant performing a gaze 802 with a single hand gesture 804 combination command for rotating 806 and tilting 808 one or more than one virtual element 810 in the original virtual world 204, the one or more than one recursive virtual world 206 or both the original virtual world 204 and the one or more than one recursive virtual world 206 of the system 100.
- FIG. 9 there is shown a diagram 900 of a participant using a gesture 902 for performing a virtual menu selection 904 in the system 100.
- FIG. 10 there is shown a diagram 1000 of a participant using a single hand 1002 gesture 1004 to select one or more than one virtual element 1006 to alter its size, shape, location, or other property of the virtual item 1006 in the original virtual world 204, the one or more than one recursive virtual world 206 or both the original virtual world 204 and the one or more than one recursive virtual world 206 of the system 100.
- FIG. 11 there is shown a diagram 1100 of a participant single tap gesture 1102 for selection of one or more than one virtual element using an action command, in the original virtual world 204, the one or more than one recursive virtual world 206 or both the original virtual world 204 and the one or more than one recursive virtual world 206 of the system 100.
- FIG. 12 there is shown a diagram 1200 of a participant using a tap and hold gesture 1202 on one or more than one virtual element in the original virtual world 204, the one or more than one recursive virtual world 206 or both the original virtual world 204 and the one or more than one recursive virtual world 206 of the system 100.
- FIG. 13 there is shown a diagram 1300 of a participant using a combination select and action 1302 command in the original virtual world 204, the one or more than one recursive virtual world 206 or both the original virtual world 204 and the one or more than one recursive virtual world 206 of the system 100.
- FIG. 14 there is shown a diagram 1400 of an avatar 1402 view from inside the one or more than one recursive virtual world 206 looking at a participant in the original virtual world 204 of the system 100.
- FIG. 15 there is shown a diagram 1500 of a participant using a gesture 1502 to move a visibility plane 1508 in any spatial orientations horizontally 1506 through a virtual element 1504 with a visibility plane 1508 in the original virtual world 204, the one or more than one recursive virtual world 206 or both the original virtual world 204 and the one or more than one recursive virtual world 206 of the system 100.
- FIG. 17 there is shown a diagram 1700 of a participant in the original virtual world 204 using ray casting 1702 to manipulate one or more than one virtual element 1704 in the one or more than one recursive virtual world 206 of the system 100.
- FIG. 18 there is shown a diagram 1800 of an exterior view 1802 of the one or more than one recursive virtual world, with programmable or selectable environment, weather and audio in the one or more than one recursive virtual world 206 of the system 100.
- the system 100 displays real time, dynamic virtual weather corresponding to a specific real physical location.
- FIG. 19 there is shown a diagram 1900 of a participant using a one or more than one voice command 1902, a virtual display control panel 1908, and one or more than one gesture command 1904 to manipulate one or more than one virtual element 1906 in the original virtual world 204, the one or more than one recursive virtual world 206, or both the original virtual world 204 and the one or more than one recursive virtual world 206 of the system 100.
- FIG. 20 there is shown a diagram 2000 of a participant using a one or more than one voice command 2002, one or more than one gesture command 2004 and, optionally, a hardware controller 2006 to manipulate one or more than one virtual element 2008 in the one or more than one recursive virtual world 206 of the system 100.
- FIG. 21 there is shown a flowchart diagram 2100 of some steps of a method 2000 for participants using the system 100.
- the method comprises the steps of first, one or more than one participant enters an original virtual world 204 as an avatar. Next, all participants regardless of physical location are spatially and audibly synchronized 2104 in three dimensions and scaled 1 : 1 in both original virtual world 204 and, optionally, the one or more than one recursive virtual world 206. Participant’s avatars can move 2106 at will to and from the original virtual world 204 or the one or more than one recursive virtual world 206 using a command set 126-134.
- the original virtual world 204 and the one or more than one recursive virtual world 206 session begins 2106 with participants appearing as avatars in the original virtual world 204 and the one or more than one recursive virtual world 206.
- remote one or more than one recursive virtual world participants can change elements 2108 in the one or more than one recursive virtual world 206 by using the command set 126-134.
- the one or more than one recursive virtual world 206 can be changed by invoking an in world virtual control panel to display the various options for a given object or part of the one or more than one recursive virtual world 206.
- participants in the remote one or more than one recursive virtual world are represented visually to any participants in the original virtual world 204 and the one or more than one recursive virtual world 206 as miniature versions of their avatars in the remote one or more than one recursive virtual world.
- participant in the one or more than one recursive virtual world 206 see and hear themselves 2110 and each other in 1 : 1 scale in the detailed one or more than one recursive virtual world, but cannot see the local one or more than one recursive virtual world or the participants.
- both the remote and local one or more than one recursive virtual world participants can see each other and modify 2112 the original virtual world 204, the one or more than one recursive virtual world 206 or both the original virtual world 204 and the one or more than one recursive virtual world 206.
- a local one or more than one virtual world session begins with one or more than one participant appearing as an avatar in the one or more than one virtual world and synchronizes their avatar in and with the one or more than one original virtual world.
- the participants’ avatars may enter one or more than one recursive virtual worlds from the one or more than one original virtual world 204, maintaining spatial and acoustical three-dimensional synchronization at, optionally, 1 : 1 scale.
- Each participant can see each other, and the local one or more than one virtual world 204 and one or more than one recursive virtual world 206.
- the local one or more than one recursive virtual world 206 comprises a reduced scale one or more than one recursive virtual world 206 of a concept, a project or an object, and miniature versions of any local one or more than one recursive virtual world session participants 402 inside the reduced scale one or more than one recursive virtual world 206 who have entered the one or more than one recursive virtual world 206.
- participant are able to change objects and features and elements of objects in the one or more than one recursive virtual world 206 by voice command, gaze, gesture, controller, a combination, or by invoking an in world control panel to display the various feature options for a given object 504, 604 or part 1006 of the one or more than one recursive virtual world 206.
- Participants who enter the one or more than one recursive virtual world 206 are represented visually to any participants remaining in the original one or more than one local virtual world 204 or one or more than one recursive virtual world 206 as miniature versions 402 of their avatars in the one or more than one recursive virtual world. However, the participants can interact, see, and converse with each other in 1 : 1 scale in the one or more than one recursive virtual world 206. Optionally, the participants can see outside the one or more than one recursive virtual world 206, viewing the local one or more than one recursive virtual world exterior environment 206 and any optionally participants’ avatars still in the original virtual world 204 that may be present.
- Participants may enter a one or more than one recursive virtual world 206. These participants can be different combinations of individual remote participants, local participants 402 that are physically co-located, and using different device types, for example, a headset, a tablet, a smart device, or a computer 106, 108, 110, 112, 116, 118, 138. Physically co-located participants will need to be position synchronized to avoid real world collisions if the co-located participants are permitted to physically move.
- a 'chair’ or ‘presenter’ role 302 is chosen by one or more than one participant to manage the system 100.
- the chair role 302 has specific permissions that enable the chair role 302 to select one or more than one recursive virtual world 206 or objects to view, and the selected object is optionally adjustable and scaled in size relative to the local original virtual world 204, and to the one or more than one recursive virtual world 206.
- Participants in the local one or more than one original virtual world 204 can view and interact with a scaled down one or more than one recursive virtual world 206 of the project or session. Degree and type of interaction depends on each participant’s 302, 304, 306, 308 role command set 126-134.
- the available command set 126-134 also called a design tools set, includes voice, gaze, gesture, device, controller and combinations thereof.
- One or more than one participant 302, 304, 306, 308. can enter a 1 : 1 scale version of the one or more than one recursive virtual world using an avatar 402 for inspection, modification, and testing of the space.
- Participants remaining in the local one or more than one original virtual world 204 will see in one or more than one recursive virtual world 206 an arbitrary, scalable, number of one or more than one participant’s avatars 402 moving proportionally in the one or more than one recursive virtual world 206.
- participant may optionally see the one or more than one original virtual world 204 and the avatars 302, 304, 306, 308 in the original virtual world 204, who are looking into the one or more than one recursive virtual world 206 from an external point in the original virtual world 204 relative to the one or more than one recursive virtual world 204.
- participant with the appropriate role privileges can use the command set 126-134 to manipulate elements of the one or more than one recursive virtual world 206.
- the command set includes instructions operable on the one or more than one server 102 to interpret the command set.
- Command set includes, for example: “make floor sky blue”, “move this bookcase left four inches”, “swap this chair ⁇ number ⁇ xyz> with a selected chair ⁇ number abc> ofran arbitrary number of virtual furniture elements available in a library of virtual elements displayed on the dashboard 140.
- the one or more than one participant 210, 212, 208 can perform diverse operations, such as, for example, run usability testing with an avatar, place one or more than one virtual element in a room, test for choke points in a building or hallway, examine body vs. object collisions in diverse scenarios including an emergency scenarios. For body vs. object collisions, any and all collisions and collision types can be logged, played back, analyzed per a diversity of metrics, and otherwise managed for evaluation in the database 122.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer And Data Communications (AREA)
- Information Transfer Between Computers (AREA)
Abstract
A system and method for a recursive virtual world with a voice controlled interface having a server, a database, a participant using a headset or a display device to view and navigate an original virtual world and a recursive virtual world. The server having instructions for: creating the virtual world having virtual elements; creating the recursive virtual world; providing a command set to manipulate the virtual elements in the virtual worlds; creating a design tool, teamwork tools for the participants; storing and analyzing interactions of the participants to create predictive models and continuously updating and dynamically adjusting the virtual worlds; and translating the command set into different languages automatically and in real time for multinational participants.
Description
A System For An Independent Recursive Virtual World With A Voice Controlled Interface
CROSS-REFERENCE TO RELATED APPLICATIONS
[001] This Application claims the benefit under 35 U.S.C. § 119(e) of U.S. Provisional
Patent Application Ser. No. 63448673, filed on 05-MAR-2023, the contents of which are incorporated herein by reference in their entirety.
FIELD OF THE INVENTION
[002] The present invention is in the technical field of virtual reality and more particularly to a system for an independent recursive virtual world with a voice controlled interface.
BACKGROUND
[003] Currently, there are a plurality of virtual worlds. Each world is pre-programmed for a specific purpose. Limited changes are allowed in these virtual worlds. Additionally, the participant interface for these virtual worlds occasionally allow for an avatar’s movement, but little else. Most virtual worlds are geared toward gaming and other quick profit enterprises without a lot of connectivity to business. Currently, people from around the world can hold a meeting in a virtual meeting room, show presentations, have discussions, and transfer documents to one another. Basically, the same functions that would be available in a real world meeting room. This lack of functionality limits the usefulness of the virtual world to either gaming or an alternative to in person meetings. Any documents, or virtual worlds are only viewable by attendees. No one can stray out of the virtual world construct that is presented. It is a very flat, almost two dimensional (2D) virtual reality.
[004] None of the current virtual worlds allow the random addition or deletion of parts of the virtual world. They currently do not allow virtual worlds nested or recursed inside other virtual worlds. Nor does the current art allow for changes in the virtual world that can be seen by people inside a recursive virtual world and observe changes made in those recursive virtual worlds.
[005] Therefore, there is a need for a system for an independent recursive virtual world with a voice controlled interface, overcoming the limitations of the prior art.
SUMMARY
[006] The system overcomes the limitations of the prior art by providing a computer implemented system for one or more than one recursive virtual world with a voice controlled interface. The system has a server selected from the group consisting of a computer, a headset, a smart phone, a smart device, a smart tablet, and a smart display. A database is operably connected to the server. Participants are operably connected to the server and one or more than one original virtual world and one or more than one recursive virtual world (collectively “the virtual worlds”) using a headset, a display device, or both a headset and a display device to to view and navigate through the virtual worlds. There is also provided instructions operable on the server for the virtual worlds for: creating one or more than one original virtual world comprising one or more than one virtual element; creating one or more than one independent recursive virtual world operably connected to the original virtual world. The independent recursive virtual world comprises virtual elements; providing a command set to the virtual elements in the virtual worlds; creating a design tool set and teamwork tools usable by the participants; storing and analyzing interactions of the participants to create predictive models to continuously update and dynamically adjust the virtual worlds in real time; and translating the command set, the design tools and the teamwork tools into different languages automatically and in real time for multinational participants.
[007] The system further comprises instructions for virtual operations management and monitoring of real world physical object. The instructions are for: receiving, aggregating, and displaying in a plurality of adjustable, extensible, optimized formats and information from a plurality of sensors that provide real-time continuous monitoring of a system, a building, a master-plan construction site, an assembly, a structure, a wind turbine tower, a theme park attraction, etc. for operations and management; detecting application categories comprising structural integrity, public safety, wind load, isolation, and a plurality of capacity or load monitoring, including power line fluctuations, logging all data and tagging the data appropriately using machine learning methods to effect pattern recognition for the building or the facility for operations management; analyzing sensor metrics and their permutations, along with external contextual data to provide real-time analytics reporting, and predictive analytics reporting; displaying information to the one or more than one participant wearing one or more than one
headset that are immersed in the original virtual world and the one or more than one recursive virtual world; the participants can see each others avatars, and can converse and interact spatially with the other avatars using a system wide communications module connected to the one or more than one headset microphone, or one or more than one external microphone; The participants that have an interactive participant role, can interact with the virtual worlds by using the command set and the system wide communications module.
[008] There are also instructions provided for a validation and/or permission scheme to limit entrance of participants into the virtual worlds and instructions for an incremental, rolebased administration for the virtual worlds for each of the participants.
[009] The database stores incrementally accumulated data for the virtual worlds, including all virtual body and object collisions can be logged, played back and otherwise managed for evaluation in the database, for future use by participants.
[0010] The one or more than one participant can speak to and interact with any other participants in the virtual worlds.
[0011] The virtual worlds can have virtual elements that correspond to actual, real world, physical objects. The virtual worlds are also persistent and updateable for the participants to virtually enter and manipulate the original virtual worlds, depending on access rights of the participants. The participants are physically local to the server, physically remote to the server or both physically local and physically remote to the server.
[0012] The command set to manipulate the virtual worlds comprise: voice commands, gestures, hardware controller commands, gaze commands; a virtual audio-visual command interface, and a virtual audio-visual control interface. The command set is used for installing, viewing, evaluating, adjusting, altering, replacing, designing, and redesigning virtual elements of the virtual worlds. The system also has real-time logging, reporting and monitoring of the virtual worlds. The command set also includes instructions operable on the one or more than one server to interpret the command set in multiple languages.
[0013] The smart devices used in the system also have instructions to install, view, evaluate, adjust, alter, replace, design and redesign various elements of the virtual worlds.
[0014] Complex projects, that use the virtual worlds, are able to be integrated with each other recursively so that all the virtual elements of all the virtual worlds are viewable independently or cooperatively.
[0015] The participants that enter the recursive virtual world are represented, visually and acoustically to other participants in the virtual worlds as an avatar. The participants, regardless of physical location, are spatially synchronized in three dimensions at a 1 : 1 scale in any virtual world in the system. The avatars in the recursive virtual worlds are a miniature versions of the avatars of the participant in the original virtual world. The avatars can see outside the recursive virtual world and can view the original virtual world and any of the avatars in the original virtual world. The avatars comprise a plurality or categories: a general avatar, an actor avatar, and a a third party avatar. The actor avatar is used for specific testing, relevant to the one or more than one participant’s preferences or to a physically challenged participant where accommodation requirements, such as the American’s with Disabilities Act (ADA) and other laws and regulations that apply to that participant; wherein the actor avatar comprises the same access and assistance as the one or more than one participant would require in the physical world. The third party avatars are created or purchased, but have to conform to system requirements. The participants in the original virtual world will see other participant’s avatars, in the one or more than one recursive virtual world, moving proportionally to the elements in the recursive virtual world.
The participants can see and hear avatars the original virtual world and the avatars in the recursive virtual world, depending on the participant’s role. The participants and the avatar can view additional recursive virtual worlds from an external point relative to the original virtual world. The participant’s avatar is selected from the group consisting of a basic avatar, an advanced avatar, or a participant avatar. The avatars are customizable by each participant based on the participant’s role, and is selected from the group comprising: avatar selection, name, profile, facial features, hair, body, and clothing. The avatars have the following interaction capabilities: opening doors and drawers, toggling light and lamp switches, opening and closing drapes; moving objects, like a chair, desk, etc., wherein all move actions are logged and optionally pinned and stored in the database; displaying different positions, superimposed, of a specific object by all participants across a defined time duration; changing, removing or adding new virtual elements or the virtual element’s materials and finishes; setting a time of day and a season to control a virtual sun direction; and using and recording the results from a point to point measuring tape.
[0016] The gesture commands comprise: selecting and moving virtual elements in a vertical plane, selecting and moving virtual elements in a horizontal plane, a combination gesture
for selecting and scaling virtual elements in the virtual worlds, selecting and moving virtual elements in any other planar and curvilinear manner, rotating and tilting virtual elements in the virtual worlds, selecting an option from a virtual menu, selecting virtual elements to alter the size, shape, location, or other property of the virtual element in the virtual worlds, using a tap and hold gesture on virtual elements in the virtual worlds, using a combination select and action command on one or more than one element in the original virtual world, the one or more than one recursive virtual world, or both the original virtual world and the one or more than one recursive virtual world, moving a visibility plane in any spatial orientation horizontally or vertically through one or more than one virtual element in the original virtual world, the one or more than one recursive virtual world, or both the original virtual world and the one or more than one recursive virtual world, and manipulating virtual elements using raycasting in the virtual worlds.
[0017] There is also provided a method of using a system for one or more than one recursive virtual world with a voice controlled interface. The method comprising the steps of, first entering an original virtual world as an avatar by one or more than one participant. Then, synchronizing participants, regardless of physical location, spatially and audibly in three dimensions and scaled 1 : 1 in both the original virtual world and the one or more than one recursive virtual world. Next, moving the one or more than one participant’s avatar at will to and from the original virtual world or the one or more than one recursive virtual world using a command set. Then, beginning a session with one or more than one participant appearing as avatars in the original virtual world and the one or more than one recursive virtual world. Next, changing one or more than one virtual elements by the one or more than one participant in he original virtual world, the one or more than one recursive virtual world, or both the original virtual world and the one or more than one recursive virtual world using the command set. Then, changing the one or more than one virtual element by invoking an in world virtual control panel to display various options of the one or more than one participant in he original virtual world, the one or more than one recursive virtual world, or both the original virtual world and the one or more than one recursive virtual world. Finally, representing the one or more than one participant as a miniature avatars of the one or more than one participant in the one or more than one recursive virtual world.
[0018] There is also provided a computer implemented system for one or more than one recursive virtual world with a voice controlled interface having one or more than one server; one or more than one database operably connected to the one or more than one server; one or more than one participant operably connected to the one or more than one server and one or more than one original virtual world and one or more than one recursive virtual world using a headset, a display device, or both a headset and a display device to to view and navigate through an original virtual world, one or more than one recursive virtual world, or both the original virtual world and the one or more than one recursive virtual world, instructions operable on the one or more than one server for the original virtual world and the virtual worlds for first, creating the one or more than one original virtual world comprises one or more than one virtual element. Then, creating the one or more than one independent recursive virtual world operably connected to the one or more than one original virtual world; wherein the one or more than one independent recursive virtual world comprises one or more than one virtual element. Next, providing one or more than one command set to manipulate one or more than one virtual element in the original virtual world and the one or more than one recursive virtual world. Then, creating a design tool set usable by the one or more than one participant. Next, creating teamwork tools usable by the one or more than one participant. Then, storing and analyzing interactions of the one or more than one participant to create predictive models to continuously update and dynamically adjust the original virtual world and the one or more than one recursive virtual world in real time. Finally, translating the command set into different languages automatically and in real time for one or more than one multinational participant.
BRIEF DESCRIPTION OF THE DRAWINGS
[0019] The present invention overcomes the limitations of the prior art by providing a system 100 for an independent recursive virtual world with a voice controlled interface. These and other features, aspects and advantages of the present invention will become better understood with regard to the following description, appended claims, and accompanying figures where:
[0020] FIG. l is a diagram of a system for an independent recursive virtual world with a voice controlled interface, according to one embodiment of the present invention;
[0021 ] FIG. 2 is a diagram showing one or more than one participant in an original virtual world and one or more than one recursive virtual world created in the system of FIG. 1; [0022] FIG. 3 is a diagram of a perspective view of a recursive virtual world of the system of FIG. 1;
[0023] FIG. 4 is a diagram of a perspective view of one or more than one participant avatars in the original virtual world viewing one or more than one participant avatar in the one or more than one recursive virtual world in the system of FIG. 1;
[0024] FIG. 5 is a diagram of a participant using one or more than one gesture for selecting and moving one or more than one virtual element in a plane in the recursive virtual world of the system of FIG. 1;
[0025] FIG. 6 is a diagram of a participant selecting and moving one or more than one virtual element in a horizontal plane in the recursive virtual world of the system of FIG. 1;
[0026] FIG. 7 is a diagram of a participant using a combination gesture for selecting and scaling one or more than one virtual element in the recursive virtual world of the system of FIG. 1;
[0027] FIG. 8 is a diagram of a participant performing a gaze with a single hand gesture combination command for rotating and tilting one or more than one virtual element in the recursive virtual world of the system of FIG. 1;
[0028] FIG. 9 is a diagram of a participant using a gesture for performing virtual menu selection in the system of FIG. 1;
[0029] FIG. 10 is a diagram of a participant using a single hand gesture for bringing up a virtual menu to select one or more than one virtual item to alter its size, shape, location, or other features in the system of FIG. 1;
[0030] FIG. 11 is a diagram of a participant single tap gesture for selection of one or more than one virtual element using an action command, in the system of FIG. 1;
[0031] FIG. 12 is a diagram of a participant using a tap and hold gesture in the system of FIG. 1;
[0032] FIG. 13 is a diagram of a participant using a combination select and action command useful in the system of FIG. 1;
[0033] FIG. 14 is a diagram of a participant’s avatar view from inside the recursive virtual world of the system of FIG. 1;
[0034] FIG. 15 is a diagram of a participant using a gesture to move a virtual element horizontally with a visibility plane in in the recursive virtual world of the system of FIG. 1; [0035] FIG. 16 is diagram of a participant using a gesture to move a virtual element vertically with a visibility plane in the recursive virtual world of the system of FIG. 1;
[0036] FIG. 17 is a diagram of a participant using ray casting to manipulate one or more than one virtual element in the recursive virtual world of the system of FIG. 1;
[0037] FIG. 18 is a diagram of an exterior view of the recursive virtual world, with weather and audio in the recursive virtual world of the system of FIG. 1;
[0038] FIG. 19 is a diagram of a participant using a one or more than one voice and gesture command to manipulate one or more than one virtual element in the recursive virtual world of the system of FIG. 1;
[0039] FIG. 20 is a diagram of a participant using a one or more than one voice command, gesture command and a virtual controller to manipulate one or more than one virtual element in the recursive virtual world of the system of FIG. 1;
[0040] FIG. 21 is a flowchart diagram of some steps of a method for participants using the system of FIG. 1; and
[0041] FIG. 22 is a flowchart diagram of some steps of a method for using the system of FIG. 1.
DETAILED DESCRIPTION OF THE INVENTION
[0042] The present invention overcomes the limitations of the prior art by providing an independent recursive virtual world with voice controlled interface.
[0043] All dimensions specified in this disclosure are by way of example only and are not intended to be limiting. Further, the proportions shown in these FIG.s are not necessarily to scale. As will be understood by those with skill in the art with reference to this disclosure, the actual dimensions and proportions of any system 100, any device or part of a system 100 or device disclosed in this disclosure will be determined by its intended use.
[0044] Methods and devices that implement the embodiments of the various features of the invention will now be described with reference to the drawings. The drawings and the associated descriptions are provided to illustrate embodiments of the invention and not to limit the scope of the invention. Reference in the specification to “one embodiment” or “an
embodiment” is intended to indicate that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least an embodiment of the invention. The appearances of the phrase “in one embodiment” or “an embodiment” in various places in the specification are not necessarily all referring to the same embodiment.
[0045] Throughout the drawings, reference numbers are re used to indicate correspondence between referenced elements. In addition, the first digit of each reference number indicates the FIG. where the element first appears.
[0046] As used in this disclosure, except where the context requires otherwise, the term “comprise” and variations of the term, such as “comprising”, “comprises” and “comprised” are not intended to exclude other additives, components, integers or steps.
[0047] In the following description, specific details are given to provide a thorough understanding of the embodiments. However, it will be understood by one of ordinary skill in the art that the embodiments can be practiced without these specific details. Well known circuits, structures and techniques may not be shown in detail in order not to obscure the embodiments. For example, circuits can be shown in block diagrams in order not to obscure the embodiments in unnecessary detail.
[0048] Also, it is noted that the embodiments can be described as a process that is depicted as a flowchart, a flow diagram, a structure diagram, or a block diagram. The flowcharts and block diagrams in the figures can illustrate the architecture, functionality, and operation of possible implementations of system 100s, methods and computer programs according to various embodiments disclosed. In this regard, each block in the flowchart or block diagrams can represent a module, segment, or portion of code, that can comprise one or more executable instructions for implementing the specified logical functions. It should also be noted that, in some alternative implementations, the functions noted in the blocks may occur out of the order noted in the figures. Although a flowchart may describe the operations as a sequential process, many of the operations can be performed in parallel or concurrently. In addition, the order of the operations can be rearranged. A process is terminated when its operations are completed. A process may correspond to a method, a function, a procedure, a subroutine, a subprogram, etc. When a process corresponds to a function, its termination corresponds to a return of the function to the calling function or the main function. Additionally, each block of the block diagrams and, or flowchart illustration, and combinations of blocks in the block diagrams and, or flowchart
illustration, can be implemented by special purpose hardware based system 100s that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
[0049] Moreover, a storage may represent one or more devices for storing data, including read only memory ROM, random access memory RAM, magnetic disk storage mediums, optical storage mediums, flash memory devices and, or other non transitory machine readable mediums for storing information. The term "machine readable medium" includes, but is not limited to portable or fixed storage devices, optical storage devices, Internet or “cloud” storage, wireless channels and various other non transitory mediums capable of storing, comprising, containing, executing or carrying instructions and, or data.
[0050] Furthermore, embodiments can be implemented by hardware, software, firmware, middleware, microcode, or a combination thereof. When implemented in software, firmware, middleware or microcode, the program code or code segments to perform the necessary tasks can be stored in a machine readable medium such as a storage medium or other storages. One or more than one processor may perform the necessary tasks in series, distributed, concurrently or in parallel. A code segment may represent a procedure, a function, a subprogram, a program, a routine, a subroutine, a module, a software package, a class, or a combination of instructions, data structures, or program statements. A code segment can be coupled to another code segment or a hardware circuit by passing and, or receiving information, data, arguments, parameters, or memory contents. Information, arguments, parameters, data, etc. can be passed, forwarded, or transmitted through a suitable means including memory sharing, message passing, token passing, network transmission, etc. and are also referred to as an interface, where the interface is the point of interaction with software, or computer hardware, or with peripheral devices.
[0051] In the following description, certain terminology is used to describe certain features of one or more embodiments of the invention.
[0052] The term “virtual environment” refers to any two dimensional or three dimensional virtual environment (VR), extended reality (XR) environment, or a mixed reality (MR) environment.
[0053] The term “smart device” refers to any monitor, VR headset, XR headset, tablet, smart device or other computing device that can be used to view and enter instructions to control a VR or XR environment.
[0054] The term “avatar” refers to an icon or figure representing a particular person.
[0055] The term “headset” refers to any VR, XR or MR headset, a head mounted display
(HMD) device, such as a Meta Quest, or an Apple Vision Pro for viewing and interacting with VR, XR or MR content.
[0056] The term “feature set” refers to a separable set of instructions operable on one or more than one processor, where each set of instructions perform specific tasks.
[0057] The term “command set” refers to a voice command, a gesture command, a gaze command, a VR hardware controller, or any combination thereof.
[0058] The term “element” refers to discrete parts of a virtual world, individually or grouped together, such as a building, a wall in the building, a room in the building, a door in the room, or a nail in the door.
[0059] The term “original virtual world” refers to a top level virtual world for accessing recursive virtual worlds operably connected to it.
[0060] The term “recursive virtual world” refers to other virtual worlds or elements directly connected to an original virtual world that expand, extend or are lined to the original virtual world.
[0061] Various embodiments provide a system for an independent recursive virtual world with a voice controlled interface. One embodiment of the present invention provides a system for an independent recursive virtual world with a voice controlled interface. In another embodiment, there is provided a method for using the system. The system and method will now be disclosed in detail.
[0062] Referring now to FIG. 1, there is shown a diagram of a system 100 for one or more than one recursive virtual world 206 with a voice controlled interface 132, according to one embodiment of the present invention. The system 100 comprises one or more than one server 102 operably connected to one or more than one database 122 for storing instructions and data for all elements of the one or more than on original virtual world 204 and 206. One or more than one participant 104, 106, 108, 110, 112, and 120 is operably connected to the one or more than one server 102 through one or more than one original virtual world 204 and an independent one or more than one recursive virtual world 206, using one or more than one headset 106, 108, 110, 116, 118 and/or one or more than on smart device 138, discussed in detail below. The system 100 also comprises instructions operable on the one or more than one server 102 for the one or more
than one participant 104-124 to manipulate the original virtual world 204, the one or more than one recursive virtual world 206 or both the original virtual world 204 and the one or more than one recursive virtual world 206 using a command set 126, 128, 130, 132, 134 and 140. The command set comprise one or more than one voice command 132, one or more than one gesture command 126 and 128, one or more than one gaze command 134, and one or more than one controller command 113, 114 and 130, according to one embodiment of the present invention. In another embodiment, set command set 126-134 further comprises a design tool set and one or more than one teamwork tool.
[0063] The system 100 comprises instructions executable on a processor for creating and using a design tool set and teamwork tools for the original virtual world 204 that is persistent and updatable and the one or more than one recursive virtual world 206. The design tools set and the teamwork tools are extremely useful in the system 100 and are available across a plurality of industries, skill sets, markets, goals, and use cases.
[0064] The system 100 creates one or more than one recursive virtual world 206 that is persistent and updateable inside the original virtual world 204 for the one or more than one participant 104-124 to virtually enter and manipulate both the original virtual world 204 and the one or more than one recursive virtual world 206, depending on the one or more than participant’s 104-124 access rights in the system 100. Using one or more than one headset 106, 108, 110, 116, 118, one or more than one controller command 113, 114 and 130, one or more than one gesture command 126 and 128, one or more than one voice command 132 and/or one or more than one gaze command 134, the one or more than one participant 104-124 is provided tools in the system 100 to manipulate elements in both the original virtual world 204 and the one or more than one recursive virtual world 206. Optionally, the system 100 comprises instruction for one or more than on smart device 138, to install, view, evaluate, adjust, alter, replace, design and redesign various elements of the original virtual world 204 and the one or more than one recursive virtual world 206. Additionally, complex projects that use one or more than one original virtual world 204 and one or more than one recursive virtual world 206, are able to be integrated with each other recursively so that all the elements of all the virtual worlds, including buildings, land area developments, facility and area master plans, and processes, can be viewed independently or cooperatively during the life of the project. As will be understood by those with skill in the art with reference to this disclosure, the examples herein are not meant to be limiting.
Any physical and virtual world elements from games, construction, interior design and coding can be entered into the system 100 for expanded capabilities not found in the prior art.
[0065] Additionally, the system 100 provides instructions for viewing, inspection, annotation, modification, original concept design stages, and subsequent project stages, by the one or more than one participant 104-124 in the original virtual world 204 and the one or more than one recursive virtual world 206. For example, in an actual, non-virtual, physical construction, installation, subsystems infrastructure review: evaluation and testing can be performed virtually, thereby alleviating the need for travel to the actual physical building. One or more than one virtual version 205 of the physical site is is also known as a ‘digital twin.’ This efficiency improvement alone will save time, money, resources, and speed up completion of the task related to the actual physical site. Moreover, acceptance inspections and post-completion operations management, that includes ongoing as-built updates to the one or more than one virtual version 205 of the physical site, can be reviewed virtually using the system 100.
[0066] The system 100 also comprises instructions for an operations dashboard 140 that can be used in conjunction with the design tools set and the teamwork tools to issue commands. Optionally, the operations dashboard 140 can be used to continuously monitor all data feeds from a plurality of sensors in a physical, real world facility. The data is stored in the database 122 and used by the server 102 to create a digital twin of the facility and the present an actual state of the facility to the one or more than one participant 104-124. The actual state of the facility is shown in real-time in the real world facility in the original virtual world 204 and the one or more than one recursive virtual world 206. For example, infrastructure services, systems performance, interior air flow and quality, real-time occupancy, usage, and an arbitrary set of additional dimensions, among others can be displayed on the dashboard. Also, the real-time reporting and monitoring of the original virtual world 204 and the one or more than one recursive virtual world 206 can be used as an emergency warning system. The system 100 can be programmed to optimize for early warning detection. For the original virtual world 204 and the a one or more than one recursive virtual world 206 operations management and monitoring tool contemplated here includes:
• receiving, aggregating, and displaying in a plurality of adjustable, extensible, optimized formats and information from a plurality of sensors that provide real-time continuous
monitoring of a system, a building, a master-plan construction site, an assembly, a structure, a wind turbine tower, a theme park attraction, etc. for operations and management.
• detecting application categories comprising structural integrity, public safety, wind load, isolation, and a plurality of capacity or load monitoring, including power line fluctuations.
• logging all data and tagging the data appropriately. Machine learning methods are used to effect pattern recognition for the building or the facility for operations management. Sensor metrics and their permutations, along with external contextual data, such as, for example, humidity and temperature are analyzed by the system to provide real-time analytics reporting, and predictive analytics reporting.
• displaying information to the one or more than one participant 104-124 wearing one or more than one headset 106-118 that are immersed in the original virtual world 204 and the one or more than one recursive virtual world 206.
• the one or more than one participant 104-124 can see each others avatars 208, 210 and 212 and can converse and interact spatially with the one or more than one avatar 208, 210 and 212 using a system 100 wide communications module connected to the one or more than one headset 106 - 118 microphone, or one or more than one external microphone (not shown).
• one or more than one participant 104-124 having an interactive participant role, can interact with the original virtual world 204 and the one or more than one recursive virtual world 206 by using the command set 126-134 and the system wide communications module. [0067] The one or more than one participant 104-124 can use one or more than on smart device 138 to view and navigate through the original virtual world 204 and the one or more than one recursive virtual world 206. This is similar to a portable window. The one or more than on smart device 138 has equivalent functionality to that experienced by the one or more than one participant 104-124 using one or more than one headset 106-118. Any of the one or more than one participant 104-124 using the one or more than on smart device 138 can speak and interact with the other participants in the original virtual world 204 and the one or more than one recursive virtual world 206.
[0068] The one or more than one server 102 also comprises instructions for a validation and/or permission scheme to limit the one or more than one participant 104-124 entrance into the one or more than one recursive virtual world 206 and functionality that each of the one or more
than one participant 104-124 is permitted in the one or more than one recursive virtual world 206. The validation and/or permission schemes are managed and administered by staff.
[0069] The system 100 also comprises instructions for an incremental, role-based administration for the original virtual world 204 and the one or more than one recursive virtual world 206 for each of the one or more than one participant 104-124. The increments of functionality, or participant levels, are controlled by an experienced participant. The experienced participant is also know as a guide, a manager, a chair, a presenter, and a superuser. The experienced participant role has a full set of participant functionality that does not include administration functions. An advanced interaction role comprises a command set 126-134 that is extensive, adjustable, and defined as needed in the system 100. The advanced interaction role does not have specific administration permissions nor experienced participant permissions. Other participant roles include a passive role. The passive role has no interaction voice for conversation with other participants, but asking questions is an optional functionality for the passive role and is controlled by the experienced participant role. One or more than one avatar 208-212 for the passive role or its point of view (POV) are also controlled by the experienced participant. The passive role is useful for one or more than one participant 104-124 visiting the original virtual world 204 and the one or more than one recursive virtual world 206 that have no need to manipulate any virtual elements. There is also a basic interaction role that has a command set 126-134 that is adjustable and includes opening doors, operating light switches, avatar locomotion within elements, and changing certain elements of the original virtual world 204 and the one or more than one recursive virtual world 206. The one or more than one avatar 208-212 for the basic interaction role is controlled by the command set 126-134 or one or more than one smart device 138. A dashboard 140 can be shown by the system 100 when one or more than one participant 104-124 uses one or more than one pre-defined voice command 132 or one or more than one pre-defined gesture command 126 and 128, such as, <‘looks at watch. ’>. The dashboard 140 is set by an administrator of the system 100 to appear and remain in a convenient location and orientation. For example, an arbitrary but typical location for the dashboard 140 is on a virtual laptop display, or a location centered on a line between the one or more than one participant’s 104-124 wrist and face. The dashboard 140 is always oriented perpendicularly to the one or more than one participant’s 104-124 face, until dismissed by the one or more than one participant 104-124 using the command set 126-134.
[0070] The position and orientation of the dashboard 140 supports readability and remains constant relative to the one or more than one avatar 208-212 during any kind of translocation. In one embodiment, the dashboard 140 is represented by a window that is repositionable and resizable by the one or more than one participant 104-124 using the command set 126-134 or by using a built in microphone for any participant using one or more than on smart device 138, or an external microphone operably connected to the system 100 or the one or more than on smart device 138.
[0071] In all participant interactions, the basic command set 126-132 for the original virtual world 204 and the one or more than one recursive virtual world 206 comprises:
• selecting one or more than one element in the original virtual world 204 or the one or more than one recursive virtual world 206.
• adjusting an arbitrary feature of the element using a widget, such as, for example, color, saturation, brightness, orientation, size, texture, reflectance, light transmission, acoustic absorption and acoustic reflection.
[0072] In another example, interactions in a virtual building interior 402 include:
• changing a surface covering, or material, such as wall paper and flooring.
• changing a surface, such as paint on a wall, the color of a chair, etc.
• changing an element’s attributes, such as, physical texture or roughness, of surface colors and coverings.
• changing reflectance, (matte, semi-matte, or gloss finish), and acoustic properties that comprise surface hardness, density, and absorption coefficient).
• substituting furniture and decor, such as adding or replacing a chair, a rug, drapes, a portrait or painting.
• adjusting furniture or decor, for example, repositioning a painting on a wall, or moving a table in a room.
• scaling furniture or decor using the command set 126-134.
• scaling all the elements in the one or more than one recursive virtual world 206 or another one or more than one recursive virtual world 206 in the system. That is, when the one or more than one participant 104-124 are in a first one or more than one recursive virtual world 206 and viewing a second one or more than one recursive virtual world 206, the one or more than one participant 104-124 in the first one or more than one recursive virtual world 206 can
modify elements in the second one or more than one recursive virtual world 206. However, the converse is not generally true. The one or more than one participant 104-124 in the one or more than one recursive virtual world 206 cannot change elements in the original virtual world 204. [0073] Referring now to FIG. 2, there is shown a diagram showing one or more than one participant 104-124 in an original virtual world 204 and one or more than one recursive virtual world 206 created in the system 100. A one or more than one recursive virtual world 206 session begins with one or more than one remote participant 202, one or more than one local participant 204 or both one or more than one remote participant 202 and one or more than one local participant 204 entering the one or more than one recursive virtual world 206. The one or more than one participant 202 and 204 appear as one or more than one avatar 208, 210 and 212 in the one or more than one recursive virtual world 206. Each of the one or more than one participant 202 and 204, that have entered the recursive virtual world 206, can see each other in the one or more than one recursive virtual world 206 using one or more than one headset 106-118 or one or more than one smart device 138. The system 100 comprises instructions to create the one or more than one recursive virtual world 206 that has a virtual replica of a physical project or an element along with one or more than one avatar 208-212 of the one or more than one participant 104-124 inside the one or more than one recursive virtual world 206.
[0074] In the one or more than one recursive virtual world 206 the one or more than one participant 202 and 204 is able to change elements in the one or more than one recursive virtual world 206 by using the command set 126-134, or by invoking the dashboard 140 to show various options for a given virtual element of the one or more than one recursive virtual world 206. [0075] The one or more than one participant 202 and 204 that enter the one or more than one recursive virtual world 206 is represented, visually, to any other participants in the original virtual world 204, as one or more than one avatar 208-212. The one or more than one avatar 208-212 is a miniature version of avatars of the one or more than one participant 104-124 in the original virtual world 204. However, the one or more than one participant 104-124 see, speak and interact with each other in 1 : 1 scale in the original virtual world 204. Optionally, the one or more than one avatar 208-212 can see outside the one or more than one recursive virtual world 206 and can view the original virtual world 204 and any of the avatars in the original virtual world 204.
[0076] In the one or more than one recursive virtual world 206 participants with the appropriate role privileges can use the command set to manipulate elements of the one or more than one recursive virtual world 206. The command set includes instructions operable on the one or more than one server 102 to interpret the command set. Such as, for example, “make floor sky blue”, “move this bookcase left four inches”, “swap chair in a first one or more than one recursive virtual world 206 to a second one or more than one recursive virtual world 206 number <xyz>”, etc. The one or more than one participant 104-124 can run usability testing with their avatar to place elements in a room, test for choke points in a building or hallway, examine body and object collisions in a scenario, such as an emergency situation. All the body and object collisions can be logged, played back and otherwise managed for evaluation in the database 122. [0077] As can be seen, participants regardless of physical location are spatially synchronized in three dimensions and 1 : 1 scale in the original virtual world 204, the one or more than one recursive virtual world 206 or both the original virtual world 204 and the one or more than one recursive virtual world 206. For example, one or more than one element or a physical site 204. The one or more than one participant avatar 208 can inhabit, with the proper role permissions, any virtual world in the system 100 at will.
[0078] There are at least three categories of avatars 208-212 used in the system 100:
1. a general avatar 208 is used to represent a basic participant. This category is available in various sizes and other specifications.
2. an actor avatar 210 is used for specific testing, relevant to the one or more than one participant’s 104-124 preferences or to a physically challenged participant where accommodation requirements, such as the American’s with Disabilities Act (ADA) and other laws and regulations that apply to that participant. The avatar for a physically challenged participant constitute a plurality of instances of avatars that require the same level of access and assistance as they would in the physical world. The physically challenged avatars in the original virtual world 204, the one or more than one recursive virtual world 206 or both the original virtual world 204 and the one or more than one recursive virtual world 206, assist in testing space designs, ease of access, such as, for example, hallway and door widths. The system supports ADA or similar local jurisdiction compliance considerations but may not function as a tool to confirm compliance without authorization and certification from a responsible authority.
3. a third party avatar, created or purchased by one or more than one participant 104-124 is permitted to enter into the system 100 under certain circumstances. The third party avatar must conform to the system 100 requirements for the one or more than one original virtual world 204 and for the one or more than one recursive virtual world 206. The third party avatar must also conform to an articulation specification and must be tested and approved by a system 100 administration prior to use.
[0079] Referring now to FIG. 3, there is shown a diagram of a perspective view 300 of original virtual world 204 of the system 100. As can be seen the one or more than one participant 304, 306, 308 and 310 is inside the original virtual world 204. In this example, the original virtual world 204 comprises virtual space for one or more than one avatar 208, 210 and 212 that are local, remote, or both local and remote to congregate with each other, and a virtual building 310, various virtual elements, or any other form that can be imported, created and displayed in the system 100. As will be understood by those with skill in the art with reference to this disclosure, the one or more than one participant 302, 304, 306 and 308 is physically local, physically remote or both physically local and physically remote. The system 100 comprises instructions to create the original virtual world 204 and provide the command set 126-134 to the one or more than one participant 302-308 based on their defined role in the system 100.
[0080] A 'chair’ or ‘presenter’ role 302 is chosen by one or more than one participant 302-308 to manage the original virtual world 204. The chair role 302 has specific permissions in the system 100 that enable the chair role 302 to select one or more than one recursive virtual world 206 or one or more than one element to view and manipulate. Optionally, the selected element is adjustable and scalable in size relative to the original virtual world 204 by the one or more than one participant 302-308 in the original virtual world 204.
[0081] The one or more than one participant 302-308 in the original virtual world 204 can view and interact with elements in the original virtual world 204. The degree and type of interaction depends on each of the one or more than one participant’s 302-308 role command set 126-134.
[0082] The one or more than one participant 302-308 can enter a 1 : 1 scale version of the one or more than one recursive virtual world 206 using one or more than one avatar 208-212 for inspection, modification, and testing of the space regardless of the one or more than one participant’s 302-308 actual physical location. The one or more than one participant 302, 306 and
308 remaining in the original virtual world 204 will see, hear and speak with the other participant’s 304 avatar 402 moving proportionally in the one or more than one recursive virtual world 206.
[0083] Referring now to FIG. 4, there is shown a diagram of a perspective view 400 of one or more than one participant 302, 306 and 308 avatar in the original virtual world 204 viewing one or more than one participant 402 avatar in the one or more than one recursive virtual world 206.
[0084] In one or more than one recursive virtual world 206 one or more than one participant 302, 306 and 308 can, depending on the one or more than one participant’s 302, 306 and 308 role, see the original virtual world 204 and the one or more than one avatar 402 in the one or more than one recursive virtual world 206. Additionally, the one or more than one participant 302, 306 and 308 can look into additional recursive virtual worlds from an external point relative to the original virtual world 204.
[0085] In the original virtual world 204, the system 100 provides the one or more than one participant 302-308 with software executable command set 126-134 to arbitrarily turn off and on elements of original virtual world 204 and/or elements of the one or more than one recursive virtual world 206 for better examination by the one or more than one participant 302, 306 and 308. In this exemplar, a roof, walls and other elements of the virtual building 310 have been turned off so that the one or more than one participant 302, 306 and 308 can see inside the virtual building 310 and also see and converse with the one or more than one avatar 402, that is a recursive avatar of the one or more than one participant 306, as it moves around in the one or more than one recursive virtual world 206.
[0086] As a result, the one or more than one participant 302, 306 and 308 in the original virtual world 204 can observe other participants’ 402 behavior at 1 : 1 scale within the one or more than one recursive virtual world 206, interacting with and optionally modifying the one or more than one recursive virtual world 206 in a plurality of ways. The one or more than one avatar 402 is also able to interact and converse with the one or more than one participant 302, 306 and 308 that did not enter the one or more than one recursive virtual world 206 of the system 100.
[0087] As can be seen one or more than one avatar 402 has entered into one or more than one recursive virtual world 206. The avatar 402 is no longer in the viewing group of the one or
more than one participant 302, 306 and 308 that have only entered the original virtual world 204 to experience it at full 1 : 1 scale. One or more than one participant 304 has entered the one or more than one recursive virtual world 206 and the one or more than one avatar 402 is displayed as small human silhouette. Activity of the one or more than one avatar 402 is depicted in real time in both the original virtual world 204 and the one or more than one recursive virtual world 206. All participants 302-308 in both the original virtual world 204 and the one or more than one recursive virtual world 206 can converse with each other readily. When any participant chooses to ‘enter’ the one or more than one recursive virtual world 206 using a pre-defined command from the command set 126-134 that participant’s avatar disappears from the original virtual world 204 and is shown as a new avatar 402 in one or more than one recursive virtual world 206. [0088] Avatars comprise a selection of general avatars that are available to the one or more than one participant 302-308. General avatar features are customizable by each participant. Customizable options are selected from the group comprising: avatar selection, name, profile, facial features, hair, body, and clothing. All customizable features are saved in the system 100 to the one or more than one database 122 and optionally store in a secure storage in the Internet. [0089] In one embodiment, special or ADA avatars are a subset of the general avatars available to participants. This subset serves arbitrarily unique participant requirements, or ADA type requirements, or other human factors testing functions. The special avatars are relatively accurate versions of approved dimension and approved articulation ‘crash test dummies’ but are not warranted as regulatory compliant. Visually, their heads are nearly featureless, like crash test dummies. The avatars are examples of human participants that are in some way(s) outside the standard range of ergonomic design, or otherwise fall under accommodation provisions of ADA or other applicable regulations. Examples of the space design issues to be evaluated with this set include: reach, view, collisions, physical danger, and choke points.
[0090] Examples of avatar types for this design and testing function comprise:
• blindness and limited vision avatars
• deafness avatars
• “taller than x inches” avatars
• “shorter than y inches” avatars
• Specifiable height applied to an assignable historically common gender (male/female), to a body type of 3 or more kinds (ex., mesomorphic female, endomorphic male)
• Bariatric patient avatars that weigh more than z lbs.
• Bariatric patients that exceed w inches in dimension/diameter
• a plurality of avatars for amputee participants, wheelchair participants and other mechanically augmented participants in scalable sizes, and multiple handicapped participants in scalable sizes.
[0091 ] Participants may optionally provide their own avatars if compliant with the system 100, or create their own avatars per system 100 specifications and submit it for testing and approval. Avatars can be ‘characters,’ like ‘tall man,’ ‘toddler,’ etc. Similarly, as with ‘ADA’ avatars, participant avatars may instead represent specific participant requirements for demographic or cultural cases not driven by differently abled or ‘ADA’ requirements.
[0092] All avatars that are used as ‘actors’ for in one or more than one recursive virtual world 206 scenario testing will be ‘crash test dummy’ style in that they are simplistic and meant to optimize testing functionality.
[0093] Avatars have the following interaction capabilities:
• Opening doors and drawers, toggle light and lamp switches, open and close drapes.
• Moving objects, like a chair, desk, etc. All move actions get logged and optionally pinned.
• Visually display all the different positions, superimposed, of a specific object by one or more than on participant across a defined time duration.
• Changing, removing, or adding objects or an object’s materials/fmish.
• Set time of day and season as a method of controlling sun direction.
• Point to point measuring tape feature using the command set.
[0094] Referring now to FIG. 5, there is shown a diagram 500 of a participant using one or more than one gesture 502 for selecting and moving one or more than one virtual element in a plane 506 in the original virtual world 204, the one or more than one recursive virtual world 206 or both the original virtual world 204 and the one or more than one recursive virtual world 206 of the system 100.
[0095] Referring now to FIG. 6, there is shown a diagram 600 of a participant selecting and moving 602 one or more than one virtual element 604 in a horizontal plane 606 in the original virtual world 204, the one or more than one recursive virtual world 206 or both the
original virtual world 204 and the one or more than one recursive virtual world 206 of the system 100.
[0096] Referring now to FIG. 7, there is shown a diagram 700 of a participant using a combination gesture 702 for selecting and scaling 704 one or more than one virtual element 706 in the original virtual world 204, the one or more than one recursive virtual world 206 or both the original virtual world 204 and the one or more than one recursive virtual world 206 of the system 100.
[0097] Referring now to FIG. 8, there is shown a diagram 800 of a participant performing a gaze 802 with a single hand gesture 804 combination command for rotating 806 and tilting 808 one or more than one virtual element 810 in the original virtual world 204, the one or more than one recursive virtual world 206 or both the original virtual world 204 and the one or more than one recursive virtual world 206 of the system 100.
[0098] Referring now to FIG. 9, there is shown a diagram 900 of a participant using a gesture 902 for performing a virtual menu selection 904 in the system 100.
[0099] Referring now to FIG. 10, there is shown a diagram 1000 of a participant using a single hand 1002 gesture 1004 to select one or more than one virtual element 1006 to alter its size, shape, location, or other property of the virtual item 1006 in the original virtual world 204, the one or more than one recursive virtual world 206 or both the original virtual world 204 and the one or more than one recursive virtual world 206 of the system 100.
[00100] Referring now to FIG. 11, there is shown a diagram 1100 of a participant single tap gesture 1102 for selection of one or more than one virtual element using an action command, in the original virtual world 204, the one or more than one recursive virtual world 206 or both the original virtual world 204 and the one or more than one recursive virtual world 206 of the system 100.
[00101] Referring now to FIG. 12, there is shown a diagram 1200 of a participant using a tap and hold gesture 1202 on one or more than one virtual element in the original virtual world 204, the one or more than one recursive virtual world 206 or both the original virtual world 204 and the one or more than one recursive virtual world 206 of the system 100.
[00102] Referring now to FIG. 13, there is shown a diagram 1300 of a participant using a combination select and action 1302 command in the original virtual world 204, the one or more
than one recursive virtual world 206 or both the original virtual world 204 and the one or more than one recursive virtual world 206 of the system 100.
[00103] Referring now to FIG. 14, there is shown a diagram 1400 of an avatar 1402 view from inside the one or more than one recursive virtual world 206 looking at a participant in the original virtual world 204 of the system 100.
[00104] Referring now to FIG. 15, there is shown a diagram 1500 of a participant using a gesture 1502 to move a visibility plane 1508 in any spatial orientations horizontally 1506 through a virtual element 1504 with a visibility plane 1508 in the original virtual world 204, the one or more than one recursive virtual world 206 or both the original virtual world 204 and the one or more than one recursive virtual world 206 of the system 100.
[00105] Referring now to FIG. 16, there is shown diagram 1600 of a participant using a gesture 1602 to move a visibility plane 1608 through a virtual element 1604 vertically 1606 in the original virtual world 204, the one or more than one recursive virtual world 206 or both the original virtual world 204 and the one or more than one recursive virtual world 206 of the system 100.
[00106] Referring now to FIG. 17, there is shown a diagram 1700 of a participant in the original virtual world 204 using ray casting 1702 to manipulate one or more than one virtual element 1704 in the one or more than one recursive virtual world 206 of the system 100.
[00107] Referring now to FIG. 18, there is shown a diagram 1800 of an exterior view 1802 of the one or more than one recursive virtual world, with programmable or selectable environment, weather and audio in the one or more than one recursive virtual world 206 of the system 100. As can be seen, the system 100 displays real time, dynamic virtual weather corresponding to a specific real physical location.
[00108] Referring now to FIG. 19, there is shown a diagram 1900 of a participant using a one or more than one voice command 1902, a virtual display control panel 1908, and one or more than one gesture command 1904 to manipulate one or more than one virtual element 1906 in the original virtual world 204, the one or more than one recursive virtual world 206, or both the original virtual world 204 and the one or more than one recursive virtual world 206 of the system 100.
[00109] Referring now to FIG. 20, there is shown a diagram 2000 of a participant using a one or more than one voice command 2002, one or more than one gesture command 2004 and,
optionally, a hardware controller 2006 to manipulate one or more than one virtual element 2008 in the one or more than one recursive virtual world 206 of the system 100.
[00110] Referring now to FIG. 21, there is shown a flowchart diagram 2100 of some steps of a method 2000 for participants using the system 100. The method comprises the steps of first, one or more than one participant enters an original virtual world 204 as an avatar. Next, all participants regardless of physical location are spatially and audibly synchronized 2104 in three dimensions and scaled 1 : 1 in both original virtual world 204 and, optionally, the one or more than one recursive virtual world 206. Participant’s avatars can move 2106 at will to and from the original virtual world 204 or the one or more than one recursive virtual world 206 using a command set 126-134. Then, the original virtual world 204 and the one or more than one recursive virtual world 206 session begins 2106 with participants appearing as avatars in the original virtual world 204 and the one or more than one recursive virtual world 206. Then, remote one or more than one recursive virtual world participants can change elements 2108 in the one or more than one recursive virtual world 206 by using the command set 126-134.
Alternatively, the one or more than one recursive virtual world 206 can be changed by invoking an in world virtual control panel to display the various options for a given object or part of the one or more than one recursive virtual world 206. Finally, participants in the remote one or more than one recursive virtual world are represented visually to any participants in the original virtual world 204 and the one or more than one recursive virtual world 206 as miniature versions of their avatars in the remote one or more than one recursive virtual world. In one embodiment, participants in the one or more than one recursive virtual world 206 see and hear themselves 2110 and each other in 1 : 1 scale in the detailed one or more than one recursive virtual world, but cannot see the local one or more than one recursive virtual world or the participants. In another embodiment, both the remote and local one or more than one recursive virtual world participants can see each other and modify 2112 the original virtual world 204, the one or more than one recursive virtual world 206 or both the original virtual world 204 and the one or more than one recursive virtual world 206.
[00111] Referring now to FIG. 22, there is shown a flowchart diagram of some steps of a method 2200 for using the system 100. A local one or more than one virtual world session begins with one or more than one participant appearing as an avatar in the one or more than one virtual world and synchronizes their avatar in and with the one or more than one original virtual
world. Similarly, the participants’ avatars may enter one or more than one recursive virtual worlds from the one or more than one original virtual world 204, maintaining spatial and acoustical three-dimensional synchronization at, optionally, 1 : 1 scale. Each participant can see each other, and the local one or more than one virtual world 204 and one or more than one recursive virtual world 206. The local one or more than one recursive virtual world 206 comprises a reduced scale one or more than one recursive virtual world 206 of a concept, a project or an object, and miniature versions of any local one or more than one recursive virtual world session participants 402 inside the reduced scale one or more than one recursive virtual world 206 who have entered the one or more than one recursive virtual world 206.
[00112] In the local one or more than one recursive virtual world, participants are able to change objects and features and elements of objects in the one or more than one recursive virtual world 206 by voice command, gaze, gesture, controller, a combination, or by invoking an in world control panel to display the various feature options for a given object 504, 604 or part 1006 of the one or more than one recursive virtual world 206.
[00113] Participants who enter the one or more than one recursive virtual world 206 are represented visually to any participants remaining in the original one or more than one local virtual world 204 or one or more than one recursive virtual world 206 as miniature versions 402 of their avatars in the one or more than one recursive virtual world. However, the participants can interact, see, and converse with each other in 1 : 1 scale in the one or more than one recursive virtual world 206. Optionally, the participants can see outside the one or more than one recursive virtual world 206, viewing the local one or more than one recursive virtual world exterior environment 206 and any optionally participants’ avatars still in the original virtual world 204 that may be present.
[00114] Participants may enter a one or more than one recursive virtual world 206. These participants can be different combinations of individual remote participants, local participants 402 that are physically co-located, and using different device types, for example, a headset, a tablet, a smart device, or a computer 106, 108, 110, 112, 116, 118, 138. Physically co-located participants will need to be position synchronized to avoid real world collisions if the co-located participants are permitted to physically move.
[00115] A 'chair’ or ‘presenter’ role 302 is chosen by one or more than one participant to manage the system 100. The chair role 302 has specific permissions that enable the chair role
302 to select one or more than one recursive virtual world 206 or objects to view, and the selected object is optionally adjustable and scaled in size relative to the local original virtual world 204, and to the one or more than one recursive virtual world 206.
[00116] Participants in the local one or more than one original virtual world 204 can view and interact with a scaled down one or more than one recursive virtual world 206 of the project or session. Degree and type of interaction depends on each participant’s 302, 304, 306, 308 role command set 126-134. The available command set 126-134, also called a design tools set, includes voice, gaze, gesture, device, controller and combinations thereof.
[00117] One or more than one participant 302, 304, 306, 308. can enter a 1 : 1 scale version of the one or more than one recursive virtual world using an avatar 402 for inspection, modification, and testing of the space.
[00118] Participants remaining in the local one or more than one original virtual world 204 will see in one or more than one recursive virtual world 206 an arbitrary, scalable, number of one or more than one participant’s avatars 402 moving proportionally in the one or more than one recursive virtual world 206.
[00119] In one or more than one recursive virtual world 206 participants may optionally see the one or more than one original virtual world 204 and the avatars 302, 304, 306, 308 in the original virtual world 204, who are looking into the one or more than one recursive virtual world 206 from an external point in the original virtual world 204 relative to the one or more than one recursive virtual world 204.
[00120] In one or more than one recursive virtual world 206 participants with the appropriate role privileges can use the command set 126-134 to manipulate elements of the one or more than one recursive virtual world 206. The command set includes instructions operable on the one or more than one server 102 to interpret the command set. Command set includes, for example: “make floor sky blue”, “move this bookcase left four inches”, “swap this chair <number <xyz> with a selected chair <number abc> ofran arbitrary number of virtual furniture elements available in a library of virtual elements displayed on the dashboard 140. The one or more than one participant 210, 212, 208 can perform diverse operations, such as, for example, run usability testing with an avatar, place one or more than one virtual element in a room, test for choke points in a building or hallway, examine body vs. object collisions in diverse scenarios including an emergency scenarios. For body vs. object collisions, any and all collisions and
collision types can be logged, played back, analyzed per a diversity of metrics, and otherwise managed for evaluation in the database 122.
[00121] What has been described is a new and improved system 100 for an independent recursive virtual world with voice controlled interface, overcoming the limitations and disadvantages inherent in the related art. Although the present invention has been described with a degree of particularity, it is understood that the present disclosure has been made by way of example and that other versions are possible. As various changes could be made in the above description without departing from the scope of the invention, it is intended that all matter contained in the above description or shown in the accompanying drawings shall be illustrative and not used in a limiting sense. The spirit and scope of the appended claims should not be limited to the description of the preferred versions contained in this disclosure.
[00122] All features disclosed in the specification, including the claims, abstracts, and drawings, and all the steps in any method or process disclosed, can be combined in any combination, except combinations where at least some of such features and, or steps are mutually exclusive. Each feature disclosed in the specification, including the claims, abstract, and drawings, can be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise. Thus, unless expressly stated otherwise, each feature disclosed is one example only of a generic series of equivalent or similar features.
[00123] Any element in a claim that does not explicitly state "means" for performing a specified function or "step" for performing a specified function should not be interpreted as a "means" or "step" clause as specified in 35 u.s.c. § 112.
Claims
1. A system for one or more than one recursive virtual world with a voice controlled interface, the system comprising: a. one or more than one server; b. one or more than one database operably connected to the one or more than one server; c. one or more than one participant operably connected to the one or more than one server and one or more than one original virtual world and one or more than one recursive virtual world using a headset, a display device, or both a headset and a display device to to view and navigate through an original virtual world, one or more than one recursive virtual world, or both the original virtual world and the one or more than one recursive virtual world; and d. instructions operable on the one or more than one server for the original virtual world and the one or more than one recursive virtual world comprising:
1) creating the one or more than one original virtual world comprises one or more than one virtual element;
2) creating the one or more than one independent recursive virtual world operably connected to the one or more than one original virtual world; wherein the one or more than one independent recursive virtual world comprises one or more than one virtual element;
3) creating one or more than one avatar of the one or more than one participant;
4) providing one or more than one command set to manipulate one or more than one virtual element in the original virtual world and the one or more than one recursive virtual world;
5) creating a design tool set usable by the one or more than one participant;
6) creating teamwork tools usable by the one or more than one participant;
7) storing and analyzing interactions of the one or more than one participant to create predictive models to continuously update and dynamically adjust the original virtual world and the one or more than one recursive virtual world in real time; and
8) translating the command set into different languages automatically and in real time for one or more than one multinational participant.
2 The system of claim 1, wherein the one or more than one server is selected from the group consisting of a computer, a headset, a smart phone, a smart device, a smart tablet, and a smart display.
3. The system of claim 1, wherein the one or more than one database stores incrementally accumulated data for the original virtual world, the one or more than one recursive virtual world, or both the original virtual world and the one or more than one recursive virtual world, including all the body and object collisions can be logged, played back and otherwise managed for evaluation in the database, for future use by the one or more than one participant.
4 The system of claim 1, wherein the one or more than one participant can speak to and interact with any other participants in the original virtual world, the one or more than one recursive virtual world, or both the original virtual world and the one or more than one recursive virtual world.
5 The system of claim 1, wherein the original virtual world and the one or more than one recursive virtual world comprise one or more than one virtual element that correspond to an actual, real world, physical object.
6 The system of claim 1, wherein the original virtual world, the one or more than one recursive virtual world, or both the original virtual world and the one or more than one recursive virtual world is persistent and updateable for the one or more than one participant to virtually enter and manipulate the original virtual world, the one or more than one recursive virtual world, or both the original virtual world and the one or more than one recursive virtual world, depending on access rights of the one or more than participant.
7 The system of claim 1, wherein the one or more than one participant is physically local to the server, physically remote to the server or both physically local and physically remote to the server.
8 The system of claim 1, wherein the command set to manipulate the original virtual world, the one or more than one recursive virtual world, or both the original virtual world and the one or more than one recursive virtual world comprises: a. one or more than one voice command; b. one or more than one gesture command; c. one or more than one hardware controller command;
d. one or more than one gaze command; e. one or more than one virtual audio-visual command interface; f . one or more than one virtual audio-visual control interface for installing, viewing, evaluating, adjusting, altering, replacing, designing, and redesigning one or more than one virtual element of the one or more than one independent recursive virtual world and the one or more than one original virtual world; g. real-time logging, reporting and monitoring of the original virtual world, the one or more than one recursive virtual world, or both the original virtual world and the one or more than one recursive virtual world; and h. the command set includes instructions operable on the one or more than one server to interpret the command set in multiple languages.
9 The system of claim 1, further comprising instructions for one or more than on smart device, to install, view, evaluate, adjust, alter, replace, design and redesign various elements of the original virtual world and the one or more than one recursive virtual world.
10 The system of claim 1, wherein complex projects that use one or more than one original virtual world and one or more than one recursive virtual world, are able to be integrated with each other recursively so that all the virtual elements of all the virtual worlds are viewable independently or cooperatively.
11 The system of claim 1, further comprises instructions for virtual operations management and monitoring of real world physical object for: a. receiving, aggregating, and displaying in a plurality of adjustable, extensible, optimized formats and information from a plurality of sensors that provide real-time continuous monitoring of a system, a building, a master-plan construction site, an assembly, a structure, a wind turbine tower, a theme park attraction, etc. for operations and management; b. detecting application categories comprising structural integrity, public safety, wind load, isolation, and a plurality of capacity or load monitoring, including power line fluctuations; c. logging all data and tagging the data appropriately using machine learning methods to effect pattern recognition for the building or the facility for operations management;
d. analyzing sensor metrics and their permutations, along with external contextual data to provide real-time analytics reporting, and predictive analytics reporting; e. displaying information to the one or more than one participant wearing one or more than one headset that are immersed in the original virtual world and the one or more than one recursive virtual world; e. the one or more than one participant can see each others avatars, and can converse and interact spatially with the one or more than one avatar using a system wide communications module connected to the one or more than one headset microphone, or one or more than one external microphone; and f . one or more than one participant having an interactive participant role, can interact with the original virtual world and the one or more than one recursive virtual world by using the command set and the system wide communications module.
12. The system of claim 1, further comprising instructions for a validation and/or permission scheme to limit entrance of the one or more than one participant into the one or more than one recursive virtual world and to limit functionality of each of the one or more than one participant; and instructions for an incremental, role-based administration of the original virtual world and the one or more than one recursive virtual world for each of the one or more than one participant.
13. The system of claim 1, wherein the one or more than one participant that enters the one or more than one recursive virtual world is represented, visually and acoustically to other participants in the original virtual world, the one or more than one recursive virtual world, or both the original virtual world and the one or more than one recursive virtual world, as one or more than one avatar.
14. The system of claim 13, wherein the one or more than one avatar is a miniature version of avatars of the one or more than one participant in the original virtual world.
15. The system of claim 1, wherein the one or more than one avatar can see outside the one or more than one recursive virtual world and can view the original virtual world and any of the avatars in the original virtual world.
16. The system of claim 1, wherein the one or more than one participant, regardless of physical location, are spatially synchronized in three dimensions at a 1:1 scale in any virtual world in the system.
17. The system of claim 1, the one or more than one avatar comprise a plurality or categories: a. a general avatar; b. an actor avatar that is used for specific testing, relevant to the one or more than one participant’s preferences or to a physically challenged participant where accommodation requirements, such as the American’s with Disabilities Act (ADA) and other laws and regulations that apply to that participant; wherein the actor avatar comprises the same access and assistance as the one or more than one participant would require in the physical world; and c. a third party avatar, created or purchased that conforms to system requirements.
18. The system of claim 17, wherein the one or more than one participant in the original virtual world will see other participant’s avatars moving proportionally in the one or more than one recursive virtual world.
19. The system of claim 1, wherein one or more than one participant is able see and hear the one or more than one avatar in the original virtual world and the one or more than one avatar in the one or more than one recursive virtual world, depending on the one or more than one participant’s role.
20. The system of claim 17, wherein the one or more than one participant, and the one or more than one avatar can view additional recursive virtual worlds from an external point relative to the original virtual world.
21. The system of claim 1, wherein an avatar for the one or more than one participant is selected from the group consisting of a basic avatar, an advanced avatar, or a participant avatar.
22. The system of claim 21, wherein the avatar is customizable by each of the one or more than one participant based on the one or more than one participant’s role.
23. The system of claim 22, wherein the avatar customization is selected from the group comprising: avatar selection, name, profile, facial features, hair, body, and clothing.
24. The system of claim 1, wherein the one or more than one avatar have the following interaction capabilities: a. opening doors and drawers, toggling light and lamp switches, opening and closing drapes; b. moving objects, like a chair, desk, etc., wherein all move actions are logged and optionally pinned and stored in the database; c. displaying different positions, superimposed, of a specific object by all participants across a defined time duration; d. changing, removing or adding new virtual elements or the virtual element’s materials and finishes; e. setting a time of day and a season to control a virtual sun direction; and f. using and recording the results from a point to point measuring tape.
25. The system of claim 8, wherein the one or more than one gesture command comprises: a. selecting and moving one or more than one virtual element in a vertical plane; b. selecting and moving one or more than one virtual element in a horizontal plane c. a combination gesture for selecting and scaling one or more than one virtual element in the original virtual world and the one or more than one recursive virtual world; d. selecting and moving one or more than one virtual element in any other planar and curvilinear manner; e. rotating and tilting one or more than one virtual element in the original virtual world, the one or more than one recursive virtual world, or both the original virtual world and the one or more than one recursive virtual world; f . selecting an option from a virtual menu; g. selecting one or more than one virtual element to alter a size, a shape, a location, or other property of one or more than one virtual element in the original virtual world, the one or more than one recursive virtual world, or both the original virtual world and the one or more than one recursive virtual world;
h. using a tap and hold gesture on one or more than one virtual element in the original virtual world, the one or more than one recursive virtual world or both the original virtual world and the one or more than one recursive virtual world; i. using a combination select and action command on one or more than one virtual element in the original virtual world, the one or more than one recursive virtual world, or both the original virtual world and the one or more than one recursive virtual world; j. moving a visibility plane in any spatial orientation horizontally or vertically through one or more than one virtual element in the original virtual world, the one or more than one recursive virtual world, or both the original virtual world and the one or more than one recursive virtual world; and k. manipulating one or more than one virtual element using raycasting in the original virtual world, the one or more than one recursive virtual world, or both the original virtual world and the one or more than one recursive virtual world.
26. A method of using a system for one or more than one recursive virtual world with a voice controlled interface, the method comprising the steps of: a. entering an original virtual world as an avatar by one or more than one participant; b. synchronizing participants, regardless of physical location, spatially and audibly in three dimensions and scaled 1:1 in both the original virtual world and the one or more than one recursive virtual world; c. moving the one or more than one participant’s avatar at will to and from the original virtual world or the one or more than one recursive virtual world using a command set; d. beginning a session with one or more than one participant appearing as avatars in the original virtual world and the one or more than one recursive virtual world; e. changing one or more than one virtual elements by the one or more than one participant in he original virtual world, the one or more than one recursive virtual world, or both the original virtual world and the one or more than one recursive virtual world using the command set; f . changing the one or more than one virtual element by invoking an in world virtual control panel to display various options of the one or more than one participant in he original virtual world, the one or more than one recursive virtual world, or both the original virtual world and the one or more than one recursive virtual world; and
g. representing the one or more than one participant as a miniature avatars of the one or more than one participant in the one or more than one recursive virtual world.
27. A computer implemented system for one or more than one recursive virtual world with a voice controlled interface, the system comprising: a. one or more than one server; b. one or more than one database operably connected to the one or more than one server; c. one or more than one participant operably connected to the one or more than one server and one or more than one original virtual world and one or more than one recursive virtual world using a headset, a display device, or both a headset and a display device to to view and navigate through an original virtual world, one or more than one recursive virtual world, or both the original virtual world and the one or more than one recursive virtual world; and d. instructions operable on the one or more than one server for the original virtual world and the one or more than one recursive virtual world comprising:
1) creating the one or more than one original virtual world comprises one or more than one virtual element;
2) creating the one or more than one independent recursive virtual world operably connected to the one or more than one original virtual world; wherein the one or more than one independent recursive virtual world comprises one or more than one virtual element;
3) providing one or more than one command set to manipulate one or more than one virtual element in the original virtual world and the one or more than one recursive virtual world;
4) creating a design tool set usable by the one or more than one participant;
5) creating teamwork tools usable by the one or more than one participant;
6) storing and analyzing interactions of the one or more than one participant to create predictive models to continuously update and dynamically adjust the original virtual world and the one or more than one recursive virtual world in real time; and
7) translating the command set into different languages automatically and in real time for one or more than one multinational participant.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US202363448673P | 2023-03-05 | 2023-03-05 | |
US63/448,673 | 2023-03-05 |
Publications (2)
Publication Number | Publication Date |
---|---|
WO2024186838A2 true WO2024186838A2 (en) | 2024-09-12 |
WO2024186838A3 WO2024186838A3 (en) | 2024-10-24 |
Family
ID=92675669
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2024/018556 WO2024186838A2 (en) | 2023-03-05 | 2024-03-05 | A system for an independent recursive virtual world with a voice controlled interface |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2024186838A2 (en) |
Family Cites Families (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090300525A1 (en) * | 2008-05-27 | 2009-12-03 | Jolliff Maria Elena Romera | Method and system for automatically updating avatar to indicate user's status |
US20100251185A1 (en) * | 2009-03-31 | 2010-09-30 | Codemasters Software Company Ltd. | Virtual object appearance control |
US20120274585A1 (en) * | 2011-03-16 | 2012-11-01 | Xmg Studio, Inc. | Systems and methods of multi-touch interaction with virtual objects |
CA2845730A1 (en) * | 2011-08-18 | 2013-02-21 | Utherverse Digital, Inc. | Systems and methods of virtual world interaction |
CA3000969C (en) * | 2012-11-28 | 2021-08-10 | Vrsim, Inc. | Simulator for skill-oriented training |
WO2015054869A1 (en) * | 2013-10-17 | 2015-04-23 | 国网新源张家口风光储示范电站有限公司 | Megawatt-level battery energy storage power station monitoring system and method therefor |
US10062205B2 (en) * | 2014-10-16 | 2018-08-28 | Trick 3D | Systems and methods for generating an interactive floor plan |
US9754419B2 (en) * | 2014-11-16 | 2017-09-05 | Eonite Perception Inc. | Systems and methods for augmented reality preparation, processing, and application |
US10137984B1 (en) * | 2016-02-23 | 2018-11-27 | State Farm Mutual Automobile Insurance Company | Systems and methods for operating drones in response to an incident |
JP6754678B2 (en) * | 2016-11-18 | 2020-09-16 | 株式会社バンダイナムコエンターテインメント | Simulation system and program |
US10586369B1 (en) * | 2018-01-31 | 2020-03-10 | Amazon Technologies, Inc. | Using dialog and contextual data of a virtual reality environment to create metadata to drive avatar animation |
AU2019294617B2 (en) * | 2018-06-27 | 2025-02-06 | SentiAR, Inc. | Gaze based interface for augmented reality environment |
US11127047B2 (en) * | 2018-12-20 | 2021-09-21 | Sap Se | Digital promotion system using digital collectibles |
US11941762B2 (en) * | 2019-07-15 | 2024-03-26 | Samsung Electronics Co., Ltd. | System and method for augmented reality scenes |
US11536476B2 (en) * | 2020-05-12 | 2022-12-27 | Johnson Controls Tyco IP Holdings LLP | Building system with flexible facility operation |
US11750774B2 (en) * | 2020-10-19 | 2023-09-05 | Sophya Inc. | Systems and methods for triggering livestream communications between users based on proximity-based criteria for avatars within virtual environments that correspond to the users |
CN112156464B (en) * | 2020-10-22 | 2023-03-14 | 腾讯科技(深圳)有限公司 | Two-dimensional image display method, device and equipment of virtual object and storage medium |
KR102602513B1 (en) * | 2021-05-28 | 2023-11-16 | 주식회사 피앤씨솔루션 | Augmented reality glasses device with voice command translation in offline environment |
CN113836762B (en) * | 2021-08-25 | 2023-01-06 | 中国大唐集团新能源科学技术研究院有限公司 | Wind turbine and wind power plant digital mirror image simulation display system |
-
2024
- 2024-03-05 WO PCT/US2024/018556 patent/WO2024186838A2/en unknown
Also Published As
Publication number | Publication date |
---|---|
WO2024186838A3 (en) | 2024-10-24 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11521355B1 (en) | Virtual affordance sales tool | |
KR100735676B1 (en) | VR model house operation system and operation method | |
US10917613B1 (en) | Virtual object placement in augmented reality environments | |
McVeigh-Schultz et al. | A “beyond being there” for VR meetings: envisioning the future of remote work | |
US11609682B2 (en) | Methods and systems for providing a communication interface to operate in 2D and 3D modes | |
Wang et al. | Mixed reality in architecture, design, and construction | |
US9305465B2 (en) | Method and system for topic based virtual environments and expertise detection | |
US8386566B2 (en) | Method and apparatus for controlling information in virtual world | |
WO2021021742A1 (en) | Rapid design and visualization of three-dimensional designs with multi-user input | |
Stahl et al. | Social telepresence robots: The role of gesture for collaboration over a distance | |
US20150007033A1 (en) | Virtual microscope tool | |
Koleva et al. | The properties of mixed reality boundaries | |
Schier et al. | Viewr: Architectural-scale multi-user mixed reality with mobile head-mounted displays | |
Cluley | An ethnographic study of organizational performances in business services: Space, staging and materiality | |
Maher et al. | Studying designers using a tabletop system for 3D design with a focus on the impact on spatial cognition | |
WO2024186838A2 (en) | A system for an independent recursive virtual world with a voice controlled interface | |
Hudák et al. | On architecture and performance of LIRKIS CAVE system | |
WO2023190344A1 (en) | Information processing device, information processing method, and program | |
Cools et al. | From Display to Interaction: Design Patterns for Cross-Reality Systems | |
CN114913307A (en) | Information interaction method, device and equipment for language learning | |
TWI799195B (en) | Method and system for implementing third-person perspective with a virtual object | |
JP2022049262A (en) | Workplace planning methods, workplace planning systems, and programs | |
JP2002189764A (en) | Room layout plan simulation system | |
US20250166100A1 (en) | Systems and methods for virtual tours of real estate properties | |
KR102826855B1 (en) | Method and device for providing grouped virtual classroom object in a virtual tutorial world |