JP2015116336A - Mixed-reality arena - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a computing system that comprises a see-through display device, a logic subsystem, and a storage subsystem storing instructions.SOLUTION: When executed by the logic subsystem, the instructions display on the see-through display device a virtual arena, a user-controlled avatar, and an opponent avatar. The virtual arena appears to be integrated within a physical space when the physical space is viewed through the see-through display device. In response to receiving a user input, the instructions may also display on the see-through display device an updated user-controlled avatar.

Description

  [0001] Fighting games are frequently displayed on a two-dimensional stationary display of a video game system as a predefined fighting environment. A user typically provides control over a fighting game using a video game controller connected to the video game system.

  [0002] Embodiments for providing a mixed reality fighting game within a computing system are disclosed herein. For example, a computing system can comprise a see-through display device, a logical subsystem, and a storage subsystem that stores instructions, when the instructions are executed by the logical subsystem, a virtual arena, When the user-controlled avatar and the opponent avatar are displayed on the see-through display device and the physical space is viewed through the see-through display device, the virtual arena is integrated into the physical space. In response to receiving user input, these instructions may also display an updated user control avatar on the see-through display device based on the user input.

  [0003] This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter. Furthermore, the claimed subject matter is not limited to implementations that solve any or all disadvantages noted in any part of this disclosure.

[0004] FIG. 4 is a top view of a user wearing a see-through display device in physical space. [0005] FIG. 1B is an illustration of the user's first person view of FIG. 1A unchanged. [0006] FIG. 1B shows the first person view of the user of FIG. 1A while the see-through display device extends reality to display a virtual arena. [0007] FIG. 2 illustrates an example extension of physical space in a third person field of view according to certain embodiments of the present disclosure. [0008] FIG. 4 illustrates an example extension of physical space in a first person view in accordance with certain embodiments of the present disclosure. [0009] FIG. 2 illustrates an exemplary opponent computing system that provides a fighting game according to an embodiment of the present disclosure. [0010] FIG. 4 illustrates an example method of integrating a virtual arena into physical space, according to certain embodiments of the present disclosure. [0011] FIG. 2 illustrates an exemplary head mounted display, according to certain embodiments of the present disclosure. [0012] FIG. 2 illustrates an example computing system, in accordance with certain embodiments of the present disclosure.

  [0013] Fighting games are often implemented as a two-dimensional predefined virtual environment with little or no connection to the real world. These games limit the level of immersion that a user can experience and tie the user to a static screen and video game system. Accordingly, the disclosed embodiments are directed to a fighting game that takes the user to the “ringside” by incorporating the fight into the user's physical environment, or even joins the user directly into the fight. To do. For example, the virtual arena and avatar can be integrated into the user's physical environment by displaying the virtual arena and one or more avatars on a see-through display, as described in more detail below. It is. Such integration may allow the user to interact with the physical environment to provide control over the user control avatar within the fighting game.

  FIG. 1A schematically illustrates a top view of a user 100 utilizing a computing system 101 that includes a see-through display device 102 in a physical space 104. As used herein, the term physical space may refer to the real world physical environment of the user 100, such as a room. Similarly, physical location may refer to the location of a user, a real world object, and / or a virtual object in physical space. The physical space can include virtually any indoor or outdoor environment. Lines 106a and 106b show the user's view through the see-through display device. FIG. 1A also shows real world objects 108 a, 108 b, 108 c, and 108 d in the physical environment 104 that are within the field of view of the user 100.

  [0015] FIG. 1B illustrates a first-person view of user 100 viewing real world objects 108a, 108b, 108c, and 108d through see-through display device 102. FIG. In FIG. 1B, the see-through display device does not visually present the virtual object. Thus, the user can see only real world objects. The user sees such a real world object because light reflected from the real world object can be transmitted to the user's eyes through the see-through display.

  [0016] Computing system 101 may be configured to provide a mixed reality fighting game. For example, FIG. 1C shows the same first-person view of the user 100 as FIG. 1B, but the see-through display device visually presents a virtual object corresponding to the mixed reality fighting game. Specifically, the see-through display device 102 displays a virtual arena 110, a user control avatar 112, and an opponent avatar 114. From the user's perspective, the virtual arena and avatar appear to be integrated into the physical space 104.

  [0017] Specifically, FIG. 1C shows a virtual arena 110 rendered to appear as if the virtual arena is located on the floor of the room. For example, the virtual arena 110 is rendered to completely obscure the real world object 108d and partially obscure the real world objects 108a, 108b, and 108c. In addition, avatars 112 and 114 are rendered so that they appear as if they are standing in a virtual arena.

  [0018] Virtual arena 110, user-controlled avatar 112, and opponent avatar 114 are provided as non-limiting examples. Virtual arenas and avatars can be rendered to have virtually any appearance without departing from the scope of the present disclosure. Further, additional or alternative virtual objects can be displayed on the see-through display device 102 and appear to be integrated within the physical space 104.

  [0019] To integrate the virtual arena 110 into the physical space 104, the see-through display device 102 can image the physical space via one or more image sensors. The physical space can include one or more topographic features that define the surface shape and other characteristics of the physical space. Information related to these features can be used, for example, to determine an open or planar area suitable for placing a virtual arena.

  [0020] In some embodiments, information about physical space is detected by various sensors of computing system 101, including an external computing system, such as a see-through display device 102 and / or an opponent computing system. Can be done. For example, the computing system 101 can identify physical space features by using surface reconstruction, room mapping, positioning services, and the like. In one example, the location of the physical space can be determined by GPS, cell triangulation, global coordinate system provided by network services. In one example, the computing system 101 can receive information about the physical space from the server based on the determined position of the physical space. In some embodiments, the computing system 101 can include a depth camera. The depth camera can image a physical space 104 that includes one or more topographic features via an image sensor. The depth camera can also determine depth values for objects, such as objects 108a, 108b, 108c, and 108d (and the individual pixels that make up such objects) in physical space 104.

  [0021] The computing system 101 can use information about topographical features and other features of the physical space to identify open areas in the physical space. The see-through display device 102 can display a virtual arena integrated in the physical space on the see-through display when the physical space is viewed through the see-through display device. In some embodiments, the see-through display device displays a virtual arena having one or more interactive elements integrated with one or more objects in physical space. The computing system 101 can identify actual objects in the physical space 104 that can be visually extended to function as mixed reality interactive elements. For example, a virtual arena may include virtual rocks integrated with a park bench in physical space. In this example, the park bench provides the physical structure but looks like a rock. In another example, the computing system 101 can identify a wall that can be expanded to function as a boxing ring virtual fence or virtual rope.

  [0022] In some embodiments, the virtual arena may define "in-area" as a region inside the virtual arena. In these embodiments, the area outside the virtual arena may be considered “out of zone”. For example, one or more physical objects and / or virtual objects can be effectively divided within an “in-area” region, whereas physical objects and / or virtual objects are effectively , Cannot be divided within the “out of zone” region. In an alternative embodiment, the fight can go out of the arena, in which case the entire physical space is considered “in area”.

  [0023] Virtual arena 110 may be automatically configured by computing system 101. In some embodiments, the virtual arena can be sized and arranged based on one or more topographic features of physical space. Additional arena features such as shape, terrain, obstacles, etc. can be configured based on physical space features (eg, identified by a depth camera of the computing system). For example, the virtual arena can be sized and positioned so that the floor of the virtual arena integrates with the ground and / or floor of the physical space. In other examples, the arena can be sized and positioned so that the arena floor is on the ground and / or top of the floor in physical space to resemble an elevated arena, such as a boxing ring. is there.

  [0024] The computing system 101 can automatically detect an open area of the physical space 104 and scale the virtual arena to match that open area. For example, an open area is a physical space that has a minimum amount of obstacles so that the virtual arena is sized and arranged to occupy a physical space position that has fewer objects than the object threshold. Can be defined. In the alternative, the open area may be defined by any suitable method. For example, an open area may be defined as a physical space having a maximum number of physical objects corresponding to interactive virtual objects.

  [0025] In additional or alternative embodiments, the virtual arena can be scaled as an upward bound function of physical space. The upper limit can indicate a maximum arena parameter, such as a maximum arena size. The maximum arena size may be selected, for example, such that the arena does not appear to be larger than the full size. The maximum arena size may be constrained by the maximum width, maximum depth, and / or maximum height. In some embodiments, the virtual arena can be scaled according to the size of the physical space, up to its size. For example, a virtual arena can be scaled to occupy as much physical space as possible without exceeding the maximum arena size, such as a full-scale arena. In additional or alternative embodiments, the virtual arena can be scaled to occupy a specified amount of physical space without crossing the upper boundary. In another embodiment, the virtual arena can be scaled up to an upper limit depending on physical space parameters, such as size in geospace, topographic features, objects, etc. In other words, in one example, the maximum arena size may be defined and the arena can be scaled regardless of which limit is reached first, either to match physical space or meet the maximum arena size. .

  [0026] In one particular example of the upper limit function, the maximum arena size may be 20 ft x 20 ft (609.6 x 609.6 cm). If the arena is placed in a room having an open area measuring 304.8 cm x 304.8 cm (10 ft x 10 ft), the arena is 10 ft x 10 ft (304.8 cm x 304.8 cm). Can be scaled to look like. Instead, if the arena is placed in a room having an open area measuring 914.4 cm x 914.4 cm (30 ft x 30 ft), the 609.6 cm x 609.6 cm (20 ft x 20 ft) is the arena. The arena can be scaled so that the arena appears to be its size. However, the arena may be scaled as other upper limiting functions without departing from the scope of the present disclosure.

  [0027] In other embodiments, the arena may be configured by the user such that one or more parameters of the virtual arena are selected by the user. For example, the user can select the size, position, orientation, shape, etc. of the virtual arena by providing user input. In some embodiments, the user can point to a location in the room and the selected virtual arena can be placed at that location. The virtual arena can have a modified appearance during configuration to indicate that the virtual arena has been customized. As soon as the virtual arena parameters are verified, the appearance of the virtual arena may be changed to indicate that the configuration is complete. The virtual arena can also be arranged in a modular fashion so that the user selects positions with respect to various boundaries of the virtual arena until the virtual arena is defined. For example, the user can point out the location for each boundary point of the modular virtual arena to define the boundaries of the virtual arena.

  [0028] In some embodiments, any parameter of the virtual arena that is not selected by the user can be automatically configured by the computing system 101. For example, the user can select a location for a selected predefined virtual arena and / or the user can select one of a plurality of predefined virtual arenas. In some examples, the predefined virtual arena can define one or more parameters. For example, a predefined virtual arena can have a particular shape and be scaled to match that room. In another example, a predefined virtual arena can be placed within a physical space location that has a particular size and that corresponds to the virtual arena. In a further embodiment, the user can select which objects in the real world can interact in the virtual arena.

  [0029] The virtual arena can be completely enclosed with the boundary defining a closed area of virtual space and / or physical space. In alternative embodiments, the virtual arena may be open on one or more ends and / or occupy different areas of physical space. For example, a portion of a virtual arena can be separated by obstacles to simulate a fighting top elevated platform separated by virtual abysses. In a further embodiment, the virtual arena may be unbounded so that the virtual arena can occupy all the physical space seen by the user through the see-through display device.

  [0030] The computing system 101 may display one or more avatars in the virtual arena via the see-through display device 102. In some embodiments, one or more avatars can be scaled as an upper limiting function in physical space. As explained in more detail above, the upper limit function can define scaling so that the avatar has a size based on the size of the physical space up to the maximum size (eg, looks full size). . The upper limit function for an avatar may be different from the upper limit function for the arena so that the avatar is scaled independently of the arena. Alternatively, the upper limit function for an avatar may be the same as the upper limit function for the arena so that the avatar is scaled in the same manner as the arena. For example, the avatar can have an independently defined maximum size. Alternatively, an avatar can have a maximum size that is equal to or derived from the maximum size of the arena. Further, each avatar may have an independent upper limiting function such that each avatar is scaled independently of each other and / or its arena. Alternatively, each avatar can share one or more elements of the upper limit function. For example, each avatar can have the same maximum size.

  [0031] The avatar may include a user-controlled avatar and one or more opponent avatars. The user controlled avatar can be controlled by the user in any suitable manner. One or more opponent avatars can be controlled by other users and / or artificial in-game intelligence.

  [0032] In some embodiments, a fighting game can include a team, whereby two or more users fight one or more opponents in a coordinated manner. In an alternative embodiment, the fighting game may be an open battle royal where each player fights each other.

  [0033] In some embodiments, the appearance of the user-controlled avatar can be predefined or can be selected from a plurality of predefined user-controlled avatar appearances. In other embodiments, the appearance of the user controlled avatar may be derived from the appearance of the user providing user input. For example, a user can be imaged by a camera (s), such as a depth camera and / or a color camera, and one or more physical features of the user are mapped to a user controlled avatar. It is possible.

  [0034] A user may provide user input to control user-controlled avatars and / or other elements of the fighting game. In response to receiving the user input, the computing system 101 can display an updated user control avatar on the see-through display device 102 based on the user input. For example, an aggressive movement, such as a kick or punch, can be displayed by user input, and in response, the see-through display can display a user-controlled avatar that performs the aggressive movement.

  [0035] In some embodiments, the updated image may be used to display the user control avatar with a new position, orientation, pose, etc. In additional examples or alternatives, the updated user control avatar can be moved to illustrate the command indicated by the user input.

  [0036] The user provides user input indicating one or more commands, such as motion commands, attack or defense commands, camera control commands to modify the virtual arena's field of view, game commands such as end a fight can do. For example, an attack command can include various fighting movements such as a virtual magic attack such as punch, kick, fireball, and the like. The defense command can also include a combo move that displays an updated user-controlled avatar where a series of user input is received and the see-through display device performs an extended defensive movement It is.

  [0037] User input may be received via multiple methods and devices for controlling a user control avatar. In some embodiments, user input can be received via voice commands provided to one or more voice capture devices. In these embodiments, the microphone can detect voice commands from the user to provide user input. For example, the user can act as a virtual coach by instructing the user control avatar using voice commands such as “punch”, “avoid left”, “move forward”, and the like. In some embodiments, user input can be received via a game controller. For example, the user can provide input by actuating one or more buttons, joysticks, flippers, switches, etc. of the game controller. In some embodiments, user input can be received via a spatial position detector (eg, an inertial measurement device). For example, the inertial measurement device can be attached to one or more positions of the user to detect and interpret movement of one or more positions of the user. For example, the inertial measurement device can be attached to the user's finger to detect punch movement by the user's hand.

  [0038] In some embodiments, user input may be received via a gesture input detection device configured to perform a step of observing a user's gesture providing user input. For example, the user can perform a gesture, such as a punch movement, detected by a gesture input detection device. Gesture input detection devices can include one or more devices that can detect and recognize gestures. For example, the gesture input detection device can include a color camera, a depth camera, an accelerometer, an inertial measurement device, a touch-sensitive device, and the like. In some embodiments, a gesture can be detected by an opponent's see-through display device camera. In another embodiment, user input may be received via a gaze tracking detection device that determines and recognizes the user's eye movements. For example, an inward-facing camera of a see-through display device can detect a user's gaze.

  [0039] In some embodiments, multiple devices may be used simultaneously to provide for user input. For example, a user can detect a punch movement while wearing an inertial measurement device and providing a voice command to “move forward”. Accordingly, the user-controlled avatar can perform a punch movement while moving forward. In addition, a single device can include multiple user input capture functions. For example, the game controller may include an accelerometer for recognizing a specific gesture. Therefore, the user can provide a user input with a push button and a gesture using the game controller.

  [0040] A user can watch and participate in a fight using multiple views and viewpoints. For example, the field of view and / or viewpoint can be chosen for the user based on physical space. In another example, the user can select a preferred field of view and / or viewpoint. In some embodiments, the user can dynamically switch between views and / or viewpoints. In alternative or additional embodiments, the system can automatically switch between views and / or viewpoints automatically in response to movement of one or more of the avatar or user.

  [0041] FIG. 2 shows an example with a first field of view that is a third person "ringside" field of view. In the third person view, the user control avatar 200 may be placed in front of the user 202 when viewed through the see-through display device 102. Virtual arena 204, user control avatar 200 and opponent avatar 206 are illustrated using dashed lines to represent a virtual environment.

  [0042] In the field of view illustrated in FIG. 2, the position of the user control avatar 200 is dynamically based in some embodiments on the position of the user 202 that provides user input to control the user control avatar. It can be updated. That is, the third person field of view may have a fixed viewpoint so that the user control avatar is maintained in the same orientation and / or position with respect to the user. For example, the user control avatar can maintain the position of the front of the user. In some embodiments, the fixed viewpoint can result in the see-through display device displaying the user control avatar with its back towards the user. In this configuration, the user can provide a gesture or control that is directly imitated by a user control avatar. For example, if the user toggles the joystick to the right, the see-through display can display an updated user-controlled avatar that has moved to the right side of the avatar. In another example, the fixed viewpoint may cause the see-through display device to display the user control avatar with its front facing the user. In this configuration, the user can provide a gesture reflected by the user control avatar. For example, if the user toggles the joystick to the right, the see-through display can display an updated user-controlled avatar that has moved to the left side of the avatar.

  [0043] In some embodiments, the position of the user-controlled avatar can be updated independently of the user's position when the user has a combat third-person view. That is, the third person field of view can have a dynamic viewpoint. For example, the user can move around the arena while maintaining the same position and orientation of the user-controlled avatar and / or arena. Such a configuration may allow the user to obtain the desired viewpoint during the fight. For example, the user can move around the arena to see the fights from different angles and identify possible fighting strategies.

  [0044] As described above, the user-controlled avatar can be viewed from a third person perspective. That is, the avatar controlled by the user is physically separated from the user. In other embodiments, the user-controlled avatar can be implemented as a user overlay.

  [0045] For example, FIG. 3 shows an example of a first person view viewed through a see-through display device 102. FIG. In the first person view, see-through displays extend reality and change the user's appearance. In this view, costume elements, such as boxing gloves 300 and / or boxing pants, overlay the user's hand 302 and / or legs when the hands 302 and / or legs are viewed through the see-through display device 102. Can write). That is, the see-through display can enhance the appearance of the user by displaying the features of the user controlled avatar as an overlay of the corresponding features of the user.

  [0046] The first person field of view may feature a fixed viewpoint as described in more detail above, or may be a dynamic viewpoint. This dynamic viewpoint for the field of view can be utilized to allow control of the movement of the user controlled avatar within a small physical space. For example, the user can change the virtual position of the user control avatar via specific user input without changing his physical position.

  [0047] In any field of view or viewpoint, the user control avatar can be displayed in a pose based on the user's pose providing user input. Alternatively, the user control avatar can be displayed in a pose that is independent of the user's pose providing user input.

  [0048] An opponent avatar, such as the opponent avatar 114 of FIG. 1C, can be controlled by AI (artificial intelligence) provided by a computing device. The opponent avatar can also be controlled by the opponent user providing the opponent user input. For example, in some embodiments, the opponent user can be located in the same physical space as the main user. In this embodiment, the virtual arena is displayed on the opponent's see-through display device so that the opponent user can see a representation of the virtual arena. The opponent see-through display device can display the representation of the virtual arena in the same physical space location as the virtual arena displayed by the main user see-through display device, so that both users can display the same physical The arena and avatar can be recognized in the position.

  [0049] In some embodiments, the opponent user may be located in a different physical space than the main user. For example, an opponent user can view a representation of a virtual arena using a see-through display device. In this way, different see-through displays are used to create the same arena and avatar illusion in two different physical spaces.

  [0050] As another example, an opponent user can view a representation of a virtual arena using a stationary display (eg, a television or a computer device). For example, FIG. 4 illustrates an opponent 400 participating in a fight via a computing system, such as a video game system 402, and watching the fight using the opponent stationary display 404.

  [0051] In some embodiments, a virtual arena can be configured by a main user and placed within a physical space location corresponding to the main user. Information regarding the arena, physical space, and one or more avatar parameters may then be sent to the video game system 402. The representation of the virtual arena 406 displayed on the opponent stationary display 404 can then reflect the physical space characteristics of the main user. In an alternative embodiment, the virtual arena can be configured in the physical space corresponding to the opponent user and placed in that physical space. Information about the arena, physical space, and one or more avatar parameters may then be sent to the main user's see-through display. The main user's see-through display can display a representation of a virtual arena that reflects the physical space characteristics of the opponent.

  [0052] When engaging in a real-time multiplayer scenario as described above, the difference between the physical space of two or more users can be adjusted by mapping the physical properties of the physical space to each other. For example, the main user physical space may be selected to accommodate the arena. Thus, in some embodiments, virtual objects representing physical objects in the main user physical space can be virtually incorporated into the opponent physical space. For example, a table placed in the main user physical space can be displayed on an opponent see-through display device in a corresponding position in the opponent physical space. In other embodiments, only physical objects represented by interactive virtual objects may be displayed on the opponent see-through display device.

  [0053] FIG. 5 illustrates an example method 500 for integrating virtual arenas into physical space, according to certain embodiments of the present disclosure. At 502, the method 500 includes imaging a physical space that includes topographic features. In some embodiments, at 504, physical space features can be further identified by determining depth values for objects in the physical space. At 506, method 500 includes displaying a virtual arena integrated in physical space. In one example, the size and position of the virtual arena can be 508 and configured based on user input. In additional examples or alternatives, the computing system may automatically place a virtual arena at 510 based on physical space. Automatic placement may include, at 512, scaling the virtual arena as an upper limiting function of physical space.

  [0054] At 514, method 500 includes displaying one or more avatars in a virtual arena. In one example, the avatar can be scaled at 516 as an upper limiting function in physical space. At 518, the avatar can be displayed with an appearance derived from the user's appearance. At 520, method 500 includes controlling a user control avatar based on user input. Next, at 522, the method 500 includes displaying an updated user control avatar based on the user input.

  [0055] FIG. 6 illustrates a non-limiting example of a see-through display device 102 that includes a see-through display 602. FIG. For example, the see-through display device 102 may be a head-mounted see-through display device. The see-through display 602 is at least partially transparent, thereby allowing light to travel through the see-through display to the user's eyes. In addition, the see-through display is configured to visually enhance the appearance of the physical space for a user viewing the physical space through the see-through display. For example, the see-through display can display virtual objects that the user can see when the user views through the see-through display. Thus, the user can see a virtual object that does not exist in the physical space at the same time that the user sees the physical space. This creates the illusion that the virtual object is part of physical space.

  [0056] The see-through display device 102 also includes a virtual reality engine 604. Virtual reality engine 604 may be configured to cause a see-through display to visually present a virtual object in the form of a virtual arena, one or more avatars, or other virtual objects. Virtual objects can simulate the appearance of real world objects. For a user viewing the physical space through a see-through display, the virtual object appears to be integrated with the physical space. For example, a virtual object and / or other image displayed via a see-through display may appear to the user as if the displayed virtual object and / or image occupies a particular position in the physical space. In addition, it can be arranged with respect to the user's eyes. In this way, the user can see objects that do not actually exist in the physical space. The virtual reality engine can include software, hardware, firmware, or any combination thereof.

  [0057] The see-through display device 102 may include a speaker subsystem 606 and a sensor subsystem 608. The sensor subsystem may include a variety of different sensors in different embodiments. By way of non-limiting example, the sensor subsystem may include a microphone 610, one or more forward-facing infrared and / or visible light cameras 612 (and away from the user), and / or one or more ( A rear-facing infrared camera and / or visible light camera 614 (facing the user) may be included. The front-facing camera (s) can include one or more depth cameras, and / or the rear-facing camera can include one or more eye tracking cameras. In some embodiments, the on-board sensor subsystem can communicate with one or more off-board sensors that transmit observation information to the on-board sensor subsystem. For example, a depth camera used by a game console can send a depth map and / or a modeled virtual skeleton to the sensor subsystem of the head mounted display.

  [0058] The see-through display device 102 may also include one or more features that allow the see-through display device to be worn on the user's head. In the example shown, the see-through display device 102 takes the form of glasses and includes a nose pad 616 and ear pads 618a and 618b. In other embodiments, the head-mounted display can include a hat or helmet with a front-of-the-face see-through-visor. Further, although described in the context of a head-mounted see-through display, the concepts described herein are non-head-mounted see-through displays (eg, windshields) and non-see-through displays (eg, cameras) Can be applied to a translucent display that renders the actual object viewed by the camera, along with virtual objects that are not in the field of view.

  [0059] The see-through display device 102 may also include a communication subsystem 620. The communication subsystem 620 can be configured to communicate with one or more offboard computing devices. As an example, the communication subsystem may be configured to wirelessly receive a video stream, audio stream, coordinate information, virtual object description, and / or other information and render a virtual arena. .

  [0060] In some embodiments, the methods and processes described above may be coupled to a computing system of one or more computing devices. In particular, such methods and processes can be implemented as computer application programs or computer application services, application programming interfaces (APIs), libraries, and / or other computer program products.

  [0061] FIG. 7 schematically illustrates one non-limiting embodiment of a computing system 700 that can enact one or more of the methods and processes described above. Computing system 700 is shown in a simplified form. It will be appreciated that virtually any computer architecture may be used without departing from the scope of the present disclosure. In different embodiments, the computing system 700 is a head-mounted see-through display device, a gaming device, a mobile computing device, a mobile communication device (eg, a smartphone), a desktop computer, a laptop computer, a tablet computer, home entertainment. It may take the form of a computer, a network computing device, a mainframe computer, a server computer, etc.

  [0062] Computing system 700 includes a logical subsystem 702 and a storage subsystem 704. The computing system 700 may optionally include a display subsystem 706 (eg, a see-through display), an input subsystem 708, a communication subsystem 710, and / or other components not shown in FIG.

  [0063] The logical subsystem 702 includes one or more physical devices configured to execute instructions. For example, a logical subsystem is configured to execute instructions that are part of one or more applications, services, programs, routines, libraries, objects, components, data structures, or other logical constructs. It is possible. Such instructions may be performed to perform a task, to implement a data type, to convert the state of one or more components, or otherwise to achieve a desired result Can be done.

  [0064] The logical subsystem may include one or more processors configured to execute software instructions. In addition or alternatively, the logical subsystem may include one or more hardware or firmware logic machines configured to execute hardware or firmware instructions. The logical subsystem processor may be single-core or multi-core, and the program executed thereon may be configured for continuous, parallel, or distributed processing . A logical subsystem can optionally be remotely located and / or configured for collaborative processing, optionally with individual components distributed between two or more devices. It is possible to include. Aspects of the logical subsystem can be virtualized and executed by remotely accessible, networked computing devices configured in a cloud computing configuration.

  [0065] The storage subsystem 704 is configured to hold one or more data and / or instructions that are executable by the logical subsystem to perform the methods and processes described herein. Includes physical non-transitory devices. When such methods and processes are implemented, the state of storage subsystem 704 can be converted, eg, to hold different data.

  [0066] The storage subsystem 704 may include removable media and / or self-contained devices. The storage subsystem 704 includes, among others, an optical storage device (eg, CD, DVD, HD-DVD, Blu-Ray disk, etc.), a semiconductor storage device (eg, RAM, EPROM, EEPROM, etc.), and / or a magnetic storage device (eg, For example, it may include a hard disk drive, floppy disk drive, tape drive, MRAN, etc. The storage subsystem 704 is a volatile device, a non-volatile device, a dynamic device, a static device, a read / write device, a read-only device, a random access device, a continuous access device, a location addressable device, a file addressable device. , And / or content addressable devices.

  [0067] It will be appreciated that the storage subsystem 704 includes one or more physical non-transitory devices. However, in some embodiments, the instructional aspects described herein are propagated in a transient manner by clean signals (eg, electromagnetic signals, optical signals, etc.) that are not held by the physical device for a finite lifetime. Can be done. Further, data and / or other forms of information related to the present disclosure can be propagated by clean signals.

  [0068] In some embodiments, aspects of the logical subsystem 702 and aspects of the storage subsystem 704 may be defined via which one or more may be functionally described herein. Can be integrated together in the hardware logic components of Such hardware logic components include, for example, field programmable gate arrays (FPGAs), program-specific integrated circuits and application specific integrated circuits (PSIC / ASIC), standard programs specific products, and It may include application specific standard products (PSSP / ASSP), system on chip (SOC) systems, and complex programmable logic devices (CPLD).

  [0069] The terms "program" and "engine" may be used to describe certain aspects of computing system 700 that are implemented to perform a particular function. In some cases, an instance of a program or engine can be created via a logical subsystem 702 that executes instructions held by the storage subsystem 704. It will be appreciated that instances of different programs and / or engines may be created from the same application, service, code block, object, library, routine, API, function, etc. Similarly, the same program and / or engine can be created by different applications, services, code blocks, objects, routines, APIs, functions, etc. The terms “program” and “engine” can encompass individual executable files, data files, libraries, drivers, scripts, database records, etc., or groups thereof.

  [0070] As used herein, it will be understood that a "service" is an application program that can be executed through multiple user sessions. A service may be available for one or more system components, programs, and / or other services. In some embodiments, the service can run on one or more server computing devices.

  [0071] When included, the display subsystem 706 can be used to present a visual representation of the data maintained by the storage subsystem 704. This visual representation may take the form of an image that appears to extend physical space, thereby creating the illusion of mixed reality. Because the methods and processes described herein change the data held by the storage subsystem, thereby converting the state of the storage subsystem, the state of the display subsystem 706 changes the underlying data. Can be similarly transformed to visually represent. The display subsystem 706 can include one or more display devices that utilize virtually any type of technology. Such a display device can be combined with logical subsystem 702 and / or storage subsystem 704 in a shared enclosure (eg, a head-mounted display) or such The display device may be a peripheral display device.

  [0072] When included, the input subsystem 708 comprises one or more user input devices such as a game controller, gesture input detection device, voice recognition device, inertial measurement device, keyboard, mouse, or touch screen, Alternatively, it can interface with the user input device. In some embodiments, the input subsystem may comprise or interface with a selected natural user input (NUI) component element. Such component elements may be integrated or peripheral, and the conversion and / or processing of input motion may be handheld or onboard or offboard. Also good. Exemplary NUI component elements include microphones for speech recognition and / or speech recognition, infrared cameras, color cameras, stereo cameras, and / or depth cameras, motion detection and / or intent for machine vision and / or gesture recognition Similar to a head tracker, eye tracker, accelerometer, and / or gyroscope for recognition, an electric field sensing component element for assessing brain activity can be included.

  [0073] When included, the communication subsystem 710 may be configured to communicatively couple the computing system 700 with one or more other computing devices. The communication subsystem 710 can include wired and / or wireless communication devices that are compatible with one or more different communication protocols. By way of non-limiting example, the communication subsystem can be configured to communicate via a wireless telephone network or a wired or wireless local area network or wide area network. In some embodiments, the communication subsystem allows the computing system 700 to send messages to and / or receive messages from other devices via a network such as the Internet. Can be possible.

  [0074] Since the configurations and / or techniques described herein are exemplary in nature and various modifications are possible, these specific embodiments or examples are considered in a limiting sense. It will be understood that it should not. The particular routines or methods described herein may represent one or more of any number of processing strategies. Accordingly, the various operations illustrated and / or described may be performed in the order illustrated and / or described, may be performed in other orders, may be performed in parallel, or may be omitted. Good. Similarly, the order of the processes described above may be changed.

  [0075] The subject matter of this disclosure is all novel non-obvious combinations and subcombinations of the various processes, systems and configurations, and other features, functions, operations, and / or attributes disclosed herein. As well as any and all equivalents thereof.

100 user 101 computing system 102 see-through display device 104 physical space
Physical Environment 106a, 106b, 106c, 106d Line 108a, 108b, 108c, 108d Real World Object 110 Virtual Arena 112 User Control Avatar
Avatar 114 Opponent Avatar
Avatar 200 User control avatar 202 User 204 Virtual arena 204
206 opponent avatar 300 boxing glove 302 hand 400 opponent 402 video game system 404 opponent stationary display 406 virtual arena 500 method 502 step 504 step 506 step 508 step 510 step 512 step 514 step 516 step 518 step 520 step 522 step 602 see-through Display 604 Virtual Reality Engine 606 Speaker Subsystem 608 Sensor Subsystem 610 Microphone 612 Forward Infrared Camera and / or Visible Light Camera 614 Backward Infrared Camera and / or Visible Light Camera 616 Nose 618a, 618b Ear 620 620 Communication Subsystem 700 Computing System 702 logical Subsystem 704 Storage Subsystem 706 Display Subsystem 706
708 Input subsystem 710 Communication subsystem

Claims (10)

A computing system that provides a mixed reality fighting game,
See-through display devices,
A logical subsystem;
When executed by the logical subsystem,
Displaying a virtual arena, a user controlled avatar, and an opponent avatar on the see-through display device so that when the physical space is viewed through the see-through display device, the virtual arena is integrated into the physical space;
A computing system comprising: a storage subsystem storing instructions for displaying a user control avatar updated based on the user input on the see-through display device in response to receiving the user input.   The computing system of claim 1, wherein a location of the user controlled avatar is dynamically updated based on a location of a user providing the user input.   The computing system of claim 1, wherein the user input is received via a gesture input detection device configured to observe a user gesture that provides the user input.   The computing system of claim 1, wherein the representation of the virtual arena is displayed on an opponent stationary display.   The computing system of claim 1, wherein the representation of the virtual arena is displayed on an opponent see-through display device.   The computing system according to claim 1, further comprising a depth camera, wherein the depth camera images the physical space.   When the physical space having one or more objects is viewed through the see-through display device, the see-through display device is integrated with the one or more objects in the physical space; The computing system of claim 6, wherein the virtual arena having a plurality of interactive elements is displayed. A method for providing a mixed reality fighting game,
Displaying a virtual arena through a see-through display device, wherein the virtual arena is scaled as a first upper limiting function in physical space;
Displaying one or more avatars in the virtual arena via the see-through display device, wherein the one or more avatars are scaled as a second upper limiting function of the physical space; And a method comprising:   The method of claim 8, wherein the first upper limit function is different from the second upper limit function.   9. The method of claim 8, wherein the first upper limit function is the same as the second upper limit function.

Images