[go: up one dir, main page]

CN115268625B - Control method, device and equipment of head-mounted display equipment and readable storage medium - Google Patents

Control method, device and equipment of head-mounted display equipment and readable storage medium

Info

Publication number
CN115268625B
CN115268625B CN202210593383.2A CN202210593383A CN115268625B CN 115268625 B CN115268625 B CN 115268625B CN 202210593383 A CN202210593383 A CN 202210593383A CN 115268625 B CN115268625 B CN 115268625B
Authority
CN
China
Prior art keywords
vibrator
vibrators
action
target
vibration
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202210593383.2A
Other languages
Chinese (zh)
Other versions
CN115268625A (en
Inventor
王海勇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Goertek Inc
Original Assignee
Goertek Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Goertek Inc filed Critical Goertek Inc
Priority to CN202210593383.2A priority Critical patent/CN115268625B/en
Publication of CN115268625A publication Critical patent/CN115268625A/en
Application granted granted Critical
Publication of CN115268625B publication Critical patent/CN115268625B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/25—Output arrangements for video game devices
    • A63F13/28—Output arrangements for video game devices responding to control signals received from the game device for affecting ambient conditions, e.g. for vibrating players' seats, activating scent dispensers or affecting temperature or light
    • A63F13/285—Generating tactile feedback signals via the game input device, e.g. force feedback
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/80—Special adaptations for executing a specific game genre or game mode
    • A63F13/837—Shooting of targets
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1037—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals being specially adapted for converting control signals received from the game device into a haptic signal, e.g. using force feedback
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/80—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game specially adapted for executing a specific type of game
    • A63F2300/8076—Shooting

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本公开实施例公开了一种头戴显示设备的控制方法、装置、设备及可读存储介质，该头戴显示设备包括多个振动器，每个振动器可沿预设方向振动，该方法包括：在头戴显示设备运行预设场景的情况下，根据预设场景的场景数据，确定第二对象对第一对象执行的操作动作的动作信息，动作信息包括动作类型、动作方向和动作强度；根据动作方向，从多个振动器中确定目标振动器；基于动作类型对应的控制方式，根据动作方向和动作强度，控制目标振动器工作；其中，第一对象为在预设场景中与头戴显示设备的佩戴者对应的虚拟对象，第二对象与所述第一对象不同。

This disclosure provides a control method, apparatus, device, and readable storage medium for a head-mounted display device. The head-mounted display device includes multiple vibrators, each capable of vibrating along a preset direction. The method includes: when the head-mounted display device is running a preset scene, determining action information of an operation performed by a second object on a first object based on scene data of the preset scene; the action information includes action type, action direction, and action intensity; determining a target vibrator from the multiple vibrators based on the action direction; and controlling the target vibrator to operate based on the control method corresponding to the action type, according to the action direction and action intensity; wherein the first object is a virtual object corresponding to the wearer of the head-mounted display device in the preset scene, and the second object is different from the first object.

Description

Control method, device and equipment of head-mounted display equipment and readable storage medium
Technical Field
The embodiment of the disclosure relates to the technical field of virtual reality equipment, and more particularly relates to a control method, a device and equipment of head-mounted display equipment and a readable storage medium.
Background
With the rapid development of Virtual Reality (VR) technology, VR products are increasingly widely used, and people also put higher demands on the performance of VR products. For example, an immersive experience of VR products.
In the related art, the VR product carries on 4K display screen or Micro LED display screen, can effectively avoid showing granule sense and gauze effect for the display effect of VR product can bring immersive experience for the user in the vision. However, the improvement of the prior art only promotes the immersive experience of the VR product in visual terms, but not in haptic terms.
Therefore, it is necessary to provide a new control method of the head-mounted display device.
Disclosure of Invention
An embodiment of the disclosure aims to provide a control method, a control device and a control device for a head-mounted display device, and a readable storage medium, so as to solve the problem that immersion experience of VR products cannot be improved in terms of touch in the prior art.
According to a first aspect of embodiments of the present disclosure, there is provided a control method of a head-mounted display apparatus including a plurality of vibrators each vibratable in a preset direction, the method including:
Under the condition that the head-mounted display device runs a preset scene, determining action information of an operation action executed by a second object on a first object according to scene data of the preset scene, wherein the action information comprises action types, action directions and action intensities;
determining a target vibrator from the plurality of vibrators according to the action direction;
Controlling the target vibrator to work according to the action direction and the action intensity based on a control mode corresponding to the action type;
The first object is a virtual object corresponding to a wearer of the head-mounted display device in the preset scene, and the second object is different from the first object.
Optionally, the controlling, based on the control manner corresponding to the action type, the target vibrator according to the action direction and the action intensity includes:
determining a vibration direction according to the action direction;
determining vibration intensity according to the action intensity;
And controlling the target vibrator to vibrate along the vibration direction according to the vibration intensity based on the control mode corresponding to the action type.
Optionally, the plurality of vibrators includes at least two target vibrators, and when the action type is a first type, the controlling the target vibrators to vibrate along the vibration direction based on the control mode corresponding to the action type includes:
Sequentially triggering a first target vibrator and a second target vibrator to vibrate along the vibration direction at the vibration intensity;
the first target vibrator is a target vibrator, close to the second object, of the at least two target vibrators, and the second target vibrator is a target vibrator, away from the second object, of the at least two target vibrators.
Optionally, the triggering the first target vibrator and the second target vibrator in turn vibrate along the vibration direction with the vibration intensity, including:
Triggering the first target vibrator to vibrate in the vibration direction at the vibration intensity at a first moment;
triggering the second target vibrator to vibrate in the vibration direction at the vibration intensity at a second moment;
the second time is later than the first time, and the time interval between the second time and the first time is a first time delay duration.
Optionally, the plurality of vibrators includes at least two target vibrators, and when the action type is the second type, the controlling the target vibrators to vibrate along the vibration direction based on the control mode corresponding to the action type includes:
Simultaneously triggering a first target vibrator and a second target vibrator to vibrate along the vibration direction at the vibration intensity;
the first target vibrator is a target vibrator, close to the second object, of the at least two target vibrators, and the second target vibrator is a target vibrator, away from the second object, of the at least two target vibrators.
Optionally, the determining a target vibrator from the plurality of vibrators according to the action direction includes:
determining a vibrator located in the first direction among the plurality of vibrators as a target vibrator when the operation direction is the first direction;
when the operation direction is a second direction, determining a vibrator corresponding to the second direction among the plurality of vibrators as a target vibrator;
The first direction is a vibration direction generated by any vibrator in the plurality of vibrators, and the second direction is different from the first direction.
Optionally, the head-mounted display device comprises two first vibrators arranged oppositely along a first preset direction and two second vibrators arranged oppositely along a second preset direction, wherein the first preset direction is perpendicular to the second preset direction, and the target vibrator is determined from the plurality of vibrators according to the action direction, and comprises:
Determining the two first vibrators as target vibrators when the action direction is the first preset direction, wherein the first target vibrators are vibrators close to the second object in the two first vibrators, and the second target vibrators are vibrators deviating from the second object in the two first vibrators;
And determining the two second vibrators as target vibrators when the action direction is the second preset direction, wherein the first target vibrator is a vibrator, close to the second object, of the two second vibrators, and the second target vibrator is a vibrator, away from the second object, of the two second vibrators.
Optionally, the head-mounted display device comprises two first vibrators arranged oppositely along a first preset direction and two second vibrators arranged oppositely along a second preset direction, wherein the first preset direction is perpendicular to the second preset direction, and the target vibrator is determined from the plurality of vibrators according to the action direction, and comprises:
determining the two first vibrators and the two second vibrators as target vibrators when the action direction is inconsistent with the first preset direction and the action direction is inconsistent with the second preset direction;
wherein the first target vibrator includes a vibrator of the two first vibrators that is close to the second object and a vibrator of the two second vibrators that is close to the second object;
The second target vibrator includes a vibrator of the two first vibrators facing away from the second object and a vibrator of the two second vibrators facing away from the second object.
Optionally, the determining the vibration direction according to the action direction includes:
Determining a vibration direction according to the included angle between the action direction and the set direction;
wherein the set direction is a vibration direction generated by any one of the plurality of vibrators.
Optionally, the determining the vibration intensity according to the action intensity includes:
determining vibration intensity according to the action intensity and the included angle between the action direction and the set direction;
wherein the set direction is a vibration direction generated by any one of the plurality of vibrators.
According to a second aspect of embodiments of the present disclosure, there is provided a control apparatus of a head-mounted display device including a plurality of vibrators each vibratable in a preset direction, the apparatus including:
The first determining module is used for determining action information of an operation action executed by the second object on the first object according to scene data of a preset scene when the head-mounted display device runs the preset scene, wherein the action information comprises action types, action directions and action intensities;
A second determining module for determining a target vibrator from the plurality of vibrators according to the action direction;
The control module is used for controlling the target vibrator to work according to the action direction and the action intensity based on a control mode corresponding to the action type;
The first object is a virtual object corresponding to a wearer of the head-mounted display device in the preset scene, and the second object is different from the first object.
According to a third aspect of embodiments of the present disclosure, there is provided a head-mounted display device comprising:
A memory for storing executable computer instructions;
A processor, configured to execute the method for controlling the head-mounted display device according to the first aspect of the embodiments of the present disclosure according to the control of the executable computer instructions.
According to a fourth aspect of embodiments of the present disclosure, there is provided a computer-readable storage medium having stored thereon computer instructions which, when executed by a processor, perform a method of controlling a head mounted display device according to the first aspect of embodiments of the present disclosure.
According to the embodiment of the disclosure, when the head-mounted display device runs a preset scene, according to scene data of the preset scene, determining an action type, an action direction and action intensity of an operation action performed by a second object on a first object, and according to the action direction, determining a target vibrator from a plurality of vibrators, so as to control the target vibrator to work according to the action direction and the action intensity based on a control mode corresponding to the action type. In this way, according to the action type of the operation action, the control mode of the vibrator can be determined, so that the target vibrator in the plurality of vibrators can be controlled to work according to the corresponding control mode, the touch sense of directivity generated by the head-mounted display device can be accurately controlled, and the touch sense brought by the operation action in the real scene can be simulated, so that the user immersion experience can be brought to the application scene of the head-mounted device. In addition, the embodiment has simple structure and low cost.
Other features of embodiments of the present disclosure and advantages thereof will be apparent from the following detailed description of exemplary embodiments of the disclosure with reference to the drawings.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings that are required to be used in the embodiments will be briefly described below. It is appreciated that the following drawings depict only certain embodiments of the disclosure and are therefore not to be considered limiting of its scope. Other relevant drawings may be made by those of ordinary skill in the art without undue burden from these drawings.
FIG. 1 is a schematic diagram of a head mounted display device according to one embodiment;
FIG. 2 is a schematic diagram of a vibrator in a grouped state according to one embodiment;
FIG. 3 is one of the schematic diagrams of a vibrator in a vibrating state according to one embodiment;
FIG. 4 is a second schematic diagram of a vibrator in a vibrating state according to one embodiment;
FIG. 5 is one of the usage scenario schematics of a head mounted display device according to one embodiment;
FIG. 6 is a second schematic view of a usage scenario of a head-mounted display device according to one embodiment;
FIG. 7 is a flow diagram of a method of controlling a head mounted display device according to one embodiment;
FIG. 8 is a functional block diagram of a control apparatus of a head mounted display device according to one embodiment;
fig. 9 is a functional block diagram of a head mounted display device according to one embodiment.
Detailed Description
Various exemplary embodiments of the present disclosure will now be described in detail with reference to the accompanying drawings. It should be noted that the relative arrangement of the components and steps, numerical expressions and numerical values set forth in these embodiments do not limit the scope of the embodiments of the present disclosure unless it is specifically stated otherwise.
The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the disclosure, its application, or uses.
Techniques, methods, and apparatus known to one of ordinary skill in the relevant art may not be discussed in detail, but are intended to be part of the specification where appropriate.
In all examples shown and discussed herein, any specific values should be construed as merely illustrative, and not a limitation. Thus, other examples of exemplary embodiments may have different values.
It should be noted that like reference numerals and letters refer to like items in the following figures, and thus once an item is defined in one figure, no further discussion thereof is necessary in subsequent figures.
Various embodiments and examples according to the present disclosure are described below with reference to the accompanying drawings.
The embodiment of the present disclosure provides a control method of a head-mounted display device, which is implemented by the head-mounted display device, and a head-mounted display device for implementing the control method is first described below.
Referring to fig. 1, the head-mounted display device 10 includes a device body 11 and a vibrator 12, the vibrator 12 being disposed in the device body, the vibrator 12 being vibratable in a preset direction.
In this embodiment, the vibrator 12 may be a bi-directional linear vibrator. The working principle of the vibrator is described by taking a bidirectional linear vibrator as an example, when the vibrator is in a non-energized state as shown in fig. 2, the vibrator is in a state of being in a middle position, a forward voltage is input to the vibrator to move the vibrator to the right as shown in fig. 3, and a reverse voltage is input to the vibrator to move the vibrator to the left as shown in fig. 4. Based on this, by controlling the direction and magnitude of the voltage input to the vibrator, the vibrator 12 can be controlled to operate.
In the present embodiment, the head-mounted display device 10 may be provided with a plurality of vibrators 12, and the plurality of vibrators 12 may vibrate in different directions, wherein the number of vibrators 12 may be set by those skilled in the art according to actual needs, for example, 4, 6, etc.
For example, as shown in fig. 1, 4 vibrators, that is, a vibrator 12a, a vibrator 12b, a vibrator 12c, and a vibrator 12d are provided in the device body 11 of the head-mounted display device, the vibrator 12a and the vibrator 12b are provided along the N axis, and the vibrator 12a and the vibrator 12b may vibrate along the N axis, the vibrator 12c and the vibrator 12d are provided along the M axis, and the vibrator 12c and the vibrator 12d may vibrate along the M axis. That is, when the user uses the head-mounted display device, the vibrator 12a and the vibrator 12b are located at front and rear sides of the wearer of the head-mounted display device, respectively, and the vibrator 12a and the vibrator 12b may vibrate in the front and rear direction of the wearer, and the vibrator 12c and the vibrator 12d are located at left and right sides of the wearer of the head-mounted display device, respectively, and the vibrator 12c and the vibrator 12d may vibrate in the left and right direction of the wearer, so that an immersive tactile experience can be provided to the user by controlling the vibrator 12a, the vibrator 12b, the vibrator 12c, and the vibrator 12d to operate.
Illustratively, 6 vibrators, namely, vibrator 12a, vibrator 12b, vibrator 12c, vibrator 12d, vibrator 12e, and vibrator 12d, are disposed within the device body 11 of the head-mounted display device. The vibrator 12a and the vibrator 12b are disposed along an N-axis (see fig. 1), and the vibrator 12a and the vibrator 12b may vibrate along the N-axis, the vibrator 12c and the vibrator 12d are disposed along an M-axis (see fig. 1), and the vibrator 12c and the vibrator 12d may vibrate along the M-axis, the vibrator 12e and the vibrator 12f are disposed along a Z-axis (not shown in the drawing), and the vibrator 12e and the vibrator 12f may vibrate along the Z-axis, wherein the Z-axis is a plane perpendicular to the N-axis and the M-axis.
The following describes a working process of the head-mounted display device provided in the embodiment of the present disclosure, taking a shooting game scene as an example.
Referring to fig. 5, in the process of experiencing a shooting game using the head mounted display device, when a user is shot on the front side (right under the screen) in a shooting game scene, if the shot is a through type, the vibrator 12a is triggered to vibrate to the rear of the user (i.e., above the screen), and after a predetermined time, the vibrator 12b is triggered to vibrate to the rear of the user (i.e., above the screen). If the shooting action is not through, the vibrator 12a and the vibrator 12b are simultaneously triggered to vibrate rearward (i.e., upward on the screen) of the user.
Referring to fig. 6, in the course of experiencing a shooting game using the head mounted display device, when a user is shot in the shooting game scene in the right front (lower left in the picture), if the shot is a through type, the vibrator 12a is triggered to vibrate in the rear (i.e., upper picture) of the user while the vibrator 12d is triggered to vibrate in the left (i.e., right picture) of the user, and after a preset time, the vibrator 12b is triggered to vibrate in the rear (i.e., upper picture) of the user while the vibrator 12c is triggered to vibrate in the left (i.e., right picture) of the user. If the shooting action is a non-penetration type, the vibrator 12a and the vibrator 12d are simultaneously triggered to vibrate rearward (i.e., above the screen) of the user, and the vibrator 12b and the vibrator 12c are simultaneously triggered to vibrate leftward (i.e., right side of the screen) of the user.
According to an embodiment of the present disclosure, the head-mounted display device includes a device body and a vibrator provided in the device body, the vibrator being vibratable in a preset direction. Under the condition that the head-mounted display device runs a preset scene, determining the action type, the action direction and the action intensity of the operation action executed by the second object on the first object according to the scene data of the preset scene, and determining a target vibrator from a plurality of vibrators according to the action direction so as to control the target vibrator to work according to the action direction and the action intensity based on a control mode corresponding to the action type. In this way, according to the action type of the operation action, the control mode of the vibrator can be determined, so that the target vibrator in the plurality of vibrators can be controlled to work according to the corresponding control mode, the touch sense of directivity generated by the head-mounted display device can be accurately controlled, and the touch sense brought by the operation action in the real scene can be simulated, so that the user immersion experience can be brought to the application scene of the head-mounted device. In addition, the embodiment has simple structure and low cost.
< Method example >
Fig. 7 is a flowchart showing a control method of a head mounted display device according to an embodiment of the present disclosure, which is applied to the head mounted display device described in the above embodiment, including a plurality of vibrators each of which is vibratable in a preset direction. As shown in fig. 7, the method for controlling the head-mounted display device provided in this embodiment may include the following steps S7100 to S7300.
Step S7100, in the case where the head-mounted display device runs a preset scene, determining, according to scene data of the preset scene, action information of an operation action performed by the second object on the first object, where the action information includes an action type, an action direction and an action intensity.
In this embodiment, the preset scene may be a shooting game scene, a boxing-type game scene, or the like. For example, a First person shooter-like game (FPS) scenario.
The first object is a virtual object corresponding to a wearer (user) of the head-mounted display device in a preset scene. The second object is different from the first object. The second object is a virtual object except the first object in the preset scene. The second object may be a different type of subject than the first object. The second object may be, for example, another character of a shooting game scene. The operation action performed by the second object on the first object may be an operation action issued by the second object to the first object. For example, for a shooting game scene, the operational action performed by the second object on the first object may be a shooting action performed by the second object on the first object, and for a boxing-type game scene, the operational action performed by the second object on the first object may be a striking action performed by the second object on the first object.
The action information of the operation action performed by the second object on the first object may include an action type, an action direction, and an action intensity. Taking a shooting game scene as an example, the action types may be classified into a first type and a second type, wherein the first type is a penetrating type, i.e., a bullet penetrates the head of the first object, and the second type is an unperforating type, i.e., a bullet does not penetrate the head of the first object. The direction of action may be a firing direction, e.g., frontal, non-frontal, etc. The action intensity may be, for example, the intensity of a shooting action or the intensity of a boxing action.
The scene data of the preset scene may include attribute information of the first object, and operation action data of an operation action performed on the first object by the second object. Taking shooting action as an example, the attribute information of the first object may comprise, for example, blood volume of the first object, and the operational action data may comprise aiming data, gun data. From the aiming data of the firing action, the action direction of the operational action can be determined. From the blood volume of the first subject and the firearm data, a type of action and an intensity of action of the operation action can be determined.
Step S7200, determining a target vibrator from the plurality of vibrators according to the action direction.
The target vibrator is a vibrator that is vibratable in an action direction among the plurality of vibrators. The target vibrator may be one or a plurality of target vibrators. In a specific implementation, after determining the action direction of the operation action performed by the second object on the first object, the vibration direction that each of the plurality of vibrators can generate may be compared with the action direction, and the vibrator that can vibrate in the action direction may be regarded as the target vibrator. A specific example will be described below.
In one embodiment, the determining the target vibrator from the plurality of vibrators according to the action direction may further include determining a vibrator located in the first direction from the plurality of vibrators as the target vibrator if the action direction is a first direction, wherein the first direction is a vibration direction generated by any one of the plurality of vibrators.
In this embodiment, the first direction is a vibration direction generated by any one of the plurality of vibrators. When the operation direction of the operation performed by the second object on the first object is the first direction, it is described that the vibration direction which can be generated by any one or more of the plurality of vibrators coincides with the operation direction of the operation performed by the second object on the first object, and the vibrator which coincides with the operation direction of the operation performed by the second object on the first object can be regarded as the target vibrator. The case where the direction of action is the first direction may be, for example, that the second object shoots the first object from the front side, or may be, for example, that the second object shoots the first object from the right rear side of the first object, or may be, for example, that the second object shoots the first object from the right side of the first object.
In an alternative embodiment, the head-mounted display device comprises two first vibrators oppositely arranged along a first preset direction and two second vibrators oppositely arranged along a second preset direction, wherein the first preset direction is perpendicular to the second preset direction, the target vibrators are determined from the plurality of vibrators according to the action direction, the two first vibrators are determined to be target vibrators when the action direction is the first preset direction, the first target vibrators are vibrators close to the second object in the two first vibrators, the second target vibrators are vibrators away from the second object in the two first vibrators, and the two second vibrators are determined to be target vibrators when the action direction is the second preset direction, wherein the first target vibrators are the second vibrators close to the second object in the two second vibrators, and the second target vibrators are determined to be target vibrators when the action direction is the second preset direction.
For example, please refer to fig. 5, which is a top view of a shooting game scene provided by an embodiment of the present disclosure. Specifically, as shown in fig. 5, four vibrators, that is, a vibrator 12a, a vibrator 12b, a vibrator 12c, and a vibrator 12d are provided in the head-mounted display device, wherein the vibrator 12a and the vibrator 12b are disposed opposite to each other in a first preset direction (N axis), and the vibrator 12a and the vibrator 12b can vibrate back and forth in the first preset direction (N axis), the vibrator 12c and the vibrator 12d are disposed opposite to each other in a second preset direction (M axis), and the vibrator 12c and the vibrator 12d can vibrate left and right in the second preset direction (M axis). The operation performed by the second object on the first object acts as a shooting action, and the shooting direction (arrow shown in the figure) is directed toward the front of the first object (wearer of the head-mounted display device), according to which the vibrator 12a and the vibrator 12b can be regarded as target vibrators. Wherein the first target vibrator is a vibrator 12a near the second object and the second target vibrator is a vibrator 12b near the second object.
In one embodiment, the determining the target vibrator from the plurality of vibrators according to the motion direction may further include determining a vibrator corresponding to a second direction from the plurality of vibrators as a target vibrator if the motion direction is the second direction, wherein the second direction is different from the first direction.
In the present embodiment, the second direction is different from the first direction, that is, there is no vibrator among the plurality of vibrators that coincides with the action direction of the operation action performed by the second object on the first object. The case where the operation direction is the second direction, that is, the case other than the operation direction is the first direction. For example, the second object fires the first object from a non-front face. In the case where the action direction of the operation action performed by the second object on the first object is the second direction, the target vibrator may be determined according to an angle between the action direction and a vibration direction that can be generated by each of the plurality of vibrators.
In another optional embodiment, the head-mounted display device comprises two first vibrators arranged oppositely along a first preset direction and two second vibrators arranged oppositely along a second preset direction, wherein the first preset direction is perpendicular to the second preset direction, the target vibrators are determined from the plurality of vibrators according to the action direction, and the method can further comprise determining the two first vibrators and the two second vibrators as target vibrators when the action direction is inconsistent with the first preset direction and the action direction is inconsistent with the second preset direction, wherein the first target vibrator comprises one vibrator close to the second object of the two first vibrators and one vibrator close to the second object of the two second vibrators, and the second target vibrator comprises one vibrator away from the second object of the two first vibrators and one vibrator away from the second object of the two second vibrators.
For example, please refer to fig. 6, which is a top view of a shooting game scene provided by an embodiment of the present disclosure. Specifically, as shown in fig. 6, four vibrators, that is, a vibrator 12a, a vibrator 12b, a vibrator 12c, and a vibrator 12d are provided in the head-mounted display device, wherein the vibrator 12a and the vibrator 12b are disposed opposite to each other in a first preset direction (N axis), and the vibrator 12a and the vibrator 12b can vibrate back and forth in the first preset direction (N axis), the vibrator 12c and the vibrator 12d are disposed opposite to each other in a second preset direction (M axis), and the vibrator 12c and the vibrator 12d can vibrate back and forth in the second preset direction (M axis). The operation performed by the second object on the first object acts as a shooting action, the shooting position of the shooting action being the front right (lower left side in the screen) of the first object (wearer of the head-mounted display device), the shooting direction (arrow as shown in the figure) being toward the rear left (upper right side in the screen) of the first object (wearer of the head-mounted display device). Since the angle between the shooting direction and the N axis is not 90 ° nor the angle between the shooting direction and the M axis is not 90 °, the vibrator 12a, the vibrator 12b, the vibrator 12c, and the vibrator 12d are all target vibrators. Wherein the first target vibrator is a vibrator including a vibrator 12a and a vibrator 12d near the second object, and the second target vibrator is a vibrator 12b and a vibrator 12c near the second object.
Taking the example that the head-mounted display device includes six vibrators, the head-mounted display device is provided with six vibrators, namely, vibrator 12a, vibrator 12b, vibrator 12c, vibrator 12d, vibrator 12e, and vibrator 12d. The vibrator 12a and the vibrator 12b are disposed along an N-axis (see fig. 1), and the vibrator 12a and the vibrator 12b may vibrate along the N-axis, the vibrator 12c and the vibrator 12d are disposed along an M-axis (see fig. 1), and the vibrator 12c and the vibrator 12d may vibrate along the M-axis, the vibrator 12e and the vibrator 12f are disposed along a Z-axis (not shown in the drawing), and the vibrator 12e and the vibrator 12f may vibrate along the Z-axis, wherein the Z-axis is a plane perpendicular to the N-axis and the M-axis. Assuming that the operation motion performed by the second object on the first object is a boxing motion, for example, the second object strikes the first object shot (wearer of the head-mounted display device) from the lower right, since the striking direction is not 90 ° with respect to the N axis, the striking direction is not 90 ° with respect to the M axis, and the striking direction is not 90 ° with respect to the Z axis, the vibrator 12a, the vibrator 12b, the vibrator 12c, the vibrator 12d, the vibrator 12e, and the vibrator 12f are all target vibrators.
In this embodiment, according to the motion direction, the target vibrator is determined from the plurality of vibrators, and by controlling the target vibrator to work, the head-mounted display device can be driven to vibrate along the corresponding direction, so as to bring immersive experience to the user.
After step 7200, step S7300 is performed to control the operation of the target vibrator according to the operation direction and the operation intensity based on the control method corresponding to the operation type.
In one embodiment, the controlling the target vibrator to work according to the motion direction and the motion intensity based on the control mode corresponding to the motion type may further include determining a vibration direction according to the motion direction, determining a vibration intensity according to the motion intensity, and controlling the target vibrator to vibrate in the vibration direction with the vibration intensity based on the control mode corresponding to the motion type.
In one embodiment, the determining the vibration direction according to the motion direction may further include determining the vibration direction according to an included angle between the motion direction and a set direction, where the set direction is a vibration direction generated by any one of the plurality of vibrators.
The set direction may be a direction in which the vibrator vibrates. The component of the action direction in the set direction can be determined according to the included angle between the action direction and the set direction, so that the vibration direction of the vibrator can be determined.
In the case where the head-mounted display device is provided with a plurality of vibrators that can vibrate in different directions, the set direction may include a direction in which each vibrator can generate vibration. For example, as shown in fig. 1, four vibrators, that is, vibrator 12a, vibrator 12b, vibrator 12c, vibrator 12d are provided in the head-mounted display device, wherein vibrator 12a and vibrator 12b can vibrate along the N-axis and vibrator 12c and vibrator 12d can vibrate along the M-axis. In this regard, the set direction may include an N-axis extending direction and an M-axis extending direction. The vibration direction of the target vibrator can be determined according to the included angle between the action direction and the set direction, namely the included angle between the action direction and the N axis and the included angle between the action direction and the M axis.
Taking the shooting scene shown in fig. 6 as an example, in the drawing, the f 0 vector is the action direction of the operation action, the included angle between the f 0 vector and the N axis is α, and the included angle between the f 0 vector and the M axis is β. From the angle α, the vibration directions of the vibrator 12a and the vibrator 12b can be determined. The vibration directions of the vibrator 12c and the vibrator 12d can be determined based on the angle β.
In this embodiment, the vibration direction of the target vibrator is determined according to the angle between the operation direction and the set direction, wherein the set direction is the vibration direction generated by any one vibrator of the plurality of vibrators. Therefore, the vibration direction can be accurately determined to control the corresponding target vibrator to work, so that the head-mounted display equipment is accurately controlled to generate directional shock feeling, and immersive experience is brought to a user.
In one embodiment, the determining the vibration intensity according to the motion intensity may further include determining the vibration intensity according to the motion intensity and an included angle between the motion direction and a set direction, wherein the set direction is a vibration direction generated by any one of the plurality of vibrators.
The action intensity may be, for example, the intensity of a shooting action or the intensity of a boxing action. Taking the firing event as an example, from the blood volume of the first subject and the firearm data, the action intensity of the operation event can be determined.
The smaller the angle between the operation direction and the setting direction, the larger the component of the operation direction in the setting direction, and the larger the vibration intensity of the target vibrator in the setting direction. The larger the angle between the operation direction and the setting direction is, the smaller the component of the operation direction in the setting direction is, and the smaller the vibration intensity of the target vibrator in the setting direction is. Based on this, the component of the operation direction in the set direction can be determined based on the angle between the operation direction and the set direction, and the vibration intensity of the target vibrator can be determined based on the component of the operation direction in the set direction and the operation intensity.
Taking the shooting scene shown in fig. 6 as an example, in the drawing, the f 0 vector is the action direction of the operation action, the included angle between the f 0 vector and the N axis is α, and the included angle between the f 0 vector and the M axis is β. From the angle α, the vibration direction and the vibration intensity of the vibrator 12a and the vibrator 12b can be determined. The vibration direction and the vibration intensity of the vibrator 12c and the vibrator 12d can be determined from the angle β. Specifically, the vibration intensities of the vibrator 12a and the vibrator 12b, that is, f n=f0 ×cos α, are determined according to the angle α, and the vibration intensities of the vibrator 12c and the vibrator 12d, that is, f m=f0 ×cos β, are determined according to the angle β, where f 0 is the action intensity of the operation action. Here, the direction and magnitude of the input voltage of the target vibrator may be controlled to control the vibration direction and the vibration intensity of the target vibrator.
In the embodiment, the vibration intensity is determined according to the action intensity, the included angle between the action direction and the set direction, wherein the set direction is the vibration direction generated by any vibrator in the plurality of vibrators. Therefore, the vibration intensity can be accurately determined to control the corresponding vibration unit to work, so that the head-mounted display equipment is accurately controlled to generate directional shock feeling, and the user experience is better.
In the present embodiment, the action types of the operation actions include a first type and a second type. Taking the shooting action as an example, the first type is a penetrating type, i.e. a bullet penetrates the head of the first object, and the second type is an unperforating type, i.e. a bullet does not penetrate the head of the first object. The type of action of the firing action may be determined from the blood volume of the first subject and the firearm data. According to different action types of the operation actions, the target vibrator can be controlled to vibrate in a corresponding control mode so as to simulate different types of operation actions, and therefore immersive experience is provided for a user. Specific examples are described below.
In one embodiment, the plurality of vibrators includes at least two target vibrators, and when the action type is a first type, the controlling the target vibrators to vibrate in the vibration direction with the vibration intensity based on the control mode corresponding to the action type includes sequentially triggering a first target vibrator and a second target vibrator to vibrate in the vibration direction with the vibration intensity.
The first target vibrator is a target vibrator close to the second object among the at least two target vibrators. The second target vibrator is a target vibrator of the at least two target vibrators facing away from the second object.
Continuing with the example of the shooting scene shown in fig. 5, the operation performed by the second object on the first object acts as a shooting action, with the shooting direction (arrow shown in the figure) being directed toward the front of the first object (wearer of the head-mounted display device). In this regard, the target vibrators include a vibrator 12a and a vibrator 12b, wherein the vibrator 12a is a first target vibrator and the vibrator 12b is a second target vibrator.
Continuing with the shooting scenario shown in fig. 6 as an example, the operation performed by the second object on the first object acts as a shooting action, the shooting position of the shooting action being the front right (lower left side in the screen) of the first object (wearer of the head-mounted display device), the shooting direction (arrow shown in the figure) being the rear left (upper right side in the screen) toward the first object (wearer of the head-mounted display device). In this regard, the target vibrators include a vibrator 12a, a vibrator 12b, a vibrator 12c, and a vibrator 12d, wherein the vibrator 12a and the vibrator 12d are first target vibrators, and the vibrator 12b and the vibrator 12c are second target vibrators.
In a more specific example, the sequentially triggering the first target vibrator and the second target vibrator to vibrate in the vibration direction with the vibration intensity may further include triggering the first target vibrator to vibrate in the vibration direction with the vibration intensity at a first time, triggering the second target vibrator to vibrate in the vibration direction with the vibration intensity at a second time, wherein the second time is later than the first time, and a time interval between the second time and the first time is a first delay time.
The first time is the time when the operation action is detected. Alternatively, the first time may be a time delayed by a predetermined length after the time at which the operation action is detected.
In the specific implementation, when the operation action of the second object on the first object is detected, the target vibrators are determined according to the action direction of the operation action, the first target vibrators close to the second object in the target vibrators are controlled to vibrate in the vibration direction, timing is started at the moment of triggering the first target vibrators to work, and when the second moment is reached, the second target vibrators away from the second object in the target vibrators are controlled to vibrate in the vibration direction. It should be noted that the first delay time may be set according to practical experience, for example, the first delay time is 1ms, which is not limited in the embodiment of the present disclosure.
Continuing with the shooting scenario shown in fig. 5 as an example, in the case where the type of action of the operation action performed by the second object on the first object is the first type, when the operation action is detected, a forward voltage is input to the vibrator 12a to trigger the vibrator 12a to vibrate rearward of the first object in the N-axis direction, and the first delay time is delayed, that is, when the second time is reached, a forward voltage is input to the vibrator 12b to trigger the vibrator 12b to vibrate rearward of the first object in the N-axis direction. In this way the effect of the bullet penetrating the head can be simulated.
Continuing with the shooting scenario shown in fig. 6 as an example, in the case where the action type of the operation action performed by the second object on the first object is the first type, upon detection of the operation action, that is, at the first timing, a forward voltage is input to the vibrator 12a to trigger vibration of the vibrator 12a in the rear (upper in the drawing) of the first object in the N-axis direction while a forward voltage is input to the vibrator 12d to trigger vibration of the vibrator 12d in the left (right in the drawing) of the first object in the M-axis direction, and upon reaching the second timing, that is, after delaying the first delay time, a forward voltage is input to the vibrator 12b to trigger vibration of the vibrator 12b in the rear (upper in the drawing) of the first object in the N-axis direction while a forward voltage is input to the vibrator 12c to trigger vibration of the vibrator 12c in the left (right in the drawing) of the first object in the M-axis direction. Here, the direction and intensity of the vibration of the target vibrator can be controlled by controlling the direction and magnitude of the input voltage of the target vibrator
In this embodiment, when the action type is the first type, the first target vibrator is triggered to vibrate in the vibration direction with the vibration intensity at the first moment, and the second target vibrator is triggered to vibrate in the vibration direction with the vibration intensity at the second moment, so that the vibrator can be triggered to vibrate in a corresponding control mode according to the action type of the operation action in the preset scene, the touch feeling brought by the operation action in the actual scene can be truly simulated, and the immersive experience is brought to the user.
In another more specific example, the plurality of vibrators includes at least two target vibrators, and in the case that the action type is a second type, the controlling the target vibrators to vibrate in the vibration direction based on the control mode corresponding to the action type may further include triggering a first target vibrator and a second target vibrator to vibrate in the vibration direction at the vibration intensity at the same time, wherein the first target vibrator is a target vibrator close to the second object from among the at least two target vibrators, and the second target vibrator is a target vibrator away from the second object from among the at least two target vibrators.
In the specific implementation, under the condition that the operation action of the second object on the first object is detected, the target vibrator is determined according to the action direction of the operation action, and meanwhile, the first target vibrator close to the second object and the second target vibrator far away from the second object in the target vibrator are triggered to vibrate along the vibration direction.
Continuing with the shooting scenario shown in fig. 5 as an example, in the case where the action type of the operation action performed by the second object on the first object is the second type, when the operation action is detected, the vibrator 12a and the vibrator 12b are simultaneously triggered to vibrate rearward of the first object in the N-axis direction, so that the effect of penetrating the bullet through the head can be simulated.
Continuing with the shooting scenario shown in fig. 6 as an example, in the case where the action type of the operation action performed by the second object on the first object is the second type, when the operation action is detected, the vibrator 12a and the vibrator 12b are simultaneously triggered to vibrate in the rear (upper in the drawing) of the first object in the N-axis direction, and the vibrator 12c and the vibrator 12d are triggered to vibrate in the left (right in the drawing) of the first object in the M-axis direction, so that the effect of penetrating the head of the bullet can be simulated.
In this embodiment, under the condition that the action type is the second type, the first target vibrator and the second target vibrator are triggered to vibrate along the vibration direction at the same time, so that the vibrator can be triggered to vibrate in a corresponding control mode according to the action type of the operation action in the preset scene, the touch feeling caused by the operation action in the actual scene can be simulated truly, and the user is immersed.
According to the embodiment of the disclosure, when the head-mounted display device runs a preset scene, according to scene data of the preset scene, determining an action type, an action direction and action intensity of an operation action performed by a second object on a first object, and according to the action direction, determining a target vibrator from a plurality of vibrators, so as to control the target vibrator to work according to the action direction and the action intensity based on a control mode corresponding to the action type. In this way, according to the action type of the operation action, the control mode of the vibrator can be determined, so that the target vibrator in the plurality of vibrators can be controlled to work according to the corresponding control mode, the touch sense of directivity generated by the head-mounted display device can be accurately controlled, and the touch sense brought by the operation action in the real scene can be simulated, so that the user immersion experience can be brought to the application scene of the head-mounted device. In addition, the embodiment has simple structure and low cost.
< Device example >
The present disclosure provides a control apparatus of a head-mounted display device, which is applied to the head-mounted display device described in the above embodiments, the head-mounted display device including a plurality of vibrators each of which is vibratable in a preset direction. As shown in fig. 8, the control apparatus 800 of the head-mounted display device may include a first determining module 810, a second determining module 820, and a control module 830.
The first determining module 810 is configured to determine, when the head-mounted display device runs a preset scene, action information of an operation action performed by a second object on a first object according to scene data of the preset scene, where the action information includes an action type, an action direction and an action intensity;
The second determining module 820 is configured to determine a target vibrator from the plurality of vibrators according to the motion direction;
The control module 830 is configured to control the target vibrator to work according to the motion direction and the motion strength based on a control manner corresponding to the motion type;
the first object is a virtual object corresponding to a wearer of the head-mounted display device in the preset scene, and the second object is a virtual object except the first object in the preset scene.
In one embodiment, the control module 830 includes:
A first determining unit configured to determine a vibration direction according to the motion direction;
A second determining unit for determining a vibration intensity according to the action intensity;
And the control unit is used for controlling the target vibrator to vibrate along the vibration direction according to the vibration intensity based on the control mode corresponding to the action type.
In one embodiment, the plurality of vibrators includes at least two target vibrators, and the control unit is specifically configured to trigger a first target vibrator and a second target vibrator to vibrate along the vibration direction with the vibration intensity in sequence when the action type is a first type, wherein the first target vibrator is a target vibrator of the at least two target vibrators, which is close to the second object, and the second target vibrator is a target vibrator of the at least two target vibrators, which is away from the second object.
In one embodiment, the sequentially triggering the first target vibrator and the second target vibrator to vibrate in the vibration direction at the vibration intensity includes:
Triggering the first target vibrator to vibrate in the vibration direction at the vibration intensity at a first moment;
triggering the second target vibrator to vibrate in the vibration direction at the vibration intensity at a second moment;
the second time is later than the first time, and the time interval between the second time and the first time is a first time delay duration.
In one embodiment, the plurality of vibrators includes at least two target vibrators, and the control unit is specifically configured to trigger a first target vibrator and a second target vibrator to vibrate along the vibration direction at the vibration intensity at the same time when the action type is a second type, wherein the first target vibrator is a target vibrator of the at least two target vibrators, which is close to the second object, and the second target vibrator is a target vibrator of the at least two target vibrators, which is away from the second object.
In one embodiment, the second determining module 820 includes:
A third determining unit configured to determine, as a target vibrator, a vibrator located in the first direction among the plurality of vibrators, in a case where the action direction is the first direction;
A fourth determining unit configured to determine, as a target vibrator, a vibrator corresponding to a second direction among the plurality of vibrators, in a case where the action direction is the second direction;
The first direction is a vibration direction generated by any vibrator in the plurality of vibrators, and the second direction is different from the first direction.
In one embodiment, the head-mounted display device comprises two first vibrators disposed opposite to each other along a first preset direction and two second vibrators disposed opposite to each other along a second preset direction, wherein the first preset direction is perpendicular to the second preset direction, and the second determining module 820 is specifically configured to:
Determining the two first vibrators as target vibrators when the action direction is the first preset direction, wherein the first target vibrators are vibrators close to the second object in the two first vibrators, and the second target vibrators are vibrators deviating from the second object in the two first vibrators;
And determining the two second vibrators as target vibrators when the action direction is the second preset direction, wherein the first target vibrator is a vibrator, close to the second object, of the two second vibrators, and the second target vibrator is a vibrator, away from the second object, of the two second vibrators.
In one embodiment, the head-mounted display device comprises two first vibrators disposed opposite to each other along a first preset direction and two second vibrators disposed opposite to each other along a second preset direction, wherein the first preset direction is perpendicular to the second preset direction, and the second determining module 820 is specifically configured to:
determining the two first vibrators and the two second vibrators as target vibrators when the action direction is inconsistent with the first preset direction and the action direction is inconsistent with the second preset direction;
wherein the first target vibrator includes a vibrator of the two first vibrators that is close to the second object and a vibrator of the two second vibrators that is close to the second object;
The second target vibrator includes a vibrator of the two first vibrators facing away from the second object and a vibrator of the two second vibrators facing away from the second object.
In one embodiment, the first determining unit is specifically configured to determine a vibration direction according to an included angle between the motion direction and a set direction, where the set direction is a vibration direction generated by any one of the plurality of vibrators.
In one embodiment, the second determining unit is specifically configured to determine the vibration intensity according to the action intensity and an included angle between the action direction and a set direction, where the set direction is a vibration direction generated by any one of the plurality of vibrators.
The disclosed embodiments also provide a head mounted display device, as shown in fig. 9, the head mounted display device 900 may include a memory 910 and a processor 920.
The memory 910 may be used to store executable computer instructions.
The processor 920 may be configured to perform a method for controlling a head-mounted display device according to an embodiment of the method of the present disclosure according to control of the executable computer instructions.
In one embodiment, the modules of the control apparatus 800 of the head mounted display device above may be implemented by the processor 920 executing computer instructions stored in the memory 910.
According to the embodiment of the disclosure, when the head-mounted display device runs a preset scene, according to scene data of the preset scene, determining an action type, an action direction and action intensity of an operation action performed by a second object on a first object, and according to the action direction, determining a target vibrator from a plurality of vibrators, so as to control the target vibrator to work according to the action direction and the action intensity based on a control mode corresponding to the action type. In this way, according to the action type of the operation action, the control mode of the vibrator can be determined, so that the target vibrator in the plurality of vibrators can be controlled to work according to the corresponding control mode, the touch sense of directivity generated by the head-mounted display device can be accurately controlled, and the touch sense brought by the operation action in the real scene can be simulated, so that the user immersion experience can be brought to the application scene of the head-mounted device. In addition, the embodiment has simple structure and low cost.
< Computer-readable storage Medium >
The embodiments of the present disclosure also provide a computer-readable storage medium having stored thereon computer instructions that, when executed by a processor, perform the method for controlling the head mounted display device provided by the embodiments of the present disclosure.
Embodiments of the present disclosure may be a system, method, and/or computer program product. The computer program product may include a computer readable storage medium having computer readable program instructions embodied thereon for causing a processor to implement aspects of embodiments of the present disclosure.
The computer readable storage medium may be a tangible device that can hold and store instructions for use by an instruction execution device. The computer readable storage medium may be, for example, but not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium include a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a Static Random Access Memory (SRAM), a portable compact disc read-only memory (CD-ROM), a Digital Versatile Disc (DVD), a memory stick, a floppy disk, a mechanical encoding device, punch cards or intra-groove protrusion structures such as those having instructions stored thereon, and any suitable combination of the foregoing. Computer-readable storage media, as used herein, are not to be construed as transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., optical pulses through fiber optic cables), or electrical signals transmitted through wires.
The computer readable program instructions described herein may be downloaded from a computer readable storage medium to a respective computing/processing device or to an external computer or external storage device over a network, such as the internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmissions, wireless transmissions, routers, firewalls, switches, gateway computers and/or edge servers. The network interface card or network interface in each computing/processing device receives computer readable program instructions from the network and forwards the computer readable program instructions for storage in a computer readable storage medium in the respective computing/processing device.
The computer program instructions for carrying out operations of embodiments of the present disclosure may be assembly instructions, instruction Set Architecture (ISA) instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source or object code written in any combination of one or more programming languages, including an object oriented programming language such as SMALLTALK, C ++ or the like and conventional procedural programming languages, such as the "C" language or similar programming languages. The computer readable program instructions may be executed entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider). In some embodiments, aspects of embodiments of the present disclosure are implemented by personalizing electronic circuitry, such as programmable logic circuitry, field Programmable Gate Arrays (FPGAs), or Programmable Logic Arrays (PLAs), with state information of computer readable program instructions, which may execute the computer readable program instructions.
Various aspects of embodiments of the present disclosure are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the disclosure. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer-readable program instructions.
These computer readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer readable program instructions may also be stored in a computer readable storage medium that can direct a computer, programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer readable medium having the instructions stored therein includes an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.
The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer, other programmable apparatus or other devices implement the functions/acts specified in the flowchart and/or block diagram block or blocks.
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions. It is well known to those skilled in the art that implementation by hardware, implementation by software, and implementation by a combination of software and hardware are all equivalent.
The foregoing description of the embodiments of the present disclosure has been presented for purposes of illustration and description, and is not intended to be exhaustive or limited to the embodiments disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the various embodiments described. The terminology used herein was chosen in order to best explain the principles of the embodiments, the practical application, or the technical improvement in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein. The scope of the embodiments of the present disclosure is defined by the appended claims.

Claims (11)

1. A control method of a head-mounted display device, the head-mounted display device including a plurality of vibrators each vibratable in a preset direction, the method comprising:
Under the condition that the head-mounted display device runs a preset scene, determining action information of an operation action executed by a second object on a first object according to scene data of the preset scene, wherein the action information comprises action types, action directions and action intensities;
determining a target vibrator from the plurality of vibrators according to the action direction;
Controlling the target vibrator to work according to the action direction and the action intensity based on a control mode corresponding to the action type;
the first object is a virtual object corresponding to a wearer of the head-mounted display device in the preset scene, and the second object is different from the first object;
The controlling the target vibrator to work according to the action direction and the action intensity based on the control mode corresponding to the action type comprises the following steps:
determining a vibration direction according to the action direction;
determining vibration intensity according to the action intensity;
Based on a control mode corresponding to the action type, controlling the target vibrator to vibrate along the vibration direction with the vibration intensity so as to control the head-mounted display equipment to generate directional shock;
The determining the vibration direction according to the action direction comprises the following steps:
Determining a vibration direction according to the included angle between the action direction and the set direction;
wherein the set direction is a vibration direction generated by any one of the plurality of vibrators.
2. The method according to claim 1, wherein at least two target vibrators are included in the plurality of vibrators, and wherein in a case where the action type is a first type, the controlling the target vibrators to vibrate in the vibration direction with the vibration intensity based on the control manner corresponding to the action type includes:
Sequentially triggering a first target vibrator and a second target vibrator to vibrate along the vibration direction at the vibration intensity;
the first target vibrator is a target vibrator, close to the second object, of the at least two target vibrators, and the second target vibrator is a target vibrator, away from the second object, of the at least two target vibrators.
3. The method of claim 2, wherein sequentially triggering the first and second target vibrators to vibrate in the vibration direction at the vibration intensity comprises:
Triggering the first target vibrator to vibrate in the vibration direction at the vibration intensity at a first moment;
triggering the second target vibrator to vibrate in the vibration direction at the vibration intensity at a second moment;
the second time is later than the first time, and the time interval between the second time and the first time is a first time delay duration.
4. The method according to claim 1, wherein at least two target vibrators are included in the plurality of vibrators, and wherein in a case where the action type is a second type, the controlling the target vibrators to vibrate in the vibration direction with the vibration intensity based on the control manner corresponding to the action type includes:
Simultaneously triggering a first target vibrator and a second target vibrator to vibrate along the vibration direction at the vibration intensity;
the first target vibrator is a target vibrator, close to the second object, of the at least two target vibrators, and the second target vibrator is a target vibrator, away from the second object, of the at least two target vibrators.
5. The method of claim 1, wherein the determining a target vibrator from the plurality of vibrators based on the action direction comprises:
determining a vibrator located in the first direction among the plurality of vibrators as a target vibrator when the operation direction is the first direction;
when the operation direction is a second direction, determining a vibrator corresponding to the second direction among the plurality of vibrators as a target vibrator;
The first direction is a vibration direction generated by any vibrator in the plurality of vibrators, and the second direction is different from the first direction.
6. The method of any of claims 2-4, wherein the head mounted display device comprises two first vibrators disposed opposite in a first preset direction and two second vibrators disposed opposite in a second preset direction, wherein the first preset direction is perpendicular to the second preset direction, wherein the determining a target vibrator from the plurality of vibrators based on the action direction comprises:
Determining the two first vibrators as target vibrators when the action direction is the first preset direction, wherein the first target vibrators are vibrators close to the second object in the two first vibrators, and the second target vibrators are vibrators deviating from the second object in the two first vibrators;
And determining the two second vibrators as target vibrators when the action direction is the second preset direction, wherein the first target vibrator is a vibrator, close to the second object, of the two second vibrators, and the second target vibrator is a vibrator, away from the second object, of the two second vibrators.
7. The method of any of claims 2-4, wherein the head mounted display device comprises two first vibrators disposed opposite in a first preset direction and two second vibrators disposed opposite in a second preset direction, wherein the first preset direction is perpendicular to the second preset direction, wherein the determining a target vibrator from the plurality of vibrators based on the action direction comprises:
determining the two first vibrators and the two second vibrators as target vibrators when the action direction is inconsistent with the first preset direction and the action direction is inconsistent with the second preset direction;
wherein the first target vibrator includes a vibrator of the two first vibrators that is close to the second object and a vibrator of the two second vibrators that is close to the second object;
The second target vibrator includes a vibrator of the two first vibrators facing away from the second object and a vibrator of the two second vibrators facing away from the second object.
8. The method of claim 1, wherein determining the vibration intensity from the motion intensity comprises:
determining vibration intensity according to the action intensity and the included angle between the action direction and the set direction;
wherein the set direction is a vibration direction generated by any one of the plurality of vibrators.
9. A control apparatus of a head-mounted display device, the head-mounted display device including a plurality of vibrators each vibratable in a preset direction, the apparatus comprising:
The first determining module is used for determining action information of an operation action executed by the second object on the first object according to scene data of a preset scene when the head-mounted display device runs the preset scene, wherein the action information comprises action types, action directions and action intensities;
A second determining module for determining a target vibrator from the plurality of vibrators according to the action direction;
the control module is used for determining a vibration direction according to the included angle between the action direction and the set direction, determining a vibration intensity according to the action intensity, and controlling the target vibrator to vibrate along the vibration direction with the vibration intensity based on a control mode corresponding to the action type so as to control the head-mounted display equipment to generate directional shock;
Wherein the set direction is a vibration direction generated by any one of the plurality of vibrators;
The first object is a virtual object corresponding to a wearer of the head-mounted display device in the preset scene, and the second object is different from the first object.
10. A head-mounted display device, comprising:
A memory for storing executable computer instructions;
a processor for executing the control method of the head mounted display device according to any one of claims 1-8, according to control of the executable computer instructions.
11. A computer readable storage medium having stored thereon computer instructions which, when executed by a processor, perform the method of controlling a head mounted display device of any of claims 1-8.
CN202210593383.2A 2022-05-27 2022-05-27 Control method, device and equipment of head-mounted display equipment and readable storage medium Active CN115268625B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210593383.2A CN115268625B (en) 2022-05-27 2022-05-27 Control method, device and equipment of head-mounted display equipment and readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210593383.2A CN115268625B (en) 2022-05-27 2022-05-27 Control method, device and equipment of head-mounted display equipment and readable storage medium

Publications (2)

Publication Number Publication Date
CN115268625A CN115268625A (en) 2022-11-01
CN115268625B true CN115268625B (en) 2026-01-23

Family

ID=83759934

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210593383.2A Active CN115268625B (en) 2022-05-27 2022-05-27 Control method, device and equipment of head-mounted display equipment and readable storage medium

Country Status (1)

Country Link
CN (1) CN115268625B (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN206312069U (en) * 2016-08-31 2017-07-07 董光磊 Wearable intelligent apparatus and intelligence system
CN107111340A (en) * 2014-12-29 2017-08-29 索尼互动娱乐美国有限责任公司 Method and system for user interaction within a virtual or augmented reality scene using a head mounted display
CN109364471A (en) * 2018-12-12 2019-02-22 歌尔科技有限公司 a VR system
CN110850980A (en) * 2019-11-07 2020-02-28 网易（杭州）网络有限公司 Mobile terminal control method, mobile terminal and storage medium

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113467617B (en) * 2021-07-15 2024-05-07 北京京东方光电科技有限公司 Haptic feedback method, device, apparatus and storage medium

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107111340A (en) * 2014-12-29 2017-08-29 索尼互动娱乐美国有限责任公司 Method and system for user interaction within a virtual or augmented reality scene using a head mounted display
CN206312069U (en) * 2016-08-31 2017-07-07 董光磊 Wearable intelligent apparatus and intelligence system
CN109364471A (en) * 2018-12-12 2019-02-22 歌尔科技有限公司 a VR system
CN110850980A (en) * 2019-11-07 2020-02-28 网易（杭州）网络有限公司 Mobile terminal control method, mobile terminal and storage medium

Also Published As

Publication number Publication date
CN115268625A (en) 2022-11-01

Similar Documents

Publication Publication Date Title
JP6872613B2 (en) Detection of session termination in augmented reality and / or virtual reality environments
US10238976B2 (en) Location-based experience with interactive merchandise
CN103959344B (en) The augmented reality crossing over multiple equipment represents
KR101857946B1 (en) Generating a screenshot
US10504295B2 (en) Systems and methods for using sensing of real object position, trajectory, or attitude to enable user interaction with a virtual object
CN109254650B (en) Man-machine interaction method and device
US20170329503A1 (en) Editing animations using a virtual reality controller
JP7278037B2 (en) Coding and rendering system for haptic effects
JP2017526030A (en) Method and system for providing interaction within a virtual environment
CN103246346A (en) Apparatus and method for controlling vibration transfer between vibration devices
CN107211117A (en) The second eyes viewport is synthesized using interweaving
CN106598246B (en) Interaction control method and device based on virtual reality
US10546431B2 (en) Systems and methods to augment an appearance of physical object for an augmented reality experience
CN104656877A (en) Human-machine interaction method based on gesture and speech recognition control as well as apparatus and application of human-machine interaction method
US10534082B2 (en) Accessibility of virtual environments via echolocation
WO2017071385A1 (en) Method and device for controlling target object in virtual reality scenario
EP3470960A1 (en) Haptic effects with multiple peripheral devices
CN108965989A (en) A kind for the treatment of method and apparatus and storage medium of interactive application scene
CN115268625B (en) Control method, device and equipment of head-mounted display equipment and readable storage medium
CN113827975B (en) Shooting animation processing method, device, terminal and storage medium
CN115604499A (en) Method and device for gift control in live broadcast room, electronic device and storage medium
US10546425B2 (en) Real physical objects interacting with augmented reality features
CN105892680A (en) Interactive equipment control method and device based on virtual reality helmet
CN115607966A (en) Information processing method, device, storage medium and electronic device in game
JP2019063378A (en) Program, system, and method for providing a game

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant