[go: up one dir, main page]

CN114546118A - A safety prompting method, device, medium and device based on VR technology - Google Patents

A safety prompting method, device, medium and device based on VR technology Download PDF

Info

Publication number
CN114546118A
CN114546118A CN202210159384.6A CN202210159384A CN114546118A CN 114546118 A CN114546118 A CN 114546118A CN 202210159384 A CN202210159384 A CN 202210159384A CN 114546118 A CN114546118 A CN 114546118A
Authority
CN
China
Prior art keywords
virtual
virtual scene
user
prompt
determining
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202210159384.6A
Other languages
Chinese (zh)
Other versions
CN114546118B (en
Inventor
芦佳硕
王光华
曹磊
张彪
侯骁
葛飞
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
State Grid Corp of China SGCC
Baoding Power Supply Co of State Grid Hebei Electric Power Co Ltd
Original Assignee
State Grid Corp of China SGCC
Baoding Power Supply Co of State Grid Hebei Electric Power Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by State Grid Corp of China SGCC, Baoding Power Supply Co of State Grid Hebei Electric Power Co Ltd filed Critical State Grid Corp of China SGCC
Priority to CN202210159384.6A priority Critical patent/CN114546118B/en
Publication of CN114546118A publication Critical patent/CN114546118A/en
Application granted granted Critical
Publication of CN114546118B publication Critical patent/CN114546118B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016Input arrangements with force or tactile feedback as computer generated output to the user
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The application provides a safety prompt method, a safety prompt device, a safety prompt medium and safety prompt equipment based on a VR technology, wherein the method comprises the following steps: the method comprises the steps of obtaining a pupil image of a user, determining a virtual scene according to the pupil image, responding to an operation instruction input by the user in the virtual scene, determining a target position corresponding to the operation instruction from a preset library, calling a controllable virtual device corresponding to the target position, and generating prompt information to prompt the user to perform corresponding operation according to the prompt information if the virtual device is triggered and is not operated within a preset time period. The first target position corresponding to the operation instruction is determined through the operation instruction input by the user in the virtual scene, and then the controllable virtual equipment is called, so that the operator can control the virtual equipment in the virtual scene, and when the operator conducts misoperation or does not operate for a long time on the virtual scene, a correct operation flow can be properly provided.

Description

一种基于VR技术的安全提示方法、装置、介质以及设备A safety prompting method, device, medium and device based on VR technology

技术领域technical field

本申请涉及安全作业技术领域,具体涉及一种基于VR技术的安全提示方法、装置、介质以及设备。The present application relates to the technical field of safe operation, and in particular to a safety prompting method, device, medium and device based on VR technology.

背景技术Background technique

目前,随着技术的发展和进步,通过VR虚拟现实技术可以还原真实场景,以使用户可以身临其境在虚拟场景中体验真实场景。例如夏威夷海滩。VR虚拟现实被称为“信息空间”,“人工现实”,“合成环境“等,虚拟现实就是一种先进的计算机用户接口,它通过给用户同时提供诸如视、听、嗅、触等各种直观而又自然的实时感知交互手段、最大限度地方便用户的操作,从而提高整个系统的工作效率。关于虚拟现实的定义,可以简单地理解为:利用计算机生成的能给人多种感官刺激的人机交互系统。但是,对于在电力系统工作且毫无经验的作业人员,一旦在真实的电力系统现场中误操作,将会产生严重的危害,而现有技术中所构建的虚拟场景,仅显示场景,而作业人员在对虚拟场景进行操作时不提供操作流程提示信息。At present, with the development and progress of technology, the real scene can be restored through VR virtual reality technology, so that users can experience the real scene in the virtual scene. For example Hawaiian beaches. VR virtual reality is called "information space", "artificial reality", "synthetic environment", etc., virtual reality is an advanced computer user interface, which provides users with various functions such as sight, hearing, smell, touch, etc. Intuitive and natural real-time perception and interaction means to maximize user convenience, thereby improving the work efficiency of the entire system. The definition of virtual reality can be simply understood as: the use of computer-generated human-computer interaction systems that can stimulate a variety of senses. However, for the inexperienced operators who work in the power system, once they misuse the real power system, it will cause serious harm. The virtual scene constructed in the prior art only displays the scene, while the operation Personnel do not provide operation process prompt information when operating the virtual scene.

发明内容SUMMARY OF THE INVENTION

为了解决上述技术问题,提出了本申请。本申请的实施例提供了一种基于VR技术的安全提示方法、装置、介质以及设备,解决了作业人员在对虚拟场景进行操作时不提供操作流程提示信息的问题。In order to solve the above technical problems, the present application is made. The embodiments of the present application provide a safety prompting method, device, medium and device based on VR technology, which solves the problem that the operator does not provide prompt information of the operation process when operating the virtual scene.

根据本申请的一个方面,提供了一种基于VR技术的安全提示方法,包括:获取用户的瞳孔图像;根据所述瞳孔图像,确定虚拟场景;响应所述用户在所述虚拟场景中输入的操作指令;从所述预设库中确定与所述操作指令对应的第一目标位置;调取所述第一目标位置对应的可控制的虚拟设备;以及若在预设时间段内所述虚拟设备被触发且未按照目标规则进行操作,则生成提示信息以提示所述用户进行所述提示信息相应的操作。According to an aspect of the present application, a safety prompting method based on VR technology is provided, comprising: acquiring a pupil image of a user; determining a virtual scene according to the pupil image; responding to an operation input by the user in the virtual scene instruction; determine a first target position corresponding to the operation instruction from the preset library; call a controllable virtual device corresponding to the first target position; and if the virtual device is within a preset time period is triggered and the operation is not performed according to the target rule, generating prompt information to prompt the user to perform an operation corresponding to the prompt information.

在一实施例中,所述根据所述瞳孔图像,确定虚拟场景包括:确定所述瞳孔图像中的瞳孔位置;以及根据所述瞳孔位置,确定所述虚拟场景。In one embodiment, the determining the virtual scene according to the pupil image includes: determining a pupil position in the pupil image; and determining the virtual scene according to the pupil position.

在一实施例中,所述根据所述瞳孔位置,确定虚拟场景包括:获取所述瞳孔位置对应的中心坐标;以及根据所述中心坐标与预设坐标区间,确定所述虚拟场景。In one embodiment, the determining the virtual scene according to the pupil position includes: acquiring the center coordinate corresponding to the pupil position; and determining the virtual scene according to the center coordinate and a preset coordinate interval.

在一实施例中,所述预设坐标区间为第一预设坐标区间和第二预设坐标区间,所述第一预设坐标区间的方向以及所述第二预设坐标区间的方向为相反的坐标方向,其中,所述根据所述中心坐标与预设坐标区间,确定所述虚拟场景包括:若所述中心坐标在所述第一预设坐标区间内,则显示第一虚拟场景;其中,所述第一虚拟场景为虚拟的室内场景;以及若所述中心坐标在所述第二预设坐标区间内,则显示第二虚拟场景;其中,所述第二虚拟场景为虚拟的室外场景。In one embodiment, the preset coordinate interval is a first preset coordinate interval and a second preset coordinate interval, and the direction of the first preset coordinate interval and the direction of the second preset coordinate interval are opposite. where the determining the virtual scene according to the center coordinates and the preset coordinate interval includes: if the center coordinates are within the first preset coordinate interval, displaying the first virtual scene; wherein , the first virtual scene is a virtual indoor scene; and if the center coordinates are within the second preset coordinate interval, a second virtual scene is displayed; wherein, the second virtual scene is a virtual outdoor scene .

在一实施例中,所述虚拟设备包括线路设备,其中,所述调取所述第一目标位置对应的可控制的虚拟设备包括:调取所述第一目标位置对应的可控制的虚拟设备;其中,所述目标位置包括提示符号,所述提示符号指向所述虚拟设备。In an embodiment, the virtual device includes a line device, wherein the invoking the controllable virtual device corresponding to the first target position includes: invoking the controllable virtual device corresponding to the first target position. ; wherein, the target position includes a prompt symbol, and the prompt symbol points to the virtual device.

在一实施例中,基于VR技术的安全提示方法还包括:若接收到所述虚拟设备被错误操作的指令,则生成反馈信息;以及将所述反馈信息发送至交互设备中以使所述交互设备产生震动;其中,所述交互设备用于所述用户操作的设备。In one embodiment, the safety prompting method based on VR technology further includes: if an instruction that the virtual device is operated incorrectly is received, generating feedback information; and sending the feedback information to the interactive device to enable the interaction The device vibrates; wherein the interaction device is used for the device operated by the user.

在一实施例中,在所述生成反馈信息之后,基于VR技术的安全提示方法还包括:若所述虚拟设备被错误操作对应的危害程度大于或者等于预设危害程度阈值,则生成模拟动画以显示所述虚拟设备被错误操作产生的危害。In one embodiment, after the feedback information is generated, the safety prompting method based on VR technology further includes: if the harm degree corresponding to the wrong operation of the virtual device is greater than or equal to a preset harm degree threshold, generating a simulation animation to Displays the harm caused by the wrong operation of the virtual device.

根据本申请的另一个方面,提供了一种基于VR技术的安全提示装置,包括:获取模块,用于获取用户的瞳孔图像;虚拟场景确定模块,用于根据所述瞳孔图像,确定虚拟场景;响应模块,用于响应所述用户在所述虚拟场景中输入的操作指令;调取模块,用于调取所述目标位置对应的可控制的虚拟设备;以及生成模块,用于若在预设时间段内所述虚拟设备被触发且未进行被操作,则生成提示信息以提示所述用户按照所述提示信息进行相应的操作。According to another aspect of the present application, a safety prompting device based on VR technology is provided, comprising: an acquisition module for acquiring a pupil image of a user; a virtual scene determination module for determining a virtual scene according to the pupil image; a response module, used for responding to the operation instruction input by the user in the virtual scene; a calling module, used for calling the controllable virtual device corresponding to the target position; and a generating module, used for if preset If the virtual device is triggered and not operated within the time period, prompt information is generated to prompt the user to perform corresponding operations according to the prompt information.

根据本申请的另一个方面,提供了一种计算机可读存储介质,所述存储介质存储有计算机程序,所述计算机程序用于执行上述任一所述的基于VR技术的安全提示方法。According to another aspect of the present application, a computer-readable storage medium is provided, where a computer program is stored in the storage medium, and the computer program is used to execute any of the above VR technology-based security prompting methods.

根据本申请的另一个方面,提供了一种电子设备,所述电子设备包括:处理器;用于存储所述处理器可执行指令的存储器;所述处理器,用于执行上述任一所述的基于VR技术的安全提示方法。According to another aspect of the present application, an electronic device is provided, the electronic device comprising: a processor; a memory for storing instructions executable by the processor; the processor for executing any one of the above safety tips based on VR technology.

本申请提供的一种基于VR技术的安全提示方法、装置、介质以及设备,该方法包括:获取用户的瞳孔图像,根据瞳孔图像,确定虚拟场景,响应用户在虚拟场景中输入的操作指令,从预设库中确定与操作指令对应的目标位置,调取目标位置对应的可控制的虚拟设备,以及若在预设时间段内虚拟设备被触发且未进行被操作,则生成提示信息以提示用户按照提示信息进行相应的操作。通过用户在虚拟场景中输入的操作指令,以确定与操作指令对应的第一目标位置,然后调取可控制的虚拟设备,以使作业人员可以在虚拟场景中控制虚拟设备,当作业人员在对虚拟场景进行误操作或者长时间没有操作时可以适当的提供正确的操作流程。A safety prompting method, device, medium and device based on VR technology provided by the present application, the method includes: acquiring a pupil image of a user, determining a virtual scene according to the pupil image, responding to an operation instruction input by the user in the virtual scene, Determine the target position corresponding to the operation instruction in the preset library, call the controllable virtual device corresponding to the target position, and generate prompt information to prompt the user if the virtual device is triggered and not operated within the preset time period Follow the prompts to perform the corresponding operations. Through the operation instruction input by the user in the virtual scene, the first target position corresponding to the operation instruction is determined, and then the controllable virtual equipment is called, so that the operator can control the virtual equipment in the virtual scene. When the virtual scene is mis-operated or has not been operated for a long time, the correct operation process can be appropriately provided.

附图说明Description of drawings

通过结合附图对本申请实施例进行更详细的描述,本申请的上述以及其他目的、特征和优势将变得更加明显。附图用来提供对本申请实施例的进一步理解,并且构成说明书的一部分,与本申请实施例一起用于解释本申请,并不构成对本申请的限制。在附图中,相同的参考标号通常代表相同部件或步骤。The above and other objects, features and advantages of the present application will become more apparent from the detailed description of the embodiments of the present application in conjunction with the accompanying drawings. The accompanying drawings are used to provide a further understanding of the embodiments of the present application, constitute a part of the specification, and are used to explain the present application together with the embodiments of the present application, and do not constitute a limitation to the present application. In the drawings, the same reference numbers generally refer to the same components or steps.

图1是本申请一示例性实施例提供的基于VR技术的安全提示方法的流程示意图。FIG. 1 is a schematic flowchart of a VR technology-based security prompt method provided by an exemplary embodiment of the present application.

图2是本申请另一示例性实施例提供的基于VR技术的安全提示方法的流程示意图。FIG. 2 is a schematic flowchart of a safety prompt method based on VR technology provided by another exemplary embodiment of the present application.

图3是本申请另一示例性实施例提供的基于VR技术的安全提示方法的流程示意图。FIG. 3 is a schematic flowchart of a safety prompt method based on VR technology provided by another exemplary embodiment of the present application.

图4是本申请另一示例性实施例提供的基于VR技术的安全提示方法的流程示意图。FIG. 4 is a schematic flowchart of a safety prompt method based on VR technology provided by another exemplary embodiment of the present application.

图5是本申请另一示例性实施例提供的基于VR技术的安全提示方法的流程示意图。FIG. 5 is a schematic flowchart of a safety prompt method based on VR technology provided by another exemplary embodiment of the present application.

图6是本申请另一示例性实施例提供的基于VR技术的安全提示方法的流程示意图。FIG. 6 is a schematic flowchart of a safety prompt method based on VR technology provided by another exemplary embodiment of the present application.

图7是本申请一示例性实施例提供的基于VR技术的安全提示装置的结构示意图。FIG. 7 is a schematic structural diagram of a safety prompting device based on VR technology provided by an exemplary embodiment of the present application.

图8是本申请另一示例性实施例提供的基于VR技术的安全提示装置的结构示意图。FIG. 8 is a schematic structural diagram of a safety prompt device based on VR technology provided by another exemplary embodiment of the present application.

图9是本申请一示例性实施例提供的电子设备的结构图。FIG. 9 is a structural diagram of an electronic device provided by an exemplary embodiment of the present application.

具体实施方式Detailed ways

下面,将参考附图详细地描述根据本申请的示例实施例。显然,所描述的实施例仅仅是本申请的一部分实施例,而不是本申请的全部实施例,应理解,本申请不受这里描述的示例实施例的限制。Hereinafter, exemplary embodiments according to the present application will be described in detail with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments of the present application, and it should be understood that the present application is not limited by the example embodiments described herein.

图1是本申请一示例性实施例提供的基于VR技术的安全提示方法的流程示意图。如图1所示,基于VR技术的安全提示方法包括:FIG. 1 is a schematic flowchart of a VR technology-based security prompt method provided by an exemplary embodiment of the present application. As shown in Figure 1, the safety prompt methods based on VR technology include:

步骤110:获取用户的瞳孔图像。Step 110: Acquire a pupil image of the user.

可通过交互主机获取用户的瞳孔图像,交互主机可以带有显示器以及摄像头。摄像头可以拍摄用户的瞳孔图像。该摄像头也可以为左右摄像头,通过左右摄像头拍摄用户的瞳孔图像以得到左图像和右图像,并选取左图像做图像处理或者右图像做图像处理,以得到用户的瞳孔图像。The pupil image of the user can be obtained through the interactive host, and the interactive host can be provided with a display and a camera. The camera can take an image of the user's pupil. The camera can also be a left and right camera. The left and right cameras are used to capture the user's pupil images to obtain the left image and the right image, and the left image is selected for image processing or the right image is selected for image processing to obtain the user's pupil image.

步骤120:根据瞳孔图像,确定虚拟场景。Step 120: Determine a virtual scene according to the pupil image.

对瞳孔图像进行图像处理,得到新的瞳孔图像,根据瞳孔图像中瞳孔的位置或者坐标点确定虚拟场景。例如,检测用户的瞳孔在最左边或者靠近左手方向,那么相应的可获取到室内的虚拟场景。检测用户的瞳孔在最右边或者靠近右手方向,那么相应的可获取到室外的虚拟场景。Image processing is performed on the pupil image to obtain a new pupil image, and the virtual scene is determined according to the position or coordinate point of the pupil in the pupil image. For example, it is detected that the user's pupil is at the far left or close to the left hand direction, then correspondingly the indoor virtual scene can be acquired. It is detected that the user's pupil is at the far right or close to the right hand direction, then the outdoor virtual scene can be obtained accordingly.

步骤130:响应用户在虚拟场景中输入的操作指令。Step 130: Respond to the operation instruction input by the user in the virtual scene.

用户通过交互设备在虚拟场景中输入操作指令,该操作指令可以为行走指令,向目标方向转动指令等,其中交互设备可以为键盘、鼠标、手柄等。通过用户在交互设备上的操作,生成操作指令并输入到虚拟场景中。响应该操作指令以使交互设备的显示设备显示相应的动作。The user inputs an operation instruction in the virtual scene through an interactive device, and the operation instruction may be a walking instruction, an instruction to rotate in a target direction, etc., wherein the interactive device may be a keyboard, a mouse, a handle, and the like. Through the user's operation on the interactive device, the operation instruction is generated and input into the virtual scene. In response to the operation instruction, the display device of the interactive device displays the corresponding action.

步骤140:从预设库中确定与操作指令对应的目标位置。Step 140: Determine the target position corresponding to the operation instruction from the preset library.

可以设置预设库并存储多个目标位置以及多个位置对应的操作指令,例如,键盘上可设定预设数量个按键,每个按键对应一个目标位置,若获取到R按键被按的操作指令,则从预设库中可确定与R按键被按的操作指令对应的电气柜所在的位置,并在交互主机的显示设备上显示电气柜。A preset library can be set to store multiple target positions and operation instructions corresponding to multiple positions. For example, a preset number of keys can be set on the keyboard, and each key corresponds to a target position. If the operation of pressing the R key is obtained command, the position of the electrical cabinet corresponding to the operation command in which the R button is pressed can be determined from the preset library, and the electrical cabinet is displayed on the display device of the interactive host.

步骤150:调取目标位置对应的可控制的虚拟设备。Step 150: Invoke the controllable virtual device corresponding to the target location.

每个目标位置可对应虚拟设备或者虚拟物体,那么可调取目标位置对应的可控制的虚拟设备,其中可控制的虚拟设备可以为虚拟设备中的电线连接,故障电线拆除、整修故障主变,设备安装等。可调取虚拟设备对应的操作流程,并将操作流程中的第一个操作流程显示,待第一个操作流程用户操作成功之后,显示操作流程中的第二个操作流程。应当理解,该目标位置可以是虚拟场景中道路上的目标点,不仅仅局限于设备对应的目标位置。Each target position can correspond to a virtual device or a virtual object, then the controllable virtual device corresponding to the target position can be selected. The controllable virtual device can be the wire connection in the virtual device, the faulty wire is removed, and the faulty main transformer is repaired. equipment installation, etc. The operation flow corresponding to the virtual device can be retrieved, and the first operation flow in the operation flow is displayed. After the user operation of the first operation flow is successful, the second operation flow in the operation flow is displayed. It should be understood that the target position may be a target point on the road in the virtual scene, and is not limited to the target position corresponding to the device.

步骤160:若在预设时间段内虚拟设备被触发且未进行被操作,则生成提示信息以提示用户按照提示信息进行相应的操作。Step 160: If the virtual device is triggered and not operated within the preset time period, generate prompt information to prompt the user to perform corresponding operations according to the prompt information.

若在预设时间段内虚拟设备被触发且未按照目标流程(目标操作流程)进行操作,生成提示信息以提示用户按照提示信息进行相应的操作。例如,用户触发了虚拟设备(头盔),但是在3分钟之后并没有将头盔带上,因此会生成提示信息提示用户需要带上头盔,该带上头盔的指令可以通过用户操作键盘、鼠标、手柄等生成。还还例如,用户用手抓起双控背带式安全带,如未操作,将提醒请拿好双控背带式安全带。还例如,站在变压器横担上对高压侧低压侧进行挂地线。安全带挂钩应该挂在横担上(如未将挂钩挂在横担上,此时让员工有种高摔的感觉,并发出摔落的声音后提醒此时您已经违反安规,请及时务必将挂钩挂在横担上再继续操作)。拆除互感器,打开变压器低压侧刀闸,从引线上拆除旧的互感器,更换二次计量导线(此时模拟大风,让员工有高摔落的感觉,并语音提醒做台区计量装置更换请注意关注天气变化以免发生危险)。放置危险点安全措施文本,通过用户接口提醒签字确认,如未操作,将提醒操作前请做好危险点安全措施签字确认。提示信息也可带有语音提示功能,可通过语音提示用户,该语音提示包括错误操作,下一步操作,停止操作等。If the virtual device is triggered within the preset time period and does not operate according to the target process (target operation process), prompt information is generated to prompt the user to perform corresponding operations according to the prompt information. For example, the user triggers the virtual device (helmet), but does not put on the helmet after 3 minutes, so a prompt message is generated to prompt the user to put on the helmet. The instruction to put on the helmet can be operated by the user through the keyboard, mouse, handle etc. to generate. For another example, if the user grabs the dual-control harness-type seat belt by hand, if it is not operated, the user will be reminded to hold the dual-control harness-type seat belt. For another example, stand on the cross arm of the transformer and connect the ground wire to the low-voltage side of the high-voltage side. The seat belt hook should be hung on the cross-arm (if the hook is not hung on the cross-arm, the employee will feel a high fall at this time, and the sound of falling will remind you that you have violated the safety regulations at this time, please be sure to promptly Hang the hook on the crossbar before continuing). Remove the transformer, open the low-voltage side knife switch of the transformer, remove the old transformer from the lead, and replace the secondary metering wire (simulate a strong wind at this time, so that the employee feels a high fall, and a voice reminds you to replace the metering device in the table area. Pay attention to weather changes to avoid danger). Place the text of safety measures for dangerous points, and remind to sign and confirm through the user interface. The prompt information can also have a voice prompt function, which can prompt the user by voice, and the voice prompt includes wrong operation, next operation, stop operation, etc.

本申请提供的一种基于VR技术的安全提示方法,该方法包括:获取用户的瞳孔图像,根据瞳孔图像,确定虚拟场景,响应用户在虚拟场景中输入的操作指令,从预设库中确定与操作指令对应的目标位置,调取目标位置对应的可控制的虚拟设备,以及若在预设时间段内虚拟设备被触发且未进行被操作,则生成提示信息以提示用户按照提示信息进行相应的操作。通过用户在虚拟场景中输入的操作指令,以确定与操作指令对应的第一目标位置,然后调取可控制的虚拟设备,以使作业人员可以在虚拟场景中控制虚拟设备,当作业人员在对虚拟场景进行误操作或者长时间没有操作时可以适当的提供正确的操作流程。A safety prompting method based on VR technology provided by the present application, the method includes: acquiring a pupil image of a user, determining a virtual scene according to the pupil image, responding to an operation instruction input by the user in the virtual scene, and determining from a preset library The target position corresponding to the operation instruction is called, the controllable virtual device corresponding to the target position is called, and if the virtual device is triggered and not operated within a preset time period, a prompt message is generated to prompt the user to perform corresponding actions according to the prompt message. operate. Through the operation instruction input by the user in the virtual scene, the first target position corresponding to the operation instruction is determined, and then the controllable virtual equipment is called, so that the operator can control the virtual equipment in the virtual scene. When the virtual scene is mis-operated or has not been operated for a long time, the correct operation process can be appropriately provided.

图2是本申请另一示例性实施例提供的基于VR技术的安全提示方法的流程示意图。如图2所示,步骤120可以包括:FIG. 2 is a schematic flowchart of a safety prompt method based on VR technology provided by another exemplary embodiment of the present application. As shown in FIG. 2, step 120 may include:

步骤121:确定瞳孔图像中的瞳孔位置。Step 121: Determine the pupil position in the pupil image.

可通过设立坐标系,并对瞳孔图像中的瞳孔位置选取多个边缘点,并确定多个边缘点的坐标系,从而确定瞳孔位置对应的多个坐标。Multiple coordinates corresponding to the pupil position can be determined by establishing a coordinate system, selecting multiple edge points for the pupil position in the pupil image, and determining the coordinate system of the multiple edge points.

步骤122:根据瞳孔位置,确定虚拟场景。Step 122: Determine the virtual scene according to the pupil position.

可设置坐标区间,以验证多个边缘点的坐标系是否均在坐标区间内,或者多个边缘点的坐标系在坐标区间的数量大于或者等于第一预设数量阈值。例如,边缘点有5个,但是有4个在坐标区间内,则确定瞳孔位置在改坐标区间内。坐标区间可以对应虚拟场景,若坐标区间为多个,则对应多个虚拟场景。A coordinate interval can be set to verify whether the coordinate systems of the multiple edge points are all within the coordinate interval, or the number of the coordinate systems of the multiple edge points in the coordinate interval is greater than or equal to the first preset number threshold. For example, if there are 5 edge points, but 4 are in the coordinate interval, it is determined that the pupil position is in the coordinate interval. The coordinate interval may correspond to a virtual scene, and if there are multiple coordinate intervals, it corresponds to multiple virtual scenes.

图3是本申请另一示例性实施例提供的基于VR技术的安全提示方法的流程示意图。如图3所示,步骤122可以包括:FIG. 3 is a schematic flowchart of a safety prompt method based on VR technology provided by another exemplary embodiment of the present application. As shown in FIG. 3, step 122 may include:

步骤1221:获取瞳孔位置对应的中心坐标。Step 1221: Obtain the center coordinates corresponding to the pupil position.

对瞳孔图像进行划分,以使瞳孔图像分成多个面积相等的图像,即通过横线、竖线、其他方向的线对瞳孔图像划分,最终线的交叉点为瞳孔位置对应的中心坐标。The pupil image is divided so that the pupil image is divided into multiple images of equal area, that is, the pupil image is divided by horizontal lines, vertical lines and lines in other directions, and the intersection of the final lines is the center coordinate corresponding to the pupil position.

步骤1222:根据中心坐标与预设坐标区间,确定虚拟场景。Step 1222: Determine the virtual scene according to the center coordinates and the preset coordinate interval.

设定预设坐标区间,当中心坐标在该预设坐标区间内时,可确定对应的虚拟场景。A preset coordinate interval is set, and when the center coordinates are within the preset coordinate interval, the corresponding virtual scene can be determined.

在一实施例中,预设坐标区间为第一预设坐标区间和第二预设坐标区间,第一预设坐标区间的方向以及第二预设坐标区间的方向为相反的坐标方向,步骤1222可具体实施为:若中心坐标在第一预设坐标区间内,则显示第一虚拟场景,其中,第一虚拟场景为虚拟的室内场景,以及若中心坐标在第二预设坐标区间内,则显示第二虚拟场景,其中,第二虚拟场景为虚拟的室外场景。In one embodiment, the preset coordinate interval is a first preset coordinate interval and a second preset coordinate interval, and the direction of the first preset coordinate interval and the direction of the second preset coordinate interval are opposite coordinate directions, step 1222 It can be specifically implemented as follows: if the center coordinates are within the first preset coordinate interval, a first virtual scene is displayed, wherein the first virtual scene is a virtual indoor scene, and if the center coordinates are within the second preset coordinate interval, then A second virtual scene is displayed, wherein the second virtual scene is a virtual outdoor scene.

若中心坐标在第一预设坐标区间内,则显示第一虚拟场景,其中,第一虚拟场景为虚拟的室内场景。若中心坐标在第二预设坐标区间内,则显示第二虚拟场景,其中,第二虚拟场景为虚拟的室外场景。If the center coordinates are within the first preset coordinate range, a first virtual scene is displayed, wherein the first virtual scene is a virtual indoor scene. If the center coordinates are within the second preset coordinate interval, a second virtual scene is displayed, wherein the second virtual scene is a virtual outdoor scene.

图4是本申请另一示例性实施例提供的基于VR技术的安全提示方法的流程示意图。虚拟设备包括线路设备,步骤150可以包括:FIG. 4 is a schematic flowchart of a safety prompt method based on VR technology provided by another exemplary embodiment of the present application. The virtual device includes a line device, and step 150 may include:

步骤151:调取目标位置对应的可控制的虚拟设备,其中,目标位置包括提示符号,提示符号指向虚拟设备。Step 151: Invoke a controllable virtual device corresponding to the target position, wherein the target position includes a prompt symbol, and the prompt symbol points to the virtual device.

因为调取到的虚拟设备可能为多个,那么在显示虚拟设备时,可显示提示符号,提示符号指向该虚拟设备,从而使用户可以确定目标虚拟设备,即查看的虚拟设备。若调取到的虚拟设备为1个,那么用户可以直观的确定目标虚拟设备。Because there may be multiple virtual devices retrieved, a prompt symbol can be displayed when displaying a virtual device, and the prompt symbol points to the virtual device, so that the user can determine the target virtual device, that is, the viewed virtual device. If the retrieved virtual device is one, the user can intuitively determine the target virtual device.

图5是本申请另一示例性实施例提供的基于VR技术的安全提示方法的流程示意图。如图5所示,基于VR技术的安全提示方法还可以包括:FIG. 5 is a schematic flowchart of a safety prompt method based on VR technology provided by another exemplary embodiment of the present application. As shown in Figure 5, the safety prompt method based on VR technology may further include:

步骤170:若接收到虚拟设备被错误操作的指令,则生成反馈信息。Step 170: If an instruction that the virtual device is operated incorrectly is received, generate feedback information.

若接收到虚拟设备被错误操作的指令,即未按目标流程中的操作提示进行操作,则生成反馈信息,该反馈信息带有震动指令。例如,操作提示应该先接绝缘片,然后连接导线,而用户直接连接导线,即未按目标流程中的操作提示进行操作,那么将会生成反馈信息,该反馈信息带有震动指令以提示用户错误操作。If an instruction is received that the virtual device is operated incorrectly, that is, the operation is not performed according to the operation prompt in the target process, feedback information is generated, and the feedback information includes a vibration instruction. For example, the operation prompt should be connected to the insulating sheet first, and then the wire, and the user directly connects the wire, that is, does not follow the operation prompt in the target process, then a feedback message will be generated with a vibration command to remind the user of the error operate.

步骤180:将反馈信息发送至交互设备中以使交互设备产生震动,其中,交互设备为用户直接操作的设备。Step 180: Send the feedback information to the interactive device to make the interactive device vibrate, wherein the interactive device is a device directly operated by the user.

将反馈信息带有的震动指令发送至交互设备中以使交互设备产生震动,从而使用户清楚刚才的操作为错误操作。例如,VR变电站电能表检验,在串电流,并电压过程中,应先接好短路片,若未先接短路片而是其他操作,那么手柄反馈触电的震动感。The vibration instruction carried by the feedback information is sent to the interactive device to cause the interactive device to vibrate, so that the user knows that the operation just now is a wrong operation. For example, in the inspection of the electric energy meter of the VR substation, in the process of string current and voltage, the short circuit should be connected first. If the short circuit is not connected first but other operations are performed, the handle will feedback the vibration of electric shock.

图6是本申请另一示例性实施例提供的基于VR技术的安全提示方法的流程示意图。如图6所示,在步骤180之后,基于VR技术的安全提示方法还可以包括:FIG. 6 is a schematic flowchart of a safety prompt method based on VR technology provided by another exemplary embodiment of the present application. As shown in FIG. 6, after step 180, the safety prompting method based on VR technology may further include:

步骤190:若虚拟设备被错误操作对应的危害程度等级大于或者等于预设危害程度等级阈值,则生成模拟动画以显示虚拟设备被错误操作产生的危害场景。Step 190: If the hazard level corresponding to the wrong operation of the virtual device is greater than or equal to the preset hazard level threshold, a simulation animation is generated to display the hazard scene caused by the wrong operation of the virtual device.

若虚拟设备被错误操作对应的危害程度等级大于或者等于预设危害程度等级阈值,则生成模拟动画,该模拟动画将模拟真实情况的发生,以使用户可以直观的看到错误操作导致的严重的危害。危害程度等级可以设置3个等级,分别为高中低,高等级表示危害程度较大,严重可能会影响到人身安全。中等级表示危害程度适中,容易导致设备损坏,低等级表示危害程度较低,对设备的损伤影响较小。If the hazard level corresponding to the wrong operation of the virtual device is greater than or equal to the preset hazard level threshold, a simulation animation will be generated, and the simulation animation will simulate the occurrence of the real situation, so that the user can intuitively see the serious damage caused by the wrong operation. harm. The hazard level can be set to 3 levels, which are high, medium and low. A medium level indicates a moderate degree of hazard, which is likely to cause equipment damage, while a low level indicates a lower degree of hazard and less damage to the equipment.

另外,若虚拟设备已按照预设操作流程操作完成之后,生成分数界面。In addition, if the virtual device has been operated according to the preset operation process, a score interface is generated.

分数界面上显示用户错误操作的次数,以及用户错误操作时的严重程度等级等,有利于用户可以直观的知道自己的不足。若虚拟设备已按照预设操作流程操作完成之后,存储操作过程中的视频动画,并将视频动画存储到视频库中,用户可以将视频动画下载到手机或者其他移动设备中,可以随时随地的观看视频动画。The score interface displays the number of user's wrong operations, and the severity level of the user's wrong operation, which is helpful for users to intuitively know their own shortcomings. If the virtual device has completed the operation according to the preset operation process, the video animation during the operation is stored, and the video animation is stored in the video library. The user can download the video animation to the mobile phone or other mobile devices and watch it anytime, anywhere. Video animation.

生成分数界面之后,若接收到用户自由观察虚拟场景的指令,则用户可以对虚拟场景进行自由观察以及操作,无需按照预设流程进行操作,从而可以使用户可以自由操作虚拟场景的任何设备,且不会再提示用户,而只是生成操作动画。若用户在自由操作中有错误操作,操作动画也会显示操作之后带来的危害,以可以使用户可以更加直观的看到每个设备的运行状态以及如何正确的操作设备。After the score interface is generated, if an instruction from the user to freely observe the virtual scene is received, the user can freely observe and operate the virtual scene without following the preset process, so that the user can freely operate any device in the virtual scene, and The user is no longer prompted, just an animation of the action is generated. If the user has a wrong operation in the free operation, the operation animation will also display the harm caused by the operation, so that the user can more intuitively see the running state of each device and how to operate the device correctly.

图7是本申请一示例性实施例提供的基于VR技术的安全提示装置的结构示意图。如图7所示,基于VR技术的安全提示装置20包括:获取模块201,用于获取用户的瞳孔图像,虚拟场景确定模块202,用于根据瞳孔图像,确定虚拟场景,响应模块203,用于响应用户在虚拟场景中输入的操作指令,目标位置确定模块204,用于从预设库中确定与操作指令对应的目标位置,调取模块205,用于调取目标位置对应的可控制的虚拟设备,以及生成模块206,用于若在预设时间段内虚拟设备被触发且未进行被操作,则生成提示信息以提示用户按照提示信息进行相应的操作。FIG. 7 is a schematic structural diagram of a safety prompting device based on VR technology provided by an exemplary embodiment of the present application. As shown in FIG. 7 , the safety prompting device 20 based on VR technology includes: an acquisition module 201 for acquiring a pupil image of a user, a virtual scene determination module 202 for determining a virtual scene according to the pupil image, and a response module 203 for In response to the operation instruction input by the user in the virtual scene, the target position determination module 204 is used to determine the target position corresponding to the operation instruction from the preset library, and the calling module 205 is used to call the controllable virtual control device corresponding to the target position. The device, and the generating module 206 are configured to generate prompt information to prompt the user to perform corresponding operations according to the prompt information if the virtual device is triggered and not operated within the preset time period.

本申请提供一种基于VR技术的安全提示装置,通过获取模块201获取用户的瞳孔图像,虚拟场景确定模块202根据瞳孔图像,确定虚拟场景,响应模块203响应用户在虚拟场景中输入的操作指令,目标位置确定模块204从预设库中确定与操作指令对应的目标位置,调取模块205调取目标位置对应的可控制的虚拟设备,以及生成模块206若在预设时间段内虚拟设备被触发且未进行被操作,则生成提示信息以提示用户按照提示信息进行相应的操作。通过用户在虚拟场景中输入的操作指令,以确定与操作指令对应的第一目标位置,然后调取可控制的虚拟设备,以使作业人员可以在虚拟场景中控制虚拟设备,当作业人员在对虚拟场景进行误操作或者长时间没有操作时可以适当的提供正确的操作流程。The present application provides a safety prompting device based on VR technology. The acquisition module 201 acquires the pupil image of the user, the virtual scene determination module 202 determines the virtual scene according to the pupil image, and the response module 203 responds to the operation instruction input by the user in the virtual scene, The target position determining module 204 determines the target position corresponding to the operation instruction from the preset library, the calling module 205 calls the controllable virtual device corresponding to the target position, and the generating module 206 if the virtual device is triggered within the preset time period If the operation is not performed, prompt information is generated to prompt the user to perform corresponding operations according to the prompt information. Through the operation instruction input by the user in the virtual scene, the first target position corresponding to the operation instruction is determined, and then the controllable virtual equipment is called, so that the operator can control the virtual equipment in the virtual scene. When the virtual scene is mis-operated or has not been operated for a long time, the correct operation process can be appropriately provided.

图8是本申请另一示例性实施例提供的基于VR技术的安全提示装置的结构示意图。如图8所示,虚拟场景确定模块202可以包括:瞳孔位置确定单元2021,用于确定瞳孔图像中的瞳孔位置,以及虚拟场景确定子单元2022,用于根据瞳孔位置,确定虚拟场景。FIG. 8 is a schematic structural diagram of a safety prompt device based on VR technology provided by another exemplary embodiment of the present application. As shown in FIG. 8 , the virtual scene determination module 202 may include: a pupil position determination unit 2021 for determining the pupil position in the pupil image, and a virtual scene determination subunit 2022 for determining a virtual scene according to the pupil position.

在一实施例中,虚拟场景确定子单元2022可具体配置为:获取瞳孔位置对应的中心坐标;以及根据中心坐标与预设坐标区间,确定虚拟场景。In one embodiment, the virtual scene determination subunit 2022 may be specifically configured to: acquire the center coordinates corresponding to the pupil position; and determine the virtual scene according to the center coordinates and a preset coordinate interval.

在一实施例中,预设坐标区间为第一预设坐标区间和第二预设坐标区间,第一预设坐标区间的方向以及第二预设坐标区间的方向为相反的坐标方向,其中,虚拟场景确定子单元2022可具体配置为:若中心坐标在第一预设坐标区间内,则显示第一虚拟场景;其中,第一虚拟场景为虚拟的室内场景;以及若中心坐标在第二预设坐标区间内,则显示第二虚拟场景;其中,第二虚拟场景为虚拟的室外场景。In one embodiment, the preset coordinate interval is a first preset coordinate interval and a second preset coordinate interval, and the direction of the first preset coordinate interval and the direction of the second preset coordinate interval are opposite coordinate directions, wherein, The virtual scene determination subunit 2022 may be specifically configured to: if the center coordinates are within the first preset coordinate interval, display the first virtual scene; wherein, the first virtual scene is a virtual indoor scene; and if the center coordinates are within the second preset coordinate interval, the first virtual scene is displayed; In the coordinate interval, a second virtual scene is displayed; wherein, the second virtual scene is a virtual outdoor scene.

在一实施例中,虚拟设备包括线路设备,其中,调取模块205可以包括:调取子单元2051,用于调取目标位置对应的可控制的虚拟设备,其中,目标位置包括提示符号,提示符号指向虚拟设备。In an embodiment, the virtual device includes a line device, wherein the retrieving module 205 may include: a retrieving subunit 2051 for retrieving a controllable virtual device corresponding to a target position, wherein the target position includes a prompt symbol, prompting Symbols point to virtual devices.

在一实施例中,基于VR技术的安全提示装置20可以包括:生成单元207,用于若接收到虚拟设备被错误操作的指令,则生成反馈信息;发送单元208,用于将反馈信息发送至交互设备中以使交互设备产生震动,其中,交互设备为用户直接操作的设备。In an embodiment, the safety prompting device 20 based on VR technology may include: a generating unit 207 for generating feedback information if an instruction that the virtual device is operated incorrectly is received; a sending unit 208 for sending the feedback information to a In the interactive device, the interactive device is vibrated, wherein the interactive device is a device directly operated by the user.

在一实施例中,基于VR技术的安全提示装置20可以包括:模拟动画单元209,用于若虚拟设备被错误操作对应的危害程度等级大于或者等于预设危害程度等级阈值,则生成模拟动画以显示虚拟设备被错误操作产生的危害场景。In one embodiment, the safety prompting device 20 based on VR technology may include: a simulation animation unit 209, configured to generate a simulation animation to Displays the hazard scenarios caused by the wrong operation of the virtual device.

图9图示了根据本申请实施例的电子设备的框图。FIG. 9 illustrates a block diagram of an electronic device according to an embodiment of the present application.

如图9所示,电子设备10包括一个或多个处理器11和存储器12。As shown in FIG. 9 , the electronic device 10 includes one or more processors 11 and a memory 12 .

处理器11可以是中央处理单元(CPU)或者具有数据处理能力和/或指令执行能力的其他形式的处理单元,并且可以控制电子设备10中的其他组件以执行期望的功能。Processor 11 may be a central processing unit (CPU) or other form of processing unit having data processing capabilities and/or instruction execution capabilities, and may control other components in electronic device 10 to perform desired functions.

存储器12可以包括一个或多个计算机程序产品,所述计算机程序产品可以包括各种形式的计算机可读存储介质,例如易失性存储器和/或非易失性存储器。所述易失性存储器例如可以包括随机存取存储器(RAM)和/或高速缓冲存储器(cache)等。所述非易失性存储器例如可以包括只读存储器(ROM)、硬盘、闪存等。在所述计算机可读存储介质上可以存储一个或多个计算机程序指令,处理器11可以运行所述程序指令,以实现上文所述的本申请的各个实施例的基于VR技术的安全提示方法以及/或者其他期望的功能。在所述计算机可读存储介质中还可以存储诸如输入信号、信号分量、噪声分量等各种内容。Memory 12 may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory. The volatile memory may include, for example, random access memory (RAM) and/or cache memory, or the like. The non-volatile memory may include, for example, read only memory (ROM), hard disk, flash memory, and the like. One or more computer program instructions may be stored on the computer-readable storage medium, and the processor 11 may execute the program instructions to implement the VR technology-based security prompting method of the various embodiments of the present application described above and/or other desired functionality. Various contents such as input signals, signal components, noise components, etc. may also be stored in the computer-readable storage medium.

在一个示例中,电子设备10还可以包括:输入装置13和输出装置14,这些组件通过总线系统和/或其他形式的连接机构(未示出)互连。In one example, the electronic device 10 may also include an input device 13 and an output device 14 interconnected by a bus system and/or other form of connection mechanism (not shown).

在该电子设备是单机设备时,该输入装置13可以是通信网络连接器,用于从第一设备和第二设备接收所采集的输入信号。When the electronic device is a stand-alone device, the input device 13 may be a communication network connector for receiving the collected input signals from the first device and the second device.

此外,该输入装置13还可以包括例如键盘、鼠标等等。In addition, the input device 13 may also include, for example, a keyboard, a mouse, and the like.

该输出装置14可以向外部输出各种信息,包括确定出的距离信息、方向信息等。该输出装置14可以包括例如显示器、扬声器、打印机、以及通信网络及其所连接的远程输出设备等等。The output device 14 can output various information to the outside, including the determined distance information, direction information, and the like. The output device 14 may include, for example, displays, speakers, printers, and communication networks and their connected remote output devices, among others.

当然,为了简化,图9中仅示出了该电子设备10中与本申请有关的组件中的一些,省略了诸如总线、输入/输出接口等等的组件。除此之外,根据具体应用情况,电子设备10还可以包括任何其他适当的组件。Of course, for simplicity, only some of the components in the electronic device 10 related to the present application are shown in FIG. 9 , and components such as buses, input/output interfaces and the like are omitted. Besides, the electronic device 10 may also include any other suitable components according to the specific application.

所述计算机程序产品可以以一种或多种程序设计语言的任意组合来编写用于执行本申请实施例操作的程序代码,所述程序设计语言包括面向对象的程序设计语言,诸如Java、C++等,还包括常规的过程式程序设计语言,诸如“C”语言或类似的程序设计语言。程序代码可以完全地在用户计算设备上执行、部分地在用户设备上执行、作为一个独立的软件包执行、部分在用户计算设备上部分在远程计算设备上执行、或者完全在远程计算设备或服务器上执行。The computer program product can write program codes for performing the operations of the embodiments of the present application in any combination of one or more programming languages, including object-oriented programming languages, such as Java, C++, etc. , also includes conventional procedural programming languages, such as "C" language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server execute on.

所述计算机可读存储介质可以采用一个或多个可读介质的任意组合。可读介质可以是可读信号介质或者可读存储介质。可读存储介质例如可以包括但不限于电、磁、光、电磁、红外线、或半导体的系统、装置或器件,或者任意以上的组合。可读存储介质的更具体的例子(非穷举的列表)包括:具有一个或多个导线的电连接、便携式盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(EPROM或闪存)、光纤、便携式紧凑盘只读存储器(CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。The computer-readable storage medium may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may include, for example, but not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatuses or devices, or a combination of any of the above. More specific examples (non-exhaustive list) of readable storage media include: electrical connections with one or more wires, portable disks, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, portable compact disk read only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

为了例示和描述的目的已经给出了以上描述。此外,此描述不意图将本申请的实施例限制到在此公开的形式。尽管以上已经讨论了多个示例方面和实施例,但是本领域技术人员将认识到其某些变型、修改、改变、添加和子组合。The foregoing description has been presented for the purposes of illustration and description. Furthermore, this description is not intended to limit the embodiments of the application to the forms disclosed herein. Although a number of example aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, changes, additions and sub-combinations thereof.

Claims (10)

1. A safety prompting method based on VR technology is characterized by comprising the following steps:
acquiring a pupil image of a user;
determining a virtual scene according to the pupil image;
responding to an operation instruction input by the user in the virtual scene;
determining a target position corresponding to the operation instruction from the preset library;
calling controllable virtual equipment corresponding to the target position; and
and if the virtual equipment is triggered and not operated within a preset time period, generating prompt information to prompt the user to perform corresponding operation according to the prompt information.
2. The VR technology based safety prompting method of claim 1, wherein the determining a virtual scene from the pupil image comprises:
determining a pupil location in the pupil image; and
and determining the virtual scene according to the pupil position.
3. The VR technology based safety prompting method of claim 2, wherein the determining the virtual scene according to the pupil position includes:
acquiring a central coordinate corresponding to the pupil position; and
and determining the virtual scene according to the central coordinate and a preset coordinate interval.
4. The VR technology-based safety prompting method of claim 3, wherein the preset coordinate intervals are a first preset coordinate interval and a second preset coordinate interval, and a direction of the first preset coordinate interval and a direction of the second preset coordinate interval are opposite coordinate directions, wherein the determining the virtual scene according to the center coordinate and the preset coordinate intervals comprises:
if the center coordinate is within the first preset coordinate interval, displaying a first virtual scene; the first virtual scene is a virtual indoor scene; and
if the central coordinate is within the second preset coordinate interval, displaying a second virtual scene; the second virtual scene is a virtual outdoor scene.
5. The VR technology-based security prompt method of claim 1, wherein the virtual device comprises a line device, and wherein the invoking the controllable virtual device corresponding to the target location comprises:
calling controllable virtual equipment corresponding to the target position; wherein the target location includes a cue symbol, the cue symbol pointing to the virtual device.
6. The VR technology based security alert method of claim 1, further comprising:
if an instruction that the virtual equipment is operated by mistake is received, generating feedback information; and
sending the feedback information to interactive equipment so as to enable the interactive equipment to generate vibration; wherein, the interactive device is a device directly operated by the user.
7. The method for safely prompting VR technology of claim 6, further comprising, after the generating feedback information:
if the hazard level corresponding to the virtual equipment being operated by mistake is greater than or equal to a preset hazard level threshold, generating a simulation animation to display a hazard scene generated by the virtual equipment being operated by mistake.
8. A safety prompt device based on VR technique, includes:
the acquisition module is used for acquiring a pupil image of a user;
the virtual scene determining module is used for determining a virtual scene according to the pupil image;
the response module is used for responding to an operation instruction input by the user in the virtual scene;
the target position determining module is used for determining a target position corresponding to the operation instruction from the preset library;
the calling module is used for calling the controllable virtual equipment corresponding to the target position; and
and the generating module is used for generating prompt information to prompt the user to perform corresponding operation according to the prompt information if the virtual equipment is triggered and not operated within a preset time period.
9. A computer-readable storage medium storing a computer program for executing the VR technology-based security prompt method of any one of claims 1-7.
10. An electronic device, the electronic device comprising:
a processor;
a memory for storing the processor-executable instructions;
the processor configured to perform the VR technology based security alert method of any of claims 1-7.
CN202210159384.6A 2022-02-21 2022-02-21 VR technology-based safety prompt method, device, medium and equipment Active CN114546118B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210159384.6A CN114546118B (en) 2022-02-21 2022-02-21 VR technology-based safety prompt method, device, medium and equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210159384.6A CN114546118B (en) 2022-02-21 2022-02-21 VR technology-based safety prompt method, device, medium and equipment

Publications (2)

Publication Number Publication Date
CN114546118A true CN114546118A (en) 2022-05-27
CN114546118B CN114546118B (en) 2024-08-20

Family

ID=81677861

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210159384.6A Active CN114546118B (en) 2022-02-21 2022-02-21 VR technology-based safety prompt method, device, medium and equipment

Country Status (1)

Country Link
CN (1) CN114546118B (en)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20010016242A (en) * 2000-11-27 2001-03-05 이등구 Pupil acquisition method using eye image
KR101255219B1 (en) * 2011-10-13 2013-04-24 상명대학교 산학협력단 Method of eye-gaze tracking and system adopting the method
CN105511618A (en) * 2015-12-08 2016-04-20 北京小鸟看看科技有限公司 3D input device, head-mounted device and 3D input method
CN105812778A (en) * 2015-01-21 2016-07-27 成都理想境界科技有限公司 Binocular AR head-mounted display device and information display method therefor
CN106618479A (en) * 2015-10-30 2017-05-10 由田新技股份有限公司 Pupil tracking system and method thereof
CN106843150A (en) * 2017-02-28 2017-06-13 清华大学 A kind of industry spot simulation method and device
CN111124133A (en) * 2019-12-30 2020-05-08 腾讯科技(深圳)有限公司 Method, device, equipment and storage medium for danger prompt information in virtual scene
CN113534959A (en) * 2021-07-27 2021-10-22 咪咕音乐有限公司 Screen display method, screen display device, virtual reality equipment and program product
CN113703574A (en) * 2021-08-26 2021-11-26 南京邮电大学盐城大数据研究中心 VR medical learning method and system based on 5G

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20010016242A (en) * 2000-11-27 2001-03-05 이등구 Pupil acquisition method using eye image
KR101255219B1 (en) * 2011-10-13 2013-04-24 상명대학교 산학협력단 Method of eye-gaze tracking and system adopting the method
CN105812778A (en) * 2015-01-21 2016-07-27 成都理想境界科技有限公司 Binocular AR head-mounted display device and information display method therefor
CN106618479A (en) * 2015-10-30 2017-05-10 由田新技股份有限公司 Pupil tracking system and method thereof
CN105511618A (en) * 2015-12-08 2016-04-20 北京小鸟看看科技有限公司 3D input device, head-mounted device and 3D input method
CN106843150A (en) * 2017-02-28 2017-06-13 清华大学 A kind of industry spot simulation method and device
CN111124133A (en) * 2019-12-30 2020-05-08 腾讯科技(深圳)有限公司 Method, device, equipment and storage medium for danger prompt information in virtual scene
CN113534959A (en) * 2021-07-27 2021-10-22 咪咕音乐有限公司 Screen display method, screen display device, virtual reality equipment and program product
CN113703574A (en) * 2021-08-26 2021-11-26 南京邮电大学盐城大数据研究中心 VR medical learning method and system based on 5G

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
张佩: "视线追踪中场景目标注视区域的信息提取研究", 《中国优秀硕士学位论文全文数据库(信息科技辑)》, 30 April 2021 (2021-04-30), pages 138 - 527 *
张闯;迟健男;邱亚飞;张朝晖;: "视线追踪系统中特征参数提取方法研究", 中国图象图形学报, vol. 15, no. 09, 16 September 2010 (2010-09-16), pages 1299 - 1308 *

Also Published As

Publication number Publication date
CN114546118B (en) 2024-08-20

Similar Documents

Publication Publication Date Title
US20220314129A1 (en) Gaming live stream control method and device, computer storage medium, and electronic apparatus
CN106997241B (en) A method and a virtual reality system for interacting with the real world in a virtual reality environment
CN113691829B (en) Virtual object interaction method, device, storage medium and computer program product
CN111263175A (en) Interaction control method and device for live broadcast platform, storage medium and electronic equipment
CN110730390A (en) Interaction method and device for intelligently activating atmosphere of live broadcast room
CN110989842A (en) Training method and system based on virtual reality and electronic equipment
CN112286411A (en) Display mode control method and device, storage medium and electronic equipment
CN113110779B (en) A map display control method, device, equipment and medium
CN114546118B (en) VR technology-based safety prompt method, device, medium and equipment
CN106791226B (en) Call fault detection method and system
CN115643445A (en) Interaction processing method and device, electronic equipment and storage medium
CN114185782A (en) Interactive testing method and device for virtual object and electronic equipment
CN115134523B (en) Remote control method, remote control device, operation terminal, control device and storage medium
WO2020124454A1 (en) Font switching method and related product
CN110377150B (en) Method and device for operating entity component in virtual scene and computer equipment
CN105681903A (en) User interface displaying method and device
KR101861128B1 (en) Appatus and mathod providing text message based on touch input
US20230078915A1 (en) Work sequence management device, work sequence management method, and work sequence management program
CN113157471B (en) Debug system and early warning system
CN110049124A (en) Online education resource automatic switching method, device, electronic equipment, storage medium
CN118137669B (en) Online monitoring method and system for electrical equipment based on virtual reality technology
CN110519650A (en) A kind of OSD language upgrade method, apparatus, electronic equipment and storage medium
CN113742950B (en) Earthquake early warning exercise method and device, electronic equipment and storage medium
WO2016029554A1 (en) Mobile terminal control method and device
CN114936060A (en) Method, device and storage medium for simulating mouse operation

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant