[go: up one dir, main page]

CN107589838A - The method of combining the play of SOP video to guide the operation with the VR method - Google Patents

The method of combining the play of SOP video to guide the operation with the VR method Download PDF

Info

Publication number
CN107589838A
CN107589838A CN201710761712.9A CN201710761712A CN107589838A CN 107589838 A CN107589838 A CN 107589838A CN 201710761712 A CN201710761712 A CN 201710761712A CN 107589838 A CN107589838 A CN 107589838A
Authority
CN
China
Prior art keywords
playing
human hand
virtual scene
sop
video content
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710761712.9A
Other languages
Chinese (zh)
Inventor
阮真
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Pangu Information Technology Co ltd
Original Assignee
Guangdong Pangu Information Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Pangu Information Technology Co ltd filed Critical Guangdong Pangu Information Technology Co ltd
Priority to CN201710761712.9A priority Critical patent/CN107589838A/en
Publication of CN107589838A publication Critical patent/CN107589838A/en
Pending legal-status Critical Current

Links

Classifications

    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/30Computing systems specially adapted for manufacturing

Landscapes

  • User Interface Of Digital Computer (AREA)

Abstract

The invention discloses a method for guiding operation by combining a VR method with playing of an SOP video, which comprises the following steps: building a virtual scene of an operator operation platform; after the hand enters the actual scene, triggering a first operation step of the electronic operation instruction book in the virtual scene according to the gesture of the hand, and playing the operation instruction video content corresponding to the first operation step; the worker guides to complete the action of the first operation step according to the video content corresponding to the first operation step; when the action of the first operation step is finished, triggering a second operation step of the electronic operation instruction book in the virtual scene according to the gesture of the human hand, and playing the operation instruction video content corresponding to the second operation step; by analogy, the operation steps of the whole electronic operation instruction book are completed, the method can keep the video of the operation steps of the electronic operation instruction book consistent with the actual operation, operators can more conveniently master the operation content, the efficiency is improved, and the quality is improved.

Description

以VR方法结合播放SOP视频指导作业的方法The method of combining the play of SOP video to guide the operation with the VR method

技术领域technical field

本发明涉及制造业培训技术领域,尤其涉及一种以VR方法结合播放SOP视频指导作业的方法。The invention relates to the technical field of manufacturing training, in particular to a method for guiding operations by combining a VR method with playing SOP videos.

背景技术Background technique

虚拟现实技术是仿真技术的一个重要方向,是仿真技术与计算机图形学人机接口技术多媒体技术传感技术网络技术等多种技术的集合,是一门富有挑战性的交叉技术前沿学科和研究领域。虚拟现实技术(VR)主要包括模拟环境、感知、自然技能和传感设备等方面。模拟环境是由计算机生成的、实时动态的三维立体逼真图像。感知是指理想的VR应该具有一切人所具有的感知。除计算机图形技术所生成的视觉感知外,还有听觉、触觉、力觉、运动等感知,甚至还包括嗅觉和味觉等,也称为多感知。自然技能是指人的头部转动,眼睛、手势、或其他人体行为动作,由计算机来处理与参与者的动作相适应的数据,并对用户的输入作出实时响应,并分别反馈到用户的五官。传感设备是指三维交互设备。Virtual reality technology is an important direction of simulation technology. It is a collection of simulation technology, computer graphics, human-machine interface technology, multimedia technology, sensor technology, network technology and other technologies. It is a challenging cross-technical frontier discipline and research field. . Virtual reality technology (VR) mainly includes aspects such as simulated environment, perception, natural skills and sensing equipment. The simulated environment is a real-time dynamic three-dimensional realistic image generated by a computer. Perception means that ideal VR should have the perception that all human beings have. In addition to the visual perception generated by computer graphics technology, there are also perceptions such as hearing, touch, force, movement, and even smell and taste, also known as multi-sense. Natural skills refer to people's head rotation, eyes, gestures, or other human behaviors. The computer processes the data adapted to the participants' movements, and responds to the user's input in real time, and feeds back to the user's facial features respectively. . Sensing devices refer to 3D interactive devices.

现有电子作业指导书,在播放操作步骤视频时,从头到尾连续播放,往往造成视频播放的内容与实际操作内容不一致,电子作业指导书不能真正起到指导作业员作业的目的。The existing electronic work instructions, when playing the video of the operation steps, are played continuously from beginning to end, often resulting in inconsistencies between the content of the video playback and the actual operation content, and the electronic work instructions cannot really serve the purpose of guiding the operator's work.

发明内容Contents of the invention

本发明所要解决的技术问题是如何提供一种将电子作业指导书操作步骤视频与实际操作保持一致,作业员更加便捷掌握操作内容,提升效率、改善品质的方法。The technical problem to be solved by the present invention is how to provide a method to keep the video of the operation steps of the electronic work instruction consistent with the actual operation, so that the operator can more easily grasp the operation content, improve the efficiency and improve the quality.

为解决上述技术问题,本发明所采取的技术方案是:一种以VR方法结合播放SOP视频指导作业的方法,其特征在于包括如下步骤:In order to solve the above-mentioned technical problems, the technical solution adopted by the present invention is: a kind of method combining playing SOP video instruction operation with VR method, it is characterized in that comprising the following steps:

借助于软件系统,搭建作业员操作平台的虚拟场景,软件系统用于捕捉人手的动作并在虚拟场景同步呈现;With the help of the software system, a virtual scene of the operator's operation platform is built. The software system is used to capture the movements of the human hands and present them synchronously in the virtual scene;

人手进入实际场景后,根据人手的手势在虚拟场景中触发电子作业指导书的第一操作步骤,播放与第一操作步骤相应的作业指导视频内容;After the human hand enters the actual scene, the first operation step of the electronic homework instruction is triggered in the virtual scene according to the hand gesture, and the homework instruction video content corresponding to the first operation step is played;

工人根据与第一操作步骤相应的视频内容指导完成第一操作步骤的动作;The worker is instructed to complete the action of the first operation step according to the video content corresponding to the first operation step;

第一个操作步骤动作结束时,根据人手的手势在虚拟场景中触发电子作业指导书的第二操作步骤,播放第二操作步骤相应的作业指导视频内容;When the first operation step ends, the second operation step of the electronic work instruction is triggered in the virtual scene according to the gesture of the human hand, and the corresponding operation instruction video content of the second operation step is played;

以此类推,完成整个电子作业指导书的操作步骤,使视频播放的内容与实际操作保持一致。By analogy, the operation steps of the entire electronic homework instruction are completed, so that the content of the video playback is consistent with the actual operation.

进一步的技术方案在于:在作业指导视频内容播放过程中,若人手离开实际场景,则播放暂停,直到人手重新进入实际场景并恢复离开时的动作,再继续播放。A further technical solution is: during the playback of the homework instruction video content, if the human hand leaves the actual scene, the playback is paused until the human hand re-enters the actual scene and resumes the action when leaving, and then continues to play.

进一步的技术方案在于:在作业员操作平台上安装有摄像头,通过摄像头进行拍摄,捕捉人手的动作,所述摄像头为高清快速拍摄摄像头。A further technical solution is: a camera is installed on the operator's operating platform, and the camera is used to shoot and capture the movements of the hands, and the camera is a high-definition fast shooting camera.

进一步的技术方案在于:作业员操作平台上还安装有3D全息投影仪,通过3D全息投影仪呈现虚拟场景。A further technical solution is: a 3D holographic projector is also installed on the operator's operating platform, and a virtual scene is presented through the 3D holographic projector.

采用上述技术方案所产生的有益效果在于:所述方法能够将电子作业指导书操作步骤视频与实际操作保持一致,作业员更加便捷掌握操作内容,提升效率、改善品质。The beneficial effect of adopting the above technical solution is that the method can keep the video of the operation steps of the electronic work instruction consistent with the actual operation, so that the operator can more easily grasp the operation content, improve the efficiency and improve the quality.

附图说明Description of drawings

下面结合附图和具体实施方式对本发明作进一步详细的说明。The present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.

图1是本发明实施例所述方法的流程图。Fig. 1 is a flow chart of the method described in the embodiment of the present invention.

具体实施方式detailed description

下面结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明的一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The technical solutions in the embodiments of the present invention are clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

在下面的描述中阐述了很多具体细节以便于充分理解本发明,但是本发明还可以采用其他不同于在此描述的其它方式来实施,本领域技术人员可以在不违背本发明内涵的情况下做类似推广,因此本发明不受下面公开的具体实施例的限制。In the following description, a lot of specific details are set forth in order to fully understand the present invention, but the present invention can also be implemented in other ways different from those described here, and those skilled in the art can do it without departing from the meaning of the present invention. By analogy, the present invention is therefore not limited to the specific examples disclosed below.

如图1所示,本发明实施例公开了一种以VR方法结合播放SOP视频指导作业的方法,包括如下步骤:As shown in Figure 1, the embodiment of the present invention discloses a method for guiding operations by playing SOP video in combination with the VR method, including the following steps:

S101、借助于软件系统,搭建作业员操作平台的虚拟场景,软件系统可捕捉人手的动作并在虚拟场景同步呈现;S101. With the help of the software system, build a virtual scene of the operator's operation platform. The software system can capture the movement of the human hand and present it synchronously in the virtual scene;

S102、人手进入实际场景后,根据人手的手势在虚拟场景中触发电子作业指导书的第一操作步骤,播放与第一操作步骤相应的作业指导视频内容;S102. After the human hand enters the actual scene, trigger the first operation step of the electronic work instruction in the virtual scene according to the gesture of the human hand, and play the work instruction video content corresponding to the first operation step;

S103、工人根据与第一操作步骤相应的视频内容指导完成第一操作步骤的动作;S103. The worker completes the action of the first operation step according to the video content corresponding to the first operation step;

S104、第一个操作步骤动作结束时,根据人手的手势在虚拟场景中触发电子作业指导书的第二操作步骤,播放第二操作步骤相应的作业指导视频内容;S104. When the first operation step ends, trigger the second operation step of the electronic work instruction in the virtual scene according to the gesture of the human hand, and play the operation instruction video content corresponding to the second operation step;

S105、以此类推,完成整个电子作业指导书的操作步骤,使视频播放的内容与实际操作保持一致。S105 , and so on, to complete the operation steps of the entire electronic work instruction, so that the content of the video playback is consistent with the actual operation.

优选的,在作业指导视频内容播放过程中,若人手离开实际场景,则播放暂停,直到人手重新进入实际场景并恢复离开时的动作,再继续播放。这样可以使作业员中途可以暂停操作离开岗位,回到岗位后继续进行操作。Preferably, during the playback of the homework instruction video content, if the human hand leaves the actual scene, the playback is paused until the human hand re-enters the actual scene and resumes the action when leaving, and then continues to play. In this way, the operator can suspend the operation and leave the post midway, and continue the operation after returning to the post.

具体的,在作业员操作平台上安装有摄像头,通过摄像头进行拍摄,捕捉人手的动作。Specifically, a camera is installed on the operator's operating platform, and the camera is used to capture the movements of the hands.

优选的,为了快速的捕捉到人手的动作,所述摄像头一般使用高清快速拍摄摄像头。所述方法能够将电子作业指导书操作步骤视频与实际操作保持一致,作业员更加便捷掌握操作内容,提升效率、改善品质。Preferably, in order to quickly capture the movement of the human hand, the camera generally uses a high-definition quick-shot camera. The method can keep the video of the operation steps of the electronic work instruction consistent with the actual operation, so that the operator can more conveniently grasp the operation content, improve the efficiency and improve the quality.

具体的,在作业员操作平台上安装有显示器,通过显示器播放作业指导视频内容。Specifically, a display is installed on the operator's operation platform, and the operation guidance video content is played through the display.

优选的,作业员操作平台上还安装有3D全息投影仪,通过3D全息投影仪呈现虚拟场景。作业员可通过观察虚拟场景检查其是否与实际场景同步,从而确定相应视频播放的准确性。Preferably, a 3D holographic projector is also installed on the operator's operating platform, and a virtual scene is presented through the 3D holographic projector. Operators can check whether the virtual scene is in sync with the real scene by observing the virtual scene, so as to determine the accuracy of the corresponding video playback.

具体的,电子作业指导书的作业指导视频内容存储在数据库中。Specifically, the homework instruction video content of the electronic homework instruction book is stored in the database.

Claims (4)

1. a kind of combine the method for playing SOP videos and instructing operation in VR methods, it is characterised in that comprises the following steps:
By means of software systems, the virtual scene of operator operating platform is built, software systems are for catching the action of human hand simultaneously Synchronously presented in virtual scene;
After human hand enters actual scene, the first operation of electronic homework guiding book is triggered in virtual scene according to the gesture of human hand Step, play operation guidance video content corresponding with the first operating procedure;
Worker instructs to complete the action of the first operating procedure according to video content corresponding with the first operating procedure;
During first operating procedure release, the of electronic homework guiding book is triggered in virtual scene according to the gesture of human hand Two operating procedures, play the corresponding operation guidance video content of the second operating procedure;
By that analogy, the operating procedure of whole electronic homework guiding book is completed, the content and practical operation for making video playback are kept Unanimously.
2. the method for playing SOP videos and instructing operation is combined in VR methods as claimed in claim 1, it is characterised in that:Making Industry is instructed in video content playing process, if human hand leaves actual scene, pause is played, until human hand reenters actual field Scape simultaneously recovers action when leaving, and is further continued for playing.
3. the method for playing SOP videos and instructing operation is combined in VR methods as claimed in claim 1, it is characterised in that:Making Camera is installed on industry person's operating platform, shot by camera, catches the action of human hand, the camera is high definition Quick shooting camera.
4. the method for playing SOP videos and instructing operation is combined in VR methods as claimed in claim 1, it is characterised in that:Operation 3D holographic projectors are also equipped with member's operating platform, virtual scene is presented by 3D holographic projectors.
CN201710761712.9A 2017-08-30 2017-08-30 The method of combining the play of SOP video to guide the operation with the VR method Pending CN107589838A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710761712.9A CN107589838A (en) 2017-08-30 2017-08-30 The method of combining the play of SOP video to guide the operation with the VR method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710761712.9A CN107589838A (en) 2017-08-30 2017-08-30 The method of combining the play of SOP video to guide the operation with the VR method

Publications (1)

Publication Number Publication Date
CN107589838A true CN107589838A (en) 2018-01-16

Family

ID=61050217

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710761712.9A Pending CN107589838A (en) 2017-08-30 2017-08-30 The method of combining the play of SOP video to guide the operation with the VR method

Country Status (1)

Country Link
CN (1) CN107589838A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109462637A (en) * 2018-10-17 2019-03-12 广东电网有限责任公司 MR expert's remote collaboration method and system based on power equipment 3D model library

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101902377A (en) * 2010-07-23 2010-12-01 四川长虹电器股份有限公司 Video following play system and method based on home network
CN103413487A (en) * 2013-07-30 2013-11-27 国网电力科学研究院武汉南瑞有限责任公司 Transformer assembling technology interactive simulation system and method
CN104133813A (en) * 2014-08-11 2014-11-05 南通大学 Navy semaphore training method based on Kinect
CN104869453A (en) * 2015-05-04 2015-08-26 小米科技有限责任公司 Video playing equipment control method and device
CN105278685A (en) * 2015-09-30 2016-01-27 陕西科技大学 Assistant instructing system and assistant instructing system method based on EON
CN106340217A (en) * 2016-10-31 2017-01-18 华中科技大学 Augmented reality technology based manufacturing equipment intelligent system and its implementation method
CN106803391A (en) * 2017-03-15 2017-06-06 国网山东省电力公司济宁供电公司 A kind of distribution uninterrupted operation training system and Training Methodology based on virtual reality
CN106843150A (en) * 2017-02-28 2017-06-13 清华大学 A kind of industry spot simulation method and device
CN106971028A (en) * 2017-03-10 2017-07-21 福州众衡时代信息科技有限公司 It is a kind of that virtual reality technology is used for the method for assembled architecture industry
CN206431875U (en) * 2016-04-29 2017-08-22 吉林医药学院 Medical anatomy assisted teaching system based on augmented reality

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101902377A (en) * 2010-07-23 2010-12-01 四川长虹电器股份有限公司 Video following play system and method based on home network
CN103413487A (en) * 2013-07-30 2013-11-27 国网电力科学研究院武汉南瑞有限责任公司 Transformer assembling technology interactive simulation system and method
CN104133813A (en) * 2014-08-11 2014-11-05 南通大学 Navy semaphore training method based on Kinect
CN104869453A (en) * 2015-05-04 2015-08-26 小米科技有限责任公司 Video playing equipment control method and device
CN105278685A (en) * 2015-09-30 2016-01-27 陕西科技大学 Assistant instructing system and assistant instructing system method based on EON
CN206431875U (en) * 2016-04-29 2017-08-22 吉林医药学院 Medical anatomy assisted teaching system based on augmented reality
CN106340217A (en) * 2016-10-31 2017-01-18 华中科技大学 Augmented reality technology based manufacturing equipment intelligent system and its implementation method
CN106843150A (en) * 2017-02-28 2017-06-13 清华大学 A kind of industry spot simulation method and device
CN106971028A (en) * 2017-03-10 2017-07-21 福州众衡时代信息科技有限公司 It is a kind of that virtual reality technology is used for the method for assembled architecture industry
CN106803391A (en) * 2017-03-15 2017-06-06 国网山东省电力公司济宁供电公司 A kind of distribution uninterrupted operation training system and Training Methodology based on virtual reality

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109462637A (en) * 2018-10-17 2019-03-12 广东电网有限责任公司 MR expert's remote collaboration method and system based on power equipment 3D model library

Similar Documents

Publication Publication Date Title
US11113885B1 (en) Real-time views of mixed-reality environments responsive to motion-capture data
CN109144273B (en) A virtual firefighting experience method based on VR technology
US20220038777A1 (en) Video distribution system, video distribution method, and video distribution program
US20160110922A1 (en) Method and system for enhancing communication by using augmented reality
Ponder et al. Immersive VR decision training: telling interactive stories featuring advanced virtual human simulation technologies
CN105513436B (en) Interactive holographic phantom teaching system and method
US20140002493A1 (en) Augmented reality simulation continuum
Danieau et al. Framework for enhancing video viewing experience with haptic effects of motion
CN105374251A (en) Mine virtual reality training system based on immersion type input and output equipment
CN107670272A (en) Intelligent somatosensory and tactile interactive scene simulation method based on VR technology
CN107168525A (en) It is a kind of that the system and method that autism children pairing is trained is aided in fine gesture identifying device
CN108805766B (en) AR somatosensory immersive teaching system and method
CN107918482A (en) The method and system of overstimulation is avoided in immersion VR systems
US20240104870A1 (en) AR Interactions and Experiences
CN204406327U (en) Based on the limb rehabilitating analog simulation training system of said three-dimensional body sense video camera
CN108877361A (en) The man-machine robot system for teaching mode altogether
Niewiadomski et al. Human and virtual agent expressive gesture quality analysis and synthesis
Kico et al. A mobile augmented reality interface for teaching folk dances
CN105355112B (en) For training the system of electrical equipment operation
CN205540577U (en) Live device of virtual teaching video
CN107589838A (en) The method of combining the play of SOP video to guide the operation with the VR method
CN108815845B (en) The information processing method and device of human-computer interaction, computer equipment and readable medium
CN103280125A (en) Motion capturing device for simulating operation in three-dimensional scene
JP7373599B2 (en) Systems, methods and programs for creating videos
Guillotel et al. Introducing Basic Principles of Haptic Cinematography and Editing.

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20180116

RJ01 Rejection of invention patent application after publication