CN106843150A - A kind of industry spot simulation method and device - Google Patents
A kind of industry spot simulation method and device Download PDFInfo
- Publication number
- CN106843150A CN106843150A CN201710114493.5A CN201710114493A CN106843150A CN 106843150 A CN106843150 A CN 106843150A CN 201710114493 A CN201710114493 A CN 201710114493A CN 106843150 A CN106843150 A CN 106843150A
- Authority
- CN
- China
- Prior art keywords
- user
- industrial equipment
- virtual
- real
- instruction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 57
- 238000004088 simulation Methods 0.000 title claims abstract description 31
- 230000003190 augmentative effect Effects 0.000 claims description 41
- 238000012545 processing Methods 0.000 claims description 30
- 239000004576 sand Substances 0.000 claims description 11
- 230000009471 action Effects 0.000 claims description 7
- 244000035744 Hura crepitans Species 0.000 claims description 4
- 238000012549 training Methods 0.000 abstract description 12
- 239000000463 material Substances 0.000 abstract description 8
- 238000005516 engineering process Methods 0.000 description 14
- 230000008569 process Effects 0.000 description 14
- 239000000306 component Substances 0.000 description 10
- 230000006870 function Effects 0.000 description 7
- 238000006073 displacement reaction Methods 0.000 description 6
- 230000003993 interaction Effects 0.000 description 5
- 238000004519 manufacturing process Methods 0.000 description 5
- 238000003801 milling Methods 0.000 description 5
- 238000007654 immersion Methods 0.000 description 4
- 230000008676 import Effects 0.000 description 4
- 230000002452 interceptive effect Effects 0.000 description 4
- 238000011161 development Methods 0.000 description 3
- 238000009877 rendering Methods 0.000 description 3
- 238000003860 storage Methods 0.000 description 3
- 230000001960 triggered effect Effects 0.000 description 3
- 230000006399 behavior Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 238000005553 drilling Methods 0.000 description 2
- 238000007667 floating Methods 0.000 description 2
- 238000000227 grinding Methods 0.000 description 2
- 238000003754 machining Methods 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 238000004806 packaging method and process Methods 0.000 description 2
- 238000012805 post-processing Methods 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 238000007514 turning Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 241000251468 Actinopterygii Species 0.000 description 1
- 241000196324 Embryophyta Species 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000001816 cooling Methods 0.000 description 1
- 239000008358 core component Substances 0.000 description 1
- 238000005520 cutting process Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 230000033764 rhythmic process Effects 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/18—Numerical control [NC], i.e. automatically operating machines, in particular machine tools, e.g. in a manufacturing environment, so as to execute positioning, movement or co-ordinated operations by means of programme data in numerical form
- G05B19/406—Numerical control [NC], i.e. automatically operating machines, in particular machine tools, e.g. in a manufacturing environment, so as to execute positioning, movement or co-ordinated operations by means of programme data in numerical form characterised by monitoring or safety
- G05B19/4069—Simulating machining process on screen
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/30—Nc systems
- G05B2219/31—From computer integrated manufacturing till monitoring
- G05B2219/31444—Compare actual manufacturing sequence with simulated sequence, correct actual
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- Manufacturing & Machinery (AREA)
- Automation & Control Theory (AREA)
- Processing Or Creating Images (AREA)
Abstract
本发明公开了一种工业现场仿真模拟方法和装置，所述方法包括：显示可供展示的虚拟工业设备；接收用户的选择指令，通过混合现实或增强现实的方式将用户所选择的虚拟工业设备与用户所在的真实场景相融合；接收用户的操作指令，使所述虚拟工业设备根据所述操作指令，进行相应的操作展示。本发明实施例通过模拟工业设备操作的真实场景，使用户有身临其境的感觉，便于用户学习和理解工业设备的实际结构和操作方法，很大程度上解决在车间训练中由于设备少，材料不足，耗材贵而产生的供需矛盾，减小机器的损耗，增大零件成品率。
The invention discloses an industrial site simulation method and device. The method includes: displaying virtual industrial equipment available for display; Integrate with the real scene where the user is located; receive the user's operation instruction, and make the virtual industrial equipment perform corresponding operation display according to the operation instruction. By simulating the real scene of industrial equipment operation, the embodiment of the present invention makes the user have an immersive feeling, facilitates the user to learn and understand the actual structure and operation method of the industrial equipment, and largely solves the problem of insufficient equipment in the workshop training. The contradiction between supply and demand caused by insufficient materials and expensive consumables reduces the loss of the machine and increases the yield of parts.
Description
技术领域technical field
本发明涉及机械制造和信息技术领域，尤指一种工业现场仿真模拟方法和装置。The invention relates to the fields of mechanical manufacturing and information technology, in particular to an industrial field simulation method and device.
背景技术Background technique
现代机械制造技术已得到越来越广泛的应用，我国的机械制造技术水平与发达国家相比还有一定差距，21世纪机械制造技术的发展方向可用“三化”来概括，即全球化、虚拟化和绿色化。Modern machinery manufacturing technology has been more and more widely used. There is still a certain gap between my country's machinery manufacturing technology level and developed countries. The development direction of machinery manufacturing technology in the 21st century can be summarized by "three modernizations", that is, globalization, virtualization and greening.
以往的机械加工危险性高，对操作人员技术要求过硬。所以前期的训练十分重要，然而由于大型机械设备的场地限制，人们只能通过师傅带领的方式亲自来到工厂来操作，并且纯机械设备没有指令提示，只能通过运转位置来判断当前机器状态。这样不仅效率低，还容易损坏机器设备，对于训练来说有一定的难度。In the past, mechanical processing was highly dangerous, and the technical requirements for operators were strong. Therefore, early training is very important. However, due to the limited space of large-scale mechanical equipment, people can only come to the factory to operate it in person under the leadership of the master, and there is no instruction prompt for pure mechanical equipment, and the current machine status can only be judged by the operating position. This is not only inefficient, but also easy to damage the machine equipment, which is difficult for training.
目前也有一些虚拟机械加工训练的系统或方法，但是其都是通过相关动画软件设计的，主要以模拟工厂、企业产品的操作流程做演示，对于外行人员来说实用性不强，而且其训练是以教程的训练形式进行训练，理论性比较强，与实际的机械加工还有很大差距。At present, there are also some systems or methods for virtual machining training, but they are all designed through relevant animation software, mainly to simulate the operation process of factories and enterprise products for demonstration, which is not very practical for laymen, and its training is very difficult. Training in the form of tutorial training is relatively strong in theory, and there is still a big gap with actual machining.
发明内容Contents of the invention
为了解决上述技术问题，本发明提供了一种工业现场仿真模拟方法和装置，通过混合现实或增强现实的技术，可以模拟工业设备操作的真实场景。In order to solve the above technical problems, the present invention provides an industrial field simulation method and device, which can simulate the real scene of industrial equipment operation through mixed reality or augmented reality technology.
为了达到本发明目的，本发明提供了一种工业现场仿真模拟方法，包括：In order to achieve the purpose of the present invention, the present invention provides a kind of industrial field simulation simulation method, comprising:
显示可供展示的虚拟工业设备；Display virtual industrial equipment available for display;
接收用户的选择指令，通过混合现实或增强现实的方式将用户所选择的虚拟工业设备与用户所在的真实场景相融合；Receive the user's selection instruction, and integrate the virtual industrial equipment selected by the user with the real scene where the user is located through mixed reality or augmented reality;
接收用户的操作指令，使所述虚拟工业设备根据所述操作指令，进行相应的操作展示。The user's operation instruction is received, so that the virtual industrial equipment performs corresponding operation display according to the operation instruction.
可选地，所述方法还包括：Optionally, the method also includes:
接收用户的调整指令，根据所述调整指令对所述虚拟工业设备进行如下一种或多种组合的调整操作：Receive an adjustment instruction from the user, and perform one or a combination of the following adjustment operations on the virtual industrial equipment according to the adjustment instruction:
缩放、旋转、位移。Scale, rotate, shift.
可选地，所述方法还包括：Optionally, the method also includes:
通过混合现实或增强现实的方式显示所述虚拟工业设备每个部分的信息。The information of each part of the virtual industrial equipment is displayed by means of mixed reality or augmented reality.
可选地，所述接收用户的操作指令，使所述虚拟工业设备根据所述操作指令，进行相应的操作展示的步骤中，Optionally, in the step of receiving an operation instruction from the user and making the virtual industrial equipment perform corresponding operation display according to the operation instruction,
若所述操作指令有误，则进行操作错误提示。If the operation instruction is wrong, an operation error prompt is given.
可选地，所述进行操作错误提示之后，还包括：Optionally, after the operation error prompt, it also includes:
若用户继续执行错误操作，则演示所述错误操作的后果。If the user continues to perform wrong actions, demonstrate the consequences of said wrong actions.
可选地，所述方法还包括：Optionally, the method also includes:
接收用户的选择指令，通过混合现实或增强现实的方式将用户所选择的虚拟工厂沙盘与用户所在的真实场景相融合；Receive the user's selection instruction, and integrate the virtual factory sand table selected by the user with the real scene where the user is located through mixed reality or augmented reality;
接收用户的操作指令，按照所述用户的操作指令展示所述虚拟工厂沙盘中的一个或多个细节。An operation instruction of the user is received, and one or more details in the virtual factory sandbox are displayed according to the operation instruction of the user.
可选地，所述方法还包括：Optionally, the method also includes:
将虚拟工业设备与真实工业设备相关联，通过真实工业设备上设置的传感器获取所述真实工业设备的信息，通过混合现实或增强现实的方式在所述真实工业设备上同步叠加虚拟拓展信息。Associate the virtual industrial equipment with the real industrial equipment, obtain the information of the real industrial equipment through the sensors set on the real industrial equipment, and synchronously superimpose the virtual extended information on the real industrial equipment through mixed reality or augmented reality.
可选地，所述方法还包括：Optionally, the method also includes:
用户操作所述真实工业设备时，通过混合现实或增强现实的方式显示如下提示信息中的一种或多种：When the user operates the real industrial equipment, one or more of the following prompt information is displayed through mixed reality or augmented reality:
加工提示、加工指引、操作错误提示。Processing prompts, processing guidelines, and operation error prompts.
本发明还提供了一种工业现场仿真模拟装置，包括：The present invention also provides an industrial field simulation simulation device, comprising:
菜单模块，用于显示可供展示的虚拟工业设备；The menu module is used to display the virtual industrial equipment available for display;
定位模块，用于接收用户的选择指令，通过混合现实或增强现实的方式将用户所选择的虚拟工业设备与用户所在的真实场景相融合；The positioning module is used to receive the user's selection instruction, and integrate the virtual industrial equipment selected by the user with the real scene where the user is located through mixed reality or augmented reality;
展示模块，用于接收用户的操作指令，使所述虚拟工业设备根据所述操作指令，进行相应的操作展示。The display module is configured to receive an operation instruction from a user, and make the virtual industrial equipment perform corresponding operation display according to the operation instruction.
可选地，所述装置还包括：Optionally, the device also includes:
调整模块，用于接收用户的调整指令，根据所述调整指令对所述虚拟工业设备进行如下调整操作中的一种或多种组合：An adjustment module, configured to receive an adjustment instruction from a user, and perform one or more combinations of the following adjustment operations on the virtual industrial equipment according to the adjustment instruction:
缩放、旋转、位移。Scale, rotate, shift.
本发明实施例包括：显示可供展示的虚拟工业设备；接收用户的选择指令，通过混合现实或增强现实的方式将用户所选择的虚拟工业设备与用户所在的真实场景相融合；接收用户的操作指令，使所述虚拟工业设备根据所述操作指令，进行相应的操作展示。本发明实施例通过模拟工业设备操作的真实场景，使用户有身临其境的感觉，便于用户学习和理解工业设备的实际结构和操作方法，很大程度上解决在车间训练中由于设备少，材料不足，耗材贵而产生的供需矛盾，减小机器的损耗，增大零件成品率。The embodiment of the present invention includes: displaying the virtual industrial equipment available for display; receiving the user's selection instruction, and merging the virtual industrial equipment selected by the user with the real scene where the user is in the way of mixed reality or augmented reality; receiving the user's operation instructions, so that the virtual industrial equipment performs corresponding operation display according to the operation instructions. By simulating the real scene of industrial equipment operation, the embodiment of the present invention makes the user feel personally on the scene, which is convenient for the user to learn and understand the actual structure and operation method of the industrial equipment, and largely solves the problems caused by the lack of equipment in the workshop training. The contradiction between supply and demand caused by insufficient materials and expensive consumables reduces the loss of the machine and increases the yield of parts.
进一步地，可以对所述虚拟工业设备进行缩放、旋转、位移等调整操作，可以将虚拟工业设备放置在用户希望的任意位置，而且用户可以以多角度、多方位详细观察工业设备结构。Further, adjustment operations such as scaling, rotation, and displacement can be performed on the virtual industrial equipment, and the virtual industrial equipment can be placed at any position desired by the user, and the user can observe the structure of the industrial equipment in detail from multiple angles and directions.
进一步地，通过混合现实或增强现实的方式显示所述虚拟工业设备每个部分的信息，可以使用户加深对工业设备的了解。Further, by displaying the information of each part of the virtual industrial equipment in the way of mixed reality or augmented reality, the user can deepen the understanding of the industrial equipment.
进一步地，当操作指令有误，进行操作错误提示，可以避免用户在操作真实工业设备时，出现类似错误；以及，若用户继续执行错误操作，演示所述错误操作的后果，使用户对操作错误的后果有更深刻的认识。Further, when the operation instruction is wrong, prompting the operation error can prevent the user from making similar mistakes when operating real industrial equipment; A deeper understanding of the consequences.
进一步地，通过沙盘的方式显示工厂的整体结构和各个细节，使用户对工厂的整体和细节有直观的认识和理解。Furthermore, the overall structure and details of the factory are displayed in the form of a sand table, so that users can have an intuitive understanding of the whole and details of the factory.
进一步地，通过混合现实或增强现实的方式在所述真实工业设备上同步叠加虚拟拓展信息，可以使得用户在操作真实工业设备时，以直观的形式获取工业设备的真实信息。Further, by synchronously superimposing virtual extended information on the real industrial equipment in the way of mixed reality or augmented reality, the user can obtain the real information of the industrial equipment in an intuitive form when operating the real industrial equipment.
进一步地，当用户操作所述真实工业设备时，采用加工提示、加工指引、或操作错误提示的方式，指导用户操作工业设备，一方面用户通过实际操作时，可以根据指导进行操作，提高了用户的实际操作水平，另一方面也避免由于误操作导致工业设备损坏，并且提高了零件成品率。Further, when the user operates the real industrial equipment, the user is guided to operate the industrial equipment by means of processing prompts, processing guidance, or operation error prompts. On the one hand, the user can operate according to the guidance during the actual operation, which improves the user experience. On the other hand, it also avoids damage to industrial equipment due to misoperation, and improves the yield of parts.
本发明的其它特征和优点将在随后的说明书中阐述，并且，部分地从说明书中变得显而易见，或者通过实施本发明而了解。本发明的目的和其他优点可通过在说明书、权利要求书以及附图中所特别指出的结构来实现和获得。Additional features and advantages of the invention will be set forth in the description which follows, and in part will be apparent from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention may be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
附图说明Description of drawings
附图用来提供对本发明技术方案的进一步理解，并且构成说明书的一部分，与本申请的实施例一起用于解释本发明的技术方案，并不构成对本发明技术方案的限制。The accompanying drawings are used to provide a further understanding of the technical solution of the present invention, and constitute a part of the description, and are used together with the embodiments of the application to explain the technical solution of the present invention, and do not constitute a limitation to the technical solution of the present invention.
图1为本发明实施例的工业现场仿真模拟方法流程图；Fig. 1 is the flow chart of the industrial field simulation simulation method of the embodiment of the present invention;
图2为本发明实施例的工业现场仿真模拟装置示意图；Fig. 2 is the schematic diagram of the industrial field simulation simulation device of the embodiment of the present invention;
图3为本发明应用实例的工业现场仿真模拟方法流程图。Fig. 3 is a flow chart of the industrial field simulation method of the application example of the present invention.
具体实施方式detailed description
为使本发明的目的、技术方案和优点更加清楚明白，下文中将结合附图对本发明的实施例进行详细说明。需要说明的是，在不冲突的情况下，本申请中的实施例及实施例中的特征可以相互任意组合。In order to make the purpose, technical solution and advantages of the present invention more clear, the embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings. It should be noted that, in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined arbitrarily with each other.
在附图的流程图示出的步骤可以在诸如一组计算机可执行指令的计算机系统中执行。并且，虽然在流程图中示出了逻辑顺序，但是在某些情况下，可以以不同于此处的顺序执行所示出或描述的步骤。The steps shown in the flowcharts of the figures may be performed in a computer system, such as a set of computer-executable instructions. Also, although a logical order is shown in the flowcharts, in some cases the steps shown or described may be performed in an order different from that shown or described herein.
工业仿真，是对实体工业的一种虚拟。具体来说就是将实体工业中的各个模块转化成数据整合到一个虚实混合的体系中去，在这个体系中模拟实现工业作业中的每一项工作和流程，并与之实现各种交互。Industrial simulation is a kind of virtualization of physical industry. Specifically, it is to convert various modules in the physical industry into data and integrate them into a virtual-real mixed system, in which each work and process in industrial operations is simulated and realized, and various interactions are realized with it.
本发明实施例基于增强现实技术(AR)或混合现实技术(MR)，所述增强现实技术是一种将真实世界信息和虚拟世界信息“无缝”集成的新技术，是把原本在现实世界的一定时间空间范围内很难体验到的实体信息(视觉信息、声音、味道、触觉等)通过电脑等科学技术，模拟仿真后再叠加，将虚拟的信息应用到真实世界，被人类感官所感知，从而达到超越现实的感官体验。真实的环境和虚拟的物体实时地叠加到了同一个画面或空间同时存在。所述混合现实技术技术结合了虚拟现实技术(VR)与AR的优势，通过在真实环境中引入虚拟场景信息，在虚拟和现实之间为用户搭起一个交互反馈的信息回路，以增强用户体验的真实感。The embodiment of the present invention is based on augmented reality technology (AR) or mixed reality technology (MR). The augmented reality technology is a new technology that "seamlessly" integrates real world information and virtual world information. Physical information (visual information, sound, taste, touch, etc.) that is difficult to experience within a certain time and space range, through computer and other science and technology, simulated and then superimposed, and the virtual information is applied to the real world and perceived by human senses , so as to achieve a sensory experience beyond reality. The real environment and virtual objects are superimposed on the same screen or space in real time. The mixed reality technology combines the advantages of virtual reality technology (VR) and AR. By introducing virtual scene information into the real environment, an interactive feedback information loop is set up for users between virtual and reality to enhance user experience. sense of reality.
如图1所示，本发明实施例的工业现场仿真模拟方法包括：As shown in Figure 1, the industrial field simulation method of the embodiment of the present invention comprises:
步骤101，显示可供展示的虚拟工业设备；Step 101, displaying virtual industrial equipment available for display;
步骤102，接收用户的选择指令，通过混合现实或增强现实的方式将用户所选择的虚拟工业设备与用户所在的真实场景相融合；Step 102, receiving the user's selection instruction, and merging the virtual industrial equipment selected by the user with the real scene where the user is located through mixed reality or augmented reality;
步骤103，接收用户的操作指令，使所述虚拟工业设备根据所述操作指令，进行相应的操作展示。Step 103, receiving an operation instruction from the user, so that the virtual industrial equipment performs a corresponding operation display according to the operation instruction.
本发明实施例通过模拟工业设备操作的真实场景，使用户有身临其境的感觉，便于用户学习和理解工业设备的实际结构和操作方法，很大程度上解决在车间训练中由于设备少，材料不足，耗材贵而产生的供需矛盾，减小机器的损耗，增大零件成品率。By simulating the real scene of industrial equipment operation, the embodiment of the present invention makes the user feel personally on the scene, which is convenient for the user to learn and understand the actual structure and operation method of the industrial equipment, and largely solves the problems caused by the lack of equipment in the workshop training. The contradiction between supply and demand caused by insufficient materials and expensive consumables reduces the loss of the machine and increases the yield of parts.
本发明实施例中的工业设备可以是机床、仓储设备、物流转运设备、包装设备、传输设备、机器人、仪器仪表等可以放置在固定位置的设备。其中，机床可以包括车床、铣床、磨床、刨床、钻床等等。The industrial equipment in the embodiments of the present invention may be machine tools, storage equipment, logistics transfer equipment, packaging equipment, transmission equipment, robots, instruments, and other equipment that can be placed in fixed positions. Wherein, the machine tools may include lathes, milling machines, grinding machines, planers, drilling machines and the like.
本发明实施例的装置可以通过增强现实显示设备/混合现实显示设备(例如HoloLens)实现，通过增强现实显示设备/混合现实显示设备实时扫描室内环境，可以在眼前的空间内置放一比一虚拟工业设备，并使其功能同真实工业设备一样可交互操作，加工零件。如果单纯做演示的话，可以采用移动终端，例如手机、IPAD等实现，只是浸入感比专业的增强现实显示设备/混合现实显示设备稍差。The device of the embodiment of the present invention can be realized by an augmented reality display device/mixed reality display device (such as HoloLens), which scans the indoor environment in real time through the augmented reality display device/mixed reality display device, and can place a one-to-one virtual industrial environment in the immediate space. Equipment, and make its functions interoperable and process parts like real industrial equipment. If you simply do a demonstration, you can use mobile terminals, such as mobile phones, IPADs, etc., but the sense of immersion is slightly worse than that of professional augmented reality display devices/mixed reality display devices.
用户所使用的指令(选择指令、操作指令、调整指令等)可以采用语音、凝视、或手势的方式。其中，手势还可以包括点击、拖拽等。例如，用户可以通过语音的方式，使虚拟工业设备执行相应的指令。用户还可以通过点击的方式，确定虚拟工业设备的摆放位置，以及使虚拟工业设备运行所选定的指令。Instructions (selection instructions, operation instructions, adjustment instructions, etc.) used by the user may be in the form of voice, gaze, or gestures. Wherein, the gesture may also include click, drag and so on. For example, users can make virtual industrial equipment execute corresponding instructions through voice. The user can also determine the placement of the virtual industrial equipment by clicking, and make the virtual industrial equipment run the selected command.
可选地，所述方法还包括：Optionally, the method also includes:
接收用户的调整指令，根据所述调整指令对所述虚拟工业设备进行如下一种或多种组合的调整操作：Receive an adjustment instruction from the user, and perform one or a combination of the following adjustment operations on the virtual industrial equipment according to the adjustment instruction:
缩放、旋转、位移。Scale, rotate, shift.
例如，用户可以通过拖拽的方式，对虚拟工业设备进行缩放、旋转、或位移调整。通过对所述虚拟工业设备进行缩放、旋转、位移等调整操作，可以将虚拟工业设备放置在用户希望的任意位置，而且用户可以以多角度、多方位详细观察工业设备结构。For example, the user can zoom, rotate, or adjust the displacement of the virtual industrial equipment by dragging and dropping. By performing adjustment operations such as zooming, rotating, and shifting on the virtual industrial equipment, the virtual industrial equipment can be placed at any position desired by the user, and the user can observe the structure of the industrial equipment in detail from multiple angles and directions.
可选地，所述方法还包括：Optionally, the method also includes:
通过混合现实或增强现实的方式显示所述虚拟工业设备每个部分的信息。The information of each part of the virtual industrial equipment is displayed by means of mixed reality or augmented reality.
其中，可以显示所述虚拟工业设备每个部分的名称、各部分的相关介绍，还可以显示虚拟工业设备每个部分的尺寸参数。Wherein, the name of each part of the virtual industrial equipment, the related introduction of each part can be displayed, and the size parameters of each part of the virtual industrial equipment can also be displayed.
例如，用户可以通过凝视的方式，触发悬浮标注，从而介绍各部分功能。For example, the user can trigger the floating annotation by gazing to introduce the functions of each part.
通过混合现实或增强现实的方式显示所述虚拟工业设备每个部分的信息，可以使用户加深对工业设备的了解。By displaying the information of each part of the virtual industrial equipment in the way of mixed reality or augmented reality, the user can deepen the understanding of the industrial equipment.
所述步骤103中，用户可以通过操作指令(例如通过手势)操作工业设备，观看工业设备运行过程，还可以将虚拟加工完成的零件拿在手中观察。In the step 103, the user can operate the industrial equipment through operation instructions (such as gestures), watch the operation process of the industrial equipment, and hold the virtual processed parts in his hand to observe.
可选地，所述步骤103中，若所述操作指令有误，则进行操作错误提示。若用户继续执行错误操作，则演示所述错误操作的后果。Optionally, in the step 103, if the operation instruction is wrong, an operation error prompt is given. If the user continues to perform wrong actions, demonstrate the consequences of said wrong actions.
当操作指令有误，进行操作错误提示，可以避免用户在操作真实工业设备时，出现类似错误；以及，若用户继续执行错误操作，演示所述错误操作的后果，使用户对操作错误的后果有更深刻的认识。When the operation instruction is wrong, the operation error prompt can prevent the user from making similar mistakes when operating real industrial equipment; A deeper understanding.
可选地，所述方法还包括：Optionally, the method also includes:
接收用户的选择指令，通过混合现实或增强现实的方式将用户所选择的虚拟工厂沙盘与用户所在的真实场景相融合；Receive the user's selection instruction, and integrate the virtual factory sand table selected by the user with the real scene where the user is located through mixed reality or augmented reality;
接收用户的操作指令，按照所述用户的操作指令展示所述虚拟工厂沙盘中的一个或多个细节。An operation instruction of the user is received, and one or more details in the virtual factory sandbox are displayed according to the operation instruction of the user.
通过沙盘的方式显示工厂的整体结构和各个细节，使用户对工厂的整体和细节有直观的认识和理解。The overall structure and details of the factory are displayed in the form of a sand table, so that users can have an intuitive understanding of the whole and details of the factory.
可选地，所述方法还包括：Optionally, the method also includes:
将虚拟车床与真实工业设备相关联，通过真实工业设备上设置的传感器获取所述真实工业设备的信息，通过混合现实或增强现实的方式在所述真实工业设备上同步叠加虚拟拓展信息。The virtual lathe is associated with the real industrial equipment, the information of the real industrial equipment is obtained through the sensors set on the real industrial equipment, and the virtual extended information is synchronously superimposed on the real industrial equipment through mixed reality or augmented reality.
所述虚拟拓展信息可包括：工业设备各部件名称、介绍，还可以包括在用户操作时，各部件的实时参数，例如、旋转速度、进给速度、温度等。The virtual extended information may include: the name and introduction of each component of the industrial equipment, and may also include real-time parameters of each component during user operation, such as rotation speed, feed speed, temperature, etc.
通过混合现实或增强现实的方式在所述真实工业设备上同步叠加虚拟拓展信息，可以使得用户在操作真实工业设备时，以直观的形式获取工业设备的真实信息。By synchronously superimposing virtual extended information on the real industrial equipment in the way of mixed reality or augmented reality, the user can obtain the real information of the industrial equipment in an intuitive form when operating the real industrial equipment.
可选地，所述方法还包括：Optionally, the method also includes:
用户操作所述真实工业设备时，通过混合现实或增强现实的方式显示如下提示信息中的一种或多种：When the user operates the real industrial equipment, one or more of the following prompt information is displayed through mixed reality or augmented reality:
加工提示、加工指引、操作错误提示。Processing prompts, processing guidelines, and operation error prompts.
当用户操作所述真实工业设备时，采用加工提示、加工指引、或操作错误提示的方式，指导用户操作工业设备，一方面用户通过实际操作时，可以根据指导进行操作，提高了用户的实际操作水平，另一方面也避免由于误操作导致工业设备损坏，并且提高了零件成品率。When the user operates the real industrial equipment, the user is guided to operate the industrial equipment by means of processing prompts, processing instructions, or operation error prompts. On the one hand, the user can operate according to the guidance during the actual operation, which improves the actual operation of the user. On the other hand, it also avoids damage to industrial equipment due to misoperation, and improves the yield of parts.
本发明实施例可以用于机械制造者和学者等人员的工业仿真演示及教学，利用混合现实技术或增强现实技术的交互性和真实性，让使用者进入到混合世界当中，反复地进行全程或分解项目训练，直到对技能要求的掌握和了解。也可通过虚拟训练的过程，及时了解在操作过程中出现的多样性和不确定性，以便在真实操作时做到有的放矢。通过逼真的模拟练习和其针对性的引导，不必担心出现安全问题，放心大胆的操作尝试，使得在真正的操作环境中就可以如鱼得水，真正提高自身操作技能水平。The embodiment of the present invention can be used for industrial simulation demonstration and teaching of machinery manufacturers and scholars, and uses the interactivity and authenticity of mixed reality technology or augmented reality technology to allow users to enter the mixed world and repeatedly perform the whole process or Break down project training until mastery and understanding of skill requirements. It is also possible to keep abreast of the diversity and uncertainty in the operation process through the process of virtual training, so as to be targeted in real operation. Through realistic simulation exercises and targeted guidance, you don’t have to worry about safety issues, and you can safely and boldly try to operate, so that you can feel like a fish in water in a real operating environment and truly improve your own operating skills.
如图2所示，本发明实施例的工业现场仿真模拟装置包括：As shown in Figure 2, the industrial field simulation device of the embodiment of the present invention comprises:
菜单模块21，用于显示可供展示的虚拟工业设备；The menu module 21 is used to display the virtual industrial equipment available for display;
定位模块22，用于接收用户的选择指令，通过混合现实或增强现实的方式将用户所选择的虚拟工业设备与用户所在的真实场景相融合；The positioning module 22 is configured to receive the user's selection instruction, and integrate the virtual industrial equipment selected by the user with the real scene where the user is located through mixed reality or augmented reality;
展示模块23，用于接收用户的操作指令，使所述虚拟工业设备根据所述操作指令，进行相应的操作展示。The presentation module 23 is configured to receive an operation instruction from a user, and make the virtual industrial equipment perform a corresponding operation display according to the operation instruction.
本发明实施例通过模拟工业设备操作的真实场景，使用户有身临其境的感觉，便于用户学习和理解工业设备的实际结构和操作方法，很大程度上解决在车间训练中由于设备少，材料不足，耗材贵而产生的供需矛盾，减小机器的损耗，增大零件成品率。By simulating the real scene of industrial equipment operation, the embodiment of the present invention makes the user feel personally on the scene, which is convenient for the user to learn and understand the actual structure and operation method of the industrial equipment, and largely solves the problems caused by the lack of equipment in the workshop training. The contradiction between supply and demand caused by insufficient materials and expensive consumables reduces the loss of the machine and increases the yield of parts.
本发明实施例中的工业设备可以是机床、仓储设备、物流转运设备、包装设备、传输设备、机器人、仪器仪表等可以放置在固定位置的设备。其中，机床可以包括车床、铣床、磨床、刨床、钻床等等。The industrial equipment in the embodiments of the present invention may be machine tools, storage equipment, logistics transfer equipment, packaging equipment, transmission equipment, robots, instruments, and other equipment that can be placed in fixed positions. Wherein, the machine tools may include lathes, milling machines, grinding machines, planers, drilling machines and the like.
本发明实施例的装置可以通过增强现实显示设备/混合现实显示设备(例如HoloLens)实现，通过增强现实显示设备/混合现实显示设备实时扫描室内环境，可以在眼前的空间内置放一比一虚拟工业设备，并使其功能同真实工业设备一样可交互操作，加工零件。如果单纯做演示的话，可以采用移动终端，例如手机、IPAD等实现，只是浸入感比专业的增强现实显示设备/混合现实显示设备稍差。The device of the embodiment of the present invention can be realized by an augmented reality display device/mixed reality display device (such as HoloLens), which scans the indoor environment in real time through the augmented reality display device/mixed reality display device, and can place a one-to-one virtual industrial environment in the immediate space. Equipment, and make its functions interoperable and process parts like real industrial equipment. If you simply do a demonstration, you can use mobile terminals, such as mobile phones, IPADs, etc., but the sense of immersion is slightly worse than that of professional augmented reality display devices/mixed reality display devices.
用户所使用的指令(选择指令、操作指令、调整指令等)可以采用语音、凝视、或手势的方式。其中，手势还可以包括点击、拖拽等。例如，用户可以通过语音的方式，使虚拟工业设备执行相应的指令。用户还可以通过点击的方式，确定虚拟工业设备的摆放位置，以及使虚拟工业设备运行所选定的指令。Instructions (selection instructions, operation instructions, adjustment instructions, etc.) used by the user may be in the form of voice, gaze, or gestures. Wherein, the gesture may also include click, drag and so on. For example, users can make virtual industrial equipment execute corresponding instructions through voice. The user can also determine the placement of the virtual industrial equipment by clicking, and make the virtual industrial equipment run the selected command.
可选地，所述装置还包括：Optionally, the device also includes:
调整模块，用于接收用户的调整指令，根据所述调整指令对所述虚拟工业设备进行如下调整操作中的一种或多种组合：An adjustment module, configured to receive an adjustment instruction from a user, and perform one or more combinations of the following adjustment operations on the virtual industrial equipment according to the adjustment instruction:
缩放、旋转、位移。Scale, rotate, shift.
例如，用户可以通过拖拽的方式，对虚拟工业设备进行缩放、旋转、或位移调整。通过对所述虚拟工业设备进行缩放、旋转、位移等调整操作，可以将虚拟工业设备放置在用户希望的任意位置，而且用户可以以多角度、多方位详细观察工业设备结构。For example, the user can zoom, rotate, or adjust the displacement of the virtual industrial equipment by dragging and dropping. By performing adjustment operations such as zooming, rotating, and shifting on the virtual industrial equipment, the virtual industrial equipment can be placed at any position desired by the user, and the user can observe the structure of the industrial equipment in detail from multiple angles and directions.
可选地，所述展示模块23，还用于通过混合现实或增强现实的方式显示所述虚拟工业设备每个部分的信息。Optionally, the presentation module 23 is further configured to display the information of each part of the virtual industrial equipment through mixed reality or augmented reality.
其中，可以显示所述虚拟工业设备每个部分的名称、各部分的相关介绍，还可以显示虚拟工业设备每个部分的尺寸参数。Wherein, the name of each part of the virtual industrial equipment, the related introduction of each part can be displayed, and the size parameters of each part of the virtual industrial equipment can also be displayed.
例如，用户可以通过凝视的方式，触发悬浮标注，从而介绍各部分功能。For example, the user can trigger the floating annotation by gazing to introduce the functions of each part.
通过混合现实或增强现实的方式显示所述虚拟工业设备每个部分的信息，可以使用户加深对工业设备的了解。By displaying the information of each part of the virtual industrial equipment in the way of mixed reality or augmented reality, the user can deepen the understanding of the industrial equipment.
通过展示模块23，用户可以通过操作指令(例如通过手势)操作工业设备，观看工业设备运行过程，还可以将虚拟加工完成的零件拿在手中观察。Through the display module 23, the user can operate the industrial equipment through operation instructions (such as gestures), watch the operation process of the industrial equipment, and hold the virtual processed parts in his hand to observe.
可选地，所述展示模块23，还用于若所述操作指令有误，则进行操作错误提示。Optionally, the display module 23 is further configured to prompt an operation error if the operation instruction is wrong.
可选地，所述展示模块23，还用于若用户继续执行错误操作，则演示所述错误操作的后果。Optionally, the presentation module 23 is further configured to demonstrate the consequences of the wrong operation if the user continues to perform the wrong operation.
当操作指令有误，进行操作错误提示，可以避免用户在操作真实工业设备时，出现类似错误；以及，若用户继续执行错误操作，演示所述错误操作的后果，使用户对操作错误的后果有更深刻的认识。When the operation instruction is wrong, the operation error prompt can prevent the user from making similar mistakes when operating real industrial equipment; A deeper understanding.
可选地，所述装置还包括：Optionally, the device also includes:
沙盘模块，用于接收用户的选择指令，通过混合现实或增强现实的方式将用户所选择的虚拟工厂沙盘与用户所在的真实场景相融合；The sand table module is used to receive the user's selection instruction, and integrate the virtual factory sand table selected by the user with the real scene where the user is located through mixed reality or augmented reality;
所述展示模块23，还用于接收用户的操作指令，按照所述用户的操作指令展示所述虚拟工厂沙盘中的一个或多个细节。The presentation module 23 is further configured to receive an operation instruction from a user, and display one or more details in the virtual factory sandbox according to the operation instruction of the user.
通过沙盘的方式显示工厂的整体结构和各个细节，使用户对工厂的整体和细节有直观的认识和理解。The overall structure and details of the factory are displayed in the form of a sand table, so that users can have an intuitive understanding of the whole and details of the factory.
可选地，所述装置还包括：Optionally, the device also includes:
关联模块，用于将虚拟车床与真实工业设备相关联，通过真实工业设备上设置的传感器获取所述真实工业设备的信息；The association module is used to associate the virtual lathe with the real industrial equipment, and obtain the information of the real industrial equipment through the sensors set on the real industrial equipment;
所述展示模块23，还用于通过混合现实或增强现实的方式在所述真实工业设备上同步叠加虚拟拓展信息。The display module 23 is also used to synchronously superimpose virtual extended information on the real industrial equipment through mixed reality or augmented reality.
所述虚拟拓展信息可包括：工业设备各部件名称、介绍，还可以包括在用户操作时，各部件的实时参数，例如、旋转速度、进给速度、温度等。The virtual extended information may include: the name and introduction of each component of the industrial equipment, and may also include real-time parameters of each component during user operation, such as rotation speed, feed speed, temperature, etc.
通过混合现实或增强现实的方式在所述真实工业设备上同步叠加虚拟拓展信息，可以使得用户在操作真实工业设备时，以直观的形式获取工业设备的真实信息。By synchronously superimposing virtual extended information on the real industrial equipment in the way of mixed reality or augmented reality, the user can obtain the real information of the industrial equipment in an intuitive form when operating the real industrial equipment.
可选地，所述方法还包括：Optionally, the method also includes:
所述展示模块23，还用于用户操作所述真实工业设备时，通过混合现实或增强现实的方式显示如下提示信息中的一种或多种：The display module 23 is also used to display one or more of the following prompt information in the form of mixed reality or augmented reality when the user operates the real industrial equipment:
加工提示、加工指引、操作错误提示。Processing prompts, processing guidelines, and operation error prompts.
当用户操作所述真实工业设备时，采用加工提示、加工指引、或操作错误提示的方式，指导用户操作工业设备，一方面用户通过实际操作时，可以根据指导进行操作，提高了用户的实际操作水平，另一方面也避免由于误操作导致工业设备损坏，并且提高了零件成品率。When the user operates the real industrial equipment, the user is guided to operate the industrial equipment by means of processing prompts, processing instructions, or operation error prompts. On the one hand, the user can operate according to the guidance during the actual operation, which improves the actual operation of the user. On the other hand, it also avoids damage to industrial equipment due to misoperation, and improves the yield of parts.
下面以采用混合现实显示设备HoloLens为例进一步说明本发明：The present invention is further described by taking the mixed reality display device HoloLens as an example below:
搭建虚拟仿真现场：根据前期数据测量及后期处理所获得的真实工业场景数据导入到仿真软件中搭建而成、设置交互方式及关键动画、测试并导入混合现实显示设备、通过头部四颗传感器实时探测环境并自动搭建环境模型、将预先搭建的工业仿真场景实时叠加到真实空间中，并通过仿真平台，运行模拟生产的仿真系统，使用者一方面通过头戴混合现实显示器观察工业现场运行情况，另一方面通过手势操作具有报错提醒的虚拟工业场景内的机械设备，从而完成虚拟零件加工过程，该操作自由，是具有真实声音模拟及误操作提示的，在进行虚拟零部件加工时，可以得到近似真实加工的感受。最终实现在真实场景中布置搭建一个虚拟工业现场，并能够进行系统中各台设备间协调统一的仿真运转。Build a virtual simulation site: import the real industrial scene data obtained from the previous data measurement and post-processing into the simulation software to build, set the interaction mode and key animation, test and import the mixed reality display device, and real-time through the four sensors on the head Detect the environment and automatically build the environment model, superimpose the pre-built industrial simulation scene into the real space in real time, and run the simulation system for simulating production through the simulation platform. On the other hand, the mechanical equipment in the virtual industrial scene with error reminder is operated by gestures to complete the virtual parts processing process. This operation is free, with real sound simulation and misoperation prompts. When processing virtual parts, you can get Approximate the feeling of real processing. Finally, a virtual industrial site can be arranged and built in the real scene, and the coordinated and unified simulation operation of each device in the system can be carried out.
具体地，实现本发明应用实例的准备工作有：Specifically, the preparatory work for realizing the application example of the present invention includes:
一、准备素材：1. Prepare materials:
1、现场测绘：测量机身尺寸，画简易草图记录；1. On-site surveying and mapping: measure the size of the fuselage, draw a simple sketch record;
2、参考图片：以三视图为主，实地拍摄(注意透视关系及镜头畸变)以及大量细节图；2. Reference pictures: based on three views, on-site shooting (pay attention to perspective relationship and lens distortion) and a large number of detailed pictures;
3、材质贴图：例如机身注意事项、关键参数关键物等平行拍摄(导入到图片处理软件细调，使多个贴图统一、真实)；3. Material maps: such as body precautions, key parameters and key objects, etc. parallel shooting (imported into image processing software for fine adjustment, so that multiple maps are unified and real);
4、了解运作方式：找到专业人员，详细了解操作步骤(例如手柄、盖板以何种方式、方向旋转或移动，会产生什么效果)，机器运作方式，注意事项等；4. Understand the operation method: Find a professional to understand the operation steps in detail (such as the way and direction of the handle and cover plate to rotate or move, what effect will be produced), the operation method of the machine, precautions, etc.;
5、运转动画：录下使用流程，机器如何运转，方便后续参照创建3维运作动画。5. Operation animation: Record the use process and how the machine operates, so as to facilitate the creation of 3D operation animation for subsequent reference.
二、后期处理2. Post-processing
1、制作模型：1. Make a model:
将数据、参考图导入到模型软件中，根据图片及测量好的尺寸创建模型。Import the data and reference pictures into the modeling software, and create a model based on the pictures and measured dimensions.
2、制作动画：2. Make animation:
根据之前录制的视频制作动画：有些加工行为并非实时计算得出来的，而是事先录入的模型动画，使用动画软件中的关键帧功能，做出动作动画，通过设定触发事件，播放对应的加工动画，行为节奏与真实相同。Make animations based on previously recorded videos: Some processing behaviors are not calculated in real time, but are model animations entered in advance. Use the key frame function in the animation software to make action animations, and play the corresponding processing by setting trigger events Animation, behavior rhythm is the same as real.
其中大多交互动画都是通过预先录制，较为简单的旋转位移动画可通过代码实现控制。Most of the interactive animations are pre-recorded, and the relatively simple rotation and displacement animations can be controlled by code.
3、开发3. Development
在开发引擎中删除主相机，放置HoloLens的组件相机:Main Camera Prefab。渲染背景改为纯黑，因为HoloLens中黑色即透明，不会遮挡到真实视野。调整坐标为原点即初始画面位置。Delete the main camera in the development engine, and place the component camera of HoloLens: Main Camera Prefab. The rendering background is changed to pure black, because black in HoloLens is transparent and will not block the real field of view. Adjust the coordinates to the origin, which is the initial screen position.
放置调节主体文件，例如工业设备、环境光等物体，使其真实、统一。Place and adjust the main files, such as industrial equipment, ambient light and other objects, to make them real and unified.
添加HoloLens核心组件：GazeManager.cs、GestureManager.cs、HandsManager.cs和KeywordManager.cs即可实现HoloLens中的三大操作方式：语音、凝视、手势。将凝视改为可视化指针。Add HoloLens core components: GazeManager.cs, GestureManager.cs, HandsManager.cs and KeywordManager.cs to realize the three major operation modes in HoloLens: voice, gaze, and gesture. Change gaze to visual pointer.
集成输入组件：场景放入HoloLens的组件CursorWithFeedback Prefab，使对应物体表面可被凝视触发，并可显示、修改当前状态。Integrated input components: Put the scene into the HoloLens component CursorWithFeedback Prefab, so that the corresponding object surface can be triggered by gaze, and the current state can be displayed and modified.
创建脚本语言并赋予场景主体文件，通过配置语音命令触发事件，输入触发文字，使用者可通过语音控制操作。Create a script language and assign the main file of the scene. By configuring the voice command to trigger the event and input the trigger text, the user can control the operation through voice.
修改渲染参数：修改渲染属性，使此应用渲染为HoloLens的3D应用，修改画质，匹配HoloLens对应的性能开销。Modify rendering parameters: modify the rendering properties to make this application render as a HoloLens 3D application, and modify the image quality to match the corresponding performance overhead of HoloLens.
修改发布平台，选择HoloLens对应的输出接口，发布程序包。Modify the publishing platform, select the output interface corresponding to HoloLens, and publish the program package.
4、导入HoloLens进行运行测试，并进行多次调节。4. Import HoloLens for running test and make multiple adjustments.
其中，HoloLens设备显示视角较窄，可通过手势缩放方式，可以将工业设备缩小摆放到桌子上进行使用操作。HoloLens设备手势较少，可将旋转手柄、拧紧卡盘等操作集成为点击交互方式，并配合真实旋转操作动画等。另外，将同一手柄用到的多个功能整合为操作菜单，供使用者选择当前所要做的操作。Among them, the HoloLens device has a narrow display angle of view, and can zoom in and out with gestures to reduce industrial equipment and place it on the table for use and operation. The HoloLens device has fewer gestures, and can integrate operations such as rotating the handle and tightening the chuck into a click interaction method, and cooperate with real rotation operation animations. In addition, multiple functions used by the same handle are integrated into an operation menu for the user to select the current operation to be done.
需要说明的是，采用HoloLens设备只是本发明的一种实施方式，本发明并不限于此，可采用各种增强现实/混合现实显示设备实现本发明。本发明实施例中，可通过图形、文字，指引使用者下一步操作；按照真实使用流程，规范虚拟工业设备使用方法，出现失误操作，会出现报错交互场景，将真实可发生状态录入进去。让使用者自由操作，并可观察误操作带来的后果；集成三维动画，把规范的演示操作录入，让使用者观看身临其境的教程。It should be noted that the use of the HoloLens device is only one embodiment of the present invention, and the present invention is not limited thereto, and various augmented reality/mixed reality display devices may be used to implement the present invention. In the embodiment of the present invention, the user can be guided to the next operation through graphics and text; according to the real use process, the use method of virtual industrial equipment is standardized, and if there is a wrong operation, there will be an error report interaction scene, and the real possible state can be entered. Allow users to operate freely and observe the consequences of misoperation; integrate 3D animation, record standardized demonstration operations, and allow users to watch immersive tutorials.
如图3所示，以工业设备为车床实现为例进行说明：As shown in Figure 3, the implementation of industrial equipment as a lathe is taken as an example for illustration:
步骤301，HoloLens自动实时扫描空间环境，搭建场景模型，放置虚拟工厂程序菜单。该菜单为图像化菜单，显示了可供展示的多个虚拟工业设备。Step 301, HoloLens automatically scans the space environment in real time, builds a scene model, and places a virtual factory program menu. This menu is a graphical menu that shows several virtual industrial devices available for display.
步骤302，从菜单中拖拽出想要操作的虚拟工业设备，放置在合适的地方。Step 302, drag and drop the virtual industrial equipment to be operated from the menu, and place it in a suitable place.
步骤303，可以对虚拟工业设备进行调整，包括缩放、旋转和位移。该调整操作在任何时间都可进行。In step 303, the virtual industrial equipment can be adjusted, including scaling, rotation and displacement. This adjustment operation can be performed at any time.
步骤304，在虚拟工业设备未运行时，可进行展示操作，包括各部件的名称、用途等介绍，还可以展示工作台各轴的位置及角度变化。Step 304, when the virtual industrial equipment is not running, the display operation can be performed, including the introduction of the names and uses of each component, and the position and angle changes of each axis of the workbench can also be displayed.
步骤305，以所选择的虚拟工业设备为车床为例，运行车床加工流程。Step 305, taking the selected virtual industrial equipment as a lathe as an example, run the lathe processing flow.
步骤306，放置工件、辅料等材料。Step 306, placing workpieces, auxiliary materials and other materials.
步骤307，使用锁紧扳手，上紧三抓卡盘。In step 307, use a locking wrench to tighten the three-grip chuck.
步骤308，启动总电源。启动总电源之后，可以打开冷却泵，并取消急停操作。Step 308, start the main power supply. After starting the main power supply, the cooling pump can be turned on and the emergency stop operation can be canceled.
步骤309，启动电机。Step 309, start the motor.
步骤310，调节电机正/反转。Step 310, adjust the forward/reverse rotation of the motor.
步骤311，判断是否取走锁紧扳手，若否，则执行步骤312，若是，则执行步骤313。Step 311, judge whether to take away the locking wrench, if not, execute step 312, and if yes, execute step 313.
步骤312，将扳手归位。若不将扳手归位，可演示扳手飞出的动画。Step 312, return the wrench to its original position. If the wrench is not returned, the animation of the wrench flying out can be demonstrated.
步骤313，演示相应的加工动画。Step 313, demonstrate the corresponding processing animation.
加工动画演示过程中，用户可选择急停，此处停止演示加工动画。用户解开急停时，并重新启动电机时，继续播放加工动画。During the processing animation demonstration, the user can choose emergency stop, and stop the processing animation demonstration here. When the user releases the emergency stop and restarts the motor, the processing animation continues to play.
步骤314，加工动画演示完成。Step 314, the processing animation demonstration is completed.
步骤315，可拿起工件成品进行观赏，还可以对工件进行旋转、位移、缩放等操作。In step 315, the finished workpiece can be picked up for viewing, and operations such as rotation, displacement, and scaling can also be performed on the workpiece.
其中，步骤315执行完成之后，还可以继续执行步骤302及之后的操作。Wherein, after the execution of step 315 is completed, the operations in and after step 302 may also be continued.
现有技术的虚拟机械加工训练的系统或方法观看体验一般，沉浸感差，与现实世界没有交互。使用灵活度差，都是事先录入的几个模版，几乎没什么可操作性。本发明实施例具有如下优点：The prior art virtual machining training system or method has average viewing experience, poor sense of immersion, and no interaction with the real world. The flexibility of use is poor, there are several templates entered in advance, and there is almost no operability. Embodiments of the present invention have the following advantages:
1、与真实世界融合，可嵌套至真实工业设备上，进行同步加工提示、加工指引、操作错误提示指引。1. Integrating with the real world, it can be nested on real industrial equipment for synchronous processing prompts, processing guidance, and operation error prompting guidance.
2、沉浸感更好，用户看起来就是自己的世界，有一小块空地就可以使用，甚至于坐下来，把虚拟工业设备放到桌子上进行使用、学习。2. The sense of immersion is better. Users seem to be their own world, and they can use it with a small open space. They can even sit down and put virtual industrial equipment on the table for use and learning.
3、可玩性高：即用起来灵活，真实工业设备具有的功能，虚拟工业设备都可以具备，用户可以对虚拟工业设备进行各种操作，遇到不规范操作会触发错误流程，将真实可发生的事情以动画的形式展现出来，这么做有什么危险，让使用者能够深刻体验、认识到。3. High playability: It is flexible to use. The functions of real industrial equipment can be possessed by virtual industrial equipment. Users can perform various operations on virtual industrial equipment. When encountering irregular operations, an error process will be triggered, and the real and reliable What happened is displayed in the form of animation, so that users can experience and realize the danger of doing so.
下面以几个应用实例说明本发明：The present invention is illustrated below with several application examples:
1、学生课前预习：在宿舍掏出手机，打开虚拟工厂APP，摄像头自动检测桌面上的二维码进行空间定位。透过手机屏幕将X5030A铣床叠加放到桌子上，观看铣床的各个零部件介绍，及3维动画操作教程，并通过各个角度对铣床进行试加工，将遇到的问题在第二天课上提出，以得到更多的技能。1. Students preview before class: Take out their mobile phones in the dormitory, open the virtual factory APP, and the camera will automatically detect the QR code on the desktop for spatial positioning. Superimpose the X5030A milling machine on the table through the screen of the mobile phone, watch the introduction of each component of the milling machine, and the 3D animation operation tutorial, and conduct trial processing of the milling machine from various angles, and raise the problems encountered in the second day class , to get more skills.
2、学习小组带上HoloLens，对课上使用的CA6136普通车床进行复习，将虚拟机床拖出放到人们中间，练习今天学到的车外圆，而将工件卡紧之后忘了将其归位，直接启动电机，此时报错：请将三爪卡盘扳手归位，否则甩出伤人！忽视这条消息，继续操作，扳手果然甩了出来，飞到同学眼前，把他吓了一跳。在将三爪卡盘扳手归位之后，电机正常运转，零件加工完成。这位同学下次再加工时就会记住这时犯的错误。2. The study group brought HoloLens to review the CA6136 ordinary lathe used in the class, dragged the virtual machine tool out and put it among the people, and practiced the outer circle of the car learned today, but forgot to return it after clamping the workpiece , Start the motor directly, and report an error at this time: Please return the three-jaw chuck wrench to its original position, otherwise it will hurt people! Ignoring the message and continuing to operate, the wrench was thrown out and flew in front of the classmate, startling him. After returning the three-jaw chuck wrench to its original position, the motor runs normally and the machining of the part is completed. This classmate will remember the mistakes made at this time when he reworks next time.
3、通过对CA6136普通车床进行加装传感器，把虚拟车床信息嵌套关联在真实机床上，在眼前显示机床的各模块组成部分及使用介绍，而操作真实机床时，眼前展示的是机床的旋转参数，工件与车刀接触点的温度，以及此时车刀的进给速度等参数，当加快进给量时，设备检测到进给速度数与所需速度不匹配，弹出警告窗口：当前进给速度过快，请降低z轴走刀速度。3. By installing sensors on the CA6136 ordinary lathe, the information of the virtual lathe is nested and associated with the real machine tool, and the components and usage introduction of each module of the machine tool are displayed in front of the eyes. When operating the real machine tool, the rotation of the machine tool is displayed in front of the eyes. Parameters, the temperature of the contact point between the workpiece and the turning tool, and the feed speed of the turning tool at this time. When the feed is increased, the equipment detects that the feed If the speed is too fast, please reduce the z-axis cutting speed.
4、开会时，将微缩的虚拟工厂沙盘，放在桌面上，进行沙盘点兵，观看演示整个生态产业链，并可随意点击任意环节观看细节演示。点开其中的汽车装配厂房，场景影像放大，当前画面正对车门装配进行实时同步，查看motoman机器手臂的车门安装进度。4. During the meeting, put the miniature virtual factory sand table on the desktop, conduct sand table counting, watch and demonstrate the entire ecological industry chain, and click on any link to watch the detailed demonstration. Click on the car assembly plant, the scene image is enlarged, the current screen is synchronizing the door assembly in real time, and check the door installation progress of the motoman robotic arm.
综上所述，本发明实施例的基于混合现实或增强现实的工业现场仿真模拟方法和装置，真实、交互性强、无场地条件限制，并且可重复利用，其工业仿真模拟现场是通过实际参数测量获得真实模型数据导入到仿真软件中搭建而成，其运转逻辑也符合真实工业设备，操作者通过空中手势操控可交互的仿真场景，从而完成虚拟加工过程，所述手势操作是具有错误提示的，在进行虚拟零部件加工时，使用者误操作可触发的仿真错误动画。而且，可以以沙盘的形式展示内部工厂流水线，并细化到内部的各式机械设备。通过实时扫描环境空间搭建地形模型。虚拟场景中的设备，可以根据使用者需要，布置在真实环境中，并从视觉上与真实环境融合，可以更好地进行工业场景还原。To sum up, the mixed reality or augmented reality-based industrial site simulation method and device of the embodiment of the present invention is real, highly interactive, free of site condition restrictions, and reusable. The industrial simulation site is simulated by actual parameters. The real model data obtained by measurement is imported into the simulation software to build, and its operation logic is also in line with real industrial equipment. The operator manipulates the interactive simulation scene through air gestures to complete the virtual processing process. The gesture operation has error prompts , during the processing of virtual parts, the simulation error animation that can be triggered by the user's misoperation. Moreover, the internal factory assembly line can be displayed in the form of a sand table and detailed to various internal mechanical equipment. Build a terrain model by scanning the environment space in real time. The equipment in the virtual scene can be arranged in the real environment according to the needs of users, and visually merged with the real environment, which can better restore the industrial scene.
显然，本领域的技术人员应该明白，上述的本发明实施例的模块或步骤可以用通用的计算装置来实现，它们可以集中在单个的计算装置上，或者分布在多个计算装置所组成的网络上，可选地，它们可以用计算装置可执行的程序代码来实现，从而，可以将它们存储在存储装置中由计算装置来执行，并且在某些情况下，可以以不同于此处的顺序执行所示出或描述的步骤，或者将它们分别制作成集成电路模块，或者将它们中的多个模块或步骤制作成单个集成电路模块来实现。这样，本发明实施例不限制于任何特定的硬件和软件结合。Obviously, those skilled in the art should understand that the modules or steps of the above-mentioned embodiments of the present invention can be implemented by general-purpose computing devices, and they can be concentrated on a single computing device, or distributed in a network composed of multiple computing devices Alternatively, they may be implemented in program code executable by a computing device so that they may be stored in a storage device to be executed by a computing device, and in some cases in an order different from that shown here The steps shown or described are carried out, or they are separately fabricated into an integrated circuit module, or a plurality of modules or steps among them are fabricated into a single integrated circuit module for implementation. Thus, embodiments of the invention are not limited to any specific combination of hardware and software.
虽然本发明所揭露的实施方式如上，但所述的内容仅为便于理解本发明而采用的实施方式，并非用以限定本发明。任何本发明所属领域内的技术人员，在不脱离本发明所揭露的精神和范围的前提下，可以在实施的形式及细节上进行任何的修改与变化，但本发明的专利保护范围，仍须以所附的权利要求书所界定的范围为准。Although the embodiments disclosed in the present invention are as above, the described content is only an embodiment adopted for understanding the present invention, and is not intended to limit the present invention. Anyone skilled in the field of the present invention can make any modifications and changes in the form and details of the implementation without departing from the spirit and scope disclosed by the present invention, but the patent protection scope of the present invention must still be The scope defined by the appended claims shall prevail.
Claims (10)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710114493.5A CN106843150A (en) | 2017-02-28 | 2017-02-28 | A kind of industry spot simulation method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710114493.5A CN106843150A (en) | 2017-02-28 | 2017-02-28 | A kind of industry spot simulation method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106843150A true CN106843150A (en) | 2017-06-13 |
Family
ID=59137375
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710114493.5A Pending CN106843150A (en) | 2017-02-28 | 2017-02-28 | A kind of industry spot simulation method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106843150A (en) |
Cited By (31)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107368314A (en) * | 2017-07-19 | 2017-11-21 | 哈尔滨工业大学 | Course Design of Manufacture teaching auxiliary system and development approach based on mobile AR |
| CN107562817A (en) * | 2017-08-16 | 2018-01-09 | 北京深数科技有限公司 | One B shareB quantifies method, apparatus, equipment and the storage medium of transaction |
| CN107589838A (en) * | 2017-08-30 | 2018-01-16 | 广东盘古信息科技股份有限公司 | The method of combining the play of SOP video to guide the operation with the VR method |
| CN107784885A (en) * | 2017-10-26 | 2018-03-09 | 歌尔科技有限公司 | Operation training method and AR equipment based on AR equipment |
| CN107797665A (en) * | 2017-11-15 | 2018-03-13 | 王思颖 | A kind of 3-dimensional digital sand table deduction method and its system based on augmented reality |
| CN107885336A (en) * | 2017-11-30 | 2018-04-06 | 成都飞机工业（集团）有限责任公司 | Map the virtual workshop model and information fusion display method of the true condition of production |
| CN107977080A (en) * | 2017-12-05 | 2018-05-01 | 北京小米移动软件有限公司 | Product uses methods of exhibiting and device |
| CN108009739A (en) * | 2017-12-14 | 2018-05-08 | 沈阳工业大学 | Production-Plan and scheduling integral method between a kind of intelligent machine extra bus |
| CN108156217A (en) * | 2017-11-20 | 2018-06-12 | 福建睿能科技股份有限公司 | A kind of monitoring method of straight-bar machines, terminal and storage device |
| CN108228027A (en) * | 2017-12-29 | 2018-06-29 | 努比亚技术有限公司 | A kind of method of information processing, equipment and computer readable storage medium |
| CN108388391A (en) * | 2018-02-24 | 2018-08-10 | 广联达科技股份有限公司 | Component display methods, system, augmented reality display device and computer media |
| CN108389459A (en) * | 2018-03-15 | 2018-08-10 | 湖南工业大学 | A kind of printing simulation system based on virtual reality |
| CN109298685A (en) * | 2017-07-25 | 2019-02-01 | 西门子（中国）有限公司 | Digital factory implementation method, digital factory realize system and digital factory |
| CN109410299A (en) * | 2017-08-15 | 2019-03-01 | 腾讯科技（深圳）有限公司 | A kind of information processing method, device and computer storage medium |
| CN109522223A (en) * | 2018-10-26 | 2019-03-26 | 惠州市德赛西威汽车电子股份有限公司 | A kind of automatic test approach and system of vehicle-mounted Android multimedia host |
| CN109557930A (en) * | 2017-09-27 | 2019-04-02 | 中国石油化工股份有限公司 | A kind of underwater robot operation control system and method based on VR |
| CN109615958A (en) * | 2018-12-04 | 2019-04-12 | 深圳市诺信连接科技有限责任公司 | The processing method and VR of interactive VR image |
| CN109696915A (en) * | 2019-01-07 | 2019-04-30 | 上海托华机器人有限公司 | A kind of test method and system |
| CN109859538A (en) * | 2019-03-28 | 2019-06-07 | 中广核工程有限公司 | A kind of key equipment training system and method based on mixed reality |
| CN110047148A (en) * | 2019-04-10 | 2019-07-23 | 珠海梅西互动技术有限公司 | A kind of the emulation interactive visual system and implementation method of virtual robot work station |
| CN111142673A (en) * | 2019-12-31 | 2020-05-12 | 维沃移动通信有限公司 | Scene switching method and head-mounted electronic equipment |
| CN111341166A (en) * | 2018-12-18 | 2020-06-26 | 国家电投集团科学技术研究院有限公司 | Control method and system of emergency drilling system |
| CN111414225A (en) * | 2020-04-10 | 2020-07-14 | 北京城市网邻信息技术有限公司 | Three-dimensional model remote display method, first terminal, electronic device and storage medium |
| CN111599292A (en) * | 2020-06-08 | 2020-08-28 | 浙江商汤科技开发有限公司 | Historical scene presenting method and device, electronic equipment and storage medium |
| CN111629205A (en) * | 2020-07-28 | 2020-09-04 | 天津美腾科技股份有限公司 | System and method applied to industrial camera simulation test |
| CN111966068A (en) * | 2020-08-27 | 2020-11-20 | 上海电机系统节能工程技术研究中心有限公司 | Augmented reality monitoring method and device for motor production line, electronic equipment and storage medium |
| CN113298598A (en) * | 2020-09-15 | 2021-08-24 | 阿里巴巴集团控股有限公司 | Method and device for providing shop object information and electronic equipment |
| CN114546118A (en) * | 2022-02-21 | 2022-05-27 | 国网河北省电力有限公司保定供电分公司 | A safety prompting method, device, medium and device based on VR technology |
| CN115061569A (en) * | 2022-06-20 | 2022-09-16 | 威艾特科技(深圳)有限公司 | Product function demonstration method and device based on virtual reality |
| CN115087948A (en) * | 2020-02-19 | 2022-09-20 | 发那科株式会社 | Operating system for industrial machine |
| CN115796027A (en) * | 2022-11-26 | 2023-03-14 | 宝钢工程技术集团有限公司 | Method for improving bearing replacement efficiency of cold rolling unit by using virtual reality technology |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104471629A (en) * | 2012-06-13 | 2015-03-25 | 赛百瑞索路信有限公司 | State-of-the-art installation for welding training based on augmented reality simulations that can be updated remotely |
| CN106066633A (en) * | 2015-04-24 | 2016-11-02 | Jpw工业有限公司 | The wearable display device being used together with lathe |
-
2017
- 2017-02-28 CN CN201710114493.5A patent/CN106843150A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104471629A (en) * | 2012-06-13 | 2015-03-25 | 赛百瑞索路信有限公司 | State-of-the-art installation for welding training based on augmented reality simulations that can be updated remotely |
| CN106066633A (en) * | 2015-04-24 | 2016-11-02 | Jpw工业有限公司 | The wearable display device being used together with lathe |
Cited By (44)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107368314B (en) * | 2017-07-19 | 2020-07-07 | 哈尔滨工业大学 | Teaching auxiliary system and development method of mechanical manufacturing technology course design based on mobile AR |
| CN107368314A (en) * | 2017-07-19 | 2017-11-21 | 哈尔滨工业大学 | Course Design of Manufacture teaching auxiliary system and development approach based on mobile AR |
| CN109298685A (en) * | 2017-07-25 | 2019-02-01 | 西门子（中国）有限公司 | Digital factory implementation method, digital factory realize system and digital factory |
| CN109298685B (en) * | 2017-07-25 | 2020-11-27 | 西门子（中国）有限公司 | Digital factory implementation method, digital factory implementation system and digital factory |
| CN109410299B (en) * | 2017-08-15 | 2022-03-11 | 腾讯科技（深圳）有限公司 | Information processing method and device and computer storage medium |
| US12165246B2 (en) | 2017-08-15 | 2024-12-10 | Tencent Technology (Shenzhen) Company Limited | Interactive graphic rendering method and apparatus, and computer storage medium |
| CN109410299A (en) * | 2017-08-15 | 2019-03-01 | 腾讯科技（深圳）有限公司 | A kind of information processing method, device and computer storage medium |
| CN107562817A (en) * | 2017-08-16 | 2018-01-09 | 北京深数科技有限公司 | One B shareB quantifies method, apparatus, equipment and the storage medium of transaction |
| CN107589838A (en) * | 2017-08-30 | 2018-01-16 | 广东盘古信息科技股份有限公司 | The method of combining the play of SOP video to guide the operation with the VR method |
| CN109557930A (en) * | 2017-09-27 | 2019-04-02 | 中国石油化工股份有限公司 | A kind of underwater robot operation control system and method based on VR |
| CN107784885A (en) * | 2017-10-26 | 2018-03-09 | 歌尔科技有限公司 | Operation training method and AR equipment based on AR equipment |
| CN107797665A (en) * | 2017-11-15 | 2018-03-13 | 王思颖 | A kind of 3-dimensional digital sand table deduction method and its system based on augmented reality |
| CN107797665B (en) * | 2017-11-15 | 2021-02-02 | 王思颖 | Three-dimensional digital sand table deduction method and system based on augmented reality |
| CN108156217A (en) * | 2017-11-20 | 2018-06-12 | 福建睿能科技股份有限公司 | A kind of monitoring method of straight-bar machines, terminal and storage device |
| CN107885336A (en) * | 2017-11-30 | 2018-04-06 | 成都飞机工业（集团）有限责任公司 | Map the virtual workshop model and information fusion display method of the true condition of production |
| CN107885336B (en) * | 2017-11-30 | 2021-04-27 | 成都飞机工业（集团）有限责任公司 | Virtual workshop model and information fusion display method for mapping real production situation |
| CN107977080B (en) * | 2017-12-05 | 2021-03-30 | 北京小米移动软件有限公司 | Product use display method and device |
| CN107977080A (en) * | 2017-12-05 | 2018-05-01 | 北京小米移动软件有限公司 | Product uses methods of exhibiting and device |
| CN108009739A (en) * | 2017-12-14 | 2018-05-08 | 沈阳工业大学 | Production-Plan and scheduling integral method between a kind of intelligent machine extra bus |
| CN108228027A (en) * | 2017-12-29 | 2018-06-29 | 努比亚技术有限公司 | A kind of method of information processing, equipment and computer readable storage medium |
| CN108388391A (en) * | 2018-02-24 | 2018-08-10 | 广联达科技股份有限公司 | Component display methods, system, augmented reality display device and computer media |
| CN108388391B (en) * | 2018-02-24 | 2020-06-30 | 广联达科技股份有限公司 | Component display method, system, augmented reality display device, and computer medium |
| CN108389459A (en) * | 2018-03-15 | 2018-08-10 | 湖南工业大学 | A kind of printing simulation system based on virtual reality |
| CN109522223A (en) * | 2018-10-26 | 2019-03-26 | 惠州市德赛西威汽车电子股份有限公司 | A kind of automatic test approach and system of vehicle-mounted Android multimedia host |
| CN109615958A (en) * | 2018-12-04 | 2019-04-12 | 深圳市诺信连接科技有限责任公司 | The processing method and VR of interactive VR image |
| CN111341166A (en) * | 2018-12-18 | 2020-06-26 | 国家电投集团科学技术研究院有限公司 | Control method and system of emergency drilling system |
| CN109696915B (en) * | 2019-01-07 | 2022-02-08 | 上海托华机器人有限公司 | Test method and system |
| CN109696915A (en) * | 2019-01-07 | 2019-04-30 | 上海托华机器人有限公司 | A kind of test method and system |
| CN109859538A (en) * | 2019-03-28 | 2019-06-07 | 中广核工程有限公司 | A kind of key equipment training system and method based on mixed reality |
| CN110047148B (en) * | 2019-04-10 | 2024-01-26 | 珠海惠中智能技术有限公司 | Simulation interaction visualization system of virtual robot workstation and implementation method |
| CN110047148A (en) * | 2019-04-10 | 2019-07-23 | 珠海梅西互动技术有限公司 | A kind of the emulation interactive visual system and implementation method of virtual robot work station |
| CN111142673A (en) * | 2019-12-31 | 2020-05-12 | 维沃移动通信有限公司 | Scene switching method and head-mounted electronic equipment |
| CN115087948A (en) * | 2020-02-19 | 2022-09-20 | 发那科株式会社 | Operating system for industrial machine |
| CN111414225B (en) * | 2020-04-10 | 2021-08-13 | 北京城市网邻信息技术有限公司 | Three-dimensional model remote display method, first terminal, electronic device and storage medium |
| CN111414225A (en) * | 2020-04-10 | 2020-07-14 | 北京城市网邻信息技术有限公司 | Three-dimensional model remote display method, first terminal, electronic device and storage medium |
| CN111599292A (en) * | 2020-06-08 | 2020-08-28 | 浙江商汤科技开发有限公司 | Historical scene presenting method and device, electronic equipment and storage medium |
| CN111629205B (en) * | 2020-07-28 | 2020-11-20 | 天津美腾科技股份有限公司 | System and method applied to industrial camera simulation test |
| CN111629205A (en) * | 2020-07-28 | 2020-09-04 | 天津美腾科技股份有限公司 | System and method applied to industrial camera simulation test |
| CN111966068A (en) * | 2020-08-27 | 2020-11-20 | 上海电机系统节能工程技术研究中心有限公司 | Augmented reality monitoring method and device for motor production line, electronic equipment and storage medium |
| CN113298598A (en) * | 2020-09-15 | 2021-08-24 | 阿里巴巴集团控股有限公司 | Method and device for providing shop object information and electronic equipment |
| CN114546118A (en) * | 2022-02-21 | 2022-05-27 | 国网河北省电力有限公司保定供电分公司 | A safety prompting method, device, medium and device based on VR technology |
| CN114546118B (en) * | 2022-02-21 | 2024-08-20 | 国网河北省电力有限公司保定供电分公司 | VR technology-based safety prompt method, device, medium and equipment |
| CN115061569A (en) * | 2022-06-20 | 2022-09-16 | 威艾特科技(深圳)有限公司 | Product function demonstration method and device based on virtual reality |
| CN115796027A (en) * | 2022-11-26 | 2023-03-14 | 宝钢工程技术集团有限公司 | Method for improving bearing replacement efficiency of cold rolling unit by using virtual reality technology |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106843150A (en) | A kind of industry spot simulation method and device | |
| US9415509B2 (en) | Robot teach device with 3-D display | |
| CN110928418A (en) | A kind of MR-based aviation cable auxiliary assembly method and system | |
| CN107368314B (en) | Teaching auxiliary system and development method of mechanical manufacturing technology course design based on mobile AR | |
| CN103488292B (en) | The control method of a kind of three-dimensional application icon and device | |
| CN104699871A (en) | Simulation training simulation drill control method | |
| Yang et al. | An augmented reality-based training system with a natural user interface for manual milling operations | |
| CN112764548A (en) | AR auxiliary assembly system | |
| CN113270006B (en) | HoloLens-based printing machine operation training system and method | |
| Li et al. | Instruction manual for product assembly process based on augmented visualization | |
| Roach et al. | Computer aided drafting virtual reality interface | |
| Zhang et al. | Application of mixed reality based on Hololens in nuclear power engineering | |
| Bellalouna | Use Case of the Application of the Optical-See-Through Augmented Reality Technology in the Engineering Context | |
| Sang et al. | Research on the development of an interactive three coordinate measuring machine simulation platform | |
| KR102247808B1 (en) | Virtual training system with node-based scenario authoring | |
| Shepherd et al. | Visualizing the" hidden" variables in robot programs | |
| Gimeno et al. | An easy-to-use AR authoring tool for industrial applications | |
| Gimeno et al. | An occlusion-aware AR authoring tool for assembly and repair tasks | |
| Novak-Marcincin et al. | Interactive monitoring of production process with use of augmented reality technology | |
| CN2612012Y (en) | Intelligent Simulator of CNC Machining Center | |
| Kirakosian et al. | Immersive simulation and training of person-to-3d character dance in real-time | |
| Dianatfar et al. | Virtual reality-based safety training in human-robot collaboration scenario: User experiences testing | |
| CN106560863A (en) | Virtual development method based on 3D planar technique | |
| TW201629655A (en) | Open simulation system of 3D machine tools and method thereof | |
| WO2024020937A1 (en) | Handicraft path guidance learning system based on mixed reality technology |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170613 |