[go: up one dir, main page]

CN113393535A - Projection type operation guiding method and system - Google Patents

Projection type operation guiding method and system Download PDF

Info

Publication number
CN113393535A
CN113393535A CN202110711694.XA CN202110711694A CN113393535A CN 113393535 A CN113393535 A CN 113393535A CN 202110711694 A CN202110711694 A CN 202110711694A CN 113393535 A CN113393535 A CN 113393535A
Authority
CN
China
Prior art keywords
information
projection
assembly
platform
guidance
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110711694.XA
Other languages
Chinese (zh)
Inventor
刘众
胡旭光
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chinese University of Hong Kong Shenzhen
Original Assignee
Shenzhen Tuopu Zhizao Technology Co ltd
Chinese University of Hong Kong Shenzhen
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Tuopu Zhizao Technology Co ltd, Chinese University of Hong Kong Shenzhen filed Critical Shenzhen Tuopu Zhizao Technology Co ltd
Priority to CN202110711694.XA priority Critical patent/CN113393535A/en
Publication of CN113393535A publication Critical patent/CN113393535A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/80—Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31—User authentication
    • G06F21/32—User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/54—Interprogram communication
    • G06F9/545—Interprogram communication where tasks reside in different layers, e.g. user- and kernel-space

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Computer Security & Cryptography (AREA)
  • Human Computer Interaction (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computer Hardware Design (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本发明公开了一种投影式作业引导方法及系统，涉及一种增强现实技术领域，由于现存的装配引导方法需要构建虚拟装配场景，然后通过混合现实设备将虚拟与现实进行融合，最终需要借助可穿戴的设备实现装配指导，虽然具有沉浸感，但在无形中增加了作业者的负担，所以本申请包括信息辅助装配平台，还包括数据层；以及：功能层；以及：软件层；以及：支撑层，本申请通过利用投影的方式实现人机交互，不影响作业人员的工作效率；本申请能够采集大量的作业过程信息，可服务于产品追溯、信息系统展示、装配工艺流程优化等；本申请通过对作业人员的手势状态进行实时捕捉，使得能够保证工作成品的合格率，降低损耗。

Figure 202110711694

The invention discloses a projection-type operation guidance method and system, and relates to the technical field of augmented reality. Since the existing assembly guidance method needs to construct a virtual assembly scene, and then use a mixed reality device to fuse the virtual and reality, the The wearable equipment implements assembly guidance, although it has a sense of immersion, but it increases the burden of the operator invisibly, so this application includes an information-assisted assembly platform, and also includes a data layer; and: functional layer; and: software layer; and: support This application realizes human-computer interaction by using projection, without affecting the work efficiency of operators; this application can collect a large amount of operation process information, which can serve product traceability, information system display, assembly process optimization, etc.; this application By capturing the gesture state of the operator in real time, it is possible to ensure the qualified rate of the finished product and reduce the loss.

Figure 202110711694

Description

Projection type operation guiding method and system
Technical Field
The invention relates to the technical field of augmented reality, in particular to a projection type operation guiding method and system.
Background
Augmented Reality (Augmented Reality) technology is to generate virtual objects which do not exist in the real world by means of computer graphics and visualization technology, accurately place the virtual objects in the physical world, and present a new environment with richer perception effect to users.
A projective navigation system is one of augmented reality technologies that can project virtual computerized synthetic information in a real environment. The application of the projection augmented reality technology in the industrial field is still rarely researched by students, and there is a gap in the application of the projection augmented reality in the fields of operation guidance, such as assembly operation, military training, surgical operation, entertainment, assembly, product design and other manufacturing industries, which need to strictly control the operation flow of operators.
As a new assembly guidance method, a method and a system for assembly guidance based on a mixed reality device mention that a virtual assembly scene needs to be constructed first, then virtual and reality are fused by the mixed reality device, and finally assembly guidance needs to be realized by a wearable device.
The assembly guiding system and the assembly guiding method guide the whole assembly process by using a storage device, a guiding terminal and a display device, actually use a guiding mode of 'characters + images + animations', automatically display the operation flow by using a prompt board, and thus, an operator still needs to pay attention to the content on the prompt board at any moment during operation, thereby causing operation inconvenience.
Disclosure of Invention
The present invention is directed to a projection-type job guiding method and system, so as to solve the problems in the background art.
In order to achieve the purpose, the invention provides the following technical scheme:
the projection type operation guiding method and system comprises an information auxiliary assembly platform and further comprises the following steps: the information auxiliary assembly platform comprises a data layer for collecting assembly description information related in the assembly process; and: the functional layer is used for realizing the sharing and the transmission of solid data; and: the software layer is used for realizing the normal operation of the platform; and: and the support layer is used for providing hardware support for the platform.
As a further scheme of the invention: the data layer comprises assembly description information, the assembly description information comprises assembly information, guide information and management documents, and the data layer is presented in the form of character data, picture data and structured management data.
As a still further scheme of the invention: the functional layer comprises a position resource registration module, a gesture recognition module and an information management module, wherein the position resource registration module, the gesture recognition module and the information management module are independent systems which are related to each other.
As a still further scheme of the invention: the software layer comprises VS2017, OpenCV and Pyorch, wherein VS2017(Microsoft Visual Studio2017) is an integrated development tool, OpenCV (open Source Computer Vision library) is an open Source Computer Visual library, and Pyorch is a deep learning framework and used for recognizing objects and characters.
As a still further scheme of the invention: the support layer includes an industrial digital camera for capturing assembly site information and user gesture information, a projector, a computer, a workstation, and a cable.
Compared with the prior art, the invention has the beneficial effects that: the man-machine interaction is realized by using a projection mode, and the working efficiency of operators is not influenced; the method and the device can acquire a large amount of operation process information, and can be used for product tracing, information system display, assembly process flow optimization, big data analysis and the like; this application is through catching in real time to operation personnel's gesture state for can guarantee the qualification rate of work finished product, reduce the loss.
Drawings
Fig. 1 is a general frame diagram of an information projection auxiliary assembly platform of the projection type work guidance method and system.
FIG. 2 is a flowchart of an overall scheme of a platform in the method and system for projection type job guidance.
Fig. 3 is a schematic diagram of a hardware structure of the projection type job guiding method and system.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Example 1
Referring to fig. 1 to 3, in The embodiment of The present invention, a projection type job guidance method and system (The projection operation guide) includes a projection type job guidance method and a projection type job system, where The projection type job system includes an information auxiliary assembly platform, The information auxiliary assembly platform includes four layers, namely, a data layer, a functional layer, a software layer, and a support layer, The data layer includes assembly description information related in an assembly process, The assembly description information includes assembly information, guidance information, and a management document, and The data layer presents a form of text data, picture data, and structured management data;
the functional layer is a key for platform operation and is a functional module for realizing user requirements, the functional layer comprises a position resource registration module, a gesture recognition module and an information management module, and the position resource registration module, the gesture recognition module and the information management module are independent systems which are mutually associated and are used for realizing sharing and transmission of information data and laying a foundation for the stability of platform operation;
the software layer comprises a VS2017, an OpenCV and a Pythroch, the software layer utilizes the VS2017, the OpenCV and the Pythroch to develop platform control software by analyzing each function module of the platform, the VS2017, the OpenCV and the Pythroch are used for controlling the opening and closing of the platform, debugging and modifying each function module, and providing guarantee for the normal operation of the platform; the VS2017(Microsoft Visual Studio2017) is an integrated development tool, the OpenCV (open Source Computer Vision library) is an open-Source Computer Vision library, and the Pythroch is a deep learning framework and is used for identifying objects and characters and enhancing information to assist the assembly platform prototype system by a primary component;
TABLE 1 platform development Environment
Figure BDA0003134029040000031
The support layer comprises an industrial digital camera, a projector, a computer, a workstation, a cable and the like, the support layer is used for providing hardware support for the platform, the industrial digital camera is used for capturing various information in an assembly scene, including assembly site information and user gesture information, the projector is used for outputting enhancement information to the assembly scene, and the workstation is used for calculating and processing data generated in the operation of the platform.
The projection type operation guiding method comprises the matching of an assembly site and an information projection auxiliary assembly platform, wherein an instruction of the assembly site is sent to the information projection auxiliary assembly platform to monitor the working process of the information projection auxiliary assembly platform, and the information projection auxiliary assembly platform transmits information to an operation console to realize the monitoring and guidance of the operation process;
the working stage of the information projection auxiliary assembly platform comprises a working stage and an off-line stage, the off-line stage is used for generating, storing and transporting information, the working stage is used for collecting and arranging the information obtained in the off-line stage and then generating data on an operation table of an assembly site, and the operation table can send an operation instruction;
the off-line stage comprises an off-line calibration and a projection information base, wherein the off-line calibration process comprises the steps of firstly shooting a reference image, then calibrating the reference image, finally collecting off-line calibration information, and sending the off-line calibration information to the working stage;
the projection information base comprises graphic guide information and character information, the character information comprises part names, description information and tool information, and the character information and the graphic guide information are sent to a working stage;
the working stage comprises five steps of assembling field images, obtaining instructions, registering on site, projecting information on site, rendering and projecting, wherein the working process comprises the steps of firstly sending the information to assemble the field images, comparing the information obtained by the instructions with the information output by off-line calibration, registering on site if the information is consistent, then setting the projection information on site, and transmitting the information to an operation console by a projector through rendering and projecting, wherein the information registered on site is from an information output end of the off-line calibration, and the information required by the projection information is from an information output end of a projection information base.
As a further embodiment of the present invention, referring to fig. 1 to 3, the platform hardware includes an industrial digital camera, a projector, a desktop computer, a real-world device and an assembly workbench, the industrial digital camera and the projector are fixed on a fixed frame, the fixed frame is installed above the assembly operation platform through a hanger, the industrial digital camera and the projector are connected with the desktop computer through a cable, the desktop computer is fixed on one side of the fixed frame, and is used for controlling projection of the projector, data processing and feedback of scene images, and for making a gesture in a designated area on the operation platform during assembly operation, and the industrial digital camera monitors and captures the gesture of an operator in real time.
As a further embodiment of the present invention, please refer to fig. 1-3, the present application can add technologies such as recognition technologies of sound and light, human face, iris, fingerprint, palm print, bar code, etc. to realize the judgment of people and objects, and add multiple channels such as computer display screen billboard, etc. on the basis of the guidance.
The working principle of the invention is as follows: firstly, an industrial digital camera is used for collecting an assembly field image, the assembly field image and offline calibrated data are compared after an instruction is obtained and the assembly field image reaches a field registration stage, field registration is carried out if the assembly field image and the offline calibrated data are consistent, then a projection information base of a projector and the projector are used for transmitting guidance information to an operation desk, then the industrial digital camera shoots the operation process of an operator, the related actions and gestures of the operator on an assembly operation platform are captured, the action of taking articles is carried out, and when the captured gestures or the related actions of the operator are incorrect, the projector stops the guidance process and prompts the operator that the gestures are incorrect.
The invention has the beneficial effects that: the man-machine interaction is realized by using a projection mode, and the working efficiency of operators is not influenced; the method and the device can acquire a large amount of operation process information, and can be used for product tracing, information system display, assembly process flow optimization, big data analysis and the like; this application is through catching in real time to operation personnel's gesture state for can guarantee the qualification rate of work finished product, reduce the loss.
It will be evident to those skilled in the art that the invention is not limited to the details of the foregoing illustrative embodiments, and that the present invention may be embodied in other specific forms without departing from the spirit or essential attributes thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned.
Furthermore, it should be understood that although the present description refers to embodiments, not every embodiment may contain only a single embodiment, and such description is for clarity only, and those skilled in the art should integrate the description, and the embodiments may be combined as appropriate to form other embodiments understood by those skilled in the art.

Claims (9)

1.投影式作业系统，包括信息辅助装配平台，其特征在于，还包括：1. Projection type operation system, including information-assisted assembly platform, is characterized in that, also includes: 所述信息辅助装配平台包括数据层，用于集合装配过程中涉及的配装说明信息；以及：The information-assisted assembly platform includes a data layer for collecting assembly instruction information involved in the assembly process; and: 功能层，用于实现实心数据的共享和传递；以及：A functional layer for sharing and passing solid data; and: 软件层，用于实现对平台工作的正常运行；以及：The software layer for the normal operation of the platform's work; and: 支撑层，用于对平台提供硬件支持。The support layer is used to provide hardware support for the platform. 2.根据权利要求1所述的投影式作业系统，其特征在于，所述数据层包括装配说明信息，所述装配说明信息包括装配信息、引导信息和管理文档，所述数据层呈现的形式为文字数据、图片数据和结构化的管理数据。2 . The projection operation system according to claim 1 , wherein the data layer includes assembly instruction information, the assembly instruction information includes assembly information, guidance information and management documents, and the data layer is presented in the form of: 3 . Text data, image data and structured management data. 3.根据权利要求1所述的投影式作业系统，其特征在于，所述功能层包括位资注册模块、手势识别模块和信息管理模块，所述位资注册模块、手势识别模块和信息管理模块是相互关联的独立系统。3. The projection operation system according to claim 1, wherein the functional layer comprises a position registration module, a gesture recognition module and an information management module, the position registration module, the gesture recognition module and the information management module are interrelated independent systems. 4.根据权利要求1所述的投影式作业系统，其特征在于，所述软件层包括VS2017、OpenCV和Pytorch，所述VS2017(Microsoft Visual Studio2017)是一个集成式开发工具，所述OpenCV(Open Source Computer Vision Library)是开源计算机视觉库，所述Pytorch是深度学习框架，用于进行物体和文字的识别。4. The projection operating system according to claim 1, wherein the software layer comprises VS2017, OpenCV and Pytorch, the VS2017 (Microsoft Visual Studio2017) is an integrated development tool, the OpenCV (Open Source Computer Vision Library) is an open source computer vision library, the Pytorch is a deep learning framework for object and text recognition. 5.根据权利要求1所述的投影式作业系统，其特征在于，所述支撑层包括工业数字摄像机、投影仪、计算机、工作站和线缆，所述工业数字摄像机用于捕获装配现场信息和用户手势信息。5. The projection type work system according to claim 1, wherein the support layer comprises industrial digital cameras, projectors, computers, workstations and cables, and the industrial digital cameras are used to capture assembly site information and users Gesture information. 6.一种投影式作业引导方法，其特征在于，包括装配现场动作和信息投影辅助装配平台的工作阶段的配合，装配现场动作的指令发送到信息投影辅助装配平台的工作阶段，监控信息投影辅助装配平台的工作进程，信息投影辅助装配平台将收集处理后的信息传送给装配现场动作的操作台上，利用信息辅助装配平台监控装配现场动作，实现信息的反馈和动作的监控。6. A projection-type operation guidance method is characterized in that, comprising the coordination of the work stage of the assembly site action and the information projection auxiliary assembly platform, the instruction of the assembly site action is sent to the work stage of the information projection auxiliary assembly platform, and the monitoring information projection aids the work stage. In the working process of the assembly platform, the information projection auxiliary assembly platform transmits the collected and processed information to the operation console of the assembly site action, and uses the information auxiliary assembly platform to monitor the assembly site action, so as to realize the feedback of information and the monitoring of the action. 7.根据权利要求6所述的投影式作业引导方法，其特征在于，所述信息投影辅助装配平台的工作阶段包括工作阶段和离线阶段，所述离线阶段包括离线标定和投影信息库，所述离线标定的过程是首先拍摄参考图像，随后进行参考图像标定，最后进行离线标定信息的收集，将离线标定信息发送给工作阶段；投影信息库包括图形引导信息和文字信息，所述文字信息包括零件名称、说明信息和工具信息，将文字信息和图形引导信息发送给工作阶段。7 . The projection type job guidance method according to claim 6 , wherein the working stage of the information projection auxiliary assembly platform includes a working stage and an offline stage, and the offline stage includes offline calibration and a projection information base, and the The process of offline calibration is to first take a reference image, then calibrate the reference image, and finally collect offline calibration information, and send the offline calibration information to the working stage; the projection information library includes graphic guidance information and text information, and the text information includes parts. Name, description information and tool information, text information and graphical guidance information are sent to the work stage. 8.根据权利要求7所述的投影式作业引导方法，其特征在于，所述工作阶段包括装配现场图像、指令获取、现场注册、现场投影信息、渲染和投射五个步骤，将采集到的装配现场图像，经过指令获取后和离线标定输出的信息进行比较，如果一致则进行现场注册，经过现场投影信息后，利用渲染与投射将指导信息传送给操作台，进行对作业过程的投影指导，所述现场注册的信息来自于离线标定的信息输出端，所述现场投影信息所需要的信息来自于投影信息库的信息输出端。8. The projection-type job guidance method according to claim 7, wherein the working stage comprises five steps of assembly site image, instruction acquisition, site registration, site projection information, rendering and projection. On-site images, after command acquisition, are compared with the information output from offline calibration. If they are consistent, on-site registration is performed. After on-site projection information, the guidance information is transmitted to the console by rendering and projection, and the projection guidance for the operation process is carried out. The information of the on-site registration comes from the information output terminal of the offline calibration, and the information required by the on-site projection information comes from the information output terminal of the projection information database. 9.根据权利要求8所述的投影式作业引导方法，其特征在于，所述投影式作业引导方法包括平台硬件构成，所述平台硬件构成包括工业数字摄像机、投影仪、台式计算机、现实设备和装配工作台，所述工业数字摄像机和投影仪固定在固定机架上，所述固定机架通过吊架安装在装配操作平台上方，所述工业数字摄像机和投影仪通过线缆和台式计算机相连，所述台式计算机固定在固定机架上一侧，首先通过渲染与投射将指导信息投影到操作台上，指导作业人员的工作，指导过程是分阶段指导，利用工业数字摄像机实时监控作业人员的手部动作，作业人员手部动作不规范时，指导投影停止，且系统给出手势错误的警告。9 . The projection type job guidance method according to claim 8 , wherein the projection type job guidance method comprises a platform hardware configuration, and the platform hardware configuration includes an industrial digital camera, a projector, a desktop computer, a reality device and an assembly workbench, the industrial digital camera and the projector are fixed on a fixed frame, the fixed frame is installed above the assembly operation platform through a hanger, the industrial digital camera and the projector are connected to the desktop computer through cables, The desktop computer is fixed on one side of the fixed rack. First, the guidance information is projected onto the operating table through rendering and projection to guide the work of the operator. The guidance process is guided in stages, and the operator's hands are monitored in real time by industrial digital cameras. When the operator's hand movements are irregular, the guidance projection stops, and the system gives a warning of wrong gestures.
CN202110711694.XA 2021-06-25 2021-06-25 Projection type operation guiding method and system Pending CN113393535A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110711694.XA CN113393535A (en) 2021-06-25 2021-06-25 Projection type operation guiding method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110711694.XA CN113393535A (en) 2021-06-25 2021-06-25 Projection type operation guiding method and system

Publications (1)

Publication Number Publication Date
CN113393535A true CN113393535A (en) 2021-09-14

Family

ID=77623932

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110711694.XA Pending CN113393535A (en) 2021-06-25 2021-06-25 Projection type operation guiding method and system

Country Status (1)

Country Link
CN (1) CN113393535A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114038253A (en) * 2021-12-14 2022-02-11 领车（上海）汽车科技有限公司 Car washing operation guide system
CN115273569A (en) * 2022-07-18 2022-11-01 长沙润伟机电科技有限责任公司 Intelligent light and shadow guiding system
CN116330305A (en) * 2023-05-30 2023-06-27 常州旭泰克系统科技有限公司 Multi-mode man-machine interaction assembly method, system, equipment and medium thereof
CN116773213A (en) * 2023-05-22 2023-09-19 北京北九方轨道交通科技有限公司 Electric locomotive brake maintenance line

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110825234A (en) * 2019-11-11 2020-02-21 江南大学 Projection type augmented reality tracking display method and system for industrial scene
CN110928418A (en) * 2019-12-11 2020-03-27 北京航空航天大学 A kind of MR-based aviation cable auxiliary assembly method and system
CN211604116U (en) * 2020-03-10 2020-09-29 南京翱翔信息物理融合创新研究院有限公司 Projection type augmented reality fastener assembly guiding and detecting device
US20200334851A1 (en) * 2019-04-22 2020-10-22 Dag Michael Peter Hansson Projected Augmented Reality Interface with Pose Tracking for Directing Manual Processes
CN111860142A (en) * 2020-06-10 2020-10-30 南京翱翔信息物理融合创新研究院有限公司 Projection enhancement oriented gesture interaction method based on machine vision

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200334851A1 (en) * 2019-04-22 2020-10-22 Dag Michael Peter Hansson Projected Augmented Reality Interface with Pose Tracking for Directing Manual Processes
CN110825234A (en) * 2019-11-11 2020-02-21 江南大学 Projection type augmented reality tracking display method and system for industrial scene
CN110928418A (en) * 2019-12-11 2020-03-27 北京航空航天大学 A kind of MR-based aviation cable auxiliary assembly method and system
CN211604116U (en) * 2020-03-10 2020-09-29 南京翱翔信息物理融合创新研究院有限公司 Projection type augmented reality fastener assembly guiding and detecting device
CN111860142A (en) * 2020-06-10 2020-10-30 南京翱翔信息物理融合创新研究院有限公司 Projection enhancement oriented gesture interaction method based on machine vision

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
《中国优秀硕士学位论文全文数据库》: "基于信息投影技术的辅助装配平台开发", 《中国优秀硕士学位论文全文数据库》 *

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114038253A (en) * 2021-12-14 2022-02-11 领车（上海）汽车科技有限公司 Car washing operation guide system
CN115273569A (en) * 2022-07-18 2022-11-01 长沙润伟机电科技有限责任公司 Intelligent light and shadow guiding system
CN115273569B (en) * 2022-07-18 2023-09-19 长沙润伟机电科技有限责任公司 Intelligent shadow guiding system
CN116773213A (en) * 2023-05-22 2023-09-19 北京北九方轨道交通科技有限公司 Electric locomotive brake maintenance line
CN116330305A (en) * 2023-05-30 2023-06-27 常州旭泰克系统科技有限公司 Multi-mode man-machine interaction assembly method, system, equipment and medium thereof
CN116330305B (en) * 2023-05-30 2023-10-31 常州旭泰克系统科技有限公司 Multi-mode man-machine interaction assembly method, system, equipment and medium thereof

Similar Documents

Publication Publication Date Title
CN113393535A (en) Projection type operation guiding method and system
Gurevich et al. TeleAdvisor: a versatile augmented reality tool for remote assistance
Ou et al. Gestural communication over video stream: supporting multimodal interaction for remote collaborative physical tasks
Regenbrecht et al. Magicmeeting: A collaborative tangible augmented reality system
EP3769509B1 (en) Multi-endpoint mixed-reality meetings
US20110316845A1 (en) Spatial association between virtual and augmented reality
CN110928418A (en) A kind of MR-based aviation cable auxiliary assembly method and system
CN107491174A (en) Method, apparatus, system and electronic equipment for remote assistance
Wang et al. A gesture-and head-based multimodal interaction platform for MR remote collaboration
Adcock et al. Using projected light for mobile remote guidance
Ustundag et al. The role of augmented reality in the age of industry 4.0
US7377650B2 (en) Projection of synthetic information
Huang et al. A review on communication cues for augmented reality based remote guidance
Raj et al. Augmented reality and deep learning based system for assisting assembly process
Chantziaras et al. An augmented reality-based remote collaboration platform for worker assistance
CN113270006B (en) HoloLens-based printing machine operation training system and method
CN117292601A (en) Virtual reality sign language education system
Wang et al. Cross-platform AR annotation for assembly-design communication in pipe outfitting
Caruso et al. Augmented reality system for the visualization and interaction with 3D digital models in a wide environment
TW202125391A (en) Artificial intelligence and augmented reality system and method and computer program product
Bode Evaluation of an augmented reality assisted manufacturing system for assembly guidance
Bednarz et al. Applications of networked virtual reality for tele-operation and tele-assistance systems in the mining industry
Gunn et al. Using sticky light technology for projected guidance
TWM594733U (en) Artificial intelligence and augmented reality system
Gimeno et al. An occlusion-aware AR authoring tool for assembly and repair tasks

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20220908

Address after: 518000 floor 2-14, 15, Xinghe wordg2, No.1 Yabao Road, Bantian street, Longgang District, Shenzhen City, Guangdong Province

Applicant after: Shenzhen Institute of artificial intelligence and Robotics

Address before: 518000 902-9a, building 2, Xinghe worldg, No. 1, Yabao Road, Nankeng community, Bantian street, Longgang District, Shenzhen, Guangdong

Applicant before: Shenzhen Tuopu Zhizao Technology Co.,Ltd.

Applicant before: Shenzhen Institute of artificial intelligence and Robotics

TA01 Transfer of patent application right
RJ01 Rejection of invention patent application after publication

Application publication date: 20210914

RJ01 Rejection of invention patent application after publication