CN110148330A - Around machine check training system before a kind of Aircraft based on virtual reality - Google Patents

Abstract

The invention discloses a virtual reality-based aircraft pre-flight walk-around inspection training system, which includes a graphics workstation, a virtual reality head-mounted display device, an operation control handle and a positioning tracking device. The system functions include guidance on precautions before use, The basic tutorial of using the system for the first time, the visual training of aircraft walk-around inspection; the visual training of aircraft walk-around includes the training of key points for inspection of the front of the fuselage, the training of key points for inspection of the middle of the fuselage, the training of key points for inspection of the rear of the fuselage, and the training of aircraft landing gear Inspection key points training, aircraft engine inspection key point training, aircraft wing inspection key point training. The beneficial effects of the present invention are: it can provide maintenance trainees with training on aircraft external inspection; compared with traditional paper-based materials and manually taught aircraft inspection training, it can provide users with a more realistic and immersive training experience, It makes human-computer interaction more convenient and training more efficient.

Description

A virtual reality-based aircraft pre-flight walk-around inspection training system

technical field

The invention relates to the technical field of virtual reality, in particular to a virtual reality-based aircraft pre-flight walk-around inspection training system.

Background technique

Virtual reality technology (Virtual Reality, VR) is an important direction of simulation technology. It is a collection of various technologies such as simulation technology, computer graphics, human-machine interface technology, multimedia technology, sensor technology, and network technology. It is a challenging interdisciplinary field. Technological frontier disciplines and research fields. Virtual reality technology mainly includes aspects such as simulated environment, perception, natural skills and sensing equipment. The simulated environment is a real-time dynamic three-dimensional realistic image generated by a computer. Perception means that ideal VR should have the perception that all human beings have. In addition to the visual perception generated by computer graphics technology, there are also perceptions such as hearing, touch, force, movement, and even smell and taste, also known as multi-sense. Natural skills refer to people's head rotation, eyes, gestures, or other human behaviors. The computer processes the data adapted to the participants' movements, and responds to the user's input in real time, and feeds back to the user's facial features respectively. . Sensing devices refer to 3D interactive devices.

With the development of computer engineering and computer graphics, the development of virtual reality technology is becoming more and more rapid, and its application is becoming more and more extensive. , developing distributed VR systems and other fields are developing better and faster. Virtual reality technology is widely used, such as education industry, game industry, medical industry, art industry and industry.

At present, aircraft pre-flight inspection training mainly relies on paper media and some multimedia technologies, such as using manuals, pictures and video information to teach and train students. Traditional training methods take a long time, and the absorption rate of trainees is generally not good, so the training efficiency is relatively low. Therefore, how to improve the training efficiency is an urgent problem to be solved in the present invention.

Contents of the invention

The technical problem to be solved by the present invention is to provide a virtual reality aircraft pre-flight walk-around inspection training system that can improve the efficiency of aircraft pre-flight inspection training.

In order to solve the above-mentioned technical problems, the technical solution adopted by the present invention is: a virtual reality-based aircraft pre-flight walk-around inspection training system, including a graphics workstation set indoors, a virtual reality head-mounted display device, an operation control handle and a positioning Tracking equipment, the virtual reality head-mounted display device is electrically connected to the graphics workstation via an adapter, and the graphics workstation transmits graphics to the virtual reality head-mounted display device; the positioning tracking device is provided with an infrared signal transceiver to receive virtual The infrared signal returned by the reality head-mounted display device and the operation control handle sends the accurate position information of the virtual reality head-mounted display device and the operation control handle in the scene space to the graphics workstation; Movement and interaction with objects in the field of view capture training information.

The virtual reality head-mounted display device includes a plurality of infrared sensing probes, a display screen, a position corrector and a gyroscope, and the infrared sensing probes are embedded in the virtual reality head-mounted display device for Accurate positioning to capture the exact position of the user; the display screen is set on the back of the virtual reality head-mounted display device to display the virtual environment and provide the user with a three-dimensional virtual immersion; the position corrector and the gyroscope are both built-in In the virtual reality head-mounted display device, it is used to estimate the motion state and relative position of the user; the camera is located at the front of the virtual reality head-mounted display device, and is used to be sensed by the positioning tracking device.

There are two positioning tracking devices; the graphics workstation includes a desktop graphics workstation and/or a mobile graphics workstation.

The graphics workstation is equipped with a pre-flight walk-around inspection training module, including a training module for key points of inspection at the front of the fuselage, a training module for key points at the middle of the fuselage, a training module for key points at the rear of the fuselage, and a key point inspection at the aircraft landing gear. A training module, an aircraft engine inspection key point training module, an aircraft wing inspection key point training module, and a tutorial guidance module, wherein the tutorial guidance module includes a precautions guidance module and a basic operation tutorial guidance module.

The virtual reality head-mounted display device displays a guide scene for precautions, a main menu scene, a main system scene, a basic operation tutorial scene, an inspection scene at the front of the fuselage, an inspection scene at the rear of the fuselage, an inspection scene at the middle of the fuselage, an aircraft Landing gear inspection scene, aircraft engine inspection scene and aircraft wing inspection scene.

The operation control handle is provided with a handle infrared sensing probe and function buttons Trigger, Pad, Menu and Power.

Include the following operations in the described training module: the switching of scene relies on the writing of C# language script; Program code is saved in the resource folder Asset; Set up three-dimensional object model under 3DSMax engine, build model in virtual scene and mount C# script and properties component.

The scene switching includes the following operations: the user holds the handle and emits a ray pointing to the scene switching button Button in the training scene, and presses the Trigger key on the handle to switch the scene.

The training module includes the following operations: the training information in the scene is composed of voice, pictures and text, wherein the pictures and text are respectively placed under the Image and Text of the Canvas, and the Canvas is set to the World Space world mode; the training module includes The following operations: In the scene, the control handle emits a straight line or curve, and the character clicks the handle Pad button to reach the position pointed by the handle in the scene where the script Teleportable is mounted, and completes the function of free movement; when the user wants to teleport to the high platform, The handle ray adjusts to curves.

The construction of the scene and the establishment of the object model are based on Unity3D and 3DsMax.

The beneficial effects of the present invention are: the virtual reality-based aircraft pre-flight inspection training provided by the present invention collects data on key points of the aircraft pre-flight inspection, uses the Unity3D engine to integrate resources to build a virtual human-computer interaction scene, and uses 3DSMax for physical training. The modeling of the model, according to the division of different areas on the outer surface of the aircraft, relies on the idea of modularization to complete the pre-flight walk-around inspection scene by area, transfer the scene from the PC to the virtual reality head-mounted display device, and combine each inspection step and The key points are presented to users more intuitively in the form of multimedia, which improves the diversity of data display and makes human-computer interaction more convenient, faster and more effective for users.

Description of drawings

Fig. 1 is the schematic diagram of the overall structure of the hardware of the aircraft pre-flight inspection training system based on virtual reality provided by the present invention;

Fig. 2 is a schematic front view of a virtual reality head-mounted display device provided by the present invention;

Fig. 3 is a schematic rear view of the virtual reality head-mounted display device provided by the present invention;

Fig. 4 is the overall design flowchart provided by the present invention;

Fig. 5 is a function diagram of a system scenario provided by the present invention.

In the picture:

1-Graphics Workstation 2-Virtual Reality Head Mounted Display Device

21-Infrared sensor probe 22-Display screen

23-Position Corrector 24-Gyroscope

25-Front camera

3-operation control handle 31-handle infrared sensor probe

4-location tracking device 5-adapter

Detailed ways

Below in conjunction with accompanying drawing and specific embodiment the present invention is described in further detail:

Fig. 1 shows a schematic diagram of the overall structure of a virtual reality-based aircraft pre-flight walk-around inspection system according to the present invention.

As shown in Figure 1, in the present invention, the display system based on virtual reality includes: graphics workstation 1, virtual reality head-mounted display device 2, operation control handle 3, positioning tracking device 4, wherein, graphics workstation 1 and virtual reality The head-mounted display device 2 is connected through an adapter 5 .

The operation control handle 3 includes a plurality of infrared sensing probes, wherein the handle infrared sensing probe 31 can be captured by the positioning tracking device 4, and the positioning tracking device 4 returns the position data of the handle to the built-in position corrector of the virtual reality head-mounted display device 2 And in the gyroscope, the accurate position of the operation control handle 3 in the indoor space can be obtained.

Graphics workstation 1 may include at least one of the following: desktop graphics workstation, mobile graphics workstation.

As shown in Figure 2 and Figure 3, the virtual reality head-mounted display device 2 includes a plurality of infrared sensing probes 21, a display screen 22 and a plurality of distance sensors, and the built-in position corrector 23 is not shown in the figure, and the gyroscope 24 is in the figure It is not shown in the figure, and the front part of the virtual reality head-mounted display device 2 also includes a front camera 25 . Wherein the infrared sensing probe 21 and the distance sensor can be sensed by the positioning tracking device 4, and the position information of the virtual reality head-mounted display device 2 in a given space is fed back to the graphics workstation; the built-in position corrector 23 and the gyroscope 24 calculate The spatial pose information of the virtual reality head-mounted display device 2 is fed back to the graphics workstation; the display screen 22 allows the user to interact with the virtual scene with the assistance of the operating control handle 3, thereby obtaining training from the system.

As shown in Figure 4, it is an overall design flow chart of the present invention, which shows the overall structure of the aircraft preflight inspection system based on virtual reality, that is, eight system function modules are developed based on the system hardware part and the relevant development engine, The hardware part of the system includes: a graphics workstation, a virtual reality head-mounted display device, an operation control handle and a positioning tracking device. The system function modules are several different training scenarios developed with the help of the Unity3D engine, including the front fuselage inspection key point training module, the fuselage middle inspection key point training module, the fuselage rear inspection key point training module, aircraft landing gear Check the key points training module, the aircraft engine inspection key points training module, the aircraft wing inspection key points training module, in addition to the precautions guidance module and the basic operation tutorial guidance module. The training module includes the following operations: In the scene, the control handle emits a straight line or a curve, and the character clicks the pad button of the handle to reach the position pointed by the handle in the scene where the teleportable script is mounted, and completes the function of free movement; when the user wants to teleport to When on a high platform, the handle ray is adjusted to a curve. In addition, the rays can be adjusted to a suitable curvature.

As shown in Figure 5, it is a system function diagram provided by the present invention, which shows all scene modules of the virtual reality-based aircraft walk-around inspection system, including: main interface scene, precautions guidance scene, basic operation tutorial scene, machine Front body inspection scene, fuselage middle inspection scene, fuselage rear inspection scene, aircraft landing gear inspection scene, aircraft engine inspection scene and aircraft wing inspection scene.

In a preferred technical solution, the UI design includes setting the UI interface font, font size, color, transparency, image size, and image resolution.

In the preferred technical solution, the switching between each scene is realized by the following operation: the operation depends on the button Button, and the Canvas where the button is located must be set to the world mode (World Space). The action of clicking the button to complete the scene switching is based on the following three points: find the VivePointer in the prefab directory in the HTC.UnityPlugin directory to make the operation control handle emit rays; mount the CanvasRaycaster script component under the Canvas; mount the self-written one on the Button In the script file, aim the handle light at the Button, press the Trigger button on the handle and click the Button to complete the scene switching.

In a preferred technical solution, the imaging in the user's field of view depends on the VR camera, and the viewing angle of the camera can move as the user moves. Among them, the VR camera component CameraRig can be found in the prefab Prefab under the Steam VR directory.

In the preferred technical solution, the user's arbitrary movement in the given plane space is realized by the following operation: this operation is based on mounting the Teleportable transmission script component on the given plane in the scene, and the user presses the Pad key on the operation control handle 3 Can move freely to target location.

In the preferred technical solution, the user interacts with virtual objects in a given space, and actions such as picking up, placing and throwing rigid objects in the space can be realized by the following operations: this operation is based on adding a ViveCollider component in the scene, and Rigidbody and Draggable script components need to be mounted on the physical model, so that with the help of the operating handle, you can get close to the object, press and hold the Trigger button to pick it up, and release the Trigger button to place and throw it.

In the preferred technical solution, the training for the user to obtain the key inspection points of each part of the aircraft exterior is realized by the following operations: create a UI in the scene, add Image and Text under the Canvas subdirectory, and assign the inspection process picture data and text data respectively For Image and Text, adjust the size of pictures and text, so that users can see the key points of each inspection process in the scene, and get more intuitive and efficient training.

In a preferred technical solution, the notice guidance module can provide the key points that users should pay attention to before using the system.

In a preferred technical solution, the basic operation tutorial guidance module can provide some operation training for users before using the system, such as training the interaction between human and UI and the interaction between human and objects.

In the preferred technical solution, the training module for the key points of the inspection of the front of the fuselage, the training module of the key points of the inspection of the middle of the fuselage, the training module of the key points of the rear of the fuselage, the training module of the key points of the aircraft landing gear inspection, and the key points of the inspection of the aircraft engine Training module, key point training module for aircraft wing inspection The six modules can provide users with more detailed and vivid aircraft inspection training, and the modular virtualized training system greatly improves the training efficiency.

In the preferred technical solution, the virtual training scene is developed under the Unity3D engine, and the physical modeling of the object is undertaken by 3DsMax.

In a preferred technical solution, the system also includes a graphics workstation (1), and a high-level graphics card and a professional-grade processor provide high-quality, high-speed, and smooth data communication support between the PC and the system.

The workflow steps of the virtual reality-based aircraft walk-around inspection training system of the present invention are as follows: connect the virtual reality hardware to the system, put on the virtual reality head-mounted display device, hold the operation control handle first to the main menu scene, and select Enter the precautions guide scene, basic operation tutorial scene or system main scene. Click the Trigger button to enter the precautions guidance scene, see the precautions before use, after viewing, turn the handle light on the "Back to Main Menu" button, click the Trigger button to return to the main menu scene; click the Trigger button to enter the basic operation tutorial scene , to practice picking and placing objects, and try the "teleport" function assisted by the handle. After practice, put the light on the handle on the "Back to Main Menu" button, and click the Trigger button to return to the main menu scene; click the Trigger button Enter the main scene of the system, you can see an aircraft maintenance scene, you can observe the appearance of the aircraft at close range, provide the interaction between people and the virtual environment, and provide an immersive experience. The function button can respectively enter the inspection scene of the front of the fuselage, the inspection scene of the middle part of the fuselage, the inspection scene of the rear fuselage, the inspection scene of the aircraft landing gear, the inspection scene of the aircraft engine, and the inspection scene of the aircraft wing. In each scene, the user can move freely, consult, sort out and memorize the key points of the inspection around the aircraft according to the pictures, text and voice prompts and compare the corresponding parts of the aircraft. In each sub-scene, there is a return to the "system main scene" Click the button to return to the main scene of the system. Compared with the traditional multimedia aircraft maintenance training, the virtual reality aircraft inspection training system of the present invention has a more intuitive training method and a stronger sense of immersion. The aircraft inspection training scene is modularized, which is conducive to the memory of the inspection process and the accuracy of memory On this basis, the training efficiency is improved.

The above is only a preferred embodiment of the present invention, but the scope of protection of the present invention is not limited thereto, any changes or changes that can be easily conceived by those skilled in the art within the technical scope disclosed in the present invention Replacement should be covered within the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

Claims (10)

1. A virtual reality-based aircraft flight inspection training system, characterized in that it includes a graphics workstation (1), a virtual reality head-mounted display device (2), an operating control handle (3) and A location tracking device (4), the virtual reality head-mounted display device (2) is electrically connected to the graphics workstation (1) via an adapter (5), and the graphics workstation (1) transmits graphics to the virtual reality head-mounted display device (2); the positioning tracking device (4) is provided with an infrared signal transceiver, receives the infrared signal returned by the virtual reality head-mounted display device (2) and the operation control handle (3) and displays the virtual reality head-mounted display The accurate position information of the device (2) and the operation control handle (3) in the scene space is sent to the graphics workstation (1); the operation control handle (3) assists in the movement in a given space and the acquisition of interactive actions with objects in the field of view Training Information. 2. A kind of virtual reality-based aircraft pre-flight walk-around inspection training system according to claim 1, characterized in that: the virtual reality head-mounted display device (2) includes a plurality of infrared sensing probes (21), A display screen (22), a position corrector and a gyroscope, the infrared sensing probe (21) is embedded on the virtual reality head-mounted display device (2), and is used for accurate positioning of the head-mounted display device to capture the user's accurate position; the display screen (22) is set on the back of the virtual reality head-mounted display device (2), used to display the virtual environment, and provide the user with a three-dimensional virtual immersion; the position corrector and the gyroscope are all built in In the virtual reality head-mounted display device (2), it is used to estimate the motion state and relative position of the user; the camera (25) is located at the front of the virtual reality head-mounted display device (2), and is used for being positioned and tracked (4) perception. 3. A virtual reality-based aircraft walk-around inspection training system according to claim 1, characterized in that: the positioning tracking device (4) is provided with two; the graphics workstation (1) includes a desktop Graphics workstations and/or mobile graphics workstations. 4. A kind of virtual reality-based aircraft pre-flight walk-around inspection training system according to claim 1, characterized in that: said graphics workstation (1) is provided with a pre-flight walk-around inspection training module, including a fuselage front Inspection key points training module, fuselage middle inspection key point training module, fuselage rear inspection key point training module, aircraft landing gear inspection key point training module, aircraft engine inspection key point training module, aircraft wing inspection key point training module and a tutorial guide module, the tutorial guide module includes a notice guide module and a basic operation tutorial guide module. 5. A kind of virtual reality-based aircraft pre-flight walk-around inspection training system according to claim 1, characterized in that: said virtual reality head-mounted display device (2) displays a point-of-care guidance scene, a main menu scene , system main scene, basic operation tutorial scene, front fuselage inspection scene, fuselage rear inspection scene, fuselage middle inspection scene, aircraft landing gear inspection scene, aircraft engine inspection scene and aircraft wing inspection scene. 6. A virtual reality-based aircraft pre-flight walk-around inspection training system according to claim 1, characterized in that: the operation control handle (3) is provided with a handle infrared sensor probe (31) and a function button Trigger to trigger key, Pad key, Menu key and Power key. 7. a kind of virtual reality-based aircraft inspection training system before flying around the plane according to claim 3, is characterized in that, comprises following operation in the described training module: the switching of scene relies on the writing of C# language script; Program code Save it to the resource folder Asset; create a 3D object model under the 3DSMax engine, and mount the C# script and property components for the model in the virtual scene. 8. A virtual reality-based aircraft walk-around inspection training system according to claim 7, characterized in that: the scene switching includes the following operations: the user holds the handle and sends a ray pointing to the scene switching button Button in the training scene , press the Trigger button on the handle to switch scenes. 9. A kind of virtual reality-based aircraft pre-flight walk-around inspection training system according to claim 3, wherein the training module includes the following operations: the training information in the scene is composed of voice, pictures and text, The pictures and text are respectively placed under the Image and Text of the Canvas, and the Canvas is set to the World Space world mode; the training module includes the following operations: In the scene, the operation control handle emits a straight line or a curve, and the character is mounted on the script Teleportable In the scene, click the Pad button of the handle to reach the position pointed by the handle to complete the function of free movement; when the user wants to teleport to the high platform, the handle ray is adjusted to a curve. 10. A virtual reality-based aircraft pre-flight walk-around inspection training system according to any one of claims 7, 8 or 9, characterized in that: the construction of the scene and the establishment of the object model are based on Unity3D and 3DsMax.