TWI687720B - Head mounted display apparatus, augmented reality system and contorl method for augmented reality - Google Patents

Abstract

A head mounted display apparatus, an augmented reality (AR) system and a control method for AR are provided. The head mounted display apparatus includes a body, an image capturing apparatus, a processor, two display apparatuses, two transparent panels, a motion sensor, and a transmission. A head can wear the body, and a mobile apparatus can be placed on the body. The 180-degree image capturing apparatus captures upwardly to obtain multiple capturing images. The processor transforms the capturing images into multiple left and right images. The display apparatuses display the left and right images, respectively. The left and right images would be projected through the transparent panel, and a paraboloid reflector thereof allocates external light. Motion status detected by the motion sensor can be transmitted to the mobile apparatus through the transmission interface. Accordingly, the weight balance of the head mounted display apparatus, image definition and estimation error can be improved.

Description

Head-mounted display device, augmented reality system and augmented reality control method

The present invention relates to an Augmented Reality (AR) technology, and particularly relates to a head-mounted display device, an augmented reality system and an augmented reality control method.

Technologies used to simulate scenes, environments, and perceptions (for example, Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR)) are considered future trends in technological development . These technologies can be applied in various fields such as games, military training, health care, remote work, etc., so that various fields of industry are eager to invest in research and development.

It is worth discussing that most AR applications today are only for mobile devices (for example, smartphones, tablets, etc.), and AR glasses or helmet products are relatively few in the market. Please refer to FIG. 1 which is a schematic diagram of a user wearing an existing AR helmet on the head H. The design of the AR helmet HMD on the market combined with a smartphone usually requires the mobile phone to be placed in a slot in front of the user's forehead and above the eyes. In addition, a semi-perspective lens is provided in front of the user, so that the user can not only see the real world through the lens, but also see the virtual objects presented through the lens reflection on the mobile phone screen, so as to achieve the AR effect.

However, the aforementioned design of the existing AR helmet has the following disadvantages: (1) The smartphone must be placed in front of the eyes, which may cause the proportion of the AR helmet to be unbalanced, and the user will feel that the front of the helmet is heavy and feels bad after wearing it. (2) The display effect is easily affected by the light intensity. The brighter the user sees, the less clear the phone screen will be, but the real world is just the opposite (the brighter the user sees, the clearer the scene will be) ). (3) The frame rate of the AR helmet display content (Frames Pre Second, FPS) is limited by the frame rate supported by the mobile phone display screen. (4) The resolution of the display content of the AR helmet is also limited to the resolution supported by the mobile phone display screen. It can be seen that the existing AR helmets still need to be improved.

In view of this, the present invention provides a head-mounted display device, an augmented reality system, and an augmented reality control method. The mobile phone can be placed above the head to balance the specific gravity, and can improve image clarity, frame rate and Resolution.

A head-mounted display device according to an embodiment of the present invention includes a body, an image capture device, a processor, two display devices, two perspective panels, a motion sensor, and a transmission interface. The body includes a head-mounted part and an accommodating part. The head-mounted part is used for wearing the head. The accommodating portion is provided on the top side of the head-wearing portion, and the accommodating portion is used for accommodating a mobile device with a display screen. The image capturing device is set in the accommodating part and used to shoot upward to obtain several captured images. The angle of view of the image capturing device is 180 degrees. The processor is coupled to the image capturing device, and the processor converts these captured images into several left-eye images and several right-eye images. The display device is disposed on the head-mounted part and coupled to the processor. The display device displays the left-eye images and the right-eye images respectively. The see-through panel is provided on the head-mounted part and includes a parabolic reflector. The two display devices project those left-eye images and right-eye images to the two see-through panels. The motion sensor is coupled to the processor and used to obtain the motion status of the head-mounted display device. The transmission interface is coupled to the processor and used for connecting the mobile device, and the processor transmits the motion state of the head-mounted display device through the transmission interface.

An augmented reality (AR) system according to an embodiment of the present invention includes a mobile device and a head-mounted display device. The mobile device includes a display screen, and the display screen plays several display images. The head-mounted display device includes a body, an image capturing device, a processor and two display devices. The body is used for placing the mobile device with its display screen facing down. The image capturing device is set on the body and used to shoot towards the display screen to obtain several captured images, and the angle of view of the image capturing device is 180 degrees. The processor is coupled to the image capturing device and converts those captured images into several left-eye images and several right-eye images. The display device is disposed on the head-mounted part and coupled to the processor. The display device displays the left-eye images and the right-eye images respectively. The perspective panel is provided on the body, and includes a parabolic reflector. The two display devices project those left-eye images and right-eye images to the two perspective panels. The motion sensor is coupled to the processor and used to obtain the motion status of the head-mounted display device. The transmission interface is coupled to the processor and used for connecting the mobile device, and the processor transmits the motion state of the head-mounted display device to the mobile device through the transmission interface.

The augmented reality control method of the embodiment of the present invention is suitable for a head-mounted display device equipped with a mobile device having a display screen. The control method includes the following steps. Shoot this display screen to obtain several captured images. Convert those captured images into several left-eye images and several right-eye images. Display those left eye images and those right eye images respectively. Project those left-eye and right-eye images to the perspective panel, and distribute the external light through the parabolic reflector of the perspective panel. Obtain the motion status of the head-mounted display device, and transmit the motion status of the head-mounted display device to the mobile device.

Based on the above, the head-mounted display device, the augmented reality system and the augmented reality control method of the embodiments of the present invention can be used to place the mobile device above the user's head, and through image capture, image conversion, and image The projection mode is imaged on the see-through panel, thereby improving the weight problem of the head-mounted display device. In addition, the embodiments of the present invention increase the definition by adding a parabolic reflector, predict the repeated content image to improve the frame rate, and improve the image resolution by adding an image capturing device. On the other hand, the motion status of the head-mounted display device and the external controller can also be fed back to the mobile device, so as to obtain more degrees of freedom (DOF) information.

In order to make the above-mentioned features and advantages of the present invention more obvious and understandable, the embodiments are specifically described below in conjunction with the accompanying drawings for detailed description as follows.

2 and 3 are schematic diagrams of an AR system 1 according to an embodiment of the invention. 2 and 3, the AR system 1 includes at least but not limited to the mobile device M and the head-mounted display device 100.

The mobile device M may be an electronic device such as a smart phone, a tablet computer, a portable game machine, etc. The mobile device M includes at least but not limited to the display screen D, and the display screen D may present several display screens.

The head-mounted display device 100 at least includes but is not limited to the body 110, the transmission interface 120, the image capture device 130, the processor 140, the two display devices 150, and the see-through panel 160. The head-mounted display device 100 of the embodiment of the present invention is applied to the AR technology.

FIG. 4 is a schematic diagram of imaging of the AR system 1 according to an embodiment of the present invention. 2 to 4, the body 110 includes a head-mounted part 111 and a receiving part 113. The head-mounted portion 111 provides an accommodation space 114 for the user's head H2 to wear. The accommodating portion 113 is disposed on the top side of the head-mounted portion 111, and its position is approximately above the top side of the head H2, and the accommodating portion 113 provides an accommodating space 112 for the mobile device M to accommodate. The heavier mobile device M is located above the head H2, which will balance the overall gravity of the AR system 1 and allow the user's head H2 to move easily. It is worth noting that the accommodating portion 113 of the embodiment of the present invention provides that the mobile device M is placed with its display screen D facing down, that is, the display screen D is generally facing the top side of the head H2.

Please refer to FIG. 1, the transmission interface 120 may be a wired interface such as Universal Serial Bus (USB), Thunderbolt, etc., or Wi-Fi, Bluetooth, Near Field Communication (Near) -Field Communication, NFC) and other wireless interfaces. The transmission interface 120 of the embodiment of the present invention is used to connect the mobile device M by wire or wirelessly to transmit or receive data with each other.

Please refer to FIGS. 1 and 2, the image capturing device 130 may be a device such as a camera or a video camera. It is worth noting that the image capturing device 130 is disposed on the bottom side of the accommodating portion 113 (ie, the top side of the head-mounted portion 111), and shoots toward the display screen D (ie, upward) of the mobile device M. The angle of view of the image capturing device 130 is 180 degrees (for example, a 180-degree camera). It should be noted that, in other embodiments, the angle of view of the image capturing device 130 may be 160 degrees, 120 degrees, or the like.

The processor 140 is coupled to the transmission interface 120 and the image capturing device 130, and may be a central processing unit (Central Processing Unit, CPU), or other programmable general-purpose or special-purpose microprocessors, Digital signal processor (Digital Signal Processor, DSP), programmable controller, application-specific integrated circuit (ASIC) or other similar components or a combination of the above components. In the embodiment of the present invention, the processor 140 is used to perform all operations of the head-mounted display device 100, and can load and process images captured by the image capturing device 130.

Each display device 150 is coupled to the processor 140, and the display device 150 may be any type of micro-projector (eg, 1, 1.5, 2 inches, etc.) such as a liquid crystal display, digital light processing (Digital Light Processing, DLP), or the like. In the embodiment of the present invention, the display device 150 displays/projects the image from the processor 140, and the two display devices 150 respectively correspond to the left-eye and right-eye frames.

The two see-through panels 160 are provided on the head-mounted portion 110 and located in front of the eyes of the head H2. Each see-through panel 160 includes a see-through area and a display area, wherein the see-through area is provided with a parabolic reflector to distribute light sources, and the display area is for a display device 150 to project a picture. Referring to FIG. 4, the light L1 emitted by the display device 150 will be reflected to the user's eyes through the see-through panel 160, and the outside light L2 can penetrate the see-through panel 160 to reach the user's eyes. After the light L2 is distributed through the parabolic reflector to distribute the light source, the influence on the clarity of the projected picture can be reduced and the stability can be improved, so that the head-mounted display device 100 can be applied to environments with different brightness.

To help understand the operation flow of the embodiment, the device and mechanism components of the AR system 1 in FIGS. 2 to 4 will be described below. 5 is a schematic flowchart of a control method according to an embodiment of the invention. Please refer to FIG. 5, a display image DI (which may include virtual objects, images or pictures) is displayed on the display screen D of the mobile device M. The image capturing device 130 shoots the display screen D to obtain several captured images CI (step S501), and the captured images CI are sequentially transmitted to the processor 140 (step S502). Then, the processor 140 converts the captured image CI into a left-eye image and a right-eye image corresponding to the two display devices 150. In this embodiment, since the 180-degree angle of view of the image capture device 130 lens specification will cause image distortion (distortion), the processor 140 will perform de-warp or distortion correction on each captured image CI (If the captured image is not distorted, it can be omitted). In addition, the processor 140 divides the frame of the corrected captured image CI to generate left-eye and right-eye images corresponding to the left and right eyes (step S503). It should be noted that, according to actual needs, the processor 140 may also perform image correction techniques such as exposure correction and color correction on each captured image CI, which is not limited in the embodiment of the present invention.

The processor 140 sequentially transmits the left-eye images and the right-eye images to the two display devices 150 respectively, and the two display devices 150 can display the left-eye images and the right-eye images respectively (step S504), and transfer the left-eye images The right-eye image is projected onto the two perspective panels 160 (step S505), so that the AR content such as virtual objects, images, or pictures included in the display image DI is displayed on the perspective panel 160, and the AR display effect is achieved. Since the embodiment of the present invention adopts the method of image capturing and re-imaging, the position of the mobile device M will not be limited to the position in front of the user. The position above the head is close to or the center of gravity of the head-mounted display device 100. Therefore, arranging the mobile device M at the position above the head will make the head-mounted display device 100 have a uniform specific gravity, and the user’s head H2 can be convenient and easy Ground activities.

It is worth noting that the frame rate (FPS) of the display image DI presented by the mobile device M on the display screen D may be inconsistent with the FPS of the image captured by the image capture device 130. For example, the FPS of the display screen D is 30 frames per second, and the image capture device 130 is 60 frames per second, so that several of the captured images CI may have duplicate content, and the left and right eye images The frame rate is limited by the frame rate of display D. In order to effectively improve the frame rate, the embodiment of the present invention uses time and the content of the previous screen to predict the screen during the occurrence of repeated content.

For example, FIG. 6 is a schematic diagram of a preset screen according to an embodiment of the invention. Please refer to FIG. 6. Assuming that the frame rate of the mobile device M playing the display image DI is 30 frames per second, the frames F1 and F2 of the front and rear frames are separated by about 33 milliseconds (ms). The image capturing device 130 obtains the captured image CI at a frame rate of 60 frames per second, and then the image capturing device 130 captures the image F1 again 16 milliseconds after capturing the image F1. The processor 140 predicts the content of the frame F1' based on the content of the frame F1 or the previous frame (for example, through dynamic prediction, neural network, etc.), and the processor 140 replaces the frame F1' with the second repeated frame. F1 (that is, the predicted picture is substituted for the content repeated picture), and then those left-eye images LI and those of the right-eye images RI are generated according to the frames F1 and F1′ (for example, processing such as distortion correction and frame division). The generation of the remaining frames F2' and F3' can be deduced by analogy, and will not be repeated here. This can increase the frame rate of 30 frames per second to 60 frames per second. It should be noted that the frame rate used in the embodiment of FIG. 6 is only used as an example and can be changed according to the specifications of different display screens D and the image capturing device 130. In addition, in other embodiments, the processor 140 may also predict more images during the content repetition period (ie, not limited to one image) to further increase the frame rate.

In addition, since the head-mounted display device 100 directly displays the image captured by the image capturing device 130 on the display screen D, the left and right eye images may also be limited by the resolution supported by the display screen D and the image capturing device 130. In order to effectively improve the resolution, one or more image capturing devices 130 may be added in the embodiments of the present invention, and these image capturing devices 130 are set at different positions and simultaneously shot toward the display screen D. The processor 140 then uses the super-resolution imaging technology (for example, sub-pixel image localization) and single frame deblurring of the captured images of these image capturing devices 130 ( single-frame de-blurring, etc.) produces those left-eye and right-eye images. For example, the resolution of the display screen D is 1920×1080. If a screen with a resolution of 2880×1440 is to be presented to the user, the processor 140 can enlarge the captured image of 1920×1080 to 2880×1440, and then fill in 960× 360 handicap color. If reference is made to the captured images of one or more image capturing devices 130 and the relative position of these captured images is obtained based on different image capturing devices 130, these difference points can be calculated by ultra-high resolution imaging technology Color value. That is, the content imaged by different image capturing devices 130 at different positions is comprehensively processed to improve the resolution.

On the other hand, please return to FIG. 5. In this embodiment, the AR system 1 of the embodiment of the present invention includes a tracking system and a remote control system. That is, the AR system 1 further includes a controller C (for example, a handheld controller, a tracker, etc.), and the head-mounted display device 100 further includes a motion sensor 170 and a wireless receiver 180. The motion sensor 170 may be a camera, an infrared receiver/transmitter, an Inertial Measurement Unit (IMU), etc. used to sense the angular velocity, acceleration, orientation, posture, and other motion states of the head-mounted display device 100 (may include Six degrees of freedom (DOF, including three directions of rotation and three directions of translation) sensing raw data). The wireless receiver 180 may be a receiver that supports Wi-Fi, Bluetooth and other wireless communication technologies, and is used to receive external data from the controller C (for example, related to the motion state of the controller C in the embodiment of the present invention) ). The processor 140 is coupled to the motion sensor 170 and the wireless receiver 180.

For motion state tracking, the processor 140 can obtain the motion state of the head-mounted display device 100 through the motion sensor 170 (step S506), and the processor 140 can obtain the motion state from the controller C through the wireless receiver 180 (step S507) ). The processor 140 aggregates data related to the motion state of the head-mounted display device 100 and/or the controller C (for example, six-degree-of-freedom raw data) (step S509), and transmits it to the mobile device M through the transmission interface 120.

The left half of FIG. 5 is about the software architecture of the mobile device M. Please refer to FIG. 5, the real-time tracking service obtains the motion-related information of the head-mounted display device 100 and/or the controller C (step S511), the low-level tracking application programming interface (Application Programming Interface, API) (or software development kit ( Software Development Kit (SDK)) will calculate the six-degree-of-freedom position, rotation angle, speed, angular velocity and other motion state information of the head-mounted display device 100 and/or the controller C according to these motion state related data (step S512), and the high-level The tracking API (or SDK) obtains motion state information from the low-level tracking API and obtains the mobile device M's own M from the operating system (OS) native AR core API (eg, iOS AR Kit, Android AR Core, etc.) Six-degree-of-freedom or three-degree-of-freedom (depending on the specifications of the sensing element of the mobile device M) motion state information (eg, position, rotation angle, speed, angular velocity, etc.) (step S513). The application program can integrate the motion state information of at least one of the head-mounted display device 100, the controller C, and the mobile device M, and calculate and generate the AR content included in the display image DI accordingly (step S514). After the native AR core API obtains the AR content (step S515), the display image DI including those AR contents can be displayed through the display screen D (step S516). It should be noted that the aforementioned tracking API can be used by third-party developers to develop their AR content, and the present invention is not limited. It can be seen that the embodiments of the present invention can improve the accuracy of the mobile device M in evaluating its own motion state and reduce errors by integrating the motion state of the head-mounted display device 100 and/or the controller C. For example, if the mobile device M originally supports only three degrees of freedom, it can be increased to six degrees of freedom because the motion sensor 170 or the controller C supports six degrees of freedom.

In summary, the head-mounted display device, augmented reality system and augmented reality control method of the present invention can provide the mobile device to be placed above the user's head, thereby improving the weight problem of the AR helmet. Since the image viewed by the user is captured by the image capture device and restored again, replacing the content repetitive frame through image prediction can effectively increase the frame rate. In addition, the embodiments of the present invention may add an image capturing device, and improve the image resolution through ultra-high resolution imaging. In image imaging, the embodiments of the present invention display the display screen of the mobile device on the perspective panel through projection technology, and distribute the light source through the parabolic reflector, which can effectively improve the clarity of the image. On the other hand, the mobile device according to the embodiment of the present invention can also obtain the motion state of the head-mounted display device and/or the external controller, so as to reduce errors in evaluating the motion state or position.

Although the present invention has been disclosed as above with examples, it is not intended to limit the present invention. Any person with ordinary knowledge in the technical field can make some changes and modifications without departing from the spirit and scope of the present invention. The scope of protection of the present invention shall be subject to the scope defined in the appended patent application.

1: Augmented reality system M: mobile device 100: Head-mounted display device D: Display screen 110: Ontology 120: Transmission interface 130: Image capture device 140: processor 150: display device 160: Perspective panel 111: Headwear 113: Accommodation Department 112, 114: accommodating space H, H2: head HMD: Augmented reality helmet L1, L2: light S501~S516: Steps DI: display image CI: Capture images LI: left eye image RI: right eye image F1~F4, F1’~F3’: Picture C: Controller 170: Motion sensor 180: wireless receiver

FIG. 1 is a schematic diagram of a user’s head wearing an existing AR helmet. FIG. 2 is a schematic diagram of an AR system according to an embodiment of the invention. FIG. 3 is a schematic diagram of another perspective of an AR system according to an embodiment of the present invention. FIG. 4 is a schematic diagram of an AR system imaging according to an embodiment of the invention. 5 is a schematic flowchart of a control method according to an embodiment of the invention. 6 is a schematic diagram of a preset screen according to an embodiment of the invention.

M: mobile device

100: Head-mounted display device

120: Transmission interface

130: Image capture device

140: processor

150: display device

160: Perspective panel

111: Headwear

113: Accommodation Department

114: accommodating space

H2: head

L1, L2: light

Claims (11)

A head-mounted display device includes a body including a head-mounted part for wearing a head, and an accommodating part provided on the top side of the head-mounted part, wherein the accommodating part is used for a mobile device with a display screen At least one image capture device, which is provided in the accommodating part and used to shoot upward to obtain multiple captured images, and the angle of view of the at least one image capture device is 180 degrees; a processor is coupled to the At least one image capturing device, and converting the captured images into multiple left-eye images and multiple right-eye images; two display devices, which are provided on the head-mounted part and coupled to the processor, and display the respective A left-eye image and the right-eye images; two perspective panels, which are provided on the head-mounted part and include a parabolic reflector, wherein the two display devices project the left-eye images and the right-eye images to the two perspective panels At least one motion sensor, coupled to the processor, and used to obtain the motion status of the head-mounted display device; a transmission interface, coupled to the processor, and used to connect the mobile device, wherein the processor passes through the The transmission interface transmits the motion state of the head-mounted display device; and a wireless receiver, coupled to the processor, and used to obtain an external data, wherein the external data relates to the motion state of an external device, and the processor passes The transmission interface transmits the external data. The head-mounted display device as described in item 1 of the patent scope, wherein the processor divides the captured image and corrects the image distortion for each of the captured images to form a left-eye image and a right-eye image. The head-mounted display device as described in item 1 of the patent application scope, wherein the captured images include a first frame and a second frame arranged according to time sequence, and the content of the first frame and the second frame are the same, The processor predicts the content of a third frame based on the content of the first frame, the processor replaces the third frame with the second frame, and generates the left-eye images based on the first frame and the third frame And these right eye images. An augmented reality (AR) system includes: a mobile device, including a display screen, and the display screen plays multiple display images; and a head-mounted display device, including: a body for the mobile device Placed with the display screen facing down; at least one image capture device is provided on the body and used to shoot toward the display screen to obtain multiple captured images, and the angle of view of the at least one image capture device is 180 degrees; A processor, coupled to the at least one image capturing device, and converting the captured images into a plurality of left-eye images and a plurality of right-eye images; two display devices are provided on the head-mounted part and are coupled to the processing And display the left-eye images and the right-eye images respectively; two perspective panels are provided on the body and include a parabolic reflector, wherein the The two display devices project the left-eye images and the right-eye images to the two perspective panels; at least one motion sensor, coupled to the processor, and used to obtain the motion status of the head-mounted display device; and a transmission The interface is coupled to the processor and used to connect the mobile device. The processor transmits the motion state of the head-mounted display device to the mobile device through the transmission interface. The augmented reality system as described in item 4 of the patent application scope further includes: at least one controller; and the head-mounted display device further includes: a wireless receiver, coupled to the processor, and obtained from the at least one External data of a controller, wherein the external data is related to the motion state of the at least one controller, and the processor transmits the external data to the mobile device through the transmission interface, and the mobile device is based on the at least one controller's The motion state produces these display images. The augmented reality system as described in item 5 of the patent application scope, wherein the mobile device integrates the motion state of at least one of the head-mounted display device, the at least one controller, and the mobile device, and generates a corresponding The augmented reality content in motion state, and the mobile device displays the display images including the augmented reality content. The augmented reality system as described in item 4 of the patent application scope, wherein the processor splits the frame and corrects the imaging distortion for each of the captured images to form a left-eye image and a right-eye image. The augmented reality system as described in item 4 of the patent application scope, wherein the captured images include a first frame and a second frame arranged according to time sequence, and the first The content of a picture is the same as that of the second picture, and the processor predicts the content of a third picture based on the content of the first picture. The processor replaces the third picture with the second picture and based on the first The third screen generates the left-eye images and the right-eye images. An augmented reality control method, which is suitable for a head-mounted display device loaded with a mobile device having a display screen, and the control method includes: shooting the display screen to obtain multiple captured images; Convert the images into multiple left-eye images and multiple right-eye images; display the left-eye images and the right-eye images respectively; project the left-eye images and the right-eye images to at least one perspective panel and pass The parabolic reflector of the at least one see-through panel distributes external light; obtains the motion state of the head-mounted display device; and transmits the motion state of the head-mounted display device to the mobile device. A head-mounted display device includes a body including a head-mounted part for wearing a head, and an accommodating part provided on the top side of the head-mounted part, wherein the accommodating part is used for a mobile device with a display screen At least one image capture device, which is provided in the accommodating part and used to shoot upward to obtain multiple captured images, and the angle of view of the at least one image capture device is 180 degrees; a processor is coupled to the At least one image capturing device, and converting the captured images into multiple left-eye images and multiple right-eye images; two display devices, which are provided on the head-mounted part and coupled to the processor, and display the respective Left eye image and the right eye image; Two perspective panels are provided on the head-mounted part and include a parabolic reflector, wherein the two display devices project the left-eye images and the right-eye images onto the two perspective panels; at least one motion sensor, coupled The processor is used to obtain the motion state of the head-mounted display device; and a transmission interface is coupled to the processor and used to connect the mobile device, wherein the processor transmits the head-mounted display device through the transmission interface In the motion state, the processor splits the frame and corrects the imaging distortion for each of the captured images to form a left-eye image and a right-eye image. A head-mounted display device includes a body including a head-mounted part for wearing a head, and an accommodating part provided on the top side of the head-mounted part, wherein the accommodating part is used for a mobile device with a display screen At least one image capture device, which is provided in the accommodating part and used to shoot upward to obtain multiple captured images, and the angle of view of the at least one image capture device is 180 degrees; a processor is coupled to the At least one image capturing device, and converting the captured images into multiple left-eye images and multiple right-eye images; two display devices, which are provided on the head-mounted part and coupled to the processor, and display the respective A left-eye image and the right-eye images; two perspective panels, which are provided on the head-mounted part and include a parabolic reflector, wherein the two display devices project the left-eye images and the right-eye images to the two perspective panels At least one motion sensor, coupled to the processor, and used to obtain the motion status of the head-mounted display device; and a transmission interface, coupled to the processor, and used to connect the mobile device, The processor transmits the motion state of the head-mounted display device through the transmission interface, wherein the captured images include a first frame and a second frame arranged according to time sequence, and the first frame and the second frame Is the same, and the processor predicts the content of a third frame based on the content of the first frame, the processor replaces the third frame with the second frame, and generates the third frame based on the first frame Some left-eye images and some right-eye images.

Images