TWI559034B - Head-mounted display apparatus employing one or more reflective optical surfaces - Google Patents

Description

Head-mounted display device using one or more reflective optical surfaces

The present invention relates to a head mounted display device that uses one or more reflective optical surfaces (e.g., one or more free spaces, ultra wide angles, reflective optical surfaces (hereinafter abbreviated as "FS/UWA/RO surfaces"). More particularly, the present invention relates to a head mounted display device that uses a reflective optical surface such as an FS/UWA/RO surface to display an image from an illuminated display system that is held in close proximity to the user's eye.

A head mounted display such as a head mounted display or a glasses mounted display (herein abbreviated as "HMD") is a display device worn on the head of a person having one eye or (more generally) located at the user's head. One or more small display devices near the two eyes. 1 shows a basic element of a type of HMD that includes a display 11, a reflective optical surface 13, and an eye 15 having a center of rotation 17. As shown in this figure, light 19 from display 11 is reflected by surface 13 and enters the user's eye 15.

Some HMDs only display analog (computer generated) images (as opposed to real world images) and are therefore often referred to as "virtual reality" or submerged HMDs. Other HMDs overlay (combine) analog images on non-simulated real world images. The combination of non-analog images and analog images allows the HMD user to view the world via, for example, goggles or eyepieces, and additional information related to the task to be performed is superimposed on the goggles or eyepieces to the user's front field of view (FOV) )on. This overlay is sometimes referred to as "Augmented Reality" or "Mixed Reality."

A partially reflective/partially transmissive optical surface ("beam splitter") can be used to combine a non-simulated real-world view with a simulated image, in which case the reflectivity of the surface is used to simulate the image as a virtual image (in In optical terms, the transmittance of the surface is used to allow the user to directly view the real world (referred to as the "see-through system"). The real world view and the analog image can also be electronically combined (referred to as a "video see-through system") by accepting video from the real world view of the camera and electronically mixing it with the analog image using a combiner. The combined image can then be presented to the user as a virtual image (in an optical sense) by means of a reflective optical surface (in this case it does not need to have a transmission property).

As can be seen from the foregoing, reflective optical surfaces can be used in HMDs, which provide the user with: (i) a combination of analog and non-analog real-world images, (ii) a combination of analog and real-world video images, or Iii) Pure analog imagery. (The last case is often referred to as the "immersion" system.) In each of these cases, the reflective optical surface produces a virtual image (in an optical sense) that is viewed by the user. Historically, such reflective optical surfaces have been part of an optical system that has an exit pupil that substantially limits not only the dynamic field of view available to the user but also the static field of view. In particular, in order to see the image produced by the optical system, the user needs to align his eye with the exit pupil of the optical system and keep it in such alignment, and even then, the image visible to the user will not be covered. The entire fully static field of view of the user, i.e., the prior optical system used in the HMD that has used the reflective optical surface, has been part of the pupil forming system and has therefore been limited by the exit pupil.

The reason why the system has been so limited is the fact that the human vision is significantly larger. Thus, the static field of view of the human eye (including both the visual and peripheral vision of the eye) is approximately ~150° in the horizontal direction and approximately ~130° in the vertical direction. (For the purposes of the present invention, 150 degrees will be used as a straight forward static field of view of the nominal human eye.) A well-corrected optical system with an exit pupil capable of accommodating this large static field of view is sparse, and when present, It is expensive and bulky.

In addition, since the eye can rotate around its center of rotation, that is, the human brain can aim at the visual field of the human eye + peripheral vision in different directions by changing the gaze direction of the eye, so the operational field of view (dynamic field of view) of the human eye is even Bigger. For nominal eyes, the vertical range of motion is approximately ~40° up and down ~60°, and the horizontal range of motion is approximately ±~50° from straight front. For an exit pupil of the size produced by an optical system of the type previously used in HMD, even small rotations of the eye will substantially reduce the overlap between the static field of view of the eye and the exit pupil, and Rotating will cause the image to completely disappear. Although theoretically possible, the exit pupil that will move in sync with the user's eyes is impractical and extremely expensive.

In view of these attributes of the human eye, there are three fields of view associated with an optical system that allows the user to view images produced by the image display system in the same manner as would be to view the natural world. The smallest of the three fields of view is the field of view defined by the user's ability to rotate their eyes and thus their ability to scan the field in the outside world. The maximum rotation is approximately ±50° from the straight front, so this field of view (visual field of view) is approximately 100°. The middle of the three fields of view is a straight front static view and includes both the user's visual and peripheral vision. As discussed above, this field of view (the visual field + peripheral static field of view) is approximately 150°. The largest of the three fields of view is the field of view defined by the user's ability to rotate their eyes and thus their ability to view their peripheral vision over the outside world. The maximum field of view (visual litter + peripheral dynamic field of view) is approximately 200° based on a maximum rotation of approximately ±50° and a visual field of about 150° + peripheral static field of view. The increased scale of the field of view from at least 100 degrees to at least 150 degrees and then to at least 200 degrees provides benefits to the user (in terms of their ability to visually and naturally view images produced by the image display system).

Therefore, there is a need for a head mounted display that has improved compatibility with the human eye's field of view (both static and dynamic). The present invention is directed to this need and provides a head mounted display that uses a reflective optical surface that provides an ultra wide viewing angle.

definition

In the rest of the invention and in the scope of the patent application, the phrase "virtual image" is used in its optical sense, that is, the virtual image is perceived as being from a particular image, and in fact, is being perceived. Not from one side.

The FS/UWA/RO surface is referred to herein as a "free space" surface because its local spatial position, local surface curvature, and local surface orientation are not related to a particular substrate (such as the xy plane), but rather to the surface. The basic optical principles (eg, Fermat and Hero minimum time principle) applicable in three-dimensional space are used during design.

The FS/UWA/RO surface is referred to as the "ultra-wide angle" surface, since at least it does not limit the dynamic view of the eye of the nominal user during use. Thus, depending on the optical properties of the optional optical component (eg, Fresnel lens system) used for the "ultra-wide angle" surface, the overall optical system of the HMD can be non-aperture formed, ie, with limited user Unlike the conventional optical system of the exit pupil of the field of view, the operational aperture for the various embodiments of the optical system disclosed herein will be the entrance pupil of the user's eye, which is associated with the external optical system. The opposite is true. Incidentally, for such embodiments, the field of view provided to the user will be much larger than in conventional optical systems, where the exit pupil of the user's eye and the external optical system is even small in the case of conventional optical systems. The alignment deviation can substantially reduce the information content available to the user, and a large alignment deviation can cause the entire image to disappear.

Throughout the present invention, the following phrase/term should have the following meaning/scope:

(1) The phrase "reflective optical surface" (also referred to herein as "reflective surface") shall include only reflective surfaces and surfaces that are both reflective and transmissive. In either case, the reflectivity can be only partial, that is, a portion of the incident light can be transmitted through the surface. Likewise, when the surface is both reflective and transmissive, the reflectivity and/or transmittance can be partial. As discussed below, a single reflective optical surface can be used for both eyes, or each eye can have its own individual reflective optical surface. Other variations include the use of multiple reflective optical surfaces for both eyes or individually for each eye. Mixing and matching combinations can also be used, for example, a single reflective optical surface can be used for one eye and multiple reflective optical surfaces can be used for the other eye. As a further alternative, one or more reflective optical surfaces may be provided for only one of the user's eyes. The scope of the patent application set forth below is intended to cover such and other applications of the reflective optical surfaces disclosed herein. In particular, each of the technical solutions requiring a reflective optical surface is intended to cover a head mounted display device comprising one or more reflective optical surfaces of a given type.

(2) The phrase "image display system having at least one illuminating surface" is generally intended to include any display system having a surface that produces light at the surface, whether by transmission of light through the surface (eg, Light is emitted by the LED array), the reflection of light from another source away from the surface or the like. The image display system can use one or more image display devices, such as one or more LEDs and/or LCD arrays. As with the reflective optical surface, a given head mounted display device can have one or more image display systems for one or both of the user's eyes. Again, each of the claims of the following statements requiring an image display system is intended to cover a head mounted display device comprising one or more image display systems of a specified type.

(3) The phrase "dual-tube viewer" means a device that includes at least one separate optical component (e.g., a display device and/or a reflective optical surface) for each eye.

(4) The phrase "field of view" and its abbreviation FOV refer to the "visual" field of view in the image (eye) space, as opposed to the "real" field of view in the object (ie, display) space.

According to a first aspect, a head mounted display device (100) is disclosed, comprising:

(I) a frame (107) adapted to be mounted on a user's head (105);

(II) an image display system (110) supported by the frame (107) (eg, the frame supports the image display system at a fixed position outside the field of view of the user during use of the HMD);

(III) a reflective optical surface (120) supported by the frame (107), the reflective optical surface (120) being a continuous surface that is rotationally symmetric about any coordinate axis of the three-dimensional Cartesian coordinate system (eg, the reflective optical surface) Can be a free space, super wide angle, reflective optical surface (120) (not a rotating surface) that is not rotationally symmetric about the x, y or z axis of a three-dimensional Cartesian coordinate system with any origin;

among them:

(a) the image display system (110) includes at least one light emitting surface (81);

(b) during use, the reflective optical surface (120) produces a spatially separated virtual image of the spatially separated portion of the at least one light emitting surface (81), at least one of the spatially separated virtual images Separating at least one of the other of the spatially separated virtual images by at least 100 degrees, the angular separation being measured from a center of rotation (17) of the eye (15) of the nominal user;

(c) during use, at least one point of the reflective optical surface (120) is angularly separated from at least one other point of the reflective optical surface (120) by at least 100 degrees from the eye of the nominal user ( 15) The rotation center (17) is measured.

According to a second aspect, a head mounted display device (100) is disclosed, comprising:

(I) a frame (107) adapted to be mounted on a user's head (105);

(II) an image display system (110) supported by the frame (107) (eg, the frame supports the image display system at a fixed position outside the field of view of the user during use of the HMD);

(III) a free space, ultra wide angle, reflective optical surface (120) supported by the frame (107);

among them:

(a) the image display system (110) includes at least one light emitting surface (81);

(b) during use, the free-space, ultra-wide angle, reflective optical surface (120) produces spatially separated virtual images of the spatially separated portions of the at least one illuminated surface (81), the spatially separated At least one of the virtual images is angularly separated from at least one other of the spatially separated virtual images by at least 100 degrees from the center of rotation of the nominal user's eye (15) (17) To measure.

According to a third aspect, a head mounted display device (100) is disclosed, comprising:

(I) a frame (107) adapted to be mounted on a user's head (105);

(II) an image display system (110) supported by the frame (107);

(III) a reflective surface (120) supported by the frame (107), the reflective surface (120) providing a field of view of at least 200° to a nominal user; wherein:

(a) the image display system (110) includes at least one light emitting surface (81), the at least one light emitting surface (81) including at least first and second spatially separated light emitting regions having first and second information content, respectively (82, 83);

(b) the reflective surface (120) includes at least first and second spatially separated reflective regions (84, 86) having first and second surface normals (85, 87) directed in different directions; And

(c) the frame (107) supports the image display system (110) and the reflective surface (120) such that during use by the nominal user:

(i) for at least one gaze direction (inwardly 88 in Fig. 8) of one of the nominal user's eyes (71), light from the first illuminating region (82) is reflected from the first reflective region (84) Leaving and entering the eye (71) to form a visible virtual image (88) of the first information content (ie, there is a nominal user seeing the first information content (and optionally, the second information content) a gaze direction);

(ii) for at least one gaze direction of the eye (71) (facing 89 in Figure 8), light from the second illuminating region (83) is reflected away from the second reflective region (86) and enters the eye ( 71), to form a visible virtual image of the second information content (89) (ie, there is a gaze direction in which one of the nominal user can see the second information content (and optionally the first information content);

(iii) for at least one gaze direction of the eye (71) (the gaze direction to the right of 88 in Fig. 8), light from the first illuminating region (82) is reflected off the first reflecting region (84) And entering the eye (71) to form a visible virtual image (88) of the first information content, and light from the second light emitting region (83) is reflected away from the second reflective region (86) and does not enter the Eye (71), and does not form a visible virtual image of the second information content (ie, there is a nominal user can see the first information content but cannot be seen by the nominal user's visual or peripheral vision) The gaze direction of the information content).

According to a fourth aspect, a computer-based method for designing a reflective optical surface (120) that may or may not be a FS/UWA/RO surface is disclosed, the reflective optical surface (120) being used in an image display system Used in a head mounted display (100) of (110), the image display system (110) has a plurality of content areas (82, 83) during use of the head mounted display (100) (eg, a plurality of individual a plurality of groups of pixels or individual pixels), the method comprising performing the following steps using one or more computers:

(a) dividing the reflective optical surface (120) into a plurality of partial reflection regions (84, 86), each of the partial reflection regions having a surface normal (85, 87) (eg, a surface at the center of the partial reflection region) Normal line);

(b) associating each of the partially reflective regions (84, 86) of the reflective optical surface (120) with one and only one content region (82, 83) of the image display system (110), each content region ( 82, 83) associated with at least one partially reflective region (84, 86); and

(c) adjusting the configuration of the reflective optical surface (120) (eg, adjusting the local spatial position and/or local curvature of the surface) such that each of the surface normals (85, 87) is equally divided into the following two Vectors:

(1) Vectors from the partially reflective region (84, 86) (eg, from the center of the partially reflective region) to its associated content region (82, 83) (eg, to the center of its associated content region) (77, 78); and

(2) from the partially reflective region (84, 86) (eg, from the center of the partially reflective region) to the center of rotation (72) of the nominal user's eye (71) during use of the head mounted display The vector of positions (79, 80).

In some embodiments of the above aspects of the invention, a separate reflective surface and/or separate image display system is utilized for each of the user's eyes. In other embodiments, the reflective optical surface alone or in combination with other optical components (eg, one or more Fresnel lenses) collimates (or substantially collimates) light from the image display system, the collimation is via The local radius of curvature of the surface is achieved.

In various embodiments, the HMD device can provide the user with a full view fove dynamic field of view, a full view fossa + peripheral static field of view, or a full view fossa + peripheral dynamic field of view.

In various embodiments, the HMD device can be a dual barrel non-aperture forming system in which the eye is free to move about its center of roll over the entire range of angles it is generally available without being constrained by external light viewing. Previous HMD devices have claimed to have or provide a wide field of view, but these devices already include external apertures through which the eye must see. Although there is a wide amount of information provided to the eyes, if the eyes turn, the information is lost. This is a fundamental problem with the pupil forming system, which is avoided in embodiments of the invention using reflective surfaces (and in particular, FS/UWA/RO surfaces).

The reference numerals used in the above summary of the present invention are to be considered as illustrative and not intended to be The scope of the invention. Rather, the foregoing general description and the following detailed description of the invention,

The additional features and advantages of the invention are set forth in the description which follows, and in which Come to know. The accompanying drawings are included to provide a further understanding of the invention It is to be understood that the various features of the invention disclosed in this specification and in the drawings may be used in any or all combinations.

2 and 3 are side and front views, respectively, of the head mounted display device 100 worn by the user 105. The head mounted display device uses the FS/UWA/RO surface 120.

In an embodiment, the head mounted display device 100 can be, for example, an optical see-through, an augmented reality, a dual-cylinder viewer. Because optical see-through, augmented reality, and binocular viewers are often the most complex forms of HMD, the present invention will primarily discuss embodiments of this type, it being understood that the principles discussed herein are equally applicable to optical see-through, Augmented reality, single-tube viewers; video fluoroscopy, augmented reality, dual-tube and single-tube viewers; and dual-tube and single-tube "virtual reality" systems.

As shown in Figures 2 and 3, the head mounted display device 100 includes a frame 107 that is adapted to be worn by a user in a manner similar to wearing glasses and supported by the user's nose and ears. In the embodiments of Figures 2 through 3 and other embodiments disclosed herein, the head mounted display device can have a variety of configurations and can be, for example, similar to conventional eye masks, eyeglasses, helmets, and the like. In some embodiments, the strap can be used to hold the frame of the HMD in a fixed position relative to the user's eyes. In general, the outer surface of the HMD package can be in any form that holds the optical system in the desired orientation relative to the display of the HMD and the eyes of the user.

The head mounted display device 100 includes at least one image display system 110 and at least one optical system including a reflective optical surface. As shown in FIGS. 2 and 3, the reflective optical surface is a free space, an ultra wide angle, and a reflective optical surface. 120 (i.e., FS/UWA/RO surface 120), the surface 120 needs to be curved. In some embodiments, the FS/UWA/RO surface can be the entire optical system. Surface 120 can be purely reflective or can have both reflective and transmissive properties, and can be considered a "beam splitter" type if both reflective and transmissive properties are present.

The FS/UWA/RO surface 120 can completely enclose one or both eyes, and at least one image display system 110. In particular, the surface can be curved around the side of the eye and toward the side of the face to expand the available horizontal field of view. In an embodiment, the FS/UWA/RO surface 120 may extend up to 180 degrees or more (eg, greater than 200°), as best seen in Figure 6 of the following discussion. As illustrated in FIG. 3, the HMD can include two separate FS/UWA/RO surfaces 120R and 120L for the user's two eyes that are separately supported by the frame and/or nose piece 210 (see below). Alternatively, the HMD can use a single FS/UWA/RO surface that serves two eyes by a single structure, some portions of the structure being viewed by two eyes and the other portions of the structure being viewed by only one eye.

As indicated immediately above and as illustrated in FIG. 3, the head mounted display device 100 can include a nose piece 210. The nose piece can be a vertical strip or wall that provides separation between the two FS/UWA/RO surfaces (one surface of each of the user's eyes). The nose piece 210 can also provide separation between the fields of view of the user's two eyes. In this way, the first representation of the three-dimensional reality in the environment can be presented to the right eye of the user by displaying the first image to the right eye via the first image display device and the first FS/UWA/RO surface, but The second image display device and the second FS/UWA/RO surface display a second image to the left eye to present a second representation of the three dimensional reality in the environment to the left eye of the user. The separate display device/reflective surface combination thus serves each eye of the user, with each eye seeing the correct image for its position relative to the three dimensional reality in the environment. By separating the two eyes of the user, the spine 210 allows the image applied to each eye to be optimized independently of the other eye. In one embodiment, the vertical wall of the nose piece can include two reflectors (one on each side) to allow the user to see the image as it rotates its eye to the left or right in a nasal motion.

At least one image display system 110 can be mounted within the FS/UWA/RO surface 120 and can be placed horizontally or at a slight angle relative to the horizontal. Alternatively, the at least one image display system can be positioned just outside the FS/UWA/RO surface. In general, the tilt or angle of at least one image display system 110 (or more specifically, at least one of its light emitting surfaces) will depend on a plurality of pixels, multiple images, and/or multiple display information to be reflected from surface 120. The position changes.

In some embodiments, the head mounted display device 100 is configured to create an internal cavity in which the FS/UWA/RO surface is reflective inwardly into the cavity. For FS/UWA/RO surfaces with transmission properties, images or display information from at least one image display system are reflected from the surface into the cavity and to the user's eyes, while at the same time, light is also transmitted from the outside through the reflective surface. The world enters the cavity and the eyes of the user.

As discussed in detail below, in some embodiments, at least one image display system 110 provides multiple images and/or multiple display information, and the image and/or display information is adjusted for close proximity before entering the user's eyes. View. In some embodiments, an optional lens or lens system 115 can facilitate this adjustment. Co-transfer and identified by the name of G. Harrison, D. Smith and G. Wiese, entitled "Head-Mounted Display Apparatus Employing One or More Fresnel Lenses" and identified by agent number IS-00307 One or more Fresnel lenses are used for this purpose, as described in U.S. Patent Application Serial No. 13/211,365, the disclosure of which is incorporated herein by reference. Other embodiments do not utilize an optional lens or lens system, but rely on the FS/UWA/RO surface to provide the desired optical properties for in-focus, near-eye viewing of the image formed by the display system.

The head mounted display device can include an electronic package 140 to control images displayed by at least one image display system 110. In one embodiment, electronic package 140 includes an accelerometer and gyroscope that provides positioning, orientation, and position information needed to synchronize images from at least one image display system 110 with user activity. Power and video can be provided to and from the head mounted display device 100 via a transmission cable 150 coupled to the electronic package 140 or via a wireless medium.

A set of cameras 170 can be located on opposite sides of the head mounted display device 100 to provide input to the electronic package to help control computer generation of, for example, an augmented reality scene. The set of cameras 170 can be coupled to the electronic package 140 to receive power and control signals and to provide video input to the software of the electronic package.

Image display systems for use in head mounted display devices can take many forms now known or subsequently developed. For example, the system can use small high resolution liquid crystal displays (LCDs), light emitting diode (LED) displays, and/or organic light emitting diode (OLED) displays (including flexible OLED screens). In particular, image display systems can use high definition, small form factor display devices with high pixel density, examples of which can be found in the cellular telephone industry. Fiber bundles can also be used in image display systems. In various embodiments, the image display system can be considered to act as a small screen television. If the image display system produces polarized light (eg, where the image display system uses a liquid crystal display in which all colors are linearly polarized in the same direction), and if the FS/UWA/RO surface is polarized orthogonally to the light emitted by the display , the light will not leak out of the FS/UWA/RO surface. The information displayed and the light source itself will therefore not be visible outside the HMD.

The overall operation of an exemplary embodiment of an optical system constructed in accordance with the present invention (specifically, an optical system for "Augmented Reality" HMD) is traced by the ray of Figure 2 (specifically, rays 180, 185, and 190) ) Description. In this embodiment, the FS/UWA/RO surface 120 has both reflective and transmissive properties. With the transmission properties of surface 120, light 190 enters the surface from the environment and travels toward the user's eyes. From the same area of surface 120, light 180 is reflected by the surface (using the reflective properties of the surface) and engages light 190 to create a combined light 185, as viewed by the user in the direction of point 195, i.e., when the user is looking at the direction of gaze. In the direction of point 195, the combined light 185 enters the user's eye. When viewed as such, the user's peripheral visual capabilities allow the user to again see the light passing through the surface 120 from other points in the environment using the transmission properties of the surface.

4 is another ray tracing diagram illustrating the operation of an exemplary embodiment of a head mounted display device 100 disclosed herein. In this embodiment, the overall vision system includes three parts: (1) at least one image display system 110, (2) FS/UWA/RO surface 120, and (3) user's eye 310. Eye 310 is represented by internal crystal 330. Light emitted from one of the pixels of at least one image display system 110 is represented by ray 180 (as in Figure 2). This light will appear at the point on the retina of the user's eye after being reflected by surface 120, subject to the user's gaze direction and associated field of view (see discussion of Figures 7 and 8 below) including ray 180. The point at which the surface 120 is struck. More specifically, as discussed below, due to the optical properties of the normals that involve aliquoting from the point on the FS/UWA/RO surface to the eye and from the point on the FS/UWA/RO surface to the normal of the pixel. The pixel will only appear at point 195; that is, even if the light is radiated from the pixel with a wider cone, the FS/UWA/RO surface is engineered to only bring light from one location.

In FIG. 4, it is assumed that the gaze direction of the user is toward the intersection of the ray 180 and the surface 120, as illustrated by the rays 185 and 340. However, what the eye sees is a virtual image that appears in the space in front of it in a distance from vectors 345 and 350 (eg, at infinity as shown by reference numeral 352). In FIG. 4, a chair is provided for illustrative purposes, wherein at least one image display system 110 produces a real image 355 of the chair, which is reflected after the light emitted from the display system is reflected by the FS/UWA/RO surface 120. It is a virtual image 360. In an "amplified reality" environment, an optical system including a FS/UWA/RO surface can, for example, cause the virtual image 360 of the chair to appear at the same location as the actual human 365 in the actual environment. Note that the ray 345 that is at a distance closer to infinity is included in Figure 4 to show that the image can be optically present at any distance between the neighborhood and infinity. For example, a person can stand 50 meters away and where the chair will be placed.

In Figures 1 through 4, at least one image display system is shown having a flat light emitting surface (e.g., surface 111 in Figure 4). The display system can also have a curved light emitting surface. This embodiment is illustrated in Figure 5, in which light ray 405 is emitted from a curved display curtain 407 (curved light emitting surface). This ray is reflected from the FS/UWA/RO surface 120 and enters the pupil 415 of the user's eye 310 (see ray 410). In this embodiment, surface 120 also receives light from ray 345 from the external environment, thereby allowing the image produced by the display to overlay the external image. Note that for purposes of illustration, the ray 345 is shown displaced from the ray 410; for a pure overlay of the external image, the ray 345 will overlay the ray 410.

As discussed above, previous optical systems used in HMDs that have used reflective optical surfaces have been pupil-formed, and thus have limited viewing areas, typically having a field of view of ~60 degrees or below. This situation has greatly limited the value and capabilities of previous head mounted display devices. In various embodiments, the head mounted display disclosed herein has a much wider field of view (FOV), thus allowing much more optical information to be provided to the user than an HMD having a smaller field of view. The wide field of view can be greater than 100°, greater than 150°, or greater than 200°. In addition to providing more information, the wide field of view allows additional information to be processed by the user in a more natural way, resulting in a better immersive and augmented reality experience via a better match of the displayed image to the real world.

In particular, in the exemplary embodiment illustrated in FIG. 6, for a straight forward gaze direction, the eye is able to acquire the entire viewport represented by curved FS/UWA/RO surfaces 201 and 202 in FIG. 6, for each eye. The viewport corresponds to a horizontal field of view (FOV) of at least 150 degrees (eg, a horizontal FOV of -168 degrees). This field of view consists of the field of view of the eye and its peripheral field of view. In addition, the eye is allowed to move freely about its center of rotation to aim the combined view + peripheral view in different gaze directions, such as when the view is taken naturally. The optical system disclosed herein thus allows the eye to travel through the range of motion to obtain information in the same manner as the eye obtains information when viewing the natural world.

Referring to Figure 6 in more detail, this figure is a simplified line representation of the front of the user's head 200 as seen from the top. It displays the FS/UWA/RO surfaces 201 and 202 placed in front of the eyes 203 and 204 of the user. As discussed above, the FS/UWA/RO surfaces 201 and 202 can rest on the user's nose 205, which meets the front portion 214 of the user's head 200 at the user's nose 205. As discussed in detail below, the local normals and local spatial locations of surfaces 201 and 202 are adjusted such that images produced by at least one image display system (not shown in FIG. 6) cover at least 100° for each eye (eg, at In certain embodiments, at least 150°, and in other embodiments, at least 200°) horizontal FOV. (As appropriate, as discussed below, the local radius of curvature is also adjusted to provide a long-range virtual image when combined with a Fresnel lens.) For example, local normals and local spatial locations can be adjusted for each The eye covers all of the user's 168 degrees straight forward horizontal static field of view, with 168 degrees extending from the edge of the FS/UWA/RO surface 201 or 202 to the edge as shown by lines of sight 210, 211 and 212, 213. The line of sight thus corresponds to a wide static field of view (visual + perimeter) provided to the user. In addition, the user is free to move his or her eyes around the scroll centers 215 and 216 while continuing to view the image produced by the computer.

In Figure 6 and in Figures 4, 5 and 12, the FS/UWA/RO surface is shown as part of the sphere for ease of presentation. In practice, the surface is not spherical, but has a more complex configuration such that its local normal and local spatial position (and, optionally, local radius of curvature) will provide the desired static and dynamic view (and, as appropriate, to the virtual image) distance). Further, in Fig. 6, the right side of the head mounted display device operates in the same manner as the left side, and it should be understood that the two sides may be different for a specific application as needed. .

Figures 7 and 8 further illustrate the static and dynamic fields of view provided by the FS/UWA/RO surface disclosed herein. Figure 7 shows the nominal right eye 71 of a user having a straight forward gaze direction 73. The eye's optic fossa + peripheral field of view is shown by an arc 75 having an angular extent of ~168°. Note that for ease of presentation, in Figures 6-8, the field of view is displayed relative to the center of rotation of the user's eye, as opposed to the center or edge of the user's pupil. In fact, the large field of view (eg, ~168°) achieved by the human eye is the result of allowing a highly skewed ray to enter the user's pupil and reach a large angular extent of the retina's retina.

8 is a schematic illustration of the interaction of the field of view of FIG. 7 with an HMD having: (a) an image display system having at least one light emitting surface 81 having a first light emitting region 82 (illustrated as a square) and a second light emitting region 83 (Illustrated as a triangle), and (b) FS/UWA/RO surface having a first reflective region 84 having a first partial normal 85 and a second reflective region 86 having a second partial normal 87.

As indicated above, the FS/UWA/RO surface is both a "free space" surface and an "ultra wide angle" surface. Moreover, as noted above and discussed in more detail below, the surface can participate in collimation (or partial collimation) of the light entering the eyes of the user (or the sole source of the collimation (or partial collimation)) . This collimation causes the virtual image produced by the FS/UWA/RO surface to appear at a distance from the user (eg, 30 meters or more), which allows the user to easily focus on the virtual by relaxing eyes image.

The "free space" and "ultra-wide angle" aspects of the FS/UWA/RO surface can be achieved by adjusting the local normal of the surface so that the user's eye considers the illumination area of at least one image display system to be from FS/ A predetermined area of the UWA/RO surface (predetermined position on the surface).

For example, in Figure 8, the designer of the HMD may determine that the virtual image 88 of the square is viewed from the central portion of the user's retina when the user's gaze direction is straight ahead and when the gaze direction is straight ahead (eg It will be advantageous to view the virtual image 89 of the triangle from the central portion of the user's retina at ~50°. The designer will then configure at least one image display system, FS/UWA/RO surface, Fresnel lens system, and any other optical components of the system (eg, one or more between the image display system and the FS/UWA/RO surface) A Fresnel lens), so that during the use of the HMD, the virtual image of the square will be straight ahead and the virtual image of the triangle will be 50° to the left of the straight ahead.

In this way, when the user's gaze direction (line of sight) intersects the FS/UWA/RO surface straight, a square virtual image will be visible at the center of the user's eye as needed, and when the user's gaze direction ( When the line of sight and the FS/UWA/RO surface intersect 50 degrees to the left in the forward direction, a virtual image of the triangle is also visible at the center of the user's eye as needed. Although not illustrated in Figures 7 and 8, the same method is used for vertical field of view and for off-axis field of view. More generally, when designing each of the HMD and its optical components, the designer "maps" at least one of the illuminated surfaces of the display to the reflective surface such that when the eye is gazing in a particular direction, the desired portion of the display Visible to the user's eyes. Thus, when the eye is scanned over the field of view (both horizontal and vertical), the FS/UWA/RO surface illuminates different portions of at least one of the illuminated surfaces of the image display system into the user's eye. While the foregoing discussion has been made with respect to the center of the nominal user's retina, of course, the design processing program may alternatively use the position of the nominal user's visual socket as needed.

It should be noted that in Figure 8, any rotation of the user's eyes to the right causes the virtual image 89 of the triangle to be no longer visible to the user. Thus, in Figure 8, any gaze direction on the straight front or straight front left side provides the user with both a square virtual image and a triangular virtual image, while the straight ahead right gaze direction provides only a square virtual image. Of course, the sharpness of the virtual image will depend on whether the virtual image is visually perceived by the user's visual field or perceived by the user.

If the designer of the HMD has placed the virtual image of the square farther to the right in Figure 8, while making the virtual image of the triangle farther to the left, there will be a gaze direction visible only to the square virtual image and only the triangle. Other gaze directions visible to the virtual image. Similarly, based on the principles disclosed herein, the designer can configure a virtual image of a square and a virtual image of a triangle such that the virtual image of the triangle is always visible, with the square virtual image being visible for some gaze directions and not visible for other gaze directions. As another variation, the HMD designer can place virtual images of squares and triangles in a position that is visible to the user for one or more gaze directions. For example, the designer can place the virtual image just as it is. Outside the static field of view of the user in the direction of the gaze straight ahead. The flexibility provided by the present invention to the HMD designer is therefore readily apparent.

In one embodiment, the "free space" and "super wide angle" aspects of the reflective surface are achieved by using the principles of Fermat and Hero (light travels along the shortest (minimum time) path). Co-transfer and the same as the name of G. Harrison, D. Smith and G. Wiese, entitled "Methods and Systems for Creating Free Space Reflective Optical Surfaces" and identified by the agent number IS-00354 An example of designing an FS/UWA/RO surface suitable for use in an HMD using Fermat and Hero principles is described in U.S. Patent Application Serial No. 13/211,389, the disclosure of which is incorporated herein by reference.

By using the Fermat and Hero minimum time principle, any "desired portion" of at least one of the illuminated surfaces of the image display system (eg, any pixel of the image display system) can have any desired reflection point at the FS/UWA/RO surface, The constraint is that the optical path from the desired portion of at least one of the illuminated surfaces to the point of reflection at the FS/UWA/RO surface and then to the center of rotation of the user's eye is at an extreme value.

The extreme value of the optical path means that the first derivative of the optical path length has reached zero, which represents the maximum or minimum of the optical path length. An extremum can be inserted at any point in the field of view by creating a localized region of the reflective optical surface, the normal of the local region being equally divided (a) from the local region to the vector of the user's eye (eg, from a local region) The vector from the center to the center of the user's eye) and (b) the vector from the local region to the "desired portion" of the illuminated surface (eg, the vector from the center of the local region to the center of the desired portion of the illuminated surface). 9 and 10 illustrate a processing procedure for the case where the "desired portion" of at least one of the light-emitting surfaces of the image display system is a pixel.

In particular, Figure 9 shows a light emitting surface 510 of an image display system constructed from a generally rectangular array of pixels that emit light in the direction of beam 515 toward the front of the head mounted display device. Light beam 515 is ejected from reflective optical surface 520, which is shown flat in Figure 8 for ease of presentation. After reflection, beam 515 becomes beam 525 that enters the user's eye 530.

For the purpose of determining the surface normal for the reflector for each pixel, it is only necessary to determine the three-dimensional bisector of the vector corresponding to beams 515 and 525. In Figure 9, this bisector vector is shown in two dimensions as line 535. The bisector vector 535 is orthogonal to the reflective optical surface at the reflection point 540, which is the location where the pixel 545 of the illumination surface 510 on the surface 520 will be visible to the user of the HMD.

In particular, in operation, pixel 545 in display surface 510 emits light beam 515 that is ejected from reflective optical surface 520 at an angle determined by surface normals corresponding to bisector vector 535 and its vertical plane 550, thereby Reflected pixels are produced by the Fermat and Hero principles at a reflection point 540 seen by the eye 530 along the beam 525. To accurately calculate the surface normal at reflection point 540, beam 525 can generally pass through the center 555 of the user's eye 530. Even if the user's eyes rotate to become peripheral vision, the result will remain substantially stable until (as discussed above in connection with Figures 7 and 8) the eye is rotated so much that the display cannot be seen by the user's visual or peripheral vision. The area.

To calculate the position of the surface normal, you can use the quaternion method, where

Q1 = orientation of beam 515

Q2 = orientation of beam 525

And

Q3 = orientation of the desired surface normal 535 = ( q1 + q2 )/2

The surface normal can also be described by a vector notation, as illustrated in FIG. In the following equation and in Figure 11, the point N is a distance away from the point M at the center of the region of interest of the reflective optical surface, and the direction of the vertical normal of the tangent plane of the reflective optical surface at point M on. The tangent plane of the reflective optical surface at control point M satisfies the relationship expressed by the following equation such that in three-dimensional space, the surface normal at point M is equally divided from point M to point P at the center of the pixel of interest Line and line C from the point M to the center of the user's eye (for reference, point C is approximately 13 mm backward from the front of the eye).

The equation for describing the point N on the surface normal at point M is:

All of the points N, M, P, and C have components [x, y, z] indicating their position in the three-dimensional space in any Cartesian coordinate system.

The resulting normal vector N-M has an Euclidean length

| NM |=1

Two of the vertical bars represent the Euclidean length and are calculated as follows:

As a numerical example, consider the following M, P, and C values:

M =[ x _M , y _M , z _M ]=[4,8,10]

P = [2,10,5]

C = [6,10,5]

Calculate the point N along the normal as follows:

P-M=[(2-4),(10-8),(5-10)]=[-2,2,-5]

C-M=[(6-4),(10-8),(5-10)]=[2,2.-5]

(P-M)+(C-M)=[0,4,-10]

And

The geometry is shown in Figure 17, where the bisector is between two longer vectors.

Of course, the foregoing is only used to demonstrate the minimum use of the local tangent plane angle constraint on the point field of the free-form (free-form) surface manifold that constitutes the reflective region that is intended to present the adjacent virtual image to the viewer. Representative calculations of the Fermat and Hero principles of time. The only real constant is the center of the user's eye and the natural view of the eye. All other components can be iteratively updated until an appropriate solution for a given image display system and the orientation of the reflective optical surface is reached. On the other hand, the pixel image reflection positions M1, M2, ..., Mn and their associated normals and curvatures can be regarded as a matrix which is "distorted" (adjusted) so that the FS/UWA/RO surface is aligned The desired virtual image processing of the image produced by the computer formed by the image display system.

In applying the Fermat and Hero principles, it should be noted that in some embodiments it will be desirable to avoid adjusting the normals so that the user sees the same pixel reflections at more than one point. It should also be noted that in some embodiments, the localized areas of the reflective optical surface can be very small and can even correspond to points on the reflector where the points are morphed into other points to form a smooth surface.

In order to ensure that the user can easily focus on the virtual image of the "desired portion" of at least one of the light-emitting surfaces (for example, a virtual image of a pixel), controlling the radius of curvature of the region surrounding the reflection point (reflection region) enables collimation (or almost collimation) The image reaches the user. A collimated (or nearly collimated) image has relatively parallel rays of light as if the image had originated at a distance (eg, tens to hundreds of meters) from the user. In order to achieve the surface, the radius of curvature of the reflective region of the reflective optical surface corresponding to the "desired portion" of the at least one illuminated surface (the desired pixel to be illuminated) can be maintained to be close to the actual desired portion of the self-reflecting region to the illuminated surface on the display. The radius of one-and-a-half the distance of the (actual pixel).

Thus, in an embodiment, the inter-pixel normal vector of the reflection from the correlation pixel to the neighboring pixel satisfies a relationship that allows the pixels to establish a vector from the position of the reflected pixel on the reflective surface to the display pixel. The radius of curvature of one-half of the length. The adjustment affecting the parameter includes the size of the at least one light emitting surface and whether the at least one light emitting surface is curved.

Figure 10 illustrates this embodiment. In order to control the radius of curvature of the region surrounding the reflection of the pixel such that the collimated (or nearly collimated) image reaches the user, two adjacent pixel reflection regions are considered at the reflection point 540, such as. In order to achieve a better balance, consider more areas, but two are sufficient. Referring to Figure 10, two pixel reflection points 540 and 610 are shown relative to two pixels 545 and 615 on display surface 510, respectively. The surface normals at points 540 and 610 are calculated along with the angle between their directions. The radius of curvature is calculated with knowledge of these angles and the distance between points 540 and 610. Specifically, the surface configuration and (as needed) spatial position of the surface are adjusted until the radius of curvature is equal to (or substantially equal to) half of the average of the lengths of beams 515 and 620. In this way, zero or near zero diopter light can be provided to the user's eyes. This is equivalent to light from a point that is essentially infinite, and the front of the light is flat, thereby forming a surface normal that is parallel to the wavefront of the light.

In addition to controlling the local radius of curvature, in some embodiments, at least one of the illuminating surfaces is nominally located away from the FS/UWA/RO surface as a solution to collimate (or nearly collimate) the image into the eye. A focal length distance, wherein the focal length is based on an average of the radii of curvature of the various reflective regions that make up the FS/UWA/RO surface.

The result of applying the Fermat and Hero principles is a group of reflective regions that can be combined into a smooth reflective surface. In general, this surface will not be spherical or symmetrical. Figure 12 is a two-dimensional representation of this FS/UWA/RO surface 520. As discussed above, surface 520 can be constructed such that the radius of curvature at points 710 and 720 is set to a value that provides an image that is reflected from at least one of the light emitting surfaces of the image display system (which is being reflected by the surface) ) Relaxation review. In this manner, viewing in a direction indicated by line 730 will provide a collimated (or nearly collimated) visual image to eye 530, as will be seen in the different directions indicated by line 740. In order to achieve a smooth transition of the view over the entire field of view, the area of the FS/UWA/RO surface can be smoothly transitioned from one control point to another, as can be achieved by using non-uniform rational B-spline (NURBS) techniques. Performed on the splined surface, thus creating a smooth transition on the reflective surface. In some cases, the FS/UWA/RO surface may include a sufficient number of regions such that the surface becomes smooth at a fine grain size level. In some embodiments, a gradient gradient can be used to provide different magnifications for each portion of the display (eg, each pixel) to allow for better manufacturability, implementation, and image quality.

Figures 13 and 14 show FS/UWA/RO surfaces created using the above techniques from two different perspective views. Figures 15 and 16 again show another modification of the reflective surface of Figures 13 and 14 from two perspective views. The FS/UWA/RO surface of these figures is designed using the computer-based technology of the above-mentioned "Methods and Systems for Creating Free Space Reflective Optical Surfaces" and the application-based application.

As can be seen from the foregoing, a method for designing a head mounted display has been disclosed. In an exemplary embodiment, it can include determining a desired field of view, selecting a display surface size (eg, width and height dimensions), and selecting a display surface. The position of each pixel on the display surface is sorted relative to the orientation of the reflective surface, and the position on the reflective surface for displaying each pixel from the display surface is selected. The display surface can be placed over the eye and tilted toward the reflective surface, allowing the curvature of the reflective surface to reflect light to the wearer's eye. In other embodiments, the display surface can be placed in other locations (such as on the side of the eye or below the eye), wherein the reflected position and curvature are selected to properly reflect light from the display surface, or to be tilted to varying degrees.

In some embodiments, a three-dimensional representation or mathematical representation of the reflective surface can be created, wherein as discussed above, each region of the reflective surface has a center that is equally spaced from the center of the region to the center of the user's eye and A local area of the normal of the vector from the center of the region to the center of the pixel in the display surface. As also discussed above, the radius of curvature of the area surrounding the reflection of the pixel can be controlled such that the collimated (or nearly collimated) image reaches the user in the field of view. Through computer-based iterations, the changeable parameters (eg, local normal, local curvature, local spatial position) can be adjusted until the identification parameter provides a desired optical performance level and an aesthetically acceptable combination of manufacturable designs in the field of view ( set).

During use, the asymmetric FS/UWA/RO surface (in some embodiments, constructed from a splined surface having a plurality of localized focal regions) forms at least one illuminated surface of the image display system that is stretched over a wide field of view Virtual image. The FS/UWA/RO surface can be viewed as a progressive or progressive curved beam splitter or a freeform mirror or reflector. When the eye is scanned over the field of view (both horizontal and vertical), the curved FS/UWA/RO surface illuminates different portions of at least one of the illuminated surfaces of the image display system into the user's eye. In various embodiments, the overall optical system can be mass produced at low cost while maintaining image quality commensurate with typical human visual resolution.

In terms of the overall structure of the HMD, Table 1 sets forth representative, non-limiting examples of parameters that would normally be met by an HMD display constructed in accordance with the present invention. Moreover, the HMD displays disclosed herein will typically have an inter-pixel distance that is small enough to ensure a convincing image in the user's visual plane.

Various features that may be included in the head mounted display devices disclosed herein include, but are not limited to, the following, some of which have been mentioned above:

(1) In some embodiments, one or more Fresnel lenses may be used to modify the diopter characteristics of the beam emitted from the display surface.

(2) In some embodiments, the reflective optical surface can be translucent to allow light to enter from the external environment. The image produced by the internal display can then overlay the external image. The two images can be aligned by using a localized device (such as a gyroscope, a camera) and a software-operated computer-generated image such that the virtual image is in place in the external environment. In particular, cameras, accelerometers, and/or gyroscope aids can be used to register where they are in reality and to overlay their images on an external view. In such embodiments, the balance between the relative transmittance and reflectance of the reflective optical surface can be selected to provide the user with an overlay image having suitable brightness characteristics. Moreover, in these embodiments, the real world image and the computer generated image may appear to be at substantially the same line of sight such that the eye can focus on both images simultaneously.

(3) In some embodiments, the reflective optical surface is kept as thin as possible to minimize the effects on the position or focus of external light passing through the surface.

(4) In some embodiments, the head mounted display device provides a field of view of at least 100 degrees, at least 150 degrees, or at least 200 degrees to each eye.

(5) In some embodiments, the static field of view provided by the head mounted display to each eye does not overlap the user's nose to any significant extent.

(6) In some embodiments, the reflective optical surface can use its optical prescription to progressively shift in view to maintain focus on the available display area.

(7) In some embodiments, ray tracing can be used to customize device parameters for specific implementations, such as military training, flight simulation, gaming, and other commercial applications.

(8) In some embodiments, the curvature of the reflective optical surface and/or the surface of the display and the lens (when used) may be manipulated with respect to a modulation transfer function (MTF) specification at the retina and/or the optic socket, and The distance between the display and the reflective optical surface and between the reflective optical surface and the eye.

(9) In some embodiments, the HMDs disclosed herein may be implemented in applications such as, but not limited to, sniper detection, business training, military training and combat, and CAD manufacturing.

Once designed, the reflective optical surfaces (eg, FS/UWA/RO surfaces) disclosed herein can be produced (eg, mass produced) using a variety of techniques and materials that are now known or subsequently developed. For example, the surfaces can be made of a plastic material that has been metallized to have suitable reflectivity. Polished plastic or glass materials can also be used. For "Actual Reality" applications, the reflective optical surface can be constructed from a transmissive material having a small embedded reflector, thereby reflecting the portion of the incident wavefront while allowing light to pass through the material.

For prototype parts, acrylic plastic (for example, colloidal glass) can be used for parts that are being formed by diamond turning. For producing parts, acrylic or polycarbonate can be used, for example, for parts that are being formed by, for example, injection molding techniques. The reflective optical surface can be described as a detailed computer-aided drawing (CAD) description or as a non-uniform rational B-spline NURBS surface (which can be converted into a CAD description). Having a CAD file allows the device to be fabricated using 3D printing, in which case the CAD description directly produces 3D objects without machining.

The mathematical techniques discussed above may be encoded in various programming environments now known or subsequently developed and/or in various programming languages now known or subsequently developed. The current preferred programming environment is the Java language implemented in the Eclipse Programmer interface. Other programming environments such as Microsoft Visual C# can also be used as needed. Calculations can also be performed using the Mathcad platform marketed by PTC (Needham, Mass.) and/or the Matlab platform from MathWorks, Inc., (Natick, Massachusetts). The resulting program can be stored on a hard drive, memory card, CD or similar device. Such programs can be executed using typical desktop computing devices available from multiple vendors (eg, DELL, HP, TOSHIBA, etc.). Alternatively, use a more powerful computing device that includes "cloud" computing as needed.

Many modifications of the scope and spirit of the invention will be apparent to those skilled in the <RTIgt; For example, although a reflective optical surface that provides a user with a large field of view (eg, a field of view greater than or equal to 100°, 150°, or 200°) constitutes an advantageous embodiment of the design aspect of the present invention, it can also be used for Computer-based methods and systems for designing reflective optical surfaces disclosed herein to create surfaces with smaller fields of view. The following claims are intended to cover such and other modifications, variations and equivalents

11. . . monitor

13. . . Reflective optical surface

15. . . eye

17. . . Rotation center

19. . . Light from the display

71. . . User's nominal right eye

72. . . The center of rotation of the user's eyes

73. . . Straight ahead gaze direction

75. . . arc

77. . . vector

78. . . vector

79. . . vector

80. . . vector

81. . . Luminous surface

82. . . First light emitting area

83. . . Second light emitting area

84. . . First reflective area

85. . . First surface normal / first partial normal

86. . . Second reflection area

87. . . Second surface normal / second partial normal

88. . . Square virtual image / visible virtual image

89. . . Virtual image of triangle / visible virtual image

100. . . Head mounted display device

105. . . User/user's head

107. . . frame

110. . . Image display system

111. . . surface

115. . . Lens or lens system

120. . . Reflective optical surface / FS / UWA / RO surface

120L. . . FS/UWA/RO surface

120R. . . FS/UWA/RO surface

140. . . Electronic package

150. . . Transmission cable

170. . . camera

180. . . Light

185. . . Light

190. . . Light

195. . . point

200. . . User's head

201. . . FS/UWA/RO surface

202. . . FS/UWA/RO surface

203. . . User's eye

204. . . User's eye

205. . . User's nose

210. . . Nose ridge / sight

211. . . Sight

212. . . Sight

213. . . Sight

214. . . Front part of the head

215. . . Rolling center

216. . . Rolling center

310. . . User's eye

330. . . Internal lens

340. . . Light

345. . . Vector/ray

350. . . vector

352. . . Reference number

355. . . Real image

360. . . Virtual image

365. . . people

405. . . Light

407. . . Curved display

410. . . Rays

415. . . Light

510. . . Luminous surface

515. . . beam

520. . . Reflective optical surface / FS / UWA / RO surface

525. . . beam

530. . . User's eye

535. . . Line / bisector vector / desired surface normal

540. . . Reflection point

545. . . Pixel

550. . . Vertical plane

555. . . Center of the eye

610. . . Pixel reflection point

615. . . Pixel

620. . . beam

710. . . point

720. . . point

730. . . line

740. . . line

Figure 1 is a schematic diagram showing the basic components of the HMD (i.e., the display, the reflective surface, and the eyes of the user).

2 is a side view representation of a head mounted display device in accordance with an example embodiment.

3 is a front elevational view of the head mounted display device of FIG. 2.

4 is a ray diagram illustrating optical paths from both a display and an external object in a head mounted display device, according to an example embodiment.

Figure 5 is a ray diagram illustrating an example embodiment using a curved display and a curved reflector.

6 is a top plan view of a head mounted display device illustrating the use of two curved reflective optical surfaces corresponding to two eyes of a user, in accordance with an example embodiment.

Figure 7 is a schematic diagram illustrating the static field of view of a nominal human eye for a straight forward gaze direction.

8 is a schematic diagram illustrating the interaction between the static field of view of FIG. 7 and the FS/UWA/RO surface, according to an example embodiment. The arrows in Figure 8 illustrate the direction of light propagation.

9 is a ray diagram illustrating an optical path from a given pixel (when it is reflected toward an eye) on a display, in accordance with an example embodiment.

10 is a ray diagram illustrating an optical path from two pixels on a display (when it is reflected toward the eye), according to an example embodiment.

11 is a diagram illustrating variables used in selecting the direction of a local normal to a reflector, according to an example embodiment.

Figure 12 is a representation of a curved reflector along with an optical path, in accordance with an example embodiment.

Figures 13 and 14 illustrate FS/UWA/RO surfaces in accordance with an example embodiment from two perspective views.

Figures 15 and 16 illustrate another FS/UWA/RO surface in accordance with an example embodiment from two perspective views.

17 is a schematic diagram illustrating a geometrical diagram for calculating a local normal of a reflective surface, in accordance with an example embodiment.

100. . . Head mounted display device

105. . . User/user's head

107. . . frame

110. . . Image display system

115. . . Lens or lens system

120. . . Reflective optical surface / FS / UWA / RO surface

140. . . Electronic package

150. . . Transmission cable

170. . . camera

180. . . Light

185. . . Light

190. . . Light

195. . . point

Claims (23)

A head mounted display device comprising: (I) a frame adapted to be mounted on a user's head; (II) an image display system supported by the frame; and (III) a reflection An optical surface supported by the frame, the reflective optical surface being a continuous surface that is rotationally symmetric about any coordinate axis of a three-dimensional Cartesian coordinate system; wherein: (a) the image display system includes at least one light emitting surface; (b) During use, the reflective optical surface produces a spatially separated virtual image of the spatially separated portion of the at least one light emitting surface, and at least one of the spatially separated virtual images is spatially separated from the spatial image At least one of the others is angularly separated by at least 100 degrees, the angular separation being measured from a center of rotation of a nominal user's eye; and (c) at least one point of the reflective optical surface during use At least one other point of the reflective optical surface is angularly separated by at least 100 degrees, the angular separation being measured from the center of rotation of a nominal user's eye. The head-mounted display device of claim 1, wherein: at least one of the spatially separated virtual images is angularly separated by at least 150 degrees from at least one other of the spatially separated virtual images; At least one point of the reflective optical surface and at least the reflective optical surface One other point is angularly separated by at least 150 degrees. The head-mounted display device of claim 1, wherein: at least one of the spatially separated virtual images is angularly separated by at least 200 degrees from at least one other of the spatially separated virtual images; At least one point of the reflective optical surface is angularly separated from at least one other point of the reflective optical surface by at least 200 degrees. The head mounted display device of claim 1, wherein during use: the at least one of the spatially separated virtual images is positioned along a gaze direction through the at least one of the reflective optical surfaces; The at least one other of the spatially separated virtual images are positioned along a gaze direction through one of the at least one other point of the reflective optical surface. A head mounted display device according to claim 1, wherein the reflective optical surface is translucent. A head mounted display device according to claim 1, wherein the device has one and only one reflective optical surface. A head mounted display device according to claim 1, wherein the device has two and only two reflective optical surfaces, one of each of the user's eyes. A head mounted display device comprising: (I) a frame adapted to be mounted on a user's head; (II) an image display system supported by the frame; and (III) a free Space, ultra-wide angle, reflective optical surface, Frame support; wherein: (a) the image display system includes at least one light emitting surface; (b) during use, the free space, the ultra wide angle, and the reflective optical surface create a spatially separated portion of the at least one light emitting surface The separated virtual image, at least one of the spatially separated virtual images being angularly separated from at least one other of the spatially separated virtual images by at least 100 degrees, the angular separation being from a nominal One of the user's eyes rotates the center to measure. The head mounted display device of claim 8, wherein at least one of the spatially separated virtual images is angularly separated by at least 150 degrees from at least one other of the spatially separated virtual images. The head mounted display device of claim 8, wherein at least one of the spatially separated virtual images is angularly separated by at least 200 degrees from at least one other of the spatially separated virtual images. The head-mounted display device of claim 8, wherein the device comprises a first image display system and a second image display system, and a first free space, an ultra-wide angle, and a fixed relationship with the first image display system. a reflective optical surface and a second free space, an ultra-wide angle, a reflective optical surface in fixed relationship with the second image display system. A head mounted display device according to claim 8, wherein the free space, the ultra wide angle, and the reflective optical surface are translucent. The head mounted display device of claim 8, wherein the free space, ultra wide angle, reflective optical surface is configured to at least partially cause the image to be displayed The light emitted by at least one of the light emitting surfaces of the system is collimated. A head mounted display device comprising: (I) a frame adapted to be mounted on a user's head; (II) an image display system supported by the frame; and (III) a reflection a surface supported by the frame, the reflective surface providing a field of view of at least 200° to a nominal user; wherein: (a) the image display system includes at least one light emitting surface, the at least one light emitting surface comprising At least first and second spatially separated illumination regions of the first and second information content; (b) the reflective surface includes at least first and second portions respectively having first and second surface normals directed in different directions a spatially separated reflective area; and (c) the frame supports the image display system and the reflective surface such that during use of the device by a nominal user: (i) at least one of the eyes of the nominal user a gaze direction, light from the first illuminating region is reflected away from the first reflective region and enters the eye to form a visible virtual image of one of the first information content; (ii) at least one gaze direction of the eye, from The second Light from the light region is reflected away from the second reflective region and enters the eye to form a visible virtual image of one of the second information content; and (iii) at least one gaze direction of the eye, light from the first illumination region Reflecting away from the first reflective area and entering the eye The virtual image is visible to form one of the first information content, and the light from the second light-emitting area is reflected away from the second reflective area and does not enter the eye, and the virtual image is not formed by one of the second information content. The head-mounted display device of claim 14, wherein the device comprises a first image display system and a second image display system, and a first reflective surface in a fixed relationship with the first image display system and the second The image display system is in a fixed relationship with one of the second reflective surfaces. A head mounted display device according to claim 14, wherein the reflective surface is translucent. The head mounted display device of claim 14, wherein the reflective surface is configured to at least partially collimate light emitted from at least one of the light emitting surfaces of the image display system. A computer based method for designing a reflective optical surface for use in a head mounted display comprising an image display system, the image display system having during use of the head mounted display a plurality of content regions, the method comprising performing the following steps using one or more computers: (a) dividing the reflective optical surface into a plurality of partial reflection regions, each of the partial reflection regions having a surface normal; (b) causing the reflection Each of the partial reflection regions of the optical surface is associated with one and only one content region of the image display system, each content region being associated with at least one partial reflection region; and (c) adjusting the configuration of the reflective optical surface such that Equal surface normal Each of the two vectors is equally divided: (1) a vector of the partially reflective region to its associated content region; and (2) the partially reflective region to a nominal use during use of the head mounted display One of the eyes of the person's eye rotates the center of the vector. The method of claim 18, wherein the configuration of the reflective optical surface is adjusted to at least partially collimate light emitted from the image display system. The method of claim 18, further comprising producing the reflective optical surface. A computer program embodied in a tangible computer readable medium for performing the method of claim 18. A computer system programmed to perform the method of claim 18. A computer system comprising: (a) a processor; (b) a memory unit coupled to the processor, the memory unit storing program instructions for executing a method as claimed in claim 18 A computer program.