JP2016164704A - Image display device and image display system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a projector capable of easily changing the indication color of an indication body by using a general-purpose felt pen, when a drawing object image is generated and projected by indicating a projection surface by the indication body.SOLUTION: A projector 100 includes a projection part 140 which projects an image onto a screen SC, an indication position detection part 150 which detects the indication position of the screen SC indicated by the indication body P, an indication color detection part 160 which photographs the indication body P and detects the indication color indicated by the indication body P, a drawing object image generation part 120 which generates the drawing object image corresponding to the indication position with the indication color, and an image processing part 130 which projects the drawing object image onto the screen SC.SELECTED DRAWING: Figure 2

Description

  The present invention relates to an image display device and an image display system.

Conventionally, an image based on an image signal output from a computer or the like is displayed on a screen or the like by an image display device such as a projector, and the image display device detects a user operation performed on a projected image using an electronic pen. Electronic blackboard systems (interactive systems) that generate and display images based on information related to user operations have been put into practical use.
The electronic pen is, for example, an indicator that emits infrared light from the pen tip, and the projector detects the infrared light from the electronic pen and recognizes the operation content of the user. For example, when a user performs an operation such as drawing a line with an electronic pen on a projected image, the projector recognizes the locus of the electronic pen and synthesizes and projects a line representing the locus of the electronic pen on the projected image. . In this manner, the user can draw a line with the indicator on the projected image.

In the display system shown in Patent Document 1 below, a setting screen that can be set for drawing is displayed superimposed on a projected image, and the user operates the setting screen to select the color of a line to be drawn. In this display system, an identification mark provided on the electronic pen and function information of the electronic pen are stored in association with each other, and the identification mark of the electronic pen is read to identify the electronic pen.
Further, Patent Document 2 below discloses a technique for switching the color of a line to be drawn by switching a switch provided on an electronic pen.

JP2013-175001A JP 2001-175404 A

  However, in conventional interactive systems, an electronic pen with a changeover switch or an electronic pen with an identification mark to associate with function information is required depending on the interactive system. In addition to this, the interactive system is not compatible, so it is necessary to prepare and manage a dedicated electronic pen for each interactive system, which increases the management cost of the interactive system. In addition, the user needs to call a setting screen on the screen and set a color for drawing with the electronic pen, which is troublesome.

  SUMMARY An advantage of some aspects of the invention is to solve at least a part of the problems described above, and the invention can be implemented as the following forms or application examples.

[Application Example 1]
An image display device according to this application example, a display unit that displays an image on a display surface, a position detection unit that detects an indication position of the display surface that is instructed by an indicator, and images the indicator, A color detection unit that detects an instruction color instructed by an indicator, a generation unit that generates a drawing object image corresponding to the indicated position with the instruction color, and an image processing unit that displays the drawing object image on the display unit; It is characterized by providing.

  According to such a configuration, when the indicator indicates the display surface on which the image is displayed, the color detection unit detects the indication color indicated by the indicator, and the drawing object image corresponding to the indication position of the indicator is obtained. The generated drawing object image is displayed on the display surface. Therefore, since the indicator color is detected by the color detector, the indicator does not need a function of transmitting information on the indicator color, and in addition to reducing the cost of the indicator, the color detector Since the change of the indication color of the indicator is detected and the drawing object image is generated with the detected indication color, the indication color can be easily switched.

[Application Example 2]
In the image display device according to the application example, the image processing unit generates a superimposed image in which the image displayed by the display unit and the drawing object image are superimposed, and the generated superimposed image is It is preferable to display on the display unit.

  According to such a configuration, since the drawing object image generated by instructing with the indicator is displayed superimposed on the image displayed on the display unit, the drawing object generated on the displayed image is displayed. Can be easily synthesized and displayed.

[Application Example 3]
In the image display device according to the application example, it is preferable that the color detection unit determines the instruction color based on attribute information included in the indicator.

  According to such a configuration, the instruction color is determined based on the attribute information of the indicator, and thus can be easily set without inputting the instruction color.

[Application Example 4]
In the image display device according to the application example described above, the drawing object image may indicate a movement locus of the indicator based on a plurality of the indication positions.

[Application Example 5]
The image display device according to the application example described above preferably includes a setting unit that sets the attribute information of the indicator.

  According to such a configuration, the attribute information of the indicator can be set via the setting unit.

[Application Example 6]
In the image display device according to the application example, it is preferable that the image processing unit generates an information image indicating the attribute information, and causes the display unit to display the generated information image superimposed on the drawing object image. .

  According to such a configuration, an information image indicating attribute information can be displayed superimposed on the drawing object image.

[Application Example 7]
An image display system according to this application example includes an image supply unit that supplies an image to be displayed, a display unit that displays the image on a display surface, and a position detection that detects an indication position on the display surface indicated by an indicator. A color detection unit that detects an instruction color indicated by the indicator, a generation unit that generates a drawing object image corresponding to the instruction position using the instruction color, and a display unit that displays the drawing object image. And an image processing unit.

  According to such a configuration, when the indicator indicates the display surface on which the image is displayed, the color detection unit detects the instruction color indicated by the indicator, and the drawing object image corresponding to the indication position of the indicator The generated drawing object image is displayed on the display surface. Therefore, since the indicator color is detected by the color detector, the indicator does not need a function of transmitting information on the indicator color, and in addition to reducing the cost of the indicator, the color detector Since the change of the indication color of the indicator is detected and the drawing object image is generated with the detected indication color, the indication color can be easily switched.

FIG. 4 is a diagram illustrating a usage example of the projector according to the embodiment of the invention. 1 is a block diagram showing a functional configuration of a projector according to an embodiment of the invention. The figure which shows the optical system of a projection part typically. The figure which shows an example of the pen setting menu displayed by an OSD function. The figure which shows the attribute display of a pointer.

  Embodiments of the present invention will be described below with reference to the drawings.

(Embodiment)
FIG. 1 is a diagram illustrating a usage example of a projector 100 according to an embodiment to which the present invention is applied. The projector 100 is one of image display apparatuses, is installed above a screen SC such as a whiteboard having a display surface, and is connected to a PC (personal computer) 50 via a cable 60 so as to be communicable.
In the present embodiment, the projector 100 and the PC 50 constitute an image display system (interactive system). The PC 50 corresponds to an image supply unit.
The projector 100 receives the image data transmitted from the PC 50 and projects an image based on this image data onto the screen SC as a projection plane. The projector 100 is a short focus type, and is installed immediately above the screen SC and projects an image obliquely downward.

  In addition, the projector 100 includes an on-screen display (OSD) function that projects a projected image being projected and a menu screen in a superimposed manner in accordance with a user instruction and receives a setting instruction from the menu screen. On the menu screen, for example, a handwriting writing function for a projected image can be selected.

In the writing function, for example, when the user grips the pen-shaped indicator P and moves the gripped indicator P in a desired direction on the screen SC, the projector 100 moves the indicator P on the screen SC. A position is detected, and a movement trajectory is calculated based on the detected plurality of positions. The projector 100 projects the calculated movement trajectory on the screen SC with a previously designated line segment. In this way, the user can draw a picture such as a straight line, a curve, or a polygon superimposed on the projected image on the screen SC.
Further, the projector 100 can store an image drawn by this function as image data, and can read and redraw the saved image as necessary.
Note that the connection between the projector 100 and the PC 50 is not limited to the mode via the cable 60, and a mode of connecting via a network by wireless communication can also be assumed.

FIG. 2 is a block diagram illustrating a functional configuration of the projector 100. The projector 100 includes a projection image input unit 102, an operation unit 104, an instruction analysis unit 110, a drawing object image generation unit 120, an image processing unit 130, a projection unit 140, an instruction position detection unit 150, and an instruction color detection unit 160. The indication position detection unit 150 corresponds to a position detection unit, and the indication color detection unit 160 corresponds to a color detection unit.
The projection image input unit 102 receives image data converted into a data format that can be projected by the projector 100 from the PC 50. The image data input to the projection image input unit 102 is sent to the image processing unit 130.
The operation unit 104 is assumed to be an operation panel 105 disposed in the projector 100, an operation remote controller (not shown), or the like, and a predetermined operation is instructed to the projector 100 by the user.

The indicated position detection unit 150 detects the position of the indicator P on the screen SC instructed by the user, and sends position information of the indicator P to the instruction analysis unit 110 based on the detected position. In this embodiment, the indicator P is assumed to be a general-purpose felt pen such as a whiteboard marker, a sign pen, and a line marker that can be drawn on a paper medium or the like. Accordingly, the indicator P does not have a function of emitting light itself or a function of transmitting an electrical signal or the like.
In the present embodiment, the pointing position detector 150 captures the pointer P with a plurality of digital cameras (not shown), and calculates the pointing position of the pointer P based on the parallax of the captured pointer P. A stereo camera system is adopted.

The indicated position detection unit 150 is not limited to the stereo camera system, and for example, a position detection system by scanning with a laser beam can be assumed. Further, the detection may be performed in two stages, a stereo camera system and a position detection system using laser light.
It is also possible to assume a mode in which a retreat location for temporarily retracting the indicator P that is not used is set and the position of the indicator position detection unit 150 is not detected for the indicator P placed at the retreat location. Note that the retreat location may be set in an end region on the screen SC, and an embodiment such as a pen holder that can be attached to and detached from any location on the screen SC and that can be identified by the indicated position detection unit 150 is assumed. it can.

The instruction color detection unit 160 detects an instruction color indicated by the indicator P on the screen SC, and sends information related to the detected instruction color to the instruction analysis unit 110. In the present embodiment, it is assumed that the instruction color detection unit 160 is a digital camera that can capture visible light. The digital camera of the indication color detection unit 160 may be used together with the digital camera of the indication position detection unit 150.
A drawing color, which is one of the attribute information of the felt pen, is displayed on at least a part of a general-purpose felt pen grip and cap. The instruction color detection unit 160 captures an image of the felt pen grip unit and the cap unit including the display area of the drawing color with a digital camera, and sends the captured image data to the instruction analysis unit 110.

The instruction analysis unit 110 has a function of analyzing the instruction content instructed by the user on the screen SC with the indicator P. Furthermore, the instruction analysis unit 110 includes a control function for controlling each functional unit in accordance with the analyzed instruction content.
The instruction analysis unit 110 includes a locus analysis unit 112, an instruction color analysis unit 114, and an attribute management unit 116 as functions for analyzing and managing instruction contents.
When the drawing on the screen SC is instructed by the indicator P held by the user, the trajectory analysis unit 112 is based on the information on the plurality of indication positions of the indicator P sent from the indication position detection unit 150. Analyze the movement trajectory of P. When the movement of the indicator P and the screen SC does not exceed the reference distance, the trajectory analysis unit 112 determines that the movement is for drawing a picture, and the indicator P moves from the screen SC to the reference. When a movement exceeding the distance is detected, it is determined that the movement is not accompanied by drawing.

The trajectory analysis unit 112 sends information on the movement trajectory of the indicator P analyzed in this way to the drawing object image generation unit 120.
The instruction color analysis unit 114 analyzes the instruction color based on information sent from the instruction color detection unit 160. For example, when the drawing color is applied to the felt pen gripping part, the indication color analysis unit 114 analyzes the image data to acquire the drawing color colored on the felt pen gripping part, and the acquired drawing The color is set as the instruction color indicated by the indicator P.

Note that the image sent to the instruction color analysis unit 114 is reflected light that is reflected from the gripping unit from outside. Accordingly, the indicator color can be analyzed more accurately by determining the color of the grip portion in consideration of the wavelength of the light that irradiates the felt pen. For this reason, the projector 100 may perform white balance correction according to the irradiation light from the outside at the time of startup, for example.
The indication color detection unit 160 is not limited to a digital camera, and irradiates predetermined reference light, for example, light beams having different wavelengths such as red, green, and blue, to the display area of the drawing color on the indicator P, respectively. It is also possible to assume a mode in which the indication color analysis unit 114 analyzes each reflected light from the display area and detects the indication color of the indicator P.

The instruction color analysis unit 114 sends information on the instruction color analyzed in this way to the drawing object image generation unit 120.
The attribute management unit 116 manages attribute information regarding the instruction color and the movement locus. Detailed functions of the attribute management unit 116 will be described later.
The drawing object image generation unit 120 draws with the instruction color based on the information on the movement locus of the indicator P sent from the locus analysis unit 112 and the information on the instruction color sent from the instruction color analysis unit 114. Locus image, that is, a drawing object is generated. The drawing object image generation unit 120 sends the generated image data of the drawing object to the image processing unit 130. The drawing object image generation unit 120 corresponds to a generation unit.

The image processing unit 130 performs predetermined image processing on the image data sent from the projection image input unit 102 and the drawing object image generation unit 120. For example, the image processing unit 130 generates image data of a superimposed image obtained by synthesizing the image sent from the projection image input unit 102 and the image sent from the drawing object image generation unit 120.
In addition, when the display of the menu screen is instructed by the OSD function, the image processing unit 130 generates image data in which the projection image and the image of the corresponding menu screen are further superimposed.
The image processing unit 130 performs resizing processing based on the image data, and generates an image signal and a luminance signal in which each gradation of R (red), G (green), and B (blue) is represented by a luminance value. To do. Furthermore, the image processing unit 130 calculates a feature amount based on the luminance signal, the image signal is expanded based on the expansion coefficient calculated from the calculated feature amount, and the expanded image signal is output from the projection unit 140. It is sent to the liquid crystal devices 285R, 285G, 285B (FIG. 3), respectively.

The projection unit 140 corresponds to a display unit, and displays an enlarged image based on the image signal output from the image processing unit 130 on the display surface of the screen SC.
Note that the instruction analysis unit 110, the drawing object image generation unit 120, and the image processing unit 130 include a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and the like, all of which are not shown. Prepare as hardware. The CPU is a central processing unit that performs various arithmetic processes, and performs overall control of the projector 100 by inputting and outputting signals to and from each unit. The ROM stores a control program and control data used for the CPU to perform various arithmetic processes. This control program includes an image processing program used in the image processing unit 130. The ROM also stores various programs. The RAM is used as a work area when the CPU performs various arithmetic processes.

The functions of the instruction analysis unit 110, the drawing object image generation unit 120, and the image processing unit 130 described above are realized by the cooperation of these hardware and programs.
FIG. 3 is a diagram schematically showing the optical system of the projection unit 140. The schematic configuration of the optical system will be described with reference to FIG.
The optical system of the projection unit 140 is configured by an optical unit 251. The optical unit 251 includes an optical component casing 252, a light source device 255, an illumination optical device 260, a color separation optical device 265, a relay optical device 270, a light modulation device 280, and a projection optical device 290. The optical components constituting each of these devices are accommodated in an optical component casing 252.

The light source device 255 includes an arc tube 256 that emits a light beam and a reflector 257. The light source device 255 reflects the light beam emitted from the arc tube 256 by the reflector 257, aligns the emission direction, and emits the light toward the illumination optical device 260. The illumination optical axis OC is a central axis of a light beam emitted from the light source device 255 to the illuminated area side. The light source may be a solid light source such as an LED or a laser.
The illumination optical device 260 includes lens arrays 261 and 262, a polarization conversion element 263, a superimposing lens 264, and a field lens 269. The illumination optical device 260 generates illuminance in a plane orthogonal to the illumination optical axis OC with respect to the light beam emitted from the light source device 255. It has a function to make uniform.
The color separation optical device 265 includes dichroic mirrors 266 and 267 and a reflection mirror 268. The light beam emitted from the illumination optical device 260 is converted into three colors of red (R) light, green (G) light, and blue (B) light. The light is separated into colored light and guided to the three liquid crystal devices 285R, 285G, and 285B.

The relay optical device 270 includes an incident side lens 272, a relay lens 276, and reflection mirrors 274 and 278. Since the optical path length of the relay optical device 270 is longer than the optical path lengths of the other color lights with respect to the color light (B light in this embodiment) separated by the color separation optical device 265, the light divergence, etc. The use efficiency of the light is prevented from decreasing, and the light is guided to the liquid crystal device 285 (the liquid crystal device 285B in this embodiment).
The light modulation device 280 includes three incident-side polarizing plates 284, three liquid crystal devices 285R, 285G, and 285B, three emission-side polarizing plates 286, and a cross dichroic prism 288. The liquid crystal devices 285R, 285G, and 285B modulate each color light separated by the color separation optical device 265 according to an image signal. The cross dichroic prism 288 combines the color lights modulated by the liquid crystal devices 285R, 285G, and 285B, and emits them to the projection optical device 290 side. The light modulation device 280 is not limited to a method using a liquid crystal panel, and other methods such as a DLP (Digital Light Processing) method and an LCOS (Liquid Crystal On Screen) method can be assumed.

The projection optical device 290 includes a projection lens 292 having a very short focus and a reflection mirror 294 having a curved surface. The projection optical device 290 enlarges the light beam modulated and synthesized by the light modulation device 280 by the projection lens 292, reflects the light beam by the reflection mirror 294, and magnifies and projects the image signal toward the display surface of the screen SC. An image based on is displayed on the display surface.
FIG. 4 is a diagram illustrating an example of a pen setting menu displayed by the OSD function. This pen setting menu corresponds to a setting unit for setting the attribute information of the indicator P. The pen setting menu is generated by the attribute management unit 116 (FIG. 2) based on the operation of the operation unit 104 by the user, and is projected on the screen SC.
The user recognizes the indicator P that draws the drawing object image, finely adjusts the instruction color, specifies the instruction color, special effect, the thickness of the line indicating the movement locus, and the display of the movement locus via the pen setting menu. Can indicate patterns, patterns, etc. The special effects are assumed to be “floating change” and “disappearance change”.

Here, in the “floating change”, the movement locus immediately after the drawing is in an invisible state (transparent state), and after a predetermined time elapses, the transition is made to the visible state. In addition, in “disappearance change”, the movement trajectory immediately after drawing is in a visible state, and after a predetermined time has elapsed, transition to an invisible state (transparent state).
The attribute management unit 116 manages the attributes of the indicator P by storing the contents set by the user via the pen setting menu in association with the indicator P.
FIG. 5 is a diagram showing an attribute display of the indicator P. For example, as shown in FIG. 5A, when the user designates the indicator P1 on the screen SC for the first time after activation, the attribute management unit 116 displays an information image indicating at least part of the attribute information of the indicator P1. The generated information image is superimposed and projected in the vicinity of the indication area of the indicator P1.

Further, as shown in FIG. 5B, an image of attribute information of the indicator P2 or an information image showing at least part of the attribute information of the indicator P3 may be projected on a predetermined position on the screen SC.
In these cases, the time for projecting the information image may be a fixed time or may be constantly projected. In addition, it is possible to assume a mode in which the user sets the attribute information to be projected.

According to the embodiment described above, the following effects can be obtained.
(1) By instructing on the screen SC on which the projector 100 projects an image with an indicator P such as a general-purpose felt pen, a desired picture can be displayed superimposed on the projected image. Therefore, since the indicator P as an electronic device such as an electronic pen is unnecessary, the interactive system can be realized easily and inexpensively.
(2) When switching the color of a line drawing drawn by the indicator P, the user replaces the indicator P indicating a desired color, whereby the projector 100 detects the indicator color of the indicator P, and then instructs The drawn object is projected with the indicated color. Therefore, it is possible to easily and quickly change the instruction color when generating the drawing object image.
(3) Since the projector 100 sets and manages attribute information such as an instruction color and a drawing pattern for each indicator P, the user can quickly and easily select a desired drawing object by switching a plurality of indicators P. Can be created.
(4) Since the attribute information of the indicator P can be displayed superimposed on the drawing object image, the user can easily recognize the attribute information of the indicator P.

  Although the embodiment of the present invention has been described with reference to the drawings, the specific configuration is not limited to this embodiment, and includes design changes and the like within a scope not departing from the gist of the present invention. For example, the indication color detection unit 160 detects the color that is colored on the felt pen grip or cap, but, for example, a bar code, character, or symbol indicating color information is attached to the indicator P. In this case, it is possible to assume a mode of decoding these pieces of information.

Further, the instruction color detection unit 160 may detect the contour of the photographed subject and determine the color associated with the detected contour. Furthermore, a predetermined motion may be associated with the contour of the subject. For example, it is possible to assume a mode in which an erasing operation such as an eraser is linked to the outline of a rectangular parallelepiped, and an area corresponding to the movement locus of the rectangular parallelepiped is erased with respect to a projected subject.
Further, at least a part of the functions of the instruction analysis unit 110 and the drawing object image generation unit 120 may be realized on the PC 50 side. In addition, an aspect in which the image supply function included in the PC 50 is provided on the projector 100 side can be assumed.
The image display device of the present invention is not limited to the projector 100 that projects an image on the screen SC, and the image is displayed on a liquid crystal monitor or a liquid crystal television that displays an image / image on a liquid crystal display panel, or on a plasma display panel (PDP). / Monitor device or television receiver for displaying an image, monitor device or television receiver for displaying an image / image on an organic EL display panel called OLED (Organic light-emitting diode), OEL (Organic Electro-Luminescence), etc. Various display devices such as a self-luminous display device are also included in the image display device of the present invention.
Moreover, the apparatus which implements the above methods may be realized by a single apparatus or may be realized by combining a plurality of apparatuses, and includes various aspects.

  DESCRIPTION OF SYMBOLS 50 ... PC, 60 ... Cable, 100 ... Projector, 102 ... Projection image input part, 104 ... Operation part, 105 ... Operation panel, 110 ... Instruction analysis part, 112 ... Trajectory analysis part, 114 ... Instruction color analysis part, 116 ... Attribute management unit 120 ... Drawing object image generation unit 130 ... Image processing unit 140 ... Projection unit 150 ... Indicating position detection unit 160 ... Indicating color detection unit 251 ... Optical unit 252 ... Optical component casing 255 ... light source device, 256 ... light emission tube, 257 ... reflector, 260 ... illumination optical device, 261,262 ... lens array, 263 ... polarization conversion element, 264 ... superimposed lens, 265 ... color separation optical device, 266,267 ... dichroic Mirror, 268... Reflection mirror, 269... Field lens, 270... Relay optical device, 272. , 278..., Reflection mirror, 276. Relay lens, 280. Lens, 294 ... reflection mirror, SC ... screen, P ... indicator.

Claims (7)

A display unit for displaying an image on the display surface;
A position detection unit for detecting an indication position on the display surface indicated by an indicator;
A color detection unit that images the indicator and detects an indication color indicated by the indicator;
A generating unit that generates a drawing object image corresponding to the indicated position with the indicated color;
An image display device comprising: an image processing unit that displays the drawing object image on the display unit. The image display device according to claim 1,
The image processing unit generates a superimposed image obtained by superimposing the image displayed by the display unit and the drawing object image, and causes the display unit to display the generated superimposed image. Image display device. The image display device according to claim 1,
The image display device, wherein the color detection unit determines the instruction color based on attribute information of the indicator. The image display device according to any one of claims 1 to 3,
The image display device, wherein the drawing object image shows a movement locus of the indicator based on a plurality of the indication positions. The image display device according to any one of claims 1 to 4,
An image display device comprising: a setting unit that sets the attribute information of the indicator. The image display device according to claim 5,
The image processing unit generates an information image indicating the attribute information, and superimposes the generated information image on the drawing object image to be displayed on the display unit. An image supply unit for supplying an image to be displayed;
A display unit for displaying the image on a display surface;
A position detection unit for detecting an indication position on the display surface indicated by an indicator;
A color detection unit for detecting an instruction color indicated by the indicator;
A generating unit that generates a drawing object image corresponding to the indicated position with the indicated color;
An image display system comprising: an image processing unit that displays the drawing object image on the display unit.

Images