JP4455185B2 - Presentation system, control method therefor, program, and storage medium - Google Patents

Description

  The present invention relates to a presentation system for providing an image to a participant in a scene such as a meeting or a presentation. More specifically, the present invention relates to a display device that displays an image and a character / image using a predetermined pointing tool on the display image. The present invention relates to a presentation system having a configuration including a coordinate input device for additionally filling in.

  Conventionally, a coordinate input device capable of inputting coordinates is arranged on a display surface of a display device such as a CRT display, a liquid crystal display (LCD), or a projector, and a handwritten handwritten or written handwritten by an operator is displayed. There is known an apparatus that can realize a relationship like paper and a pencil. The coordinate input device includes a resistive film type, electrostatic type, ultrasonic type that propagates ultrasonic waves to the coordinate input surface such as glass, etc., and those that have a transparent input plate, optical type, or sound waves in the air. A mechanism for calculating coordinates is placed on the back side of the display device, such as a method that detects the position by radiating, and an electromagnetic induction (electromagnetic transfer) method, and a transparent protective plate is placed on the front of the display device. Some of them constitute information devices integrated with input and output.

  Such devices include not only portable electronic notebooks, pen input computers, etc., but also display devices with relatively large sizes as display devices have become larger, front projectors, In combination with a large display device such as a rear projector or a PDP, it has begun to be used in, for example, a presentation device and a TV conference system. The large-sized liquid crystal display and PDP display are currently being improved in image quality and reduced in cost, and with the digitalization of satellite broadcasting and the like, the TV specification form is entering a transitional state.

  In addition, these large display devices are replaced with, for example, whiteboards or electronic blackboards used in offices. By displaying data for documents prepared in advance on a large screen display, it can be used for meetings and meetings. It is starting to be used. In this case, the information displayed on the display is controlled by a computer by directly touching the screen to update the display information by an operator or an attendee, such as a whiteboard, for example, a display screen. The display contents can be switched.

  When a large display system is adopted, it is assumed that a large audience will see, and sufficient performance is required for the viewing angle, contrast, etc. of the image. Therefore, when these large display systems are combined with a coordinate input device, it is an important requirement not only to realize low-cost and high-precision coordinate calculation, but also not to deteriorate the image quality of the display device.

  Furthermore, when thinking about this type of large input / output integrated system, the operator controls the computer by touching the screen directly in consideration of a meeting that assumes a large number of participants. If a configuration capable of appropriately displaying necessary information is realized, the operability of the operator (presentation presenter) will be greatly improved. In addition, many listeners who are participants can obtain information on the operator's instruction points, operator's facial expressions, gestures, etc., together with the information displayed on the screen, by operating the information directly on the screen. It is possible to deepen understanding.

  However, when an operator performs an action such as an instruction on this type of large display device, information on the screen is interrupted as the operator moves, and in particular, a projection type display device such as a front projector or OHP is employed. In some systems, the image is greatly distorted, which makes it difficult to view.

  As a method of solving such inconveniences such as blocking the optical path, the operator uses a pointing tool to execute a mouse-like operation (movement of the cursor in relative coordinates, not absolute coordinates) on the spot. There is a method of moving the cursor from the current cursor position to a desired position. Mouse-like movement refers to the operability of a mouse that is commonly used in recent years as a cursor position control means of a personal computer. In a small operation area, the mouse can be moved over the entire display screen by moving the mouse up and down and repeatedly. it can. If the coordinate value processing method at this time is described, in the coordinate system on the display screen, assuming that the position of the cursor at a certain point in time is (X1, Y1), for example, the method of detecting the amount of movement of the mouse by the rotation of the ball The rotation of the ball is decomposed into movement amounts in the X and Y directions, distance information (ΔX, ΔY) corresponding to the rotation is detected, and the position of the cursor is (X1 + ΔX, Y1 + ΔY) based on the signal. ) Position. If this is to be realized by the coordinate input device, it is first assumed that the coordinate values (X1, Y1) of the pointing tool at a certain point in time are detected by the operation of the operator, and then the pointing tool is moved to move the coordinates. If the coordinate input device detects the value (X2, Y2), the movement amount is (ΔX, ΔY) (ΔX = X2-X1, ΔY = Y2-Y1). If the cursor is moved with this amount of movement (ΔX, ΔY) as the amount of movement from the current arbitrary cursor position, the operator's intention (the direction and the movement distance are equal to the movement direction and the movement amount of the pointing tool. ) To move the cursor. That is, even if the pointing tool is not directly positioned at a predetermined position on the large screen, the operator can be present and move the cursor to the predetermined position.

  On the other hand, as a coordinate input device, characters can be input and drawn by touching the screen directly (a configuration in which handwriting remains as an echo back by moving the pointing tool in the relationship of paper and pencil) Command generation by an operation such as double-clicking an icon is an important function. That is, in this type of system, an operation mode for outputting absolute coordinates is indispensable, and it is an important issue to achieve compatibility with the above-described relative operations. Various methods for switching the mode have been disclosed. The display region is divided into a region where absolute coordinates can be input and a region where relative coordinates can be input (for example, see Patent Document 1), and relative. / A method of providing absolute coordinate input switching means (for example, see Patent Document 2), a method of automatically switching according to an application (for example, see Patent Document 3), and the like are disclosed.

  Furthermore, in a system that employs a projection type display device such as the front projector or OHP, considering the case of adding characters, figures, etc. on the display screen by the operation of the pointing tool by the operator, the pointing tool Or, by the hand, arm, etc. of the operator holding the pointing tool, the part where information is to be input is usually shaded, and the information currently being displayed cannot be visually recognized. In other words, when trying to add an underline to the currently displayed character information, for example, by operating the pointing tool, the character information cannot be recognized by the above-mentioned shadow, and the surrounding portion not shaded The purpose is achieved by inferring from the display information, that is, by the intuition of the operator. Therefore, there is a problem that information (in this case, underline) cannot be added to an accurate position, and the object cannot be achieved at all, particularly when trying to add a fine figure.

  A method of setting an offset value with respect to absolute coordinates (for example, see Patent Document 4) is known for the problem that “the image of the input part cannot be seen as a shadow”. In other words, by setting a desired offset value to the position coordinates of the pointing tool, the cursor position is displayed in a direction away from the position of the pointing tool, and characters and figures are input while observing the movement of the cursor. It is. In other words, the area where the pointing tool is operated is shaded and display information cannot be obtained, but it is possible to input characters, figures, etc. by visually checking the movement of the cursor displayed at a position away from that area. To do.

JP-A-4-299724 JP-A-10-333817 JP-A-5-298014 Japanese Patent Laid-Open No. 10-149253

  However, in this type of coordinate input device, it is difficult for the coordinate input device of the resistive film type, the electrostatic method, etc. to form a completely transparent input plate, and the image quality of the display device is degraded. have. On the other hand, in an ultrasonic method that requires a propagating body such as glass, the surface of the glass needs to be optically treated to prevent the reflection of a fluorescent lamp when used indoors, for example. A significant increase in cost is inevitable in terms of maintaining In addition, the electromagnetic induction method arranges electrodes on the matrix on the back side of the display surface, and sends and receives electromagnetic signals to and from the input pen. In principle, when the display device becomes larger and the thickness of the device increases, In addition to making it difficult to calculate coordinates, in the case of configuring a large-sized coordinate input device such as a conference use or a presentation use, there is a disadvantage that the device becomes very expensive. For this reason, it can be said that it is not easy to apply these coordinate input methods generally used for small touch panels to large screens for meetings or presentations.

  In addition, the operability of switching between absolute coordinates and relative coordinates in the above conventional example requires not only skill but also many operational restrictions, so it cannot be said that the configuration is easy to use. It must be taken into consideration here when adding characters or the like to the displayed information because it tries to input a figure or a character in association with the position of the displayed information (for example, The operator first decides the position on the screen where the information is to be added, not the place where the pointing tool is operated. is there. In this regard, in the above-described conventional example having means for arbitrarily setting an offset amount, the operator takes the following procedure.

Procedure 1) Determine the operating position of the indicator.
Procedure 2) Adjust / set the offset amount and move the cursor to a desired position.
Procedure 3) Add desired information by operation with pointing tool.

  That is, the operator must set the operation area and the offset amount before performing the input operation. Therefore, if the position of the reference indicator as a reference cannot be fixed during the offset setting, an error occurs (that is, information cannot be added to the desired position), and conversely, the position of the indicator is fixed. However, it is very difficult to operate the switch, and it is not easy to use.

  In addition, in the operation in the above-described procedure 3, when adding information to the displayed content, especially in a large display device, the region (relative coordinates) to be additionally recorded and the region (absolute coordinates) input with the pointing tool are separated. It is assumed that In this case, the visual line visually checks the display content of the area to be added, but it is very difficult for the operator to input because the area to be actually operated is separated. Furthermore, in a coordinate input device having this type of large display device, it is sufficient that the operator is unfamiliar with the device, considering that the purpose of use is mainly for meetings and presentations. Can be considered. In other words, if it is installed in a conference room that is used by many people in turn, people other than the participants who regularly meet in the conference room know the usability of the device well. Often not. What is important is that even a participant who happens to hold a conference in the conference room can operate the pointing tool intuitively. In this regard, in the conventional example as described above, even though it is possible to avoid a failure caused by blocking the optical path, it is not configured to be practically usable by anyone. It was.

  The present invention has been made on the basis of such a technical background. In a presentation system used for a conference or a presentation, etc., when a coordinate input device is used to additionally input information to a displayed image. The purpose is to improve operability.

One aspect of the present invention is to detect a movement locus when an instruction means in a predetermined operation state is moved within an input area provided on an image display surface, and display an image of the movement locus. A display unit configured to set an offset amount for displaying the moving locus image according to an operation of the instruction unit; and a first locus image corresponding to the moving locus. Means for displaying at a position offset by the set offset amount on the surface, and displaying a second trajectory image corresponding to the movement trajectory at a position not offset, and a partial area on the display surface And a means for displaying a copy image of an image in an area including the start point position of the first trajectory image at the start point position of the second trajectory image .

Further, another aspect of the present invention is configured to detect a movement locus when the instruction means is moved in an input area provided on an image display surface, and display an image of the movement locus. In accordance with the control method of the presentation system, a setting step of setting an offset amount when displaying the image of the movement locus according to an operation of the instruction unit, and a first locus image corresponding to the movement locus, causes display on the set offset amount offset positions on the display surface, the second trajectory image corresponding to the movement track, a first display step of displaying to a position not offset, the display surface A second display process for displaying a copy image of an image in a part of the upper region including the start point position of the first trajectory image at the start point position of the second trajectory image With the door.

Further, another aspect of the present invention is configured to detect a movement locus when the instruction means is moved in an input area provided on an image display surface, and display an image of the movement locus. The present invention relates to a program for causing a computer to execute the control method of the presentation system, and the program sets an offset amount for displaying an image of the movement locus on the computer according to an operation of the instruction unit. And displaying a first trajectory image corresponding to the moving trajectory at a position offset by the set offset amount on the display surface, and offsetting a second trajectory image corresponding to the moving trajectory. Ryo comprising a first display step, the start position of the a part of the region first trajectory image on said display surface to be displayed in the position without The copy image of the image in, characterized in that to execute a second display step of displaying the start position of the second path image.

  ADVANTAGE OF THE INVENTION According to this invention, the operativity at the time of inputting information additionally to the displayed image using a coordinate input device can be improved.

  DESCRIPTION OF EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings.

(Schematic configuration of coordinate input device)
First, a schematic configuration of the presentation system in the present embodiment will be described with reference to FIG. This presentation system is connected to a projector 7 as a display device for displaying an image, a coordinate input device 8 provided on an image display surface 7a of the projector 7, a projector 7 and a coordinate input device 8, and a control for controlling both of them. The configuration includes a host computer 6 as an apparatus. The host computer 6 is realized by a personal computer (PC), for example. Therefore, each of the projector 7 and the coordinate input device 8 can be connected to the host computer 6 via an interface such as a USB.

  Hereinafter, the configuration of the coordinate input device 8 will be described. In the drawing, 1L and 1R are sensor units each having a projector and a detector, and 1L and 1R are installed at positions separated from each other by a predetermined distance. The sensor units 1 </ b> L and 1 </ b> R are connected to a control / arithmetic unit 2 that performs control / calculation, receive a control signal from the control / arithmetic unit 2, and transmit a detected signal to the control / arithmetic unit 2. Reference numeral 3 denotes a reflecting member having a retroreflecting surface that reflects incident light in the arrival direction as shown in FIG. 2, and covers the input area 5 from the left and right sensor units along the surface of the input area 5 (for example, approximately The light projected in the 90 ° range is retroreflected toward the sensor unit. The reflected light is detected one-dimensionally by a detector of a sensor unit constituted by a condensing optical system and a line CCD, and the light quantity distribution is sent to the control / arithmetic unit 2.

  The input area 5 can be used as an interactive input device by being configured on a display screen of a display device such as a PDP, a rear projector, or an LCD panel.

  In such a configuration, when an input instruction with a finger or the like is given to the input area, the light projected from the projector is blocked, and the reflected light due to retroreflection cannot be obtained, so that the amount of light can be obtained only at the input designated position. Disappear.

  The control / arithmetic unit 2 detects the light-shielding range of the input-instructed portion from the light amount change of the left and right sensor units 1L and 1R, specifies the detection point within the same range, and calculates the respective angles. The coordinate position on the input area 5 is calculated from the calculated angle and the distance between the sensor units, and the coordinate value is output to the host computer 6.

  In this way, the host computer 6 can be operated with a finger or the like to draw a line on the screen or operate an icon.

  Hereinafter, each part of the coordinate input device 8 will be described in detail.

(Detailed explanation of sensor unit)
3A and 3B are diagrams showing a configuration example of a projector in the sensor units 1L and 1R. FIG. 3A is a diagram of the projector viewed from above (perpendicular to the input surface), and FIG. It is the figure seen from the (horizontal direction). Reference numeral 31 denotes an infrared LED that emits infrared light, and the emitted light is emitted by the light projecting lens 32 in a range of approximately 90 °. In this direction, the light from the infrared LED 31 is projected as a light beam restricted in the vertical direction, and the light is mainly projected onto the reflector 3.

  FIG. 4 is a diagram of the detectors in the sensor units 1L and 1R viewed from the direction perpendicular to the input surface. The detector includes a one-dimensional line CCD 41, lenses 42 and 43 as a condensing optical system, a diaphragm 44 that limits the incident direction of incident light, and an infrared filter 45 that prevents the incidence of extra light such as visible light. It is a configuration.

  The light from the projector is reflected by the retroreflective member, passes through the infrared filter 45 and the stop 44, and the light in the approximately 90 ° range of the input surface is incident on the detection surface of the CCD 41 at the incident angle by the condensing lenses 42 and 43. It forms an image on the dependent pixel and shows a light amount distribution for each angle. That is, the pixel number represents angle information.

  FIG. 5 shows the configuration of the sensor units 1L and 1R when the input surface is viewed from the horizontal direction. As shown in the figure, the projector and the detector are configured to overlap each other. The distance between the optical axes of the projector and the detector only needs to be set in a sufficiently detectable range from the angle characteristics of the retroreflective member.

(Reflecting member)
The retroreflective member 3 shown in FIG. 1 has a reflection characteristic with respect to an incident angle. As can be seen from the characteristic diagram of the amount of reflected light with respect to the incident angle shown in FIG. 6, when the retroreflecting member 3 is flat, the amount of reflected light obtained when the angle from the reflecting member exceeds 45 degrees decreases. However, when there is a shield, the change cannot be sufficiently taken.

  The amount of reflected light is determined by the light amount distribution (illumination intensity and distance), the reflectance of the reflecting member (incident angle, the width of the reflecting member), and the imaging system illuminance (cosine fourth law). When the amount of light is insufficient, it is conceivable to increase the illumination intensity. However, if the reflection distribution is not uniform, when a strong portion of light is received, the portion may be saturated by the CCD as the light receiving means. There is a limit to increasing the illumination intensity. In other words, it is also possible to increase the amount of light incident on the low light amount portion by making the reflection distribution of the reflecting member as uniform as possible.

  In order to make the angle direction uniform, the member to which the retroreflective member 3 is attached is formed by arranging triangular prisms as shown in FIG. 7, and the retroreflective member 3 is installed thereon. Thereby, the angle characteristic can be improved. Note that the angle of the triangular prism may be determined from the reflection characteristics of the retroreflective member, and the pitch is preferably set to be equal to or lower than the detection resolution of the CCD.

(Explanation of control / arithmetic unit)
A CCD control signal, a CCD clock signal and a CCD output signal, and an LED drive signal are exchanged between the control / arithmetic unit 2 and the sensor units 1L and 1R shown in FIG.

  FIG. 8 is a block diagram showing the configuration of the control / arithmetic unit 2. The CCD control signal is output from an arithmetic control circuit (CPU) 83 composed of a one-chip microcomputer or the like, and performs CCD shutter timing, data output control, and the like. A clock for the CCD is sent from the clock generation circuit 87 to the sensor units 1L and 1R, and is also input to the arithmetic control circuit 83 in order to perform various controls in synchronization with the CCD.

  The LED drive signal is supplied from the arithmetic control circuit 83 to the infrared LEDs of the sensor units 1L and 1R via the LED drive circuits 84L and 84R.

  Detection signals from the CCDs in the detectors of the sensor units 1L and 1R are input to the A / D converters 81L and 81R, and converted into digital values under the control of the arithmetic control circuit 83. The converted digital value is stored in a memory (for example, RAM) 82 and used for angle calculation. When the coordinate value is obtained from the calculated angle, the coordinate value data is output to the host computer 6.

(Explanation of light intensity distribution detection)
FIG. 9 is a timing chart of each control signal related to LED light emission.

  Signals SH, ICGL, and ICGR are control signals for CCD control, and the shutter release time of the CCD is determined by the interval of SH. Signals ICGL and ICGR are gate signals to the left and right sensor units 1L and 1R, respectively, and are signals for transferring the charge of the photoelectric conversion unit in the CCD to the reading unit. Each of the signals LEDL and LEDR is a drive signal for the left and right LEDs, and the drive signal LEDL is supplied to the LEDs through the LED drive circuit in order to light one LED in the first cycle of SH. The other LED is driven in the next cycle. After the driving of both LEDs is completed, the CCD signal is read from the left and right sensors.

  When the signal to be read is not input, a light amount distribution as shown in FIG. 10 is obtained as an output from each sensor. Of course, such a distribution is not necessarily obtained in any system, and the distribution changes depending on the characteristics of the retroreflective member 3, the characteristics of the LED, and changes with time (such as dirt on the reflecting surface). In the figure, the A level is the maximum light amount, and the B level is the lowest level. That is, in a state where there is no reflected light, the level obtained is near B, and the direction of the A level is increased as the amount of reflected light increases. Thus, the data output from the CCD is sequentially AD converted and taken into the CPU as digital data.

  FIG. 11 shows an example of output when input is performed with a finger or the like, that is, when reflected light is blocked. Since the reflected light is blocked by a finger or the like in the portion C, the amount of light is reduced only in that portion. Detection is performed from the change in the light amount distribution. Specifically, an initial state without input as shown in FIG. 10 is stored in advance, and whether there is a change as shown in FIG. 11 in each sample period is detected by a difference from the initial state. An operation for determining an input angle is performed using that portion as an input point.

(Description of angle calculation)
In calculating the angle, it is first necessary to detect the light shielding range. As described above, since the light quantity distribution is not constant due to changes over time, it is desirable to store it at the time of starting up the system. By doing so, for example, even if the retroreflective surface is dirty with dust or the like, it can be used unless it is not completely reflected. Hereinafter, the data of one sensor will be described, but the same processing is performed on the other sensor.

  When the power is turned on, the CCD output is first AD-converted without illumination from the projector in the absence of input, and this is stored in the memory as Bas_data [N]. This is data including variations in the bias of the CCD and the like, and is data near the level B in FIG. Here, N is a pixel number, and a pixel number corresponding to an effective input range is used.

  Next, the light quantity distribution in the state illuminated from the projector is stored. This data is represented by the solid line in FIG. 10 and is Ref_data [N]. Using these data, it is first determined whether an input has been made or whether there is a light shielding range. Data of a certain sample period is assumed to be Norm_data [N].

  First, in order to specify the light shielding range, presence / absence is determined based on the absolute amount of change in data. This is to prevent erroneous determination due to noise or the like and to detect a certain amount of reliable change. The absolute amount of change is calculated for each pixel as follows and compared with a predetermined threshold value Vtha.

  Norm_data_a [N] = Norm_data [N] −Ref_data [N] (1)

  Here, Norm_data_a [N] is an absolute change amount in each pixel.

  Since this process only takes a difference and compares it, it does not use much processing time, and therefore it is possible to determine whether or not there is an input at high speed. When the number of pixels exceeding Vtha for the first time is detected exceeding a predetermined number, it is determined that there is an input.

  Next, in order to detect with higher accuracy, a change ratio is calculated to determine an input point.

  In FIG. 12, reference numeral 121 denotes a retroreflective surface of the reflecting member 3. Here, assuming that the reflectance of the area A has decreased due to dirt or the like, the distribution of Ref_data [N] at this time has a smaller amount of reflected light in the area A as shown in FIG. In this state, if an indicator such as a finger is inserted as shown in FIG. 12 and almost half of the retroreflective member is covered, the amount of reflected light is substantially halved. Therefore, the distribution indicated by the thick line in FIG. Norm_data [N] is observed.

  When Expression (1) is applied to this state, the result is as shown in FIG. Here, the vertical axis represents the differential voltage from the initial state. If a threshold is applied to this data, the original input range may be lost. Of course, it can be detected to some extent if the threshold value is lowered, but it may be affected by noise or the like.

  Therefore, if the ratio of change is calculated, the amount of reflected light is half of the first half in both areas A and B, and therefore the ratio is calculated by the following equation.

  Norm_data_r [N] = Norm_data_a [N] / (Bas_data [N] −Ref_data [N]) (2)

  This calculation result is as shown in FIG. 14B and is represented by a fluctuation ratio. Therefore, even when the reflectance is different, it can be handled equally and detection can be performed with high accuracy.

  The threshold value Vthr is applied to this data, and the angle is obtained from the pixel numbers of the rising and falling portions with the center of both as the input pixel. FIG. 14B is schematically drawn for explanation, and does not actually rise like this, and shows a different level for each pixel.

FIG. 15 shows an example of detection after the ratio calculation is completed. Rising portion of the light shielding region now be detected in the threshold Vthr is to exceed the threshold value in N _r th pixel. Further, the below the Vthr at pixels numbered N _f. The central pixel N _p is
N _p = N _r + (N _f −N _r ) / 2 (3)
However, in this case, the pixel interval becomes the minimum resolution. In order to detect more finely, a virtual pixel number across the threshold is calculated using the level of each pixel and the level of the previous pixel.

Now, _{assume that} the level of Nr is _Lr , and the level of the _Nr- 1th pixel is _Lr-1 . _If the level of N _f is L _f and the level of N _f-1 is L _f-1 , the virtual pixel numbers N _rv and N _fv can be calculated by the following equations.

N _rv = N _r-1 + (Vthr-L _r-1 ) / (L _r -L _r-1 ) (4)
N _fv = N _f-1 + (Vthr-L _f-1 ) / (L _f -L _f-1 ) (5)

The virtual center pixel N _pv is expressed by the following equation.

N _pv = N _rv + (N _fv -N _rv ) / 2 (6)

  Thus, by calculating a virtual pixel number from the pixel number and its level, detection with higher resolution can be performed.

  In order to calculate an actual coordinate value from the obtained center pixel number, it is necessary to convert it into angle information. In actual coordinate calculation described later, it is more convenient to obtain the value of the tangent at the angle rather than the angle itself. A table reference or a conversion formula is used for conversion from the pixel number to tan θ.

  FIG. 16 is a plot of tan θ values against pixel numbers. An approximate expression is obtained for this data, and pixel number and tan θ conversion is performed using the approximate expression. For example, when a high-order polynomial is used as the conversion formula, the accuracy can be ensured, but the order and the like may be determined in consideration of the calculation capability and accuracy specifications.

  When a fifth order polynomial is used, six coefficients are required, so this data may be stored in a nonvolatile memory or the like at the time of shipment.

  If the coefficients of the fifth-order polynomial are now L5, L4, L3, L2, L1, and L0, tanθ is expressed by the following equation.

  tanθ = (L5 * Npr + L4) * Npr + L3) * Npr + L2) * Npr + L1) * Npr + L0 (7)

  If the same thing is done for each sensor, the respective angle data can be determined. Of course, in the above example, tan θ is obtained, but the angle itself may be obtained, and then tan θ may be obtained.

(Explanation of coordinate calculation method)
Coordinates are calculated from the obtained angle data.

  FIG. 17 is a diagram illustrating a positional relationship with the screen coordinates. Each sensor unit is mounted on the left and right sides of the input range, and the distance between them is represented by Ds.

  The center of the screen is the origin position of the screen, and P0 is the intersection of the angle 0 of each sensor unit. The respective angles are θL and θR, and tanθL and tanθR are calculated using the above polynomials. At this time, the x and y coordinates of the point P are expressed by the following equations.

x = Ds / 2 * (tanθL + tanθR) / (1+ (tanθL * tanθR)) (8)
y = −Ds / 2 * (tan θR−tan θL− (2 * tan θL * tan θR)) / (1+ (tan θL * tan θR)) + P0Y (9)

  FIG. 18 is a flowchart showing steps from data acquisition to coordinate calculation.

  First, when the power is turned on in step S101, various initializations such as port setting and timer setting of the arithmetic control circuit 83 and the like are performed in step S102. Step S103 is a preparation for removing unnecessary charges performed only at startup. In a photoelectric conversion element such as a CCD, unnecessary charge may be accumulated when it is not operated. If the data is used as it is as reference data, it becomes impossible to detect or causes false detection. In order to avoid this, data is first read multiple times without illumination. In step S103, the number of times of reading is set. In step S104, unnecessary data is removed by reading data a predetermined number of times without illumination.

  Step S105 is a determination sentence for repeating a predetermined number of times.

  Step S106 is fetching data without illumination as reference data, and corresponds to Bas_data. The data fetched here is stored in the memory (step S107) and used for the calculation thereafter. This and another reference data, that is, data Ref_data corresponding to the initial light amount distribution when illuminated is captured (step S108), and is also stored in the memory (step S109). Up to this step is the initial setting operation when the power is turned on, and then the normal capturing operation is performed.

  In step S110, the light amount distribution is captured as described above, and in step S111, the presence / absence of a light-shielding portion is determined based on the difference value from Ref_data. If it is determined that there is not, the process returns to step S110 and the capture is performed again.

  At this time, if the repetition period is set to about 10 [msec], the sampling rate is 100 times / second.

  If it is determined in step S112 that there is a light-shielding region, the ratio is calculated in step S113 by the processing of equation (2). A rising portion and a falling portion are determined by a threshold with respect to the obtained ratio, and the center is calculated by the equations (4), (5), and (6) (step S114). From the obtained central value, tan θ is calculated from an approximate polynomial (step S115), and x and y coordinates are calculated from the tan θ values of the left and right sensor units using equations (8) and (9) (step S116).

  Next, in step S117, it is determined whether or not it has been touched. For example, a proximity input state in which the cursor is moved without pressing a mouse button and a touch-down state in which the left button is pressed are determined. Actually, if the maximum value of the ratio obtained previously exceeds a certain predetermined value, for example, 0.5, it is determined that the input is in the proximity input state. According to this result, the down flag is set (step S118) or reset (step S119).

  Since the coordinate value and the down state are determined, the data is transmitted to the host computer 6 (step S120). In the host computer 6, the driver interprets the received data, and moves the cursor, changes the mouse button state, etc. with reference to the coordinate values, flags, and the like.

  When the process of step S120 is completed, the process returns to the operation of step S110, and thereafter this process is repeated until the power is turned off.

(Explanation of coordinate input pen)
In the coordinate input device according to the present embodiment, input with a finger is possible. However, by performing input with a pointing tool such as a pen, operations corresponding to various buttons of the mouse can be intuitively operated. . A coordinate input pen (hereinafter also referred to as “indicator”) 4 according to the present embodiment will be described with reference to FIG.

  The pointing tool 4 in this embodiment includes a pen tip switch (SW) 41 that operates by pressing a pen tip that is a writing tool, and a plurality of pen side switches (SW) provided on the casing of the pointing tool 4. 42). When any one of these switches is operated, a signal is transmitted from the pointing device 4 at a predetermined cycle. Specifically, the drive circuit 45 emits an optical signal that is a timing signal and a command signal every predetermined period.

  The optical signal is received by the control signal detection circuit 86 (see FIG. 8). The control signal detection circuit 86 determines which switch of the indicator 4 is operating based on the received optical signal. At the same time, the exchange of the CCD control signal, the CCD clock signal, and the LED drive signal is started between the sensor units 1L and 1R. Specifically, a signal indicating switch information is superimposed on an optical signal emitted by the pointing device 4 as a timing signal (in addition, an identification code for identifying a coordinate input pen or the like can be superimposed). However, a method for transmitting the information includes, for example, first outputting a header part consisting of a reader part consisting of a continuous pulse train and a code (such as a manufacturer ID) followed by a control signal such as a pen switch signal. The transmission data string is sequentially output according to a predefined order and format. This method is a well-known method (for example, a remote control using infrared rays) and will not be described in detail here.

  As another method, for example, it is also possible to change the predetermined period of this type of coordinate input device that performs coordinate detection every predetermined period and to detect the information by detecting the information. If the coordinate input device is designed to detect coordinates at a maximum of 100 points / second, that is, every 10 msec, when the pen tip SW 41 is operating, for example, coordinates are calculated at 100 points / second, and the pen side SW 42 is When operating, setting is made so that coordinates are calculated at 80 points / second, that is, the signal is emitted from the indicator 4 at each cycle, and the cycle is monitored by the control signal detection circuit 86. Thus, it is possible to determine which switch is operating.

(Explanation of coordinate input pen up / down)
Next, pen / up / down will be described with reference to the flowchart of FIG.

  First, in step S402, the state of the pen tip switch 41 is determined. When the pen tip switch 41 is in the ON state, the coordinate input pen is positioned on the input area 5, the coordinate input is performed by the operator, and the handwriting input is attempted ("pen down" state). The handwriting displayed on is reproduced faithfully with respect to the writing operation by the operator. Also, for example, when the pen tip switch is operated twice within a predetermined time, the time at which the signal is received, the interval, the timing at which the coordinates are calculated, etc. are monitored while referring to the coordinate sampling rate of the coordinate input device. Thus, it is configured to recognize the double click operation of the mouse.

  On the other hand, if the pen tip switch is not operating (OFF state) in step S402, the state of the pen side switch is determined in steps S403 to S405. In this embodiment, the indicator 4 is provided with two side switches 42, pen side switches 42a and 42b. If only one of them is in the ON state, the “pen up” state, If it is in the ON state, it operates as a “pen down” state.

  As described above, when the pen tip switch 41 is in the OFF state and at least one of the side switches 42a or 42b is in the operating state (ON state), the screen is located at a position where the operator floats from the input area 5. This is a case where, for example, the cursor is moved to a desired position or a handwriting is to be input at a floating position (hereinafter, this input state is referred to as “proximity input”). Specifically, in the pen-up state in which only one of the side switches 42a and 42b is operating, the operator can move the cursor shown on the screen, and both of them are operating. In the pen-down state, the movement locus of the pointing tool 4 can be displayed as a handwriting in the manner described later. To realize this, the coordinate input device is configured to be able to simultaneously output the pen state (pen-up, pen-down) as information when calculating the coordinates. Based on this information, the host computer The desired operation can be realized by the control software or application software stored in 6.

  In addition, the distinction between “one side switch” and “both side switches” is the result of considering the dominant arm. That is, as shown in FIG. 19, the side switch 42 of the coordinate input pen is arranged symmetrically and adjacent to the symmetry axis of the pointing device 4, so that the same operation can be performed without distinguishing between right-handed and left-handed. In this way, the same effect can be obtained. As another embodiment of the side switch, a two-stage switch, that is, a switch in which the first-stage switch is operated by pressing the key top of the switch and the second-stage switch is operated by further pressing is used. Thus, the same effect can be obtained.

  The state in which at least one of the switches of the indicator 4 is operating is a state where coordinates are always calculated at a predetermined cycle, that is, a signal is emitted from the indicator 4 at a predetermined cycle. Therefore, depending on whether or not the optical signal as the timing signal can be detected every predetermined period, whether the coordinate is input continuously or continuously from the state where the first coordinate is detected, It is possible to determine whether the state where the coordinate input is continuously performed is in the interrupted state. That is, by monitoring the generation timing of the start signal of the control signal detection circuit 86 (if the coordinate sampling rate is 100 times / second, a start signal is generated every 0.01 seconds), it is in a “continuous input” state. Determine whether or not.

  Furthermore, as means for determining “continuous input”, a predetermined time is set, and a signal (for example, an optical signal that is a start signal in the present embodiment) is detected within the predetermined time. Alternatively, it may be determined whether a coordinate value is detected.

  As described above, the control signal detection circuit 86 performs “determination of continuous input state”, “determination of switch operation state”, “determination of pen-up / down”, and the like based on the above-described method. Is output to the arithmetic control circuit 83.

(Coordinate value processing example 1)
Now, the processing mode of the detected coordinate value and its operation and effect will be described in detail.

  First, the flow of the coordinate value processing method will be described with reference to FIG.

  In step S502, it waits for the coordinate detection of the position of the pointing tool 4 to be performed. As described above, the coordinate detection is performed when any switch of the pointing tool 4 is in an operating state. When the coordinate value is detected, the process proceeds to step S503, and it is determined whether or not the pen-down state is established based on the output signal of the control signal detection circuit 86 described above. As described above, the pen-down state is determined when the pen tip SW 41 of the pointing tool 4 is in the operating state, or when both the side switches 42a and 42b are in the operating state. If the pen-down state is determined here, the value of the flag (Flag) is referred to in Step S504. If the flag value is Flag = 0, the flag value is set to Flag = 1 (Step S505). ), And the detected coordinate value is stored as a reference coordinate value (step S506).

  In step S507, a difference value between the detected coordinate value and the reference coordinate value is calculated. For example, the display device is controlled so as to move the cursor displayed on the display device by an amount corresponding to the calculated difference value. To that host computer. In step S508, it is determined whether or not the continuous input state is established by the method described above. While the coordinate detection is continuously performed, the difference value between the set reference coordinate value and the detected coordinate value is continuously output. When the continuous coordinate detection is interrupted, the process is terminated (step S513). ) Until the next coordinate detection is performed (step S502).

  When the continuous coordinate detection is interrupted and the coordinate detection of the pointing tool 4 is performed again in step S502, it is similarly checked in step S503 whether the pen is in the pen-down state. If in the pen-down state, the flag is set in step S504. In the above description, the flag is set to Flag = 1 in the previous “at the time of detecting a series of consecutive coordinates” in step S505. Step S506) is not performed, and a difference value is output while continuous coordinate detection is performed by the loop of Step S507 and Step 508 using the held reference coordinate value. During the processing in the pen-down state as described above, the handwriting is displayed on the display device as the pointing tool 4 moves.

  When the continuous input is interrupted, the coordinate detection state of the pointing device 4 is again waited in step S502. However, if the coordinate value is detected and it is determined that the pen-up state is determined instead of the pen-down state in step S503, the step is performed. The process proceeds to S509. In step S509, the flag is set to Flag = 0 which is an initial state, the detected coordinate value is set and updated as the reference coordinate, and the coordinate value is continuously detected in the loop of step S511 and step S512. During this time, a difference value (that is, a relative coordinate value) between the set reference coordinate value and the detected coordinate value is output. During processing in the pen-up state as described above, the position of the cursor displayed on the display device can be moved with the movement of the pointing tool 4.

  Next, the effect of adopting such a coordinate value processing method will be described with reference to FIG.

  FIG. 22 illustrates an example of an operation for moving the cursor and its operation. The cursor displayed by the display device is at the position (1), and the cursor is moved to the position (3) according to the operator's intention. It is explanatory drawing when it is going to move to. First, the operator moves the pointing tool 4 to the position A, and at that time, only the pen side SW 42a or 42b is turned on to enter the pen-up state. At this time, since the pen tip SW41 is not in the operating state, the flag is set to Flag = 0 in step S509, and the position coordinate of the pointing tool 4 is stored as the reference coordinate in step S510 (at this time, the cursor position is (1) remains, not moved yet). Here, when the operator moves the pointing tool 4 to the position B while maintaining the pen-up state, the cursor moves according to the moving direction and the moving distance of the pointing tool 4 by the loop of steps S511 and S512. For example, it moves to the position (2). When the penside SW 42 is turned off when the pointing tool 4 reaches the position B, the “continuous” coordinate detection is completed at this point, and a coordinate detection standby state is entered in step S502.

  At this time, if the operator returns the indicator 4 from the position B to the position A with all the switches of the indicator 4 turned OFF, the coordinate detection is not performed at this time, and the cursor moves at the position (2). Absent. Thereafter, when the operator again enters the pen-up state by turning on only one of the pen side SWs 42 (42a or 42b) in the vicinity of the position A, the continuous input state is started, and is first detected in step S510. The absolute coordinate value is newly updated and stored as the reference coordinate. Thereafter, when the operator further moves the pointing tool 4 from the position to the position B in the pen-up state, the cursor moves from the position (2) to the position (3).

  According to such an operation, a large movement of the cursor on the screen can be realized on the spot without obstructing the line of sight of the listener. In this way, the offset amount when displaying the image of the movement locus of the pointing tool 4 is set by a simple operation of the pointing tool 4.

  FIG. 23 is a diagram for explaining an operation example for displaying the handwriting of the pointing tool 4 and its operation. First, it is assumed that the operator has moved the cursor to a desired position (3) by the method described in FIG. At this time, the flag value is set to Flag = 0 as described above. Thereafter, when the operator places the pointing tool 4 on the input area 5 at the desired position C and turns on the pen tip SW41 to enter the pen-down state, coordinate detection is performed accordingly (step S502). ). Since the flag is currently 0, the flag is set to Flag = 1 in step S505, and the detected coordinate value is stored as the reference coordinate in step S506 (at this time, the cursor is positioned at the position (3)). Does not move). When the operator moves the indicator 4 to the position D while abutting on the input area 5 (that is, while maintaining the pen-down state), the detected coordinate value and the reference coordinate value are continuously detected in steps S507 and S508. Difference value (that is, relative coordinate value) is output, the movement direction and movement distance of the indicator 4 are faithfully reproduced, and the cursor moves from the position (3) to the position (4). A trajectory is displayed. When the operator stops the contact of the pointing tool 4 at the position D (that is, the pen tip SW 41 is turned off), the continuous detection is interrupted, so that the coordinate detection standby state is entered (step S502), and the pointing tool 4 is positioned. Even if the cursor moves to E, the cursor does not move from the position (4).

  Subsequently, when the operator places the pointing tool 4 in position E at the position E to bring the pointing tool 4 into contact with the input area 5 and operates the pen tip SW 41 to enter the pen-down state, the process goes through steps S502 and S503, and then in step S504. A flag is determined. In this case, since the flag is set to Flag = 1 in the previous continuous coordinate detection operation, the reference coordinates are not updated, and the reference coordinates stored at the time of the previous continuous coordinate detection are used to perform steps S507 and S507. The loop of S508 is repeated. Since the reference coordinates are the coordinate values set in the previous continuous coordinate input operation, that is, the coordinate values detected when the position of the pointing tool 4 is at the position C, the reference coordinates are when the position of the pointing tool 4 is at the position E. The difference between the coordinate value detected at that time and the coordinate value (reference coordinate value) when the position of the pointing tool 4 is at position C is output, and the cursor is moved from position (4) to position ( 5).

  Thereafter, when the operator moves to the position F while keeping the pointing tool 4 in contact (with the pen down state), the cursor faithfully reproduces the moving direction and the moving distance of the pointing tool 4, and the position of (5) To the position of (6), and the locus is displayed.

  In the description of FIG. 23, the position (3) (current cursor position) where information such as characters is desired to be added is easily set according to the operator's intention as described with reference to FIG. After that, information is input by operating the pointing tool 4, but the operating position C of the pointing tool 4 may be an arbitrary position, which is markedly different from an apparatus in which the offset amount shown in the conventional example must be set. The operability is improved. That is, as shown in FIG. 23, the addition of the character “I” to the desired position on the right side of the screen can be realized by, for example, an operation at an arbitrary position on the left side of the screen, and thus does not block the viewer's line of sight. Further, by operating in a region closer to the position where information should be added (for example, the center of the screen in FIG. 23), the operator can more easily view the input information, and the optical path of the display device can be changed by the operator's hand or the like. Even in the case of being blocked, it is possible to unconsciously set the positional relationship between the information addition position (3) and the operation position C, so that a favorable operation environment can be realized.

  Furthermore, the position (3) matches the operation position C, that is, the cursor is moved to a position where information is to be added and displayed, and the pointing tool 4 is brought into contact with the input area 5 at the cursor position (the pen tip SW 41 operates). ), The coordinate input device (as shown in the conventional example) (the absolute position coordinate of the pointing tool 4 is detected and the absolute coordinate value is output, so that the operator can move to the indicated position of the pointing tool 4. Workability equivalent to that of a cursor always exists. This equivalent workability plays an important role depending on the application because a series of operations of the pointing tool 4 is performed while only the pen tip SW is operated. In other words, when the present invention is applied to a rear projector, a PDP, etc., there is no problem that the display information cannot be visually recognized by the operator due to the light path being cut off by the operator. This is an important advantage. However, if it is an absolute input-only function, since the display information is blocked by the operator's body etc. for the listener (participant) watching it, the information is input relatively as in the present invention. The operability that can be played also plays an important role. Therefore, not only a system using a front projector or the like but also a system using a rear projector and a PDP display device can provide an operating environment with excellent operability according to the present invention.

  The switch operation performed by the operator is an operation of only the pen tip SW 41 or the pen side SW 42 for executing the coordinate detection operation, and does not require a special switch operation for realizing the operability. In other words, there is no switch operation for setting offsets, as in conventional examples, no restrictions on the coordinate input area (operation area), etc., and no skill or skill to master the device is required. It has the excellent advantage that it can be operated.

(Coordinate value processing example 2)
In the coordinate value processing example described above, the cursor is moved to a desired position by a simple operation of the pointing tool 4, and information input (drawing of a locus by relative coordinates) from that position is easily performed. It was a thing. In such a process, in order to further improve the operability, it is also a preferred embodiment that the actual movement locus (trajectory based on absolute coordinates) of the pointing tool 4 can be displayed simultaneously.

  Such processing can be basically realized according to the flow of FIG. 21 described above. However, in this case, since the trajectory based on the absolute coordinates and the trajectory based on the relative coordinates are drawn simultaneously, it is necessary to always obtain the absolute coordinates and the relative coordinates for the coordinates detected during the processing. Specifically, absolute coordinate values are detected in steps S502, S508, and S512 of FIG. 21, and a difference value between the reference coordinate value and the detected absolute coordinate value is calculated as a relative coordinate value in step S507 or step S511. The absolute coordinate value and the relative coordinate value are output to, for example, a host computer that controls the display device. That is, in the continuous coordinate detection by the loop of steps S507 and S508 or the loop of steps S511 and S512, the absolute coordinate value and the relative coordinate value are output.

  In this case, in the above-described scene of FIG. 23, when the operator moves the pointing tool 4 from the position C to D while contacting the input area 5, the absolute coordinate value and the relative value are continuously displayed in steps S507 and S508. A coordinate value (that is, a difference value between the absolute coordinate value and the reference coordinate value) is output. At this time, the host computer for image control, for example, which receives the coordinate value, displays the locus (the broken line from position C to D in FIG. 23) on the display device based on the change of the absolute coordinate value accompanying the movement of the pointing tool 4. And the movement locus (from (3) in FIG. 23 to (3) in FIG. 23) based on the change of the relative coordinate value accompanying the movement of the pointing tool 4 and the cursor position on the display device. It operates so as to display the trajectory indicated by the solid line up to 4). That is, both the trajectory where the pointing tool 4 has actually moved and the similar trajectory starting from the current cursor position are displayed on the display device. By the same processing, the movement locus from the position E to F is also displayed on the display device.

  In this way, since the information input by the operator (the trajectory indicated by the broken line in FIG. 23) is also displayed on the display screen, it is not necessary for the operator to perform input work while looking at the position intended for input. For example, it is possible to provide excellent operability that allows easy input of, for example, fine characters while visually checking the locus of the pointing tool 4.

  By the way, what the operator intended is trajectory information starting from a desired cursor position. The trajectory of the pointing device 4 (the trajectory based on absolute coordinates) that improves the operability of the operator certainly plays an important role as information for improving the operability for the operator. It is also unnecessary information for many audiences watching the display device.

  Therefore, the trajectory based on the absolute coordinates is preferably deleted after a predetermined time has elapsed after drawing.

  Alternatively, it is preferable to delete a locus based on absolute coordinates by using separately provided switch means. This switch means may be, for example, a switch provided in the vicinity of the display area, or when a predetermined area of the coordinate input effective area is assigned as a switch and, for example, the coordinate value of that area is detected, absolute coordinates are detected. You may make it delete the locus | trajectory based on.

  Alternatively, as the reference coordinates are set in steps S505 and S506 in FIG. 21, the trajectory based on the absolute coordinates may be deleted. This is because the reference coordinate values that are always set are the same when fine characters are input in a series of operations, and the trajectory information based on the absolute coordinates between them is important for the operator. A series of character input operations, for example, is completed (that is, in FIG. 21, for example, coordinate input is performed in a state where the pen tip SW is OFF in step S503, and the operation proceeds from step S509 to step S512). In this case, the trajectory information based on the absolute coordinates input so far is also unnecessary information for the operator. Therefore, by detecting the end of the series of character input operations described above when the reference coordinate value is updated, it is possible to automatically delete the locus based on the absolute coordinate value that is no longer necessary. is there.

(Explanation of coordinate value output form and display form)
In the above configuration, in order to enable input with better operability, the coordinate value output mode and the display mode on the display device may be configured as follows. This will be described with reference to FIG.

  FIG. 24 is a schematic explanatory diagram when the display content of a predetermined area including trajectory information that is relative coordinates is displayed in association with the area input by the operator. That is, in the above-described example, the operator can actually input the region A while viewing the trajectory information displayed in the region B. However, by displaying the display contents of the region B in the region A, The operability can be greatly improved. As described above, the locus based on the relative coordinates is performed starting from the position of the cursor. For example, the display information of the peripheral area at the current cursor position is displayed with the position where the pointing tool 4 is in contact as the center. Thereby, the display information of the area where the locus is actually desired can be traced in the area where the pointing tool 4 is operated.

  In this way, by tracing the display information of the area B in the area A and displaying the trajectory information a (absolute coordinates), the movement of the line of sight of the operator can be minimized, and workability is improved. Can do.

  This mode is preferably configured so that it can be arbitrarily started by an operator operating a switch or image information (icon) (not shown). For example, the mode may be changed by pressing the pen tip switch 41 against the input surface and turning it on while pressing all the pen side switches 42 of the pointing tool 4. Furthermore, as described above, when the trajectory information based on the absolute coordinates is deleted, the display information of the area A may be deleted at the same time, or the reference coordinates are set in step S506 as described above. This mode may be terminated when / update is performed.

  In the form of coordinate output in each area of FIG. 24, the reference coordinate value is fixed in area A. That is, when the operator inputs a trajectory a in area A, the display of trajectory a is displayed according to the output of absolute coordinates. The trajectory b displayed on B is displayed as a relative coordinate trajectory corresponding to the previous reference coordinate value. Here, the area A is a copy of the display data of the area B, and the same image data as the display data of the area B is displayed in the area A.

  The display data of the area A may be transparent so that the original image can be recognized as the background, or may be reduced with respect to the area B, and is configured so that the operator can select as appropriate.

  The trajectory image based on the absolute coordinates and the trajectory image based on the relative coordinates do not have to be the same, may be similar to each other, and a configuration may be provided in which the enlargement ratio of at least one of the both trajectory images can be set. When such an enlargement ratio is set, the window and transmissive area of area A are enlarged and reduced according to the enlargement ratio and displayed.

  Thus, by displaying the display data in association with the absolute coordinates and the relative coordinates, the workability of the operator can be improved.

  By the way, the display size and position of the area A input by the operator may be a predetermined area centered on the writing position (reference point), or only the window including the writing position (reference point) may be displayed. . The display may be displayed only when the command is changed (pop-up), or a fixed window for the operator to input in absolute coordinates may be displayed.

  In order to realize the above, the CPU 83 outputs both absolute coordinates and relative coordinates simultaneously. In addition, image data in the vicinity of relative coordinates is captured and stored as image data, image data is processed in association with absolute coordinates, and display data is transmitted to the host computer 6.

  The coordinate input device 8 that processes the detected coordinate values and outputs the coordinate values has been described above. However, this coordinate value processing may be executed inside the coordinate input device 8 as described above. You may comprise so that the host computer 6 which received the coordinate value which the input device 8 detected may be performed.

  FIG. 25 is a diagram illustrating an example of the flow of coordinate values and image signals between devices of the presentation system in the embodiment.

  First, FIG. 1A is a conceptual diagram when the coordinate input device 8 is configured to output both absolute coordinates and relative coordinates to the host computer 6. In this case, the coordinate data from the coordinate input device 8 is processed by the application of the host computer 6, and the image data is correlated from both the absolute coordinates and the relative coordinates (the display of the indicator track by the absolute coordinates and the indication by the relative coordinates). The display device (projector) 7 displays the image by performing processing such as determining the region).

  Next, FIG. 2B shows that only relative coordinates are output to the host computer 6, and the absolute coordinates are transmitted to the display device 7 via an image processing unit (for example, realized by the control / arithmetic unit 2). It is a conceptual diagram at the time of comprising. In this case, the relative coordinates are input to the host computer 6 and the absolute coordinates are input to the image processing unit (control / arithmetic unit 2). The image processing unit (control / arithmetic unit 2) processes the absolute and relative coordinates and the RGB signal output from the host computer 6, captures image data corresponding to the relative coordinates, and corresponds to the absolute coordinates. Display in position. The image data output from the image processing unit is different in hierarchy from the image displayed from the RGB signal output from the host computer 6, and is the same as a so-called OSD (on-screen display) that displays an adjustment menu of the display device 7 and the like. By using a hierarchy, it is possible to display an image independent of the image from the host computer 6. By doing so, the host computer 6 need only process relative coordinates, and can be operated without installing a special application.

(Other embodiments)
As mentioned above, although embodiment of this invention was explained in full detail, this invention may be applied to the system comprised from several apparatuses, and may be applied to the apparatus which consists of one apparatus.

  In the present invention, a software program that realizes the functions of the above-described embodiments is directly or remotely supplied to a system or apparatus, and the computer of the system or apparatus reads and executes the supplied program code. Is also achieved. In that case, as long as it has the function of a program, the form does not need to be a program.

  Therefore, in order to realize the functional processing of the present invention with a computer, the program code itself installed in the computer and the storage medium storing the program also constitute the present invention. In other words, the claims of the present invention include the computer program itself for realizing the functional processing of the present invention and a storage medium storing the program.

  In this case, the program may be in any form as long as it has a program function, such as an object code, a program executed by an interpreter, or script data supplied to the OS.

  As a storage medium for supplying the program, for example, flexible disk, hard disk, optical disk, magneto-optical disk, MO, CD-ROM, CD-R, CD-RW, magnetic tape, nonvolatile memory card, ROM, DVD (DVD-ROM, DVD-R).

  As another program supply method, a client computer browser is used to connect to an Internet homepage, and the computer program of the present invention itself or a compressed file including an automatic installation function is downloaded from the homepage to a storage medium such as a hard disk. Can also be supplied. It can also be realized by dividing the program code constituting the program of the present invention into a plurality of files and downloading each file from a different homepage. That is, a WWW server that allows a plurality of users to download a program file for realizing the functional processing of the present invention on a computer is also included in the claims of the present invention.

  In addition, the program of the present invention is encrypted, stored in a storage medium such as a CD-ROM, distributed to users, and key information for decryption is downloaded from a homepage via the Internet to users who have cleared predetermined conditions. It is also possible to execute the encrypted program by using the key information and install the program on a computer.

  In addition to the functions of the above-described embodiments being realized by the computer executing the read program, the OS running on the computer based on the instruction of the program is a part of the actual processing. Alternatively, the functions of the above-described embodiment can be realized by performing all of the processes.

  Furthermore, after the program read from the storage medium is written to a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, the function expansion board or The CPU or the like provided in the function expansion unit performs part or all of the actual processing, and the functions of the above-described embodiments are realized by the processing.

It is a figure which shows schematic structure of the presentation system in embodiment. It is a figure explaining the function of the reflector in an embodiment. It is a figure which shows the structure of the light projector in embodiment. It is a figure which shows the structure of the light receiver in embodiment. It is a figure which shows the structure of the sensor unit in embodiment. It is a figure which shows the example of a characteristic of the reflected light quantity with respect to an incident angle. It is a figure which shows the structural example of the attachment member of the retroreflection member in embodiment. It is a block diagram which shows the structure of the control and arithmetic unit in embodiment. It is a timing chart of the signal which concerns on LED light emission in embodiment. It is a figure which shows an example of the light quantity distribution of the sensor unit output in embodiment. It is a figure which shows an example of light quantity distribution of the sensor unit output when input is performed with a finger | toe etc. FIG. It is a figure for demonstrating the angle calculation in embodiment. It is explanatory drawing about a light quantity change. It is explanatory drawing of a light quantity change amount and a light quantity change rate. It is a figure which shows the example of a detection of the light-shielding range. It is the figure obtained by plotting tan (theta) value with respect to a pixel number. It is explanatory drawing of the coordinate calculation in embodiment. It is a flowchart which shows the process from the data acquisition in embodiment to coordinate calculation. It is a figure which shows the structure of the indicator in embodiment. It is a flowchart which shows the setting process of a pen up / down in embodiment. It is a flowchart which shows the coordinate value process in embodiment. It is a figure explaining the example of operation which concerns on the cursor movement in the coordinate input device of embodiment, and its effect | action. It is a figure explaining the operation example which concerns on the handwriting input in the coordinate input device of embodiment, and its effect | action. It is a figure explaining the output form and display form of the coordinate value in embodiment. It is a conceptual diagram which shows the example of cooperation with the coordinate input device in embodiment, and an external computer apparatus.

Claims (8)

A presentation system configured to detect a movement locus when an instruction means is moved in an input area provided on an image display surface, and to display an image of the movement locus,
Means for setting an offset amount when displaying an image of the movement locus according to an operation of the instruction means;
The first trajectory image corresponding to the movement trajectory is displayed at a position offset by the set offset amount on the display surface, and the second trajectory image corresponding to the movement trajectory is displayed at a position that is not offset. And means for displaying
Means for displaying a copy image of an image in a partial area on the display surface and including a start position of the first trajectory image at a start position of the second trajectory image;
A presentation system comprising:   The presentation system according to claim 1, further comprising means for deleting the second trajectory image while leaving the displayed first trajectory image.   The presentation system according to claim 1, further comprising means for setting a scale between the first and second trajectory images. Means for setting a scale between the first and second trajectory images;
Means for displaying the copy image at the start position of the second trajectory image according to the set scale;
The presentation system according to claim 1, further comprising: Presentation system according to claim 1 or 2, wherein the copied image is characterized by a transmissive display. A control method of a presentation system configured to detect a movement locus when an instruction means is moved in an input area provided on an image display surface and to display an image of the movement locus,
A setting step of setting an offset amount when displaying the image of the movement locus according to an operation of the instruction unit;
The first trajectory image corresponding to the movement trajectory is displayed at a position offset by the set offset amount on the display surface, and the second trajectory image corresponding to the movement trajectory is displayed at a position not offset. A first display step that also displays,
A second display step of displaying a copy image of an image in a partial area on the display surface and including a start position of the first trajectory image at a start position of the second trajectory image ; A method for controlling a presentation system, comprising: The computer executes the control method of the presentation system configured to detect the movement locus when the pointing means is moved in the input area provided on the image display surface and display the image of the movement locus. A program for causing the computer to
A setting step of setting an offset amount when displaying the image of the movement locus according to an operation of the instruction unit;
The first trajectory image corresponding to the movement trajectory is displayed at a position offset by the set offset amount on the display surface, and the second trajectory image corresponding to the movement trajectory is displayed at a position that is not offset. A first display step that also displays,
A second display step of displaying a copy image of an image in a partial area on the display surface and including a start position of the first trajectory image at a start position of the second trajectory image ; The program to be executed. A computer-readable storage medium storing the program according to claim 7 .

Images