JP6682768B2 - Display system, display device, information processing device, and control method - Google Patents

Description

  The present invention relates to control of display of an image object in a display system that performs different processing in a first mode and a second mode.

  2. Description of the Related Art There is known a display device that displays an image corresponding to a position designated by a pointer on a display surface. For example, Patent Document 1 describes a projector that projects an image corresponding to a position designated by a pointer (finger or pen device) onto an image supplied from a video supply device (PC) in an overlapping manner. In Patent Document 1, the projector projects a toolbar image for performing an operation of designating an operation mode on a projection surface.

JP, 2011-203830, A

  In the technique described in Patent Document 1, when the image supplied from the video supply device to the projector includes an image object such as a toolbar image for changing the attribute of the image according to the trajectory of the pointer, the image is displayed on the projection surface. Will display both the toolbar image of the video supply device and the toolbar image of the projector, which may be confusing for the user operating on the projection surface.

  The present invention provides a technique for preventing a plurality of image objects from being displayed on the display surface when the operation mode is switched in a display system that performs different processing in the first mode and the second mode.

The present invention includes a display device and an information processing device, wherein the display device displays a screen according to a video signal supplied from the information processing device on a display surface, and an instruction on the display surface. A detection unit that detects the position of the body, and a line for changing the attribute of the line, which corresponds to the locus of the position of the indicator detected by the detection unit when the operation mode is the first mode. When the first drawing means for drawing one image object on the display surface and the operation mode are the second mode, information indicating the position of the indicator detected by the detecting means is transmitted to the information processing device. The information processing apparatus further includes a first transmitting unit and a second transmitting unit that transmits an instruction for switching the operation mode to the information processing device when an input of an instruction for switching the operation mode is accepted. The processing device includes a second drawing means for drawing a screen including a line corresponding to a locus of a position included in the information transmitted from the display device and a second image object for changing an attribute of the line, and A supply means for supplying a video signal for displaying a screen on the display device to the display device and a command for switching the operation mode from the second mode to the first mode are received from the display device. In this case, a display system having an erasing means for erasing the second image object from the screen is provided.
According to this display system, it is possible to prevent the user from being confused by displaying both the first image object and the second image object on the display surface when the operation mode is switched from the second mode to the first mode.

In a preferred aspect, the display device includes a first storage unit that stores information indicating a position of the second image object on the screen, and the display unit changes the operation mode from the second mode to the first mode. When the input of the instruction to switch to the mode is accepted, the first image object is displayed at the position indicated by the information stored in the first storage unit of the screen.
According to this display system, the position of the displayed image object is prevented from changing when the operation mode is switched from the second mode to the first mode.

In another preferable aspect, the information processing apparatus includes a third transmitting unit that transmits information indicating the changed position to the display device when an input of an instruction to change the position of the second image object is received. It is characterized by having.
According to this display system, even when the position of the second image object is changed, the first image object is displayed at the changed position.

In another preferable aspect, the display device includes a second storage unit that stores the attribute for each of the plurality of indicators, and the detection unit detects the positions of the plurality of indicators and the first storage unit detects the positions of the plurality of indicators. The drawing unit draws a line of the attribute stored in the second storage unit for the indicator whose position is detected by the detection unit, and the information processing device stores the attribute for each of the plurality of indicators. And a synchronization unit that synchronizes the attribute stored in the second storage unit with the attribute stored in the third storage unit, and the second drawing unit uses the detection unit. It is characterized in that a line of the attribute stored in the third storage means is drawn for the indicator whose position is detected.
According to this display system, the operation of changing the line attribute performed before the operation mode is changed is reflected even after the operation mode is changed.

Further, according to the present invention, a display means for displaying a screen according to a video signal supplied from the information processing device on a display surface, a detection means for detecting a position of an indicator on the display surface, and an operation mode in a first mode. And a line according to the locus of the position of the indicator detected by the detection unit, and a drawing unit that draws a first image object for changing the attribute of the line on the display surface; When the mode is the second mode, the first transmission unit that transmits the information indicating the position of the indicator detected by the detection unit to the information processing device, and the input of the instruction to switch the operation mode are accepted. In this case, the display device further includes a second transmission unit that transmits a command for switching the operation mode to the information processing device, and the display unit is configured to display the operation mode when the operation mode is the second mode. Displaying the screen including a second image object for changing the line attribute, and displaying the screen not including the second image object when the operation mode is the first mode. A characteristic display device is provided.
According to this display device, it is possible to prevent the user from being confused by displaying both the first image object and the second image object on the display surface when the operation mode is switched from the second mode to the first mode.

Further, when the operation mode is the first mode, the present invention includes a line corresponding to the locus of the position of the indicator included in the information transmitted from the display device, and an image object for changing the attribute of the line. When a screen is not drawn and the operation mode is the second mode, drawing means for drawing the screen, and supply means for supplying the display device with a video signal for displaying the screen on the display device. There is provided an information processing device, comprising: an erasing unit that erases the image object from the screen when a command for switching the operation mode from the second mode to the first mode is received from the display device.
According to this information processing device, it is possible to prevent the video signal indicating the screen including the image object from being supplied to the display device when the operation mode is switched from the second mode to the first mode.

The present invention is also a method of controlling a display system having a display device and an information processing device, wherein the display device displays a screen according to a video signal supplied from the information processing device on a display surface. A step of detecting the position of the pointer on the display surface, and a line according to the locus of the detected position of the pointer and an attribute of the line when the operation mode is the first mode Drawing the first image object on the display surface, transmitting the information indicating the detected position of the pointer to the information processing device when the operation mode is the second mode, and the operation And a step of transmitting an instruction for switching the operation mode to the information processing device when an input of an instruction to switch the mode is received, the information processing device comprising: Drawing a screen including a line corresponding to the locus of the position included in the information transmitted from the display device and a second image object for changing the attribute of the line, and setting the operation mode to the second mode. To a command to switch to the first mode from the display device, the step of erasing the second image object from the screen is provided.
According to this control method, it is possible to prevent the user from being confused by displaying both the first image object and the second image object on the display surface when the operation mode is switched from the second mode to the first mode.

The figure which shows the function structure of the display system 1 which concerns on one Embodiment. The figure which illustrates the hardware constitutions of the display apparatus 10. The figure which illustrates the hardware constitutions of the information processing apparatus 30. The figure which shows the outline of interactive mode. The figure which shows the outline of PC mode. The figure which shows the projection surface which concerns on a comparative example. The flowchart which shows operation | movement of a display system. The figure which illustrates the projection surface which concerns on embodiment. FIG. 6 is another diagram illustrating the projection surface according to the embodiment. The figure which shows the function structure of the display system 1 which concerns on a modification.

1. Configuration FIG. 1 is a diagram showing a functional configuration of a display system 1 according to an embodiment. The display system 1 includes a display device 10, an indicator 20, and an information processing device 30. The display device 10 is a device that displays an image supplied from the information processing device 30 on a display surface. The information processing device 30 is a device that supplies an image to the display device 10. In this example, the information processing device 30 is a general-purpose personal computer and has a function of operating an application program.

  The indicator 20 is a device that indicates a position on the display surface. The display device 10 performs processing according to the position designated by the indicator 20. In this example, the processing corresponding to the designated position differs depending on the operation mode of the display device 10.

  The display device 10 includes a display unit 11, a detection unit 12, a drawing unit 13, a transmission unit 14, a transmission unit 15, and a storage unit 16.

  The display means 11 displays a screen according to the video signal supplied from the information processing device 30 on the display surface. Specifically, the display unit 11 displays the screen of the application program operating on the information processing device 30 on the display surface. The screen of the application program is a screen generated in the information processing device 30 along with the execution of the application program. For example, in the case of a multi-window GUI (Graphical User Interface), a desktop screen including the window of the active application program. The whole thing. The display surface is a surface on which an image is displayed, and is, for example, a screen or a wall surface when the display device 10 is a projector and a liquid crystal panel when the display device 10 is a liquid crystal display.

  The detection means 12 detects the position of the indicator 20 on the display surface (hereinafter simply referred to as the “position of the indicator 20”). In this example, the detection unit 12 detects an event including the position of the indicator 20. The indicator 20 is used by the user to specify a position on the display surface, and is, for example, an electronic pen or the user's own finger. The detection unit 12 includes, for example, a camera that captures an image of the display surface, and detects the position of the indicator 20 by the shape or color of the indicator 20 or the light emission of an emitter (for example, an infrared light emitting diode) provided on the indicator 20. Detect. The detection means 12 may detect the position of the indicator 20 using a pressure sensor or an electrostatic sensor provided on the display surface. The detection means 12 recognizes the type of event, for example, from the light emission pattern of the light emitter.

  Events related to the indicator 20 include a pen down event and a pen up event, for example. The pen down event is an event indicating that the indicator 20 is in contact with the display surface. The pen down event includes information (for example, coordinates) indicating the position where the indicator 20 is in contact with the display surface. The pen-up event indicates that the indicator 20 that has been in contact with the display surface until then has separated from the display surface. The pen-up event includes information indicating the position where the contact was last detected before the indicator 20 that had been in contact with the display surface until then was separated from the display surface.

  The drawing unit 13 is a function that is enabled when the operation mode of the display device 10 is the first mode, and a line (that is, a handwritten image) corresponding to the locus of the position of the indicator 20 detected by the detection unit 12, And a first image object for changing the attribute of the line is drawn on the display surface. The first image object is an image object for changing the line attribute according to the locus of the position of the indicator 20, for example, a toolbar in which a plurality of operation menus such as icons and buttons are arranged. In this example, the drawing unit 13 draws a line according to the locus of the position of the indicator 20 while the pen down events are continuously detected. More specifically, the drawing unit 13 draws a line in accordance with the position from the position where the pen down event is detected for the first time to the position where the pen up event is detected after the pen down event is not detected.

  The transmission unit 14 is a function that is enabled when the operation mode of the display device 10 is the second mode, and transmits information indicating the position of the indicator 20 detected by the detection unit 12 to the information processing device 30. The drawing means 13 may not draw a line according to the locus of the position of the indicator 20 detected during the second mode, or may draw it only when a specific condition is satisfied. Good.

  The transmitting unit 15 transmits a command for switching the operation mode (hereinafter referred to as “switching command”) to the information processing device 30. In the display system 1, the operation mode of the display device 10 and the operation mode of the information processing device 30 are synchronized with each other. When the input of the instruction to switch the operation mode (hereinafter referred to as “switching instruction”) is accepted, the transmitting unit 15 transmits the switching instruction to the information processing device 30.

  The storage unit 16 stores information indicating the position of the second image object on the screen according to the video signal supplied from the information processing device 30. The second image object is a second image object for changing the line attribute according to the locus of the position of the indicator 20, for example, a toolbar in which a plurality of operation menus such as icons and buttons are arranged.

  The information processing device 30 includes an executing unit 31, a video supplying unit 32, a receiving unit 33, a drawing unit 34, a receiving unit 35, an erasing unit 36, and a transmitting unit 37. The execution unit 31 executes an application program (for example, drawing software described later). The image supply means 32 supplies an image to the display device 10. In this example, the video supply unit 32 supplies the screen of the application program executed by the execution unit 31.

  The receiving unit 33 is a function that is enabled when the operation mode of the information processing device 30 is the second mode, and receives information indicating the position of the indicator 20 from the display device 10. The receiving unit 33 does not receive the information indicating the position of the indicator 20 when the operation mode of the information processing device 30 is the first mode.

  The drawing unit 34 is a function that becomes effective when the operation mode of the information processing device 30 is the second mode, and a line (that is, a handwritten image) corresponding to the information transmitted from the display device 10 and an attribute of the line. Draw a screen that includes a second image object for changing the. In this example, the drawing unit 34 draws a line according to the locus of the position of the indicator 20 while the pen down events are continuously detected. More specifically, the drawing means 34 draws a line in accordance with the position from the position where the pen down event is first detected from the state where the pen down event is not detected until the pen up event is detected thereafter.

  The receiving unit 35 receives the switching command transmitted from the display device 10. The erasing means 36 erases the second image object from the screen when a switching command for switching the operation mode of the information processing device 30 from the second mode to the first mode is received from the display device 10.

  When the input of the instruction to change the position of the second image object is received, the transmitting unit 37 transmits information indicating the changed position to the display device 10.

  FIG. 2 is a diagram illustrating a hardware configuration of the display device 10. The display device 10 includes a CPU (Central Processing Unit) 100, a ROM (Read Only Memory) 101, a RAM (Random Access Memory) 102, an IF unit 103, an image processing circuit 104, a projection unit 105, an operation panel 106, and a camera 107. Have.

  The CPU 100 is a control device that controls each unit of the display device 10. The ROM 101 is a non-volatile storage device that stores various programs and data. The RAM 102 is a volatile storage device that stores data, and functions as a work area when the CPU 100 executes processing.

  The IF unit 103 is an interface that mediates the exchange of signals or data with an external device (for example, the information processing device 30). The IF unit 103 has various terminals (for example, VGA terminal, USB terminal, wired LAN interface, S terminal, RCA terminal, HDMI (High-Definition Multimedia Interface: registered trademark) terminal for exchanging signals or data with an external device. , A microphone terminal, etc.) and a wireless LAN interface. These terminals may include a video output terminal in addition to a video input terminal.

  The image processing circuit 104 performs predetermined image processing (for example, size change, trapezoidal correction, etc.) on the input video signal.

  The projection unit 105 projects an image on a projection surface such as a screen or a wall surface according to the image signal subjected to the image processing. The projection unit 105 has a light source, a light modulator, and an optical system (all not shown). The light source includes a lamp such as a high-pressure mercury lamp, a halogen lamp, or a metal halide lamp, a solid-state light source such as an LED (Light Emitting Diode) or a laser diode, and a driving circuit for these. The light modulator is a device that modulates light emitted from a light source according to a video signal, and includes, for example, a liquid crystal panel or a DMD (Digital Mirror Device), and a drive circuit thereof. The liquid crystal panel may be either a transmissive type or a reflective type. The optical system is composed of an element or the like that projects the light modulated by the light modulator onto a screen, and has, for example, a mirror, a lens, and a prism. The light source and the light modulator may be provided for each color component.

  The operation panel 106 is an input device for the user to input an instruction to the display device 10, and includes, for example, a keypad, buttons, or a touch panel.

  The camera 107 is a camera for specifying the position of the indicator 20. In this example, the indicator 20 has a light emitting body (for example, an infrared light emitting diode), a pressure sensor, and a control circuit (all not shown) at the pen tip. When the pressure sensor detects that the pen tip touches an object (projection surface or the like), the control circuit causes the light emitter to emit light in a predetermined light emission pattern. The camera 107 is an infrared camera, and captures an image on the projection surface. The CPU 100 identifies the position of the indicator 20 and the corresponding event from the image captured by the camera 107.

  In this example, the projection unit 105 is an example of the display unit 11. The projection surface is the display surface. The camera 107 and the CPU 100 are an example of the detection unit 12. The CPU 100 is an example of the drawing unit 13. The IF unit 103 is an example of the transmission unit 14 and the transmission unit 15. The RAM 102 is an example of the storage unit 16.

  FIG. 3 is a diagram illustrating a hardware configuration of the information processing device 30. The information processing device 30 is, for example, a general-purpose personal computer, and has hardware elements such as a CPU 300, a ROM 301, a RAM 302, an IF unit 303, a storage unit 304, and a display unit 305.

  The CPU 300 is a control device that controls each unit of the information processing device 30. The ROM 301 is a non-volatile storage device that stores various programs and data. The RAM 302 is a volatile storage device that stores data, and functions as a work area when the CPU 300 executes processing.

  The IF unit 303 is an interface that mediates the exchange of signals or data with an external device (for example, the display device 10). The IF unit 303 includes various terminals and a wireless LAN interface for exchanging signals or data with an external device.

  The storage unit 304 is a non-volatile storage device that stores data, programs, and the like, and includes, for example, a flash ROM, SSD (Solid State Drive), or HDD (Hard Disk Drive). The storage unit 304 stores an operating system (OS) and application programs (for example, a program that sequentially displays slides of a presentation).

  The display unit 305 includes a display device such as a liquid crystal display or an organic EL (Electroluminescence) display, and displays information under the control of the CPU 300.

  In the information processing device 30, the CPU 300 is an example of the executing unit 31, the drawing unit 34, and the erasing unit 36, and the IF unit 303 is an example of the video supply unit 32, the receiving unit 33, the receiving unit 35, and the transmitting unit 37.

2. Outline of Operation Mode Here, the operation mode of the display system 1 (the display device 10 and the information processing device 30) will be described. In this example, the operation modes of the display system 1 include an interactive mode (an example of the first mode) and a PC mode (an example of the second mode).

  FIG. 4 is a diagram showing an outline of the interactive mode. In the interactive mode, the display device 10 can be used like a whiteboard or an electronic blackboard. The interactive mode is an operation mode in which the display device 10 draws a line (hereinafter referred to as “handwritten image”) corresponding to the trajectory of the indicator 20. The display device 10 can display an image obtained by superimposing a handwritten image on the video supplied from the video supply device and combining the images. For example, the display device 10 can superimpose and display a handwritten image (in this case, annotation or memo writing) on the screen of the drawing software executed by the information processing device 30. In the example of FIG. 4, the handwritten image IM1 is displayed on the screen SC along with the trajectory of the user moving the indicator 20 while touching (contacting) the projection surface. In the interactive mode, the display device 10 displays the toolbar T1 (an example of the first image object) overlaid on the video supplied from the video supply device. The toolbar T1 is used, for example, to perform an operation of switching the attribute of a line drawn according to the trajectory of the indicator 20 (for example, the type, color, or thickness of the line). The display position of the toolbar T1 can be changed by the user's operation using the indicator 20.

  FIG. 5 is a diagram showing an outline of the PC mode. In the PC mode, the indicator 20 can be used as a pointing device of the information processing device 30. In the PC mode, the display device 10 transmits information indicating an event including the position (coordinates) of the indicator 20 on the projection surface to the information processing device 30. The device driver of the information processing device 30 converts the information transmitted from the display device 10 into mouse operation information, and hands it over to the OS. In the present embodiment, drawing software is installed in the information processing device 30, and the drawing software draws a handwritten image according to information indicating the position of the indicator 20 supplied from the display device 10. In the example of FIG. 5, the drawing software draws the handwritten image IM2 on the screen in accordance with the locus that the user moves while touching the projection surface with the indicator 20. Thus, even in the PC mode, as long as the drawing software is activated, it is possible to draw a handwritten image as in the interactive mode. However, the interactive mode and the PC mode are different in that the main body that draws a handwritten image is the display device 10 or the information processing device 30. The drawing software displays the toolbar T2 on the screen. The toolbar T2 is used, for example, to perform an operation of switching the attribute of a line drawn according to the trajectory of the indicator 20. The display position of the toolbar T2 can be changed by the user's operation using the indicator 20.

  The selection of the interactive mode and the PC mode is performed, for example, depending on whether or not the user directly writes the handwritten image on the screen of the drawing software. Specifically, when the user does not want to write the handwritten image directly on the screen of the drawing software, the user draws the handwritten image using the interactive mode. On the other hand, when the user wants to write the handwritten image directly on the screen of the drawing software, the user draws the handwritten image using the PC mode. Switching between the interactive mode and the PC mode is performed by a user's instruction through a switching button (not shown) displayed on the screen by the function of the display device 10, for example.

  The drawing software is provided by, for example, the same operator as the operator who provides the display device 10, and the GUI may be very similar. In this case, the user who is using the display system 1 may not be aware of whether the user is drawing in the interactive mode or the drawing software is started in the PC mode. Therefore, the following problems may occur. In the following, unless otherwise specified, the case where the drawing software is activated in the information processing device 30 will be described.

  FIG. 6 is a diagram showing a projection surface according to a comparative example. FIG. 6 shows a projection surface when the user switches the operation mode of the display system 1 from the PC mode to the interactive mode. The display device 10 continues to project the screen of the drawing software operating on the information processing device 30 even after the operation mode is switched to the interactive mode. In this example, the drawing software screen includes a toolbar T2. The display device 10 also displays the toolbar T1 in an overlapping manner on the screen of the drawing software. Therefore, in the example of FIG. 6, the toolbar T1 of the display device 10 and the toolbar T2 of the drawing software are displayed on the projection surface. When a plurality of toolbars are displayed on the projection surface in this manner, it is difficult to distinguish whether each toolbar is a toolbar of drawing software or a toolbar of the display device 10, which is inconvenient for the user. For example, if the user forgets that the operation mode is the interactive mode and the user touches the toolbar T2 with the indicator 20, the toolbar T2 is not active, and thus a line (or a point) contrary to the user's intention is drawn. The present embodiment prevents such inconvenience from occurring when the operation mode is switched.

3. Operation FIG. 7 is a flowchart showing an operation according to the embodiment of the display system 1. The flow of FIG. 7 is started while the display system 1 is operating in the PC mode, and is repeated while the display device 10 and the information processing device 30 are powered on. In the following description, software may be described as the main body of processing, but this is because the hardware resource (CPU, etc.) executing this software is different from other hardware resources (memory, communication interface, etc.). ) Means to work in cooperation with In the PC mode, the CPU 100 of the display device 10 transmits information indicating the position of the indicator 20 to the information processing device 30. The drawing software of the information processing device 30 draws a handwritten image according to the information transmitted from the display device 10 on the screen. A toolbar T2 is displayed on the projection surface.

  In step S1, the CPU 100 of the display device 10 determines whether or not a switching instruction for switching the operation mode of the display system 1 from the PC mode to the interactive mode has been input. The switching instruction is input, for example, when the user touches the switching button (not shown) displayed on the screen by the function of the display device 10 with the indicator 20. When it is determined that the switching instruction has been input (S1: YES), the CPU 100 shifts the processing to step S2. When it is determined that the switching instruction has not been input (S1: NO), the CPU 100 waits for the processing until the switching instruction is input.

  In step S2, the CPU 100 transmits a switching command for switching the operation mode from the PC mode to the interactive mode to the information processing device 30. In step S3, the drawing software of the information processing device 30 deletes the toolbar T2 from the screen. In step S4, CPU 300 switches the operation mode of information processing device 30 from the PC mode to the interactive mode. When switched to the interactive mode, the drawing software stops drawing the handwritten image.

  In step S5, the CPU 100 of the display device 10 displays the toolbar T1 overlaid on the screen of the drawing software supplied from the information processing device 30. In the PC mode, the drawing software of the information processing device 30 transmits information indicating the display position of the toolbar T2 on the screen of the drawing software (hereinafter referred to as “position information I2”) to the display device 10. The drawing software of the information processing device 30, for example, when the instruction to change the display position of the toolbar T2 is input, transmits the position information I2 indicating the changed display position to the display device 10. In another example, the drawing software of the information processing device 30 transmits the position information I2 to the display device 10 when a switching command for switching the operation mode from the PC mode to the interactive mode is received. The CPU 100 stores the position information I2 received from the information processing device 30 in the RAM 102. In step S5, the CPU 100 refers to the position information I2 stored in the RAM 102 and displays the toolbar T1 at the same position as the display position of the toolbar T2.

  In step S6, the CPU 100 switches the operation mode of the display device 10 from the PC mode to the interactive mode. When switched to the interactive mode, the CPU 100 stops transmitting the information indicating the position of the indicator 20 and starts drawing the handwritten image.

  FIG. 8 is a diagram illustrating a projection plane after switching from the PC mode to the interactive mode. In the example of FIG. 8, the toolbar T1 of the display device 10 is displayed on the projection surface, and the toolbar T2 of the drawing software is not displayed. Thus, in this embodiment, when the operation mode is switched from the PC mode to the interactive mode, the toolbar T2 is erased from the screen of the drawing software. Therefore, in the interactive mode, the inactive toolbar T2 is prevented from being displayed on the projection surface, and the user is prevented from operating the toolbar T2 by mistake. Further, since the toolbar T1 is displayed at the same position as the display position of the toolbar T2, the change of the display position made on the toolbar T2 is reflected on the toolbar T1.

  Referring back to FIG. In step S7, the CPU 100 of the display device 10 determines whether or not a switching instruction for switching the operation mode of the display system 1 from the interactive mode to the PC mode has been input. When it is determined that the switching instruction has been input (S7: YES), the CPU 100 shifts the processing to step S8. When it is determined that the switching instruction has not been input (S7: NO), the CPU 100 waits for the processing until the switching instruction is input.

  In step S8, CPU 100 transmits a switching command for switching the operation mode from the interactive mode to the PC mode to information processing device 30. In step S9, the CPU 100 erases the toolbar T1 from the projection surface. In step S10, the CPU 100 switches the operation mode of the display device 10 from the interactive mode to the PC mode. When switched to the PC mode, the CPU 100 stops drawing the handwritten image and starts transmitting information indicating the position of the indicator 20.

  In step S11, the drawing software of the information processing device 30 displays the toolbar T2 on the screen of the drawing software. In the interactive mode, the CPU 100 of the display device 10 transmits information indicating the display position of the toolbar T1 on the screen of the drawing software (hereinafter referred to as “position information I1”) to the information processing device 30. For example, when an instruction to change the display position of the toolbar T1 is input, the CPU 100 transmits the position information I1 indicating the changed display position to the information processing device 30. In another example, the CPU 100 transmits the position information I1 to the information processing device 30 when a switching instruction for switching the operation mode from the interactive mode to the PC mode is input. The drawing software of the information processing device 30 stores the position information I1 received from the display device 10 in the RAM 302. In step S11, the drawing software of the information processing device 30 refers to the position information I1 stored in the RAM 302 and displays the toolbar T2 at the same position as the display position of the toolbar T1.

  In step S12, the CPU 300 of the information processing device 30 switches the operation mode of the information processing device 30 from the interactive mode to the PC mode. When the mode is switched to the PC mode, the drawing software of the information processing device 30 starts drawing a handwritten image.

  FIG. 9 is a diagram illustrating a projection plane after switching from the interactive mode to the PC mode. In the example of FIG. 9, the drawing software toolbar T2 is displayed on the projection surface, and the toolbar T1 of the display device 10 is not displayed. As described above, in the present embodiment, when the operation mode is switched from the interactive mode to the PC mode, the toolbar T1 is erased from the projection surface. Therefore, in the PC mode, the inactive toolbar T1 is prevented from being displayed on the projection surface, and the user is prevented from operating the toolbar T1 by mistake. Further, since the toolbar T2 is displayed at the same position as the display position of the toolbar T1, the change of the display position performed on the toolbar T1 is reflected on the toolbar T2.

4. Modifications The present invention is not limited to the above-described embodiments, and various modifications can be made. Hereinafter, some modified examples will be described. Two or more of the following modifications may be used in combination.

  The number of indicators 20 used in the display system 1 is not limited to one. In the display system 1, a plurality of indicators 20 may be used. In this case, the plurality of indicators 20 emit, for example, at wavelengths different from each other, and the display device 10 distinguishes and detects the respective positions of the plurality of indicators 20. Note that the display device 10 may detect the positions of the plurality of indicators 20 by distinguishing them based on other elements such as the shape or color of the indicator 20.

  The operation of the display system 1 when the operation mode is switched is not limited to that described in the embodiment. In the display system 1, for example, an operation (hereinafter, referred to as “switching operation”) of switching the attribute of a line drawn according to the trajectory of a certain indicator 20 (for example, line type, color, thickness, etc.) is the PC mode. (Or interactive mode), when the operation mode is switched to the interactive mode (or PC mode), the content of the switching operation is changed according to the trajectory of the indicator 20 after the operation mode is switched. May be reflected when is drawn. For example, in the PC mode, the user operates the toolbar T2 to perform the switching operation for switching the color of the line drawn according to the trajectory of the certain indicator 20 from black to red, and then the operation mode is switched to the interactive mode. In this case, a red line may be drawn according to the trajectory of the indicator 20 even in the interactive mode. In another example, the operation is performed after the user operates the toolbar T1 in the interactive mode to perform a switching operation for switching the thickness of a line drawn according to the trajectory of a certain indicator 20 from “thin” to “thick”. When the mode is switched to the PC mode, a “thick” line may be drawn according to the locus of the indicator 20 even in the PC mode.

  FIG. 10 is a diagram showing a functional configuration of the display system 1 according to the modification. In FIG. 10, the display device 10 has a storage unit 17 and a synchronization unit 18 in addition to the configuration shown in FIG. The storage unit 17 stores the line attribute corresponding to the locus of the position of the indicator 20 for each of the plurality of indicators 20. The storage unit 17 stores, for example, information indicating the line attribute (hereinafter referred to as “attribute information”) in a state of being associated with an identifier that identifies the indicator 20. In the interactive mode, the line attribute corresponding to the locus of the position of the indicator 20 is switched by the user operating the toolbar T1. The synchronization means 18 synchronizes the attributes stored in the storage means 17 with the attributes stored in the storage means 38 described later. For example, when the attribute stored in the storage unit 17 is changed, the synchronization unit 18 transmits the changed attribute information to the information processing device 30 to synchronize the attributes stored in the storage unit 17 and the storage unit 38. Let In another example, the synchronization unit 18 transmits the attribute information stored in the storage unit 17 to the information processing device 30 when the switching instruction for switching the operation mode from the interactive mode to the PC mode is input, and the storage unit 17 is stored. And the attributes stored in the storage means 38 are synchronized. In this example, the detection unit 12 distinguishes and detects the positions of the plurality of indicators 20. The drawing unit 13 also draws a line of the attribute stored in the storage unit 17 for the indicator 20 whose position is detected by the detection unit 12. Specifically, the drawing unit 13 refers to the attribute information stored in the storage unit 17 in association with the identifier of the indicator 20 whose position is detected by the detection unit 12, and draws the line of the attribute indicated by the attribute information. To draw. 2, the RAM 102 is an example of the storage unit 17, and the CPU 100 is an example of the synchronization unit 18.

  In FIG. 10, the information processing apparatus 30 has a storage unit 38 and a synchronization unit 39 in addition to the configuration shown in FIG. The storage unit 38 stores, for each of the plurality of indicators 20, the attribute of the line according to the locus of the position of the indicator 20. The storage unit 38 stores the attribute information in a state of being associated with the identifier that identifies the indicator 20, for example. In the PC mode, the line attribute corresponding to the locus of the position of the indicator 20 is switched by the user operating the toolbar T2. The synchronization means 39 synchronizes the attributes stored in the storage means 17 with the attributes stored in the storage means 38. The synchronization unit 39, for example, when the attribute stored in the storage unit 38 is changed, transmits the changed attribute information to the display device 10 and synchronizes the attributes stored in the storage unit 17 and the storage unit 38. . In another example, the synchronization means 39 transmits the attribute information stored in the storage means 38 to the display device 10 when the switching command for switching the operation mode from the PC mode to the interactive mode is received, and the storage means 17 and The attributes stored in the storage means 38 are synchronized. In this example, the drawing unit 34 draws the line of the attribute stored in the storage unit 38 for the indicator 20 whose position is detected by the detection unit 12. Specifically, the drawing unit 34 refers to the attribute information stored in the storage unit 38 in association with the identifier of the indicator 20 whose position is detected by the detection unit 12, and draws the line of the attribute indicated by the attribute information. To draw. In FIG. 3, the RAM 302 is an example of the storage unit 38, and the CPU 300 is an example of the synchronization unit 39.

  The method of detecting the position of the indicator 20 and the method of detecting an event related to the indicator 20 by the detection unit 12 are not limited to those described in the embodiment. The display device 10 may specify the position of the indicator 20 by the shape or color of the indicator 20. In addition, the indicator 20 has a button on the grip portion of the housing, and may output a signal indicating a pen down event when the user presses the button (in this case, the indicator 20 is a pen tip). Does not need to have a pressure sensor). Alternatively, a light emitting element (laser diode or the like) and a light receiving element (photodiode or the like) are provided around the screen so that the beam covers the screen, and the signal from the light receiving element is used to detect the position of the indicator 20 and the pen event. You may.

  The display device 10 is not limited to the projector, and its hardware configuration is not limited to that illustrated in FIG. It may be a direct-view display device such as a liquid crystal display or an organic EL display. In this case, the display device has a touch screen, and the position designated on the display surface is detected by the touch screen.

  The indicator 20 is not limited to the electronic pen. It may be a stylus pen having a housing of a specific shape or color, or it may be a user's finger.

  In the display system 1, the sharing of functions between the display device 10 and the information processing device 30 is not limited to that illustrated in FIG. 1. Some of the functions of FIG. 1 may be omitted. Further, at least a part of the functions described as the functions of the display device 10 in the embodiment may be mounted on the information processing device 30.

  The drawing software may be provided by a business operator different from the business operator who provides the display device 10.

DESCRIPTION OF SYMBOLS 1 ... Display system, 10 ... Display device, 11 ... Display means, 12 ... Detection means, 13 ... Drawing means, 14 ... Transmission means, 15 ... Transmission means, 16 ... Storage means, 17 ... Storage means, 18 ... Synchronization means, 31 ... Execution means, 32 ... Image supply means, 33 ... Reception means, 34 ... Drawing means, 35 ... Reception means, 36 ... Erase means, 37 ... Transmission means, 38 ... Storage means, 39 ... Synchronization means, 100 ... CPU, 101 ... ROM, 102 ... RAM, 103 ... IF section, 104 ... Image processing circuit, 105 ... Projection unit, 106 ... Operation panel, 107 ... Camera, 300 ... CPU, 301 ... ROM, 302 ... RAM, 303 ... IF section, 304 ... Storage unit, 305 ... Display unit, 20 ... Indicator

Claims (4)

Having a display device and an information processing device,
The display device is
Display means for displaying a screen according to a video signal supplied from the information processing device on a display surface,
Detection means for detecting the position of the indicator on the display surface,
When the operation mode of the display device is the first mode, the line corresponding to the locus of the position of the indicator detected by the detection unit, and the first image object for changing the attribute of the line are displayed. First drawing means for drawing on the surface,
When the operation mode of the display device is the second mode, first transmission means for transmitting information indicating the position of the indicator detected by the detection means to the information processing device,
A second transmission unit that transmits an instruction for switching the operation mode of the information processing device to the information processing device when an input of an instruction to switch the operation mode of the display device is received ;
A second storage unit that stores the attribute for each of the plurality of indicators ,
The information processing device,
When the operation mode of the information processing device is the first mode, the information processing device includes a line according to the locus of the position included in the information transmitted from the display device, and a second image object for changing the attribute of the line. When the operation mode of the information processing device is the second mode without drawing the screen, the line including the line corresponding to the locus of the position included in the information transmitted from the display device and the second image object is included. Second drawing means for drawing a screen,
Supply means for supplying a video signal for displaying the screen on the display device to the display device,
Erasing means for erasing the second image object from the screen when a command for switching the operation mode of the information processing device from the second mode to the first mode is received from the display device ,
Third storage means for storing the attribute for each of the plurality of indicators,
Possess a synchronization means for synchronizing the attributes stored with the attributes stored in said second storage means to said third storage means,
The display device is
The detection means detects the positions of the plurality of indicators,
The first drawing unit draws a line of the attribute stored in the second storage unit for the indicator whose position is detected by the detection unit,
The information processing device,
The second drawing unit draws a line having the attribute stored in the third storage unit for the indicator whose position is detected by the detection unit.
A display system characterized in that The display device is
A first storage unit that stores information indicating the position of the second image object on the screen;
When the input of an instruction for switching the operation mode of the display device from the second mode to the first mode is accepted, the display unit displays the position indicated by the information stored in the first storage unit of the screen. The display system according to claim 1, wherein the first image object is displayed on the screen. The information processing device,
The third transmission unit that transmits information indicating the changed position to the display device when an input of an instruction to change the position of the second image object is received. Display system. A method for controlling a display system having a display device and an information processing device, comprising:
The display device is
A step of displaying a screen according to a video signal supplied from the information processing device on a display surface,
Detecting the position of the indicator on the display surface,
When the operation mode of the display device is the first mode, a line corresponding to the detected locus of the position of the pointer and a first image object for changing the attribute of the line are drawn on the display surface. A first drawing step,
Transmitting the information indicating the detected position of the pointer to the information processing device when the operation mode of the display device is the second mode;
Transmitting an instruction to switch the operation mode of the information processing device to the information processing device when an input of an instruction to switch the operation mode of the display device is received;
A first storing step of storing the attribute for each of the plurality of indicators ,
The information processing device is
When the operation mode of the information processing device is the first mode, the information processing device includes a line according to the locus of the position included in the information transmitted from the display device, and a second image object for changing the attribute of the line. When the operation mode of the information processing device is the second mode without drawing the screen, the line including the line corresponding to the locus of the position included in the information transmitted from the display device and the second image object is included. A second drawing step of drawing the screen,
Erasing the second image object from the screen when a command for switching the operation mode of the information processing device from the second mode to the first mode is received from the display device ,
A second storing step of storing the attribute for each of the plurality of indicators;
Possess the step of synchronizing the attributes stored in said first storage attributes in the storage step the second storage step,
In the display device
The step of detecting the position of the indicator detects the position of the plurality of indicators,
The first drawing step draws a line of the attribute stored in the first storage step for the indicator whose position is detected in the step of detecting the position of the pointer,
In the information processing device
In the second drawing step, a line of the attribute stored in the second storage step is drawn for the indicator whose position is detected in the step of detecting the position of the pointer.
A control method characterized by the above.

Images