JP3530340B2 - Electronic equipment control system - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an electronic device control system for controlling electronic devices, and more specifically, a plurality of AV (audio / audio) such as a television, a video cassette recorder and a compact disc player installed in a living room. Visual) system for controlling equipment.

[0002]

2. Description of the Related Art There is an AV device control system in which a plurality of AV devices connected to the computer are associated with each other and controlled by moving a cursor to a position of an icon displayed on a display of a computer and pressing a key (Japanese Patent Application No. Hei. 8-348031). On the operation screen of the AV device control system, icons representing AV devices connected to the computer, such as a television (hereinafter referred to as TV) and a video cassette recorder (hereinafter referred to as VCR), are displayed. An AV device to be controlled and a command given to the AV device are associated with each of these icons in advance.

A VCR icon representing a VCR is associated with a VCR as a control target, and as a command to be given, a command for reproducing the cassette loaded in the VCR and a series of commands necessary for the reproduction, specifically, Are associated with commands such as power-on of VCR, power-on of TV and switching of display screen to VCR input signal. by this,
Even if the power of the VCR and TV is turned off, if the cassette is loaded in the VCR, the user can
Operation indirectly required to obtain the desired result (playback of cassette) by one operation of pressing the icon (power supply of TV
You will not be bothered with the ON operation).

[0004]

By the way, the above-mentioned AV
In a device control system, an unfamiliar user cannot always intuitively understand a command associated with an icon. Taking the VCR icon described above as an example, the user may select "PLAY" or "PLAY" to instruct to play the cassette.
It is also possible to look for the icon displayed as. In such a case, there is a problem that it gives an unwieldy impression. Further, in a situation in which a plurality of AV devices are controlled by a single AV device control system in a centralized manner and simultaneously, a device for displaying the control state of each AV device in an easily confirmable manner is required.

The present invention has been made in view of the above circumstances, and an electronic device such as an AV device and a command given thereto are associated with different icons, and these are combined to be input to operate the electronic device. Accordingly, it is an object of the present invention to provide an electronic device control system whose operation method is intuitively understandable. Another object is to display the control state of the electronic device in an easily confirmable manner by controlling the display position of the icon according to the control state of the electronic device. Still another object is to detect the operating state of each electronic device in the electronic device control system and assist the input operation necessary to obtain a desired result.

[0006]

An electronic device control system according to a first aspect of the present invention is an electronic device control system which gives a command to a plurality of electronic devices and controls each electronic device, and is associated with each electronic device. A unit for displaying a plurality of first icons, a unit for displaying a plurality of second icons associated with a command to be given to each electronic device, and a pointing device for operating a pointer for pointing the first or second icon, Means for changing the display position of the first or second icon in response to a drag-and-drop operation of the first or second icon by the pointing device;
Means for displaying a reception area for receiving a designated input of an electronic device or a command associated with the icon by dropping the icon; and another second icon within a predetermined time after the second icon is dropped in the reception area. When is dropped, a means for selecting a command associated with the second icon that was dropped last, and an electronic device capable of executing the selected command are dropped in the reception area within the predetermined time. It is characterized by comprising electronic device selecting means for selecting from the electronic devices associated with the first icon and means for giving the selected command to the selected electronic device. This electronic device control system selects an electronic device to be controlled and a command to be given from the first and second icons received within a predetermined time, and gives the command to the electronic device, thereby intuitively operating the method. Make it easier to understand.

The electronic equipment control system according to the second invention is
The electronic device selection means has the first icon in the dropped icon.
When it is determined that the icon does not exist, the electronic device selected last is selected. This electronic equipment control system is the first necessary for selecting electronic equipment.
When the icon is not accepted, the input operation is supplemented by selecting it from the control targets of the commands already executed.

An electronic equipment control system according to the third invention is
The electronic device selection means has the first icon in the dropped icon.
When it is determined that there are a plurality of icons, the electronic device associated with the last dropped first icon is selected. When receiving a plurality of first icons necessary for selecting an electronic device, this electronic device control system supplements the input operation by selecting the electronic device associated with the last received first icon.

An electronic equipment control system according to the fourth invention is
An electronic device control system having a television having a multi-screen display function in an electronic device to be controlled, where the screen display is performed on the television, and when a new command for screen display is selected , A means for giving a multi-screen display command before giving the selected command to the television. This electronic device control system is a case where a single screen is displayed on a television having a multi-screen display function, and when a new command for displaying on the television screen is selected, the multi-screen is displayed before the command is given. By commanding the display function, the input operation commanding the multi-screen display function is supplemented.

An electronic equipment control system according to the fifth invention is
An electronic device control system having a video cassette recorder and a television as an electronic device to be controlled, wherein means for displaying an icon and whether the video cassette recorder is loaded with a cassette when the icon is dropped in a reception area A means for determining whether or not the cassette is loaded, a means for determining whether or not the cassette is recordable, and a means for determining whether or not the cassette is recordable. Means for giving to the television an instruction to switch the input of the signal to be displayed to the video cassette recorder, and to give to the video cassette recorder an instruction to reproduce the cassette for a predetermined time. This electronic device control system simplifies the input operation by preparing in advance an icon associated with a series of commands for confirming the recording contents of the cassette.

The electronic equipment control system according to the sixth aspect of the present invention is
It is characterized by further comprising an execution result display means for displaying the execution result of the given command by the display position of the icon. This electronic device control system makes it easy to confirm the control state of each electronic device by changing the display position of the icon according to the control state of each electronic device in the execution result of the command.

An electronic equipment control system according to the seventh invention is
The execution result display means is characterized by displaying a message for explaining the reason of the command not executed. This electronic device control system provides information on the execution result by displaying the reason for the command not executed.

An electronic equipment control system according to the eighth invention is
The means for displaying the reception area displays an image simulating a face, and when the first or second icon is dragged to the area inside the face, an image simulating a face with an open mouth is displayed as the reception area, Further, when the first or second icon is dropped in the area inside the face, an animation for masticating the icon is displayed, and the execution result display means associates the executed electronic device or command with each other. There is a first
Alternatively, the animation for swallowing the second icon and holding it in the lower area of the face is displayed, and the animation for ejecting the icon that has not been executed from the mouth is displayed. This electronic device control system makes it easy to confirm the reception area by changing the image of the operation screen when the icon is in the reception area.
Further, by displaying an image simulating a face on the operation screen and animating and displaying the mouth portion of the icon when it is in the reception area, the user can be visually entertained and the electronic device control system can be easily familiarized. You can expect the effect of doing.

[0014]

1 is a block diagram showing the configuration of an electronic device control system according to the present invention. In the figure,
A computer 1 receives an input of a control command and outputs a command for controlling an AV device, and includes a timer 9 for measuring a predetermined remaining time. Computer 1
A monitor 2 for displaying an operation screen and a mouse 3 as a pointing device for inputting a control command are connected to the. The computer 1 is also connected to an interface device 4 that sends the command output by the computer 1 to the AV device to be controlled. The interface device 4 includes a transmission / reception circuit 41 that wirelessly transmits a command for controlling AV equipment and that receives a response signal given by wireless.

On the other hand, TV5, VCR6, VCR7 and D
The VD player 8 is an AV device to be controlled. Commands are sent from the interface device 4 to the TV 5 and the VCR 6 wirelessly, and the VCR 7 and the DVD are also provided.
A command is given to the player 8 by wire. TV5, VCR6, VCR7, DVD player 8
The detectors 10, 11, 12 and 13 for detecting the operating state of each are connected to each. The detection signals transmitted from the detection devices 10 and 11 are converted into wireless signals by the transmission devices 14 and 15 respectively connected thereto as response signals and transmitted. Further, the detection devices 12 and 13 are connected to the interface device 4, and give the detection signal to the interface device 4 as a response signal.

FIG. 2 is an explanatory view for explaining an operation screen displayed on the monitor 2 by the computer 1. In the figure, a circular area simulating the face in the center of the screen is a reception area 21 that receives an AV device or a command associated with the icon by dropping an icon described later. 2
2, 23, 24, and 25 are icons associated with the TV 5, VCR 6, VCR 7, and DVD player 8, respectively.
Further, 26, 27 and 28 are icons respectively associated with a stop command, a reproduction command and a recording command.

When watching a television program,
When suddenly thinking of recording the program by VCR and instructing recording, the recorded content is overwritten in the cassette loaded in the VCR, and the original recorded content is lost.
Even if the recorded contents are desired to be saved, the lost original recorded contents cannot be restored.
Therefore, in order not to cause such a situation, the user first issues a command to reproduce the cassette loaded in the VCR, determines that it is acceptable to lose the recorded contents, and then winds it to the original position. Return and command recording.

The icon 29 assists the input of such a troublesome operation for preparation for recording, and a command for discriminating whether or not the cassette loaded in the designated VCR can be recorded, and the cassette The reproduction command, the stop command after the predetermined time, and the rewind command to the original position of the cassette are associated with each other. The user can easily and efficiently prepare for recording by designating and inputting the icon 29. Furthermore, 30, 31 and 32, 33 are icons associated with channel up / down and volume up / down commands, respectively. In some cases, the channel up / down and the volume up / down may be continuously controlled. In that case, the channel up / down and the volume up / down icons 30, 31, 32, 3 in FIG.
3 moves directly into the reception area 21.

FIG. 3 is a state transition diagram showing a control processing state by the computer 1. 4, FIG. 5, FIG. 6 and FIG. 7 are explanatory views for explaining an example of the operation screen. In FIG. 3, the state I is an operating state in which the operation screen as shown in FIG. 2 is displayed on the monitor 2 and waiting for the operation of the icon, which is the state immediately after the start of the control process. When the icon 24 is dragged into the reception area 21 in the state I, the image with the open mouth is displayed (FIG. 4), and the icon 24 is displayed again.
When the icon is dropped in the reception area 21, an animation for masticating the icon is displayed (FIG. 5), a predetermined waiting time is set in the timer 9, and the next icon is waited for.

Then, a plurality of icons dropped in the reception area 21 within the waiting time (in this case, it is assumed that the icon 27 is dropped after the icon 24) are received and stored. In the state I, when there is no icon operation from the start of the control process or when the elapsed time after the icon 27 is dropped is within the set waiting time, the transition from the state I does not occur. When the set waiting time elapses without dropping the next icon after the icon 27 is dropped, the state transits to the state II.

In the state II, the AV device to be controlled and the command to be given to the AV device are displayed as a dropped icon (icon 24
And 27), which is an operation state in which a command is selected from AV equipments or commands associated with the command and transmitted. In state II, when it is determined that there is no icon associated with the command among the dropped icons, the state transitions to state I.
When the command transmission is completed normally in state II or an abnormal command transmission is detected, state III
Transition to. State III is the selected icon (icon 24
And when the command transmission by 27) is completed normally, an animation of swallowing the icon is displayed (Fig. 6), and when an abnormal command transmission is detected (for example, when the VCR 7 is not loaded with a cassette). It is an operating state in which the execution result of the command is displayed by displaying the animation and the error message for ejecting the icon in FIG. When the display of the execution result is completed, the state transitions to state I.

8 and 9 are flowcharts showing the control processing procedure in the state I of the computer 1. When the electronic device control system is activated, the waiting time of the timer 9 is cleared (S1), and the process waits until an event generated by mouse operation is input (S2). When it is determined that an event has been input, it is determined whether the event is a drag of an icon (S3). When it is determined that the event is a drag, it is determined whether or not the position of the mouse cursor is within the reception area (S4). When it is determined that the event is within the reception area, the mouth as shown in FIG. 4 is opened. Display the image (S5). If it is determined in S4 that the area is not the reception area,
An image with the mouth closed as shown in FIG. 2 is displayed (S6). S3
When it is determined that the event is not a drag in, it is determined whether the event is a drop (S7). When it is determined that the event is not a drop, the process is returned to S2 and the subsequent steps are repeated.

When it is determined in S7 that the icon is a drop, it is determined whether or not the drop position is within the reception area (S8). When it is determined that it is within the reception area, the display of an animation of a predetermined length that chews an icon as shown in FIG. 5 is started (S9), and the icon is stored (S10). Then, the waiting time is set in the timer 9 and the operation is commanded (S11). It is checked whether or not the waiting time set in the timer 9 remains (S12). When it is determined that the waiting time does not remain, the state transits to the state II. When it is determined that the waiting time remains, the process is returned to S12 until the next event is input, and the subsequent steps are repeated (S13).
.

When it is determined in S13 that an event has been input, it is determined whether or not the event is dragging of an icon (S14). When it is determined that the event is a drag, it is determined whether or not the position of the mouse cursor is within the reception area (S15). When it is determined that the event is within the reception area, the mouth as shown in FIG. 4 is opened. Display image (S
16). If it is determined in S15 that the area is not the reception area, an image with the mouth closed as shown in FIG. 2 is displayed (S17). S14
When it is determined that the event is not the drag in, it is determined whether the event is the drop (S18).
When it is determined that the event is a drop, the process is returned to S8, and the subsequent steps are repeated. If it is determined in S18 that the event is not a drop, the process returns to S12 and the subsequent steps are repeated. If it is determined in S8 that the icon is not in the reception area, the display position of the icon is updated to that position (S19), the process proceeds to S12, and the subsequent steps are repeated.

FIG. 10, FIG. 11 and FIG. 12 are flowcharts showing the control processing procedure in the state II of the computer 1. First, it is determined whether or not the icon stored in the state I has an icon 22, 23, 24 or 25 (hereinafter referred to as a device icon) associated with an AV device (S21). When it is determined that there is a device icon, the AV device associated with the most recently received device icon is set as a control target (S22). Next, it is determined whether or not there is an icon 26, 27, 28, 30, 31, 32 or 33 (hereinafter, referred to as a command icon) in which the command is associated with the stored icon (S2).
3). When it is determined that there is no command icon, the state transitions to state I. When it is determined that there is a command icon, the command icon received most recently is selected and the command associated with that command icon is set as the one to be given to the control target (S24).

Next, the icon selected in S24 is
An icon associated with a series of commands to prepare for recording
If it is determined that it is the icon 29 (S25), and if it is determined that it is the icon 29, a command sequence preset in the following procedure is generated and transmitted. If it is determined that the icon is not the icon 29, it is determined whether the set command corresponds to the set AV device (S26). If it is determined that the command does not correspond, the setting of the AV device is deleted (S27). ), The AV device is set in the following procedure.

When it is determined in S26 that the set command does not correspond to the set AV device, or after the setting of the AV device is deleted in S27, it is determined whether the AV device is already set. When it is determined that the setting has been completed (S31), it is stored (S35). When it is determined that the AV device is not set, the operating state of the connected AV device is detected (S32), and it is determined whether or not there is an AV device that continues to operate (S33). When there is no AV device that continues to operate, the target device of the command previously issued is A
It is set as a V device (S34) and stored (S35). S
When there is an AV device that continues to operate in 33, it is set as an AV device to be controlled (S36), and this is stored (S35).

After storing the AV device in S35, a command sequence is generated based on the stored setting information (S41).
On the other hand, when it is determined in S25 that the selected icon is the icon 29, it is determined whether or not a series of command sequences for recording preparation, specifically, the cassette loaded in the VCR is recordable, After reproducing the cassette for a predetermined time, it is stopped and a command sequence for instructing to rewind to the original position is generated (S42). Next, it is necessary to detect the operation status of the connected AV equipment and to display a plurality of commands for displaying the screen from the detected operation status and the generated command string, that is, is it necessary to use the multi-screen display function? If it is determined that it is necessary, a multi-screen switching command is added to the generated command sequence (S4).
Four) . Then, the command sequence generated in S41, S42, or S44 is transmitted to the AV device set as the control target (S45), and the response signal indicating the execution result is received (S4).
6).

It is determined whether or not the received response signal indicates a normal end (S47), and when it is determined that the response signal indicates an abnormality, a message notifying the abnormality is created (S48), and the state III is entered. When it is determined in S47 that the command has ended normally, it is determined whether or not there is a command to be transmitted (S49), and when it is determined that there is no command, the state transits to state III. When it is determined in S49 that there are remaining commands to be transmitted, the next command is selected (S50), the process proceeds to S45, and the subsequent steps are repeated to transmit all commands.

By the way, the size of the operation screen is limited. When the number of icons to be displayed is large, it becomes difficult to see the operation screen if all the icons are displayed, so it is necessary to devise a method of displaying the icons. FIG. 13 is an explanatory diagram illustrating an example of an operation screen that allows a predetermined icon to be hidden to make it easier to see. In the figure, 34 is an icon for controlling the display state of the icon based on the display state set for each icon. The icons 22, 32 and 33 are icons that are not displayed on the operation screen. Furthermore, each icon has its display state set to "display" or "non-display" by clicking on it. Normally, the display status of all icons is "Display"
However, in this case, the icons 22, 32 and 33 are set to "non-display". Description of other components similar to those in FIG. 2 is omitted.

The user previously clicks an icon of low frequency of use (in this case, icons 22, 32 and 33),
The icon is set to "hidden"("hidden" means that the displayed brightness and contrast are reduced compared to the displayed icon, and the icon is displayed lightly). At this point, all the icons are displayed on the operation screen. Then, when the user clicks the icon 34, the icons 22, 32 and 33 set to "non-display" are erased, and only the icon set to "display" is displayed on the operation screen. When the user clicks the icon 34 again in this state, all the icons are displayed. Afterwards icon 34
Each time you click, switch to one of the above display states. This makes it easier to see the operation screen even when the number of icons to be displayed is large.

[0032]

According to the electronic equipment control system of the first aspect of the invention as described above, the first and second aspects of the electronic equipment control system accepted within a predetermined time period.
From the icon to select the electronic device to be controlled and the command given to it, from giving the command to the electronic device,
The operation method can be easily understood intuitively.

According to the electronic equipment control system of the second invention, when the first icon necessary for selecting the electronic equipment is not accepted, it is selected from the control objects of the commands already executed, so that the user can control it. Even if the input operation of the electronic device is neglected, this can be estimated and compensated.

According to the electronic device control system of the third aspect of the invention, when a plurality of first icons necessary for selecting an electronic device are received, the electronic device associated with the last received first icon is selected. Even if the user specifies a plurality of electronic devices to be controlled, it is possible to supplement the input operation by selecting a suitable first icon from among them.

According to the electronic equipment control system of the fourth aspect of the present invention, when a single screen is displayed on a television having a multi-screen display function, and when a new command for displaying on the television screen is selected, Since the multi-screen display function is instructed before the instruction is given, the input operation of the user can be supplemented.

According to the electronic equipment control system of the fifth invention, an icon associated with a series of commands for confirming the recording contents of the cassette is prepared in advance, so that the input operation can be simplified.

According to the electronic equipment control system of the sixth invention, the execution result of the command is represented by changing the display position of the icon according to the control status of each electronic equipment, so that the control status of each electronic equipment is confirmed. Can be made easier.

Depending on the electronic equipment control system of the seventh invention, the reason why the command is not executed is displayed.
The information can be provided to the user who wants a detailed report of the execution result.

Depending on the electronic device control system of the eighth invention, the image of the operation screen is changed when the icon is in the reception area, and the display position of the icon is changed according to the control state of each electronic device. Therefore, it is possible to easily confirm the control area of the reception area and each electronic device.
Further, by displaying an image simulating a face on the operation screen and animating and displaying the mouth portion of the icon when it is in the reception area, the user can be visually entertained and the electronic device control system can be easily familiarized. You can expect the effect of doing.

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration of an electronic device control system according to the present invention.

FIG. 2 is an explanatory diagram illustrating an operation screen.

FIG. 3 is a state transition diagram showing a control processing state.

FIG. 4 is an explanatory diagram illustrating an example of an operation screen.

FIG. 5 is an explanatory diagram illustrating an example of an operation screen.

FIG. 6 is an explanatory diagram illustrating an example of an operation screen.

FIG. 7 is an explanatory diagram illustrating an example of an operation screen.

FIG. 8 is a flowchart showing a control processing procedure in state I.

FIG. 9 is a flowchart showing a control processing procedure in a state I.

FIG. 10 is a flowchart showing a control processing procedure in state II.

FIG. 11 is a flowchart showing a control processing procedure in state II.

FIG. 12 is a flowchart showing a control processing procedure in state II.

FIG. 13 is an explanatory diagram illustrating an example of an operation screen.

[Explanation of symbols]

1 Computer 2 Monitor 3 Mouse 4 Interface Device 5 TV 6,7 VCR 8 DVD Player 9 Timer 10, 11, 12, 13 Detection Device 14, 15 Transmission Device 21 Reception Area 22, 23, 24, 25, 26, 27, 28 , 29 icons

─────────────────────────────────────────────────── ─── Continuation of the front page (58) Fields surveyed (Int.Cl. ⁷ , DB name) G06F 3/00 G06F 3/14-3/153

Claims (8)

(57) [Claims] 1. An electronic device control system for giving a command to a plurality of electronic devices to control the respective electronic devices, comprising means for displaying a plurality of first icons associated with the respective electronic devices, and each electronic device. Means for displaying a plurality of second icons associated with the command to be given, a pointing device for operating a pointer for pointing the first or second icon, and dragging of the first or second icon by the pointing device A means for changing the display position of the icon in response to a drop operation, and a means for displaying a reception area for receiving a designated input of an electronic device or a command associated with the icon by dropping the first or second icon, When another second icon is dropped within a predetermined time after the second icon is dropped in the reception area A means for selecting a command associated with the last dropped second icon, an electronic device capable of executing the selected command, and a first icon dropped in the reception area within the predetermined time. An electronic device control system comprising: an electronic device selecting unit that selects from associated electronic devices; and a unit that gives a selected command to the selected electronic device. 2. The electronic device selecting means, when it is determined that the first icon does not exist among the dropped icons,
The electronic device control system according to claim 1, wherein the electronic device selected last is selected. 3. The electronic device selecting means, when it is determined that a plurality of first icons exist among the dropped icons, selects an electronic device associated with the last dropped first icon. The electronic device control system according to claim 1. 4. An electronic device control system having a television having a multi-screen display function in an electronic device to be controlled, wherein the screen display is performed on the television,
2. The electronic device control system according to claim 1, further comprising means for giving a multi-screen display command before giving the selected command to the television when a new command for screen display is selected. 5. An electronic equipment control system having a video cassette recorder and a television as electronic equipment to be controlled, comprising means for displaying an icon, and a cassette for the video cassette recorder when the icon is dropped in the reception area. When it is determined that a cassette is loaded, when it is determined that a cassette is loaded, and when it is determined that the cassette is recordable A means for giving to the television an instruction to switch the input of the signal to be displayed on the television screen to the video cassette recorder, and to give to the video cassette recorder an instruction to reproduce the cassette for a predetermined time. The electronic device control system according to claim 1. 6. The electronic device control system according to claim 1, further comprising execution result display means for displaying the execution result of the given command by the display position of the icon. 7. The electronic device control system according to claim 6, wherein the execution result display means is configured to display a message explaining the reason of the instruction not executed. 8. The means for displaying the reception area displays an image simulating a face, and when the first or second icon is dragged to the inner area of the face, the face with an open mouth is imitated as the reception area. An image is displayed, and when the first or second icon is dropped in the area inside the face, an animation for chewing the icon is displayed, and the execution result display means is an electronic device that has been executed. Alternatively, an animation for swallowing the first or second icon associated with the command and holding it in the lower area of the face is displayed, and an animation for spitting out an icon that has not been executed is displayed. The electronic device control system according to claim 6.