JP5187743B2 - Terminal device and program - Google Patents

Description

The present invention relates to a terminal device and a program having display means for performing a display operation using a charged body that moves according to an applied voltage.

In recent years, display means having a memory property such as electronic paper may cause charged particles (charged bodies) to aggregate over time or be partially biased depending on display contents. When such agglomeration or bias occurs, the charged particles cannot be sufficiently moved even when a voltage is applied, which causes display unevenness and contrast reduction.
Therefore, conventionally, a technique is known in which a refresh operation is performed by alternately applying stronger voltages (alternating voltages) having different directions in order to eliminate aggregation and bias of charged particles. For example, in Patent Document 1, the refresh operation is controlled in accordance with the elapsed time from the previous display, the elapsed time from the previous refresh operation, the number of times displayed from the previous refresh operation, and the ambient temperature.
JP 2007-187938

However, since the refresh operation in the above-described prior art applies an alternating voltage to move charged particles, the user perceives the display as “flickering” during the refresh operation. For example, as a refresh operation of the display means for performing black and white two-color display, when the entire black display is performed for 250 milliseconds and then the entire white display is performed for 250 milliseconds, the entire black display and the entire white display are used. There was a defect that the whole display flickered.

An object of the present invention is to perform a refresh operation at an appropriate timing in a display means that performs a display operation using a charged body that moves in accordance with an applied voltage so that aggregation and bias of the charged body can be prevented. It is to be.

The invention according to claim 1 is a terminal device having display means for performing a display operation using a charged body that moves according to an applied voltage, and performing a refresh operation by applying a predetermined voltage to the display means. Based on the detection means by the refresh means, the time measurement means for measuring the elapsed time from the previous refresh operation by the refresh means, the detection means for detecting the current state of the terminal device, the terminal When it is determined that the current state of the apparatus is a state in which the display means does not face the user , and the elapsed time from the previous refresh operation by the time measuring means exceeds a predetermined time If you are, by comprising a refresh control means for controlling the operation of the refresh means to perform the refresh operation And butterflies.
Furthermore, a program for realizing the main functions shown in the invention described in claim 1 is provided to the computer (invention described in claim 11 ).

The invention described in claim 1 described above may be as follows.
The refresh means performs a refresh operation by monochromatic display on the entire display area of the display means (the invention according to claim 2).

The detection means detects the orientation of the display means as the current state of the terminal device (the invention according to claim 3).

4. The image processing apparatus according to claim 3, further comprising a photographing unit that photographs the user's face, wherein the detecting unit determines whether the user's face is photographed by the photographing unit as a current state of the terminal device. The direction of the display means may be detected based on the invention (the invention according to claim 4).

The detection means detects brightness around the display means as a current state of the terminal device (invention according to claim 5).

The camera further includes an imaging unit that captures a face of the user, and the detection unit includes a first detection unit that detects a direction of the display unit as a current state of the terminal device, and a current state of the terminal device. Second detection means for detecting the orientation of the display means based on whether or not the user's face has been photographed by the photographing means; and detecting the brightness around the display means as the current state of the terminal device And the refresh control means is based on a detection result of at least one of the first detection means, the second detection means, or the third detection means. It is characterized in that it is determined whether or not the current state of the terminal device is a state in which the display means is facing the user (the invention according to claim 6).
When the detection result of the detection unit changes during the refresh operation, the refresh control unit cancels the refresh operation (the invention according to claim 7 ).

When an operation by a user is performed during the refresh operation, the refresh control unit cancels the refresh operation (the invention according to claim 8 ).

In the invention according to claim 7 or 8 , when the refresh control unit cancels the refresh operation, the refresh control unit acquires the state of the function being operated and causes the display unit to display display information corresponding to the state (invoice). (Invention of Item 9 )

Even if the refresh control means determines that the current state of the terminal device is a state where the display means faces the user based on the detection result by the detection means, by time measuring means, when the elapsed time from the previous refresh operation exceeds a predetermined time, the controlling operation of the refresh means to perform a refresh operation (the invention of claim 10, wherein).

According to the present invention, the display unit that performs a display operation using a charged body that moves according to the applied voltage can appropriately prevent aggregation and bias of the charged body by performing a refresh operation at an appropriate timing. In addition, the charged body can be effectively prevented from being deteriorated, and the practical effect is high.

Hereinafter, an embodiment of the present invention will be described with reference to FIGS.
This embodiment exemplifies a case where the present invention is applied to a mobile phone device as a terminal device, and FIG. 1 is a block diagram showing basic components of the mobile phone device.
This mobile phone device is, for example, a foldable device in which two casings (an operation unit casing and a display unit casing) are detachably attached. FIG. 2 illustrates an operation unit casing, a display unit casing, The folding of is shown. The mobile phone device is provided with a call function (voice call function, videophone function), an e-mail function, a camera function, and the like.

The control unit 1 operates by supplying power from a power supply unit 2 including a secondary battery, and controls the overall operation of the mobile phone device according to various programs in the storage unit 3. Is provided with a CPU (Central Processing Unit), a memory and the like. The storage unit 3 is an internal memory and has a program area and a data area. In this program area, a program for realizing the present embodiment is stored in accordance with an operation procedure shown in FIGS. Has been. The storage unit 3 may include a removable portable memory (recording medium) such as an SD card or an IC card.

As shown in FIG. 2, the display unit 4 is arranged in almost the entire area inside the display unit housing A, and can display numerical values, characters, standby images, captured images, animations, and the like with high definition. A time display, reception sensitivity, and the like are displayed in the picto area of the standby screen. The display unit 4 is configured by microcapsule electronic paper (an example of an electrophoretic display) using an electrophoretic phenomenon. That is, the display unit 4 is electronic paper in which a large number of media filled with colored charged particles (charged bodies) are arranged between a pair of opposed electrodes, and a voltage is applied between the pair of electrodes. Then, the display is performed by moving the charged particles in the medium in a direction corresponding to the applied voltage. The display unit 4 is refreshed by monochromatic display (entire black display or full white display) by applying a predetermined voltage between the pair of electrodes in order to eliminate the aggregation and bias of the charged particles. I try to do it. This refresh operation is controlled according to the current state of the mobile phone device, that is, the direction of the display unit 4 and the brightness of the surrounding area.

As shown in FIG. 2, the operation unit 5 is arranged in substantially the entire area inside the operation unit casing B, and performs dial input, character input, command input, and the like. The control unit 1 operates from the operation unit 5. As processing according to the signal, for example, various processing such as transmission processing is executed. The communication unit 6 includes a radio unit, a baseband unit, a demultiplexing unit, and the like. For example, the communication unit 6 transmits and receives data to and from the nearest base station when the call function and the e-mail function are operated. Sometimes, after receiving a signal from the receiving side of the baseband unit and demodulating it into a received baseband signal, the voice is output from the speaker SP for calling through the telephone unit 7, and the input voice data from the microphone MC for calling is also input to the telephone unit 7 and encoded into a transmission baseband signal, which is then given to the transmission side of the baseband part and transmitted from the antenna.

The orientation detection unit 8 is constituted by, for example, a vibration sensor (acceleration sensor), and detects the orientation of the display unit 4 with respect to the user as the current state of the mobile phone device. As shown in FIG. In a state in which the casing A and the operation unit casing B are folded, it is detected whether the display unit 4 faces the user or is in the reverse direction. That is, when the acceleration sensor detects vibration applied to the apparatus main body, the direction detection unit 8 is in a state where the user does not look at the display unit 4 as the direction of the display unit 4 due to the strength of the vibration and the regularity of the change. That is, a reverse state in which the display unit 4 is in the reverse direction with respect to the user is detected. The direction detection unit 8 may detect whether the user is viewing the display unit 4, that is, whether the display unit 4 is facing the user. The control unit 1 controls the refresh operation of the display unit 4 according to the direction of the display unit 4 detected by the direction detection unit 8.

The photographing unit 9 constitutes a video phone function and the like. In addition to a photographing lens, a mirror / lens block such as a mirror, an image sensor, its drive system, a distance measuring sensor, a light quantity sensor, an analog processing circuit, a signal processing circuit, It has a compression / decompression circuit. As shown in FIG. 2, in a state where the folding of the display unit housing A and the operation unit housing B is opened, a photographing lens constituting the photographing unit 9 is disposed below the display unit housing A. The photographing unit 9 photographs the user's face when the photographing lens faces the user (user). When the image photographed by the photographing unit 9 is given to the face detection unit 10, the face detection unit 10 analyzes the photographed image as the current state of the mobile phone device to determine whether the user's face is included. If it is detected and the user's face is included, it is determined that the display unit 4 is facing the user.

The face detection unit 10 captures a captured image, extracts an image portion corresponding to the face portion of a person, and extracts the extracted image (face image) and a registered image (face image) of a user registered in advance. Is sequentially detected to detect whether the user's face is included in the captured image. In this case, the control unit 1 performs the refresh operation of the display unit 4 according to the result of whether the face detection unit 10 includes the user's face (whether the display unit 4 faces the user). I try to control it. That is, when it is determined that the user's face is included and the display unit 4 is facing the user, the refresh operation is started.

The brightness detection unit 11 is an illuminometer that detects the brightness of the periphery of the display unit 4 as the current state of the mobile phone device. As shown in FIG. An optical sensor constituting the brightness detection unit 11 is arranged. The control unit 1 controls the refresh operation of the display unit 4 according to the brightness detected by the brightness detection unit 11. For example, when the display unit 4 is face down on a desk surface, stored in a desk drawer, or in darkness such as at night, the refresh operation of the display unit 4 is executed. . The clock unit 12 measures the current date and time, and the current date and time is displayed on the display unit 4.

Next, the operation concept of the mobile phone device in this embodiment will be described with reference to the flowcharts shown in FIGS. Here, each function described in these flowcharts is stored in the form of a readable program code, and operations according to the program code are sequentially executed. In addition, the operation according to the above-described program code transmitted via the transmission medium can be sequentially executed. That is, in addition to the recording medium, an operation specific to this embodiment can be executed using a program / data supplied externally via a transmission medium.

3 to 5 are flowcharts showing the overall operation of the mobile phone device that is started to be executed when the power is turned on.
First, when the power is turned on, the control unit 1 resets the refresh holding flag to “0” (step S1 in FIG. 3), clears the elapsed time timer (step S2), and starts its measurement operation. (Step S3). This refresh hold flag is a flag indicating whether or not the refresh operation of the display unit 4 is held.
FIG. 6 is a diagram for explaining the refresh holding flag. When the value is “0”, it indicates that “the refresh state is not held” and “1”.
In this case, “refresh state is maintained” is indicated. When the power is turned on, the refresh hold flag is reset to “0”. The elapsed time timer measures the elapsed time from the previous refresh operation, and when the power is turned on, the elapsed time timer is cleared and started.

In this state, the presence / absence of an incoming call from the communication unit 6 is checked (step S4), whether the time acquisition timing for updating the display time is reached (step S9), and the displayed reception sensitivity is updated. It is checked whether or not the reception sensitivity acquisition timing has been reached (step S14). When an incoming call is detected (YES in step S4), in response to an off-hook operation to connect the line (YES in step S5), a call process for making a call ready is executed (step S6), and the line is blocked. In response to the on-hook operation to be performed (YES in step S7), line disconnection processing is performed (step S8). Thereafter, the process returns to step S4.

Further, if it is detected that the time acquisition timing has been received by receiving the carry signal from the clock unit 12 (YES in step S9), if it is not the timing for updating the minute unit (NO in step S10), the above-described steps Returning to S4, if it is time to update the minute unit (YES in step S10), it is checked whether the refresh holding flag is “0” (step S11). If the refresh hold flag is “1”, the process returns to step S4 to invalidate the time display. If the refresh hold flag is “0” (YES in step S11), the time display is in progress. If there is a certain condition (YES in step S12), the time display is updated (step S13).

When it is detected that the reception sensitivity acquisition timing has been reached (YES in step S14), it is checked whether the reception sensitivity in the communication unit 6 has changed (step S15). When the reception sensitivity has changed, the time display described above is performed. As in the case of, on condition that the refresh hold flag is “0” (YES in step S16) and the reception sensitivity is being displayed (YES in step S17), the process proceeds to the next step S18 and the reception sensitivity display is displayed this time. Update the acquired sensitivity.

If it is not the reception sensitivity acquisition timing (NO in step S14), the flow proceeds to the flow of FIG. 4 to check whether the timing for detecting the orientation of the display unit 4 is reached (step S19). It is checked whether it is time to detect brightness (step S20), or it is checked whether it is time to detect the user's face (step S21). Now, when it is time to detect the direction of the display unit 4 (for example, one minute interval) (YES in step S19), the user does not look at the display unit 4 based on the detection result from the direction detection unit 8. It is determined whether the display unit 4 is in the reverse direction with respect to the user (step S22). If the display unit 4 is in the reverse direction, the user is not looking at the display unit 4. If it is determined that there is, the process proceeds to step S23 to check whether the refresh holding flag is “0”.

If the refresh holding flag is “1” in the reverse state of the display unit 4 (NO in step S23), the process returns to step S4 in FIG. 3 because the refresh operation is being performed. Is “0” (YES in step S23), it is checked whether the time measured by the elapsed time timer has exceeded a predetermined time, for example, whether 30 minutes have elapsed since the elapsed time timer started the measurement operation. (Step S24). Here, if it is less than the predetermined time (30 minutes), the process returns to step S4 in FIG. 3 in order to avoid an excessive refresh operation. However, if the predetermined time is exceeded, the condition is satisfied (step S24). YES), the refresh operation of the display unit 4 is started (step S25).

That is, a refresh operation by monochromatic display (black display or white display) is started by applying a predetermined voltage between a pair of electrodes constituting the display unit 4. In this case, the entire display is performed so that the entire display screen is black or white. Then, after changing the refresh hold flag to “1” (step S26), the control unit 1 stops the measurement operation of the elapsed time timer (step S27) and clears the measurement time of the elapsed time timer (step S27). S28), the process returns to step S4 in FIG.

If it is the timing for detecting the brightness of the periphery of the display unit 4 (YES in step S20), it is checked whether the brightness is less than a predetermined value (for example, 10 lux) (step S34), and the brightness is less than the predetermined value. If the periphery of the display unit 4 is dark, for example, it is determined that the display unit 4 is in a state of being concealed on a desk surface, stored in a desk drawer, or the darkness such as at night. (Yes in Step S34), and in the same manner as described above, the condition that the refresh hold flag is “0” (YES in Step S23) and the measured time of the elapsed time timer exceeds the predetermined time (Step S24). At step S25, the refresh operation is started (step S25), and the refresh holding flag is changed to “1” (step S26). Then, the measurement operation of the elapsed time timer is stopped (step S27), the measurement time of the elapsed time timer is cleared (step S28), and the process returns to step S4 in FIG.

If it is the face detection timing (YES in step S21), the image (monitor image) taken by the photographing unit 9 is captured, and the face detecting unit 10 is activated to check whether the user's face has been recognized ( Step S35). In this case, the face detection unit 10 extracts an image of the face portion from the captured image, and sequentially compares the extracted image (face image) with a registered image (face image) of the user registered in advance. . For example, in addition to comparing face shapes, eyes, mouth, nose, forehead shape, position, size, hairstyle, presence / absence and types of glasses, etc., face images can be compared by comprehensively comparing them. And check whether the user's face is recognized.

If the user's face cannot be recognized (NO in step S35), it is determined that the display unit 4 is in the reverse direction with respect to the user, and the refresh hold is performed as described above. On the condition that the flag is “0” (YES in step S23) and the measured time of the elapsed time timer exceeds the predetermined time (YES in step S24), the refresh operation is started (step S25) and the refresh hold is performed. The flag is changed to “1” (step S26). Then, the measurement operation of the elapsed time timer is stopped (step S27), the measurement time of the elapsed time timer is cleared (step S28), and the process returns to step S4 in FIG.

On the other hand, when the display unit 4 is not reversed (NO in step S22), when the periphery of the display unit 4 is bright and exceeds a predetermined value (NO in step S34), or when the user's face is recognized (user) In contrast, if it is determined that the display unit 4 is in the reverse direction (YES in step S35), it is checked whether the refresh holding flag is “0” (step S29). If the hold flag is “0”, the process returns to step S4 in FIG. 3. If the refresh hold flag is “1” (NO in step S29), that is, if the refresh operation is being performed, The process moves to canceling (steps S30 to S33).

That is, the status of the function currently being executed is acquired (step S30), and display information (for example, if the mail function is being executed, display information such as a mail creation screen is generated) from the acquired status. And it is made to display on the display part 4 (step S31). As a result, the refresh operation by single color display (full black display or full white display) is canceled, and the function screen currently being executed is switched. Then, the refresh hold flag is reset to “0” (step S32), and after the elapsed time timer measurement operation is restarted (step S33), the process returns to step S4 in FIG.

On the other hand, if it is not any of the orientation detection timing, brightness detection timing, and face detection timing (NO in step S21), the flow proceeds to the flow of FIG. 5 and the elapsed time timer measurement time is a predetermined time (for example, 2 hours). Is exceeded (YES in step S36), the refresh operation of the display unit 4 is started (step S37). In other words, the refresh operation is started every predetermined time even when the direction detection timing, brightness detection timing, and face detection timing are not reached. Then, after the elapsed time timer is cleared (step S38), the process returns to step S4 in FIG. When a user operation is performed (YES in step S39), for example, after performing a transmission process, an e-mail transmission process, or the like as a process corresponding to the operation (step S40), the process proceeds to step S29 in FIG. If the refresh hold flag is “1” and the refresh operation is in progress (NO in step S29), the process proceeds to the cancellation process (steps S30 to S33).

As described above, in this embodiment, the control unit 1 performs a refresh operation by applying a predetermined voltage to the display unit 4 that performs a display operation using a charged body that moves according to the applied voltage. Since the current state is detected and whether or not the refresh operation is performed is controlled based on the detection result, the refresh operation can be performed at an appropriate timing, and the aggregation and the bias of the charged body are appropriately performed. In addition to being able to prevent, deterioration of the charged body can be effectively prevented as compared with the case where an alternating voltage is applied to the display unit 4, and the practical effect is high.

Since the refresh operation by monochromatic display (for example, black display or white display) is performed on the entire display area of the display unit 4, a refresh effect can be applied to the entire display area, and an effect of preventing deterioration of the charged body can be achieved. Can be further improved.

Since the orientation detection unit 8 detects the orientation of the display unit 4 as the current state of the mobile phone device, it can be easily determined whether or not the user is looking at the display unit 4.

As the current state of the mobile phone device, the face detection unit 10 detects whether or not the user's face has been photographed by the photographing unit 9 and determines the orientation of the display unit 4. It is possible to easily determine whether or not the user is looking at the display unit 4 simply by doing so.

Since the brightness detection unit 11 detects the brightness around the display unit 4 as the current state of the mobile phone device, if the periphery of the display unit 4 is dark, for example, the display unit 4 is a desk surface or the like. It can be determined that the user is in a dark state such as at night or in a dark state such as at night.

Since the refresh operation is canceled when the current state of the mobile phone device changes during the refresh operation, the refresh operation can be held until the state of the mobile phone device changes. The refresh operation can be canceled without performing any operation.

Since the refresh operation is canceled when the user performs an operation during the refresh operation, for example, an operation for instructing mail creation is performed even if the current state of the mobile phone device does not change. It is possible to cancel the refresh operation only.

When canceling the refresh operation, the status of the function in operation is acquired, and the display information corresponding to this status is displayed on the display unit 4. For example, only an operation for instructing mail creation or the like is performed. In addition to canceling the refresh operation, the mail creation screen can be displayed.

Since whether or not to perform the refresh operation is controlled based on the detection result of detecting the current state of the mobile phone device and the measurement time obtained by measuring the elapsed time from the previous refresh operation, In addition to the state, the refresh operation can be controlled according to the elapsed time from the previous refresh operation, which is more effective.

In the above-described embodiment, the refresh operation is performed by monochromatic display (full black display or full white display) by applying a predetermined voltage between the pair of electrodes constituting the display unit 4. For example, a refresh operation for alternately switching between full-color black display and full-color white display may be performed by alternately applying a strong pulse voltage (alternating voltage) having a reverse polarity with a different direction.

In the above-described embodiment, the orientation of the display unit 4 and the brightness of the surrounding area are detected as the current state of the mobile phone device. However, the present invention is not limited to this. It is detected as the current state, and it is determined whether the display unit 4 is not likely to be used or the user is not likely to see the display unit 4 according to the current position and current time, and the refresh operation is performed. You may make it control.

In the above-described embodiment, electronic paper is exemplified as the electrophoretic display. However, the present invention is not limited to this, and an electrophoretic display that performs a display operation using an electrophoretic phenomenon may be used.

In addition, the display unit (main display unit) 4 disposed in substantially the entire area inside the display unit casing A is not limited to the case of being configured by an electrophoretic display. The display unit (sub display unit) that simply displays the remaining battery level may be configured by an electrophoretic display.

Other terminal devices such as PCs, PDAs, digital cameras, music players, etc. that have display screens that perform display operations using charged particles that move according to the applied voltage Is equally applicable.

The block diagram which showed the basic component of the mobile telephone apparatus applied as a terminal device. The figure which showed the state which opened folding of the operation part housing | casing and the display part housing | casing. The flowchart which showed the whole operation | movement of the mobile telephone apparatus started execution with power activation. The flowchart which showed the operation | movement following FIG. The flowchart which showed the operation | movement following FIG. The figure for demonstrating a refresh holding flag.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Control part 2 Power supply part 3 Memory | storage part 4 Display part 5 Operation part 6 Communication part 7 Telephone part 8 Direction detection part 9 Shooting part 10 Face detection part 11 Brightness detection part 12 Clock part

Claims (11)

A terminal device having display means for performing a display operation using a charged body that moves according to an applied voltage,
Refresh means for performing a refresh operation by applying a predetermined voltage to the display means;
Time measuring means for measuring an elapsed time from a previous refresh operation by the refresh means;
Detecting means for detecting a current state of the terminal device;
Based on the detection result by the detection unit, when the current state of the terminal device is determined to be a state in which the display unit is not facing the user , and the previous refresh by the time measurement unit Refresh control means for controlling the operation of the refresh means so as to perform the refresh operation when an elapsed time from the operation exceeds a predetermined time ;
A terminal device comprising: The refresh means performs a refresh operation by monochromatic display on the entire display area of the display means.
The terminal device according to claim 1, which is configured as described above. The detection means detects the direction of the display means as the current state of the terminal device;
The terminal device according to claim 1 , wherein the terminal device is configured as described above. It further includes a photographing means for photographing the user's face,
The detecting means detects the orientation of the display means based on whether or not the user's face is being photographed by the photographing means as the current state of the terminal device;
The terminal device according to claim 1, wherein the terminal device is configured as described above. It said detecting means, current detecting the ambient brightness of the display means as a state, as in the possible terminal device according to claim 1 or 2, characterized in the the terminal device. It further includes a photographing means for photographing the user's face,
The detection means includes
First detection means for detecting the orientation of the display means as the current state of the terminal device;
Second detection means for detecting the orientation of the display means based on whether or not the user's face has been photographed by the photographing means as the current state of the terminal device;
Third detection means for detecting brightness around the display means as a current state of the terminal device;
With
The refresh control unit is configured to display the current state of the terminal device based on a detection result of at least one of the first detection unit, the second detection unit, or the third detection unit. 3. The terminal device according to claim 1, wherein it is determined whether or not the means is facing the user. When the detection result of the detection means changes during the refresh operation, the refresh control means cancels the refresh operation;
The terminal device according to claim 1 , wherein the terminal device is configured as described above. When an operation by a user is performed during the refresh operation, the refresh control unit cancels the refresh operation.
The terminal device according to claim 1 , wherein the terminal device is configured as described above. The refresh control means acquires the state of the function being operated when canceling the refresh operation, and causes the display means to display display information corresponding to the state.
As to the possible terminal apparatus as set forth in any one of claims 7 or claim 8, wherein. Even if the refresh control means determines that the current state of the terminal device is a state where the display means faces the user based on the detection result by the detection means, When the elapsed time from the previous refresh operation by the time measuring means exceeds a predetermined time, the operation of the refresh means is controlled to perform the refresh operation.
The terminal device according to claim 1, which is configured as described above. Against the computer,
A function of performing a refresh operation by applying a predetermined voltage to display means that performs a display operation using a charged body that moves in accordance with an applied voltage;
A function to measure the elapsed time since the last refresh operation,
The ability to detect the current state,
Based on the detection result, the current state is determined to be a state where the display means does not face the user , and the elapsed time from the previous refresh operation exceeds a predetermined time. If you are a function of controlling the operation of the refresh means to perform the refresh operation,
A program to realize

Images