JP4241337B2 - Mobile phone and display control program - Google Patents

Description

The present invention relates to a mobile phone and a display control program .

In recent years, there is a mobile phone equipped with a camera function and a mail function as a camera having a wireless communication function.
Such a mobile phone has both a call processing function and a data communication function such as e-mail communication, which are originally intended for use, and a still image shooting function and a video shooting function by a camera. When an incoming call is not detected, there are cases in which shooting must be interrupted and some response processing must be performed for the incoming call, and there are various cases related to simultaneous processing of such shooting operation and incoming call processing operation. A device has been proposed (see, for example, Patent Document 1).
JP 2001-78078 A

  However, in the above-mentioned document, the user has to learn in advance about the response processing at the time of incoming call and the corresponding key operation method, and there are various response processing methods when an unexpected incoming call is detected during the shooting operation. There was a problem that the user lacked usability.

An object of the present invention is to provide a mobile phone and a display control program capable of guiding a response operation that is easy for a user to understand even when an unexpected voice call is received when an image is displayed by a shooting operation or the like. is there.

The invention of claim 1, wherein the control and display means, input means, an image to be processed by the operation of the image compression and expansion processing program, the operation of the pre-Symbol image compression and expansion processing program that corresponds to the input by the input means a control content for the first display control means for displaying on said display means, and call detection means for detecting a voice incoming call, when the display means is controlled by said first display control means If the incoming call by prior Symbol incoming detection means is detected, changing means for changing the control contents displayed by said first display control means to the control content corresponding to the incoming call detection including pending response to the incoming voice call If, upon detecting the input by the entering force means corresponding to hold the response of the control content that has been changed by the changing unit, together with starting the hold of the response Characterized by comprising a first control means for controlling to display the duration of the hold on the display means.

According to a second aspect of the present invention, in the first aspect of the present invention, the first determination means for determining whether or not a message transmission instruction for the voice incoming call is detected during the duration , and the first determination means. If the determination means determines that the message transmission instruction has been detected, it further comprises a transmission means for releasing the hold and transmitting the message .

The invention according to claim 3 is the invention according to claim 1 or 2, wherein the duration is preset, and whether or not a continuation instruction to hold the response is detected during the duration. A second determination means for determining the continuation time, and if the second determination means determines that the continuation instruction has been detected, the continuation time is restarted and control is performed to display the continuation time duration on the display means. And a second control means .

According to a fourth aspect of the invention, in the invention according to any one of the first to third aspects, when a voice incoming call is detected by the incoming call detecting means, caller information corresponding to the detected voice incoming call is displayed. The display device further comprises second display control means for controlling the display means .

According to a fifth aspect of the invention, in the invention according to any one of the first to fourth aspects, the image compression / decompression processing program is detected when an input by the input means corresponding to the control content changed by the changing means is detected. It is characterized by further comprising third control means for controlling to interrupt the operation .

The invention according to claim 6 is the invention according to any one of claims 1 to 5, further comprising an imaging unit, and the image compression / decompression processing program processes an image captured by the imaging unit by its operation. It is the program which carries out.

Invention of claim 7, the computer, and an image to be processed by the operation of the image compression and expansion processing program, the control content for controlling the operation of the pre-Symbol image compression and expansion processing program that corresponds to the input from the input unit when, the display control means for displaying on the display unit, the incoming detection means for detecting a voice incoming call, the incoming call is detected by the pre-Symbol incoming detecting means when the display unit is controlled by said display control means, Change means for changing the control content displayed by the display control means to control content corresponding to incoming call detection including hold of a response to the voice incoming call, of the control content changed by the change means to hold the response When an input from the corresponding input unit is detected, the response is suspended and the duration of the suspended state is displayed on the display unit. Wherein the control means to function as, for.

According to the present invention, when there is an unexpected voice call while displaying an image, the control content displayed together with the image is switched to the response processing content, so that the user can hold the response to the voice call while continuing the shooting operation. It is possible to display the contents of response processing when a voice call is received.

<Embodiment>
Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the present embodiment, the imaging device is described as a two-fold type mobile phone having a camera function.
1A and 1B are diagrams showing an open state of the mobile phone 1 according to the present embodiment, where FIG. 1A is a front view and FIG. 1B is a rear view.

  As shown in FIG. 1A, a main display unit (display means) 11 for displaying various types of information such as graphics and images and displaying operation guidance for the operator is provided on the surface of the mobile phone 1. Has been. The main display unit 11 is formed of color liquid crystal and has a resolution equivalent to QVGA.

Above the main display unit 11, a speaker 12 that outputs a received voice in a call mode or the like is disposed.
Below the main display unit 11, a key operation unit (input unit) 14 is provided for an operator to input various information, give a function instruction, and the like.

  The key operation unit 14 includes a camera key 141 that is operated when the shooting mode is operated, a mail key 142 for operating the mail mode, a determination key 143 that instructs determination in each mode, and up, down, left, and right in each mode. A cursor key 144 and the like for performing a selection operation are provided.

  The camera key 141 is also operated when operating a specific function in each mode. The enter key 143 is also operated when instructing a shutter in the shooting mode.

  The key operation unit 14 includes an address book key 145 operated when operating the address book mode, a clear key 146 for instructing cancellation in each mode, a numeric keypad 147 for instructing character input and dial input, an Internet In addition to the Web key 109 for instructing connection, an off-hook key 111, an on-hook / power ON / OFF key 112, and the like are also provided.

The address book key 145 is also operated when a specific function is operated in each mode.
Below the key operation unit 14, a microphone 15 that collects a transmitted voice in a call mode or the like is disposed.

  As shown in FIG. 1B, a sub display unit 21 is disposed on the back surface of the mobile phone 1. The sub display unit 21 is formed of a color liquid crystal and can inform the operator of a simple message even when the lid is closed.

A microphone 22 is disposed above the sub display unit 21. The microphone 22 is for collecting sound when the recording function is operated in the shooting mode or the like.
Below the sub display unit 21, a photographing lens (photographing means) 23 for photographing a still image or a moving image in a photographing mode or the like is disposed.

  A notification LED 24 and a flash LED 25 are arranged on the side of the photographing lens 23. The notification LED 24 is lit to notify the photographer or the like of an incoming call or a warning. The flash LED 25 is lit to brighten the periphery of the subject during shooting.

  Further, an antenna 27 for communicating with a server of a communication service company is extendably provided on the side of the flash LED 25. The antenna 27 corresponds to a predetermined frequency band, specifically, a frequency band used in a portable wireless protocol adopted by a communication service company.

  Below the photographic lens 23 is provided a notifying speaker 26 that outputs a ringtone or a warning sound to notify an operator or the like.

Further, as shown in FIG. 2, the mobile phone 1 includes a control unit 32 (display control means, incoming call detection means, change means, control means) that controls the operation and mode switching of the mobile phone 1.
The control unit 32 includes a communication data processing unit 321, a system ROM 322, and an audio interface 323.

  The communication data processing unit 321 includes a CLEP vocoder, a speech decoding processing circuit, a packet data generation circuit, a packet data restoration circuit, and the like. Accordingly, the communication data processing unit 321 performs input / output control of packet data including voice data, mail data, still image data, and moving image data. Specifically, the communication data processing unit 321 allows data input / output based on a terminal authentication method set in advance for data input from the wireless unit 31. In addition, the communication data processing unit 321 controls the WWW connection.

  The system ROM 322 stores an OS basic system, authentication data set for each subscriber or terminal, and a communication protocol processing program. The authentication data includes a telephone number and a mail address set for the mobile phone 1.

  The audio interface 323 is connected to the microphones 15 and 22 and the speaker 12, and controls audio input / output. Specifically, the audio interface 323 compresses and encodes the voice input from the microphones 15 and 22 during voice call or recording based on the CELP voice coding system. The audio interface 323 decodes the compressed voice data input from the communication data processing unit 321 or the address / data bus processing unit 33 during voice call or video playback, and outputs the decoded voice data from the speaker 12. Yes.

An antenna 27 is connected to the control unit 32 via a wireless unit 31.
The radio unit 31 extracts a radio signal addressed to the mobile phone 1 from radio signals input via the antenna 27 and outputs the radio signal to the control unit 32. The radio unit 31 converts various digital data output from the control unit 32 into radio signals and outputs the radio signals to the antenna 27. In this embodiment, the CDMA system is adopted as the radio signal format, and the QPSK modulation / demodulation system is adopted as the modulation / demodulation system.

Connected to the control unit 32 is an address / data bus processing unit 33 that controls input / output timing of data with peripheral circuits of the control unit 32 (portion surrounded by a broken line in FIG. 2).
The address / data bus processing unit 33 is connected to a RAM 34, a program ROM 35, a sound source IC 36, a display module system driver 37, an imaging device (imaging means) 39, a DSP 38, and the like.

  The RAM 34 stores data necessary for the operation of the control unit 32. The RAM 34 also stores data necessary for the mobile phone and the imaging device, such as address book data, mail data, compression-encoded still image data, and moving image data.

  The program ROM 35 is composed of an electrically rewritable flash ROM. The program ROM 35 stores application software that operates in various modes, such as an image compression / decompression processing program that operates in the shooting mode.

  The sound source IC 36 stores melody sound source information converted into digital data. The notification speaker 26 is connected to the sound source IC 36 via the AMP 360.

  The display module system driver 37 controls display output and notification output by the main display unit 11, the sub display unit 21, the notification LED 24, and the flash LED 25.

  The imaging device 39 is composed of a CCD or a CMOS. The imaging device 39 outputs a still image or moving image captured by the photographing lens 23 as an electrical signal.

  The DSP 38 converts an analog electric signal output from the imaging device 39 into a digital signal.

  Next, the operation of the mobile phone 1 when there is an incoming voice call after the start of image shooting will be described with reference to FIGS. In the following description, the mobile phone 1 is described as being in motion picture shooting, but may be in still image shooting.

  First, when the operator operates the camera key 141 or the like, the mobile phone 1 enters a shooting mode and starts shooting a moving image using the shooting lens 23. At this time, the main display unit 11 displays the subject within the “monitor display” frame in FIG. 5A (step S1). In addition, the main display unit 11 displays “cancel”, “pause”, and “end” options at the lower end. Here, “Cancel” means that image shooting is stopped, “Pause” means that image shooting is paused, and “End” means that shooting mode ends. These options are selected by using the cursor key 144, the enter key 143, and the like. If no option is selected, the mobile phone 1 continues to take an image.

  In this state, as a parallel process, the mobile phone 1 determines whether the mobile phone 1 has received and detected a voice incoming request signal via the server (step S2). If no reception is detected, the process returns to step S1 and the processing continues. If detected, the main display unit 11 displays the subject in the center and receives the incoming call as shown in the dashed-dotted frame in FIG. 5B. Based on caller information (for example, the telephone number of the communication terminal that made the call) included in the voice incoming request signal, the other party's telephone number is displayed in a pop-up (speech balloon) at the bottom ( Step S3).

Further, the main display unit 11 switches to the display of “abort”, “pause”, and “end”, and displays three options “reject”, “speak”, and “hold” at the lower end. These options are for instructing the operator to select whether or not to stop image capturing. On the other hand, the operator operates the camera key 141 to select “reject”, the enter key 143 to select “speak”, and the address book key 145 to select “hold”.
In this way, the information of the other party who made the call and the image being shot are displayed on the main display unit 11 at the same time, so the operator can select according to the other party who made the call and the importance of the shooting. It can be carried out.

In receiving, it is preferable that no sound or vibration is generated so that a photographed image does not blur or a ringtone does not enter.
In FIG. 5B, the telephone number of the communication partner is displayed. However, when the communication partner is registered in the address data in the RAM 34, the communication partner of FIG. It is preferable that a registered name and a registered image are displayed as shown in a dashed-dotted frame. In this case, the incoming call is displayed in an easy-to-understand manner.

  When the operator operates the camera key 141 to select “reject” (step S4), this is detected, the response to the incoming call is rejected, and a pop-up message is displayed (step S5). Return image shooting continues. At this time, as shown in FIG. 5 (d), the main display unit 11 continues to display the subject in the center and displays that the response has been rejected in the lower part. Note that “Reject” may be selected when there is an incoming voice call from a party that does not want to talk. In such a case, after selecting “reject”, the operator may select whether or not to register call rejection.

  On the other hand, when the operation of the camera key 14 by the operator is not detected, it is determined whether or not the enter key 143 is operated, that is, whether or not “speak” is selected (step S6). When “speak” is selected, the current shooting state is held in the RAM 34, and the mode is changed from the shooting mode to the call mode (step S7). As shown in FIG. S8). The data held in the RAM 34 is held as an image without being compressed. Then, it is determined whether or not the call has ended (step 9). When the end of the call is detected, the shooting mode is restored (step S10), and the process proceeds to step S1.

If no operation of the camera key 141 or the enter key 143 by the operator is detected, it is determined whether or not the address book key 145 is operated, that is, whether or not “hold” is selected ( Step S11). When selection of “hold” is detected, a timer that operates for a certain period of time is started (step S12), image shooting is continued, and the communication partner is notified through the server that the call is on hold. Is done. Further, the main display unit 11 displays the subject in the center, and indicates that the subject is on hold and the duration of the hold state (counting from the timer start) as shown in the dashed-dotted frame in FIG. Value) is displayed in a pop-up at the bottom (step S13). On the other hand, it is determined whether or not the operator operates the camera key 141, the enter key 143, and the address book key 145 (steps S14, S16, and S18), and if the camera key 141 is operated, it is determined that “speak” is selected. If the enter key 143 is operated, it is determined that “holding is continued”, and if the address book key 145 is operated, it is determined that “absence” is selected. If neither is detected, the timer time-up is detected (step S20).
When the operator selects “speak”, the timer is reset in step S15, and the mobile phone 1 is shifted from the shooting mode to the call mode (step S8).

  On the other hand, when the operation of the camera key 141 by the operator is not detected and the operation of the address book key 145 is detected in step S16, the hold is released and a message indicating absence is sent to the server ( Step S17), the process returns to step S1. In the state of step S17, the main display unit 11 deletes the notification message while displaying the subject in the center, and further transmits an absence message as shown in the dashed-dotted frame in FIG. A flashing message is displayed at the bottom.

  If the operation of the enter key 143 is detected in step S18 without detecting any operation of the camera key 141 or the address book key 145 by the operator, it is determined that the hold state is continued and already started. The timer is reset (step S19) and restarted (step S20). Accordingly, the number of seconds in the pop-up display of “pending xx seconds” displayed in FIG. 5F is returned to the number of seconds from the start time again, and the hold state from step S13 is continued.

  If none of the above operations are detected, it is determined whether or not the timer has timed out (step S21). If no time-up is detected, the process proceeds to step S13. On the other hand, when time-up is detected, the hold is canceled and a message indicating absence is sent to the server (step S17), and the process returns to step S1.

  If no operation is detected while detecting the voice incoming request signal, the display state is maintained until reception of the voice incoming request signal is stopped in step S22. And when the stop of reception is detected in step S23, it returns to the process of step S1.

  Next, the operation of the mobile phone 1 when an incoming mail is received during moving image shooting will be described with reference to FIGS. In the following description, the mobile phone 1 is described as being in motion picture shooting, but may be in still image shooting.

  First, when the operator operates the camera key 141 or the like, the mobile phone 1 enters a shooting mode, and starts moving image shooting using the shooting lens 23 (step S31). At this time, the main display unit 11 displays the same as in FIG.

  In this state, when the mobile phone 1 receives mail via the server (step S32), a timer is started (step S33).

  If the mail has not been received, the operation in step S31 is continued again. However, when the mail is received, the main display unit 11 displays the subject in the center, as shown in the dashed-dotted frame in FIG. 7B. The notification message for notifying the incoming call and the mail address of the communication partner are displayed in a pop-up on the upper end (step S34).

The main display unit 11 displays three options “mail”, “pause”, and “end” at the lower end. These options are for instructing the operator to select whether or not to stop image capturing. On the other hand, the operator operates the camera key 141 to select “mail”, the enter key 143 to select “pause”, and the address book key 145 to select “end”. I do. Then, the control unit 36 selects a process to be performed next depending on whether or not “mail” is selected (step S35).
As described above, the information of the other party who made the call and the image being photographed are displayed on the main display unit 11 at the same time. Therefore, the operator can select according to the partner who has sent the mail and the importance of the photographing. It can be carried out.

In receiving, it is preferable that no sound or vibration is generated so that a photographed image does not blur or a ringtone does not enter.
The mail address is preferably scrolled. In this case, even if the mail address does not fit within the screen, the address of the communication partner is displayed in an easy-to-understand manner for the operator.
Further, in FIG. 7 (b), the mail address of the communication partner is displayed, but when the communication partner is registered in the address data in the RAM 34, the mail address of FIG. 7 (c) is displayed. It is preferable that a registered name and a registered image are displayed as shown in a dashed-dotted frame. In this case, it is displayed more clearly who the mail is coming from.

  When the operator selects “mail”, the control unit 32 temporarily stores the data being shot in the RAM 34 (step 36) and shifts from the shooting mode to the mail mode (step S37). . Further, the main display unit 11 displays a mail folder list as shown in FIG.

On the other hand, when the time-up is detected in step S38 while the operator does not select anything, the cellular phone 1 continues to take an image (step S39). At this time, the main display unit 11 deletes the notification message while displaying the subject in the center, and further displays that the incoming mail has been received at the upper end as shown in the dashed-dotted frame in FIG. Display pictograms. Thus, since the notification message is erased from the main display unit 11 after a short period of time compared to the case of voice incoming, it is possible to take an image while making it easier to see the subject.
When the image shooting is completed, the operator can set the mobile phone 1 in the mail mode as necessary, and can display the received mail on the main display unit 11.

  According to the mobile phone 1 as described above, it is possible to select whether or not to continue the shooting mode according to the subject when there is an incoming voice call or mail during the moving image or still image shooting mode.

  In addition, since the information on the other party of the communication destination and the image being captured are displayed at the same time on the main display unit 11, selection can be performed while continuing image capturing. In addition, the selection can be made according to the other party or the subject who made the call.

  In addition, since the duration time of the hold state is displayed on the main display unit 11, it is possible to prevent the user from being engrossed in shooting and making the other party wait too much.

<Modification of Embodiment>
Then, the modification of the said embodiment is demonstrated. In addition, the same code | symbol is attached | subjected to the component same as the said embodiment, and the description is abbreviate | omitted.

The mobile phone 1 in the present modification has the same configuration as that of the mobile phone 1 described in the above embodiment, but when there is an incoming voice call after the start of image shooting, the control unit 32 1 is automatically switched from the shooting mode to the call mode.
According to such a mobile phone 1, if there is an incoming voice call when taking an image, a call is made immediately, and if there is an incoming mail when taking an image, whether to continue the shooting mode is determined to the subject or the sender of the mail. Can be selected accordingly.

  In the above-described embodiment, it has been described that the mail folder list is displayed on the main display unit 11 when the operator selects “mail” during the shooting mode. It is good to be done.

  Moreover, although it has been described that the main display unit 11 displays the instruction to select whether or not to continue image shooting, it may be displayed by blinking a key of the key operation unit 14 or the like.

It is a figure which shows the mobile telephone in this Embodiment, (a) is a figure on the surface side, (b) is a figure on the back side. It is a block diagram showing a schematic configuration of a mobile phone in the present embodiment. It is a figure for demonstrating operation | movement of a mobile telephone when there exists an audio | voice incoming during image pick-up. It is a figure for demonstrating operation | movement of a mobile telephone when there exists an audio | voice incoming during image pick-up. It is a figure which shows the display screen of a main display part. It is a figure for demonstrating operation | movement of a mobile telephone when there exists a mail incoming during image photography. It is a figure which shows the display screen of a main display part.

Explanation of symbols

1 Mobile phone (imaging device)
11 Main display section (display means)
12 Speaker 14 Key operation part (input means)
15 Microphone 23 Shooting lens (shooting means)
32 Control unit (display control means, incoming call detection means, change means, control means)
39 Imaging device (photographing means)

Claims (7)

Display means;
Input means;
The display and image processed by the operation of the image compression and expansion processing program, and a control content for controlling the operation before Symbol image compression and expansion processing program that corresponds to the input by the input means on the display means 1 Display control means,
An incoming call detection means for detecting an incoming voice call ;
When a voice call is detected by the pre-Symbol incoming detecting means when said display means is controlled by said first display control means, the incoming call control what is displayed by the first display control means Change means for changing to control content corresponding to incoming call detection including pending response to
Upon detecting an input by the entering force means corresponding to hold the response of the control content that has been changed by the changing unit, together with starting the hold of the response, to display the duration of the hold on said display means First control means for controlling;
A mobile phone characterized by comprising: First determination means for determining whether or not a message transmission instruction for the incoming voice call is detected during the duration;
When it is determined that the message transmission instruction is detected by the first determination unit, the holding unit releases the hold and transmits the message.
The mobile phone according to claim 1 , further comprising: The duration is preset, and a second determination means for determining whether or not an instruction to continue holding the response is detected during the duration;
If it is determined that the continuation instruction has been detected by the second determination means, the second control means for starting the duration again and controlling the display means to display the duration of the hold state;
The mobile phone according to claim 1, further comprising: When a voice call is detected by the incoming call detecting means, and further comprising a second display control means for controlling said display means to display the caller information corresponding to the detected incoming call The mobile phone according to any one of claims 1 to 3 . The system further comprises third control means for controlling to interrupt the operation of the image compression / decompression processing program when an input by the input means corresponding to the control content changed by the changing means is detected. Item 5. The mobile phone according to any one of Items 1 to 4. Further comprising an imaging means,
The image compression and expansion processing program, a mobile phone according to any one of claims 1 to 5, characterized in that a program for processing an image captured by the imaging unit by its operation. Display for displaying the image processed by the operation of the image compression expansion processing program a computer, and a control content for controlling the operation of the pre-Symbol image compression and expansion processing program that corresponds to the input from the input unit on the display unit Control means,
Incoming call detection means for detecting incoming voice calls ,
When a voice call is detected by the pre-Symbol incoming detecting means when the display unit is controlled by said display control means includes a pending response control content displayed by said display control means with respect to the incoming call Changing means for changing to control content corresponding to incoming call detection,
When the input from the input unit corresponding to the suspension of the response is detected among the control contents changed by the changing means , the response is suspended and the duration of the suspension state is displayed on the display unit. Control means for controlling,
A display control program characterized by functioning as

Images