JP2008305108A - Handwriting input device, control method thereof, handwriting input control program, and recording medium with the program recorded thereon - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a handwriting input device, etc., wherein restriction to a handwriting input range is reduced. <P>SOLUTION: The handwriting input device is prepared for inputting handwritten data. The handwriting input device is provided with a display part 24 for displaying information, a displacement detection part 31 for detecting displacement of at least two axes of its own device, a locus creation part 41 for creating locus data indicating the locus of changes of the own device as handwritten data on the basis of the displacement information detected by the displacement detection part 31, and a display control part 42 for controlling the display part 24 so as to display a part or all of the locus. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a handwriting input device for inputting handwritten information, a control method therefor, a handwriting input control program, and a recording medium on which the program is recorded. In particular, the present invention relates to input of handwritten information in a mobile terminal.

  In recent years, mobile terminals such as mobile phones have become widespread. In addition, mobile terminals have become multifunctional, and accordingly, key operations for operating functions have become complicated. If the key operation is complicated as described above, a person unfamiliar with the key operation takes time to input characters.

  On the other hand, in a portable terminal having an input function only for key operations, a user can create handwritten characters, figures, etc. (hereinafter referred to as “characters”) or display the created handwritten characters, etc. Inconvenience that it is difficult occurs.

  Thus, a handwritten character input method is known in which characters and the like are input using an input pad instead of key operations. This is because the input pads in which pressure-sensitive elements are arranged in a matrix on a transparent film are pasted on a display device, and pressure is applied to the input pads with a pen-like instrument to indicate coordinates or handwritten characters. Or the like.

  Non-Patent Document 1 discloses a system that allows a user who wears a wearable computer to write information using a pen at any place and share the information with other users. Yes. In this system, when a user wearing a transmissive head mounted display (HMD) or a monocular eyephone moves outdoors or indoors, stops at an appropriate location, and moves a two-dimensional input device such as a gyro sensor in the air, You can create a virtual memo.

  Conventionally, there has been considered a system that enables input of characters and figures by photographing a light locus such as a penlight with a camera.

Non-Patent Document 2 discloses a handwriting input system in which a pen device is equipped with a camera and a laser pointer, and a handwritten character or the like is input by photographing the locus of the laser pointer with the camera.
Japanese Patent Laying-Open No. 2005-284882 (released on October 13, 2005) Ichiro Shiio and Yoshinobu Yamamoto, “Air Pen: Sharing Information by Drawing in Space”, “59th National Convention of Information Processing Society”, Proceedings (4), p. 39-40, September 29, 1999 Yusuke Sakan, "Pen device for generating high-definition handwritten information suitable for wearable computers", Master thesis, February 6, 2004

  However, the method of inputting characters or the like instead of the above key operation has the following problems.

  That is, since it is necessary to separately provide an input pad, a pen device, an HMD, and the like, the cost of components increases. Also, in the handwritten character input method using the input pad, it is difficult to write if the screen to be written is small like a mobile terminal.

  When using an input pad or pen device on a mobile terminal, the user holds the mobile terminal with one hand and operates the input pad or pen device with one hand. It will be blocked for input operation.

  The present invention has been made in view of the above problems, and an object of the present invention is to provide a handwriting input device with few restrictions on the handwriting input range. In particular, an object of the present invention is to provide a portable handwritten input device that can input handwritten information by one-handed operation.

  A handwriting input device according to the present invention is a handwriting input device for inputting handwritten information, a display unit for displaying information, a displacement detecting means for detecting displacement information of at least two axes of the own device, and the displacement Based on the displacement information detected by the detecting means, trajectory creating means for creating trajectory information indicating a trajectory of change of the device as the handwritten information, and controlling the display unit to display a part or all of the trajectory. And a display control means.

  Moreover, the control method of the handwriting input device which concerns on this invention is a handwriting input device for inputting handwritten information, Comprising: In order to solve the said subject in the control method of a handwriting input device provided with the display part which displays information. In addition, a displacement detection step for detecting displacement information of at least two axes of the own device and, based on the displacement information detected in the displacement detection step, locus information indicating a change locus of the own device is created as the handwritten information. And a display control step of controlling the display unit so as to display a part or all of the trajectory.

  Here, examples of handwritten information include handwritten characters, symbols, figures, and the like. Moreover, said axis is a concept including a coordinate axis and a rotation axis.

  According to the above configuration and method, when the device is moved, displacement information is detected, and based on the detected displacement information, locus information indicating a locus of change of the device is created as handwritten information, and the created locus A part or all of is displayed. Therefore, in the handwriting input device of the present invention, the handwritten input range is a range in which the device can be moved, and thus there are fewer restrictions on the handwriting input range than conventional input devices such as an input pad. That's it. As a result, it is possible to input handwritten characters desired by the user.

  The trajectory information may be acquired from a trajectory creation unit or may be acquired from a storage unit. That is, the handwriting input device according to the present invention further includes a storage unit that stores information, the trajectory creation unit writes the created trajectory information in the storage unit, and the display control unit includes the storage unit. A part or all of the trajectory may be acquired from the unit.

  There may also be cases where it is desired to correct the trajectory. Therefore, the handwriting input device according to the present invention further includes a trajectory erasure unit that erases a part of the trajectory indicated by the trajectory information stored in the storage unit based on the displacement information detected by the displacement detection unit. preferable.

  Furthermore, in the handwriting input device according to the present invention, an operation unit that receives a user operation, and an operation that instructs one of the trajectory creation unit and the trajectory deletion unit to operate based on the operation in the operation unit It is preferable to further include an instruction unit. In this case, the trajectory can be created or deleted based on the user's operation.

  In the handwriting input device according to the present invention, the display control unit detects a display area displayed in the display screen of the display unit among display images to be displayed on the display unit. It is preferable to control the display unit so as to change based on the displacement information. In this case, the display image having a size larger than the display screen of the display unit can be easily confirmed by moving the handwriting input device. Therefore, a locus having a size larger than that of the display screen can be easily confirmed by moving the handwriting input device.

  Furthermore, it is preferable that the display control unit controls the display unit so that a position of the display image corresponding to the displacement information detected by the displacement detection unit is displayed in the display screen. Here, the position of the display image corresponding to the displacement information is handwritten by the user, such as the position of the trajectory being created by the trajectory creation means or the position of the trajectory being erased by the trajectory elimination means. This is a position that is executed by moving the input device, that is, a position that the user is paying attention to. Therefore, in the above case, it is possible to prevent the position of the display image that the user is paying attention from from the display screen.

  The handwriting input device according to the present invention further includes an imaging unit that performs imaging, and the displacement detection unit may detect displacement information of the own device based on a captured image captured by the imaging unit. Good. In this case, the present invention can be realized without adding additional components if it is an electronic device including a photographing unit and a display unit, such as a mobile phone or a digital camera.

  Note that methods for detecting displacement information from a captured image include a method of detecting a motion vector from a captured image, and a method of detecting a relative position with respect to a reference object from a captured image of the reference object. For detecting the displacement information of the device itself, a position sensor, an acceleration sensor, a gyro sensor, or the like may be used in addition to the photographing unit.

  The handwriting input device according to the present invention can be applied to a portable electronic device. In this case, handwritten information can be input simply by moving the portable electronic device with one hand.

  Each means of the handwriting input device can be executed on a computer by a handwriting input control program. Further, by storing the handwriting input control program in a computer-readable recording medium, the handwriting input control program can be executed on an arbitrary computer.

  As described above, the handwriting input device according to the present invention is capable of inputting handwritten information by moving the device itself, so that the handwriting input range is less restricted than conventional input devices. Play.

[Embodiment 1]
An embodiment of the present invention will be described with reference to FIGS. In this embodiment, the handwriting input device of the present invention is applied to a camera-equipped mobile phone.

  FIG. 2 shows the appearance of the mobile phone 10 of the present embodiment. The mobile phone 10 is a so-called clamshell type, and is shown in an open state in FIG. (A) of the figure shows a portion that becomes an inner side when the cellular phone 10 is closed, and this portion is a side that is mainly used by the user when the cellular phone 10 is opened. Therefore, in the present application, the side shown in FIG. Moreover, (b) of the figure shows the part which becomes outside when the cellular phone 10 is closed, and this part is the opposite side to the (a) side of the figure when the cellular phone 10 is opened. It becomes. Therefore, in the present application, the side shown in FIG. That is, in FIG. 2, (a) is a front view and (b) is a rear view.

  The mobile phone 10 has a display screen 12 on which information is displayed on the front side of the housing 11, an operation button group 13 for receiving user operations, a mouthpiece 14 for allowing the user's voice to reach the microphone, An earpiece 15 for allowing sound output from the earphone or the speaker to reach the outside is provided, and a camera (photographing unit) 16 that performs imaging on the back side of the housing 11 is provided.

  The operation button group 13 includes a function button group for performing various settings and function switching in the mobile phone 10 and an input button group for inputting symbols such as numbers and characters. Specifically, the function button group includes a power button for switching on / off the power of the mobile phone 10, a camera button for starting the camera 16, a mail button for starting mail software, and a selection target A cross button for moving up, down, left and right, a determination button arranged at the center of the cross button for determining various selections, for canceling input symbols and canceling operations Includes a clear button. The input button group is a numeric keypad.

  The camera 16 is for photographing a subject. Specifically, the camera 16 includes an imaging device such as a charge coupled device (CCD) and a complementary metal-oxide semiconductor (CMOS) image sensor and an optical system.

  The mobile phone 10 according to the present embodiment detects displacement information of at least two axes of the own device, creates trajectory data indicating the trajectory of the change of the own device as handwritten data based on the detected displacement information, and Some or all of them are displayed. Thus, the handwritten input range in the mobile phone 10 is a range in which the mobile device can be moved, so that there are fewer restrictions on the handwritten input range than conventional input devices such as an input pad. As a result, it is possible to input handwritten characters desired by the user.

  Next, a detailed configuration of the mobile phone 10 will be described with reference to FIGS. FIG. 3 shows a specific example of the hardware configuration of the mobile phone 10 in the present embodiment. As shown in the figure, the mobile phone 10 includes a control unit 20, an input / output unit 21, and a storage unit 22.

  The control unit 20 comprehensively controls various components in the mobile phone 10. The function of the control unit 20 is realized by a CPU (Central Processing Unit) executing a program stored in a storage device such as a RAM (Random Access Memory) or a flash memory. Details of the control unit 20 will be described later.

  The input / output unit 21 inputs / outputs information from / to the outside of the mobile phone 10. The input / output unit 21 includes an operation unit 23, a display unit 24, an image input unit (imaging unit) 25, a communication unit 26, an audio input unit 27, and an audio output unit 28.

  The operation unit 23 creates operation data and transmits it to the control unit 20 when the user operates an input device such as the operation button group 13 provided on the surface of the mobile phone 10. Examples of the input device include a touch panel in addition to the button switch.

  The display unit 24 receives image data from the control unit 20 and displays an image on the display screen 12 based on the received image data. Specifically, the display unit 24 includes a display element such as an LCD (Liquid Crystal Display), a PDP (Plasma Display Panel), and an EL (Electroluminescence) display, and a driver circuit that drives the display element based on received image data. Is included.

  The image input unit 25 receives input of a captured image captured by the camera 16 and generates captured image data. The image input unit 25 transmits the generated captured image data to the control unit 20. Specifically, the image input unit 25 includes a video processing circuit that converts an electrical signal from the camera 16 into digital video data of RGB colors.

  The communication unit 26 is for communicating with an external device. Specifically, the communication unit 26 includes an antenna, a communication processing circuit, and the like.

  The voice input unit 27 converts a sound wave input from the outside into a voice signal that is an analog electric signal, further converts the voice signal into a predetermined digital format, and transmits the voice data to the control unit 20. Specifically, the voice input unit 27 includes a microphone, an A / D converter, a voice encoder, and the like.

  The audio output unit 28 converts the audio data from the control unit 20 into an audio signal, further converts it into a sound wave, and outputs it to the outside. Specifically, the audio output unit 28 includes an audio decoder, a D / A converter, a speaker, an earphone, an audio output connector, and the like. Normally, the mobile phone 10 uses an earphone when making a call, and a speaker when making an incoming call notification or a videophone call. Also, when listening to music, headphones are connected to the audio output connector in consideration of the surrounding people.

  The storage unit 22 stores various data and programs. The storage unit 22 includes a program storage area 29 that stores a program executed by the control unit 20 and a data storage area 30 that stores intermediate data of the program or data received from another device. Specifically, the storage unit 22 includes a ROM (Read Only Memory) that is a read-only semiconductor memory and a RAM as a working memory.

  Although the above configuration is a hardware configuration of a general mobile phone, the hardware configuration of the handwriting input device according to the present invention is not limited to the hardware configuration shown above.

  In the present embodiment, the input / output unit 21 includes a displacement detection unit (displacement detection means) 31 that detects the displacement of the mobile phone 10 that is the device itself. The displacement detection unit 31 transmits the detected displacement data to the control unit 20. Various known methods can be used as a method for detecting the displacement. As an example of the above method, there is a method of detecting a position using a position sensor or a method of detecting an acceleration using a gyro sensor having two or more axes.

  As another example of the above method, as described in Patent Document 1, a method of detecting a motion vector from an image captured by the camera 16 or a reference object image from an image of a reference object captured by the camera 16 is described. A method for detecting the relative position is mentioned. In this case, since most of the commercially available mobile phones have the camera 16 recently, the present invention can be realized with the same hardware configuration as that of the commercially available mobile phone.

  FIG. 1 shows a schematic configuration of the control unit 20 and the storage unit 22 in the mobile phone 10. As shown in the figure, the control unit 20 includes a displacement data acquisition unit (displacement detection unit) 40, a locus creation unit (trajectory creation unit) 41, and a display control unit (display control unit) 42. The data storage area 30 of the storage unit 22 includes a trajectory data storage unit 30a.

  The displacement data acquisition unit 40 acquires displacement data from the displacement detection unit 31. The displacement data acquisition unit 40 transmits the acquired displacement data to the trajectory creation unit 41.

  The trajectory creation unit 41 creates trajectory data indicating the trajectory of change from the reference position of the mobile phone 10 as handwritten data based on the displacement data from the displacement data acquisition unit 40. The trajectory creation unit 41 stores the created trajectory data in the trajectory data storage unit 30 a of the data storage area 30.

  The reference position is preferably the position of the mobile phone 10 when the mobile phone 10 starts the handwriting input operation. However, the reference position is the same as the position of the mobile phone 10 when a predetermined button of the operation button group 13 is operated. It is possible to set an arbitrary position such as. Further, the reference position and the displacement may be a position on the captured image or a position on an actual space. Further, the coordinates indicating the reference position and the displacement may be Cartesian coordinates or coordinates including a rotation angle such as polar coordinates.

  Further, the trajectory data may be bitmap data or vector data.

  The display control unit 42 controls the display unit 24 to perform display based on the acquired data. In the present embodiment, the display control unit 42 controls the display unit 24 to display part or all of the trajectory as handwritten characters or the like based on the trajectory data stored in the trajectory data storage unit 30a. . Thereby, as shown to (a) of FIG. 2, a handwritten character etc. are displayed on the display screen 12 of the mobile telephone 10. FIG.

  As shown in FIG. 2A, it is desirable to additionally display a pointer at the tip of the trajectory so that the user can easily recognize the tip of the trajectory. As the pointer, an arbitrary symbol such as an aiming symbol as shown in FIG. 2A, an arrow symbol as shown in FIG. 7, a pen symbol, or a cursor can be selected. Further, a photographed image photographed by the camera 16 may be displayed on the display screen 12 as a background image.

  In the present embodiment, since the user can input handwritten characters by moving the mobile phone 10, the area that can be moved for input is greatly expanded as compared to an input device such as a touch panel or a mouse pad. Can do.

  On the other hand, it is conceivable that the locus protrudes from the display area (display screen) of the display unit 24 as the mobile phone 10 moves. For this reason, the display control unit 42 moves the display area in the trajectory data so that the tip of the trajectory is always displayed on the display unit 24, or reduces the entire trajectory so that the entire trajectory is displayed on the display unit 24. It is desirable to display it.

  4 and 5 show how the display area moves in accordance with the movement of the trajectory of characters and the like. In the illustrated example, an example using a biaxial (X-axis, Y-axis) position sensor is shown for the sake of simplicity of explanation. In addition, the coordinates of the display area are local coordinates, and the coordinate data (trajectory data) from the position sensor is global coordinates.

  That is, the entire image indicated by the global coordinates is a display image to be displayed on the display unit 24. In addition, an area surrounded by a solid line in local coordinates is a display area displayed on the display screen.

  4 and 5, it can be understood that the tip R of the locus falls within the display area by moving the origin G of the local coordinates on the global coordinates in the direction in which the tip R of the locus moves. Therefore, the user can continue to write characters and the like continuously without interruption. At this time, on the display screen, the image including the trajectory scrolls in the direction opposite to the direction in which the tip R of the trajectory moves.

  A processing operation in the mobile phone 10 having the above configuration will be described with reference to FIG. FIG. 6 shows processing operations performed by the control unit 20 when inputting handwritten characters or the like.

  As shown in FIG. 6, first, the displacement data acquisition unit 40 acquires the displacement data detected by the displacement detection unit 31 (step S10 (hereinafter sometimes abbreviated as “S10”. The same applies to other steps). is there.)). Next, based on the acquired displacement data, the trajectory creation unit 41 creates the trajectory data as handwritten data (S11), and the created trajectory data is stored in the trajectory data storage unit 30a in the data storage area 30 of the storage unit 22. Store (S12). Next, the display control unit 42 causes the display unit 24 to display a trajectory of change from the reference position based on the trajectory data stored in the trajectory data storage unit 30a of the storage unit 22 (S13). Then, it returns to step S10 and repeats the said operation | movement.

[Embodiment 2]
Next, another embodiment of the present invention will be described with reference to FIGS. Although the mobile phone 10 shown in FIGS. 1 to 7 has only a drawing mode for inputting handwritten characters, the mobile phone 10 of the present embodiment further erases input handwritten characters and the like. An erasing mode for scrolling, and a scroll mode for scrolling input handwritten characters and the like.

  The mobile phone 10 according to the present embodiment is different from the mobile phone 10 shown in FIGS. 1 to 7 in the configuration of the control unit 20, and the other configurations are the same. In addition, the same code | symbol is attached | subjected to the structure which has the function similar to the structure demonstrated in the said embodiment, and the description is abbreviate | omitted.

FIG. 8 shows a schematic configuration of the control unit 20 and the storage unit 22 in the mobile phone 10. Compared with the control unit 20 and the storage unit 22 shown in FIG. 1, an operation data acquisition unit (operation instruction unit) 43 and a track deletion unit (track deletion unit) 44 are added to the illustrated control unit 20 and storage unit 22. The operation data acquisition unit 43 in which the functions of the displacement data acquisition unit 40, the trajectory creation unit 41, and the display control unit 42 are changed acquires operation data from the operation unit 23. The operation data acquisition unit 43 instructs each block based on the acquired operation data.

  In the present embodiment, when the operation data acquisition unit 43 acquires operation data indicating that a predetermined button (for example, the determination button 17 shown in FIG. 2A) has been pressed on the operation unit 23, the operation data acquisition unit 43 enters the drawing mode. The process proceeds to instruct the trajectory creation unit 41 to operate. When the operation data acquisition unit 43 acquires operation data indicating that another predetermined button (for example, the clear button 18 shown in FIG. 2A) has been pressed on the operation unit 23, the operation data acquisition unit 43 shifts to the erasure mode. The trajectory erasing unit 44 is instructed to operate. Further, when the operation data acquisition unit 43 does not acquire any operation data, or acquires operation data indicating that the predetermined button or the other predetermined button is released, the operation data acquisition unit 43 shifts to the scroll mode, Instructs the display control unit 42 to perform an operation in the scroll mode.

  Compared to the displacement data acquisition unit 40 shown in FIG. 1, the displacement data acquisition unit 40 transmits the acquired displacement data to the locus deletion unit 44 and the display control unit 42 in addition to the locus creation unit 41. The other functions are the same.

  The trajectory creation unit 41 is different from the trajectory creation unit 41 shown in FIG. 1 in that it operates when it receives a drawing mode instruction from the operation data acquisition unit 43, and the other functions are the same.

  The trajectory erasure unit 44 operates when receiving an instruction of the erasure mode from the operation data acquisition unit 43. A part of the trajectory data stored in the trajectory data storage unit 30a is transferred from the displacement data acquisition unit 40. Erasing is based on the displacement data. The trajectory deletion unit 44 updates the trajectory data storage unit 30a with the trajectory data from which a part has been deleted. The width erased by the trajectory erasing unit 44 is preferably wider than the width of the trajectory created by the trajectory creation unit 41.

  Compared to the display control unit 42 shown in FIG. 1, the display control unit 42 scrolls the display screen 12 based on the displacement data from the displacement data acquisition unit 40 when receiving an instruction for the scroll mode from the operation data acquisition unit 43. The other functions are the same.

  According to the above configuration, when the user moves the mobile phone 10 while pressing the predetermined button, locus data is created and handwritten information is input. Further, when the user moves the mobile phone 10 while pressing the other predetermined button, the corresponding locus data is deleted, and the corresponding handwritten information is deleted. Then, when the user moves the mobile phone 10 without pressing any of the predetermined button and the other predetermined buttons, the input handwritten information is scrolled on the display screen 12.

  Processing operations in the mobile phone 10 having the above configuration will be described with reference to FIGS. FIG. 9 shows processing operations performed by the control unit 20.

  As shown in FIG. 9, the operation data acquisition unit 43 first determines which button of the operation unit 23 has been pressed (S20). When the enter button 17 shown in FIG. 2A is pressed, the drawing mode is entered (S21). When the clear button 18 shown in FIG. 2A is pushed, the mode is changed to the erasing mode (S22). ) If none of the buttons are pressed, the process shifts to the scroll mode (S23). Then, it returns to step S20 and repeats the said operation | movement. The processing operation in the drawing mode (S21) is different from the processing operation shown in FIG. 6 in that the repeated operation is omitted, and the other processing operations are the same.

  FIG. 10 shows the processing operation in the erase mode (S22). As shown in the figure, first, the displacement data acquisition unit 40 acquires the displacement data detected by the displacement detection unit 31 (S25). Next, the trajectory deletion unit 44 deletes a portion corresponding to the acquired displacement data from the trajectory data stored in the trajectory data storage unit 30a of the storage unit 22 (S26), and stores the changed trajectory data in the storage unit. It memorize | stores in 22 locus | trajectory data storage parts 30a (S27). That is, the trajectory data stored in the trajectory data storage unit 30a is updated.

  Then, the display control unit 42 causes the display unit 24 to display a trajectory of change from the reference position based on the changed trajectory data stored in the trajectory data storage unit 30a of the storage unit 22 (S28). Thereafter, the erase mode (S22) is terminated and the routine returns to the routine shown in FIG.

  FIG. 11 shows the processing operation in the scroll mode (S23). As shown in the drawing, first, the displacement data acquisition unit 40 acquires the displacement data detected by the displacement detection unit 31 (S30). Next, the display control unit 42 moves the display area of the display screen 12 (see FIGS. 4 and 5) based on the acquired displacement data (S31), and the trajectory included in the moved display area is Based on the trajectory data stored in the trajectory data storage unit 30a of the storage unit 22, it is displayed on the display unit 24 (S32). Thereafter, the scroll mode (S23) is terminated, and the routine returns to the routine shown in FIG.

  In this embodiment, the drawing mode is entered while the predetermined button is pressed. However, the drawing mode is entered when the predetermined button is pressed, and the predetermined button is pressed again. In such a case, the scroll mode may be entered. Similarly, in the present embodiment, the mode is shifted to the erase mode while the other predetermined button is pressed. However, when the other predetermined button is pressed, the mode is shifted to the erase mode, and the other When the predetermined button is pressed again, the scroll mode may be entered.

[Usage example 1]
Next, usage examples of trajectory data input by handwriting as described above will be described with reference to FIGS.

  FIG. 12 shows an example of usage of trajectory data in the mobile phone 10 of the present embodiment. In this usage example, the mobile phone 10 incorporates the trajectory data into the captured image data created by photographing with the camera 16 and transmits it to an external communication terminal. The transition of the display screen 12 of the mobile phone 10 from the step until the step of transmitting data in which characters are input is shown.

  First, a certain person is photographed by the camera 16 provided in the mobile phone 10. Then, the captured image is displayed on the display screen 12 as shown in FIG. Next, a predetermined button is pressed to shift to the drawing mode, and the user moves the mobile phone 10 to write, for example, “I symbol (heart mark) U”. At this time, the display control unit 42 controls the display unit 24 so that the drawing point is fixed in the display screen 12 of the mobile phone 10 and the captured image is scrolled in the direction opposite to the moving direction of the mobile phone 10. Then, as shown in FIG. 12 (b), data of an image in which a trajectory due to the movement of the mobile phone 10, that is, a handwritten character such as “I symbol (heart symbol) U” or the like is added to the photographed image. Created.

  Next, as shown in FIG. 12 (c), when the destination E-mail address and title are set and the send button is selected, an e-mail is sent as shown in FIG. 12 (d). . At this time, the image data is transmitted to a transmission destination together with a message or the like. Thereby, the mobile phone 10 can easily exchange handwritten characters and the like with other communication terminals.

  FIG. 13 shows a display example of the display screen 12 when handwritten characters and the like as shown in FIG. As shown in FIG. 13A, the captured image may be displayed semi-transparently, and an image of the pen and the right hand holding the pen may be combined and displayed at the tip of the locus.

  Further, the captured image may be displayed as it is, and a pointer as shown in FIG. 13B may be superimposed on the tip of the locus, or a writing instrument as shown in FIG. A deformed image may be superimposed and displayed.

[Usage example 2]
The mobile phone 10 in the present embodiment records a handwritten trajectory as “the same moving image as the background” or “coordinate data with time information” at the same time as shooting a moving image, and generates characters and the like during later playback. The operation can be reproduced.

  FIG. 14 shows an example of coordinate data with time information in a table format. FIG. 15 shows an example of coordinate changes with time. Here, the coordinate data accompanied by time information refers to coordinate designation data along a time series. For example, the coordinate data is as follows when described with reference to the example of FIG.

  Referring to FIG. 14, the coordinate position of the tip of the locus at 0 milliseconds is (X, Y) = (10, 20), and the mode is coordinate movement. That is, the coordinate position of the tip of the locus is set to (10, 20). Next, the coordinate position of the tip of the locus at 10 milliseconds is designated as (20, 30), and the mode is the drawing mode. That is, a line segment is drawn from (10, 20) to (20, 30). Furthermore, the coordinate position of the tip of the locus at 20 milliseconds is indicated as (40, 50), and the mode is the drawing mode. That is, line segments are drawn from (20, 30) to (40, 50).

  If coordinate data with time information as shown in FIG. 14 is used, as shown in FIG. 15, the trajectory of characters and the like can be displayed in the drawing order.

  As described above, the operation at the time of writing a character can be recorded as “position vector + time data”, and these data can be transmitted and received between users of the mobile phone 10. It can also be used for chatting. The coordinate data accompanied by the time information is a moving image data because the vector is transmitted as data, but the data amount can be relatively suppressed.

[Usage example 3]
In the mobile phone 10 according to the present embodiment, trajectory data can be transmitted and received between a plurality of terminals. FIG. 16 shows another example of use in the mobile phone 10 of the present embodiment, and shows the display screen 12 of the mobile phone 10 when chatting is performed between a plurality of terminals.

  As shown in FIG. 16, the user of the mobile terminal A inputs a handwritten character “Is it already?” On the display screen of the mobile terminal A, and transmits the data with the input character to the mobile terminal B. To do. The user of the portable terminal B that has received the data can write handwritten characters that are different from “simple” on the same data.

  Since the display position of the message does not depend on the temporal order, the mobile terminal B can input a new character over the character “Is it already?” Input by the mobile terminal A. Further, when chatting, only the trajectory data may be transmitted / received or may be transmitted / received together with the background image data. Thereby, it is possible to chat while photographing the background.

  Further, as shown in FIG. 15, the locus of handwritten characters or the like may be displayed on the receiving side (mobile terminal B) in the order of time series at the time of input on the transmitting side (mobile terminal A). In this case, it is possible to enjoy a dynamic and more realistic chat. At this time, on the receiving side, it is preferable to display an image of a “hand holding a pen” or “pen” as shown in FIG. .

  In addition, even on a small display screen such as a mobile phone in the present embodiment, it is possible to chat without degrading operability. Furthermore, the mobile phone 10 of the present embodiment in which the display screen is relatively large and the processing similar to the input processing by the mobile terminal provided with the input pad on the display screen is small, like the mobile phone 10. But it can be realized.

  The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope shown in the claims, and embodiments obtained by appropriately combining technical means disclosed in different embodiments. Is also included in the technical scope of the present invention.

  Finally, each block of the mobile phone 10, particularly the control unit 20, may be configured by hardware logic, or may be realized by software using a CPU as follows.

  That is, the mobile phone 10 is a storage device (recording device) such as a CPU that executes instructions of a control program that realizes each function, a ROM that stores the program, a RAM that expands the program, a memory that stores the program and various data, and the like. Medium). An object of the present invention is to provide a recording medium on which a program code (execution format program, intermediate code program, source program) of a control program of the mobile phone 10 which is software that realizes the above-described functions is recorded in a computer-readable manner, This can also be achieved by supplying the mobile phone 10 and reading and executing the program code recorded on the recording medium by the computer (or CPU or MPU).

  Examples of the recording medium include tapes such as magnetic tapes and cassette tapes, magnetic disks such as floppy (registered trademark) disks / hard disks, and disks including optical disks such as CD-ROM / MO / MD / DVD / CD-R. Card system such as IC card, IC card (including memory card) / optical card, or semiconductor memory system such as mask ROM / EPROM / EEPROM / flash ROM.

  The mobile phone 10 may be configured to be connectable to a communication network, and the program code may be supplied via the communication network. The communication network is not particularly limited. For example, the Internet, intranet, extranet, LAN, ISDN, VAN, CATV communication network, virtual private network, telephone line network, mobile communication network, satellite communication. A net or the like is available. Also, the transmission medium constituting the communication network is not particularly limited. For example, even in the case of wired such as IEEE 1394, USB, power line carrier, cable TV line, telephone line, ADSL line, etc., infrared rays such as IrDA and remote control, Bluetooth ( (Registered trademark), 802.11 wireless, HDR, mobile phone network, satellite line, terrestrial digital network, and the like can also be used. The present invention can also be realized in the form of a computer data signal embedded in a carrier wave in which the program code is embodied by electronic transmission.

  As described above, since the handwriting input device according to the present invention can input handwritten information by moving its own device, not only a portable electronic device but also any electronic device that can move its own device. Can be applied to devices.

It is a block diagram which shows schematic structure of the control part and memory | storage part in the mobile telephone which is one Embodiment of this invention. It is the front view and back view which show the external appearance in the state which opened the said mobile telephone. It is a block diagram which shows the specific example of the hardware constitutions of the said mobile telephone. It is a graph which shows a mode that a display area moves with the movement of locus | trajectories, such as a character. It is a graph which shows a mode that a display area moves with the movement of locus | trajectories, such as a character. It is a flowchart which shows the flow of the process which the said control part performs. It is a front view which shows the example of the pointer displayed on the display screen of the said mobile telephone. It is a block diagram which shows schematic structure of the control part and memory | storage part in the mobile telephone which is other embodiment of this invention. It is a flowchart which shows the flow of the process which the said control part performs. It is a flowchart which shows the flow of the process which the said control part performs in deletion mode. It is a flowchart which shows the flow of the process which the said control part performs in scroll mode. It is a figure which shows one usage example of the locus | trajectory data which the said mobile telephone produces. It is a figure which shows the example of a display of a display screen in the case of producing the said locus | trajectory data. It is a figure which shows an example of the coordinate data with time information in a table format. It is a figure which shows that the locus | trajectory of a character etc. can be displayed in order of drawing. It is a figure which shows the other usage example of the locus | trajectory data which the said mobile telephone produces.

Explanation of symbols

10 Mobile phone (handwriting input device)
12 Display screen 13 Operation button group 16 Camera (shooting unit)
17 OK button 18 Clear button 20 Control unit 21 Input / output unit 22 Storage unit 23 Operation unit 24 Display unit 25 Image input unit (shooting unit)
29 Program storage area 30 Data storage area 30a Trajectory data storage section 31 Displacement detection section (displacement detection means)
40 Displacement data acquisition unit (displacement detection means)
41 Trajectory creation unit (trajectory creation means)
42 Display control unit (display control means)
43 Operation data acquisition unit (operation instruction means)
44 Trajectory elimination unit (trajectory elimination means)

Claims (11)

A handwriting input device for inputting handwritten information,
A display for displaying information;
Displacement detecting means for detecting displacement information of at least two axes of the own device;
Based on the displacement information detected by the displacement detection means, trajectory creation means for creating trajectory information indicating the trajectory of change of the device as the handwritten information;
A handwriting input device comprising: display control means for controlling the display unit so as to display part or all of the locus. A storage unit for storing information;
The trajectory creation means writes the created trajectory information in the storage unit,
The handwriting input apparatus according to claim 1, wherein the display control unit acquires a part or all of the trajectory from the storage unit.   The handwriting input according to claim 2, further comprising trajectory erasing means for erasing a part of a trajectory indicated by trajectory information stored in the storage unit based on displacement information detected by the displacement detecting means. apparatus. An operation unit for receiving user operations;
The handwriting input device according to claim 3, further comprising an operation instruction unit that instructs one of the trajectory creation unit and the trajectory deletion unit to operate based on an operation in the operation unit. .   The display control unit changes a display area displayed in the display screen of the display unit among the display images to be displayed on the display unit based on the displacement information detected by the displacement detection unit. The handwriting input device according to any one of claims 1 to 4, wherein the display unit is controlled.   The display control unit controls the display unit so that a position of the display image corresponding to the displacement information detected by the displacement detection unit is displayed in the display screen. 5. The handwriting input device according to 5. It also has a shooting part that takes pictures,
The handwriting input device according to any one of claims 1 to 6, wherein the displacement detection unit detects displacement information of the device itself based on a photographed image photographed by the photographing unit. .   The handwriting input device according to any one of claims 1 to 7, wherein the handwriting input device is portable.   A handwriting input control program for operating the handwriting input device according to any one of claims 1 to 8, wherein the computer functions as each of the above means.   A computer-readable recording medium on which the handwriting input control program according to claim 9 is recorded. In the control method of a handwriting input device for inputting handwritten information, comprising a display unit for displaying information,
A displacement detection step for detecting displacement information of at least two axes of the device;
Based on the displacement information detected in the displacement detecting step, a trajectory creating step for creating trajectory information indicating a trajectory of change of the device as the handwritten information;
A display control step of controlling the display unit so as to display a part or all of the trajectory.

Images