JPH10312257A - Portable information collection device and information processing method thereof - Google Patents

Abstract

(57) [Summary] [Problem] To display a display of an image with a margin left on a screen, to easily write a comment or the like on the image, and to reduce a data amount by using handwritten input as coordinate point sequence data. Aim for reduction. The information report input means (23, 25) for inputting handwritten input information and image information, and when each information is arbitrarily input as information to be displayed on the same display surface, each input information is input. Data storage means 27 in which information is written to an address specified as associated information, and display storage in which information stored in the data storage means 27 is written as display information on a display surface opened on a screen. Means 37, and control means 21 for controlling each of these means. The handwriting input information from the handwriting input means is captured as coordinate point sequence data, and the captured image information is in a state where a margin is left on the screen. To display.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to a portable information collection processing device and a portable information collection device capable of capturing not only handwritten input information such as characters but also other information such as images.

[0002]

2. Description of the Related Art Recently, portable information collecting apparatuses have become widespread. This portable information collection device can capture not only a function of recording handwritten characters and line drawing information (hereinafter, referred to as ink data) written on a tablet screen with an input pen or the like, but also recent images and sounds. Things are also being developed and their functions are becoming increasingly diversified and more convenient.

[0003]

In a conventional portable information collecting apparatus of this type, when displaying a captured image, it is common to display the image on a screen in full. Therefore, when attempting to write a comment on the displayed image, there is no space on the screen, and the only option is to overwrite the displayed image. For this reason, there has been a problem that the image and the characters are combined to make the screen difficult to see.

In a conventional portable information collecting apparatus, handwritten input data (ink data) is bitmap data. When ink data is overwritten on an image, the bitmap data is rewritten, that is, the image data is rewritten. However, there is a problem that it is not possible to erase only the ink data and return to the display of the original image only after writing the ink data.

In addition, when ink data is overwritten on an image, there is a method in which a frame for image data and a frame for ink data are superimposed and displayed instead of rewriting bitmap data. In this method, it is possible to return to the display of only the original image after writing the ink data from above the image.

However, this method requires a memory for one screen for image data and a memory for one screen for ink data when displaying both images in a superimposed manner. Therefore, for example, even when writing one line, a memory for ink data for one screen different from image data is required.

Therefore, even if the setting is such that the display of 100 pages can be performed, if the screens of all the pages are displayed by superimposing the image and the ink data, the display of 50 screens (50 pages) is performed. There is a problem that the page capacity cannot be used effectively.

Thus, not only the ink data, but also
There are still many points to be improved in the conventional portable information collection device that can also capture image data.

In view of this, the present invention displays a captured image in a state in which a margin is left on a screen, thereby facilitating writing of a comment or the like on the image, and capturing handwritten input data (ink data) as coordinate data. Accordingly, an object of the present invention is to significantly reduce the data amount, effectively use the memory capacity, and selectively display or delete the ink data and the image data.

[0010]

The portable information collecting apparatus according to the present invention can capture at least handwritten input information and image information, and displays and collects the information. In a portable information collection device having a function of storing information, it is characterized in that the captured image information can be displayed on a screen when the captured image information is displayed on the screen.

The portable information collecting apparatus according to the second aspect of the present invention is capable of capturing at least handwritten input information and image information, displaying these information and storing the collected information. In the portable information collection device having a function, each information input means for inputting the respective information, and when each information is arbitrarily input as information to be displayed on the same display surface,
A data storage unit in which each input information is written to an address specified as associated information, and information stored in the data storage unit is written as display information on a display surface opened on a screen. Display storage means, and control means for controlling each of these means,
When writing a plurality of types of information associated with each other in the data storage unit into the display storage unit as display information on a display surface opened on a screen, a writing order is set for each type of input information. According to the order, it is possible to sequentially write in the display storage means for each type of information and display it on the screen, and to convert the image information displayed on the screen to a display size that leaves a margin on the screen and display it. It is characterized by doing.

According to a third aspect of the present invention, in the first or second aspect of the present invention, when displaying the image, a variable for determining a display size of the image is given so that the display size of the image can be adjusted within the screen size. The display position of the image can be set arbitrarily by giving a variable for determining the display position of the image on the screen, in addition to being arbitrarily settable.

Further, the invention of claim 4 provides the invention according to claims 1 to 3
In any one of the inventions, when displaying an image while leaving a margin on the screen, the display size of the image, the vertical size and the horizontal size of the image, the vertical and horizontal screen size of the screen, respectively It is about 2/3.

According to a fifth aspect of the present invention, in the first to fourth aspects of the present invention, when displaying an image with a margin left on the screen, the display position of the image is located at the upper left corner of the screen.
The upper left corner of the image is set to the matched position.

[0015] The invention of claim 6 provides the invention according to claims 1 to 5.
In the invention, the handwritten input information is fetched as coordinate point sequence data and stored in the data storage means.

According to a seventh aspect of the present invention, in the invention of the sixth aspect, when the handwritten input information is captured as coordinate point sequence data, the coordinate data of the input start point and the coordinate data of each sampling point on the movement are captured. , And these coordinate data are stored in the data storage means.

According to an eighth aspect of the present invention, when the handwritten input information is captured as coordinate point sequence data, the coordinate data of the input start point and the relative position data of each sampling point on the movement are obtained. Then, the starting point coordinate data and the relative position data are stored in the data storage means.

According to a ninth aspect of the present invention, at least handwritten input information and image information can be captured, and the information is displayed and collected. In the information processing method in a portable information collection device having a function of storing information, when displaying the captured image information on a screen, it is possible to display the image with a margin left on the screen. It is characterized by:

The portable information collecting apparatus according to the present invention has an information processing method in which at least handwritten input information and image information can be captured, the information is displayed, and the collected information is displayed. In the information processing method in the portable information collecting apparatus having the function of storing the information, the information arbitrarily input as the information to be displayed on the same display surface is designated as the associated information by the data storage means. After writing to the address, the associated plural kinds of information in the data storage means are written to the display storage means as display information of the display surface opened on the screen, and the writing to the display storage means is performed. When performing, the order of writing to the display storage means is set for the associated information in the data storage means, and the order is set. According to the above, it is possible to sequentially write the associated information in the display storage means and display it on the screen, and to convert the image information displayed on the screen to a display size that leaves a margin on the screen and display it It is characterized by.

[0020] According to an eleventh aspect of the present invention, in the display device according to the ninth or tenth aspect, when the image is displayed, a variable for determining a display size of the image information is provided so that the display size of the image is within the screen size. , And a variable for determining the display position of the image on the screen is provided, so that the display position of the image can be set arbitrarily.

According to a twelfth aspect of the present invention, in the ninth to eleventh aspects of the present invention, when displaying an image with a margin left on the screen, the display size of the image information is determined in the vertical and horizontal directions of the image. Is about 2/3 of the screen size in the vertical and horizontal directions of the screen.

According to a thirteenth aspect, in the ninth to twelfth aspects, when displaying an image with a margin left on the screen, a display position of the image information is located at an upper left corner of the screen. The upper left corner of the image is set as the matched position.

According to a fourteenth aspect, in the ninth to thirteenth aspects, the handwritten input information is taken in as coordinate point sequence data.

According to a fifteenth aspect of the present invention, in the invention of the fourteenth aspect, when the handwritten input information is captured as coordinate point sequence data, the coordinate data of the input start point and the coordinate data of each sampling point on the movement are captured. , These coordinate data are stored.

According to a sixteenth aspect of the present invention, in the invention of the fourteenth aspect, when the handwritten input information is captured as coordinate point sequence data, the coordinate data of the input start point and the relative position data of each sampling point on the movement are obtained. The starting point coordinate data and the relative position data are stored.

According to the present invention, a portable information collection device capable of capturing not only handwritten input information such as characters and line drawings but also image information is provided. Displayed as the size to leave margins. Thereby, when a comment is written in the displayed image, a space for writing a character or the like is provided, so that the character or the like can be easily written and a screen that is easy to view can be provided.

Further, according to the present invention, each information (image information, handwritten input information) arbitrarily input as information to be displayed on the same display surface is designated as data associated with the data storage means. After writing to the address, a plurality of types of associated information in the data storage unit are written to the display storage unit as display information of the opened display surface, and when writing to the display storage unit, A writing order is set to the display storage means for the associated information in the data storage means, and in accordance with the order, the associated information is sequentially written to the display storage means and displayed on the screen. Is converted to a display size that leaves a blank space on the screen and can be displayed.

As a result, each piece of information such as ink information and image information captured as information of a certain page is written at a predetermined address of the storage means as information associated with the page, and when displayed, the information is Is read out, and the image and the ink data can be superimposed and displayed as the associated information. Therefore, it is possible to selectively delete any of the data displayed in a superimposed manner, and it is also possible to display each type of information such as only an image or only a handwritten input.

Further, when displaying an image in such a device, the image is displayed on the display screen as a size that leaves a margin. Thereby, when a comment is written in the displayed image, a space for writing a character or the like is provided, so that the character or the like can be easily written and a screen that is easy to view can be provided.

Then, by enabling the display screen size and display position to be set arbitrarily, screen display according to the situation becomes possible. However, considering the ease of viewing the screen and the ease of writing characters and the like, the display size of the image information is approximately two-thirds of the size of the image in the vertical and horizontal directions, respectively, about the screen size in the vertical and horizontal directions of the screen. By doing so, the size of the image and the margin become appropriate, and information such as a comment can be easily written, and the usability can be improved. When displaying an image with a margin on the screen, the display position of the image is set to the position where the upper left corner of the image matches the upper left corner of the screen, so that comments and the like can be viewed while viewing the image. Is written, the image and the margin have an easy-to-use positional relationship, and the usability can be improved.

Further, according to the present invention, by incorporating the handwritten input information as coordinate point sequence data instead of bitmap data, the data amount of the handwritten input information can be significantly reduced, and the memory can be effectively utilized. Furthermore, when the coordinate point sequence data is captured, the coordinate data of the input start point and the relative position data of each sampling point on the movement are captured, and the start point coordinate data and the relative position are stored. Quantity
Further reductions can be made.

[0032]

Embodiments of the present invention will be described below. FIG. 1 is a block diagram illustrating the overall configuration of a portable information collection device to which the present invention has been applied.

This portable information collecting device has a CPU 21
A basic processing program of the apparatus, an information collection processing program of the present invention (a processing procedure based on this program will be described in detail later), a ROM 22 storing data necessary for processing, and image information. A CCD camera 23 for capturing, a CCD controller 24 for driving the CCD camera 23 and converting a signal from the CCD camera into a digital signal, capturing information such as characters and line drawings, and displaying input information. Body type tablet (digitizer 251
And a liquid crystal display unit 252) 25, a liquid crystal display (LCD) controller 26, a flash memory as data storage means for storing data captured by the user (data stored in the flash memory and its storage area, etc.) Will be described in detail later) 27,
A RAM 28 used as a work memory when performing various processes as a portable information collection device, a real-time clock 29 for measuring the current time and outputting date information together with time information, a power switch 30, a page feed button (next page) Button 31, a previous page button 32), a camera button 33, and an erasing button for erasing written data (this erasing button includes two erasing buttons 34a and 34b, the functions of which will be described later). A button signal processing unit 35 that detects an off state and outputs a signal corresponding to the on / off state; a system bus 36 that connects the parts; a display memory (VRAM) 37 in which contents to be displayed on the LCD 252 are written; Have been.

Although the portable information collecting apparatus shown here is one capable of capturing images and ink data, the portable information collecting apparatus may also be capable of capturing voices. In this case, since the voice is not directly related, the illustration of the portion related to the voice capture is omitted.

FIG. 2 is a view showing the external configuration of the portable information collecting apparatus of the present invention. The components corresponding to FIG.
Are given the same reference numerals. Among the components shown in FIG. 1, those appearing in the external configuration include a CCD camera 2.
3 (actually, lens 23a of CCD camera 23), camera button 33, tablet 25, next page button 31,
Previous page button 32, power switch 30, delete button 3
4a and 34b. Reference numeral 51 denotes an input pen for drawing characters and line drawings on the screen of the tablet 25 and pointing icons. The delete button 34
a and 34b are, as shown in FIG.
Placed one by one.

In the above configuration, the tablet 2
When a character or a line drawing is drawn on the screen of the tablet 5 by the input pen 51, the CPU 21 inside reads the coordinates from the digitizer 251 and displays the coordinates on the screen of the tablet 25 (LCD
In step 252), the handwriting is displayed at the corresponding position, and the coordinate data is stored at a predetermined address in the flash memory 27. As described above, in the present invention, ink data is stored as coordinate point sequence data.

When an image is input by the CCD camera 23, the lens 23a of the CCD camera 23 is pointed at the image to be captured, and when the camera button 33 is first pressed halfway, the image is input through the lens 23a. The image is displayed as a moving image on the screen of the tablet 25, and when the camera button 33 is further pressed, the image is locked, and the locked image is captured. This image signal is converted into a digital signal by the CCD camera controller 24 and then stored at a predetermined address of the flash memory 27.

The above information is fetched in units of one screen (one page). Hereinafter, the processing procedure will be described.

If the portable information collection device is completely unused, when the power switch 30 is turned on, nothing is displayed on the screen (LCD 252) of the tablet 25. The first page). Here, an example will be described in which some information is already taken in the first page, and new information is taken in the second and subsequent pages.

When a user who owns this information collecting device has a business meeting with a person who has met for the first time,
An example will be described in which information about the person, the contents of the meeting, and information about products to be dealt with are taken.

First, when the user turns on the power switch 30, the first page in which information has already been captured is displayed. When the next page button 31 is pressed, a second page screen in which no information has been captured appears. . In this state, in order for the user to capture the face image of the other party, the lens button 23a of the CCD camera 23 is first turned halfway as described above with the camera button 33 facing the party to be photographed. When the camera button 33 is further pressed, the face image (still image) at that time is captured, and the face image is displayed on the screen of the tablet 25,
The image data is stored at a predetermined address of the flash memory 27.

When this image is displayed, the screen is not displayed in full, but its display area is made smaller than the entire screen so that a margin can be provided.
In this embodiment, the tablet 25 is positioned on the upper left side with respect to the entire display area on the screen. As shown in FIG. 3A, the size of the image in the vertical direction is about 2/3 of the vertical screen size of the display screen, and the horizontal length is 2/3 of the horizontal screen size of the display screen. / 3.

As described above, the image is displayed not in the entire screen but in a margin, leaving a space for writing ink data. The portable information collection device of the present invention can write ink data from the top of an image, but in the case of writing a comment or the like to a photo, it can also write in a blank portion, resulting in an easy-to-view screen. .

Then, the user who owns the electronic memo pad writes memo information such as the name of the other party, the name of the company, and the name of the department to which the other party belongs with the input pen 51 as characters or line drawings as information about the meeting partner. The ink data such as characters and line drawings by the input pen 51 is displayed on the screen of the tablet 25 as drawn by the user, and is stored at a predetermined address of the flash memory 27. The ink data is data of a coordinate point sequence, and the flash memory 27 captures the start point coordinates and the coordinate data of each sampling point accompanying the movement of the input pen 51 based on the start point coordinates. The ink data will be described later in detail.

FIG. 3A shows an example in which the information taken in by performing the above processing is displayed on the screen of the tablet 25. As can be seen from FIG. 3A, face image information 61 and ink information 62 such as characters and line drawings are displayed as visual information as page information associated with one page.

In addition to the above information, information indicating the date at that time is automatically displayed from the real-time clock 29, and the date and time information is stored in the flash memory 27 as one of the page additional information. Written to address. And this date and time information,
Later, when this page data is read, the date and time when the information was input are displayed.

As described above, when the information collection of the page for which the information has been fetched is completed and another information is to be fetched into another page (for example, the next page), the next page button 32 is pressed. Press this button to set the next page as a new page and take in new information on this page.

In this way, a page can be changed for each piece of information to be taken in, and a plurality of types of information can be taken in page units.

FIG. 4 shows an example of the contents of the flash memory 27 when the above-mentioned information fetching process is performed. In FIG. 4, the page (3 page ), The previous page (second page), and the memory contents of the previous page (first page). Hereinafter, FIG. 4 will be described.

In FIG. 4, addresses A0, A1, A
In 2, ..., for each page where the information is captured,
The address where the information of the page is stored is written.

Here, in order to make the description easy to understand, one page is the first page where data is taken, two pages are the next page where data is taken, and the page where data is currently taken. Is set to three pages, and it is assumed that data has not yet been taken in from the third page.

In FIG. 4, A0, A1, A2,.
Is a page address area for designating an address of each page from which information is taken, and an address A0 is an address B0 as an address at which information of the first page is stored.
Is written in the address A1, the address B1 is written as the address where the information of the second page is stored, and the address A2 is the address where the information of the last page is stored (in this case, the last page). Since the information is page information of the third page, (address of B2) is written.

The addresses B0, B1, B2,...
Is a page content designating address area in which an address for designating an area in which information on each page is stored is written. The address B0 in which the information of the first page is stored has the next page (in this case, (2nd page)
B1 is written as the address where the information of
"NUL" is used as the address where the information of the previous page is stored.
L "(this" NULL "indicates" none ",
This indicates that the first page is the first page), and C0 and C1 are the addresses at which the information captured in the first page is stored.
And the address C2 where the page additional information of the first page is stored.

In the address B1 where the information of the second page is stored, B2 is written as the address where the information of the next page (in this case, the third page) is stored, and the address of the previous page (in this case, the third page) is stored. The address B0 is written as the address where the information of the first page is stored, and D0 and D1 are stored as the addresses where the information fetched on the second page is stored, and the page additional information of the second page is stored. The stored address D2 has been written.

Further, the address B2 in which the information of the third page (the page at which data is currently fetched) is stored as "N" as the address in which the information of the next page is stored.
"ULL" (indicating that the third page is the last page), B1 is written as the address where the information of the previous page (in this case, the second page) is stored, and the third page is further written. E0 and E1 are written as addresses at which the information taken in is stored, and an address E2 at which the page additional information of the third page is stored.

The address C0 stores the image data of the first page, and the address C1 stores the ink data of the first page. The address D0 has 2
The image data of the page and the ink data of the second page are stored in the address D1. The address E
0 stores image data of the third page, and address E1 stores ink data of the third page. Further, in addition to the input information described above, additional data (here, date and time data as described above) of each page includes 1
The page is address C2, the second page is address D2
The third page is stored at the address E2.

In the example shown in FIG. 4, various information (image data,
Ink data and the like are grouped for each page and written in order, but the location where these pieces of information are written is the address (C0, C1, C1) indicating the write position of the input data for the page. ...
D0, D1,..., E0, E1,...), And are not necessarily written in continuous addresses in page units. For example, the image data of the first page specifies the address C0, the ink data of the first page specifies the address D2, the image data of the second page specifies the address C1, and the ink data of the second page specifies the address E0. Is specified,
Written to the specified address.

By the way, the information indicating the address of each page written at the addresses B0, B1, B2 is as follows:
It has a bidirectional list structure so that the start addresses of related pages (in this case, the previous and next pages) can be specified with each other.

For example, the address indicating the next page written at address B1 (second page) is B2, and B2 indicates the head address of the area where the information of the third page is stored. Address B1 (second page)
The address indicating the previous page written in is B0,
This B0 indicates the start address of the area where the information of the first page is stored.

Similarly, the address indicating the previous page written in the address B2 (the third page) is B1, and this B1 is the leading address of the area where the information of the second page is stored. Can be specified with each other.

In such a list structure, for example, when the second page is deleted, the first page is the next page, the third page is the first address, and the third page is the previous page, the first page is the first page. Since it is possible to easily cope with page deletion / insertion by specifying an address, it is convenient when data is deleted / inserted.

In this manner, the data fetched for each page is written to the flash memory 27.

As described above, ink data such as characters and line drawings input by the user by handwriting is taken in as coordinate point sequence data. Hereinafter, the ink data will be described.

For example, assume that a line drawing is drawn on the screen as shown in FIG. Then, the X, Y coordinates (X, Y) at the sampling points P0 to P6 of the line drawing are represented by P0
Point (10, 10), P1 point (12, 11), P2 point (1
5,13), P3 point (18,19), P4 point (20,1)
6), P5 point (27, 12) and P6 point (30, 10). The coordinate point sequence data for such a line drawing is “10, 10, 12, 11, 15, 13, 18, 1”.
9,20,16,27,12,30,10,0xffff, 0x
ffff ”is stored in the flash memory 27. Note that 0xffff and 0xffff indicate pen-up.

Here, the size of the screen in the horizontal (X) direction is set to 3
20, the coordinates in the vertical (Y) direction are 240, the coordinates in the vertical (Y) direction are 240, the coordinates are in the coordinates 0 to 239, and the sampling points P0 to P6 are in the coordinates (X, Y).
The X coordinate value and the Y coordinate value of the sampling points P0 to P6 can each be sufficiently represented by 2 bytes. Therefore,
Both the X coordinate value and the Y coordinate value of the sampling points P0 to P6 are stored in the flash memory 27 as 2-byte data.

As described above, the coordinate point sequence of each sampling point may be stored as 2-byte (16-bit) coordinate data, but data compression is performed to reduce the data amount. This will be described below.

Here, the coordinate data of each of the sampling points P0 to P6 is represented by the starting point coordinates and the relative position. The start point P0 of the line drawing represents the X coordinate value and the Y coordinate value of the start point P0 in 16 bits, respectively, and the other sampling points P0
1 to P6 are represented as relative position data, and each relative position data is represented by signed 4 bits.

The relative position here is a relative position in the X and Y directions (represented by RX and RY) with respect to the immediately preceding sampling point with respect to the moving direction of the pen.
When X and RY are each represented by 4 bits, the relative position R
X and RY can each take a range from -8 to +7, but in practice, -6≤RX≤6, -6≤RY≤6
Is set, and when the relative positions RX and RY satisfy this condition, the relative positions RX and RY satisfying the condition are represented by signed 4 bits. This control table is shown in FIG.

Then, this range (−6 ≦ RX ≦ 6, −6
A value of a hexadecimal number (numerical value represented by 4 bits with a sign) corresponding to a numerical value "7, -8, -7" deviating from ≤RY≤6 is used as a control code. For example, hexadecimal "7"
Is represented by “0x7” and “8” is represented by “0x8”. Then, one of the relative positions RX and RY is -6 ≦ RX ≦ 6,
If −6 ≦ RY ≦ 6, the coordinate value (X, Y) of the sampling point is written after “0x7, 0x7”. (0x8, 0x8) is used as a code indicating pen-up. These “0x7” and “0x8” are each represented by 4 bits.

The coordinate point sequence data "10, 10, 12, 11, 15, 13, 18, 18" for the line drawing shown in FIG.
19, 20, 16, 27, 12, 30, 10, 0xffff,
An example of data compression of “0xffff” will be described with reference to FIG. The coordinates of the starting point P0 of this line drawing are (10, 1
0), and the starting point coordinates are directly represented as 2-byte absolute value data. Then, the coordinate values (12, 11) of the sampling point P1 next to the start point are obtained by calculating relative positions RX and RY with respect to the start point P0, and calculating the relative position “2, 1” by 4
Expressed by bit data. That is, the relative position “RX = 2,
RY = 1 "indicates that -6≤RX≤6 and -6≤RY≤6
Therefore, the relative position is represented by 4-bit data. Further, the coordinate values (15, 1, 1) of the sampling point P2 are set.
3) calculates a relative position with respect to the sampling point P1,
The relative position “3, 2” is represented by 4-bit data. Also in this case, the relative positions “RX = 3, RY = 2” are
Since -6≤RX≤6 and -6≤RY≤6, the relative position is represented by 4-bit data. Thereafter, in the same manner, the relative positions of the respective sampling points are obtained. If the relative positions satisfy −6 ≦ RX ≦ 6 and −6 ≦ RY ≦ 6, each is represented by 4-bit data.

Then, for example, the sampling point P5
Since the coordinates of the sampling point P5 are (27, 12) with respect to the coordinates (20, 16) of the sampling point P4, the relative position is "RX = 7, RY = -4",
The relative position RX does not satisfy −6 ≦ RX ≦ 6.

As described above, when any of the relative positions RX and RY does not satisfy -6≤RX≤6 and -6≤RY≤6, as described above, after "0x7, 0x7", The coordinate value (X, Y) of the sampling point is written. That is, it is written as "0x7, 0x7, 27, 12". Of the data of “0x7, 0x7, 27, 12”, the portions of “0x7, 0x7” are 4
Although the bits are "27, 12", data of 16 bits is used. Then, "0x8, 0x8" indicating the pen-up is written when the pen-up is performed.

As described above, although part of the position data at each sampling point is 16-bit data, most of the position data can be represented by 4-bit data, and the amount of data can be greatly reduced. .

As described above, ink data such as a line drawing is stored in the flash memory 27 as coordinate data without any data compression or as data compressed by performing the above-described compression processing.

FIG. 8 is a flowchart for explaining a process of writing data to the flash memory 27 without data compression.
First, when pen input is started (step s1), the coordinates at that time are read (step s2), and the coordinates X0, Y are read.
Write 0 as the start point coordinates (step s3). Then, the next coordinate is read (step s4), and it is determined whether the pen is up (step s5). If the pen is not up, it is determined whether the pen is moving (step s6). If the pen has moved, the pen position is written (step s7). Then, the next coordinate is read (step s4), and it is determined whether or not the pen is up (step s5). If the pen is not up, it is determined whether or not the pen is moving (step s6). If so, the process of writing the pen position (step s7) is repeated. If the pen is up in step s5, “0xffff, 0xffff” indicating that the pen is up is written (step s8).

FIG. 9 shows that by performing such processing,
It indicates the coordinate data of each sampling point written in the flash memory 27, and the coordinate values (X0, Y0), (X1, Y1),..., (Xn, Y) of each sampling point
n) are each written as 16-bit data,
When the pen is raised, “0xffff, 0xffff” is written as a code indicating that the pen is raised.

FIG. 10 is a flow chart for explaining the process of writing the compressed data into the flash memory 27 by performing the compression process.

First, when pen input is started (step S
11), read the coordinates at that time and read the coordinate values (X0, Y
0) (step s12), the coordinates X0 and Y0 are written as start point coordinates (step s13). The start point coordinates are stored as 2-byte data for both X0 and Y0.

Then, the next coordinate is read and set as the current coordinate value (X1, Y1) (step s14). here,
It is determined whether the pen is up (step s1).
5) If the pen has not moved up, it is determined whether or not the pen has moved (step s16). If the pen has moved, the difference between the current coordinate value and the previous coordinate value is calculated, and the difference is calculated as a relative value. The positions RX and RY are obtained (step s17). That is, in this case, the previous coordinate value is the start point coordinate value, and the current coordinate value is the coordinate value read in step s14. If the current coordinates are (X1, Y1), RX = X1-X0 and R
Find Y = Y1-Y0.

Thereafter, the current coordinate value is updated (step s).
18) Then, RX and RY obtained in step s17
It is determined whether or not satisfies −6 ≦ RX ≦ 6, −6 ≦ RY ≦ 6 (step s19). If both RX and RY satisfy this condition, the RX and RY are stored in the flash memory 27 as relative position data (step s20). The relative position data RX and RY are each represented by 4 bits.

Then, the next coordinate is read (step s).
14) It is determined whether or not the pen is up (step s15). If the pen is not up, it is determined whether or not the pen is moving (step s16). And if the pen is moving, take the difference between the current coordinate value and the previous coordinate value,
The difference is obtained as relative positions RX and RY (step s
17). Then, the current coordinate value is updated (step s1).
8) Next, RX and RY obtained in step s17
It is determined whether or not satisfies −6 ≦ RX ≦ 6, −6 ≦ RY ≦ 6 (step s19). If both RX and RY satisfy this condition, the RX and RY are stored in the flash memory 27 as relative position data (step s20).

Then, the next coordinate is read (step s).
14), and the same processing is performed. In this manner, the relative position of each sampling point is obtained, and when the obtained relative positions RX and RY satisfy -6≤RX≤6 and -6≤RY≤6, they are each set as 4-bit data. It is stored in the flash memory 27.

On the other hand, in step s19, one of the relative values RX and RY obtained is -6 ≦ RX ≦ 6, -6
When it is determined that ≤RY≤6 is not satisfied, the processing of steps s22 and s23 is performed. That is, 0x7, 0x7
After writing (each 4 bit data), the X coordinate value and the Y coordinate value (each 16 bit data) of the sampling point are written (step s24).

If it is determined that the pen is up (step s15), 0x8 and 0x8 are written as codes indicating the pen-up.

FIG. 11 shows the data of each sampling point written to the flash memory 27 by performing such processing. The start point coordinates (X0, Y0) are written as 2-byte data for the start point. , And other sampling points are -6 ≦ RX ≦
6, -6 ≦ RY ≦ 6, the relative positions are written as 4-bit data, and -6 ≦ RX
If ≦ 6 and −6 ≦ RY ≦ 6 are not satisfied, 0x7 and 0x7 (4-bit data each) are written as control codes, and then the coordinate values Xm and Ym (16-bit data each) of the sampling point are written. Write. Also,
When it is determined that the pen is up, “0x8, 0x8” is written as a control code indicating the pen-up.

As described above, in the present invention, ink data is taken in as coordinate point sequence data. As described above, by capturing the ink data as the data of the coordinate point sequence, the data amount can be reduced as compared with the case where the ink data is captured as the bitmap data. In particular, the relative value of each sampling point is obtained and the relative value is calculated. By storing the data, the amount of data can be significantly reduced.

Further, according to the present invention, when writing ink data from the top of an image, it is not a method of rewriting the bit map. Therefore, even if the ink data is written on the image data, the image data is restored. The image data and the ink data can be treated as independent data, such as deleting only the ink data or displaying the image and the ink data separately.

As described above, according to the present invention, each piece of information such as an image and ink taken into a certain page as data is made independent information, and each piece of data is associated with the data associated with that page. It is to be treated as.

FIG. 12 shows how data associated with a certain page stored in the flash memory 27 is written into the display memory (VRAM) 37. In FIG. 12, image data and ink data taken in a certain page, as well as additional information thereof, are written in a predetermined address of the flash memory 27 as data associated with one page.

That is, for example, if the user first captures an image and then inputs a memo for the captured image, additional information such as image data, ink data, and date is stored in the flash memory as described above. 27 is written to a predetermined address assigned to the page. Then, the written content is read out, transferred to the RAM 28, subjected to predetermined data processing by the CPU 21, and then written to a predetermined address of the display memory 37, thereby displaying the content on the screen of the tablet 25. Is displayed.

When writing to the display memory 37, as shown in FIG. 12, a layer structure is used. First, image data is written to a predetermined address of the display memory 37, and then ink data is written to the display memory 37. The data is written to a predetermined address of the memory 37, and the additional information is further stored in the display memory 3.
The information is overwritten for each type of information according to a predetermined order, such as writing to a predetermined address of No. 7.

FIG. 13 is a diagram for explaining an example in which an image is taken in a page in which the ink data 71 has already been written. FIG. 13A shows that the already taken ink information 71 is displayed on the screen of the tablet 25. Is displayed. Then, when an image is taken into this page, the taken image data is once transferred to the RAM 28 and then written into the flash memory 27 at an address associated with the page. Then, the written data is read out from the flash memory 27 and written into the display memory 37, whereby the tablet 25 is read.
Will be displayed on the screen.

At this time, the display position of the image on the screen of the tablet 25 and the ink information 7 already written
When viewed from the positional relationship of No. 1, the image is in a positional relationship such that it is displayed on the ink data. In this case, the image data is read from the flash memory 27 first. Displayed memory 3
7 and then the ink data is read from the flash memory 27 and written to the display memory 37. The display on the screen after the image is captured is shown in FIG. 13B, the ink information 71 is overwritten on the image 72. That is, the ink information in this case is displayed again with respect to the ink information 71 already displayed.

By reading data from the flash memory 27 and writing (updating) the data in the display memory 37 again for the data already written in the display memory 37 like the ink information, Redisplaying is referred to as redisplay.

Also, contrary to the case of FIG. 13, when writing ink information from the top of an image on a page on which image data is already displayed as an initial state, first, the image data is first stored in the flash memory. 27 is written to the display memory 37, and then the ink data is read from the flash memory 27 and
7, the display memory 37 in the order in which the
, The screen after redisplay is in a state where the ink information is overwritten on the image.

Note that the layer order is not limited to the above example, and for example, the ink data may be numbered one. Further, the redisplay may be such that only the data whose writing order is set lower than the data being newly captured is displayed again without performing the previous data. For example, when the image data, the icon, and the additional information are present and the ink data is subsequently written, only the icon and the additional information may be displayed again.

FIG. 14 is a flowchart for explaining the flow of the redisplay processing described above. Here, the display processing of only the image information and the ink data is shown,
Processing for other information such as additional information is omitted. In FIG. 14, first, the entire screen of the page is whitened (step s31), and the page number of the processing target page is obtained (step s32).

Then, it is determined whether or not the page (referred to as a current page) has image data (step s33).
If there is no image data, the process proceeds to a determination as to whether or not there is ink data. If there is image data in step s33, the image data associated with the current page is read from the flash memory 27 and transferred to the RAM. . At this time, the user setting for the image size is determined. In other words, whether the display range of the image is set to normal (display size of ／ of the length in the vertical and horizontal directions of the screen) or enlarged (display size of the full screen) Is determined (step s34). And
If the setting is the normal setting, the image is converted into a size of 2/3 of the length in the vertical direction and the horizontal direction of the screen (step s35), and displayed at the designated position on the display screen (tablet) (step s36).

On the other hand, if the setting of the user is enlarged display, the display size of the image is set to the same size as the screen (step s37), and the image is displayed full on the display screen (step s38).

As described above, according to the present invention, when displaying the captured image data, the display range of the image is normally displayed with a margin left on the screen. Also, full display can be performed according to the user's request.

Here, the display size of the image at the time of normal display is 2/1/2 of the length of the screen in the vertical and horizontal directions.
Although the size is set to 3, specifically, as shown in FIG. 15, when the screen size is set to “320 (horizontal) × 240 (vertical)”, it is converted to “213 (horizontal) × 160 (vertical)”. To display. When the display position is a display position where the upper left corner of the image is aligned with the upper left corner of the screen, the display designated position is set to coordinates (0, 239).

An image is displayed in this way. Next, returning to the flowchart of FIG. 14, it is determined whether or not there is ink data (step s39). If there is ink data, the ink data associated with the current page is read from the flash memory 27. And RAM2
Transfer to 8. If there is a request to enlarge the display size (step s40), the display is enlarged on the screen of the tablet 25 by performing coordinate conversion and enlarging the display size (step s41), and then writing the information to a predetermined address of the display memory 50. Perform (step s42).

Although the above-described embodiment is one of the preferred embodiments of the present invention, it can be variously modified without departing from the gist of the present invention. For example, in the above-described example, the display range of the image is ２ each of the length of the screen in the horizontal direction and the length in the vertical direction. However, the display range is not limited to this. The point is that the display size of the image should be determined so that the image can be easily viewed and an appropriate margin for writing handwritten data such as characters can be secured. In addition, in the above-described embodiment, the display position of the image is set to match the upper left corner of the screen with the upper left corner of the image. However, the display position is not limited to this. It may be arranged in the portion, the lower left portion, or the upper right portion, or may be arranged in the center of the screen to leave a margin around.

The display size of the image or the display position is not fixed, and a value in the X-axis direction (Sx) and a value in the Y-axis direction (Sy) for determining the display size are used as variables. Further, a value in the X-axis direction (Px) and a value in the Y-axis direction (Py) for determining the display position are used as variables, and these variables (Sx, Sy), (Px, Py)
By arbitrarily selecting, the display size of the image can be set to an arbitrary size in the display screen, and the display position of the image can be set arbitrarily in the display screen.

Further, as shown in FIG. 16, an image may be displayed in the upper half or lower half thereof by using the screen in the vertical direction, and the display size and display position of the image may be variously considered. .

In the embodiment described above, the information that can be captured is image information and pen input information. However, by providing a sound input means such as a microphone and a circuit associated therewith, voice and the like can be obtained. It can also incorporate sound information. Further, the image information can be not only a still image but also a moving image.

Further, by providing an external device connection section and connecting to a personal computer or the like, the data taken in the portable information collecting device of the present invention is inputted to the personal computer, and taken into a certain page on the personal computer, for example. It is also possible to perform an editing operation such as adding the content of another page to the edited content.

In the above description, the entire display screen is considered as a display surface opened on the screen, and this display screen is described as a page. However, the present invention is not limited to this. One window opened on one screen Is regarded as one page, and the present invention can be applied.

The processing program for performing the processing of the present invention described above can be stored in a storage medium such as a floppy disk, an optical disk, or a hard disk, and the present invention also includes the storage medium. Also,
The processing program may be obtained from a network.

[0110]

As described above, according to the present invention,
When displaying the captured image information on the screen, since the image is displayed with a margin left on the screen,
When writing a comment etc. for the displayed image,
Writing comments is easy and easy to read.

Further, when displaying the image, by giving a variable for determining the display size of the image, the display size of the image can be arbitrarily set within the screen size, and the display position of the image on the screen can be changed. By giving a variable to be determined, the display position of the image can be set arbitrarily, so that the user can arbitrarily set the display size and display position of the image according to the situation, the image size according to the situation, The display position can be set. Further, considering the ease of viewing the screen and the ease of writing characters and the like, the display size of the image information is approximately two-thirds of the vertical size and the horizontal size of the image, respectively. By doing so, the size of the image and the margin portion become appropriate. In other words, the image can be maintained in a size that is easy to see without being too small, and information such as a comment can be easily written and the image can be used easily. Also, when displaying an image with a margin on the screen, the display position of the image is set to the position where the upper left corner of the image matches the upper left corner of the screen, so that characters can be displayed while viewing the image. Is written, the positional relationship between the image and the margin becomes an easy-to-use arrangement, and the usability can be improved.

Further, according to the present invention, when each information such as ink information and image information taken in as information of a certain page is written at a predetermined address of the storage means as information associated with the page and displayed, It is possible to read out such information and superimpose and display it as related information. Therefore, it is possible to selectively delete any of the data displayed in a superimposed manner, and it is also possible to display for each type of information such as only an image or only a handwritten input. .

Further, according to the present invention, the data amount of the handwritten input information can be greatly reduced by incorporating the handwritten input information as coordinate point sequence data instead of bitmap data, and the memory can be effectively utilized. Furthermore, when the coordinate point sequence data is captured, the coordinate data of the input start point and the relative position data of each sampling point on the movement are captured, and the start point coordinate data and the relative value are stored, so that the data of the handwritten input information is obtained. The amount can be further reduced.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a configuration of an embodiment of the present invention.

FIG. 2 is an external configuration diagram of a portable information collection device as an embodiment of the present invention.

FIG. 3 is an exemplary view showing a display example of information taken into the portable information collecting apparatus according to the embodiment of the present invention;

FIG. 4 is a diagram illustrating contents of a flash memory according to an embodiment of the present invention.

FIG. 5 is a view for explaining an example in which handwritten input information (line drawing) is taken in as coordinate point sequence data in the embodiment of the present invention.

FIG. 6 is a diagram illustrating a range in which relative positions can be taken and a comparison table in a case where the range is represented by a hexadecimal number, for explaining a process of compressing coordinate point sequence data.

FIG. 7 is a view for explaining compressed data for each coordinate point sequence data in a process of compressing the coordinate point sequence data.

FIG. 8 is a flowchart for explaining processing when coordinate point sequence data is stored in a flash memory without data compression.

FIG. 9 is a view showing coordinate point sequence data stored in a flash memory when the processing of FIG. 8 is performed.

FIG. 10 is a flowchart illustrating a process in a case where coordinate point sequence data is compressed and stored in a flash memory.

FIG. 11 is a view showing coordinate point sequence data stored in a flash memory when the processing of FIG. 10 is performed.

FIG. 12 shows a display memory (VRA) from a flash memory.
FIG. 9 is a view for explaining a write process to M).

FIG. 13 is a view for explaining a display example when two pieces of information are overwritten.

FIG. 14 is a flowchart illustrating display processing of an image and handwritten input information according to the embodiment of the present invention.

FIG. 15 is a diagram illustrating conversion of a display size of an image with respect to a screen.

FIG. 16 is a diagram showing another display example of an image on a screen according to the embodiment of the present invention.

[Explanation of symbols]

 21 CPU 22 ROM 23 CCD Camera 23a CCD Camera Lens 24 CCD Controller 25 Tablet 26 LCD Controller 27 Flash Memory 28 RAM 29 Real Time Clock 30 Power Switch 31 Next Page Button 32 Previous Page Button 33 Camera Button 34a, 34b Erase Button 35 Button Signal Processing unit 36 System bus 37 Display memory (VRAM) 51 Input pen 61, 63, 72 Example of captured image 62, 64, 71 Example of captured ink information

Claims (16)

[Claims] 1. A portable information collecting apparatus capable of capturing at least handwritten input information and image information, and having a function of displaying the information and storing the collected information. A portable information collecting apparatus characterized in that, when displaying on a screen, an image can be displayed while leaving a blank space on the screen. 2. A portable information collection device capable of capturing at least handwritten input information and image information, and having a function of displaying the information and storing the collected information. Each information input means to be input, and when each information is arbitrarily input as information to be displayed on the same display surface, each input information is written to an address designated as associated information. A data storage unit, a display storage unit in which information stored in the data storage unit is written as display information of a display surface opened on a screen, and a control unit that controls each of these units. A plurality of types of information associated with each other in the data storage unit are written into the display storage unit as display information on a display surface opened on a screen. In this case, a writing order is set for each type of input information, and the information is sequentially written in the display storage means for each type of information and displayed on the screen according to the order, and the image information displayed on the screen is A portable information collecting apparatus characterized in that it can be displayed after being converted to a display size that leaves a margin on a screen. 3. When displaying the image, by giving a variable for determining the display size of the image, the display size of the image can be arbitrarily set within the screen size, and the display position of the image on the screen can be changed. 3. The portable information collection device according to claim 1, wherein a display position of an image can be arbitrarily set by giving a variable to be determined. 4. When displaying an image with a margin left on the screen, the display size of the image is determined by dividing the size of the image in the vertical and horizontal directions by two times the screen size in the vertical and horizontal directions of the screen, respectively. 3. The method according to claim 1, wherein the number is about three.
4. The portable information collection device according to any one of items 1 to 3. 5. When displaying an image with a margin left on the screen, the display position of the image is a position where the upper left corner of the image is matched with the upper left corner of the screen. The portable information collection device according to claim 1. 6. The portable information collecting apparatus according to claim 1, wherein said handwritten input information is fetched as coordinate point sequence data and stored in said data storage means. 7. When fetching the handwritten input information as coordinate point sequence data, fetching coordinate data of an input start point and coordinate data of each sampling point on the movement, and storing these coordinate data in the data storage means. The portable information collection device according to claim 6, wherein: 8. When the handwritten input information is captured as coordinate point sequence data, coordinate data of an input start point and relative position data of each sampling point on the movement are captured, and the start point coordinate data and the relative position data are stored in the data. The portable information collection device according to claim 6, wherein the portable information collection device stores the information in a storage unit. 9. An information processing method in a portable information collection device capable of capturing at least handwritten input information and image information, and having a function of displaying the information and storing the collected information. An information processing method in a portable information collecting apparatus, wherein when displaying fetched image information on a screen, the image can be displayed while leaving a margin on the screen. 10. An information processing method in a portable information collection device capable of capturing at least handwritten input information and image information, and having a function of displaying the information and storing the collected information. After each piece of information arbitrarily input as information to be displayed on the display surface is written as associated information at a designated address of the data storage means, a plurality of associated types in the data storage means are written. Is written in the display storage means as display information on the display surface opened on the screen, and when writing to the display storage means, the information associated with the data storage means is displayed on the display storage means. Set the writing order to the storage means,
According to the order, it is possible to sequentially write the associated information in the display storage means and display it on the screen, and to convert the image information displayed on the screen to a display size that leaves a margin on the screen and display it. An information processing method in a portable information collection device, comprising: 11. When displaying the image, by giving a variable for determining the display size of the image information, the display size of the image can be arbitrarily set within the screen size, and the display position of the image on the screen 11. The information processing method in the portable information collection device according to claim 9, wherein a display position of an image can be arbitrarily set by giving a variable for determining the image display position. 12. When displaying an image with a margin left on the screen, the display size of the image is determined by dividing the size of the image in the vertical direction and the horizontal direction by two times the screen size in the vertical direction and the horizontal direction of the screen, respectively. 12. The information processing method in the portable information collection device according to claim 9, wherein the number is about three. 13. When displaying an image with a margin left on the screen, the display position of the image is a position where the upper left corner of the image matches the upper left corner of the image. An information processing method in the portable information collection device according to claim 9. 14. The information processing method according to claim 9, wherein the handwritten input information is captured as coordinate point sequence data. 15. The method according to claim 15, wherein when the handwritten input information is captured as coordinate point sequence data, the coordinate data of the input start point and the coordinate data of each sampling point on the movement are captured, and these coordinate data are stored. Item 15. An information processing method in the portable information collection device according to Item 14. 16. When the handwritten input information is captured as coordinate point sequence data, the coordinate data of the input start point and the relative position data of each sampling point on the movement are captured, and the start point coordinate data and the relative position data are stored. 15. The information processing method in the portable information collection device according to claim 14, wherein: