JPH05324704A - Bilingual image forming device - Google Patents

Abstract

PURPOSE:To eliminate a deficiency in information and efficiently read a document in a foreign language by classifying words whose equivalents are to be outputted and words whose equivalents need not be outputted, and generating a word book wherein the words to be outputted and their equivalents are listed. CONSTITUTION:When the power source is turned on, process modes, etc., are initialized. Then it is judged whether bilingual operation is instructed from an operation board 112 or not. When not, normal copying operation is performed and a wait state for the bilingual operation indication is entered. When the bilingual is indicated, on the other hand, it is judged what is a process format indication from the operation board 112. When a word process is judged, it is similarly judged whether or not there is a start instruction from the operation board 112. Once the start instruction is judged, an original set on a scanner part 101 is read and stored in an input image memory 104. Then the number of pages of the original is counted and original recognition is performed. Then the word book for the words present in the original image is generated.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a bilingual image forming apparatus such as a copying machine or a facsimile machine which uses digital image data having a bilingual function, and more specifically, it optically reads an original document (or communication line). The present invention relates to a bilingual image forming apparatus that creates a wordbook by recognizing a word in read (or input) image information by inputting image information via) and outputting a translated word corresponding to the word.

[0002]

2. Description of the Related Art For a person who reads a sentence written in another language, there is no problem in reading comprehension of many parts of the sentence, but it is difficult to read because only a specific word does not know an appropriate translation. There are many situations where it is not possible. In such a situation, it is a common experience to know the meaning of the specific word using a dictionary and proceed with reading.

Therefore, as a translation copying machine for automatically translating and outputting a sentence written in another language, there is, for example, a "translation copying machine" disclosed in Japanese Patent Laid-Open No. 154845/1987. According to the publication disclosed in that publication, the first
Firstly, the image reading means reads the original image, and secondly, the original image read by the identifying means is distinguished into pattern information and character information,
Third, the translation means recognizes the character information for each character,
Further, the content is translated into another language and the translated image is output together with the original image. Therefore, according to the technique disclosed in the above publication, a translated image relating to character information can be obtained together with a copy image of an original image, and therefore the labor of using a dictionary can be omitted.

[0004]

However, in the above-mentioned "translation copying apparatus" in the prior art, since a translated image relating to character information can be obtained together with a copied image of the original image, it is not necessary to use a dictionary. However, for many users who have a certain level of language knowledge, considering the current translation linguistics and implementation costs, which are not necessarily error-free, it is highly redundant and is always a desirable function. There was a problem that I could not say.

Further, in the conventional art, for a manuscript image having a plurality of columns, the position of the translated word corresponding to the word existing in the manuscript image is not clear, and the addition of the translated word causes The contents have changed drastically, the initial layout is broken, and the copied images are very difficult to read. Furthermore, when the bilingual information is posted on the same recording paper as the manuscript image information, since the space for the translated word information is limited, only the minimum necessary translated word information can be posted, and due to lack of information, other languages are not available. There was a problem that it was not possible to read the sentences in the text efficiently and quickly.

The present invention has been made in view of the above-mentioned problems, and the translated words corresponding to the words existing in the manuscript image are collected as a word book to eliminate the information shortage and to efficiently write sentences in other languages. ， The purpose is to be able to read through quickly.

[0007]

SUMMARY OF THE INVENTION According to the present invention, an image reading means for optically reading a document image and converting it into image information, and image information read by the image reading means or an image input through a communication line. Image storage means for storing information, image processing means for performing various image processing on the image information, image recording means for recording an image on a recording medium based on an image signal output by the image processing means, In a bilingual image forming apparatus having translation word storage means for storing the original image information and translation word information corresponding to the information, and control means for executing bilingual processing on the original image information based on the information in the translation word storage means. The control means recognizes words in the manuscript image information, classifies words for which translated words and words for which translated words do not need to be output, and outputs the translated words. There is provided a translation image forming apparatus which controls to create output wordbook in which the translation of said word in the list.

Further, it is preferable that the control means limits the number of output characters or / and the number of output lines of the translated word in the word book to a predetermined number.

Further, it is preferable that the control means performs a re-search control for executing a translated word output for the word when it is determined that the translated word information recognized from the manuscript image information further includes a word.

Further, it is preferable that the control means limits the number of repetitions of the re-search control to a predetermined number.

Image reading means for optically reading a document image and converting it into image information, and image storing means for storing the image information read by the image reading means or the image information input through a communication line. Image processing means for executing various image processing on the image information, image recording means for recording an image on a recording medium based on an image signal output by the image processing means, and bilingual translation of information in the original image. A parallel translation image forming apparatus capable of outputting a translated word for the word when the translated word information recognized from the manuscript image information further includes a word. , Parallel translation image formation including selection means for selecting a re-retrieval mode in which the word translation output is executed and a normal mode in which the word translation output is not executed It is to provide a location.

Further, it is preferable that the control means controls the output order of the words in the word book and the translated words of the words based on the output order of the words in the manuscript image information or the alphabetical order of the words.

Further, it is preferable that the control means controls the same page of the word book so as to eliminate duplicate description of the same word and a translation of the word.

Further, when the control means determines that a group word composed of a plurality of words connected by a specific symbol is not stored in the translated word storage means, at least one of the group word connection is determined. It is preferable to control so that the word book is created by decomposing and outputting the translated words for the divided words.

[0015]

The present invention recognizes words in manuscript image information,
A word for which a translated word should be output and a word for which a translated word does not need to be output are classified, and a word book that lists the words for which the translated word should be output and the translated words of the word is created and output. Further, the number of output characters or (and) the number of output lines of the translated word in the word book is limited to a predetermined number.

Further, when it is determined that the translated word information recognized from the manuscript image information has a further word, re-search control for executing the translated word output for the word is performed. Also, the number of repetitions of the re-search control is limited to a predetermined number.

Further, it is possible to select a re-search mode in which word translation output is executed or a normal mode in which word translation output is not executed.

Further, the output order of the words in the wordbook and the translations of the words is controlled based on the output order of the words in the document image information or the alphabetical order of the words. Further, in the same page of the word book, the same word and the translation of the word are controlled to be excluded from being duplicated.

When it is determined that a group word composed of a plurality of words connected by a specific symbol is not stored in the translated word storage means, at least one of the group word connections is decomposed and divided. It controls to output a translated word for the selected word and create a word book.

[0020]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiments of a bilingual image forming apparatus according to the present invention will be described below. (1) Schematic configuration of bilingual image forming apparatus (2) Configuration of scanner section and printer section (3) CPU processing operation (3)- Manuscript recognition process (3) -Paragraph, line, page composition process (3) -Translation dictionary search process for inset composition (3) -Translation dictionary search process I for wordbook creation (3) -Wordbook creation (3) -Translation word storage processing (3) -Inset composite image generation processing (3) -Wordbook image generation processing will be described in this order with reference to the drawings.

(1) Schematic Configuration of Parallel Image Forming Apparatus FIG. 1 is a block diagram showing a schematic configuration of a parallel image forming apparatus which is an embodiment of the present invention. This bilingual image forming apparatus includes a scanner unit 101 that reads an original image, a CPU 109 that controls the entire apparatus, a ROM 110 that stores a control program, a RAM 111 that is temporarily used by the control program, and an input that stores the read image. Image memory 104, output image memory 10 for storing output images
5, a recognition dictionary memory 106 in which data used for character recognition is stored, a translation dictionary memory 107 in which a word and a translation corresponding to the word are stored, and an output in which character font data used for image generation is stored Font memory 108, internal system bus 115 for exchanging data between devices, A / D converter 102 for converting analog signals into digital signals, I / Fs 103, 113 for interfacing with system bus 115, and outputs A printer unit 114 for outputting the image stored in the image memory,
Operation board 112 that gives instructions such as start and stop
Etc.

Further, this bilingual image forming apparatus has a facsimile communication function, and 116 is a network control unit (NCU) 117 for closing and opening a telephone line or transmitting a dial signal and detecting a ringing frequency. Is a modem (modulator / demodulator) that performs data modulation when transmitting data to a telephone line (analog line) and demodulates data when receiving.
Reference numeral 8 denotes a communication control unit for executing processing before sending the image information to the telephone line (re-compressing the data according to the facsimile function of the receiving side or reducing the image information). Descriptions of other parts necessary for the facsimile communication function are omitted.

(2) Configuration of Scanner Unit and Printer Unit FIG. 2 is an explanatory diagram showing a schematic configuration of the inside of the scanner unit 101 and the printer unit 114. The contact glass 201 for placing a document on the scanner unit 101 is
Illuminated by the light sources 202a and 202b, the reflected light from the read document is imaged on the light receiving surface of the CCD image sensor 209 via the mirrors 203 to 207 and the lens 208. Light source 202 (202a, 202b) and mirror 20
3 is mounted on a traveling body 210 which moves the lower surface of the contact glass 201 parallel to the contact glass 201 in the sub-scanning direction. Moving body 2 moving to
It is installed in 11. CC in the main scanning direction
The original image is read by the CCD image sensor 209 by the solid-state scanning of the D image sensor 209, and the entire original is scanned by moving the optical system as described above. Incidentally, reference numeral 239 in the figure is a pressure plate for pressing the document.

Next, the printer unit 114 comprises a laser writing system, an image reproducing system and a paper feeding system. The laser writing system includes a laser output unit 221, an imaging lens 22.
2 and a mirror 223. Inside the laser output unit 221, a laser diode, which is a laser light source, and a polygon mirror that rotates at high speed by a motor are provided. The laser beam output from the laser writing system is applied to the photosensitive drum 224 of the image reproducing system. Around the photosensitive drum 224, a charging charger 225, an eraser 226, a developing unit 227, a transfer charger 228, a separation charger 229, a separation claw 2 are provided.
30, a cleaning unit 231 and the like are provided. A beam sensor (not shown) for generating a main-scanning synchronization signal is arranged near the one end of the photosensitive drum 224 at a position where the laser beam is emitted.

The operation of the image reproduction process in the printer section 114 will be briefly described. The peripheral surface of the photosensitive drum 224 is uniformly charged to a high potential by the charging charger 225. When the peripheral surface is irradiated with laser light, the potential of the irradiated part is lowered. Laser light is black for recording / playback
Since the ON / OFF control is performed according to the white color, the potential distribution corresponding to the recorded image, that is, the electrostatic latent image is formed on the peripheral surface of the photosensitive drum 224 by the irradiation of the laser light. When the portion on which the electrostatic latent image is formed passes through the developing unit 227, toner adheres according to the level of the potential, and the electrostatic latent image becomes a visualized toner image. In the part where the toner image is formed,
The recording sheet 232 is fed from the paper feed cassette at a predetermined timing and overlaps the toner image. The toner image is transferred to the recording sheet 232 by the transfer charger 228, and then separated from the photoconductor drum 224 by the separation charger 229 and the separation claw 230. The separated recording sheet 232 is conveyed by a conveyor belt 234, heated by a fixing roller 235 having a heater built therein, and then ejected to an ejection tray 236.

Further, in this embodiment, as shown in FIG. 2, the printer section 114 has two paper feeding systems. One of the paper feed systems includes an upper paper feed cassette 233a and a manual paper feed tray 2
33c, and the recording sheets 232 set in the upper paper feed cassette 233a and the manual paper feed tray 233c.
The sheet a is fed by the sheet feeding roller 237a. The other paper feed system is provided with a lower paper feed cassette 233b, and the recording sheet 232b in the lower paper feed cassette 233b is fed by a paper feed roller 237b. Then, the recording sheet 232 fed from any one of the sheet feeding rollers is temporarily stopped while being in contact with the registration roller 238, and the photosensitive drum 224 is synchronized with the progress of the recording process.
Is sent to the transfer section of.

(3) CPU Processing Operation FIGS. 3 to 13 are flowcharts showing the processing operation of the CPU 109. First, refer to the flowchart of FIG. When the power is turned on (ON), the processing mode and the like are initialized (S301). Next, it is determined whether there is a parallel translation operation instruction from the operation board 112 (S30).
2). When there is no parallel translation operation instruction, the normal copying operation (S
303) is performed and the state of waiting for the parallel translation operation instruction (S302) is resumed.

On the contrary, when the parallel translation operation instruction is given, it is judged what the processing format instruction from the operation board 112 is (S304). Here, when it is determined that the process is the inset combining process, it is determined again whether or not there is a start instruction from the operation board 112 (S305). If it is determined that the start instruction is given, the original image set on the scanner unit 101 is read (S307) and stored in the input image memory 104. Next, the number of pages of the document is counted (S309), and document recognition (S311) is executed.

If it is determined in step 304 that the wordbook processing is being performed, it is similarly determined again whether or not there is a start instruction from the operation board 112 (S306). If it is determined that the start instruction is given, the original image set on the scanner unit 101 is read (S
308), and stores it in the input image memory 104. Next, the number of pages of the manuscript is counted (S310), and the manuscript recognition (S310) is performed.
312) is executed.

(3) -Original Recognition Processing The processing of original recognition (S311 / S312) is shown in FIG.
In document recognition, first, column recognition (S401) is executed.
The column recognition recognizes a case where a portion (white area) of the read image data where no character exists in a main scanning direction / sub-scanning direction is a certain interval or more as a column break. Next, column position recognition (S402) is executed. The column position recognition is read by the scanner unit 101, and the input image memory 10
Coordinates are given in pixel units to the image information stored in 4, and the coordinates occupied by the recognized column in the image are obtained. For example, "Chapter 1" in the manuscript shown in FIG.
For example, the column starting with "Ch
The rectangular area that completely includes the column starting with "apter 1" is obtained, and the coordinates (bsx, bs) at the upper left of the area are obtained.
y) and the lower right coordinate (bex, bey) are recognized.

Next, line recognition (S403) is executed. Line recognition is performed for each recognized column, and when a portion (white area) of the read image data where there is no character in the sub-scanning direction is present over a certain interval, it is recognized as a line delimiter. Next, line position recognition (S404) is executed. In the line position recognition, coordinates are given in pixel units to the image information read by the scanner unit 101 and stored in the input image memory 104, and the coordinates occupied by the recognized line in the image are obtained.
For example, in the manuscript shown in FIG.
Taking a line starting with "gle" as an example, as shown in FIG. 16, a rectangular region that completely includes the line starting with "from single" is obtained, and the upper left coordinates (ls
x, lsy) and the lower right coordinate (lex, ley) are recognized.

Next, character recognition (S405) is executed.
The character recognition algorithm uses a combination of conventional techniques such as template matching and topological matching. Next, word extraction (S406) is executed from the characters recognized by the character recognition. Words are extracted line by line, and if there are more than a certain interval (white area) in the scanned image data where there are no characters in the scanned image data, or if there are space characters, punctuation marks, or other delimiters, the words are separated. To extract. Next, word position recognition (S407)
To execute. In the word position recognition, coordinates are given in pixel units to the image data read by the scanner unit 101 and stored in the input image memory 104, and the coordinates occupied by the recognized word in the image are obtained. For example, taking the word “This” in the manuscript shown in FIG.
As shown in FIG. 3, a rectangular area completely containing “This” is obtained, and the upper left coordinates (wsx, wsy) and the lower right coordinates (wex, way) of the area are recognized.

(3) -Paragraph / Line / Page Compositing Process Next, returning to the flowchart of FIG. 3, in the case of inset compositing process and word book process, paragraph / line / page compositing process (S3).
13 / S314) is executed. This process is shown in FIG.
In the paragraph, line, and page combination processing, first, read image copying (S501) is executed. In the read image copying, the image information read by the scanner unit 101 and stored in the input image memory 104 is copied to the output image memory 105.

Next, a column framework drawing (S502) is executed. In the column framework drawing, a rectangle completely including each column is drawn based on the coordinate data obtained by the column position recognition in step 402. That is, in each column, (bsx, bsy) and (bex, be
Draw a rectangle with y) as diagonal coordinates. FIG. 17 shows an example of drawing a column framework.

Next, stage number composition (S503) is executed. In column number composition, a column number is sequentially added to the upper left of each column for each column recognized by the column recognition in step 401. The method of adding the column number is such that font data used for the column number to be added is output to the output font memory 10
It is read out from the memory 8 and expanded in the output image memory 105.
(Bsx, bsy) is used as the reference coordinate at this time. That is, the expansion of font data is (bsx, bsy)
Execute starting from. FIG. 17 shows an example in which a column number is drawn.

Next, line number composition (S504) is executed. In the line number synthesis, a line number is sequentially added to the left side of each line recognized by the line recognition in step 403. As a method of adding a line number, the font data used for the line number to be added is read from the output font memory 108 and expanded in the output image memory 105. (Lsx, lsy) is used as the reference coordinate at this time. That is, the expansion of the font data is executed starting from (lsx, lsy). FIG. 17 shows an example in which line numbers are drawn. In this example, the output line number is limited to a multiple of 5.

Next, page number composition (S505) is executed. In the page number combining, the page number counted by the document page number counting in step 306 is added to the lower center portion of the image in the output image memory 105. The page number addition method is similar to the step number addition method, the font data used for the page number to be added is read from the output font memory 108, and the output image memory 1 is read.
Expand to 05. As the reference coordinates at this time, the coordinates of the lower central portion of the image in the output image memory 105 are determined in advance. The expansion of font data is performed with the determined coordinates as the starting point. FIG. 17 shows an example in which page numbers are drawn.

An image in which a paragraph number, a line number, and a page number are combined with the original image read by the above processing is created in the output image memory 105. Next, a print output (S315 / S3) for recording this image by the printer unit 114 is performed.
16) is executed (see FIG. 3). Thereafter, in the word book process, the recognized word is sorted (S3).
29).

(3) -Translation dictionary search processing for inset synthesis Next, translation word dictionary search for inset synthesis (S317)
Will be explained. This process is shown in the flowchart of FIG.
In the translation word dictionary search, first, a recognition word read operation (S601) is performed in which one of the words extracted and stored in the word extraction processing (see FIG. 4) in step 406 is read. Next, it is inspected whether or not the word read by the inflection change inspection (S602) has an inflection change associated with its use (S603). If the word has changed, the part of speech of the word is specified by specifying the part of speech (S604). For example, when "s" is added as the inflection change, it is determined to be a part of speech that can be plural, and is identified as a noun. Also, "e
If it has "d", it is determined as a part of speech that can be in the past tense and is identified as a verb. If there is a change in inflection, the original form of the word is obtained by further obtaining the original form (S605).

Next, a dictionary search (S606) is executed.
The dictionary search basically uses a pattern matching algorithm. In the translated word dictionary memory 107, a word and a translated word corresponding to the word are registered in advance in pairs. Also,
In the translated word dictionary memory 107, output attributes are also registered for each word. The words in the translated word dictionary memory 107 and the words read by the recognition word reading in step 601 are compared character by character, and it is determined whether or not there is a word in which all the characters match (S607). If there is a word in which all the characters match, the target word is registered in the dictionary. When the target word exists in the dictionary, next, an output attribute check (S608) is executed. The above-mentioned output attribute is an attribute that determines whether or not the translated word corresponding to the word is actually output. In the case of a word such as a simple word that does not need to be output, the output is not output. The attribute is added to the translated word dictionary memory 107 and registered.

If it is determined in the output attribute check in step 608 that the word is to be output, then the neighborhood output check (S609) is executed. This neighborhood output test is
It is checked whether the word currently being searched for in the dictionary has already appeared near the current line and the translated word is registered. Specifically, the word corresponding to the translated word stored in the translated word storage (S610) and the word currently undergoing the dictionary search are compared character by character to determine whether or not a matching word exists. If there is a matching word, it means that the word currently being searched for in the dictionary is in the vicinity,
If there is no matching word, it means that it does not exist in the neighborhood. After that, the output flag is set to the word in which the translated word is stored (S611). Further, the word determined to be “not in the dictionary” in step 607, the word determined to be “output attribute does not output” in step 608, and determined to be “already output in the vicinity” in step 609. The output flag of the selected word is reset (S612). The above process is repeated until all the extracted words are finished (S613).

(3) -Translation Dictionary Search Process I for Creating a Wordbook Next, the translation dictionary search (S318) for creating a wordbook will be described. This process is shown in the flowchart of FIG. In the translated word dictionary search, first, a recognized word read (S701) is executed to read one of the words extracted and stored by the word extraction processing (see FIG. 4) in step 406. Next, it is checked whether or not the word read by the word end change inspection (S702) has a word end change associated with its use (S703). If the word has changed, the part-of-speech of the word is specified by specifying the part-of-speech (S704). For example, when "s" is added as the inflection change, it is determined to be a part of speech that can be plural, and is identified as a noun. Also, "e
If it has "d", it is determined as a part of speech that can be in the past tense and is identified as a verb. If there is a change in inflection, the original form of the word is obtained by further obtaining the original form (S705).

Next, a dictionary search (S706) is executed.
The dictionary search basically uses a pattern matching algorithm. In the translated word dictionary memory 107, a word and a translated word corresponding to the word are registered in advance in pairs. Also,
In the translated word dictionary memory 107, output attributes are also registered for each word. The words in the translated word dictionary memory 107 and the words read by the recognition word reading in step 601 are compared character by character, and it is determined whether or not there is a word in which all the characters match (S707). If there is a word in which all the characters match, the target word is registered in the dictionary. If the target word is present in the dictionary, then an output attribute check (S708) is executed. The above-mentioned output attribute is an attribute that determines whether or not the translated word corresponding to the word is actually output. In the case of a word such as a simple word that does not need to be output, the output is not output. The attribute is added to the translated word dictionary memory 107 and registered.

If it is determined in the output attribute check in step 708 that the word is to be output, then a neighborhood output check (S709) is executed. This neighborhood output test is
It is checked whether the word currently being searched for in the dictionary has already appeared near the current line and the translated word is registered. Specifically, the word corresponding to the translated word stored in the word book translated word storage (S711) and the word currently undergoing the dictionary search are compared character by character to determine whether or not there is a matching word. To do. If there is a matching word, the word currently being searched for in the dictionary is in the vicinity, and if there is no matching word, it is not in the vicinity. When it is judged that it exists in the vicinity,
The number of reference lines is stored (S714), and the neighborhood output flag is set (S715). On the other hand, if it is determined that the word does not exist in the vicinity, the word output word storage process (S711) is executed after resetting the vicinity output flag (S710). After that, the output flag is set to the word for which the translated word is stored (S712). Further, the output flag is reset for the word determined to be "not present in dictionary" in step 707 and the word determined to be "output attribute not output" in step 708 (S716).
The above process is repeated until all the extracted words are completed (S713).

(3) -Translation dictionary search process II for creating a word book FIG. 8A is an explanatory diagram showing the contents stored in the RAM 111. 0 to 4 on the right side are addresses, and A1, B1 and B on the left side.
2, C1 are data stored corresponding to each address. FIG. 8B is a flowchart showing a translated word dictionary search processing operation when an English word is detected in a translated word. In the figure, lvl is a re-search level, wrp is a word read pointer, wwp is a word write pointer, and ec is an end code.

First, lvl = 1, wrp = 0, wwp =
1, ec = 1 (S801), English word reading is executed (S802), and wrp is set to wrp + 1 (S803). After that, the processing of 318 'shown in FIG. 7 is executed (S804), and it is determined whether or not an English word is detected in the translated word (S805). As a result, if an English word is detected in the translated word, the English word is stored (S80
6), wwp is set to wwp + 1 (S807). After that, it is judged whether or not the English words in the translated words are finished (S8).
08), if it is determined that the English word in the translated word has not ended, the process returns to step 806, and the subsequent processing is repeated until it is determined that the word has ended. On the other hand, when it is determined that the English word in the translated word has ended, it is determined whether ec = wrp (S809). If it is determined that ec ≠ wrp, the process returns to step 802, and the subsequent processing is performed.
Repeat until it is determined that c = wrp. On the contrary, e
If it is determined that c = wrp, then it is determined whether or not lvl = translation setting level (S810). If it is determined that lvl ≠ translation setting level is not set, then lvl = lvl + 1 is set (S811), and ec = Set to wwp (S81
2) Return to the above step 802, and the subsequent processing is lvl.
= Repeat until the translation setting level is determined. On the contrary, when it is judged that the translation level is set, the process returns. Further, when selecting the normal mode in which the basic form translation is not executed, the setting in step 810 is set to 1
You can set it to.

Next, a specific processing example of the above embodiment will be described. That is, when a dictionary search is performed and it is determined that the translated word includes a citation of a basic form, the basic form is re-searched and output.

First, as in the following example, the first-ranked translated word of the part-of-speech part judged from the changed form is output in the translated word of the basic form re-searched. Input English word: gone Headline English word: gone Translated word: go Input English word: feet Headword English word: feet Translated word: foot Second, as in the following example, it is judged from the form of change in the re-searched basic form translated word. The translation word of the part-of-speech part is inserted into the translation word of the heading English word found first, and all the translation words are output. Input word: gone Headline English word: gone Translated word: [verb] go participle of go [go, run]
[Shape] Erroneous input word: feet Heading English word: feet Translation: [mov] Feet (unit of length), plural of foot [foot, (mountain) foot, foot (length)] In the example shown above, the contents of the translated word dictionary memory 107 are as follows. go [moving] go, running [name] going, (leaving), energetic gone [moving] go past participle [form] of go,
Pleasant foot [name] edge, foot of (mountain), foot (length) feet [name] feet (unit of length), plural of foot In addition, in this embodiment, one word of When there are multiple citations of different words in the translated word, re-search is executed up to 3 words. (3) -Translated word storage process Next, the translated word storage (S610) shown in FIG. 6 will be described. This process is shown in FIG. In this translated word storage process, a word and a translated word corresponding to the word are read from the translated word dictionary memory 107 and stored. The translation dictionary memory 107 stores a word and a translation corresponding to the word in pairs.
The translated word has a plurality of meanings registered for one word. Each translated word is prioritized by part of speech.

Next, it is judged in the part-of-speech identification inspection (S901) whether or not the part-of-speech is identified by the part-of-speech identification (see FIG. 6) in step 604. If the part of speech is specified, the translation of the specified part of speech is read (S90).
3). On the contrary, when the part of speech is not specified, it is determined whether or not there are a plurality of parts of speech (S902). When there are a plurality of parts of speech, the translated word of the first priority part of speech is read (S90).
4). When there are no plural parts of speech, the translated word is read (S9).
05).

For example, the word "play" is stored in the translation word dictionary memory 107 as follows. play [verb] play; to do; to play [name] to play This is the first priority part of speech is a verb, and the translated words at that time are "play", "...", "play", and second priority. Part of speech is a noun, and the translated word at that time is "play." That is, if the part of speech is specified as a verb, "play" is read, and if it is specified as a noun, "play" is read. When the part of speech is specified, the word "play" which is the translation of the first priority part of speech is read. The translated word thus read is stored together with the word (S906).

Next, the translated word storage process of the word book (S711)
Will be described with reference to FIG. Next, a part-of-speech identification inspection (S1001) determines whether or not the part-of-speech is identified by the part-of-speech identification (see FIG. 7) in step 704. If the part of speech is specified, the translated word of the specified part of speech is read (S1003). On the contrary, when the part of speech is not specified, it is determined whether there are a plurality of parts of speech (S1002). When there are a plurality of parts of speech, the translated word of the first priority part of speech is read (S1004). When there are no plural parts of speech, the translated word is read (S1005).

In step 1003, after the translated word of the specified part of speech is read, the translated words of the remaining part of speech are read (S1006). Similarly, the above step 1004
In step S1007, after the translated word of the first priority part-of-speech is read out, the translated words of the remaining part-of-speech are read out (S1007). Thereafter, the translated word thus read is stored together with the word (S
1008).

Next, returning to the flowchart of FIG. 3, the output page number counting (S319 / 320) is executed. In the present invention, since the image generated and output by the image generating means has a larger amount of information than the read original image,
The output image of a plurality of pages may correspond to the original image of one page. In the output page count processing,
The number of pages of this output image is counted.

(3) -Inset Composite Image Generation Process Next, the inset composite image generation process (S321) will be described. This process is shown in FIG. In the fitting composite image generation, first, paragraph number counting (S1101) is executed. The column number counting is performed by sequentially counting the columns recognized by the column recognition (see FIG. 4) in step 401. Next, column number composition (S1102) is executed. The column number combination is executed by reading the font data corresponding to the counted column number from the output font memory 108 and expanding it in the output image memory 105. FIG. 18 shows an example of executing this stage number combination.

Next, line number counting (S1103) is executed. The line number counting sequentially counts the lines recognized by the line recognition in step 403 (see FIG. 4). Next, line number composition (S1104) is executed. The line number composition is executed by reading the font data corresponding to the counted line number from the output font memory 108 and expanding it in the output image memory 105. Next, read line copying (S1105) is executed. In the read line copying, a rectangular area having the coordinates diagonally obtained by the line position recognition in step 404 is copied from the image information read by the scanner unit 101 and stored in the input image memory 104 to the output image memory 105. It is executed by An example of executing this line number synthesis is shown in FIG.
8 shows. Here, only the line numbers that are multiples of 5 are expanded.

Next, the output flag check (S1106) is executed. In the output flag check, it is determined whether the output flag for each word attached by the output flag set in step 611 and the output flag reset in step 612 (see FIG. 6) is set or reset. When it is determined that the output flag is set, the translated word is read (S1107). In the translated word reading, the translated word stored by the translated word storage (see FIG. 6) in step 610 is read. Then, translation word synthesis (S1108) is executed. The translated word synthesis is executed by reading the font data corresponding to the read translated word from the output font memory 108 and expanding it in the output image memory 105. The reference position to be expanded is calculated from the word position of the word corresponding to the expanded translated word. By expanding the translated word in the output image memory 105 as described above, the translated word corresponding to the word below the word for which the output flag is set is output in a state centered on the word.

Next, it is judged whether or not the processing has been completed for all the words in the line (S1109), and if not completed, the same processing is repeated for the next word from the "output flag check" in step 1106. .. When it is determined that the processing has been completed for all the words in the line, it is determined whether or not all the lines in the column have been completed (S1110). If not completed, the same process is repeated from the "line number count" in step 1103 for the next line. When it is determined that the processing has been completed for all the lines in the column, it is determined whether all the columns in the page have been completed (S11).
11). If not completed, the same process is repeated for the next stage from the "column number counting" in step 1101. Then, page number composition (S1112) is executed. The page number combining process is performed in step 50 shown in FIG.
The same process as the "page number composition" of 5 is executed.

(3) -Wordbook Image Generation Process Next, the wordbook image generation process (S322) will be described. This process is shown in FIG. The word book image generation process is
First, paragraph number counting (S1201) is executed. The column number counting is performed by sequentially counting the columns recognized by the column recognition (see FIG. 4) in step 401. Next, column number composition (S1202) is executed.
The column number combination is executed by reading the font data corresponding to the counted column number from the output font memory 108 and expanding it in the output image memory 105.

Next, line number counting (S1203) is executed. The line number counting sequentially counts the lines recognized by the line recognition in step 403 (see FIG. 4). Next, line number composition (S1204) is executed. The line number composition is executed by reading the font data corresponding to the counted line number from the output font memory 108 and expanding it in the output image memory 105. Next, the output flag check is executed (S1205). Here, if it is determined that the output flag is set, next,
English word composition is executed (S1206). After that, the neighborhood flag check is executed (S1207), and when it is determined that the word is reset, the translated word is read (S12).
08), translation word synthesis is executed (S1209). Conversely,
When it is determined that the neighborhood flag is set, the reference row numbers are combined (S1210).

In the output flag check of step 1205, including the case where it is determined that the output flag is reset, it is then determined whether or not the processing has been completed for all the words in the line (S1211), and the processing is completed. If not, the same process is repeated from the "output flag check" in step 1205 for the next word. If it is determined that the processing has been completed for all the words in the line, it is determined whether or not all the lines in the column have been completed (S1212). If not completed, the above step 1203 is performed for the next line.
The same process is repeated from "Line number count". When it is determined that the processing has been completed for all the lines in the column, it is determined whether all the columns in the page have been completed (S1).
214). If not completed, the same process is repeated for the next column from the "column number counting" in step 1201. Then, page number composition (S1214) is executed. The page number combining process is step 5 shown in FIG.
The same process as the "page number combination" of 05 is executed, but as shown in FIG. 12, a number in which the number of pages of the original image and the number of pages of the generated image are connected by a hyphen is combined.

Returning to the flowchart of FIG. 3, print output (S313) is then executed. The print output process is the same as the "print output" in step 309, and the image generated by the "inset composite image generation" in step 312 is printed by the printer unit 114.
Next, it is determined whether or not all the inlaid composite images corresponding to the read document have been printed (S314).
If it is determined that the process is not completed yet, the process returns to step 311, and the same process is repeated from the next page number count.

When all the printing is completed, all the read originals are read and it is judged whether or not the processing is completed (S31).
5). If it has not been completed yet, the same process is repeated from the "document reading" in step 305 for the next document. When all the above processing is completed, the process returns to the "parallel translation operation instruction" in step 302 above.

Further, in FIG. 13, when a group word composed of a plurality of words connected by special symbols is not stored in the translated word storage means, the group word connection is decomposed,
It is a flowchart which shows the operation | movement for controlling to output a translated word with respect to the divided | segmented word and to create a word book.

First, the special symbols "-", "&", "/"
A search for an English word including "etc." will be described. When an English word containing the special symbols "-", "&", and "/" is given, the dictionary is searched as appropriate for the English word. When the English word cannot be found in the dictionary, the English word is special symbol. Is divided into parts, and the search process is executed again for each of the divided English words. An output example is shown below. Input English word: electron-spin Headline English word 1: electron Translated word 1: Electronic Headword English word: spin Translated word 2: Spin In other modes, input English word: electron-spin Headword English word: electron translated word 1: [name ] Electron, electron Headword English 2: spin Translated word 2: [moving] spinning, spinning, turning,
Spinning The example shown above is a case where the contents of the translation word dictionary memory 107 are as follows. That is, electron [name] electron, electron spin [moving] spinning (threading), spinning,
Spin

Next, in FIG. 13, abc-de-f
The description will be made by taking the translation search process of gh as an example. First, ab
A translated word search is executed in the state of c-de-fgh (S13).
01). Then, in the abc-de-fgh state, it is determined whether the translated word is in the dictionary (S1302). If it is determined that it is in the dictionary, the process returns and the process described above is executed. On the contrary, if it is determined that the dictionary is not found in the dictionary, then a translated word search is executed in the abc-de state (S1303). Then, in the abc-de state, it is determined whether the translated word is in the dictionary (S1304). If it is determined that it is in the dictionary, a translation search for fgh is executed (S1309). On the contrary, if it is determined that the dictionary is not found in the dictionary, then a translation search is executed by abc (S130).
5). Next, a translated word search is executed in the de-fgh state (S1306), and then it is determined whether the translated word is in the dictionary in the de-fgh state (S1307). If it is determined that it is in the dictionary, it returns. Conversely,
If it is determined that the dictionary is not in the dictionary, the translated word search is executed in de (S1308), and the translated word search is executed in fgh (S1309), and then the process returns.

FIG. 14 shows an example of a word book output in each of the above processes.

Further, in the above embodiment, various controls in the bilingual image forming apparatus are realized by software. However, in view of the high speed of processing, hardware (entirely or partially) is required. It may be replaced with.

[0068]

As described above, according to the bilingual image forming apparatus of the present invention, the words in the original image information are recognized,
A word for which a translated word should be output and a word for which a translated word does not need to be output are classified, and a word book that lists the words for which the translated word should be output and the translated words of the word is created and output. In addition, the number of output characters and / or the number of output lines of the translated word in the word book is limited to a predetermined number, and when it is determined that the translated word information recognized from the manuscript image information has more words, the translated word of the word Perform re-search control that executes output. In addition, it is possible to limit the number of repetitions of the re-search control to a predetermined number, and select a re-search mode in which word translation output is executed or a normal mode in which word translation output is not executed. The output order of a word and its translation is
Control is performed based on the output order of the words in the document image information or the alphabetical order of the words. Further, in the same page of the word book, control is performed so as to eliminate duplicate description of the same word and its translated word, and a group word composed of a plurality of words connected by a specific symbol is the translated word. When it is determined that the word is not stored in the storage means, at least one of the connection of the group word is decomposed, and the divided word is output as a translated word so as to create a word book.
The translated words corresponding to the words existing in the manuscript image can be collected as a word book, the lack of information can be resolved, and the sentences in other languages can be read efficiently and quickly.

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration of a bilingual image forming apparatus according to the present invention.

FIG. 2 is an explanatory diagram showing a configuration of a copying machine that embodies a bilingual image forming apparatus according to the present invention.

3 is a flowchart showing a main operation of the bilingual image forming apparatus shown in FIG.

FIG. 4 is a flowchart showing the operation of the document recognition process shown in FIG.

5 is a flowchart showing an operation of a paragraph / line / page combining process shown in FIG.

FIG. 6 is a flowchart showing the operation of the translation dictionary search process (inset image) shown in FIG.

FIG. 7 is a flowchart showing an operation of the translated word dictionary search process (word book) shown in FIG.

8 is a flowchart showing the operation of the translated word dictionary search process (word book) shown in FIG.

9 is a flowchart showing the operation of the translated word storage process (inset image) shown in FIG.

10 is a flowchart showing the operation of the translated word storage process (word book) shown in FIG.

11 is a flowchart showing the operation of the embedded composite image generation process shown in FIG.

FIG. 12 is a flowchart showing the operation of the word book image generation processing shown in FIG.

13 is a flowchart showing the operation of another translation dictionary search process (word book) shown in FIG.

FIG. 14 is an explanatory diagram showing an example of a word book output by the bilingual image forming apparatus according to the present invention.

FIG. 15 is an explanatory diagram showing an example of a document image.

16 is an explanatory diagram showing a state where coordinates are designated for the original image shown in FIG.

17 is an explanatory diagram showing a state in which paragraph numbers are added to the document image shown in FIG.

FIG. 18 is an explanatory diagram showing an example of a copied image that is output after executing a series of parallel translation adding processes according to the present invention on the original image shown in FIG. 15;

[Explanation of symbols]

101 Scanner Unit 104 Input Image Memory 105 Output Image Memory 106 Recognition Dictionary Memory 107 Translation Dictionary Memory 108 Output Font Memory 109 CPU 110 ROM 111 111 RAM 114 Printer Unit 115 System Bus 116 Network Control Unit (NCU) 117 Modem 118 Communication Control Unit

Claims (8)

[Claims] 1. An image reading unit for optically reading a document image and converting it into image information, and an image storage unit for storing the image information read by the image reading unit or the image information input via a communication line. , Image processing means for performing various image processing on the image information, image recording means for recording an image on a recording medium based on an image signal output by the image processing means, the document image information and the information. In a parallel translation image forming apparatus having translation word storage means for storing corresponding translation word information, and control means for executing parallel translation processing on the document image information based on the information in the translation word storage means, the control means includes a document image. Recognizing the words in the information, classifying the words that should output the translated words and the words that do not need to output the translated words, and making a list of the words that should output the translated words and the translated words of the words. A bilingual image forming apparatus characterized by controlling to create and output a word book. 2. The bilingual image forming apparatus according to claim 1, wherein the control unit limits the number of output characters or / and the number of output lines of the translated word in the word book to a predetermined number. 3. The control means performs re-retrieval control for executing a translated word output for the word when it is determined that the translated word information recognized from the manuscript image information further includes a word. The bilingual image forming apparatus according to claim 1. 4. The control means limits the number of repetitions of the re-search control to a predetermined number.
The parallel image forming apparatus described. 5. An image reading means for optically reading a document image and converting it into image information, and an image storing means for storing the image information read by the image reading means or the image information input via a communication line. , Image processing means for executing various image processing on the image information, image recording means for recording an image on a recording medium based on an image signal output by the image processing means, and bilingual translation of information in the original image A parallel translation image forming apparatus capable of outputting a translated word for the word when the translated word information recognized from the document image information includes a word , A pair comprising selection means for selecting a re-retrieval mode in which the word translation output is executed and a normal mode in which the word translation output is not executed. Translation image forming device. 6. The control means controls the output order of the words in the word book and the translated words of the words based on the output order of the words in the manuscript image information or the alphabetical order of the words. The parallel image forming apparatus described. 7. The bilingual image forming apparatus according to claim 1, wherein the control means controls so as to eliminate duplicate description of the same word and a translation of the word on the same page of the word book. .. 8. The control means, when determining that a group word composed of a plurality of words connected by a specific symbol is not stored in the translated word storage means, at least one of the group word connection. 2. The bilingual image forming apparatus according to claim 1, wherein the bilingual image forming apparatus is controlled so that a word book is created by decomposing the words and outputting the translated words for the divided words.