KR100664421B1 - Handheld terminal and business card recognition method for business card recognition using equipped camera - Google Patents

Abstract

The present invention relates to a portable terminal and a method for recognizing a business card using a provided camera, the method of recognizing a business card of the present invention comprises the steps of: a) setting character notation characteristics for each field of a business card; b) extracting a text area from a business card image captured by the camera in a business card recognition mode; c) extracting a candidate region for each field, which is estimated to have information on a corresponding field to be extracted from the business card image, by referring to the characterization characteristics of each field; d) extracting character information from each of the field candidates having the highest priority among the candidate fields for each field; And e) integrating extracted character information, respectively. This enables faster and more accurate card data recognition and selective card recognition for required fields.

Description

Portable terminal and method for recognizing name card using having camera}

1 is a view showing an example of a portable terminal with a camera for recognizing a general business card,

2 is a flowchart showing an example of a business card recognition method using a portable terminal having a conventional camera;

3 is a view showing a general field structure of a business card to which an embodiment of the present invention is applied;

Figure 4 is a block diagram showing a portable terminal for performing a faster and more accurate business card recognition using the provided camera, according to a preferred embodiment of the present invention,

5 is a flowchart illustrating a method for recognizing a business card more quickly and accurately using a portable terminal equipped with a camera according to a preferred embodiment of the present invention;

6 is a flowchart illustrating in detail the candidate region extraction step for each field of FIG. 5 according to the first embodiment of the present invention;

7A-7I illustrate various examples of actual business cards to which embodiments of the invention can be applied; and

FIG. 8 is a flow chart illustrating in detail the candidate region extraction step for each field of FIG. 5 according to the second embodiment of the present invention.

The present invention relates to a business card recognition method and apparatus using a portable terminal with a camera, and more particularly, to take a business card using a camera attached to the portable terminal and extract only necessary information more quickly to text data It relates to a business card recognition method and apparatus therefor.

In general, when a business card is passed from the other party, the user of the portable terminal directly inputs and stores the necessary contents from the business card by using the keypad using a telephone call editing menu supported by the portable terminal.

Such personal information management requires a lot of manual work for the user of the portable terminal. In addition, if the user has a lot of business cards received from acquaintances, there is a problem that the accuracy or management of the input data is difficult as much if you need to organize them manually.

In order to solve this drawback, a method of storing a business card in a portable terminal has been proposed by photographing a business card using a camera attached to the portable terminal and recognizing the photographed image using a character recognition algorithm.

Character recognition refers to a technology of reading and identifying characters recorded in a certain area such as paper by using a mechanical device and converting them into codes that can be understood by a computer.

In general, a character recognition device is composed of a photoelectric conversion device, a recognition processing device, a memory device, and an output device. The photoelectric conversion device converts a character of the ground into a voltage waveform, and at this time, the shape of the character, which is a two-dimensional figure of the ground, is converted into a one-dimensional signal which is a time series change of the voltage waveform by a scan, which is a TV-like method. The storage device stores arithmetic control program for controlling the recognition processing device and data representing a recognized shape in a specific form. The recognition processing device inputs and processes unknown characters through a photoelectric conversion device under the control of a program on the storage device, and compares the type of characters corresponding to the pattern with the highest match with the standard pattern in the same storage device. Recognize it as a letter type. The output device transfers the recognized characters in a form that is easy to transfer to a computer or other information processing device.

The character recognition device includes an optical character reader (OCR) that can recognize both printed and handwritten characters, a tablet that can recognize handwritten characters, and an optical mark reader that can recognize special characters ( Optical Mark Reader (OMR), Barcode, Magnetic Ink Character Reader (MICR).

1 is a diagram illustrating an example of a portable terminal with a camera for recognizing a general business card.

As illustrated, the portable terminal captures an image of a business card through the camera 10 using the operation keys 32 and 34 provided on the keypad, and displays the captured image on the screen 20. At this time, the portable terminal recognizes a character from the displayed image through a text recognition function, extracts the corresponding information, and stores the extracted information as business card data. These features make it easier for users to store business card information.

2 is a flowchart illustrating an example of a business card recognition method using a portable terminal having a conventional camera.

First, the portable terminal photographs a business card through the camera 10 and reads out a business card image (S11). The portable terminal performs image processing on the read business card image (S13). In this case, the image processing is a step of converting the captured image to facilitate recognition, and includes binarization and removal of noise.

The portable terminal extracts a text area from the image processed business card image (S15). The portable terminal performs character recognition on the extracted text area (S170). The portable terminal extracts information of each field through character recognition for all text areas (S18). Accordingly, the portable terminal displays the finally extracted information on the screen 20 (S19).

However, the conventional card recognition method using a portable terminal performs universal character recognition on the character area of the card image when the character is recognized. Therefore, the existing business card recognition method performs character recognition on the text area of the entire business card image including unnecessary information in addition to the information to be extracted from the business card, so that the text recognition time and the extraction time of the business card information take much time. have.

In addition, the character recognition speed is not a big problem in a general computer (PC) that has a high speed of a processor, but a portable terminal may cause inconvenience to a user due to a slow business card recognition speed when a business card is recognized by a conventional method. There is a problem that reduces the utilization of the recognition function.

In addition, in the conventional business card recognition method, character data is collectively displayed according to the recognition result after text recognition is processed for the entire business card image regardless of the type of field, so that there is a possibility that an error in character recognition occurs.

SUMMARY OF THE INVENTION An object of the present invention for solving the above problems is to provide a portable terminal and a method for recognizing a business card faster when a business card is recognized using a provided camera.

Another object of the present invention is to provide a portable terminal and a method for recognizing a business card more accurately according to the type of field when recognizing a business card using a provided camera.

According to an embodiment of the present invention, there is provided a business card recognition method using a portable terminal equipped with a camera, the method comprising the steps of: a) setting character display characteristics for each field of the business card; b) extracting a text area from a business card image captured by the camera in a business card recognition mode; c) extracting a candidate area for each field, which is estimated to have information on a corresponding field to be extracted from the business card image, with reference to the character notation for each field; d) extracting character information from each of the field candidates having the highest priority among the candidate fields for each field; And e) integrating the extracted character information, respectively.

Preferably, the business card recognition method of the present embodiment comprises the steps of: displaying on the screen business card data consisting of the integrated character information; And correcting and displaying the business card data according to the input command when a correction command for the displayed business card data is input.

In addition, the business card recognition method of the present embodiment further includes the step of storing the business card data consisting of the integrated character information and the modified business card data according to a storage command.

 The business card recognition method according to the present embodiment further includes an extraction field setting step of setting a field including information to be obtained from all the fields of the business card after step a). Accordingly, in step c), the field candidate area corresponding to the set extraction field is extracted from the business card image by referring to the character writing characteristic of each field.

The field of the business card is composed of a company mark, a company name, a department / title, a name, and a detailed information field. The detailed information field includes a postal code, address, telephone number, fax number, mobile phone number, homepage address, and e-mail address field.

The field-specific character notation property is that the company mark is located at the top left of the business card image, the company name is located at the center of the top of the business card image, the department / job title is below the company name field area Located in the area, the letter size is small and separated by "/" or blank, the name is located below or to the right of the belonging / title field area and the letter size is large and is located in the center area of the business card. Letters are displayed, and the detailed information is located at the lower part of the name field area and is grouped into small letters to have a displayed paragraph form.

The character notation characteristic of each field may be displayed by dividing three digits based on the "-" in the detailed information field, and the address is displayed after the zip code field area and starts with a city or a road. A number starting at the bottom of the address field area and starting with a country or area code, and the fax number starting at or below the phone number field area and starting with the same country or area code as the phone number field Is displayed, the mobile phone number is located below the fax number field area and consists of a number starting with the mobile operator specified number, the homepage address is displayed as a letter including "http" or "www", The e-mail address is characterized by being displayed in English including the special character "@".

On the other hand, the above object is, according to an embodiment of the present invention, in the portable terminal for recognizing a business card using the provided camera, the setting information for the program for recognizing the business card and the character display characteristics of each field of the business card A storage unit for storing; A text area extraction unit for extracting a text area from the business card image photographed by the camera in a business card recognition mode; A field candidate region extraction unit for extracting a candidate region for each field, which is estimated to have information on a corresponding field to be extracted from the business card image, by referring to the character marking characteristic of each field; A character information extraction unit for extracting character information from each of the field candidates having the highest priority among the candidate fields for each field; And a control unit for integrating the extracted character information and storing the extracted character information as the business card data in the storage unit.

Preferably, the controller sets an extraction field including information to be obtained from all the fields of the business card according to an input command and stores the extraction field. Accordingly, the field candidate region extracting unit extracts a field candidate region corresponding to the set extraction field from the business card image with reference to the character notation characteristic of each field.

The control unit displays the integrated business card data on the screen, and when a correction command for the displayed business card data is input, the controller modifies and displays the business card data according to the input command.

On the other hand, the above object is, according to an embodiment of the present invention, in the business card recognition method using a portable terminal equipped with a camera, setting the character array pattern for each field of the business card; Extracting a text area from a business card image captured by the camera in a business card recognition mode; Extracting, by reference to the character array pattern information for each field, a candidate region for each field, which is estimated to have information on a corresponding field to be extracted from the business card image; Extracting corresponding character information by applying a recognizable character recognition algorithm corresponding to each character characteristic indicated in the extracted candidate region for each field; And integrating the extracted character information, respectively.

Preferably, in the character information extracting step, when the extracted candidate region for each field is a field candidate region in which Hangul is also expected to be marked, character information of the field candidate region is extracted by applying a Hangul recognition algorithm to extract character information. If the extracted candidate field for each field is a field candidate area expected to be represented in English or numbers, character information of the field candidate area is extracted by applying an English or numeric recognition algorithm, respectively.

In the present exemplary embodiment, the candidate region extraction step for each field may be divided into blocks for each character display area in consideration of the line spacing between the characters, the height of each line, a string sorting method (content addition), and the like for the extracted character region. step; Checking a characteristic of a text display line for each of the divided blocks; Estimating a type of field according to the checked line-specific characteristic; Checking character display characteristics for each of the estimated fields; And determining the candidate area for each field according to the character display specification.

The field of the business card may be a company mark, a company name, a department / title, a name, a detail information field, and the like. The detailed information field may be a postal code, address, telephone number, fax number, mobile phone number, homepage address, and e-mail address field.

According to the present invention, after extracting a text area with respect to an image of a business card and extracting a field candidate area on which information to be extracted is displayed with reference to preset arrangement pattern information for each field or character information for each field, the text information is extracted. By extracting the card information to obtain the card information, it is possible to process the card information acquisition through character recognition from the card more quickly. In addition, by estimating a field candidate to extract the character information according to the character characteristics of each field from the character region of the card image and extracting the character information thereof, it is possible to obtain the card information from the business card through more accurate character recognition. In addition, by setting an extraction field for extracting the text information from the business card in advance and extracting only the field candidate area for extracting the text information based on the setting information, the text information is extracted only for the extracted candidate field. Only bays can be acquired quickly.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. It should be noted that the same elements in the figures are represented by the same numerals wherever possible. In addition, detailed descriptions of well-known functions and configurations that may unnecessarily obscure the subject matter of the present invention will be omitted.

3 is a diagram illustrating a general field structure of a business card to which an embodiment of the present invention is applied.

As shown, the business card is located at the bottom center of the company mark (41) displayed at the top left, the right of the company mark (41) and the top of the business card (42), the bottom of the company name (42). The name 44, which is larger than the font size and shown in bold text, the department / position 43 shown to the left or top of the name 44, and the name 44, is located below and forms one paragraph in small letters. It consists of detailed information.

The details are based on the postal code (45) with three numbers separated by "-", the address starting with the city or road (46), the phone number starting with the area code (47), and the phone number (47) below. It consists of a fax number (48) located at, a mobile phone number (49) starting with a mobile operator specified number, and an e-mail address (50) displayed in English including "@".

In an embodiment of the present invention, the character area is divided by field type without increasing the character recognition of the entire business card image, thereby increasing the speed and accuracy of the character recognition.

4 is a block diagram illustrating a portable terminal for performing a faster and more accurate business card recognition using a camera provided in accordance with a preferred embodiment of the present invention.

As shown, the portable terminal includes a control unit 100, a camera unit 120, an image processing unit 140, a display unit 160, a wireless communication unit 220, a data processing unit 240, an audio processing unit 260, and a key. The input unit 310, the storage unit 330, the text area extraction unit 350, the field candidate area extraction unit 370, and the text information extraction unit 390 are configured.

The controller 100 performs an overall control operation of the portable terminal. The control unit 100 performs a function of controlling information extraction by character recognition for each field of a business card image according to an exemplary embodiment of the present invention. In addition, the controller 100 controls the extraction of information through character recognition for a field set by a user in the business card image.

The camera unit 120 photographs an image captured by a lens, and includes a camera sensor that converts the photographed optical signal into an electrical signal, and a signal processor that converts the analog image signal photographed from the camera sensor into digital data. In this case, a CCD (Charge Coupled Device) sensor is generally applied to the camera sensor, and the signal processor may be implemented by a digital signal processor (DSP). In addition, the camera sensor and the signal processor may be implemented separately or integrally. The camera unit 120 according to an embodiment of the present invention photographs a business card according to an input photographing command and outputs the photographed business card image data to the image processor 140.

The image processor 140 converts the card image data output from the camera unit 120 into screen data for displaying. The image processor 140 removes the noise image from the business card image data output from the camera unit 120, converts the size according to the characteristics and the size of the display unit 160, and outputs the converted image. In addition, the image processor 140 includes an image codec and performs a function of compressing the frame image data displayed on the display unit 160 in a set manner or restoring the compressed frame image data to the original frame image data. . The image codec may be a JPEG codec, an MPEG codec, a wavelet codec, or the like. In addition, the image processing unit 140 may have an OSD function, and in this case, the image processing unit 140 outputs display data to be displayed on a predetermined area of the screen under the control of the control unit 100. can do.

The display unit 160 displays the business card image output from the image processor 140 on the screen, and displays the display data output from the control unit 100 on the screen. The display unit 160 may be a liquid crystal display (LCD). In this case, the display unit 160 may include an LCD controller, a memory capable of storing image data, and an LCD display device. In this case, when the LCD is implemented using a touch screen method, the LCD may operate as an input unit. In addition, the display unit 160 may display the business card information in the form of text in which the business card image is converted under the control of the controller 100 on a screen for each field.

The wireless communication unit 220 performs a function of transmitting and receiving corresponding data for wireless communication of the portable terminal. The wireless communication unit 220 includes an RF transmitter for upconverting and amplifying a frequency of a transmitted signal, and an RF receiver for low noise amplifying and downconverting a received signal. The radio communication unit 220 converts an input transmission target signal into a radio signal and transmits the radio signal. In addition, the wireless communication unit 220 receives a wireless signal transmitted through a wireless channel, converts it into corresponding data, and outputs the converted data.

The data processor 240 includes a transmission module that encodes and modulates a signal for transmission through a wireless channel, and a reception module that demodulates and decodes a signal received through a wireless channel.

The audio processor 260 may be configured as a codec, and the codec includes a data codec for processing packet data and an audio codec for processing an audio signal such as voice. The audio processor 260 converts the digital audio signal received by the data processor 240 into an analog signal through an audio codec and reproduces the same through a speaker. In addition, the audio processor 260 converts an analog audio signal input from the microphone into a digital audio signal through an audio codec and outputs the digital audio signal to the data processor 240. The codec may be provided separately or included in the controller 100. The audio processor 260 according to the present exemplary embodiment may convert a field-specific information of a business card extracted in correspondence to a business card image under the control of the controller 100 and output the voice information through a speaker.

The key input unit 310 includes a plurality of keys for inputting numeric and text information and control keys for controlling the operation of the portable terminal. The key input unit 310 according to the embodiment of the present invention includes keys for controlling photographing of the business card and extraction of character information for each field of the photographed business card image. The key input unit 310 outputs the corresponding command signal to the controller 100.

The storage unit 330 may be configured as a program storage unit, a data storage unit, and the like. The program storage unit may include programs for controlling a general operation of the portable terminal and programs required for character recognition for extracting text information from a character image displayed on a predetermined surface according to an embodiment of the present invention. The data storage unit is used for temporarily storing data generated while executing programs. According to an exemplary embodiment of the present invention, the storage unit 330 stores the extraction field setting information in which the field of the information to be obtained from the business card is set, and the card information for each field extracted from the business card image. In addition, the storage unit 330 stores the arrangement pattern information for each field of the set business card by analyzing the general type of the corresponding business card.

The text area extractor 350 extracts a text area in which a character is displayed from a business card image under the control of the controller 100.

According to the first embodiment of the present invention, the field candidate area extractor 370 refers to candidate field of the corresponding field to which the character information is to be extracted by priority with reference to the arrangement pattern information for each card of the business card stored in the storage unit 330. Extract. Accordingly, the character recognition time of the business card can be shortened.

According to the second embodiment of the present invention, the field candidate region extracting unit 370 extracts candidate regions of fields to be extracted in order of priority according to the set extraction field setting information. The field candidate area extracting unit 370 extracts a field candidate area corresponding to the set extraction field setting information with reference to the character property of each field described in the business card. Here, the character property information for each field is stored in the storage unit 330.

As shown in Fig. 3, the type of field displayed on the business card consists of a company mark 41, a company name 42, a department / job title 43, a name 44, and detailed information. Here, the detailed information may include a postal code 45, an address 46, a phone number 47, a fax number 48, a mobile phone number 49, an e-mail address 50, and a company homepage address.

A detailed example of extracting the field candidate region including the character information to be extracted by the field candidate region extractor 370 will be described with reference to FIGS. 6 to 8.

The controller 100 may check the field candidate region extracted by the field candidate region extractor 370 and control the text information extractor 390 to extract the character information of the candidate field according to the result. In addition, the controller 100 may receive a confirmation command from the user with respect to the field candidate region extracted by the field candidate region extractor 370, and control the text information extractor 390 to extract text information about the last selected field. have.

The text information extracting unit 390 extracts the text information displayed on the field candidate region extracted by the field candidate region extracting unit 370 by using the character recognition function under the control of the controller 100. Preferably, when the character information extracting unit 390 extracts the character information for the extracted field candidate region, the character information extractor 390 corresponds to the character characteristics (Korean, English, numbers, etc.) expected to be described in each of the field candidate regions. Character information is extracted by applying a character recognition algorithm to the candidate region.

For example, if the extracted field candidate region is a Korean field (eg, a candidate region determined to be a name field in the case of a Korean business card), the character information extracting unit 390 may apply the Korean character recognition algorithm to apply the character information. Extract. In addition, when the extracted field candidate area is a field composed of English and numbers (for example, a phone number, an email address, a homepage address, etc.), the text information extractor 390 extracts text information by applying an English / numeric recognition algorithm. do.

Therefore, it is possible to prevent the recognition of the field region other than the information to be extracted, and to apply the recognition algorithm for the character pattern that is expected to be described in the field region for the field region first, thereby recognizing the required information. Can be shortened.

The controller 100 integrates the character information extracted from each field by the character information extractor 390 and stores the business card information in the storage 330 according to a display and storage command on the screen.

Therefore, by extracting the text area and extracting the field candidate area on which the information to be extracted is displayed, and extracting the text information on the card image to obtain the card information, it is possible to obtain the card information from the card by acquiring the card information. Can be processed quickly. In addition, by estimating a field candidate to extract the character information according to the character characteristics of each field from the character region of the card image and extracting the character information thereof, it is possible to obtain the card information from the business card through more accurate character recognition. In addition, by setting an extraction field for extracting the text information from the business card in advance and extracting only the field candidate area for extracting the text information based on the setting information, the text information is extracted only for the extracted candidate field. Only bays can be acquired quickly.

5 is a flowchart illustrating a method for recognizing a business card more quickly and accurately using a portable terminal equipped with a camera according to a preferred embodiment of the present invention.

First, the control unit 100 reads a business card image by capturing a business card placed on the front through the camera 120 according to the business card recognition command through the key input unit 310 (S110). The controller 100 controls the image processor 140 to remove the noise image from the read business card image and perform image processing in a form suitable for character recognition (S120). The controller 100 displays the image processed business card image on the screen through the display unit 160. Accordingly, a process of generating the business card information by extracting the character information of the corresponding field from the business card image and integrating the extracted information is displayed on the screen through the display unit 160.

The controller 100 controls the text area extractor 350 to extract an area where the text is displayed on the processed text image (S130). When the text area is extracted, the control unit 100 controls the field candidate area extraction unit 370 to sequentially select the candidate area for each field in which the character to be extracted is displayed according to the priority according to the extraction field setting information set from the extracted text area. Extracted to (S140). At this time, the field candidate region extracting unit 370 extracts the candidate region for each field by referring to the arrangement pattern information for each field or the character property displayed for each field.

When the candidate area for each field is extracted, the controller 100 determines a final field area for obtaining text information from the candidate areas, and controls the text information extraction unit 390 in consideration of the character characteristics displayed in the determined field area. Character information (at least one of Korean, English, and numbers) is extracted using the corresponding character recognition algorithm (at least one of Korean, English, and numbers) (S150).

At this time, when the extracted candidate candidate area for each field is a field candidate area in which Hangul is expected to be marked like the name field, the character information extracting unit 390 first applies the Hangul recognition algorithm to character in the field candidate area. Recognition is performed to extract character information. When the candidate region for each field extracted in the same manner is a field candidate region expected to be represented in English or numbers, the character information extracting unit 390 first applies an English or numeric recognition algorithm to character recognition of the field candidate region first. To extract the character information.

The controller 100 generates one business card information by integrating the text information extracted from each field area by the text information extractor 390 (S160). The control unit 100 displays the integrated business card information on the screen by arranging corresponding locations for each field (S170). When a save command is input for the displayed business card information, the controller 100 stores the displayed business card information in the storage unit 330 (S180). Here, when the editing command for the displayed business card information is input, the controller 100 may edit the business card information according to the input command.

Therefore, after extracting the text area for the image of the business card and extracting the field candidate area on which the information to be extracted is displayed based on the arrangement pattern information for each field or the character display property for each field, the character field displayed on the extracted field area is applied. By applying the character recognition algorithm to extract the character information and finally obtain the card information, it is possible to process the card information acquisition through the character card from the business card more quickly and accurately.

FIG. 6 is a flow chart illustrating in detail the candidate region extraction step of FIG. 5 according to the first embodiment of the present invention. FIGS. 7A to 7I illustrate various examples of actual business cards to which embodiments of the present invention are applicable. Figure is shown.

Before describing FIG. 6, the arrangement structure of main information of the actual business card will be briefly described with reference to FIGS. 7A to 7I, which show examples of the business card applied to FIG. 6.

7A to 7C illustrate examples of line alignment method characteristics of a business card. 7A is an example in which names and main information are displayed in left-aligned manner, FIG. 7B is an example in middle-aligned manner, and FIG. 7C is an example in right-alignment manner. The arrangement pattern information including the line alignment scheme characteristics of the business card according to the alignment scheme and the display characteristics of the name and the main information displayed thereon is stored in the storage unit 330.

7D to 7I illustrate examples according to a line arrangement method characteristic of a business card. Specifically, FIGS. 7D to 7F illustrate examples in which names and main information are arranged up and down, and FIGS. 7G to 7I are arranged to the left and right. The arrangement pattern information including the line arrangement method characteristic of the business card according to the arrangement method and the display characteristic of the name and the main information displayed thereon is stored in the storage unit 330.

Accordingly, the field candidate region extractor 370 may more easily extract the field region including the information to be extracted by referring to the arrangement pattern information for each card of the business card stored in the storage 330.

Hereinafter, the candidate field extraction step S140 according to the first embodiment of the present invention will be described with reference to FIG. 6. FIG. 6 is applied when the field candidate region cannot be extracted with reference to the array pattern information for each field.

The controller 100 controls the field candidate region extraction unit 370 to extract candidate regions for each field. Therefore, the process of extracting the candidate region for each field by the field candidate region extraction unit 370 under the control of the controller 100 will be described below.

As shown in the drawing, the field candidate region extracting unit 370 classifies blocks according to character display regions using the line spacing between the characters, the height of each line, a string alignment scheme, and the like, in the extracted character region (S610).

At this time, the field candidate region extraction unit 370 checks the characteristics of the character display line for each divided block (S630). For example, a block containing phone numbers typically contains lines that contain addresses, faxes, cell phone numbers, and e-mail information more closely between the top and bottom lines than the other lines. It can contain or include the longest line horizontally. These line-specific characteristics are checked through the field candidate region extraction unit 370.

After checking the characteristic of each line, the field candidate region extraction unit 370 estimates the type of field according to the characteristic of each line checked (S650). For example, the field candidate region extractor 370 may estimate that the longest line in the horizontal direction is an address field.

After estimating the type of field, the field candidate region extraction unit 370 checks the character display characteristics of the corresponding field (S670). For example, Hangeul name field is generally distinguished from other fields in line spacing, position, font size, character spacing, etc. with other fields. Accordingly, in the present invention, the display characteristics of the field may be checked based on the following characteristics of the Korean name field.

First, the name field is higher in height than other information field areas, and the spacing between character areas is relatively wide and constant. Second, if a name exists alone, it is usually composed of two to four character areas, with a constant interval. Third, if the name does not exist alone, it may exist together with the position or department, in which case there is a height difference between the character candidate areas of the same field area. Generally, the text area such as title or department is smaller than the name text area. Fourth, the name field may have a line with a relatively small title or department above or below.

In addition, detailed information fields (telephone, fax, mobile phone, e-mail information, etc.) can be used to determine fields such as keyword and character composition that are separated by each field after recognition. The distinctive features are hard to find. However, these fields are mainly gathered together in a business card to form a line block, and in this embodiment, it is possible to determine the position of these fields by utilizing such a feature. The following is an example of the features that can be used to find a line block area that contains detailed information fields.

First, the block area contains the largest number of lines. Secondly, if the first characteristic is not satisfied, the longest horizontal line is included among lines extracted from a business card such as a line or an address line in which telephone numbers, mobile phones, and fax information are continuously arranged. Third, the number of character areas is larger than other lines.

The field candidate region extractor 370 determines the field candidate region determined to exist by including the information to be recognized by referring to the characteristics of each field (S690).

FIG. 8 is a flowchart illustrating an example of extracting a candidate region for each field S140 of FIG. 5 according to the first embodiment of the present invention. FIG. 8 is an example applicable to a case in which a field candidate region cannot be extracted with reference to field-specific arrangement pattern information and a check characteristic for each line is difficult.

First, the field candidate region extraction unit 370 extracts the first recognized region from the top center portion of the business card image as the "company name" field candidate region (S141).

The field candidate area extracting unit 370 is located in the lower area of the "company name" field candidate area and extracts an area in which the letter size is small and is separated by "/" as the "own / title" field candidate area (S142). ). However, in this case, a blank space may be used as a means for separating a position from a position instead of "/", and in this case, the field candidate area extraction unit 370 is located in the area below the "company name" field candidate area, An area in which a small font size is separated by a blank can be extracted as a "own / position" field candidate area.

The field candidate area extractor 370 is located below or to the right of the "own / position" field candidate area and is located in the middle area of the business card with a large letter size and spaced one letter at a time in the "name" field candidate area. Extracted to (S143).

The field candidate area extracting unit 370 is located at the lower portion of the "name" field candidate area and extracts the displayed paragraph area grouped in small letters into the "detail" field candidate area.

In more detail, the field candidate region extraction unit 370 extracts a region in which three numbers are divided based on "-" as a "zip code" field candidate region (S144).

The field candidate area extracting unit 370 is displayed after the "zip code" field candidate area and extracts an area beginning with a city or a road as an "address" field candidate area (S145).

The field candidate area extracting unit 370 is located below the "address" field candidate area and extracts the numeric display area starting with the country or area code as the "telephone number" field candidate area (S146).

The field candidate area extractor 370 is located below or next to the "phone number" field candidate area, and the "Fax number" field candidate shows an area where a number starting with the same country or area code as the "phone number" field candidate area is displayed. Extract to area (S147).

The field candidate area extracting unit 370 is located below the "fax number" field candidate area and extracts a numeric area starting with the mobile communication operator designated number as the "cell phone number" field candidate area (S148).

The field candidate area extracting unit 370 is located below the "cell phone number" field candidate area and extracts an area displayed in English including the special character "@" as an "e-mail address" field candidate area (S149).

The field candidate area extraction unit 370 extracts a display area including "http" or "www" as a "home page address" field candidate area.

As described above, the information for determining the field candidate area for the corresponding area is stored in the storage unit 330 based on the display area and the character property of the card image according to the property of the field.

In the above, specific preferred embodiments of the present invention have been illustrated and described. However, the present invention is not limited to the above-described embodiments, and various modifications can be made by those skilled in the art without departing from the gist of the present invention attached to the claims. will be.

According to the present invention, after extracting a text area with respect to an image of a business card and extracting a field candidate area on which information to be extracted is displayed with reference to preset arrangement pattern information for each field or character information for each field, the text information is extracted. By extracting the card information to obtain the card information, it is possible to process the card information acquisition through character recognition from the card more quickly.

In addition, by estimating a field candidate to extract the character information according to the character characteristics of each field from the character region of the card image and extracting the character information thereof, it is possible to obtain the card information from the business card through more accurate character recognition.

In addition, by setting an extraction field for extracting the text information from the business card in advance and extracting only the field candidate area for extracting the text information based on the setting information, the text information is extracted only for the extracted candidate field. Only bays can be acquired quickly.

Claims (18)

In the business card recognition method using a portable terminal equipped with a camera, a) setting a character display characteristic for each field of the business card; b) extracting a text area from a business card image captured by the camera in a business card recognition mode; c) extracting a candidate area for each field, which is estimated to have information on a corresponding field to be extracted from the business card image, with reference to the character notation for each field; d) extracting character information from each of the field candidates having the highest priority among the candidate fields for each field; And e) integrating the extracted text information, respectively. The method of claim 1, Displaying business card data consisting of the integrated character information on a screen; And And correcting and displaying the business card data according to the input command when a correction command for the displayed business card data is input. The method according to claim 1 or 2, And storing the business card data consisting of the integrated text information and the modified business card data according to a storage command. The method of claim 1, After the step a), further comprising the extraction field setting step of setting a field containing the information to obtain from among all the fields of the business card, Accordingly, in the step c), the field candidate area corresponding to the set extraction field is extracted from the card image by referring to the character writing characteristic of each field. The method of claim 1, The field of the business card includes at least one of a company mark, a company name, a department / title, a name, and a detail information field. And the detail information field comprises at least one of a postal code, address, telephone number, fax number, mobile phone number, homepage address, and email address field. The method of claim 5, The character notation characteristic for each field is The company mark is located at the top left of the business card image, the company name is located at the top center of the business card image, the department / position is located at the bottom area of the company name field area and the font size is small. "/" Or spaces are displayed, the name is located below or to the right of the belonging / title field area, the size of the letter is large, located in the center area of the business card, spaced one letter at a time, the detailed information Is located at the bottom of the name field area and grouped in small letters to have a displayed paragraph form. The method of claim 6, The character notation characteristic for each field is Of the detailed information field, The postal code is divided into three numbers based on the "-", the address is displayed after the postal code field area, starts with a city or a road, and the telephone number is located below the address field area and the country Or a number beginning with an area code, wherein the fax number is located below or next to the telephone number field area so that a number beginning with the same country or area code as the telephone number field is displayed; It is composed of numbers starting with a mobile communication provider designation number located below, the homepage address is represented by a letter including "http" or "www", and the email address is in English including the special character "@". The business card recognition method characterized by the above-mentioned. In the portable terminal for recognizing a business card using the provided camera, A storage unit for storing the program for recognizing the business card and setting information on the character display characteristics of each field of the business card; A text area extraction unit for extracting a text area from the business card image photographed by the camera in a business card recognition mode; A field candidate region extraction unit for extracting a candidate region for each field, which is estimated to have information on a corresponding field to be extracted from the business card image, by referring to the character marking characteristic of each field; A character information extraction unit for extracting character information from each of the field candidates having the highest priority among the candidate fields for each field; And And a controller for integrating the extracted text information and storing the extracted text information in the storage unit as business card data. The method of claim 10, The control unit sets an extraction field including information to be obtained from all the fields of the business card according to an input command, and stores the extraction field in the storage unit. And the field candidate region extracting unit extracts a field candidate region corresponding to the set extraction field from the business card image with reference to the character representation characteristic of each field. The method of claim 8, And a field of the business card includes at least one of a company mark, a company name, a department / title, a name, and a detailed information field. The method of claim 10, The detailed information field may include at least one of a postal code, address, telephone number, fax number, mobile phone number, homepage address, and e-mail address field. The method of claim 11, And the control unit displays the integrated business card data on the screen, and corrects and displays the business card data according to an input command when a correction command for the displayed business card data is input. In the business card recognition method using a portable terminal equipped with a camera, Setting a character array pattern for each field of the business card; Extracting a text area from a business card image captured by the camera in a business card recognition mode; Extracting, by reference to the character array pattern information for each field, a candidate region for each field, which is estimated to have information on a corresponding field to be extracted from the business card image; Extracting corresponding character information by applying a recognizable character recognition algorithm corresponding to each character characteristic indicated in the extracted candidate region for each field; And And incorporating the extracted text information, respectively. The method of claim 13, In the text information extraction step, If the extracted field candidate area is a character area that is expected to be written in Hangul, the card recognition method, characterized in that for extracting the Hangul characters from the extracted field candidate region by applying a Hangul recognition algorithm. The method of claim 13, wherein in the text information extraction step, If the extracted field candidate area is a character area that is expected to be represented in English and numbers, business card recognition comprising extracting English / numeric characters from the extracted field candidate area by applying an English / numeric recognition algorithm. Way. The method of claim 15, The extracting candidate area for each field may include: Dividing the blocks by character display area into the extracted character area in consideration of line spacing between characters, height of each line, and string alignment method; Checking a characteristic of a text display line for each of the divided blocks; Estimating a type of field according to the checked line-specific characteristic; Checking character display characteristics for each of the estimated fields; And And determining the candidate area for each field according to the character display specification. The method of claim 13, And a field of the business card includes at least one of a company mark, a company name, a department / title, a name, and a detailed information field. The method of claim 17, And the detail information field comprises at least one of a postal code, address, telephone number, fax number, mobile phone number, homepage address, and email address field.

Images