KR200332373Y1 - Mobile communication device with business card recognition processing - Google Patents

Abstract

The present invention relates to a mobile communication device having a business card recognition function using a character recognition technology, the input unit for receiving the data about the business card, reference data on the characteristics of the character, data and recognition for each attribute in the business card And a storage unit for storing the results, an output unit for displaying the image and the recognition result of the input business card, and a control unit for controlling the device. The image data of the business card received from the input unit is analyzed and stored in the storage unit. Recognizes the character corresponding to the input image data by referring to the reference data for each character in the text, analyzes the contents composed of the recognized characters, determines the attribute, and stores the corresponding contents in the storage unit according to the attribute. It is characterized by displaying, specifically, The input unit is composed of a camera, and the image data for the business card to provide a mobile communication device, characterized in that photographed by the camera.

Description

Mobile communication device with business card recognition function {MOBILE COMMUNICATION DEVICE WITH BUSINESS CARD RECOGNITION PROCESSING}

The present invention relates to having a business card recognition function using a character recognition technology in a mobile communication device.

In recent years, mobile communication devices, that is, mobile phones and PDAs, have been widely equipped with a photographing device such as a camera as a standard, and are continuously being attached as a basic device. Accordingly, interest in using an input image in addition to a simple photographing function of a camera is increasing. Until now, the camera provides only simple functions such as saving and loading images according to simple shooting.

Therefore, the present invention is to enhance the utilization of the camera device provided in the conventional mobile communication device, and in particular, to provide a mobile communication device that can recognize the business card by the character recognition technology and outputs the recognized content, etc. on the screen. .

That is, it is to increase the utilization of the mobile communication device by having a business card recognition function that can best represent the utilization of the character recognition technology in the mobile communication device.

1 is an exemplary view showing a form of photographing a business card with a camera mounted on a mobile communication device according to an embodiment of the present invention;

Fig. 2 is a diagram showing a mobile communication device according to an embodiment of the present invention, (a) is an illustration showing a recognized result of a business card on the screen, and (b) is a screen for retrieving contents from a built business card DB. A drawing showing an example of the output of a list,

3 is a system block diagram of a mobile communication device according to an embodiment of the present invention;

4 is a flowchart showing a business card recognition process, (a) is a flowchart showing the whole process, (b) is a flowchart showing a subroutine of image area classification and character recognition;

5 is a flowchart showing a process of character recognition, (a) is a flowchart for the process of the learning process, (b) is a flowchart for the character recognition process.

* Description of the major symbols in the drawings *

110: input device (camera device) 120: control unit

130: data storage unit 140: button input unit

150: output unit 160: communication unit

170: other devices

In order to solve the above problems, the present invention provides an input unit for receiving data on a business card, a reference data on characteristics of characters, a storage unit for storing data on each attribute in the business card, and a recognition result, and an input card. An output unit for displaying a related image and a recognition result, and a control unit for controlling the device, and inputs the image data for the business card received from the input unit by analyzing the image data and referring to the reference data for each character stored in the storage unit. Recognizing a character corresponding to the image data, and analyzes the content consisting of the recognized character to determine the attribute, and stores the corresponding content in the storage according to the attribute, and to display on the output unit, specifically the input Blowing consists of camera, image for business card The data is photographed with a camera.

In order to recognize the characters of business cards captured by the camera, the resolution of the shooting data of 300DPI is generally required.In the case of 1 million pixels of shooting capability, approximately 1000 pixels of horizontal resolution and 1000 pixels of vertical resolution are displayed on the display screen. The recognition processing area is about 85mm x 85mm. The normal size of a business card is 90mm x 50mm, and the edges of the business cards are mostly in the margin, so you can enter all the contents of the business card in one shot.

1 shows an embodiment of a mobile communication device equipped with a camera device and a business card recognition function.

The camera is equipped with a macro function on the back of the mobile communication device, and the image taken by the camera is displayed on the display device screen. have.

Figure 2 (a) shows that after pressing the business card recognition processing button to recognize the input business card image and the result on the screen according to the business card properties such as name, rank, telephone number. FIG. 2 (b) shows an example in which a business card DB constructed by recognizing a character of a business card and the like is recalled and displayed on the screen by using a search button of a mobile communication device. If you want to see more details in the listed items, you can print them out on the screen through the attached enter key.

3 shows an example of a system block diagram in the mobile communication device with a business card recognition function. 110 is an input unit including a camera device, and the input data is sent to the controller 120. 120 is a control unit including a CPU such as a mobile communication device, which executes a business card recognition process on data input from the input unit 110. When the business card recognition processing, refer to the data storage unit 130. 130 is a data storage unit for storing reference data and character recognition processing data necessary for the business card recognition. 140 denotes a button input unit for operation of various buttons located inside and outside the mobile communication device. The state when the button is pressed is sent to the control unit 120. 150 is an output unit including a display device for displaying the image of the business card and the recognized result, 160 is a communication unit for transmitting and receiving data for communication, which is the original function of the mobile communication device, 170 may be connected to an external device The other device is equipped with an interface device.

Business card recognition is a method of analyzing and recognizing the data input by the input unit 110 of the camera device into the control unit 120 of the CPU of the mobile communication device to process the meaningful business card data.

Business card recognition processing is generally pre-processed to ensure the optimal data for business card recognition through the angle correction, unnecessary image removal and image enhancement for the data coming from the camera. The image is extracted by dividing the area with the characters line by line. The image of the divided line unit is divided again by character unit, and character recognition is executed. If the recognition result is wrong, the optimal recognition result is obtained through the process of re-segmenting and recognizing the image by feeding back the separation operation of the character unit. Have it. The characters processed in this way analyze the attributes of the name, address, telephone number, homepage, etc. of the business card to have each recognition result with the contents related to the corresponding item.

Character recognition processing in letter unit is largely divided into structural method and statistical method. The structural method mainly analyzes the structure and shape of the character by thinning or trajectory processing of the outline of the character. Character recognition is performed. On the other hand, the statistical method extracts the feature points from the image in character units and stores them in memory in character units, and when a new image comes in, extracts the feature points and compares and analyzes the characteristics of the character units in the stored memory to find the most similar characters. How to print

4A shows a processing diagram of an embodiment of the business card recognition processing method. In step 190, an image of a business card is read through an input device such as a digital camera. In step 191, image data of the character input in step 190 is preprocessed. This preprocessing mainly performs image enhancement and tilt correction to enhance the image to an optimal image state for removing the surrounding images and character recognition. In step 192, character recognition is performed by dividing the card image by area. FIG. 4 (b) is a process flow diagram showing the process of step 192 of FIG. 4 (a) in the form of a subroutine. In step 201, the whole business card image is divided and divided into regions, and the image divided into regions is divided into rows of images in step 202. FIG. The image divided by lines is divided by the character unit in step 203. In step 204, the character recognition process is performed, and the result is returned to step 193.

In step 193, the attributes of the business card are analyzed according to the character recognition result for each area processed in step 192. The attribute analysis of the card contents determines the attributes according to the characteristics of the card in each country. In the case of Korea, for example, the phone number can be TEL, PHONE, or a telephone number consisting of numbers with an area code of 02 or 031. The attributes are determined based on the related contents. In case of a phone number following a number indicating a mobile phone service such as 011,016, etc., it is recognized as a mobile phone number.In the case of a name, it is composed of three letters of Korean or Chinese. In some cases. In addition, referring to a content having an attribute indicating a position or the like near the name can reduce the error of attribute determination. As such, each country analyzes and decides the attributes of the recognized contents according to the attribute classification system according to the business cards. In the case of address, if there is address-related contents of Seoul, Gyeonggi-do, etc., it is judged as the address contents. In the case of an email or a homepage, if the characteristics of an email or a homepage, ie, www.autocard.com or www.autocard.co.kr, are in the form of 'www.', They are determined as a homepage attribute. Kimig@autocard.com As in the case of 'kimig @', the attribute is determined by an email address. In step 194, a business card DB is constructed with contents of the result of recognizing the contents of the business card and analyzing its properties.

The character recognition process of step 203 shows the flowchart in detail in FIG.

In the present embodiment, a recognition processing method will be described based on a statistical character recognition method. In order to recognize the character by the statistical character recognition method, the characteristics of the character must be stored through the learning process. Through this learning process, the recognition process is performed through the recognition process after the feature data for the character is provided. First, the learning process of FIG. 5 (a) will be described. When an image of a letter unit is input, in step 210, the image is formatted into a constant sized image. For example, if the image size of the character unit is 36x40 or 40x40, all of them are reduced to 32x32 size, and the uniformity of the size is performed. In operation 220, a feature extraction operation is performed to extract a feature from an image of a letter unit. Although there are various feature extraction methods, the Crossing Point method, which is a simple and efficient feature of the processor, will be described as an example.

First, the character image is divided into 16 * 16 areas, and a straight line drawn in the direction of 0 degree, 45 degree, 90 degree, 135 degree, 180 degree, 225 degree, 270 degree, and 315 degree from the center of each area to the character image border. The number of times and the number of times of meeting are extracted and extracted as feature data. In step 230, reference data having a deviation and an average value is constructed through statistical processing of the input feature data for each character code using the feature data extracted in step 220 and the corresponding character code.

The character recognition processing method of FIG. 5 (b) is the same as the processing method from step 210 to step 220 of FIG. 5 (a). In step 240, the data having the highest similarity is detected by comparing the reference data which is the feature data corresponding to each character code constructed in the learning process and the feature data extracted in step 220 of the recognition process, and the character corresponding to the character code is recognized. Output as a result.

The above is an example of the use of a camera mounted on a mobile communication device such as a mobile phone to recognize the business card and output the result on the screen or to build a business card DB to increase the utilization of the camera.

As described above, the mobile communication device of the present invention is intended to expand the applicability of the camera device, and is equipped with a business card recognition processing function by character recognition technology. The output device is to increase the utilization of the mobile communication device.

In addition, the business card recognition processing function through the camera device mounted on the mobile communication device can easily input a large number of business cards generated in many businesses, and thus the utilization thereof is very high, thus providing high added value of the product.

In the above embodiment, the mobile phone has been described as an example, but it can be applied to a portable communication device such as a PDA.

Claims (2)

Input unit for receiving data about the business card, A storage unit for storing reference data on character features, data on each attribute in a business card, and recognition results; An output unit which displays an image of the input business card and a recognition result; A control unit for controlling the device, Analyze the image data of the business card received from the input unit, refer to the reference data of each character stored in the storage unit, recognize the character corresponding to the input image data, and analyze the contents composed of the recognized characters And determine and store the contents in a storage unit and display the contents in an output unit according to an attribute. The method of claim 1, The input unit is composed of a camera, Image data about the business card was taken with the camera A mobile communication device, characterized in that.