KR100700141B1 - A Method for Recognizing Name Card in Mobile Phone - Google Patents

Abstract

A method for recognizing a name card in a mobile communication terminal is provided to process data only around a selected field if data stored in the mobile communication terminal is displayed by using a stylus pen on the image of a stored name card, thereby significantly reducing a process and accurately recognizing information. A method for recognizing a name card in a mobile communication terminal comprises the following steps of: photographing the name card through a camera mounted in the mobile communication terminal(S201); assigning an area where information to be recognized is displayed by contacting a stylus pen on a touch screen in the image of the photographed name card(S202); selecting a field to store the assigned information(S203); and reading information about the name card within the assigned area by optical character read technology, classifying the name card into the selected field, and storing the selected field in a memory(S210).

Description

A method for recognizing name card in mobile phone}

1 illustrates screens displayed on a mobile communication terminal in chronological order when a business card is recognized according to the present invention.

2 is a flowchart illustrating a business card recognition method of a mobile communication terminal according to the present invention.

<Description of main parts of drawing>

110 ...... mode display section, 120 ...... business card display section

130 ...... Field designation button display section 140 ...... Edit / OK button display section

150 ... Stylus pen 160 ...

170 ...... Previous / Save Button Display Area

Korean Patent No. 459074 "Method for Recognizing Business Card of Mobile Communication Terminal with Camera"

The present invention relates to a business card recognition method of a mobile communication terminal using an optical character reading technology, and more particularly, to a business card recognition method using an optical character reading technology in a touch screen mobile communication terminal.

In the prior art, a technique for recognizing a business card in a mobile communication terminal having a camera and storing information of the business card in a phone book of the mobile communication terminal has been proposed. For example, Korean Patent No. 459074, "Business Card Recognition Method of Mobile Communication Terminal with Camera".

The above-mentioned 459074 patent discloses a technique of photographing a business card with a camera of a mobile communication terminal, dividing a field, and storing information corresponding to each field in a phone book of the mobile communication terminal. The field is a part indicating an identifier of the information when the information is stored in the phone book of the mobile communication terminal. For example, fields such as name, home telephone number, company telephone number, and mobile terminal number may exist.

Using this conventional technology, there is a convenience in that data such as a name of a business card, a company name, a phone number, an email address, and the like can be easily stored in a mobile communication terminal.

However, these prior arts have the following problems. At present, it is impossible to recognize 100% of all business cards in a mobile communication terminal that can recognize business cards. Since letters, colors, sizes, positions, and overall layouts are different for each card, there are many errors when the card reader embedded in the mobile terminal cannot process all the cards correctly. Will occur. For example, there are limitations in processing by a device embedded in a mobile communication terminal because the letter positions and colors of the business cards such as telephone numbers and e-mail addresses are all different. As described above, when an error occurs in the business card recognition process, it is inconvenient to manually input information into the mobile communication terminal.

The present invention has been made to solve the above problems of the prior art. That is, an object of the present invention is to provide a method of storing business card information by recognizing a business card more accurately in a mobile communication terminal equipped with a camera and a touch screen.

Business card recognition method of the mobile communication terminal according to the present invention for achieving the above object is a business card shooting step of taking a business card through a camera mounted on the mobile communication terminal equipped with a camera; An area designation step of designating an area in which information to be recognized is displayed in the image of the business card photographed in the business card photographing step; A storage field selection step of selecting a field for storing information specified in the area designation step; And an information storage step of reading information of the business card image in the area designated in the area designation step by using an optical character reading technique, classifying the information into a field selected in the storage field selection step, and storing the information in the memory of the mobile communication terminal. do.

In addition, after the business card shooting step, using the optical character reading technology to automatically classify the field further comprises an automatic information recognition step for recognizing all the information displayed on the business card, the area designation step is recognized in the automatic information recognition step If there is an error in the received information, it may be characterized by designating an area in which the error information is displayed in the image of the photographed business card.

The mobile communication terminal may be a mobile communication terminal equipped with a touch screen, and the area may be designated by contacting the stylus pen with the touch screen by a method of specifying an area in the area specifying step.

According to the present invention, when inputting information of a business card to a mobile communication terminal using an optical character reading technology using a camera in a mobile communication terminal equipped with a camera and a touch screen, the area is designated through the touch screen to read only the information in the area. Recognizing accurate information is a basic technical idea.

Since the present invention uses the touch screen of the mobile communication terminal, the mobile communication terminal to which the present invention is applied should have a touch screen function.

Touch screen means that when a person's hand or an object touches a character or a specific location on the screen (screen) without using a keypad, the input data is directly displayed on the screen so that the location can be detected and processed by stored software. Speak the screen that allows you to receive.

The touch screen is a function of attaching a device called a touch panel to the screen of a general monitor, and the touch panel causes numerous invisible infrared rays to flow on the screen from left to right and up and down to create numerous rectangular grids on the screen. If it touches the grid with other objects, it has a function to determine its position.

Therefore, if you touch the character or picture information displayed in advance on the screen equipped with the touch panel by hand, it is very easy to find out what the user has selected according to the position of the touched screen and process the corresponding command by the computer. You can get the information you want.

In addition, the mobile communication terminal applied to the present invention should be equipped with a camera because it uses the optical character reading technology.

Hereinafter, a business card recognition method of a mobile communication terminal according to the present invention will be described in detail with reference to the accompanying drawings.

1 illustrates screens displayed on a mobile communication terminal in chronological order when a business card is recognized according to the present invention.

Referring to FIG. 1, the display windows 100 of five mobile communication terminals 1 to 5 are shown, and the screen displayed on the display window is divided into four parts. From above, the mode display section 110, the business card display section 120, the field designation button display section 130, and the edit / confirm button display section 140 are shown. Field designation button display portion 130, 'Name' button 131, 'Office' button 132, 'Mobile' button 133, 'E-mail' button 134, 'Fax' button 135 And the like, and the edit / confirmation button display portion 140 includes an 'Edit' button 141 and an 'OK' button 142.

In order to input the information of the business card to the mobile communication terminal, it is necessary to first photograph the business card with a camera mounted on the mobile communication terminal, as in the business card recognition method using a conventional optical character reading technology.

Referring to FIG. 1, a business card photographed by a mobile communication terminal is shown on the display window 100 of the mobile communication terminal. Specifically, it is displayed on the business card display portion 120 of the display window 100. In the mode display section 110 above the business card display section 120, the phrase 'Card Recognition' is displayed to indicate that the card is currently performing a function of recognizing the business card. The button display portion 130 includes buttons 131, 132, 133, 134, and 135 for a field in which information of a business card is stored.

The field designation button shown in FIG. 1 includes a 'Name' button 131, an 'Office' button 132, a 'Mobile' button 133, an 'E-mail' button 134, and a 'Fax' button ( 135). Here, the 'Name' button 131 is a button for instructing to be stored as a name field among the information to be stored in the mobile communication terminal, 'Office' button 132 is stored as an office telephone number field of the information to be stored in the mobile communication terminal It is a button that commands to be, 'Mobile' button 133, 'E-mail' button 134, 'Fax' button 135 are respectively stored as a mobile terminal number field, email address field, fax number field It is a button to command.

Since the buttons 131, 132, 133, 134, and 135 are implemented on a touch screen, the buttons 131, 132, 133, 134, and 135 may be pressed by an object used for a fingertip or a touch screen. In the following description, only the case of pressing with a stylus pen is assumed.

A stylus pen is a pen-shaped object that makes a touch screen respond. You can tap, drag, tap and hold, and double tap with the stylus pen.

The tap operation means tapping the screen once with a stylus pen to open or select an item. The drag operation is mainly used when a character or an image is moved on the touch screen using a stylus pen. You can also use drag in the list to select multiple items.

The tap and hold operation is used to see the functions available for the item. Press the stylus pen over the item and keep it.

The double tap operation is mainly used to execute a program or a document. It's the same action as double-clicking, hitting the screen twice in a row.

In FIG. 1, an area is designated using the stylus pen 150 and a button is pressed. However, in the present invention, it should be noted that an object capable of reacting with the touch screen may use a human body or other objects in addition to the stylus pen.

Although only five field designation buttons are shown in FIG. 1, more buttons may be implemented according to the number of fields.

When a certain area is designated in the business card displayed on the business card display part 120 and one of the buttons 131, 132, 133, 134, 135 is pressed with the stylus pen 150, the information of the business card in the area is pressed. The information of the field corresponding to the button is stored in the mobile communication terminal.

The edit / confirm button display portion 140 below the field designation button display portion 130 includes an 'Edit' button 141 and an 'OK' button 142.

The 'Edit' button 141 is a button for editing information when there is an item to be modified in case of inputting information from a business card. If you designate a certain area with the stylus pen 150 on the business card displayed on the mobile terminal and press the 'Edit' button 141, the information of the business card included in the specified schedule area is displayed in a separate window and can be edited manually. . In this case, the editing method is performed using a keypad or a stylus pen 150 in a mobile communication terminal equipped with a touch screen as in the case of manually inputting information into the mobile communication terminal.

The 'OK' button 142 is a button which is pressed when instructing the user to proceed with the next operation when the required operation is completed. When information recognition through a business card is preferably made, pressing the 'OK' button 142 stores the information in the phone book of the mobile communication terminal. Then, press the 'Edit' button 141 to edit the information displayed on the business card and press the 'OK' button 142 when the editing is finished, the information is ready to be stored in the edited state. In this case, when the 'OK' button 142 is pressed, the edited information is not immediately stored in the mobile communication terminal because the other information to be edited should be stored at once after finishing editing to other information.

In the present invention, a method of inputting information of a business card to a mobile communication terminal is as follows.

First, the mobile terminal is switched to the information input mode by taking a business card. Mode switching may be performed by entering a predetermined menu of the mobile communication terminal and selecting or pressing a certain button of the mobile communication terminal. However, controlling a separate button for each function in a mobile communication terminal that provides various functions today may impair the aesthetics of the mobile communication terminal or impair the convenience of operation. Preference is given to using.

When the mode switch is made, the phrase 'Card Recognition' is displayed on the mode display part 110 on the upper part of the display window of the mobile communication terminal as shown in FIG. 1. It says that the card has been switched to the recognition mode.

And aiming the business card with the camera mounted on the mobile communication terminal is displayed on the business card display portion 120. Before shooting, the other side of the business card is displayed on the business card display portion 120 according to the movement of the camera. While moving the camera, hold the camera angle so that all the information on the business card can be displayed on the business card display part 120. Then, press the 'OK' button 142 or use it when shooting with the camera of a mobile communication terminal. If you press and the card is displayed on the business card display portion 120 at the time of pressing the button is fixed and displayed. This state is shown in the five display windows 100 of FIG.

The name of the business card in Fig. 1 is' Hong Gil-dong ', the address is' Gasan-dong, Geumcheon-gu, Seoul', the mobile terminal number is' 010-123-1234 ', and the office phone number is '02 -111-2222'. 02-111-3333 'and email address is' abc@lge.com'.

In the prior art, these parts are recognized by each identifier, and information is automatically input. However, as described above, a lot of errors occur in this manner. In the present invention, the area is designated by the touch screen to input information.

The first information to be entered is a name. In order to input the name, the name area of the business card displayed in the business card display portion 120 must be designated. A method of designating an area may be performed by tapping and tapping the stylus pen 150 and then dragging and releasing it.

Referring to FIG. 1, when receiving a name, an area in which the information 'Hong Gil-dong' of the business card is displayed should be designated. In ② of FIG. 1, the upper left side of the portion having the name 'Hong Gil-dong' was pressed (tap).

In order to designate an area with a name, the area must be specified so that all the words 'Hong Gil-dong' appear on the card. The designation of the 'Hong Gil-dong' area is shown in ④ of FIG. The area is specified as a rectangle. The way to specify the area is to tap the stylus pen at one end of the rectangle, tap and hold on the touch screen, drag it to the opposite end of the diagonal line, and then release the stylus pen. The dragging while pressing the touch screen with the stylus pen is shown in ③ of FIG. 1.

A method of dragging will be described with reference to the drawings. If the corners of the rectangular area designated by the name part in ④ of FIG. 1 are a, b, c, and d, respectively, if the stylus pen is in contact with the touch screen at point a, drag while maintaining contact to point d. If you have to remove it from the screen and touch the stylus pen on the touch screen at point d, you must drag the stylus pen off the touch screen while maintaining contact to point a. Alternatively, if the stylus pen is in contact with the touch screen at point b, drag it while maintaining contact to point c, and then remove the stylus pen from the touch screen, and if you have touched the stylus pen at the point c with touch screen, drag while maintaining contact to point b. After removing the stylus pen from the touch screen.

As such, there are four ways to specify the area of one rectangle. The user may designate the region in any way for convenience. In Fig. 1 ③, a state of designating an area while moving the stylus pen from point a to point d is mentioned.

The area designation method may be used in addition to the above-described method for designating an area for contacting and dragging the stylus pen. For example, if you press point a with the stylus pen, release it, and then press point d again, you can use the method of specifying a rectangular area with the points a and d diagonally opposite. It should be noted that the method of region designation in the present invention is not limited to any one method.

After designating the area including 'Hong Gil-dong', it should be saved as a name, so press the 'Name' button 131. Then, in the a-b-c-d area including 'hong gil dong', the text 'hong gil dong' is extracted and prepared to be stored in the name field using optical character reading technology.

Similarly, in the case of storing the mobile communication terminal number, a portion of the image of the business card displayed on the business card display portion 120 is designated as an area and then the 'Mobile' button 132 is pressed. When specifying the area of the mobile communication terminal number displayed on the business card, it is preferable to designate only "010-123-1234" in the phrase "Mobile: 010-123-1234" on the business card. Even if you include the "Mobile:" part, only the number will be extracted by the optical character reading technology, but if you specify only the number as an area, the probability of error will be reduced.

After repeating the above operation for the name, mobile communication terminal number, office telephone number, fax number, and e-mail address, and press the 'OK' button 142, a screen such as ⑤ is displayed on the display window 100.

5, the display window 100 includes a mode display part 110, a recognition information display part 160, and a previous / save button display part 170.

The mode display portion 110 is a portion that indicates that the current business card recognition mode, as shown in ①, ②, ③, ④ "Card Recognition" is displayed.

The recognition information display portion 160 displays the information recognized from the business card for each field. The information included in the business card is "Name: Hong Gil-dong", "Mobile: 010-123-1234", "Office: 02-111- 2222 "," Fax: 02-111-3333 "," E-mail: abc@lge.com ", and the like are displayed. Where "Name:", "Mobile:", "Office:", "Fax:", "E-mail:", etc. are not information received from business cards, but "Hong Gil Dong", "010-123-1234", "02 -111-2222 "," 02-111-3333 "," abc@lge.com ", and the like are information received from a business card.

In the previous / save button display portion 170, a 'Back' button 171, a 'Save' button 172 is displayed. 'Back' button 171 is a button to give a command to return to the screen shown in ① receiving information from the business card and 'Save' button 172 is the recognized information shown in the recognition information display portion 160 to the phone book This button gives the command to save. If the information displayed in the recognition information display portion 160 is correct, press the 'Save' button 172 and save it.

In ⑤, only the case of pressing the 'OK' button 142 of ① to ④ which commands to recognize all the information is shown, but can be checked by the same screen as ⑤ while recognizing the information one by one. For example, if only the name of the business card is recognized in the same manner as in ① to ④ and then the 'OK' button 142 is pressed, only the phrase "Name: Hong Gil-dong" is displayed on the recognition information display part 160 of the screen. Will be. You can check the recognized information one by one to see if there is an error in the information recognition, if there is an error, you can edit and enter.

To save only the name in the state where only the name is recognized, press the 'Save' button 172. To further recognize other information from the business card, press the 'Back' button 171 button and then recognize the mobile terminal number, office phone number, fax number, e-mail address and the like in the same way as the name is recognized.

The above process will be described with a flowchart. 2 is a flowchart illustrating a business card recognition method of a mobile communication terminal according to the present invention.

When the business card recognition mode is started, the business card is photographed by the camera (S201). The business card is then displayed on the business card display portion 120. In the displayed business card, an area including information to be recognized using a stylus pen is designated (S202). If the area is correctly specified, the 'Name' button 131, 'Office' button 132, 'Mobile' button 133, 'E-mail' button 134, ' One of the field designation buttons of the Fax 'button 135 is pressed (S203). The information is then recognized as the field.

Here, it is determined whether the 'OK' button 142 is pressed (S204). Pressing the 'OK' button 142 is switched to the recognition information display screen ⑤ to display the recognized information on the recognition information display portion 160 (S207). If the 'OK' button 142 is not pressed, it is determined whether to press the 'Edit' button 141 (S205). If the 'Edit' button 141 is pressed, the information can be edited (S206). When the 'Edit' button 141 is not pressed in step S205 or after the 'Edit' button 141 is pressed and the information is edited in step S206, the process returns to step S202 to repeat the recognition of information through the area designation. .

After the recognition information is displayed in step S207, it is determined whether the 'Save' button 172 is pressed (S208). If the 'Save' button 172 is pressed, the information so far recognized is stored in the phone book (S210) and the business card recognition mode ends. If the 'Save' button 172 is not pressed, it is determined whether to press the 'Back' button 171 (S209). If the 'Back' button 171 is pressed, the controller returns to step S202 and the 'Back' button 171. If it is not pressed to go back to step S208 to determine whether to press the 'Save' button (172).

The present invention may be complementarily applied to a conventional business card recognition method using the optical character reading technology. That is, a method of first recognizing information of a business card using a conventional technology and then confirming the recognized information so that only the information in which an error occurs is designated and recognized according to the present invention is also included in the scope of the present invention.

In the above, the business card recognition method of the mobile communication terminal according to the present invention has been described.

Although the invention has been described herein in its individual embodiments, the scope of the invention is not limited to that described in this application, but all variations and modifications that fall within the spirit and spirit of the description and the appended claims. It includes. In this specification, only the case of recognizing information by designating a region through a touch screen has been described. However, various means may be used as long as it is a means for designating a region in an image of a business card. All other area designations are also within the scope of the present invention.

In the present invention, if only the data to be stored in the mobile communication terminal to display the image of the business card stored after shooting the business card with the camera of the mobile communication terminal with an object used in the hand or other touch screen, processing the data to be stored in the whole field of the business card Instead, the data is processed only around the selected field, which greatly shortens the process and saves time.

In addition, even if the initial data is incorrectly selected because the card is not recognized correctly in the entire field of the card as in the conventional method, there is an advantage that can be modified and stored using the stylus pen.

Claims (3)

In a mobile terminal equipped with a camera and a touch screen , A business card photographing step of photographing a business card through a camera mounted on the mobile communication terminal; An area designation step of designating an area in which the information to be recognized is displayed by touching the stylus pen on the touch screen in the image of the business card photographed in the business card photographing step; A storage field selection step of selecting a field for storing information specified in the area designation step; And And an information storage step of reading information of the business card image in the area designated in the area designation step by using optical character reading technology, classifying the information into a field selected in the storage field selection step, and storing the information in the memory of the mobile communication terminal. Business card recognition method of mobile communication terminal. The method according to claim 1, After the business card shooting step, by using the optical character reading technology automatically classifies the field further comprises an automatic information recognition step of recognizing all the information displayed on the business card, In the area designating step, if there is an error in the information recognized in the automatic information recognition step, the business card recognition method of the mobile communication terminal, characterized in that for designating the area in which the error information is displayed in the image of the business card. delete

Images