US20180367737A1 - Apparatus and method for automatically adjusting size of characters using camera - Google Patents
Apparatus and method for automatically adjusting size of characters using camera Download PDFInfo
- Publication number
- US20180367737A1 US20180367737A1 US16/115,042 US201816115042A US2018367737A1 US 20180367737 A1 US20180367737 A1 US 20180367737A1 US 201816115042 A US201816115042 A US 201816115042A US 2018367737 A1 US2018367737 A1 US 2018367737A1
- Authority
- US
- United States
- Prior art keywords
- characters
- size
- image
- character
- camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- H04N5/23296—
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
-
- G06K9/20—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/10—Image acquisition
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/22—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of characters or indicia using display control signals derived from coded signals representing the characters or indicia, e.g. with a character-code memory
- G09G5/222—Control of the character-code memory
- G09G5/227—Resolution modifying circuits, e.g. variable screen formats, resolution change between memory contents and display screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/63—Control of cameras or camera modules by using electronic viewfinders
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/69—Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/04—Changes in size, position or resolution of an image
- G09G2340/0407—Resolution change, inclusive of the use of different resolutions for different screen areas
Definitions
- the present invention relates generally to character recognition using a camera, and more particularly, to an apparatus and method for optimizing user views by adjusting a size of characters in an image received by means of a camera.
- Camera-based Optical Character Recognition may be classified into Snapshot OCR (OCR based on a view of an image to be photographed) and Preview OCR (OCR based on a preview image or viewfinder images).
- Snapshot OCR an image is acquired according to the same method as a normal method for acquiring an image for a photograph.
- the image acquisition process includes, in turn, photographing desired characters by means of a camera, performing a character recognition process on the photographed characters, and outputting the recognition results to an output unit.
- an image acquisition process of Preview OCR includes scanning characters by a user by means of a camera, and continuously performing a recognition operation on an image received through the camera using a recognizer in the camera.
- Snapshot OCR The largest difference between Snapshot OCR and Preview OCR consists in the resolution of an image to be recognized. While Preview OCR recognizes a small image of Quater Video Graphics Array (QVGA; 320 ⁇ 240) for real-time recognition, Snapshot OCR recognizes an image of 1 Mega pixels or more, thus having a longer recognition time compared with Preview OCR. Due to the use of high-resolution images, Snapshot OCR is far superior to Preview OCR in character recognition capability. Recently, as the performance of cameras improves and accurate recognition becomes increasingly important, Snapshot OCR has become widely used than Preview OCR.
- QVGA Quater Video Graphics Array
- Snapshot OCR it is possible for Snapshot OCR to recognize all characters in an input image, or characters corresponding to a particular region among all the characters in the input image. Hence, a user may perform full recognition on the image displayed on a Liquid Crystal Display (LCD) screen of the camera, or perform partial recognition on a particular region designated.
- LCD Liquid Crystal Display
- FIG. 1 illustrates a conventional process of recognizing characters in an image.
- a mobile terminal receives an image with characters using a camera module.
- the mobile terminal may acquire a focused image from the received image using an Automatic Focusing (Auto-Focus) technique.
- the mobile terminal stores the acquired focused image in a separate storage.
- the mobile terminal recognizes characters in the stored image. The mobile terminal may recognize all the characters in the image or only characters in a region of the image selected by the user.
- the mobile terminal displays the recognition results on its display.
- characters in the input image may vary in size.
- the sizes of the displayed characters are also appear very small and very large, proportionally to the actual image.
- the excessively large or small size of the characters displayed on the LCD may reduce recognition efficiency or cause recognition failure.
- an aspect of the present invention is to address at least the above-mentioned problems and/or disadvantages and to provide at least the advantages described below. Accordingly, an aspect of the present invention provides an apparatus and method for optimizing a size of characters in an image by automatically adjusting a zoom ratio using a zoom function of a camera when the size of the characters in the image does not fall within a predetermined range.
- an electronic device includes a camera, a display and a processor that is configured to control the camera to obtain an image containing characters, detect a region and a size of the characters in the image, control determining whether the size of the characters in the image falls within a recognizable character size range, and in response to detecting that the size of the characters is less than the recognizable character size range, control the camera to automatically adjust an optical zoom ratio of the camera and resize the obtained image so that the size of the characters in the image falls within the recognizable character size range, and recognize the characters in the resized image.
- a method includes controlling a camera of the electronic device to obtain an image containing characters; detecting a region and a size of the characters in the image; determining whether the size of the characters in the image falls within a recognizable character size range; and in response to detecting that the size of the characters is less than the recognizable character size range, controlling the camera to automatically adjust an optical zoom ratio of the camera and resizing the obtained image so that the size of the characters in the image falls within the recognizable character size range, and recognizing the characters in the resized image.
- an electronic device includes a camera, a display and a processor configured to control to display an image obtained by the camera corresponding to an object including at least one character displayed on the display, detect an area of the object, wherein the at least one character included in the area is displayed based on a first size according to a specified distance between the camera and the object including the at least one character, in response to the specified distance being a first distance, display again the at least one character based on a second size, wherein the second size is larger than the first size, in response to the specified distance being a second distance, display again the at least one character based on a third size, wherein the third size is smaller than the first size, and display, on the display, a process result for one of the at least one character being displayed based on the second size and the at least one character being displayed based on the third size.
- FIG. 1 is a flowchart illustrating a conventional process of recognizing characters in an image
- FIG. 2 is a diagram illustrating an internal structure of a mobile terminal for recognizing characters according to an embodiment of the present invention
- FIG. 3 is a flowchart illustrating a process of recognizing characters in an image according to an embodiment of the present invention.
- FIGS. 4 and 5 are flowcharts illustrating a process of enlarging a size of characters in an image using a zoom function according to an embodiment of the present invention.
- the present invention provides an apparatus and method for receiving an image with characters having a proper size, by means of a zoom function, for precise recognition of the characters.
- FIG. 2 illustrates an internal structure of a mobile terminal for recognizing characters according to an embodiment of the present invention.
- the mobile terminal includes a recognizer module 207 , an OCR recognition engine module 209 , a camera module 201 , a display module 203 , and a dictionary module 205 .
- the recognizer module 207 a module for controlling the overall operation of an application called Snapshot OCR, mainly initiates and terminates an application for recognizing characters in an image, like character recognition of a camera.
- the recognizer module 207 implements pre-recognition, including resizing an image received from the camera module 201 for recognition of characters in the image.
- the OCR recognition engine module 209 receives the image with characters from the recognizer module 207 , performs character recognition on the received image, and transmits the recognition results back to the recognizer module 207 . As to the criteria for recognizing characters, the OCR recognition engine module 209 determines whether a size of the characters falls within a preset range of a recognizable character size, and transmits the determined results back to the recognizer module 207 .
- the camera module 201 receives an image with characters by driving and controlling a camera. In the process of receiving an image, the camera module 201 captures a clear image using an Auto-Focus function, and if the size of the characters in the image is excessively large or small, captures an image with characters having a size desired by the user using a zoom function. Auto-Focus, an important function for increasing an image recognition rate, serves to increase a resolution of an input image.
- the display module 203 outputs at least one of a camera preview image, a photographed image, and character recognition results on a screen.
- the dictionary module 205 provides a dictionary definition of the characters recognized by the OCR recognition engine module 209 based on a dictionary search interface function.
- a variety of information in the dictionary module 205 is stored in a DataBase (DB) in the mobile terminal
- DB DataBase
- the dictionary module 205 may receive the required information from a DB in a server.
- FIG. 3 illustrates a process of recognizing characters in an image according to an embodiment of the present invention.
- the mobile terminal receives an image with characters using a camera module, in step 301 .
- the received image may be displayed for viewing by a user.
- the mobile terminal acquires a focused image by adjusting the focus of the received image using an automatic focusing technique.
- the mobile terminal detects a character region within the acquired image by means of a character size measurer, and then detects a size of the characters within the character region by detecting a line on which characters exist, in the X- and Y-axes with use of a threshold, and calculates an average size of characters on the line.
- step 307 the mobile terminal compares the measured character size with a preset range of a recognizable character size, and determines whether the measured character size falls within the range of the recognizable character size. If the measured character size does not fall within the range, the mobile terminal automatically adjusts a zoom ratio, or a zoom magnification, so that the measured character size falls within the range, and then receives the resized image in step 309 . After performing step 309 , the method returns to step 303 , where the mobile terminal adjusts the focus of the zoomed image, and then re-performs the character region and size detection in step 305 .
- the mobile terminal stores the image for accurate character recognition in step 311 .
- the mobile terminal recognizes characters in the stored image in step 313 , and displays the recognition results corresponding to the information desired by the user, on a display in step 315 .
- the character size when the measured character size does not fall within the range of the recognizable character size, the character size may be excessively large or excessively small.
- the mobile terminal may simply decrease the zoom ratio and receive the resized image.
- the increased character size may still not fall within the recognizable character size range. In this case, characters in the image may be recognized as follows.
- FIGS. 4 and 5 illustrate processes of enlarging a size of characters in an image using a zoom function according to an embodiment of the present invention.
- FIG. 4 illustrates a method for a mobile terminal that supports only an optical zoom function
- FIG. 5 illustrates a method for a mobile terminal supporting both an optical zoom function and digital image zoom function.
- the mobile terminal first uses an optical zoom function, which does not influence the image quality.
- the mobile terminal uses a digital image zoom function, when the mobile terminal cannot recognize characters only with the optical zoom function.
- the mobile terminal receives an image with characters using a camera module in step 401 .
- the received image may be displayed for viewing by a user.
- the mobile terminal acquires a focused image by adjusting the focus of the received image using the automatic focusing technique.
- the mobile terminal detects a character region from the acquired image by means of a character size measurer, and then detects a size of the characters within the character region.
- step 407 the mobile terminal determines whether the detected character size is greater than a predetermined minimum size of a distinguishable character. If the measured character size is greater than the minimum size, the mobile terminal stores the image for precise character recognition in step 409 , recognizes characters in the stored image in step 411 , and displays the recognition results corresponding to the information desired by the user, on a display in step 413 .
- the mobile terminal automatically adjusts a zoom ratio in step 415 .
- the mobile terminal determines whether the adjusted zoom ratio is the maximum zoom ratio. If the adjusted zoom ratio is not the maximum zoom ratio, the mobile terminal re-receives the image enlarged at the adjusted zoom ratio in step 419 . However, if the adjusted zoom ratio is the maximum zoom ratio, the mobile terminal cannot recognize the detected characters as the mobile terminal cannot further increase the zoom ratio. Therefore, the mobile terminal displays a manual action request message on an output unit or a display for the user in step 421 , informing that it is not possible to distinguish the detected characters at the current location of the user. In this case, the user may acquire a desired size of characters by moving the mobile terminal closer to the subject having the characters.
- the mobile terminal receives an image with characters using a camera module in step 501 .
- the received image may be displayed for viewing by a user.
- the mobile terminal acquires a focused image by adjusting the focus of the received image using the automatic focusing technique.
- the mobile terminal detects a character region from the acquired image by means of a character size measurer, and then detects a size of the characters.
- step 507 the mobile terminal determines whether the detected character size is greater than a predetermined minimum size of a distinguishable character. If the measured character size is greater than the minimum size, the mobile terminal stores the image for precise character recognition in step 509 . The mobile terminal recognizes characters in the stored image in step 511 , and displays the recognition results corresponding to the information desired by the user, on its display in step 513 .
- the mobile terminal automatically adjusts a zoom ratio in step 515 .
- the mobile terminal determines whether the adjusted zoom ratio is the maximum zoom ratio. If the adjusted zoom ratio is not the maximum zoom ratio, the mobile terminal re-receives the image enlarged at the adjusted zoom ratio in step 519 . However, if the adjusted zoom ratio is the maximum zoom ratio, the mobile terminal provides the user with a message indicating that the character size is small for recognition, and stores the image in step 521 . This message is displayed on an output unit or display of the mobile terminal In step 523 , the mobile terminal enlarges a region corresponding to characters in the stored image using a digital image zoom function. Thereafter, the mobile terminal recognizes characters in the enlarged image using the image zoom in step 509 , and displays the recognition results in step 513 .
- embodiments of the present invention can optimize the size of characters in an image so that the user may easily carry out an operation of distinguishing and recognizing characters in the image on the LCD, thereby increasing the character recognition rate.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Computer Hardware Design (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
- Character Input (AREA)
- Character Discrimination (AREA)
Abstract
Description
- This application is a Continuation Application of U.S. application Ser. No. 14/022,799, which was filed in the U.S. Patent and Trademark Office on Sep. 10, 2013 as a Divisional Application of U.S. application Ser. No. 12/632,101, which was filed in the U.S. Patent and Trademark Office on Dec. 7, 2009 and issued as U.S. Pat. No. 8,553,083 on Oct. 8, 2013, and claims priority under 35 U.S.C. § 119(a) to a Korean Patent Application filed in the Korean Intellectual Property Office on Dec. 5, 2008 and assigned Serial No. 10-2008-0123019, the contents of each of which are incorporated herein by reference.
- The present invention relates generally to character recognition using a camera, and more particularly, to an apparatus and method for optimizing user views by adjusting a size of characters in an image received by means of a camera.
- Camera-based Optical Character Recognition (OCR) may be classified into Snapshot OCR (OCR based on a view of an image to be photographed) and Preview OCR (OCR based on a preview image or viewfinder images). In Snapshot OCR, an image is acquired according to the same method as a normal method for acquiring an image for a photograph. The image acquisition process includes, in turn, photographing desired characters by means of a camera, performing a character recognition process on the photographed characters, and outputting the recognition results to an output unit.
- By contrast, in Preview OCR, images are input at a preset rate of Frames Per Second (FPS). Therefore, in Preview OCR, character recognition is possible in real time. Generally, an image acquisition process of Preview OCR includes scanning characters by a user by means of a camera, and continuously performing a recognition operation on an image received through the camera using a recognizer in the camera.
- The largest difference between Snapshot OCR and Preview OCR consists in the resolution of an image to be recognized. While Preview OCR recognizes a small image of Quater Video Graphics Array (QVGA; 320×240) for real-time recognition, Snapshot OCR recognizes an image of 1 Mega pixels or more, thus having a longer recognition time compared with Preview OCR. Due to the use of high-resolution images, Snapshot OCR is far superior to Preview OCR in character recognition capability. Recently, as the performance of cameras improves and accurate recognition becomes increasingly important, Snapshot OCR has become widely used than Preview OCR.
- It is possible for Snapshot OCR to recognize all characters in an input image, or characters corresponding to a particular region among all the characters in the input image. Hence, a user may perform full recognition on the image displayed on a Liquid Crystal Display (LCD) screen of the camera, or perform partial recognition on a particular region designated.
-
FIG. 1 illustrates a conventional process of recognizing characters in an image. - In
step 101, a mobile terminal receives an image with characters using a camera module. Instep 103, the mobile terminal may acquire a focused image from the received image using an Automatic Focusing (Auto-Focus) technique. Instep 105, the mobile terminal stores the acquired focused image in a separate storage. Instep 107, the mobile terminal recognizes characters in the stored image. The mobile terminal may recognize all the characters in the image or only characters in a region of the image selected by the user. In step 109, the mobile terminal displays the recognition results on its display. - Since, unlike the conventional name-card recognition, Snapshot OCR has no limitation on a recognizable distance desired by the user, characters in the input image may vary in size. For example, when an image, in which very large characters and very small characters are included in various ways, is resized on an LCD, the sizes of the displayed characters are also appear very small and very large, proportionally to the actual image. The excessively large or small size of the characters displayed on the LCD may reduce recognition efficiency or cause recognition failure.
- An aspect of the present invention is to address at least the above-mentioned problems and/or disadvantages and to provide at least the advantages described below. Accordingly, an aspect of the present invention provides an apparatus and method for optimizing a size of characters in an image by automatically adjusting a zoom ratio using a zoom function of a camera when the size of the characters in the image does not fall within a predetermined range.
- According to one aspect of the present invention, an electronic device is provided that includes a camera, a display and a processor that is configured to control the camera to obtain an image containing characters, detect a region and a size of the characters in the image, control determining whether the size of the characters in the image falls within a recognizable character size range, and in response to detecting that the size of the characters is less than the recognizable character size range, control the camera to automatically adjust an optical zoom ratio of the camera and resize the obtained image so that the size of the characters in the image falls within the recognizable character size range, and recognize the characters in the resized image.
- According to another aspect of the present invention, a method is provided that includes controlling a camera of the electronic device to obtain an image containing characters; detecting a region and a size of the characters in the image; determining whether the size of the characters in the image falls within a recognizable character size range; and in response to detecting that the size of the characters is less than the recognizable character size range, controlling the camera to automatically adjust an optical zoom ratio of the camera and resizing the obtained image so that the size of the characters in the image falls within the recognizable character size range, and recognizing the characters in the resized image.
- According to a further aspect of the present invention, an electronic device is provided that includes a camera, a display and a processor configured to control to display an image obtained by the camera corresponding to an object including at least one character displayed on the display, detect an area of the object, wherein the at least one character included in the area is displayed based on a first size according to a specified distance between the camera and the object including the at least one character, in response to the specified distance being a first distance, display again the at least one character based on a second size, wherein the second size is larger than the first size, in response to the specified distance being a second distance, display again the at least one character based on a third size, wherein the third size is smaller than the first size, and display, on the display, a process result for one of the at least one character being displayed based on the second size and the at least one character being displayed based on the third size.
- The above and other aspects, features and advantages of certain embodiments of the present invention will be more apparent from the following description taken in conjunction with the accompanying drawings, in which:
-
FIG. 1 is a flowchart illustrating a conventional process of recognizing characters in an image; -
FIG. 2 is a diagram illustrating an internal structure of a mobile terminal for recognizing characters according to an embodiment of the present invention; -
FIG. 3 is a flowchart illustrating a process of recognizing characters in an image according to an embodiment of the present invention; and -
FIGS. 4 and 5 are flowcharts illustrating a process of enlarging a size of characters in an image using a zoom function according to an embodiment of the present invention. - The matters defined in the description such as a detailed construction and elements are provided to assist in a comprehensive understanding of embodiments of the invention. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. Also, descriptions of well-known functions and constructions are omitted for clarity and conciseness.
- Since conventional mobile terminals for recognizing characters in an image have no limitations on recognizable distances desired by users, excessively large or small size of characters in an input image may not be properly recognized in a character recognition process. To address these and other problems and/or disadvantages, the present invention provides an apparatus and method for receiving an image with characters having a proper size, by means of a zoom function, for precise recognition of the characters. Features of the present invention will be more apparent by describing certain embodiments of the present invention.
-
FIG. 2 illustrates an internal structure of a mobile terminal for recognizing characters according to an embodiment of the present invention. The mobile terminal includes arecognizer module 207, an OCRrecognition engine module 209, acamera module 201, adisplay module 203, and adictionary module 205. - Referring to
FIG. 2 , therecognizer module 207, a module for controlling the overall operation of an application called Snapshot OCR, mainly initiates and terminates an application for recognizing characters in an image, like character recognition of a camera. In accordance with an embodiment of the present invention, therecognizer module 207 implements pre-recognition, including resizing an image received from thecamera module 201 for recognition of characters in the image. - The OCR
recognition engine module 209 receives the image with characters from therecognizer module 207, performs character recognition on the received image, and transmits the recognition results back to therecognizer module 207. As to the criteria for recognizing characters, the OCRrecognition engine module 209 determines whether a size of the characters falls within a preset range of a recognizable character size, and transmits the determined results back to therecognizer module 207. - The
camera module 201 receives an image with characters by driving and controlling a camera. In the process of receiving an image, thecamera module 201 captures a clear image using an Auto-Focus function, and if the size of the characters in the image is excessively large or small, captures an image with characters having a size desired by the user using a zoom function. Auto-Focus, an important function for increasing an image recognition rate, serves to increase a resolution of an input image. - The
display module 203 outputs at least one of a camera preview image, a photographed image, and character recognition results on a screen. - The
dictionary module 205 provides a dictionary definition of the characters recognized by the OCRrecognition engine module 209 based on a dictionary search interface function. A variety of information in thedictionary module 205 is stored in a DataBase (DB) in the mobile terminal However, if required information is not stored in the DB in the mobile terminal, thedictionary module 205 may receive the required information from a DB in a server. A process of recognizing characters in an image using the aforesaid structure will be described as follows. -
FIG. 3 illustrates a process of recognizing characters in an image according to an embodiment of the present invention. - Referring to
FIG. 3 , the mobile terminal receives an image with characters using a camera module, instep 301. The received image may be displayed for viewing by a user. Instep 303, the mobile terminal acquires a focused image by adjusting the focus of the received image using an automatic focusing technique. Instep 305, the mobile terminal detects a character region within the acquired image by means of a character size measurer, and then detects a size of the characters within the character region by detecting a line on which characters exist, in the X- and Y-axes with use of a threshold, and calculates an average size of characters on the line. - In
step 307, the mobile terminal compares the measured character size with a preset range of a recognizable character size, and determines whether the measured character size falls within the range of the recognizable character size. If the measured character size does not fall within the range, the mobile terminal automatically adjusts a zoom ratio, or a zoom magnification, so that the measured character size falls within the range, and then receives the resized image instep 309. After performingstep 309, the method returns to step 303, where the mobile terminal adjusts the focus of the zoomed image, and then re-performs the character region and size detection instep 305. - If the measured character size falls within the range of the recognizable character size in
step 307, the mobile terminal stores the image for accurate character recognition instep 311. The mobile terminal recognizes characters in the stored image instep 313, and displays the recognition results corresponding to the information desired by the user, on a display instep 315. - In
FIG. 3 , when the measured character size does not fall within the range of the recognizable character size, the character size may be excessively large or excessively small. When the character size is excessively large, the mobile terminal may simply decrease the zoom ratio and receive the resized image. However, if the character size is excessively small and the zoom ratio has already been increased to the maximum zoom ratio, the increased character size may still not fall within the recognizable character size range. In this case, characters in the image may be recognized as follows. -
FIGS. 4 and 5 illustrate processes of enlarging a size of characters in an image using a zoom function according to an embodiment of the present invention. As an example,FIG. 4 illustrates a method for a mobile terminal that supports only an optical zoom function, whileFIG. 5 illustrates a method for a mobile terminal supporting both an optical zoom function and digital image zoom function. In bothFIGS. 4 and 5 , the mobile terminal first uses an optical zoom function, which does not influence the image quality. InFIG. 5 , the mobile terminal uses a digital image zoom function, when the mobile terminal cannot recognize characters only with the optical zoom function. - Referring to
FIG. 4 , the mobile terminal receives an image with characters using a camera module instep 401. The received image may be displayed for viewing by a user. In step 403, the mobile terminal acquires a focused image by adjusting the focus of the received image using the automatic focusing technique. Instep 405, the mobile terminal detects a character region from the acquired image by means of a character size measurer, and then detects a size of the characters within the character region. - In
step 407, the mobile terminal determines whether the detected character size is greater than a predetermined minimum size of a distinguishable character. If the measured character size is greater than the minimum size, the mobile terminal stores the image for precise character recognition instep 409, recognizes characters in the stored image instep 411, and displays the recognition results corresponding to the information desired by the user, on a display instep 413. - However, if the measured character size is less than the size of the minimum distinguishable character in
step 407, the mobile terminal automatically adjusts a zoom ratio instep 415. Instep 417, the mobile terminal determines whether the adjusted zoom ratio is the maximum zoom ratio. If the adjusted zoom ratio is not the maximum zoom ratio, the mobile terminal re-receives the image enlarged at the adjusted zoom ratio in step 419. However, if the adjusted zoom ratio is the maximum zoom ratio, the mobile terminal cannot recognize the detected characters as the mobile terminal cannot further increase the zoom ratio. Therefore, the mobile terminal displays a manual action request message on an output unit or a display for the user instep 421, informing that it is not possible to distinguish the detected characters at the current location of the user. In this case, the user may acquire a desired size of characters by moving the mobile terminal closer to the subject having the characters. - Referring to
FIG. 5 , the mobile terminal receives an image with characters using a camera module instep 501. The received image may be displayed for viewing by a user. In step 503, the mobile terminal acquires a focused image by adjusting the focus of the received image using the automatic focusing technique. Instep 505, the mobile terminal detects a character region from the acquired image by means of a character size measurer, and then detects a size of the characters. - In step 507, the mobile terminal determines whether the detected character size is greater than a predetermined minimum size of a distinguishable character. If the measured character size is greater than the minimum size, the mobile terminal stores the image for precise character recognition in
step 509. The mobile terminal recognizes characters in the stored image instep 511, and displays the recognition results corresponding to the information desired by the user, on its display instep 513. - If the measured character size is less than the size of the minimum distinguishable character in step 507, the mobile terminal automatically adjusts a zoom ratio in
step 515. In step 517, the mobile terminal determines whether the adjusted zoom ratio is the maximum zoom ratio. If the adjusted zoom ratio is not the maximum zoom ratio, the mobile terminal re-receives the image enlarged at the adjusted zoom ratio instep 519. However, if the adjusted zoom ratio is the maximum zoom ratio, the mobile terminal provides the user with a message indicating that the character size is small for recognition, and stores the image in step 521. This message is displayed on an output unit or display of the mobile terminal Instep 523, the mobile terminal enlarges a region corresponding to characters in the stored image using a digital image zoom function. Thereafter, the mobile terminal recognizes characters in the enlarged image using the image zoom instep 509, and displays the recognition results instep 513. - As is apparent from the foregoing description, embodiments of the present invention can optimize the size of characters in an image so that the user may easily carry out an operation of distinguishing and recognizing characters in the image on the LCD, thereby increasing the character recognition rate.
- While an apparatus and method for adjusting a size of characters using a camera according to the present invention has been shown and described with reference to a certain embodiments of the present invention, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims and their equivalents.
Claims (18)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/115,042 US20180367737A1 (en) | 2008-12-05 | 2018-08-28 | Apparatus and method for automatically adjusting size of characters using camera |
Applications Claiming Priority (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020080123019A KR20100064533A (en) | 2008-12-05 | 2008-12-05 | Apparatus and method for automatic character resizing using camera |
KR10-2008-0123019 | 2008-12-05 | ||
US12/632,101 US8553083B2 (en) | 2008-12-05 | 2009-12-07 | Apparatus and method for automatically adjusting camera |
US14/022,799 US10079978B2 (en) | 2008-12-05 | 2013-09-10 | Apparatus and method for automatically adjusting size of characters using camera |
US16/115,042 US20180367737A1 (en) | 2008-12-05 | 2018-08-28 | Apparatus and method for automatically adjusting size of characters using camera |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/022,799 Continuation US10079978B2 (en) | 2008-12-05 | 2013-09-10 | Apparatus and method for automatically adjusting size of characters using camera |
Publications (1)
Publication Number | Publication Date |
---|---|
US20180367737A1 true US20180367737A1 (en) | 2018-12-20 |
Family
ID=42230605
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/632,101 Active 2031-04-25 US8553083B2 (en) | 2008-12-05 | 2009-12-07 | Apparatus and method for automatically adjusting camera |
US14/022,799 Active 2029-12-15 US10079978B2 (en) | 2008-12-05 | 2013-09-10 | Apparatus and method for automatically adjusting size of characters using camera |
US16/115,042 Abandoned US20180367737A1 (en) | 2008-12-05 | 2018-08-28 | Apparatus and method for automatically adjusting size of characters using camera |
Family Applications Before (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/632,101 Active 2031-04-25 US8553083B2 (en) | 2008-12-05 | 2009-12-07 | Apparatus and method for automatically adjusting camera |
US14/022,799 Active 2029-12-15 US10079978B2 (en) | 2008-12-05 | 2013-09-10 | Apparatus and method for automatically adjusting size of characters using camera |
Country Status (3)
Country | Link |
---|---|
US (3) | US8553083B2 (en) |
KR (1) | KR20100064533A (en) |
CN (1) | CN101753846B (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11373619B2 (en) | 2018-06-04 | 2022-06-28 | Fujifilm Business Innovation Corp. | Display control apparatus, display system, and non-transitory computer readable medium |
Families Citing this family (24)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4906685B2 (en) * | 2007-11-14 | 2012-03-28 | キヤノン株式会社 | Imaging apparatus, control method thereof, and program |
JP4737269B2 (en) * | 2008-10-31 | 2011-07-27 | 富士ゼロックス株式会社 | Image processing apparatus and program |
US20110078600A1 (en) * | 2009-09-30 | 2011-03-31 | Sap Ag | Modification Free Tagging of Business Application User Interfaces |
CN102254544B (en) * | 2011-07-12 | 2012-10-24 | 北京海尔集成电路设计有限公司 | Method for automatically adjusting video signal proportion and television using same |
US9317764B2 (en) * | 2012-12-13 | 2016-04-19 | Qualcomm Incorporated | Text image quality based feedback for improving OCR |
KR102103277B1 (en) * | 2013-04-12 | 2020-04-22 | 삼성전자주식회사 | Method for managing for image an electronic device thereof |
CN104767926A (en) * | 2014-01-07 | 2015-07-08 | 北京三星通信技术研究有限公司 | Automatic focusing method and device |
CN104298993B (en) * | 2014-01-09 | 2018-11-09 | 郑州金惠计算机系统工程有限公司 | A kind of bar number positioning and recognition methods suitable under complex scene along track |
CN103885712B (en) * | 2014-03-21 | 2017-08-15 | 小米科技有限责任公司 | Webpage method of adjustment, device and electronic equipment |
US9602728B2 (en) * | 2014-06-09 | 2017-03-21 | Qualcomm Incorporated | Image capturing parameter adjustment in preview mode |
JP6208094B2 (en) | 2014-08-26 | 2017-10-04 | 株式会社東芝 | Information processing apparatus, information processing system, information processing method, and program thereof |
JP6548920B2 (en) * | 2015-03-09 | 2019-07-24 | 株式会社東芝 | INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING METHOD, AND PROGRAM |
US9619701B2 (en) * | 2015-05-20 | 2017-04-11 | Xerox Corporation | Using motion tracking and image categorization for document indexing and validation |
JP2017021695A (en) | 2015-07-14 | 2017-01-26 | 株式会社東芝 | Information processing apparatus and information processing method |
CN105426518A (en) * | 2015-12-03 | 2016-03-23 | 广东小天才科技有限公司 | Method and system for searching questions by photographing |
CN105578046A (en) * | 2015-12-21 | 2016-05-11 | 魅族科技(中国)有限公司 | Image acquisition method and terminal |
US10210384B2 (en) * | 2016-07-25 | 2019-02-19 | Intuit Inc. | Optical character recognition (OCR) accuracy by combining results across video frames |
CN108171231A (en) * | 2016-12-07 | 2018-06-15 | 中兴通讯股份有限公司 | A kind of communication means and device based on image identification |
CN106686308B (en) * | 2016-12-28 | 2018-02-16 | 平安科技(深圳)有限公司 | Image focal length detection method and device |
JP6448696B2 (en) * | 2017-03-22 | 2019-01-09 | 株式会社東芝 | Information processing apparatus, method, and program |
CN107220578B (en) * | 2017-05-31 | 2020-03-10 | 维沃移动通信有限公司 | Two-dimensional code scanning and identifying method and device, mobile terminal and storage medium |
CN107438160A (en) * | 2017-07-21 | 2017-12-05 | 上海明数数字出版科技有限公司 | A kind of preview image scales the method and device into line character inquiry manually |
CN111970437B (en) * | 2020-08-03 | 2022-08-09 | 广东小天才科技有限公司 | Text shooting method, wearable device and storage medium |
CN112507983B (en) * | 2021-02-03 | 2021-11-16 | 北京世纪好未来教育科技有限公司 | Target detection method and device, electronic equipment and storage medium |
Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5719969A (en) * | 1992-06-30 | 1998-02-17 | Canon Kabushiki Kaisha | Data input apparatus and data processing apparatus |
US20010043229A1 (en) * | 2000-05-10 | 2001-11-22 | Nec Corporation | Method, system and record medium for generating wide-area high-resolution image |
US6473523B1 (en) * | 1998-05-06 | 2002-10-29 | Xerox Corporation | Portable text capturing method and device therefor |
US6650368B1 (en) * | 1999-10-26 | 2003-11-18 | Hewlett-Packard Development Company, Lp. | Digital camera and method of enhancing zoom effects |
US6922487B2 (en) * | 2001-11-02 | 2005-07-26 | Xerox Corporation | Method and apparatus for capturing text images |
US20060017810A1 (en) * | 2004-04-02 | 2006-01-26 | Kurzweil Raymond C | Mode processing in portable reading machine |
US20060170793A1 (en) * | 2005-02-03 | 2006-08-03 | Eastman Kodak Company | Digital imaging system with digital zoom warning |
US20070230786A1 (en) * | 2006-03-30 | 2007-10-04 | Benjamin Perkins Foss | System for capturing and presenting text using video image capture for optical character recognition |
US20080094496A1 (en) * | 2006-10-24 | 2008-04-24 | Kong Qiao Wang | Mobile communication terminal |
US7417673B2 (en) * | 2005-05-31 | 2008-08-26 | Nokia Corporation | Optical and digital zooming for an imaging device |
Family Cites Families (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH07288722A (en) * | 1994-04-15 | 1995-10-31 | Canon Inc | Image pickup device |
JP2002024762A (en) * | 2000-06-30 | 2002-01-25 | Toshiba Corp | Document recognizing device and its method |
US6463220B1 (en) * | 2000-11-08 | 2002-10-08 | Xerox Corporation | Method and apparatus for indicating a field of view for a document camera |
US20080018754A1 (en) * | 2001-04-05 | 2008-01-24 | Nikon Corporation | Method for image data print control, electronic camera and camera system |
US7343049B2 (en) * | 2002-03-07 | 2008-03-11 | Marvell International Technology Ltd. | Method and apparatus for performing optical character recognition (OCR) and text stitching |
JP2004297751A (en) * | 2003-02-07 | 2004-10-21 | Sharp Corp | Focusing state display device and focusing state display method |
JP3696216B2 (en) * | 2003-03-05 | 2005-09-14 | 株式会社スクウェア・エニックス | Three-dimensional video game apparatus, control method of virtual camera in three-dimensional video game, program and recording medium |
JP2005033508A (en) * | 2003-07-14 | 2005-02-03 | Minolta Co Ltd | Imaging device |
EP1810234A2 (en) * | 2004-09-03 | 2007-07-25 | Panaseca, Inc. | Vision center kiosk |
JP2006094082A (en) | 2004-09-24 | 2006-04-06 | Casio Comput Co Ltd | Image photographing device, and program |
JP2006135837A (en) * | 2004-11-09 | 2006-05-25 | Nec Access Technica Ltd | Video telephone |
US7262812B2 (en) * | 2004-12-30 | 2007-08-28 | General Instrument Corporation | Method for fine tuned automatic zoom |
KR100746755B1 (en) | 2005-10-20 | 2007-08-06 | 안성준 | The Electronic dictionary PMP of image processing by Digital camera |
JP4655991B2 (en) * | 2006-04-21 | 2011-03-23 | カシオ計算機株式会社 | Imaging apparatus, electronic zoom method, and program |
US8107675B2 (en) * | 2006-12-29 | 2012-01-31 | Cognex Corporation | Trigger system for data reading device |
US8209635B2 (en) * | 2007-12-20 | 2012-06-26 | Sony Mobile Communications Ab | System and method for dynamically changing a display |
-
2008
- 2008-12-05 KR KR1020080123019A patent/KR20100064533A/en not_active Application Discontinuation
-
2009
- 2009-12-07 CN CN200911000056.2A patent/CN101753846B/en active Active
- 2009-12-07 US US12/632,101 patent/US8553083B2/en active Active
-
2013
- 2013-09-10 US US14/022,799 patent/US10079978B2/en active Active
-
2018
- 2018-08-28 US US16/115,042 patent/US20180367737A1/en not_active Abandoned
Patent Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5719969A (en) * | 1992-06-30 | 1998-02-17 | Canon Kabushiki Kaisha | Data input apparatus and data processing apparatus |
US6473523B1 (en) * | 1998-05-06 | 2002-10-29 | Xerox Corporation | Portable text capturing method and device therefor |
US6650368B1 (en) * | 1999-10-26 | 2003-11-18 | Hewlett-Packard Development Company, Lp. | Digital camera and method of enhancing zoom effects |
US20010043229A1 (en) * | 2000-05-10 | 2001-11-22 | Nec Corporation | Method, system and record medium for generating wide-area high-resolution image |
US6922487B2 (en) * | 2001-11-02 | 2005-07-26 | Xerox Corporation | Method and apparatus for capturing text images |
US20060017810A1 (en) * | 2004-04-02 | 2006-01-26 | Kurzweil Raymond C | Mode processing in portable reading machine |
US20060170793A1 (en) * | 2005-02-03 | 2006-08-03 | Eastman Kodak Company | Digital imaging system with digital zoom warning |
US7417673B2 (en) * | 2005-05-31 | 2008-08-26 | Nokia Corporation | Optical and digital zooming for an imaging device |
US20070230786A1 (en) * | 2006-03-30 | 2007-10-04 | Benjamin Perkins Foss | System for capturing and presenting text using video image capture for optical character recognition |
US20080094496A1 (en) * | 2006-10-24 | 2008-04-24 | Kong Qiao Wang | Mobile communication terminal |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11373619B2 (en) | 2018-06-04 | 2022-06-28 | Fujifilm Business Innovation Corp. | Display control apparatus, display system, and non-transitory computer readable medium |
Also Published As
Publication number | Publication date |
---|---|
US20100141758A1 (en) | 2010-06-10 |
CN101753846B (en) | 2015-08-05 |
KR20100064533A (en) | 2010-06-15 |
US10079978B2 (en) | 2018-09-18 |
US20140009645A1 (en) | 2014-01-09 |
US8553083B2 (en) | 2013-10-08 |
CN101753846A (en) | 2010-06-23 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20180367737A1 (en) | Apparatus and method for automatically adjusting size of characters using camera | |
US7688379B2 (en) | Selecting quality images from multiple captured images | |
US5745175A (en) | Method and system for providing automatic focus control for a still digital camera | |
US8659619B2 (en) | Display device and method for determining an area of importance in an original image | |
KR100967855B1 (en) | System and method for checking framing and sharpness of a digital image | |
US7433586B2 (en) | Camera with an auto-focus function | |
US7643742B2 (en) | Electronic camera, image processing apparatus, image processing method and image processing computer program | |
US20050134719A1 (en) | Display device with automatic area of importance display | |
US7856173B2 (en) | Shooting device for electrical image stabilizing using relationship between stabilization information and shooting condition | |
US8295558B2 (en) | Image previewing system capable of automatically magnifying face portion in image and magnifying method thereof | |
US8284273B2 (en) | Imager for photographing a subject with a proper size | |
US20110069156A1 (en) | Three-dimensional image pickup apparatus and method | |
CN105934940B (en) | Image processing apparatus, method and program | |
KR20060133893A (en) | Imaging apparatus, processing method of the apparatus and program making computer execute the method | |
JP2006094082A (en) | Image photographing device, and program | |
EP2200275B1 (en) | Method and apparatus of displaying portrait on a display | |
US20100007769A1 (en) | Image capturing device capable of automatically magnifying face portion in image and magnifying method thereof | |
CN108810326B (en) | Photographing method and device and mobile terminal | |
JP2012074894A (en) | Electronic camera | |
JP2000217022A (en) | Electronic still camera and its image data recording and reproducing method | |
US20050147327A1 (en) | Image processing apparatus and method | |
JP4936799B2 (en) | Electronic camera | |
JP2000354181A (en) | Digital camera and method for displaying its image | |
US20220360724A1 (en) | Display method | |
KR101400459B1 (en) | Apparatus and method for displaying |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |