JP2016004157A - Image display device, image display method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image display device that can display an image that can be easily visually recognized by a user in enlarging and displaying an image.SOLUTION: An image display device specifies the states of individual characters included in a photographed image (step B4), reads the amount of the type of characters specified in advance by a user (step B3), and specifies a range of a size corresponding to the amount of specified characters from the photographed image on the basis of the specified states of the characters (step B5). The image display device cuts out an image part within the specified range from the photographed image (step B6), enlarges the entire cut-out image part to a size corresponding to a display size (screen size) of a monitor screen (step B7), and displays the enlarged image on the monitor screen as a live view image.

Description

  The present invention relates to an image display device that displays an enlarged image, an image display method, and a program.

  2. Description of the Related Art Conventionally, as a digital camera or a camera-equipped mobile phone equipped with an imaging unit that can close up a subject and capture the details in macro with high definition, for example, the imaging unit captures the description content of printed matter including small characters. There is disclosed a technique that can be used like a magnifying glass by taking an image of the image and enlarging and displaying the captured image on a display means (see Patent Document 1).

JP 2002-374450 A

However, in the technique of Patent Document 1, in order for the user to arbitrarily change the size of the displayed character, an image is adjusted by an operation for adjusting the distance from the apparatus main body to the object (subject) or by zooming. In this case, unlike an actual magnifying glass consisting only of optical lenses, in addition to the process of capturing the subject, a process of displaying the captured image is required, and the time lag is changed. There is a problem that it is difficult to make adjustment smoothly.
On the other hand, for example, when an enlarged view of a printed material placed on a desk is viewed, it is common to tilt the device body and look into the monitor screen from an oblique direction, but the image displayed on the monitor screen is visually When the direction is oblique, another problem arises that the image is distorted and difficult to see.

  An object of the present invention is to display an image that is easy for a user to visually recognize when an image is enlarged and displayed.

In order to solve the above-described problems, the image display device of the present invention
In an image display device that enlarges and displays an image including characters on a display means,
A specifying means for specifying a state of characters included in the image;
When displaying the image on the display means, control is performed to enlarge and display the image on the display means based on the amount of characters designated and the state of the character specified by the specifying means. Display control means;
It is characterized by providing.

In order to solve the above-described problem, another image display device of the present invention
In an image display device for enlarging and displaying an image of an object imaged by an imaging means on a display means,
Correction control means for sequentially controlling the amount of correction of the image picked up by the image pickup means based on the positional relationship that sequentially changes with respect to the object according to the movement of the image display device;
Display control means for performing control for sequentially correcting the images picked up by the image pickup means based on the correction amount sequentially controlled by the correction control means and sequentially displaying the images on the display means;
It is characterized by providing.

  According to the present invention, when an image is enlarged and displayed, an image that is easy for the user to visually recognize can be displayed.

The block diagram which showed the basic component of the digital camera applied as an image display apparatus. (1), (2) is the figure which illustrated the mode at the time of imaging a target object (for example, pamphlet) from the upper direction at the time of a special imaging function (enlarged view function). (1)-(3) is the figure which illustrated the mode at the time of imaging, changing the distance with the target object, when imaging a target object from the upper direction at the time of an expansion view function. (1) to (3) are the amounts of arbitrary characters (number of digits of characters) designated and input in advance when an image (image including characters) obtained by capturing an object in the enlarged view function is displayed as a live view image. The figure which showed that an image was expanded and displayed by the magnitude | size corresponding to (). (1) to (3) are the amounts of arbitrary characters (number of lines of characters) input and specified in advance when an image (image including characters) obtained by capturing an object in the enlarged view function is displayed as a live view image. The figure which showed displaying an image expanded in the magnitude | size match | combined to (). The flowchart which is started to be executed in response to an activation command for an enlarged view function. 7 is a flowchart for explaining step A8 (enlargement processing) in FIG. 6 in detail. The figure which showed the distance / character quantity conversion table used in 2nd Embodiment. 7 is a flowchart for explaining step A8 (enlargement processing) in FIG. 6 in detail in the second embodiment.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
(First embodiment)
First, a first embodiment of the present invention will be described with reference to FIGS.
This embodiment exemplifies a case where the present invention is applied to a digital camera as an image display device, and FIG. 1 is a block diagram showing basic components of the digital camera.
This digital camera is a compact camera having various functions and capable of taking still images and moving images. In other words, an imaging function that can capture a subject in high definition, a digital zoom function that cuts out and enlarges a part of the captured image, and an image that can be read and played back as a recorded image (saved image) In addition to basic functions such as a playback function, in particular, in the present embodiment, a special imaging function (enlarged view function) that captures a macroscopic image of an object (for example, a newspaper, a book, an advertisement, etc.) and displays it in an enlarged manner is provided. ing. In addition, not only a compact camera but a single-lens reflex camera may be sufficient.

  The special imaging function (enlarged view function) can be used, for example, when observing insects and flowers, reading a newspaper or a book, and the macro on the wide-angle end side (wide end side) of the zoom lens described later. Or, unlike the macro on the telephoto end side (tele end side), the digital zoom function is used together to generate an image that has been enlarged to the size desired by the user, or to generate a corrected image by detecting image distortion It is a function to display as a live view image on the monitor screen. A light (not shown) for illuminating the subject (object) is provided during the enlarged view function, and the illumination light is automatically turned on in response to a lighting instruction by a user operation or detection of a distance to the subject. Also good.

  The control unit 1 operates by supplying power from the power source unit (secondary battery) 2 and controls the overall operation of the digital camera according to various programs stored in the storage unit 3. The unit 1 is provided with a CPU (Central Processing Unit) and a memory (not shown). The storage unit 3 includes, for example, a ROM, a flash memory, and the like, and stores programs and various applications for realizing the present embodiment in accordance with operation procedures shown in FIGS. 6 and 7 to be described later. A program memory 3A, a work memory 3B for temporarily storing flags and the like. The storage unit 3 may include a removable portable memory (recording medium) such as an SD card or an IC card, and is connected to a network via a communication function (not shown). The state may include a storage area on a predetermined server device side.

  Although not shown, the operation unit 4 includes various push button type keys. For example, a mode change button for switching between a shooting mode and a playback mode for playing back a captured image (stored image), or switching to the above-described special imaging function (enlarged view function) or the like as a shooting mode, or a shooting instruction is performed A release button, a zoom lever for adjusting the angle of view (zoom), a setting button for setting shooting conditions such as exposure and shutter speed, and the like are provided. The control unit 1 executes, for example, a mode change process, a shooting condition setting process, and the like as a process according to the input operation signal from the operation unit 4.

  The touch display unit 5 includes a touch panel, for example, has a high-definition liquid crystal screen having screens with different aspect ratios, displays a function name as a software key, and functions as a touch input unit. The display screen may be a monitor screen (live view screen) that displays captured images (live view images) in real time, or a playback screen that plays back captured images. The screen is not limited to a screen with a touch panel (monitor screen, playback screen), and may be a screen with only a display unit (monitor screen, playback screen).

  The imaging unit 6 constitutes a camera unit capable of photographing a subject with high definition, and has zoom adjustment, focus adjustment, automatic exposure adjustment (AE), automatic focus adjustment (AF) functions, and the like. In response to the control signal, zoom adjustment, automatic focus adjustment (AF), automatic exposure adjustment (AE), and shooting start / end are controlled by driving a zoom lens, a focus lens, and a diaphragm / shutter (not shown). ing. When a subject image from an optical lens system such as a zoom lens and a focus lens is formed on the image sensor in the imaging unit 6, an image signal (analog value signal) read out by photoelectric conversion is digital value data. Is converted into the screen size of the touch display unit 5 and displayed in real time as a live view image. When shooting is instructed by the release button, the captured image is subjected to compression processing with white balance, sharpness, and the like, and then recorded and stored in the storage unit 3 (for example, an SD card).

  The acceleration sensor 7 detects the posture of the camera at the time of the enlarged view function, that is, the angle (tilt) of the camera body with respect to the direction of gravity. For example, the acceleration sensor 7 is configured by a three-axis type acceleration sensor and is orthogonal to each other. Based on the acceleration component (X, Y, Z directions), the angle (tilt) of the camera body with respect to the direction of gravity is detected. For example, when a user reads a character string (article) described in a newspaper (object) on a desk using the above-described enlarged view function, the camera is directed to be parallel to the desk surface. However, in such a case, the control unit 1 causes the trapezoidal distortion occurring in the entire image captured during the enlarged view function to be detected by the acceleration sensor 7. Correction processing is performed based on the angle (angle in the optical axis direction: inclination). This trapezoidal distortion correction process is a process for correcting distortion of a geometric image that changes depending on the positional relationship (angle) between the camera body and the object, and is realized by using a known technique. Therefore, detailed description is omitted here.

FIG. 2 is a diagram illustrating a state in which an object (for example, a pamphlet) is imaged by a digital camera from above when the enlarged view function is used.
2A shows a digital camera, and FIG. 2B shows a description content (character string) of an object (printed material). As shown in FIG. 2A, a camera provided on the front side of the digital camera. When the lens CR is brought closer to the object (printed material) in FIG. 2 (2), an image captured by the image sensor (an image including written characters) is displayed on the touch display unit provided on the front side of the camera. 5 is displayed on the monitor screen in real time as a live view image. The characters include kanji, katakana, hiragana, alphabetic characters, numbers, symbols, symbol marks, and the like, and are not limited to Japanese.

FIG. 3 is a diagram exemplifying a situation when an object such as a pamphlet is imaged from above with a camera in the enlarged view function, and the distance to the object is changed.
FIG. 3 (1) is a diagram showing the positional relationship between the camera and the object (printed material) when the image is taken close to the distance B from the distance A, and (2) is an image (characters taken at the distance A). (3) shows an image captured at a distance B (an image including characters) displayed on the monitor screen (live view screen). It is the figure which showed the state. Each distance has a relationship of A> B, and the angle of view of the camera changes depending on the distance to the object. Therefore, the image captured at the distance B is larger than the image captured at the distance A. Is displayed.

FIG. 4 is an enlarged view function. When an image obtained by capturing an object such as a pamphlet with a digital camera (an image including characters) is displayed on a monitor as a live view image, input is arbitrarily designated by numerical data in advance by a user operation. It is the figure which showed that an image was expanded and displayed by the magnitude | size corresponding to the amount (number of digits of a character) of the other character.
FIG. 4A shows a live view screen when “display digit number = 5 digits” is designated as the amount of characters to be displayed. The captured image (image including characters) is displayed at a distance to the object. Regardless, the character string in the digit direction in the screen is enlarged and displayed to a size of 5 digits. The illustrated example is a case where a character string of 5 digits and 2 lines is displayed on a monitor.

  FIG. 4 (2) shows a live view screen when “display digit number = 10 digits” is designated as the amount of characters to be displayed. The captured image (image including characters) is displayed at a distance from the object. Regardless, the character string in the digit direction in the screen is enlarged and displayed to a size of 10 digits. The illustrated example is a case where a 10-digit, 4-line character string is displayed on the monitor. FIG. 4 (3) shows a live view screen when “display digit number = 15 digits” is designated as the amount of characters to be displayed. The captured image (image including characters) is displayed at a distance from the object. Regardless, the character string in the digit direction in the screen is enlarged and displayed to a size of 15 digits. The illustrated example is a case where a 15-digit, 6-line character string is displayed on the monitor.

  As described above, during the enlarged view function, the control unit 1 enlarges and displays the image on the monitor based on the amount of characters (number of characters) specified in advance. In this case, the control unit 1 is included in the image based on the character separation, character size, and character positional relationship (vertical writing, horizontal writing) for each character included in the captured image. The character state is specified, and the image is enlarged and displayed based on the specified character state and the character amount (number of character digits) specified in advance. In this case, for example, a portion in which black dot data is gathered in the image is recognized as a character portion, or a character separation is recognized, thereby specifying individual character separations and character sizes. The character positional relationship (vertical writing, horizontal writing) is recognized by whether the starting point (character writing start position) is in the upper right or upper left because the line digit relationship is different by 90 degrees, and the vertical writing and horizontal writing are specified. I am doing so. Then, based on the identified result (character state) and the amount of characters (number of character digits) specified in advance, a process of enlarging and displaying the image is executed. In this case, the enlargement display processing calculates the enlargement ratio based on the specified result (character state) and the amount of characters specified in advance (number of character digits), and displays an image enlarged at this enlargement ratio. You may make it do. Note that the recognition of the character part, the separation between characters, or the recognition of the positional relationship of the characters can be realized by using a known technique, and thus detailed description thereof is omitted here.

FIG. 5 is an enlarged view function in which an image (an image including characters) obtained by capturing an object such as a pamphlet with a digital camera is displayed on a monitor as a live view image. It is the figure which showed that the image was expanded and displayed by the magnitude | size according to quantity (the number of lines of a character).
FIG. 5A shows a live view screen when “display line number = 3 lines” is designated as the amount of characters to be displayed, and the captured image (an image including characters) is displayed at a distance from the object. Regardless, the character string in the line direction in the screen is enlarged and displayed to a size of 3 lines. The example shown in the figure is a case where a character string of 7 digits and 3 lines is displayed on a monitor.

  FIG. 5 (2) shows a live view screen when “number of display lines = 4 lines” is designated as the amount of characters to be displayed. The captured image (image including characters) is displayed at a distance from the object. Regardless, the display is enlarged so that the line direction in the screen is 4 lines. The illustrated example is a case where a 10-digit, 4-line character string is displayed on the monitor. FIG. 5 (3) shows a live view screen in the case where “number of display lines = 5 lines” is designated as the amount of characters to be displayed, and the captured image (image including characters) is at a distance from the object. Regardless, the display is enlarged so that the line direction in the screen is 5 lines. The illustrated example is a case where a character string of 11 digits and 5 lines is displayed on a monitor.

  As described above, during the enlarged view function, the control unit 1 enlarges and displays an image on a monitor based on a character amount (number of character lines) designated in advance. In this case, the control unit 1 is included in the image based on the character separation, character size, and character positional relationship (vertical writing, horizontal writing) for each character included in the captured image. The character state is specified, and the image is enlarged and displayed based on the specified character state and the character amount (number of character lines) specified in advance. Even in this case, the control unit 1 recognizes the separation of individual characters and the size of the characters, and recognizes the positional relationship (vertical writing, horizontal writing) of the characters. Then, based on the specified result and the amount of characters (number of character lines) specified in advance, a process of enlarging and displaying the image is executed. Even in this case, the enlargement display process calculates the enlargement ratio based on the specified result (character state) and the amount of characters (number of character lines) specified in advance, and the image enlarged at this enlargement ratio. May be displayed.

  The display example of FIG. 4 described above shows the case where the number of digits is specified as the amount of characters, and the display example of FIG. 5 shows the case where the number of rows is specified as the amount of characters. Not only when one of the numbers is designated, but also when both the number of digits and the number of rows, that is, a combination of the number of digits and the number of rows are designated. For example, when “10 digits” is designated as the number of character digits and “4 lines” is designated as the number of character lines, the monitor screen has display contents as shown in FIG.

  Further, in the display state as shown in FIGS. 4 and 5, the process for enlarging the captured image is controlled, and as described above, based on the angle of the camera body (angle in the optical axis direction: inclination), the trapezoid A process for correcting the distortion is also performed. Even when the user moves the camera body (for example, moves to the right in the figure) to view other articles (character strings that are off the screen) following the displayed character string (article). The control unit 1 continues the process of enlarging and displaying the image to the size corresponding to the amount of the designated character as it is, and even if the angle of the camera body changes with the movement, it is sequentially detected by the acceleration sensor 7. The process of correcting the trapezoidal distortion is continued based on the changed angle of the camera body. In other words, the control unit 1 sequentially controls the amount of correction of the captured image based on the positional relationship with the object that sequentially changes as the camera body moves, and sequentially corrects the image based on the amount of correction. And display them sequentially on the monitor screen.

  Next, the operation concept of the digital camera in the first embodiment will be described with reference to the flowcharts shown in FIGS. Here, each function described in these flowcharts is stored in the form of a readable program code, and operations according to the program code are sequentially executed. Further, it is possible to sequentially execute the operation according to the above-described program code transmitted via a transmission medium such as a network. The same applies to other embodiments described later. In addition to the recording medium, an operation peculiar to the present embodiment can be executed using a program / data supplied externally via a transmission medium. FIG. 6 is a flowchart showing an outline of the operation of the characteristic part of the present embodiment in the overall operation of the digital camera. When the flow of FIG. 6 is exited, the main flow of the overall operation (not shown) Return to).

FIG. 6 is a flowchart that is started when a special imaging function (enlarged view function) is activated.
First, the control unit 1 checks whether it is an imaging timing (step A1), checks whether a user operation for inputting and specifying an arbitrary character amount is performed (step A2), and performs other user operations. Whether or not a user operation for instructing the end of the enlarged view function has been performed (step A4). As another operation, for example, when an operation for setting the brightness of the monitor screen is performed (YES in step A3), a process for setting the brightness of the monitor screen is performed as a process corresponding to the operation (step A6). ).

  When a numerical key (not shown) of the operation unit 4 is operated and an arbitrary character amount is input and specified as numerical data (YES in step A2), the amount of the input specified character and its type A process of temporarily storing (the number of digits, the number of lines) in the work memory 3B is performed (step A5). For example, when “number of display digits = 5 digits” is designated as the amount of characters to be displayed, the number of characters is temporarily stored in the work memory 3B as 5 digits and the type thereof. When “displayed line number = 3 lines” is designated as the amount of characters to be displayed, 3 lines are stored as the amount of characters, and the number of lines is temporarily stored in the work memory 3B. Further, when “display digit number = 10 digits” and “display line number = 4 lines” are designated as the amount of characters to be displayed, the character amount is 10 digits and 4 rows, and the type is the number of digits and lines. The number is temporarily stored in the work memory 3B.

  In this way, after the user performs an operation for setting the monitor screen to a brightness that is easy to see or an operation for specifying the amount of characters to be displayed, the digital camera is brought close to an object such as a pamphlet. When the control unit 1 detects the imaging timing (YES in step A1), the control unit 1 acquires an image (an image including characters) captured by the imaging device from the imaging unit 6 (step A7), and the image is designated. A process of enlarging based on the amount of characters is performed (step A8).

FIG. 7 is a flowchart for explaining in detail the process of enlarging the image based on the designated character amount (step A8 in FIG. 6).
First, the control unit 1 acquires the camera attitude detected by the acceleration sensor 7, that is, the camera angle (tilt) with respect to the direction of gravity (step B1), and based on the camera angle (tilt), the entire image is acquired. Keystone correction is performed (step B2). Next, the amount and type of characters temporarily stored in the work memory 3B are read (step B3). The state of each character included in the image is recognized by recognizing the character separation, character size, and character positional relationship (vertical writing, horizontal writing) for each character included in the captured image. Is specified (step B4).

  Based on the state of each character in the image thus specified and the amount of character specified by the user, a range of a size corresponding to the specified character amount is specified from the captured image (step B5). That is, the range of the same character amount as the designated character amount is specified from the captured image. For example, if the designated character amount is 10 digits, from the predetermined position (for example, the left end position when recognized as horizontal writing) to the 10th character position (10 characters) in the digit direction of the captured image. After specifying the length between the minute and the character 9), the length in the row direction is specified based on the length in the digit direction. At this time, the length is adjusted according to the aspect ratio of the monitor screen. The length of the direction is specified. The image portion within the specified range is cut out from the captured image (step B6), and the whole cut out image portion is enlarged to a size corresponding to the display size (the number of display pixels) of the monitor screen. Processing is performed (step B7).

  If the designated character amount is four lines, first, from the predetermined position (for example, the upper end position when recognized as horizontal writing) to the position of the fourth line in the line direction of the captured image (characters). Between four lines and their characters 3) Specify the length in the line direction. Next, the length in the digit direction is specified according to the aspect ratio of the monitor screen, and the image portion within the specified range is cut out from the captured image and enlarged to a size corresponding to the display size of the monitor screen. Do.

  In such an enlargement process, when enlarging with reference to the number of digits as described above, between characters in the line direction, or when enlarging with reference to the number of lines as described above, between characters in the direction of digits. Since the characters may not be displayed on the monitor screen and the character display may be cut off halfway, the position of each character included in the enlarged image is compared with the peripheral part of the monitor screen. Is cut off in the middle, that is, whether the entire character does not fit within the monitor screen and is cut off halfway (step B8). If the character display is cut off halfway (YES in step B8), processing for correcting the inter-digit and line spacing is performed (step B9). In this case, at least one of the character spacing and the line spacing is corrected. For example, when the display of characters in the digit direction is interrupted, correction is performed to uniformly narrow the space between the digits. Further, when the display of characters is cut off in the line direction, correction is performed to uniformly narrow the space between lines. In this case, the amount of protrusion of a character whose display is cut off in the middle is detected, and correction is performed so that the amount of protrusion is evenly distributed between each digit or line.

  When the number of digits and the number of lines are designated as the user-specified character amount, first, the above-described steps B5 to B7 are performed by designating either the designated number of digits or the number of lines. Subsequently, the processes of steps B8 and B9 described above are performed so that the display of characters is not interrupted at the peripheral edge of the monitor screen. Then, the process of step B5-B9 is performed by the other designation | designated. Note that it is arbitrary whether to give priority to the process in the digit direction or the line number direction, but it is desirable to give priority to the longer one.

  When such enlargement processing (step A8 in FIG. 6) is completed, the enlarged image is displayed as a live view image on the monitor screen (step A9). Thereafter, the process returns to the first step A1, and the above-described operation is repeated thereafter. In this case, even when the user moves the camera body in order to view another article following the displayed character string (article), the above operation is repeated, so that the specified character amount is matched even during the movement. The process of enlarging and displaying the image in size is continued as it is. Here, when an operation to instruct the end of the enlarged view function is performed (YES in step A4), the process returns to the main flow (not shown).

  As described above, in the first embodiment, the control unit 1 specifies the state of characters included in an image, and when the amount of characters for displaying the image is specified, Since the control for enlarging and displaying the image is performed based on the specified character state, the image can be enlarged based on the designated character amount when the image is enlarged and displayed. Therefore, it is possible to display images (characters) that are easy to visually recognize (easy to read).

  Since the control unit 1 specifies the state of the character included in the image based on the character delimiter, the character size, and the positional relationship of the characters for each character included in the image, It is possible to appropriately specify the character state.

  When the object including a character is imaged by the imaging unit 6, the control unit 1 specifies the state of the character as the image including the character, and thus the object including the character is selected. By capturing an image, the image can be enlarged based on the amount of designated characters.

  Since the control unit 1 controls the enlarged display based on the designated character amount regardless of the distance from the imaging unit 6 to the target object, the control unit 1 maintains the posture to keep holding the camera body. Even if the distance changes, the image can be enlarged based on the amount of designated characters.

  Since the amount of characters for displaying the image on the monitor is arbitrarily specified by the user operation, the user can freely change the amount of characters at any time to view the character in the desired size. .

  Since the amount of characters is specified by at least one of the number of characters and the number of characters, the amount of characters is specified by the number of digits and the number of lines that are easy to understand for users. be able to.

  In order to prevent the characters in the image from being cut off halfway, at least one of the character spacing and line spacing has been corrected to match the size of the monitor screen. Can be displayed in an easy-to-see state in which the characters are within the screen.

  The control unit 1 sequentially controls the amount of correction of the image picked up by the photographing unit 6 based on the positional relationship that sequentially changes with respect to the object as the camera body moves, and based on the amount of correction, the control unit 1 Since the images are sequentially corrected and sequentially displayed on the monitor screen, even if the positional relationship with the object changes during the movement of the camera body, the image can be corrected in real time and the user can be corrected in real time. It is possible to display images (characters) that are easy to visually recognize (easier to read).

  Since the control unit 1 performs the trapezoidal distortion correction on the captured image based on the angle of the camera body (angle in the optical axis: inclination) detected by the acceleration sensor 7, the movement of the camera body Even if the angle with the object changes, the distortion of the image can be corrected in real time.

In the first embodiment described above, the character amount is input and designated by a user operation during the enlarged view function. However, the timing for designating the character amount is not limited to this, and the enlarged view function is activated. It may be specified in advance.
In the first embodiment described above, the amount of characters that can be input is not limited by the input specification of the amount of characters, but the amount of characters that is clearly too large or too small, or the monitor screen The input restriction may be performed so that the character cannot overlap with the character by correction from the aspect ratio.

  In the first embodiment described above, the case where the trapezoidal distortion due to the angle of the camera body is corrected is exemplified, but geometrical image distortion other than the trapezoidal distortion may be corrected.

(Second Embodiment)
A second embodiment of the present invention will be described below with reference to FIGS.
In the first embodiment described above, the amount of characters is arbitrarily input and designated by a user operation. However, in the second embodiment, the distance from the camera to the object is detected, and this distance is set to this distance. The amount of characters is automatically specified based on this. Furthermore, in the second embodiment, in addition to the trapezoidal distortion correction described above, when the printing surface is a curved surface like a spread book, the curved surface is corrected in real time. Here, in both the embodiments, the same or the same names are denoted by the same reference numerals, the description thereof will be omitted, and the following description will focus on the features of the second embodiment. .

FIG. 8 is a diagram for explaining a distance / character amount conversion table T used for designating the amount of characters based on the distance from the camera to the object.
The distance / character amount conversion table T stores the amount of characters corresponding to the distance to the object, and has items of “distance”, “number of display digits”, and “number of display lines”. . In the illustrated example, the “distance” to the object is divided into three stages of “less than distance (1)”, “distance (1) or more and less than distance (2)”, and “distance (2)”. The “number of display digits” and the “number of display lines” are stored in association with the stages.

  Here, for example, “distance (1)” may be set to 6 cm and “distance (2)” may be set to 12 cm. Further, the distance is not limited to three stages, but may be divided into two stages or four or more stages. The control unit 1 searches the distance / character amount conversion table T based on the distance measured by the automatic focus adjustment (AF) function, and reads the corresponding “number of display digits” and “number of display lines” to read the character. Specify the amount automatically. That is, the distance / character amount conversion table T is used as means for designating the amount of characters when the captured image is displayed on the monitor screen. In the second embodiment, “number of display digits” and “number of display lines” are designated as the amount of characters, but either one of them may be designated. The contents of the distance / character amount conversion table T may be arbitrarily set by a user operation.

Since the difference between the processing of the second embodiment and the first embodiment is step A8 (enlargement processing) in FIG. 6, in the second embodiment, the entire enlarged view function of FIG. The flowchart is omitted. FIG. 9 is a flowchart for explaining step A8 (enlargement process) in FIG. 6 in detail in the second embodiment.
First, the control unit 1 acquires the camera angle (tilt) detected by the acceleration sensor 7 (step C1), and performs trapezoidal distortion correction on the entire image based on the camera angle (tilt) (step C1). C2). Assuming that the printing surface is curved like a spread book, paying attention to the area of the character part, that is, the rectangular area of the character size, the deformation amount of the rectangle is detected as the distortion of the character ( In step C3), the entire image is subjected to curved surface correction based on the distortion (character deformation amount) of the character (step C4). The curved surface correction process is a process for correcting the distortion of characters so that the curved surface becomes a horizontal plane when the printed surface is a curved surface such as a spread book, and a known technique is used. Therefore, detailed description is omitted here.

  Next, the distance measured by the automatic focus adjustment (AF) function is acquired (step C5), and the distance / character amount conversion table T is referred to based on the acquired distance (step C6). ”And“ number of display lines ”are read to designate the character amount corresponding to the distance (step C7). As in the first embodiment, each character included in the captured image is converted into an image based on the character separation, character size, and character positional relationship (vertical writing, horizontal writing). The state of the included character is specified (step C8), and based on the state of the character in the specified image and the specified character amount, a process for specifying the same character amount range as the specified character amount from the captured image is performed. (Step C9).

  Then, the image portion within the specified range is cut out from the captured image (step C10), and the cut-out image is enlarged to a size corresponding to the display size (screen size) of the monitor screen (step C11). ). When such enlargement processing (step A8 in FIG. 6) is completed, the enlarged image is displayed as a live view image on the monitor screen (step A9). Thereafter, the process returns to the first step A1, and the above-described operation is repeated thereafter. In this case, even when the user moves the camera body in order to view another article following the displayed character string (article), the above operation is repeated, so that the specified character amount is matched even during the movement. The process of enlarging and displaying the image in size is continued as it is.

  Although not shown in the second embodiment, as in the first embodiment described above, it is checked whether one character in the enlarged image does not fit in the monitor screen and is cut off halfway. When the display is cut off in the middle, processing for correcting the inter-digit and inter-line spacing (steps B8 and B9 in FIG. 7) may be performed.

  As described above, in the second embodiment, the distance / character amount conversion table T is referred to based on the distance measured by the automatic focus adjustment (AF) function, and the image is specified while specifying the character amount corresponding to the distance. Performs processing to enlarge and display. That is, the control unit 1 sequentially controls the amount of correction of the captured image based on the positional relationship with the object that sequentially changes as the camera body moves, and sequentially corrects the image based on the amount of correction. To display on the monitor screen sequentially. Here, in the second embodiment, the positional relationship indicates the distance to the object, the correction amount indicates the amount of the designated character, and the control unit 1 can perform the distance / character even during the movement of the camera body. A process of enlarging and displaying the image while referring to the amount conversion table T is performed. Here, when an operation for instructing the end of the enlarged view is performed (YES in step A4), the process returns to the main flow (not shown). In addition, as a positional relationship with the object in the second embodiment, in addition to the distance to the object, the angle of the camera body may be added as in the first embodiment.

  As described above, in the second embodiment, the control unit 1 further specifies the deformation amount (character distortion) for each character included in the captured image, and the character deformation amount (character distortion). ), The curved surface correction is performed on the image. Therefore, even when the printing surface is curved, such as a spread book, an image (easy to read) that is easy for a user to visually recognize (easy to read). Character) can be displayed.

  The distance to the object is divided into a plurality of stages, and a distance / character amount conversion table T for storing the amount of characters is provided in association with the plurality of stages, and the control unit 1 measures by an automatic focus adjustment (AF) function. The distance / character amount conversion table T is referred to based on the determined distance, the amount of characters associated with the level corresponding to the acquired distance is specified as the amount of characters, and the enlarged display is performed based on the specified character amount Therefore, it is not necessary to input and specify the amount of characters by a user operation, and the specification of the amount of characters can be easily changed by simply changing the distance from the objective.

  The control unit 1 sequentially determines the amount of correction (the amount of characters) for the image captured by the imaging unit 6 based on the positional relationship (distance to the target) that sequentially changes with respect to the target as the camera body moves. Based on the amount to be corrected (the amount of characters), the images are sequentially corrected and sequentially displayed on the monitor screen, so even if the distance to the object changes during the movement of the camera body Accordingly, the enlarged display of the image can be controlled in real time.

(Modification)
In the second embodiment described above, the distance from the camera to the object is detected and the amount of characters is automatically specified. However, the angle of view specified by the zoom lever is detected, and this The amount of characters may be automatically specified based on the angle of view.

  In this case, an angle of view / character amount conversion table (not shown) having a configuration in which “distance” in the distance / character amount conversion table T of FIG. For example, “view angle” is divided into three stages of “view angle (less than 1)”, “view angle (1) or more and less than view angle (2)”, and “view angle (2)”. This can be realized if the “number of display digits” and the “number of display lines” are stored in association with each other.

  Also, in this case, instead of “acquisition of the distance to the object” in step C5 in FIG. 9, “obtain angle of view” and in step C6 “distance / character amount conversion table based on acquisition distance”. Instead of “refer to”, “refer to the angle of view / character amount conversion table based on the acquired angle of view” may be used.

  In this way, the angle of view is divided into a plurality of stages, and an angle of view / character amount conversion table for storing the amount of characters is provided in association with the plurality of stages. The control unit 1 is designated by the zoom lever operation of the user. The angle of view / character amount conversion table is referred to based on the angle of view, the amount of characters associated with the level corresponding to the acquired angle of view is designated, and the enlarged display is controlled based on the designated amount of character. By doing so, it is not necessary to input and specify the amount of characters by a user operation, and it is possible to easily change the specification of the amount of characters simply by changing the angle of view.

  In each of the above-described embodiments, the number of characters and the number of character lines are exemplified as the amount of characters. However, the total number of characters displayed on the monitor screen may be designated as the amount of characters.

  In each of the embodiments described above, the case where characters having different sizes are mixed is not mentioned in the image, but when characters having different sizes are mixed, the average value of the sizes is mixed. And the average value may be specified as the character state, or the character size may be compared to specify the largest number as the character state.

  In each of the above-described embodiments, the case of enlarging an image using the digital zoom function is illustrated, but the image may be enlarged using an optical zoom function.

  Further, in each of the above-described embodiments, the description has been given of the process of enlarging and displaying the captured image as a live view image based on the designated character amount. However, the image is being displayed by operating the release button or the like. You may make it image | photograph based on a live view image and to acquire and reproduce | regenerate the imaged image. This makes it possible to reproduce a captured image similar to the live view image.

  Further, in each of the above-described embodiments, the case where the present invention is applied to a digital camera is shown. However, a mobile phone such as a smartphone with a camera function, a PC (personal computer), a tablet terminal, or a PDA (personal portable information communication device). -An electronic wristwatch may be used.

  In each of the above-described embodiments, the image to be displayed is not limited to the image captured by the camera, and may be a case where a recorded video image such as a captured image or a TV video is displayed. The image to be processed may be obtained by converting text data into image data for display. Furthermore, it is not limited to an electronic device with a camera function as described above, and may be an image display device having an image reproduction function.

  Further, the “apparatus” and “unit” shown in each of the above-described embodiments may be separated into a plurality of cases by function, and are not limited to a single case. In addition, each step described in the above-described flowchart is not limited to time-series processing, and a plurality of steps may be processed in parallel or separately.

The embodiment of the present invention has been described above. However, the present invention is not limited to this, and includes the invention described in the claims and the equivalent scope thereof.
Hereinafter, the invention described in the claims of the present application will be appended.
(Appendix)
(Claim 1)
The invention described in claim 1
In an image display device that enlarges and displays an image including characters on a display means,
A specifying means for specifying a state of characters included in the image;
When displaying the image on the display means, control is performed to enlarge and display the image on the display means based on the amount of characters designated and the state of the character specified by the specifying means. Display control means;
It is characterized by providing.
(Claim 2)
The invention according to claim 2 is the image display device according to claim 1,
The display control means performs control for enlarging a portion corresponding to the amount of the designated character from the image and displaying it on the display means.
It is characterized by that.
(Claim 3)
The invention according to claim 3 is the image display device according to claim 1 or 2,
The specifying unit specifies the state of the character included in the image based on at least one of character separation, character size, and character positional relationship with respect to each character included in the image.
It is characterized by that.
(Claim 4)
The invention according to claim 4 is the image display device according to any one of claims to 3,
The specifying means further specifies a deformation amount for each character included in the image,
The display control unit corrects the image based on the deformation amount of the character specified by the specifying unit.
It is characterized by that.
(Claim 5)
The invention according to claim 5 is the image display device according to any one of claims 1 to 4,
It further comprises imaging means for imaging an object including the characters,
The specifying unit specifies an image captured by the imaging unit as an image including the character and the state of the character;
It is characterized by that.
(Claim 6)
The invention according to claim 6 is the image display device according to claim 5,
The display control means controls the enlarged display based on the amount of the designated character regardless of the distance from the imaging means to the object.
It is characterized by that.
(Claim 7)
The invention according to claim 7 is the image display device according to claim 5,
Obtaining means for obtaining a distance from the imaging means to the object;
Storage means for dividing the distance from the imaging means to the object into a plurality of stages, and storing the amount of characters in association with the plurality of stages;
With
The display control means controls the enlarged display with the amount of characters stored in the storage means corresponding to the distance acquired by the acquisition means as the specified character amount.
It is characterized by that.
(Claim 8)
The invention according to claim 8 is the image display device according to claim 5,
Obtaining means for obtaining an angle of view designated by a zoom function included in the imaging means;
Storage means for dividing the angle of view into a plurality of stages and storing the amount of characters in association with the plurality of stages;
With
The display control means controls the enlargement display with the amount of characters stored in the storage means corresponding to the angle of view acquired by the acquisition means as the specified character amount. ,
It is characterized by that.
(Claim 9)
The invention according to claim 9 is the image display device according to any one of claims 1 to 8,
Further comprising designation means for arbitrarily designating the amount of characters when displaying the image on the display means by a user operation;
The display control means controls the enlarged display based on the amount of characters specified by the specifying means and the state of the characters specified by the specifying means.
It is characterized by that.
(Claim 10)
The invention according to claim 10 is the image display device according to claim 9,
The designation means designates at least one of the number of digits of characters and the number of lines of characters when displayed on the display means as the amount of characters.
It is characterized by that.
(Claim 11)
The invention according to claim 11 is the image display device according to claim 10,
The display control means is configured to adjust the size of the display area of the display means so that the display of the characters included in the image is not cut halfway. Correct at least one of them,
It is characterized by that.
(Claim 12)
The invention according to claim 12
In an image display device for enlarging and displaying an image of an object imaged by an imaging means on a display means,
Correction control means for sequentially controlling the amount of correction of the image picked up by the image pickup means based on the positional relationship that sequentially changes with respect to the object by the movement of the image display device;
Display control means for performing control for sequentially correcting the images picked up by the image pickup means based on the correction amount sequentially controlled by the correction control means and sequentially displaying the images on the display means;
It is characterized by providing.
(Claim 13)
The invention according to claim 13 is the image display device according to claim 12,
A detector for detecting an angle of the imaging unit in the optical axis direction with respect to the object;
The correction control means sequentially controls the correction amount based on the angle detected by the detection means.
It is characterized by doing so.
(Claim 14)
The invention according to claim 12 is the image display device according to claim 12 or 13,
A detection unit for detecting a distance from the imaging unit to the object;
The correction control means sequentially controls the correction amount based on the distance detected by the detection means.
It is characterized by doing so.
(Claim 15)
The invention according to claim 15 is the image display device according to claim 14,
The object includes characters,
The control means sequentially controls the correction amount based on the distance detected by the detection means and the amount of designated characters.
It is characterized by doing so.
(Claim 16)
The invention described in claim 16
An image display method in an image display device for enlarging and displaying an image including characters on a display means,
Processing for specifying the state of characters included in the image;
Processing for enlarging and displaying the image on the display unit based on the amount of the designated character and the state of the specified character when the image is displayed on the display unit;
An image display method comprising:
(Claim 17)
The invention described in claim 17
For a computer of an image display device that enlarges and displays an image including characters on a display means,
A function for specifying the state of characters included in the image;
A function of performing control for enlarging and displaying the image on the display unit based on the amount of the designated character and the state of the specified character when the image is displayed on the display unit;
A program to realize
(Claim 18)
The invention described in claim 18
An image display method in an image display device for enlarging and displaying an image of an object imaged by an imaging means on a display means,
A process of sequentially controlling an amount of correcting an image captured by the imaging unit based on a positional relationship that sequentially changes with respect to the object by the movement of the image display device;
Processing for sequentially correcting the images picked up by the image pickup means based on the sequentially controlled correction amount and sequentially displaying the images on the display means;
An image display method comprising:
(Claim 19)
The invention according to claim 19 is
For the computer of the image display device that enlarges and displays the image of the object imaged by the imaging means on the display means,
A function of sequentially controlling an amount of correcting an image captured by the imaging unit based on a positional relationship that sequentially changes with respect to the object by movement of the image display device;
A function of sequentially correcting the images picked up by the image pickup means based on the amount of correction to be sequentially controlled and sequentially displaying the images on the display means;
A program to realize

DESCRIPTION OF SYMBOLS 1 Control part 3 Memory | storage part 3A Program memory 4 Operation part 5 Touch display part 6 Imaging part 7 Acceleration sensor T Distance / character amount conversion table

Claims (19)

In an image display device that enlarges and displays an image including characters on a display means,
A specifying means for specifying a state of characters included in the image;
When displaying the image on the display means, control is performed to enlarge and display the image on the display means based on the amount of characters designated and the state of the character specified by the specifying means. Display control means;
An image display device comprising: The display control means performs control for enlarging a portion corresponding to the amount of the designated character from the image and displaying it on the display means.
The image display device according to claim 1, wherein The specifying unit specifies the state of the character included in the image based on at least one of character separation, character size, and character positional relationship with respect to each character included in the image.
The image display device according to claim 1, wherein the image display device is an image display device. The specifying means further specifies a deformation amount for each character included in the image,
The display control unit corrects the image based on the deformation amount of the character specified by the specifying unit.
The image display device according to any one of claims 1 to 3, wherein It further comprises imaging means for imaging an object including the characters,
The specifying unit specifies an image captured by the imaging unit as an image including the character and the state of the character;
The image display device according to claim 1, wherein the image display device is an image display device. The display control means controls the enlarged display based on the amount of the designated character regardless of the distance from the imaging means to the object.
The image display device according to claim 5. Obtaining means for obtaining a distance from the imaging means to the object;
Storage means for dividing the distance from the imaging means to the object into a plurality of stages, and storing the amount of characters in association with the plurality of stages;
With
The display control means controls the enlarged display with the amount of characters stored in the storage means corresponding to the distance acquired by the acquisition means as the specified character amount.
The image display device according to claim 5. Obtaining means for obtaining an angle of view designated by a zoom function included in the imaging means;
Storage means for dividing the angle of view into a plurality of stages and storing the amount of characters in association with the plurality of stages;
With
The display control means controls the enlargement display with the amount of characters stored in the storage means corresponding to the angle of view acquired by the acquisition means as the specified character amount. ,
The image display device according to claim 5. Further comprising designation means for arbitrarily designating the amount of characters when displaying the image on the display means by a user operation;
The display control means controls the enlarged display based on the amount of characters specified by the specifying means and the state of the characters specified by the specifying means.
The image display device according to claim 1, wherein the image display device is an image display device. The designation means designates at least one of the number of digits of characters and the number of lines of characters when displayed on the display means as the amount of characters.
The image display device according to claim 9. The display control means is configured to adjust the size of the display area of the display means so that the display of the characters included in the image is not cut halfway. Correct at least one of them,
The image display device according to claim 10. In an image display device for enlarging and displaying an image of an object imaged by an imaging means on a display means,
Correction control means for sequentially controlling the amount of correction of the image picked up by the image pickup means based on the positional relationship that sequentially changes with respect to the object by the movement of the image display device;
Display control means for performing control for sequentially correcting the images picked up by the image pickup means based on the correction amount sequentially controlled by the correction control means and sequentially displaying the images on the display means;
An image display device comprising: A detector for detecting an angle of the imaging unit in the optical axis direction with respect to the object;
The correction control means sequentially controls the correction amount based on the angle detected by the detection means.
The image display device according to claim 12, which is configured as described above. A detection unit for detecting a distance from the imaging unit to the object;
The correction control means sequentially controls the correction amount based on the distance detected by the detection means.
14. The image display device according to claim 12, wherein the image display device is configured as described above. The object includes characters,
The control means sequentially controls the correction amount based on the distance detected by the detection means and the amount of designated characters.
The image display device according to claim 14, which is configured as described above. An image display method in an image display device for enlarging and displaying an image including characters on a display means,
Processing for specifying the state of characters included in the image;
Processing for enlarging and displaying the image on the display unit based on the amount of the designated character and the state of the specified character when the image is displayed on the display unit;
An image display method comprising: For a computer of an image display device that enlarges and displays an image including characters on a display means,
A function for specifying the state of characters included in the image;
A function of performing control for enlarging and displaying the image on the display unit based on the amount of the designated character and the state of the specified character when the image is displayed on the display unit;
A program to realize An image display method in an image display device for enlarging and displaying an image of an object imaged by an imaging means on a display means,
A process of sequentially controlling an amount of correcting an image captured by the imaging unit based on a positional relationship that sequentially changes with respect to the object by the movement of the image display device;
Processing for sequentially correcting the images picked up by the image pickup means based on the sequentially controlled correction amount and sequentially displaying the images on the display means;
An image display method comprising: For the computer of the image display device that enlarges and displays the image of the object imaged by the imaging means on the display means,
A function of sequentially controlling an amount of correcting an image captured by the imaging unit based on a positional relationship that sequentially changes with respect to the object by movement of the image display device;
A function of sequentially correcting the images picked up by the image pickup means based on the amount of correction to be sequentially controlled and sequentially displaying the images on the display means;
A program to realize

Images