JP2009021724A - Portable terminal device and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To always display characters in the same size without performing special operation in the case of displaying a photographed image obtained by photographing characters. <P>SOLUTION: If characters in a photographed image are not ones in a loupe character size LCS as a result of determining whether the characters are ones in the loupe character size LCS when a loupe mode for making a photographing display function (electronic loupe function) for displaying a photographed image from a photographing part 8 operable is selected, a CPU 1 changes photographing magnification of the photographing part 8 so as to display the characters in the photographed image in the loupe character size LCS, and displays the photographed image that has been photographed with the photographing magnification. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a portable terminal device and a program having a photographing display function for displaying a photographed image photographed by photographing means.

Conventionally, as a portable terminal device having a camera function, a portable terminal device that can utilize this camera function as an electronic loupe (magnifying glass) is known in the case of a camera function capable of close-up photography. For example, a technique is known in which image data captured by a camera function is enlarged and displayed as it is (see Patent Document 1).
JP 2002-374450 A

   However, in the above-described prior art, the image data captured by the camera function is enlarged and reduced by operating the enlargement button and the reduction button, and is displayed in a desired size. However, it is necessary to operate the enlarge button and the reduce button each time, which places a heavy burden on the user and cannot always display the image data in the same size every time.

  An object of the present invention is to display character data always at the same size without performing a special operation when displaying a photographed image of characters.

The invention according to claim 1 is a portable terminal device having a photographing display function for displaying a photographed image photographed by the photographing means, and is photographed by the photographing means when the photographing display function is selected. Determining means for determining whether or not the characters in the photographed image have a predetermined character size, and when the determining means determines that the characters are not the predetermined size, the characters in the photographed image are displayed in the predetermined character size In this way, a determination unit for determining a shooting magnification of the shooting unit is provided, and a photographed image shot at a shooting magnification determined by the determination unit is displayed.
Furthermore, a program for realizing the main functions shown in the invention described in claim 1 is provided to the computer (the invention described in claim 8).

The invention described in the above claims may be as follows.
Prior to determining whether or not the character size is a predetermined character size, the determining means determines whether or not a character is included in the photographed image, and the determining means is that the character is included in the photographed image. When it is determined, the shooting magnification of the shooting means is determined so as to be displayed with the predetermined character size, and when it is determined that no character is included in the shot image, the predetermined shooting magnification is determined. Is determined (invention of claim 2).

  Recognizing means for recognizing whether or not the content of the photographed image has changed by analyzing the photographed image is further provided, and when the recognizing means recognizes that the content of the photographed image has been changed by the recognition means. Then, it is determined whether or not characters are included in the photographed image (the invention according to claim 3).

  When the photographing display function is selected and the photographing magnification of the photographing means is arbitrarily changed, the character size of characters included in the photographed image photographed at the photographing magnification after the change is changed. Recognizing means for recognizing is further provided, and the character size recognized by the recognizing means is stored as the predetermined character size.

  According to a fourth aspect of the present invention, the character size recognized by the recognition unit may be updated and stored as the predetermined character size each time the photographing magnification of the photographing unit is changed. Invention).

  When the character size of the information displayed by the information display function is changed in addition to the photographing display function, the changed character size is stored as the predetermined character size ( Invention of Claim 6).

 A portable terminal device having a photographing display function for displaying a photographed image photographed by the photographing means in addition to a photographing recording function for recording a photographed image photographed by the photographing means, and determines whether or not a specific state is present 8. A determination means, and a selection means for selecting the photographing display function if the result of determination by the determination means is in a specific state, and selecting the photographing recording function if not in the specific state. Invention).

  The present invention is capable of displaying character data in the same size at all times without displaying any special operation when displaying a photographed image of characters. It becomes.

Hereinafter, embodiments of the present invention will be described with reference to FIGS.
This embodiment exemplifies a case where the present invention is applied to a mobile phone device as a mobile terminal device, and FIG. 1 is a block diagram showing basic components of the mobile phone device.
This cellular phone device is, for example, a foldable one in which two casings (an operation unit casing and a display unit casing) are attached so as to be openable and closable, and includes a call function, an e-mail function, an Internet connection function (Web access function) ) And the like, a shooting recording function (camera function) for recording a photographed image taken by the camera, and a photographing display function (electronic loupe function) for displaying the photographed image taken by the camera as they are.

  The CPU 1 is a core central processing unit that controls the overall operation of the mobile phone device in accordance with various programs in the storage unit 2. A program area of the storage unit 2 stores a program for realizing the present embodiment in accordance with an operation procedure shown in FIGS. 5 and 6 described later, and a mail character size MCS described later is stored in the data area. The loupe character size LCS is stored. The memory 3 is an internal memory having a work area, for example. The radio communication transmitting / receiving unit 4 takes in a signal from the receiving side of the transmitting / receiving unit (baseband unit) connected to the antenna and demodulates the signal to a received baseband signal, and then outputs the audio from the reception speaker SP via the audio signal processing unit 5. Let Further, the wireless communication transmitting / receiving unit 4 takes in the audio data input from the transmission microphone MC from the audio signal processing unit 5 and encodes it into a transmission baseband signal, which is then given to the transmitting side of the transmitting / receiving unit and transmitted from the antenna. Output.

  On the other hand, during the operation of the electronic mail function and the Internet connection function, display data received and acquired via the wireless communication transmitting / receiving unit 4 is given to and displayed on the display unit 6 using a high-definition liquid crystal, organic EL, or the like. The operation unit 7 performs dial input, character input, command input, and the like. The operation unit 7 is provided with a camera key for instructing activation of the imaging unit 8 and a shutter button for instructing start of imaging. The process according to the input signal from is performed. The photographing unit 8 can control optical zoom driving, autofocus driving, shutter driving, adjust exposure, white balance, and the like, and can also take short-distance shooting (shooting with a shooting lens close to the subject) Close-up photography is possible.

  The camera orientation detection unit 9 has, for example, a configuration having a gyro sensor that detects a rotational angular velocity, and detects the orientation of the apparatus body, that is, whether or not the photographing lens of the camera is facing downward. When the unit 8 is activated, the operation mode is switched according to the detection result of the camera direction detection unit 9 and the distance to the subject (close-up shooting). That is, the CPU 11 switches between an operation mode (camera mode) in which the shooting / recording function (camera function) is operable and an operation mode (loupe mode) in which the shooting display function (loupe function) is operable. Like to do. The distance sensor 10 automatically measures the distance from the lens position to the subject as in the normal autofocus function, and this measured distance is converted into a digital value and given to the CPU 1.

FIG. 2 is a diagram illustrating a detailed configuration of the imaging unit 8.
A subject image from the photographic lens system 11 is formed on an image sensor 13 such as a CCD through a diaphragm mechanism 12. The optical system drive unit 14 controls the position of the moving lens in the photographic lens system 11 to perform focusing, adjusts the exposure by changing the aperture amount of the aperture mechanism 12, and adjusts the photographic magnification. Therefore, the CPU 1 controls the operation of the optical system driving unit 14 based on the output from the sensor unit 15 including a distance measuring sensor, a light amount sensor, and the like. The drive circuit 16 sequentially takes out the charge corresponding to each pixel photoelectrically converted by the image sensor 13 as an image signal, and gives it to the analog processing circuit 17.

  The analog processing circuit 17 performs color separation, gain adjustment, white balance and the like on the input image signal, and the image data digitally converted by the A / D conversion circuit 18 is temporarily stored in the buffer register 19. . The signal processing circuit 20 is a processing circuit that converts and outputs image data into a luminance signal and a color difference signal, and the compression / decompression circuit 31 performs compression processing of the image data when recording and storing the image data in response to a shutter operation. It is a processing circuit. Here, in the camera mode, the image data compressed by the compression / decompression circuit 31 is given to the recording unit 2 or a recording medium (not shown) to be recorded and stored. However, in the above-described loupe mode, the image data is processed by the signal processing circuit 20. The obtained image data is given to the display unit 6 and is displayed through (displayed as it is).

3 and 4 are display examples when a subject (printed material) is photographed by short-distance photographing (close-up photographing) in the loupe mode.
The CPU 1 determines whether or not characters are included in the photographed image (printed material) photographed in close proximity by the photographing unit 8 in the state in which it is switched to the loupe mode, and if characters are included, it is stored in advance. The loupe character size LCS is read from the storage unit 2, and it is determined whether or not the characters in the captured image substantially match the loupe character size LCS. That is, the term “substantially coincides” means that both character sizes are so approximate that they cannot be identified visually. The CPU 1 is not limited to the case where both character sizes completely coincide with each other. Also perform discrimination

  The loupe character size LCS is a character size for always displaying the characters in the same size in the loupe mode, and can be arbitrarily set in advance by a user operation, and the above-mentioned mail character size MCS is set as the loupe character size LCS. If the character size does not match the loupe character size LCS, the CPU 1 adjusts the optical zoom of the photographing unit 8 so that the character data is displayed with the loupe character size LCS, and the photographing magnification is increased. At the same time, the captured image captured at this magnification is displayed on the display unit 6. Note that the above-described mail character size MCS is a character size for displaying the contents of an electronic mail, and is arbitrarily set in advance by a user operation.

  FIG. 3 exemplifies the case where the distance between the portable terminal device (photographing lens) and the printed material is different even for the same printed material. FIG. 3 shows the distance L1 to the subject shown in FIG. Even if the distance L2 to the subject shown in 2) is closer, the characters in the display unit 6 are always displayed in the same size by changing the shooting magnification. FIG. 4 shows a case where the content of the printed matter is different even when the distance between the portable terminal device (photographing lens) and the printed matter is the same, that is, a case where the size of characters in the printed matter is different. Even if the size of the printed character shown in FIG. 4 (2) is smaller than the size of the printed character shown in (1), each character in the display unit 6 is always the same size by changing the shooting magnification. It is displayed.

  Next, the operation concept of the mobile phone device in this embodiment will be described with reference to the flowcharts shown in FIGS. Here, each function described in these flowcharts is stored in the form of a readable program code, and operations according to the program code are sequentially executed. In addition, the operation according to the above-described program code transmitted via the transmission medium can be sequentially executed. In other words, in addition to the recording medium, an operation peculiar to this embodiment can be executed by using a program / data supplied externally via a transmission medium.

FIG. 5 and FIG. 6 are flowcharts showing the overall operation of the mobile phone device that starts executing when the power is turned on.
First, the CPU 1 activates the wireless communication transmitting / receiving unit 4 and performs a standby process for reading and displaying a predetermined standby image (step S1). In this standby state, when the CPU 1 detects an incoming mail at the wireless communication transmitting / receiving unit 4 (YES in step S2), the CPU 1 reads the mail character size MCS from the storage unit 2, and the contents of this incoming mail are the same as the mail character size MCS. It is displayed (step S3). Then, in response to a user operation or the like, other processes such as mail saving, mail erasure, reply mail creation, etc. are executed (step S4), and the above standby state is returned (step S1).

 If any operation is performed in the standby state (YES in step S5), whether or not the camera key for instructing activation of the photographing unit 8 has been operated (step S6), or an e-mail setting operation for instructing various settings regarding e-mail. It is checked whether it has been performed (step S17). If another operation is performed (NO in step S17), for example, a transmission process, a mail creation process, etc. are executed as a process corresponding to the operation (step S23). ). If a mail setting operation has been performed (YES in step S17), it is checked whether an operation for instructing the setting of the character size for displaying the mail content has been performed (step S18).

 If mail setting other than the character size setting is instructed (NO in step S18), a setting process corresponding to the instruction is executed (step S22), but if it is a character size setting instruction (in step S18). YES) When an arbitrary character size is selected and designated by user operation from various character sizes (selection candidates) prepared in advance for mail display (step S19), this character size is set as the mail character size MCS. Besides being stored (step S20), it is also stored as a loupe character size LCS (step S21). As a result, the mail character size MCS and the loupe character size LCS have the same value.

 When the camera key is operated in the standby state (YES in step S6), the imaging unit 8 is activated accordingly (step S7), and then the camera direction detection unit 9 is driven to acquire the detection result. Then, it is checked whether the objective lens (camera lens) constituting the photographing lens system 11 is facing downward (step S8). Here, if the camera lens is facing downward to photograph a printed matter (YES in step S8), the distance sensor 10 is driven to obtain a measurement distance to a subject such as a printed matter, and this measurement distance is 20 cm. Whether it is the following or not, that is, close-up shooting (close-up shooting) is checked (step S9).

 Here, if the camera lens is not downward (NO in step S8) or if the distance to the subject exceeds 20 cm even if it is downward (NO in step S9), the camera function is operable. Move on to the shooting and recording process under camera mode. In other words, after displaying the photographed image from the photographing unit 8 as a finder image (step S10), the operation wait state is entered (step S11). Here, when a change operation instructing to change the shooting magnification is performed (YES in step S12), the process of changing the shooting magnification of the shooting unit 8 by controlling the optical system driving unit 14 of the shooting unit 8 (zoom in / out). Zoom out processing) is performed (step S13). When the shutter button is operated (YES in step S14), a process of recording and saving a photographed image from the photographing unit 8 is performed (step S15). If an operation for instructing the end of shooting is performed (YES in step S16), the camera mode is canceled and the standby state is returned (step S1).

 On the other hand, when it is determined that the camera lens is facing downward based on the detection result of the camera direction detection unit 9 (YES in step S8) and the distance to the subject is determined to be 20 cm or less (YES in step S9). ), The process proceeds to the flow of FIG. 6, and the process proceeds to the loupe process under the loupe mode in which the electronic loupe function is operable. That is, after the photographed image from the photographing unit 8 is displayed as it is (through display) (step S24), it is examined whether or not characters are included in the photographed image by analyzing the photographed image (step S25). If the photographed image contains characters, the character size is recognized (step S26), and the character size is compared with the loupe character size LCS (step S27).

 As a result, if the character size in the photographed image is smaller than the loupe character size LCS (YES in step S28), the optical system of the photographing unit 8 is driven so that the characters in the photographed image are displayed in the loupe character size LCS. A zoom-in process is performed to increase (up) the imaging magnification of the imaging unit 8 by controlling the unit 14 (step S29). If the size of the character data in the captured image is larger than the loupe character size LCS (step S29). Zoom in which the photographing magnification of the photographing unit 8 is lowered (down) by controlling the optical system driving unit 14 of the photographing unit 8 so that the character data in the photographed image is displayed with the loupe character size LCS. Out processing is executed (step S31). If the character data in the photographed image is completely or substantially coincident with the loupe character size LCS by changing the photographing magnification of the photographing unit 8 in this way (NO in step S30), the photograph taken at the photographing magnification after the change. The image is displayed through (step S32). It should be noted that the degree of matching between the characters in the photographed image and the loupe character size LCS may be as long as there is no apparent difference.

 As described above, in the state where the character data in the photographed image is displayed in a predetermined size, whether the photographing object has changed by sequentially analyzing the photographed image from the photographing unit 8, that is, the content of the photographed image has changed. (Step S33), and if the photographic image changes because the subject changes or the distance to the subject changes, the process returns to step S5 to determine whether or not the characters in the photographic image are included. Then, according to the determination result, the above-described operation is repeated. However, if there is no change in the content of the captured image (NO in step S33), the presence / absence of an operation is checked (step S34).

 Here, when a change operation for instructing to change the shooting magnification is performed in the loupe mode (YES in step S35), the process of changing the shooting magnification of the shooting unit 8 by controlling the optical system driving unit 14 of the shooting unit 8 is performed. After performing (zoom-in / zoom-out processing) (step S36), the character size is recognized in the photographed image photographed at the photographing magnification after the change (step S37), and this character size is stored as the loupe character size LCS. Then, the value is updated (step S38). When an operation for instructing the end of shooting is performed (YES in step S39), the loupe mode is canceled and the above standby state is restored (step S1 in FIG. 5).

 If no character is included in the photographic image in the loupe mode (NO in step S5), the magnifying magnification for the loupe is changed to “3 times” (step S40), and the presence / absence of the operation is determined. While examining (step S41), the photographed image photographed at the photographing magnification “3 times” after the change is displayed through (step S45). In this state, when a change operation for instructing to change the shooting magnification is performed (YES in step S42), a process of changing the shooting magnification of the shooting unit 8 by controlling the optical system driving unit 14 of the shooting unit 8 (zoom-in). (Zoom-out process) is performed (step S43), and if an operation for instructing the end of shooting is performed (YES in step S44), the loupe mode is canceled to return to the standby state described above (step S1 in FIG. 5). ).

 As described above, in this embodiment, when the loupe mode in which the photographing display function (electronic loupe function) for displaying a photographed image from the photographing unit 8 is selected, the CPU 1 selects characters in the photographed image. Is determined to be a loupe character size LCS, and if it is not the loupe character size LCS, the shooting magnification of the shooting unit 8 is changed so that the characters in the shot image are displayed with the loupe character size LCS. Since the captured image is displayed, the character data can always be displayed in the same size without any special operation when displaying the captured image of characters. And the practical effect is high.

  The CPU 1 determines whether or not characters are included in the captured image before determining whether or not the characters in the captured image are the loupe character size LCS, and if the characters are included in the captured image. The shooting magnification of the shooting unit 8 is changed so that characters in the shot image are displayed with the loupe character size LCS. If no characters are included in the shot image, the shooting magnification for the loupe is determined in advance. Therefore, even when no character is included in the photographed image, display at the same magnification is always possible.

  Since the CPU 1 determines whether or not characters are included in the captured image when the content of the captured image changes, the subject changes or the distance from the subject changes. Each time the character changes, the character size can be changed following the change.

  When the shooting magnification of the shooting unit 8 is arbitrarily changed in the loupe mode, the size of the character included in the photographed image taken at the changed shooting magnification is recognized, and this character size is determined as the loupe character size. Since it is stored as LCS, the loupe character size LCS can be arbitrarily set by a user operation. In this case, since the loupe character size LCS is updated every time the shooting magnification is changed, the shooting magnification and the loupe character size LCS can be linked.

  When an arbitrary character size is selected and designated by the user operation from various character sizes prepared for mail display, this character size is stored as the mail character size MCS and also as the loupe character size LCS. Therefore, the loupe character size LCS can be matched with the mail character size MCS.

  When the camera lens is not facing downward or is facing downward, if the distance to the subject exceeds 20 cm, the camera mode is entered, but when the camera lens is facing downward and the distance to the subject is 20 cm or less. Since the mode is shifted to the loupe mode, the camera mode and the loupe mode can be switched without performing the mode switching operation.

  In the above-described embodiment, the camera orientation detection unit 9 is provided to switch between the camera mode and the loupe mode by determining whether the camera lens is facing downward. Even when close-up shooting (close-up shooting) is detected, switching to the loupe mode may be performed.

  Further, as a condition for switching to the loupe mode, the distance to the subject is 20 cm or less, but the numerical value may be arbitrarily changed by a user operation. In addition, although the close-up shooting is set as the condition for switching to the loupe mode, it may be possible to switch to the loupe mode even when zooming in on a distant signboard, etc., provided that characters are included in the captured image. You may make it switch to loupe mode.

  In the above-described embodiment, the loupe character size LCS is updated when the photographing magnification of the photographing unit 8 is arbitrarily changed in the loupe mode or when the mail character size MCS is changed. The loupe character size LCS displayed during the loupe mode may be stored, and the previous loupe character size LCS may be read out and used as the current display size during the current loupe mode.

In the above-described embodiment, the imaging magnification of the imaging unit 8 is changed by controlling the optical system driving unit 14 of the imaging unit 8. However, the present invention is not limited to changing the imaging magnification of the optical zoom. It may be a case where the photographing magnification of the digital zoom is changed by image processing.
In addition, the present invention is not limited to a mobile phone device, and can be similarly applied to a mobile terminal device such as a PDA, a portable personal computer (PC), an electronic camera, an electronic wristwatch, or a music player.

The block diagram which showed the basic component of the mobile telephone apparatus applied as a portable terminal device. FIG. 3 is a diagram illustrating a detailed configuration of the imaging unit 8. This is a display example when shooting a subject (printed material) by close-up shooting (close-up shooting) in the loupe mode. Even if the distance from the mobile terminal device (shooting lens) to the subject is different, characters are always displayed in the same size. The figure shown. FIG. 6 is a display example when a subject (printed material) is photographed by close-up photography (close-up photography) in the loupe mode, and shows that characters are always displayed in the same size even if the sizes of the printed characters are different. The flowchart which showed the outline | summary of the whole operation | movement of the mobile telephone apparatus started execution with power activation. The flowchart following FIG.

Explanation of symbols

1 CPU
2 Storage Unit 4 Wireless Communication Transmit / Receive Unit 6 Display Unit 7 Operation Unit 8 Shooting Unit 9 Camera Orientation Detection Unit 10 Distance Sensor MCS Mail Character Size LCS Loupe Character Size

Claims (8)

A portable terminal device having a photographing display function for displaying a photographed image photographed by photographing means,
A discriminating means for discriminating whether or not a character in a photographed image photographed by the photographing means is a predetermined character size when the photographing display function is selected;
Determining means for determining a photographing magnification of the photographing means so that characters in the photographed image are displayed in the predetermined character size when it is determined that the predetermined size is not determined by the determining means;
A portable terminal device characterized in that a photographed image photographed at a photographing magnification determined by the determining means is displayed. Prior to determining whether the character size is a predetermined character size, the determining means determines whether a character is included in the captured image,
When it is determined that the character is included in the photographed image, the determining unit determines the photographing magnification of the photographing unit so that the character is displayed in the predetermined character size, and the character is included in the photographed image. If it is determined that it is not included, a predetermined shooting magnification is determined.
The portable terminal device according to claim 1, which is configured as described above. Recognizing means for recognizing whether or not the content of the photographed image has changed by analyzing the photographed image;
The determination unit determines whether or not characters are included in the captured image when the recognition unit recognizes that the content of the captured image has changed.
The portable terminal device according to claim 2, which is configured as described above. When the photographing display function is selected and the photographing magnification of the photographing means is arbitrarily changed, the character size of characters included in the photographed image photographed at the photographing magnification after the change is changed. A recognition means for recognizing
Storing the character size recognized by the recognition means as the predetermined character size;
The portable terminal device according to claim 1, which is configured as described above. Each time the photographing magnification of the photographing means is changed, the character size recognized by the recognizing means is updated and stored as the predetermined character size.
The portable terminal device according to claim 4, which is configured as described above. In addition to the shooting display function, it has a predetermined information display function,
When the character size of the information displayed by the information display function is changed, the changed character size is stored as the predetermined character size.
The portable terminal device according to claim 1, which is configured as described above. In addition to a shooting recording function for recording a shot image shot by the shooting means, a portable terminal device having a shooting display function for displaying a shot image shot by the shooting means,
A determination means for determining whether or not a specific state;
If the result of determination by the determination means is in a specific state, the photographing display function is selected; if not, the selection means for selecting the photographing recording function is selected.
The mobile terminal device according to claim 1, further comprising: Against the computer,
A function for determining whether or not characters in a photographed image photographed by the photographing means have a predetermined character size when a photographing display function for displaying a photographed image photographed by the photographing means is selected;
A function for determining a photographing magnification of the photographing means so that characters in the photographed image are displayed in the predetermined character size when it is determined that the predetermined size is not satisfied;
A function of displaying a photographed image photographed at the determined photographing magnification;
A program to realize

Images