JP2004064535A - Camera module, portable terminal, photographing method and its program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a camera module capable of performing photographing while viewing a display picture on which an image to be photographed is displayed, a portable terminal, a photographing method and its program. <P>SOLUTION: A camera module (11) installed in a portable terminal (10) wherein a lens of the camera is formed as a fish-eye lens (12) is provided with an image converting means (26) for converting an image obtained from the fish-eye lens (12) and a trimming means (26) for trimming the converted image. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a camera module, a portable terminal, a photographing method and a photographing program in the camera module or the portable terminal.
[0002]
[Prior art]
2. Description of the Related Art Mobile phones provided with a camera have become widespread. This camera-equipped mobile phone can not only be used as a mobile phone that one usually carries, but also can immediately transmit a captured image or the like using electronic mail.
[0003]
[Problems to be solved by the invention]
However, it may not be possible to shoot while looking at the display screen on which the image to be shot is displayed. For example, in a case where the display screen and the camera are provided on opposite sides, if the camera is turned to oneself in order to take a picture of himself / herself, the display screen is on the opposite side and the user cannot look at the display screen to take a picture. In addition, even when the display screen and the camera are provided on the same side, when shooting a background, it is not possible to shoot while viewing the display screen.
[0004]
In view of such problems, an object of the present invention is to provide a camera module, a mobile terminal, a shooting method, and a shooting program that enable shooting while viewing a display screen on which an image to be shot is displayed. .
[0005]
[Means for Solving the Problems]
The invention according to claim 1 is characterized in that, in the camera module (11) provided in the portable terminal (10), the lens of the camera is a fisheye lens (12).
[0006]
According to the first aspect, it is possible to provide a camera module that enables photographing while viewing an image to be photographed on a display screen of a mobile terminal provided with the camera module.
[0007]
According to a second aspect of the invention, there is provided an image conversion unit (26) for converting an image obtained from the fisheye lens (12), and a trimming unit (26) for performing a trimming process on the converted image. Features.
[0008]
According to the second aspect, it is possible to provide a camera module that can convert a captured image into, for example, an image captured by a standard lens and trim the image.
[0009]
According to a third aspect of the present invention, in the portable terminal (10) provided with the camera module (11), a lens of the camera is a fisheye lens (12).
[0010]
According to the third aspect, it is possible to provide a mobile terminal capable of shooting while viewing a display screen on which an image to be shot is displayed.
[0011]
The invention according to claim 4, wherein the image conversion means (26, 30) for converting an image obtained from the fisheye lens (12), and a range determination means for determining a range of trimming performed on the converted image. (16), trimming means (26, 30) for trimming based on the determined range, and display means (14) for displaying a trimmed image.
[0012]
According to the fourth aspect, there is provided a portable terminal capable of converting a photographed image, for example, into an image photographed with a standard lens, determining a range for trimming the image, and displaying the trimmed image. be able to.
[0013]
The invention according to claim 5 is a photographing method in the camera module (11), wherein an image obtaining step (S101) for obtaining an image from the fisheye lens (12) and an image converting step for converting an image obtained from the fisheye lens. (S102) and a trimming step (S103) of performing a trimming process on the converted image.
[0014]
According to the fifth aspect, it is possible to take a picture while viewing the picture to be taken on the display screen of the portable terminal connected to the camera module, and convert the taken picture to an image taken with a standard lens, for example. In addition, it is possible to provide a photographing method in a camera module that enables trimming of the image.
[0015]
The invention according to claim 6 is a photographing method for a portable terminal (10) provided with a camera module (11), wherein an image acquiring step (S101) of acquiring an image from a fisheye lens (12) and the fisheye lens ( 12) an image conversion step (S102) for converting the image obtained from step S12, a range determination step (S103) for determining a range of trimming performed on the converted image, and trimming based on the determined range. And a display step (S105) of displaying the trimmed image.
[0016]
According to the sixth aspect, it is possible to shoot while watching the display screen on which the image to be shot is displayed, and convert the shot image to an image shot with, for example, a standard lens, and trim the image. It is possible to provide a shooting method in a portable terminal capable of determining a range and displaying the trimmed image.
[0017]
According to a seventh aspect of the present invention, there is provided an imaging program for causing a computer to execute the imaging method according to the fifth or sixth aspect.
[0018]
According to the seventh aspect, it is possible to provide a program capable of realizing the imaging method according to the fifth or sixth aspect by a computer.
[0019]
Note that the reference numerals are only examples, and the present invention is not limited to these reference numerals.
[0020]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to the drawings.
[0021]
A mobile terminal according to an embodiment of the present invention will be described with reference to FIG. The mobile terminal 10 shown in FIG. 1 has a fisheye lens 12, a display screen 14, a cross key 16, and an antenna 18.
[0022]
The display screen 14 displays an image captured by the fisheye lens 12, information necessary for using the mobile terminal 10, and the like. The cross key 16 is for trimming an image displayed on the display screen 14. The antenna 18 transmits and receives radio waves.
[0023]
Next, the fisheye lens 12 will be described with reference to FIG. The fisheye lens 12 is provided in a lens barrel 20, as shown in FIG. The lens barrel 20 is provided with a CCD 22 so as to receive light from the fisheye lens 12. Note that the CCD sensor 22 may be a CMOS sensor.
[0024]
FIG. 3 shows a block diagram of the portable terminal 10. As shown in FIG. 3, the portable terminal 10 includes a fisheye lens 12, a CCD sensor 22, a CCD control unit 24, an image processing unit 26, a RAM (Random Access Memory) 32, and a CPU (Central Processing Unit) 30. , A ROM (Read Only Memory) 28, a wireless unit 34, an antenna 18, a display screen 14, a cross key 16, a keypad 38, and an audio processing unit 40.
[0025]
Among them, the CCD control unit 24 controls the CCD sensor 22, and the image processing unit 26 performs processes such as interpolation and trimming described later on the image obtained from the CCD control unit 24. The CPU 30 controls the entire mobile terminal 10. Programs and data for performing the processing are stored in the ROM 28. The RAM 32 is used as an area where programs are developed when the CPU 30 executes processing, and as a work area. The wireless unit 34 transmits and receives radio waves using the antenna 18. The keypad 38 is used for inputting a telephone number and the like. The audio processing unit 40 processes audio input and output from a microphone and a speaker (not shown).
[0026]
In the above configuration, the fisheye lens 12, the CCD sensor 22, the CCD control unit 24, and the image processing unit 26 are the camera module 11, but the camera module is not limited to this example. There is another configuration example in which the CPU 30 performs the above processing and the camera module 11 is composed of the fisheye lens 12 and the CCD sensor 22 as shown in FIG.
[0027]
The configuration of the mobile terminal 10 according to the present embodiment has been described above. Next, actual shooting using the fisheye lens 12 will be described.
[0028]
First, as shown in FIG. 4, a state when the subject 42a is photographed by the fisheye lens 12 of the mobile phone 10 in a direction indicated by an arrow will be described with reference to FIG. As shown in FIG. 5, when the rectangular subject 42a shown in FIG. 4 is photographed by the fisheye lens 12, an image like an image 42b is obtained. As shown in this image 42b, it can be seen that the resolution of the subject existing in the horizontal direction of the fisheye lens 12 is the highest. Actually, the resolution of the fisheye lens will be described with reference to FIG. 6. The circumference of the cross section of the fisheye lens 12 shown in FIG. In this case, 2πr, and the circumferential length of the cross section in the case of the elevation angle θ is 2πrcosθ. Therefore, the resolution in the case of the elevation angle θ is cos θ times the resolution in the horizontal case, and the resolution in the horizontal case where θ is 0 is the highest.
[0029]
A method of converting an image composed of portions having different resolutions into an image as if photographed with a standard lens will be described with reference to FIG.
[0030]
FIG. 7 converts an image composed of pixels A, B, and C in a high-resolution part and pixels D and E in a low-resolution part like an image captured by a standard lens. It is a figure showing the situation.
[0031]
As shown in FIG. 7, when trying to convert the pixels A, B, C, D, and E into an image taken with a standard lens, the portion of the pixel F between the pixels D and E with low resolution is missing. Therefore, by performing an interpolation process between the pixels D and E, the portion of the pixel F is supplemented, and the image is converted into an image captured by a standard lens. As this interpolation processing, for example, the average of the adjacent pixels D and E may be obtained and supplemented, or may be supplemented by other interpolation processing.
[0032]
Contrary to this interpolation processing, the pixel B may be used as a surplus pixel, the pixel B may be thinned out, and an image composed of the pixels A, C, D and E may be used as the converted image. The pixels in this case are based on the pixels D and E.
[0033]
Whether the interpolation processing or the thinning-out is performed on a certain portion as described above may be determined in advance based on the number of pixels to be provided, and may be determined based on the number of pixels. For example, when it is determined that the number of pixels to provide a pixel on a cross section when θ in FIG. 6 is 30 degrees, the process of converting to a standard image is performed by thinning out pixels in a portion where θ is 30 degrees or less, and θ is 30 degrees. The larger portion is a process for performing an interpolation process.
[0034]
This makes it possible to convert an image taken with a fisheye lens like an image taken with a standard lens.
[0035]
Next, a trimming process performed on the converted image will be described with reference to FIG. This trimming process is a process of cutting out only necessary portions from a wide range of images obtained by a fisheye lens.
[0036]
The cross key 16 is used to determine the range from which the image is cut out, as shown in FIG. When the cross key 16 is moved up, down, left and right, the scope 44 indicating the range also moves on the image 46 in conjunction with the movement. Further, since the image 46 usually does not fit on the display screen 14 of the mobile terminal 10, the image 46 displayed on the display screen 14 scrolls in accordance with the movement of the scope 44.
[0037]
Further, the size of the scope 44 may be changeable. In this case, for example, the size of the scope 44 can be set to the entire display screen.
[0038]
After the range is determined using the cross key 16 in this manner, a trimming process is performed, and an image of the selected range can be displayed. What moves the scope 44 is not necessarily the cross key 16, and for example, a jog shuttle switch or the like may be used.
[0039]
A series of processes described above will be described with reference to the flowchart of FIG. First, in step S101, the mobile terminal 10 acquires an image by shooting. Next, in step S102, the mobile terminal 10 performs an interpolation process or a thinning-out on the image obtained by shooting to convert the image into an image as if shot with a standard lens. In order to trim the image, in step S103, the mobile terminal 10 determines a range to be trimmed. When step S103 is executed for the first time, a predetermined range is determined.
[0040]
Next, the mobile terminal 10 performs trimming in step S104 based on the range determined in step S103. Then, in step S105, the mobile terminal 10 displays the trimmed image. This display is to display at least the trimmed image, and does not necessarily display only the trimmed image.
[0041]
When there is an input from the cross key 16, the portable terminal 10 proceeds from step S <b> 106 to step S <b> 103, and determines a trimming range based on the input direction of the cross key 16. If there is no input on the cross key 16, the process of step S106 is performed again. This means that a state is entered in which a cross key input wait state is set.
[0042]
Note that the flowchart showing the processing in the camera module 11 includes steps S101 to S104 except for steps S105 and S106 in the flowchart of FIG. The flowchart of FIG.
[0043]
By doing so, it becomes possible to realize a camera module or a mobile terminal using a fisheye lens. Further, it can be understood from the above embodiment that the present invention can be applied not only to a still image but also to a moving image.
[0044]
The mobile terminal is not limited to a mobile phone as in the above embodiment, but may be a PDA (Personal Digital Assistant) or a small camera provided in a computer.
[0045]
【The invention's effect】
As described above, it is possible to obtain a camera module, a mobile terminal, a shooting method, and a shooting program that enable shooting while viewing a display screen on which an image to be shot is displayed.
[Brief description of the drawings]
FIG. 1 is a diagram showing a portable terminal.
FIG. 2 is a diagram showing a lens barrel provided with a fisheye lens and a CCD sensor.
FIG. 3 is a block diagram of a portable terminal.
FIG. 4 is a diagram showing an image photographed with a fisheye lens.
FIG. 5 is a diagram showing a fisheye lens and a subject.
FIG. 6 is a diagram illustrating the resolution of a fisheye lens.
FIG. 7 is a diagram illustrating pixels of an image to be converted.
FIG. 8 is a diagram showing how a trimming range is determined.
FIG. 9 is a flowchart illustrating processing of a mobile terminal and a camera module.
[Explanation of symbols]
Reference Signs List 10 mobile terminal 11 camera module 12 fisheye lens 14 display screen 16 cross key 18 antenna 20 lens barrel 22 CCD sensor 24 CCD control unit 26 image processing unit 28 ROM
30 ... CPU
32 ... RAM
34 radio section 38 keypad 40 audio processing section 42a subject 42b 46 image 44 scope

Claims (7)

In a camera module provided in a mobile terminal,
A camera module, wherein the lens of the camera is a fisheye lens. The camera module according to claim 1,
Image conversion means for converting an image obtained from the fisheye lens,
Trimming means for performing a trimming process on the converted image,
A camera module comprising: In a mobile terminal provided with a camera module,
A portable terminal, wherein the lens of the camera is a fisheye lens. The mobile terminal according to claim 3,
Image conversion means for converting an image obtained from the fisheye lens,
Range determining means for determining a range of trimming performed on the converted image,
Trimming means for performing trimming based on the determined range,
Display means for displaying the cropped image;
A mobile terminal comprising: A shooting method in a camera module,
An image acquisition step of obtaining an image from a fisheye lens;
An image conversion step of converting an image obtained from the fisheye lens,
A trimming step of performing a trimming process on the converted image;
An imaging method, comprising: A shooting method in a mobile terminal provided with a camera module,
An image acquisition step of obtaining an image from a fisheye lens;
An image conversion step of converting an image obtained from the fisheye lens,
A range determining step of determining a range of trimming performed on the converted image;
A trimming step of performing trimming based on the determined range,
A display step of displaying the cropped image;
An imaging method, comprising: An imaging program for causing a computer to execute the imaging method according to claim 5.

Images