JP2004159014A - Digital camera attached mobile communication terminal - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a digital camera attached mobile communication terminal capable of photographing a photographing area with a wide angle close to the visual field of human beings in spite of a comparatively simple configuration. <P>SOLUTION: Three sensors 2 to 4 capable of respectively photographing prescribed photographing areas (field angles) are mounted on a rear part and both side faces of a mobile phone terminal 8. The sensors 3, 4 mounted on the side faces are disposed on both sides of a hinge 9 which are ordinarily a free space. The sensor 2 covers a prescribed photographing area in a direction of the rear face of the mobile phone terminal 8, and the sensors 3, 4 cover a prescribed photographing area partly overlapped on both sides of the photographing area by the sensor 2. A data processing circuit connects image data photographed by the sensors 2 to 4 and a scenery in front of a user photographed by the sensors 2 to 4 is subjected to image processing to have a panorama size and a display section 7 displays the processed image. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a camera-equipped mobile communication terminal having a built-in digital camera, and more particularly to a camera-equipped mobile communication terminal capable of expressing a wide-angle image close to a human field of view.
[0002]
[Prior art]
A digital camera is built into a mobile communication terminal such as a mobile phone to display not only voice calls or text information, but also images such as face photographs and landscapes taken with the built-in digital camera. 2. Description of the Related Art Portable communication terminals that can transmit data using a mail function have become widespread.
[0003]
For example, in Patent Literature 1, a portable communication terminal main body and a flip portion having a monitor screen are rotatably connected by a shaft portion, and a first photographing lens is stored and provided in a longitudinal direction in the shaft portion. By providing a second photographing lens at a location, for example, when used as a videophone, it is possible to photograph one's face and the scenery that one is looking at with two photographing lenses and switch with a switch. This makes it possible to simultaneously display one's own face and the scenery that one is looking at and to convey it to the other party.
[0004]
Further, in Patent Document 2, a camera unit mounting portion is provided in a portable information communication terminal main body, and a video camera unit having a different specification such as a wide-angle video camera or a telephoto video camera is selectively attached to and detached from the camera unit mounting portion. A technique is described in which a camera unit having a different specification can be attached and used depending on the situation by making it possible.
[0005]
[Patent Document 1]
JP 2001-169166 A [Patent Document 2]
JP 2001-245266 A
[Problems to be solved by the invention]
The portable communication terminal with a video camera described in Patent Literature 1 has various functions such as displaying and transmitting a face photographed by two photographing lenses and a scenery seen by the photographer at the same time. However, the data shot by each shooting lens is independent data, and the angle of view (shooting area) that can be shot by each shooting lens is relatively narrow. You must pay attention to the orientation of the lens. Although it is possible to expand the shooting area by the zoom function, there is a limit to that, and there is a problem that an adjustment mechanism for that is required and the configuration becomes complicated.
[0007]
In the portable information communication terminal described in Patent Literature 2, camera units having different specifications can be selectively switched according to the situation, so that shooting corresponding to various situations can be performed. It is necessary to carry a camera unit of a different specification separately, and a camera unit of a different specification must be re-mounted according to the situation, and the operation is complicated.
[0008]
It is an object of the present invention to provide a portable communication terminal with a digital camera that enables photographing of a wide-angle photographing area close to a human field of view with a relatively simple configuration, and that can easily switch the photographing area.
[0009]
[Means for Solving the Problems]
A portable communication terminal with a digital camera according to the present invention comprises: a first sensor disposed on a back portion of the main body of the portable communication terminal and capable of photographing a predetermined photographing area in a rear direction of the main body of the portable communication terminal; A second sensor and a third sensor are provided on the surface and are capable of photographing a predetermined photographing area adjacent to the first sensor so as to partially overlap on both sides of the photographing area.
[0010]
The image data captured by the first to third sensors is corrected and processed by a digital signal processor (DSP) and a central processing unit (CPU), and three images from the first to third sensors are joined. As a result, the image data is output to the display unit as wide-angle panoramic image data close to the human visual field. Therefore, it is possible to simultaneously display the scenery in front of the user as a panoramic image on the display unit.
[0011]
BEST MODE FOR CARRYING OUT THE INVENTION
FIG. 1 is a schematic block diagram showing a first embodiment of a camera image photographing device in a mobile phone terminal with a digital camera according to the present invention, and includes a camera module 1, a CPU 6, and a display unit 7. The CPU 6 and the display unit 7 are also used as a CPU and a display unit included in the mobile phone terminal body, and also perform control and display as a mobile phone other than signal processing and display from the camera module 1.
[0012]
The camera module 1 includes three sensors 2 to 4 capable of photographing predetermined photographing areas, respectively, and a DSP 5 for processing image data input from the sensors 2 to 4. The DSP 5 controls three sensors 2 to 4 and processes image data from these sensors with one DSP in consideration of space saving.
[0013]
The image data processed by the DSP 5 is output to the CPU 6. The CPU 6 is connected to the DSP 5 and the display unit 7, processes an input image from the DSP 5, determines a display method, and outputs the display method to the display unit 7. The display unit 7 is connected to the CPU 6, and displays an input image from the CPU 6.
[0014]
FIG. 2 is an external view schematically showing rear and side views of the mobile phone terminal with a digital camera according to the present embodiment.
[0015]
As shown in FIG. 2, the three sensors 2 to 4 are mounted on the back surface and both side surfaces of the mobile phone terminal 8, respectively. At this time, in order to effectively use the angle of view and the space, the sensors 3 and 4 mounted on the side portions are arranged on both sides of the hinge 9 which is usually an empty space. Further, the photographing specifications (focal length, angle of view, etc.) of each sensor are set in detail according to the mounting position, method, and the like.
[0016]
FIG. 3 shows an example of each photographing area photographed by the three sensors 2 to 4. The photographing area 10 is covered by the sensor 2 mounted on the back of the mobile phone terminal 8. The imaging areas 11 and 12 adjacent to the imaging area 10 are covered by the sensors 3 and 4 mounted on both side surfaces. Both sides of the photographing area 10 are set so as to partially overlap the photographing areas 11 and 12.
[0017]
FIG. 4 shows a case where image data captured by the three sensors 2 to 4 is connected by the DSP 5 and the CPU 6 to display the scenery in front of the user as a panoramic size image on the display unit 7 at a time. An example is shown.
[0018]
Next, the operation of the present embodiment will be described in detail with reference to FIGS.
[0019]
When the user sets a shooting function using a camera from the key operation unit of the mobile communication terminal to shoot a landscape or the like and designates a panorama mode as a display mode, image data shot by the three sensors 2 to 4 is input to the DSP 5. Is done. The DSP 5 corrects and processes the overlapping portions of the image data 10 to 12 input from the three sensors 2 to 4 to connect them, and outputs them to the CPU 6 as panoramic size image data 14.
[0020]
The CPU 6 adjusts, for example, the vertical size of the panorama-size image data 14 input from the DSP 5 so that the connected panorama-size image is optimally displayed in the horizontal direction of the display unit 7. Output. Accordingly, the scene in front of the user as shown in FIG. 4 is displayed on the display unit 7 as a wide-angle panoramic size image 14 at a time.
[0021]
The photographing by the sensors 2 to 4 is performed simultaneously or every several frames, and the photographed image data 10 to 12 are temporarily stored in the memory. The DSP 5 reads out image data from each sensor stored in the memory according to an instruction from the CPU 6 and performs predetermined image correction and processing.
[0022]
When the user designates the split display mode from the key operation unit of the mobile communication terminal as the display mode, the CPU 6 instructs the DSP 5 to stop the panorama size image processing and output the split display data. The image data in each direction obtained by the three sensors 2 to 4 is output to the CPU 6 without being connected. The CPU 6 outputs the three images in a divided state to the display unit 7 for display according to a user's instruction, or displays one of the three images (for example, the image 13 captured by the sensor 2). ) Is output to the display unit 7 and displayed.
[0023]
As individual cameras (sensors) used in the present embodiment, it is not necessary to use a camera having a special configuration in order to achieve a particularly wide angle, and generally used cameras are used, and images taken by those cameras are used. Can be easily obtained a wide-angle image which is difficult to obtain with a single camera. In addition, shooting can be performed without concern for the width of the subject, and an image close to the human visual field can be obtained relatively easily.
[0024]
Also, in the DSP 5, from the panorama size image data 14 obtained by processing the image data input from the sensors 2 to 4, the object in the image for reading the image change due to the movement is captured in the previous time. The panorama-size image data 14 and the current panorama-size image data 14 are compared, and the image of the photographed object is recognized to detect a positional shift on the screen and a change in the size of the object. When a system for detecting a user's moving angle, moving distance, and the like is constructed by using the portable communication terminal with a digital camera according to the present embodiment, a wide-angle image is obtained, and thus an image change accompanying movement is read. For this reason, the number of target points in the image disappears from the screen, the number of target objects can be set in a wide range, and the reliability is improved.
[0025]
This can be used as an auxiliary function for detecting movement in places where radio waves cannot reach, such as GPS. In addition, by downloading a map around the place, it becomes possible to mount a navigation function without communication.
[0026]
As an application of the function of combining the images from the three sensors 2 to 4 by the DSP 5, the same is applied to a case in which an image taken in the past or an image taken with a time difference is connected and the object moves from one end of the screen to the other. A new image display method such as displaying a subject moving on a background screen is also possible.
[0027]
FIG. 5 is a block diagram showing a second embodiment of a camera image photographing device in a mobile communication terminal with a digital camera according to the present invention. FIG. 6 is a rear view and both side surfaces of the mobile communication terminal with a digital camera of the present embodiment. It is an external view which shows a figure typically.
[0028]
In the present embodiment, in addition to the three sensors 2 to 4 in the first embodiment, a fourth sensor 15 for photographing a predetermined photographing area is mounted on the surface portion (display side) of the mobile phone terminal 8. The other configuration is the same as that of the first embodiment. Hereinafter, the operation of this characteristic portion will be described.
[0029]
The fourth sensor 15 is provided mainly for photographing the user himself. In FIG. 6, the sensor 15 is disposed on the side of the housing having the display unit 7. However, the sensor 15 may be provided on the side of the housing having operation keys or at the center of the hinge unit 9. The DSP 5 has a function of inputting image data from the sensors 2 to 4 and image data from the sensor 15 to simultaneously display a user photographed by the sensor 15 and a background screen photographed by the sensors 2 to 4. are doing.
[0030]
For example, when displaying as an image in which the user himself is placed in front of a landscape in front of the user, the DSP 5 identifies the photographed outline of the user and removes a background screen overlapping the outline, It has a function of performing image data combining processing so that the user is displayed as an image in which the user himself is arranged in front of a landscape in front of the user.
[0031]
Further, by further increasing the number of cameras mounted, it is possible to obtain a wider-angle image, and the range of applications using these cameras is expanded.
[0032]
In the above-described embodiment, a case has been described in which the housing having the key operation unit and the housing having the display unit are applied to the portable communication terminal configured to be foldable by the hinge unit 9, but the present invention is not limited thereto. The present invention is not limited to this, and can be applied to a portable communication terminal that includes a key operation unit and a display unit in one housing and does not have a folding function using a hinge unit.
[0033]
【The invention's effect】
According to the present invention, it is not necessary to use a camera having a special configuration for achieving a wide angle particularly as an individual camera, and it is difficult to obtain an image using a single camera by connecting images from a plurality of cameras. A wide-angle image can be easily obtained, and photographing can be performed without worrying about the width of the subject. Also, an image close to the human visual field can be obtained relatively easily.
[0034]
In addition, when a portable terminal having a folding structure having a hinge portion is used, a plurality of sensors can be added without causing a major obstacle in a mounting surface by effectively utilizing the hinge 9.
[0035]
Since the imaging area of this system is wide-angle, it is easy to perform imaging, panorama-size imaging can be performed, the range of selection of imaging methods is widened, and the use of the camera of the portable terminal is increased.
[0036]
In addition, the shooting area covers a wide-angle area close to the human visual field, and the angle of view is preset on the mobile terminal body by each sensor, so that the image is easily recognized and the like, and the image recognition is improved. In addition to improving the reliability of applications such as detection of a moving angle and a moving speed, the range of application to games and the like is expanded to new applications.
[Brief description of the drawings]
FIG.
1 is a block diagram showing a first embodiment of a camera image photographing device in a mobile communication terminal with a digital camera according to the present invention.
FIG. 2
BRIEF DESCRIPTION OF THE DRAWINGS It is an external view which shows typically the back and both sides figure of the portable communication terminal with a digital camera of this embodiment.
FIG. 3
FIG. 4 is a diagram illustrating an example of each photographing area photographed by three sensors according to the present embodiment.
FIG. 4
FIG. 5 is a diagram illustrating an example of a case where images captured by three sensors according to the embodiment are displayed on a display unit as panoramic size images at a time.
FIG. 5
It is a block diagram showing a 2nd embodiment of a camera picture photography device in a portable communication terminal with a digital camera of the present invention.
FIG. 6
It is an external view which shows typically the front, back, and both side views of the portable communication terminal with a digital camera of this embodiment.
[Explanation of symbols]
1 camera module 2 to 4, 15 sensor 5 DSP (digital signal processor)
6 CPU (central processing unit)
7 display section 8 portable communication terminal body 9 hinge section

Claims (6)

A first sensor disposed on the back of the main body of the portable communication terminal and capable of photographing a predetermined photographing area in the rear direction of the main body of the portable communication terminal; and a first sensor arranged on both side surfaces of the main body of the portable communication terminal. A portable communication terminal equipped with a digital camera, comprising: a second sensor and a third sensor that can photograph a predetermined photographing area adjacent to both sides of the photographing area so as to partially overlap each other. The portable communication terminal is configured such that a first housing having a key operation unit and a second housing having a display unit are foldable by a hinge unit, and the first sensor is provided in the first housing. The mobile communication terminal with a digital camera according to claim 1, wherein the mobile communication terminal is provided with a digital camera, wherein the second and third sensors are provided on both sides of the hinge. Image data processing means for performing processing for joining image data captured by the first to third sensors to convert the image data into a wide-angle image, and display means for displaying the wide-angle image output from the image data processing means The mobile communication terminal with a digital camera according to claim 1 or 2, wherein: The apparatus according to claim 1, further comprising means for detecting a moving angle and a moving distance of the portable communication terminal by comparing previous image data connected by the image data processing means with current image data. 4. The mobile communication terminal with a digital camera according to 3. The portable communication with a digital camera according to any one of claims 1 to 4, further comprising a fourth sensor capable of photographing a user himself / herself using the portable communication terminal on a surface of the portable communication terminal main body. Terminal. The image data processing means has a function of creating an image in which image data captured by the fourth sensor and image data captured by the first to third sensors are combined. The mobile communication terminal with a digital camera according to claim 5.

Images