JP2013038632A - Photographing apparatus, mobile information processing terminal having photographing apparatus, and program for controlling mobile information processing terminal - Google Patents

Abstract

PROBLEM TO BE SOLVED: To capture a wide image and a zoom image with one photographing operation.SOLUTION: When detecting touch operation on an area 20 in an image area 10 displayed on a monitor 120, a photographing apparatus 100 comprising two cameras displays the whole image area 10 as a wide image area 40 and an area 30 including the area 20 as a zoom image area 50. Thereafter, a first image equivalent to the wide image area and a second image equivalent to the zoom image area are captured on the basis of shutter operation.

Description

  The present invention relates to control of a photographing apparatus, and more particularly to control of a photographing apparatus having two cameras.

  A so-called twin camera having two cameras is known. Regarding the twin camera, for example, Japanese Patent Application Laid-Open No. 2005-072678 (Patent Document 1) discloses an “imaging device capable of continuously recording good images while using a zoom function during moving image shooting”. (See [Problem] in [Summary]). Japanese Patent Laying-Open No. 2008-054062 (Patent Document 2) discloses “an imaging apparatus that can experience the effect of shake correction with low power consumption” (see [Problem] in [Summary]).

  Further, when shooting using a twin camera, exposure control in each camera becomes a problem. Regarding exposure control, for example, Japanese Patent Laid-Open No. 4-309932 (Patent Document 3) states, “In a trimming camera having a plurality of exposure control modes and an optical zoom and an electronic zoom, both zooms are performed according to subject conditions. A technique for making it possible to set a suitable combination of photographing magnification and trimming magnification by making use of the feature of the function is disclosed ([object] of [Summary]).

JP 2005-072678 A JP 2008-054062 A JP-A-4-309932

  However, in the conventional technology, for example, the user of the twin camera needs to decide in which mode the shooting is to be performed before shooting. For this reason, for example, when tele-wide shooting is necessary, there are cases where the operation procedure increases and a photo opportunity is missed. In addition, when digital zooming is performed, image information may be reduced and image quality may deteriorate. When shooting with a single eye, image degradation may be large in contrast to light and dark and far.

  The present invention has been made to solve the above-described problems, and one of its purposes is to provide a photographing apparatus that does not miss a photo opportunity. Another object is to provide a photographing apparatus in which image deterioration is prevented.

  Another object is to provide a portable information processing terminal having a photographing device that does not miss a photo opportunity. Another object is to provide a portable information processing terminal having a photographing device in which image deterioration is prevented.

  Another object is to provide a program for controlling a portable information processing terminal so as to function as a photographing apparatus that does not miss a photo opportunity. Another object is to provide a program for controlling a portable information processing terminal so as to function as a photographing apparatus in which image degradation is prevented.

  An imaging apparatus according to an embodiment includes a first camera, a second camera, a monitor, an operation unit for receiving an instruction input to the imaging apparatus, and a control unit for controlling the operation of the imaging apparatus. With. The control means displays the first image from the first camera on the monitor and is an image from the second camera based on an operation for designating a part of the first image, the designated part. And a second image obtained by enlarging the first image at a preset magnification is displayed on a monitor, and the first image and the second image are displayed based on a shutter operation. Take an image.

  Preferably, the control unit causes the monitor to display an image obtained by reducing the first image and a second image based on an operation for designating a part of the image.

  Preferably, the control means displays the image from the first camera and the image from the second camera side by side on the monitor.

  Preferably, the shooting conditions for the first camera and the shooting conditions for the second camera are independent.

  Preferably, the control means expands the magnification to the limit of the optical zoom of the second camera based on an operation for designating a part of the image.

  Preferably, the control unit generates the second image using the image data obtained by the imaging of the first camera and the image data obtained by the imaging of the second camera, and is obtained by the generation. The second image is displayed on the monitor.

  According to another embodiment, a portable information processing terminal including any of the imaging devices described above is provided.

  According to another aspect, a program for controlling the portable information processing terminal is provided. The portable information processing terminal includes a first camera, a second camera, a monitor, an operation device for receiving an instruction input to the form information processing terminal, and a processor for controlling the operation of the portable information processing terminal. And. The program is an image from the second camera based on the step of displaying on the monitor the first image from the first camera on the processor and the operation of designating a part of the first image, A step of displaying on the monitor a second image obtained by enlarging the first image at a preset magnification and including the designated portion, and based on the shutter operation, the first image, And a step of capturing a second image.

According to a photographing apparatus according to a certain aspect, it is possible to photograph without missing a photo opportunity.
The above and other objects, features, aspects and advantages of the present invention will become apparent from the following detailed description of the present invention taken in conjunction with the accompanying drawings.

FIG. 6 is a diagram illustrating a change in a screen displayed on photographing apparatus 100. 2 is a block diagram illustrating a hardware configuration of imaging apparatus 100. FIG. 3 is a flowchart showing a part of a series of processes executed by CPU 110 of imaging apparatus 100. It is a figure showing transition of the image displayed on monitor.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

[Technology]
With reference to FIG. 1, the technical idea of the imaging device 100 according to the embodiment of the present invention will be described. FIG. 1 is a diagram illustrating a change in a screen displayed on the photographing apparatus 100.

  The photographing apparatus 100 includes a monitor 120. The monitor 120 displays the screen 10 from the first camera in its display area. In this state, when the user of the photographing apparatus 100 selects the area 20 to be zoomed by touch operation, as shown in the state (B), the monitor 120 detects the area 30 including the area 20 to be zoomed as an optical zoom target. To do. The monitor 120 displays a wide screen 40 obtained based on the image from the first camera and a zoom screen 50 obtained by optically zooming the second camera in the display area. In order to enlarge an image, in one aspect, optical zoom is used up to its limit, and digital zoom is used for zoom that exceeds the limit of optical zoom.

  The area 20 is specified based on the touch operation, for example, as a rectangular area in which a portion where the touch operation is detected is surrounded by a predetermined number of pixels. The area 30 is defined as, for example, a rectangular area surrounding the area 20 with a predetermined number of pixels. The “predetermined number of pixels” in the area 20 or the area 30 may be changeable by the user of the photographing apparatus 100.

  In addition, as a point that determines the position of the rectangular area, any of the coordinate values of the four corners (upper left, lower left, upper right, and lower right) of the area 20 specified as the rectangular range may be used. Which coordinate value is used is determined according to the position of the area 20 in the display area of the monitor 120, for example. For example, when the area 20 is detected at the upper left of the display area, the area 30 including the area 20 is determined as an area including a predetermined number of pixels from the upper left coordinate value of the area 20.

  In one aspect, the imaging device 100 is realized as an information processing terminal having a plurality of cameras such as a mobile phone, a smartphone, a tablet computer, and the like. Further, the image capturing apparatus 100 can be realized not only for capturing a two-dimensional image but also for capturing a three-dimensional image.

[Hardware configuration]
With reference to FIG. 2, the structure of the imaging device 100 according to the embodiment of the present invention will be described. FIG. 2 is a block diagram illustrating a hardware configuration of the image capturing apparatus 100.

  The photographing apparatus 100 includes a CPU (Central Processing Unit) 110, a monitor 120, a touch panel 130, a first camera 140, a second camera 150, a RAM (Random Access Memory) 160, a memory card reader / writer. 170. A memory card 180 can be attached to the memory card reader / writer 170.

  The first camera 140 includes a lens 141, an AF (Auto Focus) motor 142, a motor driver 143, an ISP (Image Signal Processor) 144, and an image sensor 145. The second camera 150 includes a lens 151, an AF motor 152, a motor driver 143, an ISP 154, and an image sensor 155.

  The CPU 110 controls the operation of the image capturing apparatus 100. The CPU 110 also detects the subject from the image using the data output from the ISP 144 and the data output from the ISP 154, calculates the feature amount, and combines the data. The detection of the subject is executed by a known face recognition process, pet recognition process, or the like. The calculation of the feature amount is also executed using a known technique.

  The monitor 120 displays an image. The image includes a still image and a moving image. The monitor 120 may be either a liquid crystal monitor or an organic EL (Electro Luminescence) monitor.

  The touch panel 130 receives an instruction input to the image capturing apparatus 100 as a touch operation. The touch panel 130 is disposed on the upper surface of the monitor 120, for example.

  The first camera 140 and the second camera 150 are arranged side by side in front of the casing of the photographing apparatus 100, respectively. The first camera 140 is set as a camera that operates by default in one aspect. That is, when the photographing apparatus 100 photographs using one camera, the first camera 140 is used for photographing.

  The lens 141 receives light from the outside of the photographing apparatus 100. The AF motor 142 drives the lens 141 in order to realize the operation (zoom or wide) of the lens 141. The motor driver 143 drives the AF motor 142 based on a signal sent from the CPU 110. The image sensor 145 converts an optical signal incident through the lens 141 into an electrical signal. The ISP 144 performs image processing on the electrical signal sent from the image sensor 145 using a predetermined process, and sends data obtained by the execution to the CPU 110.

  In the second camera 150, the lens 151 collects light outside the imaging apparatus 100. The AF motor 152 drives the lens 151 in order to realize zooming or widening of the lens 151. The motor driver 153 drives the AF motor 152 based on a signal sent from the CPU 110. The image sensor 155 converts an optical signal incident through the lens 151 into an electrical signal. The converted electrical signal is input to the ISP 154. The ISP 154 executes image processing of the electrical signal by applying a predetermined processing algorithm, and sends the processed signal to the CPU 110.

  The RAM 160 stores image data obtained by the first camera 140 or the second camera 150. The memory card reader / writer 170 writes data temporarily held in the RAM 160 to the memory card 180. In another aspect, the memory card reader / writer 170 reads data stored in the memory card 180, and the CPU 110 stores the read data in the RAM 160.

  In one aspect, the CPU 110 causes the monitor 120 to display the first image from the first camera 140. Based on an operation given to the touch panel 130 as an operation for designating a part of the first image, the CPU 110 is an image from the second camera 150 that includes the designated part and is preset. A second image obtained by enlarging the first image at a magnification is displayed on the monitor 120. Further, CPU 110 captures a first image and a second image based on a shutter operation given to touch panel 130.

  In another aspect, CPU 110 causes monitor 120 to display an image obtained by reducing the first image and a second image based on an operation for designating a part of the image.

  In another aspect, CPU 110 displays the image from first camera 140 and the image from second camera 150 side by side on monitor 120.

  In one aspect, the shooting conditions for the first camera 140 and the shooting conditions for the second camera 150 are independent. For example, the exposure of the first camera 140 and the exposure of the second camera 150 may be different. Further, the shutter speed of the first camera 140 and the shutter speed of the second camera 150 may not be the same. For example, in one aspect, the shutter speed of the zoomed camera of the first camera 140 and the second camera 150 may be faster than the shutter speed of the other cameras. In this case, deterioration of image quality due to camera shake can be prevented.

  The CPU 110 enlarges the magnification to the limit of the optical zoom of the second camera 150 based on an operation for designating a part of the image. When a zoom that exceeds the limit of the optical zoom is demanded, the CPU 110 further executes digital zoom.

  In another aspect, CPU 110 generates and generates a second image using image data obtained by imaging of first camera 140 and image data obtained by imaging of second camera 150. The second image obtained by the above is displayed on the monitor 120.

  Furthermore, as a modification, in another aspect, when the user performs a drag operation on the zoom screen 50, the image to be zoomed may be switched according to the drag operation. For example, when the user performs a drag operation for moving the image displayed at the end of the zoom screen 50 to the center of the display area of the zoom screen 50, the CPU 110 drags based on the data output from the touch panel 130. Detect that an operation has been performed. CPU 110 calculates the amount of movement of the image based on the data. CPU110 specifies the image which should be displayed on the center of a display area using the calculated movement amount. This is performed using an algorithm for determining the area 30 as described with reference to FIG. In this way, since the center position of the image displayed as the zoom image can be changed, the user can change the display target of the zoom image while maintaining the content displayed as the wide image. .

[Control structure]
With reference to FIG. 3, the control structure of imaging device 100 according to the embodiment of the present invention will be described. FIG. 3 is a flowchart showing a part of a series of processes executed by CPU 110 of imaging apparatus 100.

  In step S310, CPU 110 detects that the camera function is set to ON based on a signal sent from touch panel 130, and activates first camera 140.

  In step S320, CPU 110 displays an image obtained by imaging by first camera 140 on monitor 120. At this time, when the user of the photographing apparatus 100 detects a zoom or wide operation by the first camera 140, the CPU 110 drives the AF motor 142 in response to the detection and changes the lens 141 to a position corresponding to the drive. . The CPU 110 displays an image obtained from the changed lens 141 on the monitor 120.

  In step S330, CPU 110 detects a touch operation on touch panel 130 for designating a part of an image from first camera 140 displayed on monitor 120.

  In step S340, CPU 110 activates second camera 150 in response to the detection of the touch operation. The CPU 110 drives the AF motor 152 to change the position of the lens 151 so that the image is enlarged to a preset range including a place specified by the touch operation. CPU 110 accepts input of an image obtained through lens 151 arranged at the position after the change.

  In step S350, CPU 110 displays the image from first camera 140 in the display area on the left half of monitor 120, and from second camera 150 as an image of the zoom area including the area where the touch operation is detected. Are displayed on the right half of the display area of the monitor 120.

  In step S <b> 360, CPU 110 detects a shutter operation on photographing apparatus 100 based on a signal sent from touch panel 130.

  In step S <b> 370, CPU 110 performs shooting by first camera 140 and shooting by second camera 150, and uses first image data obtained from ISP 144 and second image data obtained from ISP 154. And stored in the RAM 160.

  In step S380, CPU 110 detects that an instruction to save data obtained by photographing is given based on a touch operation given to touch panel 130, and stores the data stored in RAM 160 in memory card 180. Write to.

[Display mode]
With reference to FIG. 4, an image display mode in photographing apparatus 100 according to the present embodiment will be described. FIG. 4 is a diagram showing transition of images displayed on the monitor 120.

  In the state (A), the monitor 120 of the photographing apparatus 100 displays the screen 400 obtained by the imaging of the first camera 140. Here, when the finger 450 of the user of the photographing apparatus 100 touches the vicinity of the image 401 in the screen 400, the monitor 120 adds to the image from the first camera 140 as shown in the state (B). Thus, an image from the second camera 150 is displayed. The image by the first camera 140 is a screen 410 obtained by reducing the screen 400. The image by the second camera 150 is a screen 420 that includes the image 401 and is obtained by enlarging to a predetermined area. In this case, the enlargement is performed either as an optical zoom or a digital zoom, or as a combination of each zoom.

  Thereafter, when the user of the photographing apparatus 100 performs an operation for saving the screen on the touch panel 130, as shown in the state (C), the data corresponding to the screen 430 and the state (D) are displayed. The data corresponding to the screen 440 is stored in association with the memory card 180 by the memory card reader / writer 170, respectively.

  Here, the zoom image shown in the state (D) is generated by the CPU 110 by, for example, combining the image obtained by the second camera 150 and the image acquired by the first camera 140 as a wide image. The In this case, the image processing by the CPU 110 is performed as follows, for example. The CPU 110 recognizes the subject based on the feature amount extracted from each image. The calculation of the feature amount or the recognition of the subject (face recognition, pet recognition, etc.) is performed using a known technique. More than one subject is recognized from the viewpoint of the accuracy of image synthesis. By specifying an area to be combined based on a plurality of subjects, the image data used for the combination is accurately specified, so that the accuracy of the combination can be improved.

  As described above, according to the photographing apparatus 100 according to the embodiment of the present invention, (1) since a simultaneous photographing can be performed by one operation, a still image can be photographed without missing a photo opportunity. (2) The exposure of two images can be taken in an optimal state. For example, it is possible to zoom finely in a partially dark place and a bright place. Further, at this time, by increasing the shutter speed on the zoom side, touching can be prevented. (3) It is possible to capture AF of two images in an optimal state. (4) Since the number of pixels can be artificially increased by image synthesis, the image quality can be improved. (5) Since the enlarged image is captured using the optical zoom, the image can be stored while image quality deterioration is suppressed.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

  The present invention is applicable to an information processing terminal having a plurality of cameras such as a mobile phone, a smartphone, a tablet computer, and the like.

  100 photographing device, 120 monitor, 130 touch panel, 140 first camera, 141, 151 lens, 142, 152 motor, 143, 153 motor driver, 145, 155 image sensor, 150 second camera, 160 RAM, 170 reader / Writer, 180 memory card, 401 images, 450 fingers.

Claims (8)

A photographing device,
A first camera;
A second camera,
A monitor,
Operating means for receiving an input of a command to the photographing apparatus;
Control means for controlling the operation of the photographing apparatus,
The control means includes
Displaying a first image from the first camera on the monitor;
Based on an operation for designating a part of the first image, the image from the second camera includes the designated part, and the first image is set at a preset magnification. A second image obtained by enlarging is displayed on the monitor;
An imaging device that captures the first image and the second image based on a shutter operation. The control means includes
The imaging device according to claim 1, wherein an image obtained by reducing the first image and the second image are displayed on the monitor based on an operation for designating a part of the image. The control means includes
The imaging device according to claim 1, wherein an image from the first camera and an image from the second camera are displayed side by side on the monitor.   The imaging device according to claim 1, wherein an imaging condition for the first camera and an imaging condition for the second camera are independent.   The imaging device according to claim 1, wherein the control unit expands the magnification to the limit of the optical zoom of the second camera based on an operation for designating a part of the image. The control means includes
The second image is generated by using the image data obtained by the imaging of the first camera and the image data obtained by the imaging of the second camera, and the second image obtained by the generation The imaging device according to claim 1, wherein an image is displayed on the monitor.   A portable information processing terminal comprising the imaging device according to claim 1. A program for controlling a portable information processing terminal,
The portable information processing terminal
A first camera;
A second camera,
A monitor,
An operating device for receiving an instruction input to the portable information processing terminal;
A processor for controlling the operation of the portable information processing terminal, and the program is stored in the processor,
Displaying a first image from the first camera on the monitor;
Based on an operation for designating a part of the first image, the image from the second camera includes the designated part, and the first image is set at a preset magnification. Displaying a second image obtained by enlarging on the monitor;
A program for executing the step of capturing the first image and the second image based on a shutter operation.

Images