JP4593653B2 - Imaging apparatus and imaging system - Google Patents

Description

  The present invention relates to an image pickup apparatus and a photographing system including a pair of image pickup means for picking up subject light and outputting digital image data.

  As an imaging device, digital cameras that convert subject light captured from an imaging lens into electrical signals using an image sensor such as a CCD image sensor (CCD) and record it as digital image data in a memory card or built-in memory are on sale Has been. Recently, camera-equipped mobile phones with a built-in digital camera are rapidly spreading.

Some digital cameras and camera-equipped mobile phones as described above have a function of creating a composite image in order to obtain high-quality images and to enhance the enjoyment of photography. For example, there has been proposed a camera that divides a photographing range into a plurality of parts, captures each divided range on the entire imaging surface of a CCD, acquires divided image data, and synthesizes the divided image data (see Patent Document 1). In addition, a partial area in the image to be referred to for composition is designated as a reference image area, and the reference image in the reference image area is displayed so as to be superimposed on the current image to be captured, and the reference image is displayed on the shooting frame. A digital camera that synthesizes an image has been proposed (see Patent Document 2).
JP-A-10-136298 JP 2001-333327 A

  The camera described in Patent Document 1 is not suitable for capturing a moving object as a subject in order to sequentially photograph the divided subjects, and the subject to be photographed is limited. In addition, the digital camera described in Patent Document 2 has a problem that it takes time and effort because the photographed image and the image to be referred to for composition are photographed in two steps.

  The present invention has been made in view of the above problems, and an object thereof is to provide an imaging apparatus and an imaging system that can easily obtain a high-quality image.

  In order to achieve the above object, an imaging apparatus according to the present invention shoots with a pair of imaging means that are arranged at a predetermined interval and that capture subject light taken from an imaging lens and output digital image data. A state detection unit that detects a state of the subject; and a control unit that performs image processing on the image data output from the pair of imaging units according to the detection result of the state of the subject. To do.

  The state detection means detects at least one of the contrast, movement amount, brightness, and distance of the subject.

  When the contrast of the subject is greater than or equal to a predetermined value, the control means takes a picture by changing the exposure amount with the pair of imaging means.

  When the amount of movement of the subject is equal to or greater than a predetermined value, the control unit performs shooting by changing the shutter speed with the pair of imaging units, or shooting with a predetermined time difference. Note that, when the shooting is moving image shooting, the control unit performs moving image shooting by shifting the shooting timing with the pair of imaging units.

  When the brightness of the subject is less than or equal to a predetermined value, the control means images the same subject at the same time with the pair of imaging means, combines the obtained images, and performs an averaging process.

  When the brightness of the subject is within a predetermined range of the middle luminance range, the control unit performs strobe shooting on one of the pair of imaging units and then performs normal shooting on the other with a predetermined time difference.

  When the distance to the subject is greater than or equal to a predetermined value, the control means takes an image while changing the zoom magnification with the pair of imaging means.

  When the distance to the subject is equal to or less than a predetermined value, the control unit performs shooting by changing the aperture amount with the pair of imaging units.

  In addition, when the image display means for displaying the subject image is provided, it is preferable that the pair of imaging means are arranged at symmetrical positions with the display screen of the image display means interposed therebetween.

  The control means shoots with one of the pair of imaging means focused on the subject and the other focused on the infinity point, and the sharpness of the image data of one imaging means focused on the subject is infinite. A portion larger than the sharpness of the image data of the other imaging means focused on the far point is cut out as a main subject area.

  Location / orientation information acquisition means for acquiring the current shooting location's position / orientation information, and examples of failed shooting at a specific shooting location are collected, and shooting techniques are provided to prevent unsuccessful shooting derived from this case. Communication means for accessing the database on the network and acquiring the imaging technique corresponding to the current imaging location acquired by the position / orientation information acquisition means, and display means for displaying the acquired imaging technique. It is preferable.

  The imaging system of the present invention has a pair of imaging means that are arranged at a predetermined interval and that captures subject light captured from an imaging lens and outputs digital image data, and state detection that detects the state of the subject to be photographed Means, control means for causing the pair of imaging means to perform photographing in a photographing mode corresponding to the detection result of the state of the subject, recording means for recording the image data and the photographing mode in association with each other, and the recording means An image pickup apparatus including the image data recorded in the image and a transmission unit that transmits the shooting mode to the outside, and an external device that performs image processing according to the shooting mode on the image data from the transmission unit It is characterized by comprising.

  According to the imaging apparatus of the present invention, a pair of imaging means that are arranged at a predetermined interval and that captures subject light captured from the imaging lens and outputs digital image data, and the state of the subject to be photographed are detected. Since a state detection unit and a control unit that performs image processing on the image data output from the pair of imaging units according to the detection result of the state of the subject, a high-quality image can be easily obtained. be able to.

  In addition, according to the imaging system of the present invention, a pair of imaging means perform imaging in an imaging mode according to the state of the subject, and the obtained image data and the imaging mode are recorded in association with each other and transmitted to an external device. Since the image processing according to the shooting mode is performed by the external device, it is not necessary to perform image processing by the imaging device, and it is possible to save the trouble of designing the image processing sequence of the imaging device.

  In FIG. 1, the camera-equipped mobile phone 2 according to the first embodiment of the present invention includes an upper main body 10 and a lower main body 11, which are rotatably engaged via a hinge portion 12. The hinge portion 12 is provided with a click mechanism (not shown) so that the upper main body 10 and the lower main body 11 are locked at a predetermined angle shown when the mobile phone 2 with a camera is used. When the camera-equipped mobile phone 2 is not used, the upper body 10 and the lower body 11 are folded so as to be parallel.

  An antenna 13 is housed behind the upper body 10, and a reception speaker 14 and a liquid crystal display (LCD) 15 are provided on the front surface 10 a. A strobe light emitting unit (not shown) is provided on the back surface 10 b of the upper body 10. Further, notches 16 and 17 are formed at symmetrical positions across the display screen 15 a of the LCD 15, and the first and second cameras 18 and 19 are arranged inside these notches 16 and 17. .

  The lower body 11 is provided with an operation unit 23 including a transmission microphone 20, a selection key 21, a dial key 22, and the like. Further, the side surface of the lower body 11 is provided with a socket 24 for cable connection with an external device such as a personal computer, and a memory card slot 25 into which a memory card 60 (see FIG. 4) is loaded.

  The antenna 13 is pulled out from the upper body 10 when using a telephone call, an e-mail service, or an Internet connection service, receives a radio signal from another mobile phone or an Internet server, and is transmitted from the camera-equipped mobile phone 2. Transmit the radio signal to the outside.

  The receiving speaker 14 outputs the voice (receiving voice) of the communication partner and the incoming melody. The LCD 15 displays various menu screens, the telephone number and mail address of the called party, images downloaded from the Internet server, through images and photographed images output from the first and second cameras 18 and 19, and the like.

  The transmission microphone 20 converts the voice of the speaker (transmission voice) into an electric voice signal and transmits it to the call partner via the antenna 13. The selection key 21 is operated when selecting / setting various menus such as registration of telephone numbers and mail addresses, and when using an Internet connection service or an electronic mail service. Further, by operating the selection key 21, it is possible to perform photographing with the first and second cameras 18 and 19. The dial key 22 is operated when inputting a telephone number or an e-mail text.

  As shown in FIG. 2, the first and second cameras 18 and 19 are configured such that the imaging lenses 30 and 31 are incorporated in cylindrical holding members 32 and 33. Bosses 34 to 37 are provided at both ends of the holding members 32 and 33. The holding members 32 and 33 are attached in the notches 16 and 17 by fitting these bosses 34 to 37 into receiving holes 38 to 41 formed in the upper main body 10. As a result, the first and second cameras 18 and 19 have the first position where the imaging lenses 30 and 31 face the front surface 10a of the upper body 10 on which the display screen 15a of the LCD 15 is provided, and the rear surface 10b of the upper body 10. It can be rotated in the direction of the arrow in the figure between the second position where the imaging lenses 30 and 31 face.

  Ball click mechanisms 42 and 43 are provided in the bosses 34 and 36 and the receiving holes 38 and 40. As shown in FIG. 3, the ball click mechanisms 42 and 43 are provided around the receiving holes 38 and 40 at the same interval as the balls 44 attached to the peripheral surfaces of the bosses 34 and 36 at a predetermined interval. And a click hole 45 that is click-engaged with the ball 44. When the first and second cameras 18 and 19 are rotated in the direction of the arrow in FIG. 2, the engagement between the ball 44 and the click hole 45 is released and the ball 44 is clicked again after being rotated to a desired angle. The holes 45 engage with each other to fix the orientations of the first and second cameras 18 and 19.

  The first and second cameras 18 and 19 can select a still image shooting mode for shooting still images, a movie shooting mode for shooting movies, a playback mode for displaying captured images on the LCD 32, and a setting mode for performing various settings. It has become. Switching between these modes is performed by operating the operation unit 23.

  In FIG. 4, CCD image sensors (CCD) 50 and 51 are disposed behind the imaging lenses 30 and 31. The subject light transmitted through the imaging lenses 30 and 31 is output as an imaging signal by the CCDs 50 and 51. The signal processing circuits 52 and 53 perform sampling, amplification, and A / D conversion on the imaging signals output from the CCDs 50 and 51, and output digital image data. The output image data is temporarily stored in the frame memory 54. The operation of the CCDs 50 and 51 is individually controlled by a timing generator (not shown).

  Rotation position detection sensors 55 and 56 are connected to the first and second cameras 18 and 19. The rotation position detection sensors 55 and 56 count the number of times that the ball 44 passes through the reference click hole 45, for example, and the first and second cameras 18 and 18 whose directions are fixed by the ball click mechanisms 42 and 43, 19 rotation positions are detected, and the detection result is transmitted to the CPU 57.

  The CPU 57 comprehensively controls the overall operation of the camera-equipped mobile phone 2. In addition to the operation unit 23 described above, the CPU 57 controls the display of the voice processing circuit 58 and the LCD 15 for performing various processes such as noise removal on the voice input / output by the receiving speaker 14 and the transmitting microphone 20. LCD driver 59 to perform, media controller 61 to control input / output of data to / from memory card 60, wireless communication I / F 62 to transmit / receive radio signals via antenna 13, and transmission / reception of data to / from external devices via socket 24 An external communication I / F 63 that performs the above and a strobe device 64 are connected.

  The CPU 57 switches the photographing mode of the first and second cameras 18 and 19 according to the detection result of the rotational positions of the first and second cameras 18 and 19 transmitted from the rotational position detection sensors 55 and 56. Then, processing corresponding to the switched shooting mode is performed.

  When the rotation position detection sensors 55 and 56 detect that the first and second cameras 18 and 19 are both facing the rear surface 10b and are in the second position, the CPU 57 determines that the first and second cameras 18 and 18 are in the second position. , 19 switches to a mode for photographing the subject in stereo, and when both are detected to be directed to the first position at a predetermined angle from the second position, the first and second cameras 18, 19 simultaneously Switch to the panorama shooting mode that captures images and combines the obtained images to obtain a panorama image.

  When the CPU 57 detects that both the first and second cameras 18 and 19 are facing the front surface 10a and is in the first position, the CPU 57 performs stereo shooting of the photographer himself with the first and second cameras 18 and 19. Switch to the self-portrait stereo shooting mode, and if it is detected that one of the first and second cameras 18, 19 is in the first position and the other is in the second position, the one in the first position Then, the photographer himself is photographed, the subject is photographed at the second position, and the mode is switched to the two-shot photographing mode in which the obtained images are combined.

  The CPU 57 performs gradation conversion, image composition, encoding processing, etc. on the two image data output from the first and second cameras 18 and 19 and temporarily stored in the frame memory 54 in each of the above shooting modes. Various image processing is performed. The image data after image processing is displayed as a through image on the LCD 15 via the LCD driver 59. Alternatively, after the shutter release, recording is performed on the memory card 60 via the media controller 61.

  As a method of image composition processing, contour extraction processing is performed on two image data, the same subject or an overlapping portion is image-recognized, and two images are overlapped so as to match the image-recognized portions. Match. Here, in the two-shot shooting mode, the contour extraction process is performed on the image shot by the camera at the first position and projected by the photographer, and the photographer in the image is extracted by removing the background image. Thereafter, the extracted image of the photographer is inserted into a predetermined position of the image on which the subject is projected, thereby performing image composition processing. In addition, in the stereo shooting mode and the self-portrait shooting mode, the correlation between the two image data is high, so that one is subjected to normal coding processing and the other is not subjected to both of the image data. It is preferable to perform an encoding process on the difference.

  In addition to automatically switching the shooting mode as described above, the camera-equipped mobile phone 2 can perform continuous shooting by shifting the shooting timing of the first and second cameras 18 and 19 by manual setting. As a result, the continuous shooting interval can be shortened, and the number of moving image shooting frames can be increased in a pseudo manner when shooting moving images. Further, between the first and second cameras 18 and 19, various shooting conditions such as an exposure amount, a focus value, a zoom magnification, and a shutter speed can be changed by manual setting to perform shooting.

  Next, the operation of the first embodiment will be described. When photographing using the first and second cameras 18 and 19, first, the upper main body 10 and the lower main body 11 are rotated through the hinge portion 12 to obtain the state shown in FIG.

  The first and second cameras 18 and 19 are rotated in the direction of the arrow in FIG. 2 to release the engagement between the ball 44 and the click hole 45, and the first and second cameras 18 and 19 are selected according to the shooting mode to be executed. Then, the ball 44 and the click hole 45 are engaged again, and the orientations of the first and second cameras 18 and 19 are fixed.

  At this time, the rotation position detection sensors 55 and 56 count the number of times the ball 44 passes through the reference click hole 45, and the first and second directions are fixed by the ball click mechanisms 42 and 43. The rotational positions of the cameras 18 and 19 are detected, and the detection result is transmitted to the CPU 57.

  When the first and second cameras 18 and 19 are both facing the back surface 10b and the rotation position detection sensors 55 and 56 detect that the first and second cameras 18 and 19 are in the second position, the camera is switched to the stereo shooting mode. In both cases, when it is detected that the head is directed from the second position toward the first position at a predetermined angle, the panorama shooting mode is switched.

  When it is detected that both the first and second cameras 18 and 19 are facing the front surface 10a and are in the first position, the camera is switched to the self-portrait stereo shooting mode, and the first and second cameras 18, When it is detected that one of 19 is in the first position and the other is in the second position, the mode is switched to the two-shot shooting mode.

  The subject light transmitted through the imaging lenses 30 and 31 is output from the CCDs 50 and 51 as an imaging signal. The imaging signals output from the CCDs 50 and 51 are sampled, amplified, and A / D converted by the signal processing circuits 52 and 53, and digital image data is output. The output image data is temporarily stored in the frame memory 54.

  The image data once stored in the frame memory 54 is read by the CPU 57 and subjected to various image processing such as gradation conversion, image composition, and encoding processing. The image data after image processing is displayed as a through image on the LCD 15 via the LCD driver 59. When the selection key 21 is operated in this state and the shutter release is executed, the image data after image processing is recorded in the memory card 60 via the media controller 61.

  With the configuration as described above, it is possible to easily enjoy a variety of photography by simply rotating the first and second cameras 18 and 19 according to the photographing mode to be executed.

  FIG. 5 is a perspective view showing an appearance of a camera-equipped mobile phone 70 according to the second embodiment of the present invention. Similar to the camera-equipped mobile phone 2 shown in FIG. 1, the camera-equipped mobile phone 70 includes first and second cameras 71 and 72. However, the first and second cameras 71 and 72 do not rotate like the first and second cameras 18 and 19, and the imaging lenses 73 and 74 (see FIG. 6) are directed toward the back surface 10b of the upper body 10. It is fixed at the position.

  In FIG. 6, the camera-equipped mobile phone 70 includes a state detection circuit 80. The state detection circuit 80 calculates various parameters (contrast, amount of movement of the subject, brightness, distance to the subject, etc.) representing the state of the subject, and transmits the calculated subject parameter information to the CPU 81.

  For example, the state detection circuit 80 calculates the luminance value of the image data output from the first camera 71 and temporarily stored in the frame memory 54, and compares the brightest part and the dark part of the image to detect the contrast. . Further, the amount of movement of the subject is obtained based on the change in the luminance value at a fixed frame interval and the change in the distance to the subject. Further, the state detection circuit 80 is connected to a distance measuring sensor 82 that emits, for example, ultrasonic waves or infrared rays toward the subject and receives the reflected light. Until the reflected light is received by the distance measuring sensor 82 Measure the distance from the time to the subject.

  The CPU 81 automatically switches the shooting mode of the first and second cameras 71 and 72 according to the detection result of the state of the subject transmitted from the state detection circuit 80, and performs processing corresponding to the switched shooting mode. .

  When the state detection circuit 80 detects that the contrast of the subject to be photographed is equal to or greater than a predetermined value, the first and second cameras 71 and 72 are switched to a photographing mode by changing the exposure amount, and the amount of movement of the subject Is detected to be greater than or equal to a predetermined value, the first and second cameras 71 and 72 are switched to a mode for shooting at a different shutter speed or a mode for shooting at a predetermined time difference.

  When it is detected that the brightness of the subject is equal to or less than a predetermined value, the first and second cameras 71 and 72 are simultaneously photographed under the same photographing conditions, and the obtained images are combined and subjected to an averaging process. Can be switched to. If it is detected that the brightness of the subject is within a predetermined range of the middle luminance range, after one of the first and second cameras 71 and 72 is subjected to flash photography, the other is left with a predetermined time difference. To switch to the normal shooting mode.

  When it is detected that the distance to the subject is greater than or equal to a predetermined value, the first and second cameras 71 and 72 are switched to a mode in which the zoom magnification is changed, and conversely, the distance to the subject is less than or equal to the predetermined value. Is detected, the first and second cameras 71 and 72 are switched to a mode for shooting with different apertures.

  After the shooting mode is switched, the image data once stored in the frame memory 54 is read out by the CPU 81, and gradation conversion, image composition and averaging processing (when it is detected that the brightness of the subject is below a predetermined value) ), Various image processing such as encoding processing is performed. One of the image data after the image processing is displayed as a through image on the LCD 15 via the LCD driver 59. When the selection key 21 is operated in this state and the shutter release is executed, the image data after image processing is recorded in the memory card 60 via the media controller 61.

  With the above-described configuration, at least one of the two image data captured by the first and second cameras 71 and 72 while changing the exposure amount, shutter speed, zoom magnification, shooting interval, and the like is a desired captured image. It is possible to prevent the shooting from failing. Even if the subject is selected (for example, when it is desired to shoot both the background and the person) and whether or not the flash photography is performed, an image satisfying both requirements can be obtained. Furthermore, when the brightness of the subject is equal to or less than a predetermined value, the images captured under the same shooting conditions are combined and the pixels of the combined image (the gradation value for each pixel) are averaged. Image quality degradation can be reduced.

  The image data and the shooting mode in which the image was shot are associated and recorded in the memory card 60, the image data is downloaded to an external device such as a personal computer, and gradation conversion, image synthesis, Various image processing such as encoding processing may be performed. In this way, the trouble of designing the image processing sequence of the CPUs 57 and 81 can be saved.

  Alternatively, the first camera may be focused on the subject, the second camera may be focused on the infinity point, and the first and second cameras may be used to change the focus value to cut out the main subject area. . In this case, after correcting the positional deviation between the two image data output by the first and second cameras using a known local block matching technique, the sharpness of the two image data is compared, A portion where the sharpness of the image data by the first camera is larger than that of the image data by the second camera is regarded as a main subject area and is cut out.

  In the first embodiment, the first and second cameras 18 and 19 are manually rotated, and the shooting mode is automatically switched according to the rotation positions. However, on the display screen 15a of the LCD 15, A menu for instructing the photographer about the orientation of the first and second cameras 18 and 19 corresponding to the photographing mode is displayed, and the photographer can manually select the photographing mode by operating the operation unit 23. Good. Further, a mechanism for automatically rotating the first and second cameras 18 and 19 may be provided at a position corresponding to the selected photographing mode.

  The camera phone 2, 70 has a function that can acquire position / orientation information such as GPS (Global Positioning System), and failure shooting cases at tourist attractions and scenic spots are collected. When a database prepared with shooting techniques for preventing shooting is built on an Internet server or the like and shooting at a tourist spot or a scenic spot using a mobile phone 2 or 70 with a camera is detected by GPS, By accessing the above database, an imaging technique optimal for the imaging location may be acquired and displayed on the LCD 15.

  Note that the various shooting modes described in the above embodiment are examples, and can be appropriately added and changed according to the specifications of the apparatus. In the above embodiment, the camera-equipped mobile phones 2 and 70 have been described as examples of the imaging device. However, the present invention is also effective when applied to other imaging devices such as a digital camera.

1 is an external perspective view of a camera-equipped mobile phone according to a first embodiment of the present invention. It is an enlarged plan view of the upper body. It is an enlarged plan view which shows a ball click mechanism periphery. It is a block diagram which shows the electrical structure of the mobile phone with a camera shown in FIG. It is an external appearance perspective view of the mobile phone with a camera which concerns on the 2nd Embodiment of this invention. FIG. 6 is a block diagram showing an electrical configuration of the camera-equipped mobile phone shown in FIG. 5.

Explanation of symbols

2. 70 Mobile phone with camera 10 Upper body 10a Front surface 10b Rear surface 11 Lower body 13 Antenna 14 Receiver speaker 15 Liquid crystal display (LCD)
15a Display screen 18, 71 First camera 19, 72 Second camera 20 Transmitting microphone 23 Operation unit 30, 31, 73, 74 Imaging lens 34-37 Boss 38-41 Receiving hole 42, 43 Ball click mechanism 44 Ball 45 Click Hole 50, 51 CCD
52, 53 Signal processing circuit 55, 56 Rotation position detection sensor 57, 81 CPU
60 Memory Card 80 Status Detection Circuit 82 Distance Sensor

Claims (10)

A pair of imaging means arranged at a predetermined interval and imaging subject light taken from the imaging lens and outputting digital image data;
State detecting means for detecting the contrast of the object to be photographed,
Control means for performing image processing on the image data output from the pair of imaging means according to the detection result of the contrast of the subject ,
When the contrast of the subject is greater than or equal to a predetermined value, the control unit performs imaging by changing the exposure amount with the pair of imaging units. The state detection means detects the amount of movement of the subject,
If the amount of movement of the object is equal to or greater than a predetermined value, said control means, to claim 1, characterized in that shoot at shooting by changing the shutter speed, or a predetermined time difference in the pair of image pickup means The imaging device described. The imaging apparatus according to claim 2 , wherein the shooting is moving image shooting, and the control unit performs moving image shooting with the shooting timing shifted by the pair of imaging units. The state detection means detects the brightness of the subject,
When the brightness of the subject is equal to or less than a predetermined value, the control unit photographs the same subject at the same time with the pair of imaging units, combines the obtained images, and performs an averaging process. Item 4. The imaging device according to any one of Items 1 to 3 . The state detection means detects the brightness of the subject,
When the brightness of the subject is within a predetermined range of the middle luminance range, the control unit performs strobe shooting on one side of the pair of imaging units and performs normal shooting on the other side with a predetermined time difference. imaging device according to any one of claims 1 to 4, wherein. The state detection means detects the distance of the subject,
When the distance between the object is equal to or greater than a predetermined value, said control means, the image pickup apparatus according to any one of claims 1 to 5, characterized in that to shoot by changing the zoom magnification by the pair of imaging means. The state detection means detects the distance of the subject,
When the distance between the object is less than a predetermined value, said control means, the image pickup apparatus according to any one of claims 1 to 6, characterized in that to change the shooting aperture amount in the pair of imaging means. An image display unit for displaying a subject image, wherein the pair of imaging means, in any one of claims 1 through 7, characterized by being arranged to sandwich at symmetrical positions a display screen of said image display means The imaging device described. The control means shoots with one of the pair of imaging means focused on the subject and the other focused on the infinity point, and the sharpness of the image data of one imaging means focused on the subject is infinite. imaging device according to any one of the larger portion than the sharpness of the image data of the other imaging means is focused on the far point, I claim 1, characterized in that cut out as the main subject area 8. Position / orientation information acquisition means for acquiring position / orientation information of the current shooting location;
A communication unit that accesses a database on a network in which a shooting technique is prepared corresponding to a specific shooting location, and acquires the shooting technique corresponding to the current shooting location acquired by the position / orientation information acquisition unit;
It acquired imaging apparatus according to any one of claims 1 to 9, characterized in that a display means for displaying the imaging techniques.

Images