JP2019075663A - Image reproduction device - Google Patents

Abstract

To perform suitable image reproduction by automatically selecting only an appropriate image from the same scene when an image of the same scene is a panoramic image in an image reproduction device that selects multiple images to be reproduced and reproduces the selected images.SOLUTION: An image reproduction device includes read means for reading an image from a recording medium, selection means (S613, S614, S615) for automatically selecting a plurality of images to be reproduced from a plurality of images recorded in the recording medium, and reproducing means for sequentially reproducing a plurality of images to be reproduced selected by the selection means. When there is the same scene images that are continuous in time, the selection means selects a plurality of images from the same scene images as a reproduction target (S614), and the selection means selects one image from the same scene images when the same scene image is a panoramic image (S613).SELECTED DRAWING: Figure 6

Description

  The present invention relates to an image processing apparatus, and more particularly to an image reproducing apparatus that automatically selects a plurality of images to be reproduced and reproduces the selected image.

  In the past, digital still cameras, video cameras, mobile phones and smartphones were used to evaluate and select metadata using stored still images and moving images, and had opening, main feature, and ending configurations based on certain scenarios. A method has been proposed for creating short album videos. In the method of displaying a still image of the main part in the album moving image, it is desired to make the user who browses not get bored by giving a variation. Therefore, in the case of the album moving image, when the same scene with a short shooting interval or a short shooting interval is selected, the image effect of displaying the flip comic is produced. The images to be selected also include "panoramic still images" created by photographing and synthesizing a wide range other than normal still images. Panorama still images are combined, and the user frequently retakes them to create one image, and it is highly likely that a plurality of images of the same scene will be taken in a short period of time. Therefore, in the selection method similar to the conventional method, there is a possibility that a plurality of panoramic still images selected again at the time of album moving image creation may be selected.

  Therefore, it is necessary to create an album moving image so as not to display a panoramic still image retaken a plurality of times. Continuously shot images and images with short shooting intervals are displayed for 1 second in a shorter period than the normal 3 seconds, and image effects such as flip flops are produced and displayed. Patent Document 1 proposes that a similar effect is produced also in a stitch image created by connecting a plurality of images.

JP, 2008-118481, A

  However, Patent Document 1 does not propose a method for producing the above-described effect in a panoramic still image created by capturing a wide range and combining images. Panoramic still images are useful when photographing a large landscape at a travel destination or the like, and are frequently photographed. Panorama images often fail to be synthesized due to movement of the subject or blurring of the shooting operation, and are often recaptured. Therefore, a plurality of panoramic images including a failure image may be captured at one time. As for a plurality of panoramic images including such failure images, there are many cases in which one panoramic image is successfully captured. Therefore, in the case where a plurality of images are selected as one to be reproduced from one scene, a panoramic image for which shooting has failed may be included as one to be reproduced.

  In view of the above problems, the present invention is an image reproducing apparatus that automatically selects a plurality of images to be reproduced and reproduces the selected images, and when an image of the same scene is a panoramic image, appropriate from the same scene It is an object of the present invention to perform suitable image reproduction by selecting only the above images.

In order to achieve the above object, the image reproduction device of the present invention is
A reading unit for reading out an image from a recording medium, a selecting unit for automatically selecting a plurality of images to be reproduced from a plurality of images recorded on the recording medium, and a plurality of reproduction targets selected by the selecting unit When there is the same scene image that is continuous in time, the selecting unit selects a plurality of images from among the same scene image as objects to be reproduced, and the selecting unit When the same scene image is a panoramic image, one image is selected from the same scene image as a reproduction target.

  According to the present invention, when an image of the same scene is a panoramic image, it is possible to perform suitable image reproduction by selecting only an appropriate image from the same scene.

FIG. 2 is a block diagram of a digital camera. It is a flowchart regarding digital camera operation. It is a flowchart regarding a still image recording mode process. It is a flowchart at the time of regarding a reproduction | regeneration mode. It is a flowchart at the time of creating an album. It is a flowchart at the time of the image selection at the time of album preparation. It is a reference drawing about the same scene display.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the attached drawings.

  The embodiments of the present invention show the most preferable mode of the invention and do not limit the scope of the invention. FIG. 1 is a schematic block diagram of a digital camera (imaging device) 100 according to an embodiment of the present invention.

  In the present embodiment, a digital camera is described as an example of an imaging device, but in addition to this, an image reproduction device such as a mobile phone or a tablet may be used.

  Hereinafter, the main configuration of the imaging device 100 according to the present embodiment will be described with reference to FIG.

  In FIG. 1, the control unit 101 includes, for example, a CPU (MPU), a memory (DRAM, SRAM), a non-volatile memory (EEPROM), and the like, and executes various processing (programs) to control each block of the imaging device 100 Control data transfer between blocks. Further, the control unit 101 controls each block of the imaging device 100 according to an operation signal from the operation unit 102 that receives an operation from the user. Further, the control unit 101 analyzes an image obtained by the image processing unit 111 described later, and controls each block of the imaging device 100 according to the analysis result.

  The operation unit 102 includes, for example, switches for inputting various operations related to shooting, such as a power button, a still image recording button, a moving image recording start button, a zoom adjustment button, and an autofocus button. Further, it comprises a menu display button, an enter button, other cursor keys, a pointing device, a touch panel, etc., and when these keys and buttons are operated by the user, an operation signal is transmitted to the control unit 101.

  The bus 103 is a general-purpose bus for sending various data, control signals, instruction signals, and the like to each block of the imaging device 100.

  The non-volatile memory 105 is an electrically erasable / recordable memory, and stores a constant for operation of the control unit 101, a program, and the like.

  The BGM data used in the present embodiment is recorded in the non-volatile memory 105 as compressed data that can be decoded by the audio processing unit 121 described later. The number of data to be recorded may be plural, and is recorded in the non-volatile memory 105 together with the BGM data. Although in the present embodiment AAC (Advanced Audio Coding) is used as a system using audio compression processing, the compression processing system may not be AAC.

  The imaging unit 110 controls the light intensity of an optical image of an object taken in by a lens with an aperture, converts it into an image signal with an imaging device such as a CCD sensor or a CMOS sensor, and converts it into analog to digital data to obtain an image processing unit. Send to 111

  The image processing unit 111 performs image quality adjustment processing of adjusting the white balance, color, brightness, and the like on the input digital image signal based on the setting value. The image signal processed by the image processing unit 111 is transmitted by the control unit 101 to the memory 104, the video output unit 150 described later, and the display control unit 131.

  In the present embodiment, for example, the imaging unit 110 has an “optical zoom” function and an “optical anti-vibration” function, and the image processing unit 111 has an “electronic zoom” function and an “electronic anti-vibration” function. ing. Here, the “optical zoom” function and the “electronic zoom” function are functions for enlarging the obtained image according to the user's operation. Further, the “optical anti-vibration” function and the “electronic anti-vibration” function are functions for preventing the shaking of the image due to the vibration of the imaging apparatus 100 main body. These functions are used simultaneously, alternately, or independently under the control of the control unit 101.

  Here, the “optical zoom” function is a function of moving the lens of the imaging unit 110 in response to the user operating the zoom key of the operation unit 102 and enlarging / reducing the optical image of the subject to be taken in . Also, with the “electronic zoom” function, the image processing unit 111 enlarges an image obtained by cutting out a part of the image generated by the imaging unit 110 in response to the user operating the zoom key of the operation unit 102. Is a process of generating an image signal. In addition, with the “optical anti-vibration” function, the amount of movement of the lens is calculated based on the value of the acceleration signal from the vibration detection unit (not shown), and movement of the lens prevents movement of the acquired image. Function. The “electronic image stabilization” function prevents the image from shaking by adjusting the position of the image signal acquired by the imaging unit 110 based on the value of the acceleration signal from the vibration detection unit (not shown). It is a function. The “electronic image stabilization” function can also be realized by shifting the reading position of the imaging device of the imaging unit 110 based on the value of the acceleration signal from the vibration detection unit (not shown). Since these functions are known techniques, detailed description will be omitted.

  Also, the voice input unit 120 collects (collects) voice around the imaging device 100 by, for example, a built-in nondirectional microphone or an external microphone connected via a voice input terminal, etc. The digital conversion is performed and transmitted to the audio processing unit 121. The audio processing unit 121 performs processing related to audio such as processing for optimizing the level of the input digital audio signal. Then, the control unit 101 transmits the audio signal processed by the audio processing unit 121 to the memory 104. The memory 104 temporarily stores the image signal and the audio signal obtained by the image processing unit 111 and the audio processing unit 121.

  An image processing unit 111 and an audio processing unit 121 read out an image signal and an audio signal temporarily stored in the memory 104, encode the image signal, encode an audio signal, and the like, and generate a compressed image signal and a compressed audio signal. Generate etc. The control unit 101 transmits the compressed image signal and the compressed audio signal to the recording and reproducing unit 140.

  The recording and reproducing unit 140 records, on the recording medium 141, the compressed image signal and the compressed sound signal generated by the image processing unit 111 and the sound processing unit 121, and other control data related to photographing. When the audio signal is not compressed and encoded, the control unit 101 transmits the audio signal generated by the audio processing unit 121 and the compressed image signal generated by the image processing unit 111 to the recording and reproducing unit 140. Recording is performed on the recording medium 141.

  The recording medium 141 may be a recording medium incorporated in the imaging apparatus or a removable recording medium, and records various data including the compressed image signal, the compressed audio signal, the audio signal, and the BGM data generated by the imaging apparatus 100. A medium having a larger capacity than the non-volatile memory 105 is generally used. For example, the recording medium 141 includes a recording medium of any type such as a hard disk, an optical disk, a magneto-optical disk, a CD-R, a DVD-R, a magnetic tape, a nonvolatile semiconductor memory, a flash memory, and the like.

  The recording and reproducing unit 140 also reads (reproduces) the compressed image signal, the compressed sound signal, the sound signal, various data, and the program recorded on the recording medium 141. Then, the control unit 101 transmits the read compressed image signal and compressed audio signal to the image processing unit 111 and the audio processing unit 121. The image processing unit 111 and the audio processing unit 121 temporarily store the compressed image signal and the compressed audio signal in the memory 104, decode the audio signal according to a predetermined procedure, and decode the decoded audio signal to the audio output unit 151. A signal is transmitted to the video output unit 150 and the display control unit 131. When the audio signal is uncompressed and recorded on the recording medium 141, the control unit 101 directly transmits the audio signal to the audio output unit 151.

  The audio output unit 151 includes, for example, an audio output terminal, and transmits an audio signal in order to output audio from the connected earphone or speaker. Further, the audio output unit 151 may be a speaker that is built in the imaging device 100 and outputs audio relating to the audio signal. The video output unit 150 includes, for example, a video output terminal, and transmits an image signal to display a video on a connected external display or the like. The audio output unit 151 and the video output unit 150 may be one integrated terminal, for example, a terminal such as a High-Definition Multimedia Interface (HDMI) (registered trademark) terminal.

  Further, the display control unit 131 causes the display unit 130 to display an image based on an image signal transmitted from the image processing unit 111, an operation screen (menu screen) for operating the imaging device 100, and the like. For example, the display unit 130 may be any display device such as a liquid crystal display, an organic EL display, an electronic paper, and the like.

  The communication unit 152 performs communication between the imaging apparatus 100 and an external device, and transmits and receives data such as an audio signal, an image signal, a compressed audio signal, and a compressed image signal, for example. In addition, it transmits and receives control signals related to imaging such as imaging start and end commands, and other information. The communication unit 152 is, for example, a wireless communication module such as an infrared communication module, a Bluetooth (registered trademark) communication module, a wireless LAN communication module, a wireless USB, or a GPS receiver.

  Here, the normal operation of the imaging device 100 of the present embodiment will be described.

  In the imaging apparatus 100 according to the present embodiment, when the user operates the power button of the operation unit 102, the operation unit 102 issues a start instruction to the control unit 101. In response to this instruction, the control unit 101 controls a power supply unit (not shown) to supply power to each block of the imaging apparatus 100.

  When power is supplied, the control unit 101 instructs, for example, which mode switching switch of the operation unit 102 is, such as a still image shooting mode, a moving image shooting mode, or a playback mode, from the operation unit 102, for example. Confirm by the signal.

  In the still image shooting mode, when the user operates the still image recording button of the operation unit 102 in the shooting standby state, the imaging apparatus 100 performs shooting and a compressed image signal is recorded on the recording medium 141. And it will be in the shooting standby state again. In the moving image shooting mode, the imaging apparatus 100 starts shooting when the user operates the moving image recording start button of the operation unit 102 in the shooting standby state, and during that time, the compressed image signal and the compressed audio signal or audio signal are sent to the recording medium 141 It is recorded. Then, when the user operates the moving image recording end button of the operation unit 102, the shooting is ended and the shooting standby state is set again. In the reproduction mode, a compressed image signal, a compressed audio signal or an audio signal concerning a file selected by the user is reproduced from the recording medium 141, an audio signal is outputted from the audio output unit 151, and a video is displayed on the display unit 130.

  First, the still image shooting mode will be described. When the still image shooting mode is set by the operation unit 102, as described above, the control unit 101 sets each block of the imaging apparatus 100 in a shooting standby state.

  As described above, the “panorama still image” shooting mode can be selected by the operation unit 102, and the control unit 101 sets each block of the imaging device 100 in the shooting standby state.

  In the imaging standby state, the image processing units 111 and 113 transmit the image signal to the display control unit 131 and cause the display unit 130 to display an image related to the image signal. The user prepares for shooting while looking at the screen displayed in this manner.

  When a shooting instruction signal is transmitted by the user operating the still image recording button of the operation unit 102 in the shooting standby state, the control unit 101 transmits a shooting control signal to each block of the imaging apparatus 100, as described below. Control to make it work.

  The imaging units 110 and 112 convert an optical image of a subject captured by a lens into an image signal by an imaging device, convert the signal into analog to digital data, and transmit the image signal to the image processing unit 111. The image processing unit 111 processes image quality adjustment processing (white balance, color, brightness, and the like) of the input digital image signal based on the setting value. The image signal processed by the image processing units 111 and 113 is transmitted by the control unit 101 to the memory 104, the video output unit 150, and the display control unit 131. Here, by looking at the video displayed on the display unit 130, the user can confirm the photographed still image.

  Then, the image processing units 111 and 113 read out the image signal temporarily stored in the memory 104, perform predetermined encoding, generate a compressed image signal, and output the compressed image signal to the recording and reproducing unit 140. The recording and reproducing unit 140 writes the compressed image signal as a still image file on the recording medium 141 under file system management such as UDF and FAT.

  When the image processing units 111 and 113 end the encoding operation, the control unit 101 transmits a control signal to each block of the imaging apparatus 100 to shift to the imaging standby state, and returns to the imaging standby state.

  Next, the moving image shooting mode will be described. As described above, when the moving image shooting mode is set by the operation unit 102, the control unit 101 sets each block of the imaging apparatus 100 in a shooting standby state.

  In the imaging standby state, the image processing units 111 and 113 transmit the image signal to the display control unit 131 and cause the display unit 130 to display an image related to the image signal. The user prepares for shooting while looking at the screen displayed in this manner.

  In the shooting standby state, when the user inputs a shooting start instruction signal by operating the moving image recording start button of the operation unit 102, the control unit 101 transmits a shooting start control signal to each block of the imaging apparatus 100. , To control the following operations.

  The imaging units 110 and 112 convert an optical image of a subject captured by a lens into an image signal by an imaging element, convert the signal into analog to digital, and transmit the image signal to the image processing units 111 and 113. The image processing units 111 and 113 process image quality adjustment processing (white balance, color, brightness, and the like) of the input digital image signal based on the setting value. Then, the image signal processed by the image processing units 111 and 113 is transmitted by the control unit 101 to the display control unit 131 and the memory 104. The display control unit 131 causes the display unit 130 to display an image regarding the received image signal.

  On the other hand, the voice input unit 120 converts an analog voice signal obtained by the microphone into a digital signal, and transmits the obtained digital voice signal to the voice processing unit 121. The audio processing unit 121 performs processing for optimizing the level of the input digital audio signal and the like, and outputs an audio signal. The control unit 101 transmits the audio signal processed by the audio processing unit 121 to the memory 104.

  Then, the image processing units 111 and 113 and the audio processing unit 121 read out the image signal and the audio signal temporarily stored in the memory 104 and perform predetermined encoding to generate a compressed image signal, a compressed audio signal, and the like. . Then, the control unit 101 combines these compressed image signals and compressed audio signals to form a data stream, and outputs the data stream to the recording / reproducing unit 140. The recording and reproducing unit 140 writes the data stream as one moving image file on the recording medium 141 under file system management such as UDF and FAT. When the audio is not compressed, the control unit 101 outputs the audio signal generated by the audio processing unit 121 to the recording and reproducing unit 140 together with the compressed image signal generated by the image processing units 111 and 113. Then, as described above, the recording / reproducing unit 140 writes the data stream as one moving image file in the recording medium 141 under file system management such as UDF or FAT.

  The above operation continues while shooting.

  The control unit 101 controls the imaging unit 110 or 112 or the image processing according to the operation of the operation unit 102 by the user during photographing, or according to the analysis result of the image signal generated by the image processing unit 111 or 113. Various control signals are transmitted to the units 111 and 113, the audio processing unit 121, and the like. For example, the control signals for moving the lens and adjusting the aperture are transmitted to the imaging units 110 and 112, and the control signals for adjusting the image and sound are transmitted to the image processing units 111 and 113 and the audio processing unit 121. Do.

  Similarly, during shooting, the user operates the zoom key of the operation unit 102 to cause the control unit 101 to perform the “optical zoom” function of the imaging units 110 and 112 and the “electronic zoom” of the image processing units 111 and 113. Function can be operated. Also, based on the acceleration signal detected by the vibration detection unit (not shown), the control unit 101 causes the “optical anti-vibration” function of the imaging units 110 and 112 and the “electronic anti-vibration” function of the image processing units 111 and 113. Is working.

  When the user operates the moving image recording end button of the operation unit 102 to transmit an instruction signal to end shooting to the control unit 101, the control unit 101 causes each block of the imaging device 100 to control the end of shooting. Send and control to perform the following operation.

  The image processing units 111 and 113 and the audio processing unit 121 stop transmission of the image signal and the audio signal to the memory 104, respectively. Then, the remaining image signals and audio signals stored in the memory 104 are read out and subjected to predetermined encoding to generate compressed image signals, compressed audio signals and the like.

  The control unit 101 combines these last compressed image signal and compressed audio signal to form a data stream, and outputs the data stream to the recording / reproducing unit 140. When the audio is not compressed, the control unit 101 outputs the audio signal generated by the audio processing unit 121 and the compressed image signal to the recording and reproducing unit 140.

  The recording and reproducing unit 140 writes the data stream as one moving image file on the recording medium 141 under file system management such as UDF and FAT. Then, when the supply of the data stream is stopped, the control unit 101 controls to perform the following operation to generate a thumbnail.

  The recording and reproducing unit 140 reads the compressed image signal of the first frame of the moving image file recorded on the recording medium 141, and transmits the compressed image signal to the image processing units 111 and 113. The image processing units 111 and 113 temporarily store the compressed image signal in the memory 104 and decode the compressed image signal according to a predetermined procedure. Next, the image processing units 111 and 113 perform predetermined encoding for thumbnails on the obtained image signals, and generate thumbnail compressed image signals. Then, the control unit 101 outputs the thumbnail compressed image signal to the recording and reproducing unit 140. The recording / reproducing unit 140 writes the compressed image for thumbnail into the recording medium 141 so as to be combined with the base moving image file under file system management such as UDF, FAT, etc., completes the moving image file, and performs recording operation. Stop.

  When the recording operation is stopped, the control unit 101 transmits a control signal to each block of the imaging apparatus 100 to shift to the shooting standby state, and returns to the shooting standby state.

  It is possible to store the name of the copyright holder and the name of the creator in the non-volatile memory 105 in accordance with the operation of the operation unit 102 by the user. In addition, each time the operation unit 102 is operated, the copyright holder name and the creator name stored in the non-volatile memory 105 can be changed. The copyright holder name and the creator name stored in the non-volatile memory 105 are recorded as metadata in the still image file or the moving image file according to the photographing process.

  It is assumed that the still image file and the moving image file recorded in the still image shooting mode and the moving image shooting mode described above are recorded in accordance with DCF (Design rule for Camera File system).

  Next, the reproduction mode will be described. When the reproduction mode is set by the operation unit 102, the control unit 101 transmits a control signal to each block of the imaging apparatus 100 to shift to the reproduction state, and causes the following operation.

  The recording / reproducing unit 140 reads a still image file consisting of a compressed image signal recorded on the recording medium 141 or a moving image file consisting of a compressed image signal and a compressed audio signal or an audio signal. The control unit 101 sends the read compressed image signal and compressed audio signal to the image processing units 111 and 113 and the audio processing unit 121. If the audio signal is not compressed, the control unit 101 transmits the audio signal to the audio output unit 151.

  The image processing units 111 and 113 and the audio processing unit 121 temporarily store the compressed image signal and the compressed audio in the memory 104, and decode them in a predetermined procedure. Then, the control unit 101 transmits the decoded audio signal to the audio output unit 151, and the decoded image signal to the video output unit 150 and the display control unit 131. The display control unit 131 causes the display unit 130 to display an image relating to the input image signal, and the audio output unit 151 uses a speaker incorporating the sound relating to the input audio signal, or a connected earphone or speaker. Output.

  As described above, the imaging device of the present embodiment records and reproduces still images and moving images.

  The first embodiment of the present invention will be described below with reference to the flowchart of FIG.

  FIG. 2 is a flow chart for explaining the overall operation of the digital camera 100 of the present embodiment. Each process in this flowchart is realized by the control unit 101 loading a program stored in the non-volatile memory 105 or the like into the memory 104 and executing the program.

  When the power is switched on by the operation unit 102, the control unit 101 initializes a flag, a control variable, and the like in step S201. Subsequently, in step S202, management processing relating to the file recorded on the recording medium 141 is started.

  Next, in steps S203, S205, and S207, the control unit 101 determines the setting position of the mode switch from the operation unit 102. If the still image recording mode is set, the process proceeds from step S203 to step S204, and the still image recording mode process is executed. Details of the still image recording mode process in step S204 will be described later with reference to FIG. If the mode switching switch is set to the moving image recording mode from the operation unit 102, the process proceeds to step S206 via steps S203 and S205, and the moving image recording mode process is executed. If the mode switch is set to the reproduction mode from the operation unit 102, the process proceeds to step S208 through steps S203, S205, and S207, and the reproduction mode process is executed.

  If the other mode is set, the process proceeds to step S 209, and the control unit 101 executes the process according to the selected mode. Other modes include, for example, transmission mode processing for transmitting a file stored in the recording medium 141, and reception mode processing for receiving a file from an external device and storing the file in the recording medium 141. After the processing corresponding to the mode set by the mode switch is performed from the operation unit 102 among steps S204, S206, S208, and S209, the process proceeds to step S210. In step S210, the control unit 101 determines the setting position of the power switch. If the power switch is set to power on, the process returns to step S203. On the other hand, if the power switch is set to power off, the process proceeds from step S210 to step S211, and the control unit 101 performs the termination process. The end processing includes, for example, the following processing. That is, the display on the display unit 130 is changed to the end state, the lens barrier is closed, and the imaging unit 110 is protected. In addition, parameters and set values including flags and control variables and the like and setting modes are recorded in the non-volatile memory 105, and the power supply to a part not requiring power supply is shut off. When the termination process of step S211 is completed, the present process is terminated, and the power is turned off.

[About still image recording mode processing]
FIG. 3 is a flowchart showing the still image recording mode process, which is the details of the process of step S204 in FIG. 2 described above. Each process in the still image recording mode process is realized by the control unit 101 developing a program stored in the non-volatile memory 105 or the like in the memory 104 and executing the program. In the still image recording mode process shown in FIG. 3, when the mode switching switch is used to switch to another mode or when the power switch is set to OFF by the operation unit 102, interrupt processing etc. It shall end by

When the control unit 101 starts the still image recording mode, the control unit 101 determines a shooting mode in step S301. The determination of the shooting mode is made by acquiring the shooting mode at the end of the previous still image recording mode from the non-volatile memory 105 and storing the shooting mode in the memory 104. The shooting mode here is a shooting mode for shooting a still image. The digital camera 100 according to the present embodiment has the following shooting mode.
Auto mode: A mode in which various parameters of the camera are automatically determined by a program incorporated in the digital camera 100 based on the measured exposure value.
Manual mode: A mode in which the user can freely change various camera parameters.
Scene mode: A combination of shutter speed, aperture value, flash light emission condition, sensitivity setting, etc. suitable for the shooting scene is automatically set.

The scene mode includes the following modes.
Portrait mode: A mode specialized for person shooting, with the background blurred and the person floating.
Night scene mode: A mode specialized for night scene scenes where strobe light is applied to a person and the background is recorded at a slow shutter speed.
Landscape mode: A mode specialized for expansive landscape scenes.
Night & Snap Mode: A mode suitable for shooting night scenes and people without a tripod.
Kids & Pet Mode: A mode that enables shooting moving children and pets without missing a photo opportunity.
Fresh green & autumn leaves mode: A mode suitable for photographing trees and leaves such as fresh green in a colorful manner.
Party mode: A mode that shoots with the color faithful to the subject, suppressing camera shake under fluorescent lights and light bulbs.
Snow mode: A mode in which the person does not get dark even when the snow scene is back, and the picture is taken without bluish.
Beach mode: A mode in which you can shoot people without getting dark, even on a sea surface or sandy beach where sunlight is strongly reflected.
Fireworks mode: A mode to shoot skyrockets with optimum exposure and vividness.
Aquarium mode: A mode to set the sensitivity, white balance, and color tone that are suitable for shooting fish etc. in an indoor aquarium.
Underwater mode: A mode in which you can set the optimal white balance for underwater and shoot with bluish tints.
Monochrome mode: A mode to select and shoot the color tone such as black and white / sepia / blue / purple / green.
Extreme color mode: A mode that shoots in vivid colors with increased saturation.
Live View Mode: A shooting mode that allows you to select brightness and color / brightness with easy-to-understand words and make pictures.
Panorama shooting mode: A shooting mode that can shoot a wide range of scenes by shooting multiple images and combining them.

  When the photographing mode is determined, in the subsequent step S302, through display for displaying the image data from the imaging unit 110 is performed (image display control). Through display is to display an image captured by the imaging unit 110 as a substantially real-time moving image on the display unit 130 without recording the image on the recording medium 141. In S303 where the timing can be measured, it is determined whether the battery is present or the recording medium 141 is attached.

  In step S303, the control unit 101 determines whether there is a problem with the operation of the digital camera 100, using the power control, the remaining capacity of the power source configured by a battery or the like, the presence or absence of the recording medium 141, and the remaining capacity. . If there is a problem, the process proceeds to step S304, and a predetermined warning is displayed by an image or sound using the display unit 130, and the process returns to step S301. If there is no problem in the state of the power supply or the recording medium 141, the process proceeds to step S305.

  In step S305, the control unit 101 expands the shooting setting stored in the non-volatile memory 105 or the like in the memory 104 according to the user setting, and determines whether the shooting parameter is set.

  If not set, the process proceeds to step S307.

  If the setting is in progress, processing according to the shooting setting is performed in step S306.

  In step S307, the control unit 101 performs face detection to detect whether or not a human face is present in the through-displayed image signal. When a human face is detected in the face detection process, the control unit 101 uses, as face information, the position coordinates of the face detected in the image signal, the size (width, height), the number of detections, the reliability coefficient, etc. Remember to If a face is not detected in the face detection processing, 0 is set in the area such as position coordinates in the memory 104, size (width, height), number of detections, reliability coefficient, and the like.

  Subsequently, in step S309, the control unit 101 determines whether or not the first shutter switch signal SW1 is ON (reception of photographing preparation instruction). If the first shutter switch signal SW1 is OFF, the process returns to step S305. On the other hand, if the first shutter switch signal SW1 is ON, the process proceeds to step S310.

  In step S310, a shooting preparation operation is performed. The control unit 101 performs distance measurement processing to focus the photographing lens on the subject (autofocus processing), and performs photometry processing to determine the aperture value and the shutter speed (exposure determination processing). In the photometric process, flash setting is also performed if necessary. At this time, if a face is detected in step S307, it is also possible to perform face AF in which distance measurement is performed within the range of the detected face.

  Next, in steps S311 and S312, the ON / OFF state of the first shutter switch signal SW1 and the second shutter switch signal SW2 is determined. If the second shutter switch signal SW2 is turned on while the first shutter switch signal SW1 is turned on, the process proceeds from step S312 to step S313. When the first shutter switch signal SW1 is turned off (when the second shutter switch signal SW2 is not turned on and the first shutter switch signal SW1 is also released), the process returns from step S312 to step S306. Further, while the first shutter switch signal SW1 is ON and the second shutter switch signal SW2 is OFF, the processing of steps S311 and S312 is repeated.

  When the second shutter switch signal SW2 is turned on, in step S313, the control unit 101 sets the display state of the display unit 130 from the through display to the fixed color display state (for example, black only display). Then, in step S314, the control unit 101 executes a photographing process including an exposure process and a development process. In the exposure processing, image data obtained through the imaging unit 110 and the A / D converter is transferred to the memory 104 via the image processing unit 111 or directly from the A / D converter via the control unit 101. Will be written. Further, in the development process, the control unit 101 reads out the image data written in the memory 104 using the control unit 101 and, if necessary, the image processing unit 111, and performs various processes.

  Next, in step S315, the control unit 101 causes the display unit 130 to perform quick review display of the image data obtained by the photographing process. The quick review display is processing for displaying image data on the display unit 130 for a predetermined time (review time) before recording on a recording medium after shooting of a subject, in order to check a photographed image.

  In step S316, the control unit 101 executes recording processing for writing the image data obtained by the photographing processing as an image file on the recording medium 141, and ends the processing.

[About playback mode processing]
FIG. 4 is a flowchart showing the reproduction mode process, which is the details of the process of step S208 of FIG. 2 described above.

  In step S401, the control unit 101 acquires latest image information from the recording medium 141, displays the image on the display unit 130, and proceeds to step S402.

  In step S402, it is determined whether the album button of the operation unit 102 is pressed. If it is determined that the album button is pressed, the process proceeds to step S403. If it is determined that the album button is not pressed, the process proceeds to step S408.

  In step S403, it is determined whether the album target image exists using the latest image information acquired in S401. If the album target image is present, the process proceeds to step S404. If the album target image is not present, the process proceeds to step S407.

  The album target image is a still image or a moving image self-recorded by the digital camera.

  In step S404, it is determined from the operation unit 102 whether each album icon displayed on the display unit 130 is to be selected an album to be created. When an album is selected, the process proceeds to step S405, and when an album is not selected, the process proceeds to 406.

  The created album is for this day, for several days, for a person using authentication information, or for a custom (a date, an image, a person of your choice).

  In step S405, the control unit 101 creates an album, and the process proceeds to step S406. The creation of an album will be described in FIG.

  In step S406, the control unit 101 determines whether to end the album mode. When the album mode is ended, the operation proceeds to step S402 using the operation unit 102. When the album mode is not ended, the operation proceeds to step S403 and the processing is repeated.

  In step S407, album icon gray out display is performed using the display unit 130, making it impossible to select and making it impossible to create an album, and the process proceeds to step S406.

  In step S408, the control unit 101 determines whether the reproduction mode has ended. When the reproduction mode is ended, the reproduction mode is ended. When the reproduction mode is not ended, the process proceeds to step S409.

  In step S409, the control unit 101 performs other reproduction processing instructed by the operation unit 102, and the process proceeds to step S402.

  The other processing is, for example, image deletion, image editing, image transmission and the like.

  As described above, the reproduction mode processing is performed.

[About album creation process]
FIG. 5 is a flowchart showing the album moving image creation process, which is the details of the process of step S405 in FIG. 4 described above.

  In step S501, image selection processing is performed using the album object image read into the memory 104, and the process proceeds to step S502. The image selection process will be described with reference to FIG.

  In step S502, it is determined whether the write protection of the recording medium 141 is "on". If the write protection is "on", the process proceeds to step S506. If the write protection is "off", the process proceeds to step S503.

  In step S503, the control unit 101 determines whether the file name of the album moving image can be created. If the file name creation is possible, step S504 follows. If the file name creation is not possible, step S506 follows.

  The file name is stored as being named according to the file path defined by DCF (Design Rure for Camera File System).

  When naming according to the file path defined in the DCF standard, it is assumed that the file name can not be created if the maximum file number (9999) already exists in the DCF maximum directory (directory number 999).

  In step S504, the capacity of the moving image to be created is calculated based on the calculation of the free space of the recording medium 141 and the scenario created based on the image selected in step S501, and the process proceeds to step S505.

  In step S505, the free space capacity of the recording medium 141 calculated in S504 is compared with the capacity of the created album moving image, and the control unit 101 determines whether or not the album moving image can be recorded on the recording medium 141. If there is free space, the process proceeds to step S506. If the required free space is insufficient, the process proceeds to the preview reproduction process of step S508.

  In step S506, album preview confirmation display based on each state is performed using the display unit 130, and the process proceeds to step S507. If it is not possible to save the album moving image created by write protection, file name creation, or free space, a warning message is displayed to that effect.

  In step S507, the control unit 101 creates a scenario based on the selected image created in step S501, and determines whether to play an album preview.

  If the album preview reproduction is to be performed, the process proceeds to step S508. If the album preview reproduction is not to be performed, the process proceeds to step S509.

  In step S508, the control unit 101 actually performs preview reproduction using the display unit 130, and the process proceeds to step S509. Preview reproduction is processing for real-time reproduction of the contents of an album moving image created based on a scenario with BGM and image effects. That is, a plurality of images selected by the selection process are sequentially reproduced based on the scenario.

  In step S509, the control unit 101 determines whether to select preview reproduction again from the album setting change menu displayed on the display unit 130 via the operation unit 102. If preview reproduction is selected, the process proceeds to step S513, and if preview reproduction is not selected, the process proceeds to step S510.

  In step S510, the control unit 101 determines whether BGM is selected from the album setting change menu displayed on the display unit 130 via the operation unit 102. If BGM is selected, the process proceeds to step S514. If BGM is not selected, the process proceeds to step S511.

  In step S 511, the control unit 101 determines whether to select the color effect (filter) change to be applied to the natural image of the album via the operation unit 102 from the album setting change menu displayed on the display unit 130. . If the color effect change is selected, the process proceeds to step S515. If the color effect change is not selected, the process proceeds to step S512.

  In step S512, the control unit 101 determines from the album setting change menu displayed on the display unit 130 whether or not to select album moving image saving via the operation unit 102. If the storage of the album moving image is selected, the process proceeds to step S516. If the storage of the album moving image is not selected, the process proceeds to step S509 and the process is repeated.

  In step S513, a preview reproduction process is performed, and the process proceeds to step S509 to repeat the process. The preview reproduction process has already been described in step S508, and thus the description thereof is omitted.

  In step S514, the control unit 101 performs BGM selection processing, proceeds to step S509, and repeats the processing.

  In the BGM selection processing described here, when the BGM file (.WAV) is not stored in the recording medium 141, the BGM data compressed in the AAC format stored in the non-volatile memory 105 is expanded in the memory 104. The audio processing unit 121 decodes BGM data, converts it into a PCM data format, stores it in the memory 104, combines it with the header section, performs BGM file (WAV format) recording on the recording medium 141, Choose to listen to one of the BGM.

  In step S515, in accordance with an instruction from the operation unit 102, the control unit 101 performs change selection processing as to whether to apply a color effect to the album moving image, proceeds to step S509, and repeats the processing.

  The color effect change processing referred to here means performing “on” and “off” of giving a specific color filter effect to a series of natural images of album moving images.

  In step S516, a scenario is created based on the image selected in step S501, moving image storage of a series of albums is recorded on the recording medium 141 from the scenario as a moving image file (.MP4), and the process is ended.

  As described above, the album creating process is performed.

[About image selection processing]
FIG. 6 is a flowchart showing an image selection process for selecting a reproduction target image to be used for the album moving image, and is a detail of the process of step S501 of FIG. 5 described above.

  In step S601, the Exif information attached to the image read into the memory 104 is referred to, extracted via the control unit 101, and it is determined whether the GrID of the proof photographed by a series of shutters is attached. If the GrID is assigned, it is determined that the image is not the same, and the process advances to step S615; if the GrID is not assigned, the process advances to step S602. FIG. 8 shows an example of images continuously photographed at 701 in FIG. 7.

  Here, the Exif information means the creation date of the original image data, the number of detected faces, the scale in the height direction of face detection, the resolution in the upper and lower ends corresponding to the height of the image, and the detected faces. The largest face height, average brightness, scale of color distribution, average brightness of the entire image, and the ratio of each color to the entire image are used.

  In step S602, it is determined whether the photographing time of the image one before the control unit 101 is one second or less than that of the previous photographing. If the photographing time is one second or less, the process proceeds to step S603. If the photographing time is not one second or less, the process proceeds to step S604.

  In step S603, it is determined in steps S601 and S602 and steps S604, S605, S606, and S607 to be described later that they are the same scene image, and the process proceeds to step S608.

  In step S604, it is determined via the control unit 101 whether the imaging time of the target image is within one minute.

  If the photographing time is within one minute, the process advances to step S605. If the photographing time is not within one minute, it is determined that the image is not the same scene image, and the process advances to step S615.

  In step S605, it is determined via the control unit 101 whether the face size ratio of the target image is within a certain range. If it is determined that the image is not within the predetermined range, the process proceeds to step S606. If not, the image is determined not to be the same scene image, and the process proceeds to step S615.

  In step S606, it is determined via the control unit 101 whether or not the difference in the position of the face center coordinates of the target image is within a certain range. If it is determined that the image is not within the predetermined range, the process proceeds to step S607. If it is determined that the image is not within the predetermined range, it is determined that the image is not the same scene image, and the process proceeds to step S615.

  In step S 607, it is determined via the control unit 101 whether the image similarity by the color block of the target image is equal to or less than a threshold. If it is less than the threshold value, the process proceeds to step S603. If it is determined not to be less than the threshold value, it is determined that the image is not the same scene image, and the process proceeds to step S615.

  As described above, the same scene image is determined by the processing in steps S602 to S607. As a result of this determination, a plurality of images that are temporally continuous (short imaging time interval between images) and have high correlation (similarity) between the images are determined as the same scene image.

  In step S <b> 608, it is determined whether or not favorite metadata is attached to the target image via the control unit 101. If a favorite is given, the process proceeds to step S609, and if it is determined that a favorite is not given, the process proceeds to step S611.

  In step S609, it is determined from the image group determined to be the same scene image through the control unit 101 whether or not there are a plurality of images to which a favorite is added. If there are a plurality of images to which a favorite is given, the process proceeds to step S611 to repeat the process. If there is not a plurality of images given a favorite, the process proceeds to step S610.

  In step S610, the same scene is selected using the results determined in steps S608 and 609 and in step S611 described later via the control unit 101, and the process proceeds to step S612.

  In step S611, it is determined whether the image comprehensive evaluation value calculated by extracting metadata of the image through the control unit 101 is the highest. If the comprehensive evaluation value is the highest, the process proceeds to step S610. If the comprehensive evaluation value is not the highest, the process proceeds to step S611 and the process is repeated until there is no image determined to be the same scene.

  The evaluation value mentioned here is a value calculated by weighting smile, face size, color, face up, human whole body, macro image, multiple people, person authentication, continuous shooting scene, same scene, vertical position shooting. Represents

  In step S612, it is determined whether the image selected via the control unit 101 is an image captured in the panoramic imaging mode. If it is determined that the image is a panoramic still image, the process proceeds to step S613. If it is determined that the image is not a panoramic still image, the process proceeds to step S614.

  In the present invention, although the image is taken in the panoramic shooting mode, it is also possible to include a shooting mode to be combined other than the panoramic shooting mode (HDR, depth combination, etc.).

  In step S613, the control unit 101 selects a representative image of a panoramic image from among the same scene images. By selecting one of the panoramic images with the highest evaluation value, it is used in the album moving image without using a special effect of displaying a plurality of images, such as a flip flop used in the same scene. With regard to panoramic images, instead of effects used in the same scene, reproduction effects for panoramic images may be applied to generate an album moving image.

  In step S614, the control unit 101 sequentially switches a plurality of the same scene images other than a panoramic image like a parapa cartoon to apply an animation effect and display it, and uses it for an album moving image. Therefore, for the same scene image other than the panoramic image, a plurality of images from the same scene image are selected as reproduction targets of the album moving image. In addition, the effect of displaying a plurality of sheets as in the case of the paraparagine as used herein means that the same scene image is selected and used as in 703 to 706 as shown by 702 in FIG.

  In step S615, other image selection processing is performed on the image in the same scene via the control unit 101, and the process ends. The other selection processing referred to here is to select an image to be used for an album as a single image instead of the same scene image.

  As mentioned above, although the preferable embodiment of this invention was described, this invention is not limited to these embodiment, A various deformation | transformation and change are possible within the range of the summary.

Claims (5)

Reading means for reading an image from a recording medium;
Selecting means for automatically selecting a plurality of images to be reproduced from the plurality of images recorded on the recording medium;
The reproduction means for sequentially reproducing the plurality of images to be reproduced selected by the selection means;
When there is the same scene image continuous in time, the selection unit selects a plurality of images from among the same scene image as reproduction targets,
The image reproduction apparatus, wherein the selection unit selects one image from the same scene image as a reproduction target when the same scene image is a panoramic image.   The reproduction means continuously reproduces a plurality of images selected from the same scene image with a predetermined reproduction effect, and when the same scene image is a panoramic image, the panoramic image is 2. The image reproduction apparatus according to claim 1, wherein the reproduction is performed without applying the predetermined reproduction effect.   3. The image reproduction according to claim 2, wherein, when the same scene image is a panoramic image, the reproduction means reproduces the panoramic image with a reproduction effect different from the predetermined reproduction effect. apparatus.   The image reproduction apparatus according to claim 2, wherein the predetermined reproduction effect is an animation effect in which display of a plurality of images is sequentially switched. Furthermore, imaging means for capturing an image;
Recording means for recording a photographed image on a recording medium;
5. The image forming apparatus according to claim 1, further comprising: a generation unit configured to generate a panoramic image by combining a plurality of images continuously captured by the imaging unit in the panoramic imaging mode. Image playback device.

Images