JP2017184114A - Image processing device, image processing method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To set a display effect with a feeling of presence.SOLUTION: An imaging apparatus 1 includes a photographing control part 51 and a transition setting part 52. The photographing control part 51 acquires a plurality of images. The photographing control part 51 acquires related sensor information and time information during the photographing of the plurality of images acquired by the photographing control part 51. When the plurality of images are continuously displayed, the transition setting part 52 sets an effect at the time of switching the display of the images on the basis of the sensor information and time information acquired by the photographing control part 51.SELECTED DRAWING: Figure 3

Description

  The present invention relates to an image processing apparatus, an image processing method, and a program.

  Conventionally, it is known to select a display effect when images are sequentially displayed using shooting parameters. For example, there is a technique that allows a display effect to be added when switching images based on the shooting parameters of each image when a plurality of images are sequentially displayed (see Patent Document 1).

Japanese Patent Laid-Open No. 2005-12673

  However, with the technique described in Patent Document 1 described above, a display effect can be selected according to the content of the image, but the situation at the time of shooting cannot be estimated from the shooting parameters of the image, and therefore it is not always realistic. A high display effect could not be selected.

  The present invention has been made in view of such circumstances, and an object thereof is to set a more realistic display effect.

In order to achieve the above object, an image processing apparatus according to an aspect of the present invention includes:
Image acquisition means for acquiring a plurality of images;
Information acquisition means for acquiring sensor information or time information related to photographing a plurality of images acquired by the image acquisition means;
In the case of displaying a plurality of images continuously, setting means for setting the effect at the time of switching the display of the image based on the sensor information or the time information acquired by the information acquisition means;
It is characterized by providing.

  According to the present invention, a more realistic display effect can be set.

It is a block diagram which shows the hardware constitutions of the imaging device 1 which concerns on one Embodiment of the image processing apparatus of this invention. It is a schematic diagram for demonstrating the display between the images in this embodiment. It is a functional block diagram which shows the functional structure for performing an imaging | photography process and a moving image generation process among the functional structures of the imaging device 1 of FIG. 4 is a flowchart for explaining a flow of imaging processing executed by the imaging apparatus 1 of FIG. 1 having the functional configuration of FIG. 3. 4 is a flowchart for explaining a flow of moving image generation processing executed by the imaging apparatus 1 of FIG. 1 having the functional configuration of FIG. 3. It is a flowchart explaining the flow of the transition setting process among moving image generation processes. It is a flowchart explaining the flow of the transition setting process (with relevance) among transition setting processes. It is a flowchart explaining the flow of the transition setting process (no relevance) among the transition setting processes.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

FIG. 1 is a block diagram illustrating a hardware configuration of an imaging apparatus 1 according to an embodiment of the image processing apparatus of the present invention.
The imaging device 1 is configured as a digital camera, for example.

  As shown in FIG. 1, the imaging apparatus 1 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a bus 14, an input / output interface 15, and an imaging. Unit 16, sensor unit 17, input unit 18, output unit 19, storage unit 20, communication unit 21, and drive 22.

  The CPU 11 executes various processes according to a program recorded in the ROM 12 or a program loaded from the storage unit 20 to the RAM 13.

  The RAM 13 appropriately stores data necessary for the CPU 11 to execute various processes.

  The CPU 11, ROM 12, and RAM 13 are connected to each other via a bus 14. An input / output interface 15 is also connected to the bus 14. An imaging unit 16, a sensor unit 17, an input unit 18, an output unit 19, a storage unit 20, a communication unit 21, and a drive 22 are connected to the input / output interface 15.

  Although not shown, the imaging unit 16 includes an optical lens unit and an image sensor.

The optical lens unit is configured by a lens that collects light, for example, a focus lens or a zoom lens, in order to photograph a subject.
The focus lens is a lens that forms a subject image on the light receiving surface of the image sensor. The zoom lens is a lens that freely changes the focal length within a certain range.
The optical lens unit is also provided with a peripheral circuit for adjusting setting parameters such as focus, exposure, and white balance as necessary.

The image sensor includes a photoelectric conversion element, AFE (Analog Front End), and the like.
The photoelectric conversion element is composed of, for example, a CMOS (Complementary Metal Oxide Semiconductor) type photoelectric conversion element or the like. A subject image is incident on the photoelectric conversion element from the optical lens unit. Therefore, the photoelectric conversion element photoelectrically converts (captures) the subject image, accumulates the image signal for a predetermined time, and sequentially supplies the accumulated image signal as an analog signal to the AFE.
The AFE performs various signal processing such as A / D (Analog / Digital) conversion processing on the analog image signal. Through various signal processing, a digital signal is generated and output as an output signal of the imaging unit 16.
Hereinafter, the output signal of the imaging unit 16 is referred to as “captured image data”. Data of the captured image is appropriately supplied to the CPU 11 or an image processing unit (not shown).

  The sensor unit 17 includes various sensors such as an acceleration sensor, a temperature sensor, a sound sensor, an illuminance sensor, a GPS (Global Positioning System) sensor, a pressure sensor, and a fingerprint sensor. Various sensing information such as acceleration information, temperature information, sound information, brightness information, image information, position information, pressure information, and fingerprint information is output from the sensor unit 17.

  The input unit 18 includes various buttons and the like, and inputs various types of information according to user instruction operations.

  The output unit 19 includes a display, a speaker, and the like, and outputs images and sounds.

  The storage unit 20 is configured by a hard disk, a DRAM (Dynamic Random Access Memory), or the like, and stores various image data.

  The communication unit 21 controls communication with other devices (not shown) via a network including the Internet.

  A removable medium 31 composed of a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is appropriately attached to the drive 22. The program read from the removable medium 31 by the drive 22 is installed in the storage unit 20 as necessary. The removable medium 31 can also store various data such as image data stored in the storage unit 20 in the same manner as the storage unit 20.

  In the imaging apparatus 1 configured as described above, the display effect of switching between images (hereinafter referred to as “transition”) during continuous display of a plurality of images is set based on various sensor information acquired at the time of shooting. The type of transition to be set is determined based on the relationship between the images to be switched.

  The transition may be set when images are continuously displayed, and may be set when a moving image is generated or when an image is displayed. In the present embodiment, a transition is set when a moving image is generated in advance for continuous display.

  In the present embodiment, the transition is a display at the time of image switching, and is not limited to an image that has been given an effect on the image after the switching. For example, and a display such as an image added.

FIG. 2 is a schematic diagram for explaining the transition in the present embodiment. In this example, when a plurality of images are displayed, it is assumed that image A is displayed first and then image B is displayed.
In the present embodiment, as shown in FIG. 2, the transition takes different images in which sensor information is considered depending on whether or not the images are related.
That is, when the relationship between the images A and B is [None], it can be estimated that the sensor information of the images A and B is completely non-common, and thus is acquired when the image B displayed after the transition is captured. If only the sensor information is taken into consideration and the relationship between the images A and B is [Yes], it can be estimated that the sensor information of the images A and B has a highly common value, so images displayed before and after the transition Consider the sensor information acquired at the time of shooting A and B. If the images A and B are not related, it is only necessary to promptly view the image B smoothly. Therefore, if sensor information of only the image B is taken into consideration, the image B becomes a more realistic display. When A and B are related, the presence can be further enhanced by performing a transition so that the images are related.

The relevance of images is determined from, for example, the result of image analysis, shooting time, shooting location, and the like.
Specifically, the image relevance is determined to be “relevant” when the images are similar according to the result of image analysis, when the shooting time is close, or when the shooting location is close.

When the relationship between the images A and B is [None], only the sensor information acquired when the image B displayed after the transition is captured (including before and after the capture) is considered, and the type of transition is determined. Configured as follows.
On the other hand, when the images A and B are related to [Yes], the sensor information acquired at the time of capturing the images A and B before and after the transition (including before and after the capturing) is taken into consideration. The type is configured to be determined.
Note that in this example, the degree of similarity between images may be handled as presence / absence of relevance.

  The sensor information to be used and the content (intensity) of the transition according to the content (value) of the sensor information are set according to the transition type determined in this way.

  Specifically, for example, transitions are set using sensor information and time information from the following various sensors (acceleration sensor, temperature sensor, sound sensor, illuminance sensor, GPS sensor, pressure sensor, fingerprint sensor).

1. When using [Acceleration sensor] (1-1) If the sensor information indicates that the image was taken while moving forward or backward, a transition that zooms in / out is set.
At this time, the zoom speed and magnification are adjusted according to the moving speed and the moving time. In a continuous display image, when the moving speed is slow / fast, a transition that slows / fastens the zoom speed is set.
(1-2) If the sensor information indicates that there was no motion, the sensor information is crossfade.
In the case where the image is captured at a fixed position, the effect of the transition is suppressed in a state where the change of the image content is not so much seen in combination with the image analysis.
(1-3) When a vertical / left / right blur is detected, a transition is set so as to slide in from the vertical / left / right.
Adjust the speed and number of slide-ins according to the size and speed of the blur.
(1-4) When it is detected that the screen has been swung up / down / left / right, a transition is set so as to change the image by cube (rotating) the entire top / bottom / left / right screen.

2. When using [Temperature sensor] (2-1) If the temperature is higher than the threshold, set a transition that fades (whites out) with a bright color such as white or red. If the temperature is lower than the threshold, black Set a transition that fades (blackout) with a calm color such as blue or blue.
(2-2) Set a transition that fades (whites out) with a bright color such as white or red when a continuous display image has a hot temperature. If the temperature becomes cold, black or blue Set a transition that fades (blacks out) with a subdued color.

3. When [Sound sensor] is used (3-1) A sound direction is determined, and a transition such as zoom-in is performed to emphasize the direction.
Adds strength to the transition depending on the volume of the sound. For example, if a loud sound is produced, a violent switching effect is made.
(3-2) When a specific sound (for example, a human voice) is recognized, a transition that emphasizes a subject (for example, a human face) that is likely to emit the sound in the direction in which the sound is made is applied. In particular, when there are a plurality of similar subjects, a transition for emphasizing a specific subject that emits sound is applied.

4). When [Illuminance Sensor] is Used (4-1) When the illuminance is higher / lower than the threshold value, fading (whiteout / blackout) with a bright color such as white or red / a calm color such as black or blue.
(4-2) When the illuminance is high / low in continuous display images, fading (whiteout / blackout) with a bright color such as white or red / a calm color such as black or blue.
(4-3) If the image suddenly becomes brighter / darker before and after shooting, it is faded (whiteout / blackout) with a bright color such as white or red / a calm color such as black or blue.

5. When using [GPS sensor] (5-1) The positional relationship is determined from the difference in positional information between consecutive display images, and the slide-in is performed in that direction.
(5-2) When it is determined that the difference in position information between consecutive display images is small and the positional relationship is the same, crossfading is performed.
(5-3) If it is determined from the position information that the image was taken in a specific environment (for example, near the coast), the transition is associated with the environment (for example, a transition such as a blue fade or dissolve reminiscent of the sea).
(5-4) Estimate the shooting position where the image was shot based on the position information, and make a transition that contains the image representing the shooting position, such as a national flag, country name, place name, and building name.

6). When using the [Pressure Sensor] Change the strength of the transition effect according to the pressure level. For example, when the pressure is strong, the zoom-in speed is increased.

7). When [Fingerprint Sensor] is Used The image effect selected by a person specified in the past is adopted as a default or is set to a preset transition according to the person (photographer) specified by the fingerprint.

8). When [Time information] is used Change the effect of the transition according to the time associated with the image. Specifically, when it is determined that the photographed time is night, it is determined that the photographed time is morning so as to fade (black out) with a calm color such as black or blue. Set the transition to fade (white out) with bright colors such as white and red.

  Therefore, in order to set the transition in consideration of the environment at the time of image capture (sensor information), it is possible to reflect the environment at the time of image capture that is not displayed in the image, so that a more realistic image can be reflected. A display effect can be added. In addition, since the relevance of images is taken into consideration, it is possible to perform switching without a sense of incongruity or switching of scene changes as in the relationship between images.

FIG. 3 is a functional block diagram illustrating a functional configuration for executing the shooting process and the moving image generation process among the functional configurations of the imaging apparatus 1 in FIG. 1.
The imaging process refers to a series of processes for acquiring sensor information from the sensor unit 17 and storing it together with an image when an image is captured.
The moving image generation process is a series of processes for generating a moving image based on a transition set from a plurality of selected images.

  When the shooting process is executed, the shooting control unit 51 functions in the CPU 11 as shown in FIG.

A captured image storage unit 71 is set in one area of the storage unit 20.
The captured image storage unit 71 stores captured image data that is a still image and sensor information acquired at the time of capturing the captured image in association with each other.

The imaging control unit 51 controls the imaging unit 16 to execute the imaging process. As a result, a captured image is output from the imaging unit 16.
In addition, the imaging control unit 51 acquires various sensor information from the sensor unit 17 at the time of imaging.
In addition, the shooting control unit 51 associates the captured image with the sensor information acquired at the time of shooting the captured image, and stores it in the captured image storage unit 71.

In addition, when executing the moving image generation process, as shown in FIG. 3, the transition setting unit 52 and the moving image generation unit 53 function in the CPU 11.
A moving image storage unit 72 is set in one area of the storage unit 20.
The moving image storage unit 72 stores data of the generated moving image.

The transition setting unit 52 sets a transition between images based on the sensor information of the image according to the presence or absence of the relevance of the image.
Specifically, the transition setting unit 52 selects an image and executes a transition setting process for setting a transition to be added between images.
The transition setting process includes a transition setting process (related) that is related to images and a transition setting process (not related) that is not related to images.
In the transition setting process (with relevance), since there is a relevance between images, the transition is set in consideration of sensor information of the preceding and following images.
Further, in the transition setting process (no relevance), since there is no relevance between images, the transition is set considering only the sensor information of the subsequent image.

  The moving image generation unit 53 executes a moving image generation process. In the moving image generation process, a display effect between images is given based on the setting of transitions between images constituting the moving image selected by the user, and the moving images are generated as a slide show by connecting the images. .

FIG. 4 is a flowchart for explaining the flow of imaging processing executed by the imaging apparatus 1 of FIG. 1 having the functional configuration of FIG.
The photographing process is started by an operation for starting the photographing process on the input unit 18 by the user.

In step S <b> 11, the shooting control unit 51 determines whether a user has performed a shooting operation on the input unit 18.
If there is no shooting operation, NO is determined in step S11, and the process enters a standby state.
If there is a shooting operation, YES is determined in step S11, and the process proceeds to step S12.

  In step S12, the imaging control unit 51 controls the imaging unit 16 to execute the imaging process. As a result, a captured image is output from the imaging unit 16.

  In step S <b> 13, the shooting control unit 51 acquires sensor information at the time of shooting from the sensor unit 17.

In step S <b> 14, the imaging control unit 51 associates the captured image data with the sensor information and stores them in the captured image storage unit 71.
Thereafter, the photographing process ends.

FIG. 5 is a flowchart for explaining the flow of moving image generation processing executed by the imaging apparatus 1 of FIG. 1 having the functional configuration of FIG.
The moving image generation process is started by an operation of starting a moving image generation process on the input unit 18 by the user.

  In step S <b> 31, the moving image generation unit 53 selects an image for generating a moving image, for example, by an image selection operation on the input unit 18 by the user.

  In step S32, the transition setting unit 52 executes a transition setting process. As a result of the transition setting process, a transition to be added between images is set based on the presence or absence of relevance between images. The detailed flow of the transition setting process will be described later.

  In step S <b> 33, the moving image generation unit 53 generates a moving image (for example, a slide show format) by connecting the selected images based on the set image arrangement order and transition.

In step S <b> 34, the moving image generating unit 53 determines whether there is a storage operation for storing a moving image on the input unit 18 by the user, for example.
If there is no storage operation, NO is determined in step S34, and the process proceeds to step S36.
If there is a storage operation, YES is determined in step S34, and the process proceeds to step S35.

  In step S <b> 35, the moving image generation unit 53 stores moving image data in the moving image storage unit 72.

In step S <b> 36, the moving image generation unit 53 determines whether or not there has been an end operation for ending generation of a moving image on the input unit 18 by the user.
If there is no end operation, NO is determined in step S36, and the process returns to step S31.
If there is an end operation, YES is determined in step S36, and the moving image generation process ends.

  FIG. 6 is a flowchart for explaining the flow of the transition setting process in the moving image generation process.

  In step S51, the transition setting unit 52 rearranges the selected images in the shooting order. In addition, you may comprise so that rearrangement may be performed based on the relevance of an image.

In step S52, the transition setting unit 52 determines whether or not there is a relationship between consecutive images.
If there is no relationship between consecutive images, NO is determined in step S52, and the process proceeds to step S54.
If there is a relationship between successive images, YES is determined in step S52, and the process proceeds to step S53.

  In step S53, the transition setting unit 52 executes a transition setting process (related). As a result of executing the transition setting process (relevant), transitions between images are set.

  In step S54, the transition setting unit 52 executes a transition setting process (no relevance). As a result of the transition setting process (not relevant) being executed, transitions between images are set.

  FIG. 7 is a flowchart for explaining the flow of the transition setting process (with relevance) in the transition setting process.

  In step S71, the transition setting unit 52 performs grouping according to the relevance between images. For example, the groups are divided according to closeness of shooting date and time, closeness of shooting position, and the like.

  In step S72, the transition setting unit 52 refers to the leading group number P = 1.

  In step S73, the transition setting unit 52 refers to the first image number N = 1 in the group.

  In step S74, the transition setting unit 52 compares the differences between the sensor information of the Nth and N + 1th images.

In step S75, the transition setting unit 52 sets the type and intensity of the transition between the corresponding images based on the sensor information having the largest difference.
For example, if the sensor information with the largest difference is an acceleration sensor, set zoom as the transition type, and adjust the zoom speed and magnification as the transition intensity according to the movement speed and movement time based on the sensor information. And set.

  In step S76, the transition setting unit 52 refers to the next image in the group with the image number N = N + 1.

In step S77, the transition setting unit 52 determines whether N = the number of sheets in the group.
If N = the number of sheets in the group, YES is determined in step S77, and the process proceeds to step S78.
If N is not the number in the group, NO is determined in step S77, and the process returns to step S73.

  In step S78, the transition setting unit 52 refers to the next group as P = P + 1.

In step S79, the transition setting unit 52 determines whether P = number of groups.
If P = the number of groups, NO is determined in step S79, and the process returns to step S73.
If P = number of groups, YES is determined in step S79, and the transition setting process (not related) returns to the main flow of the transition setting process.

  FIG. 8 is a flowchart for explaining the flow of the transition setting process (no relevance) in the transition setting process.

In step S91, the transition setting unit 52 calculates an average value of each sensor information in the entire selected image. After that, the transition setting unit 52 performs normalization and the like so that each sensor information can be compared.
For example, by defining and normalizing the maximum value and the minimum value of each sensor information of the entire selected image as 1 and −1, it is possible to compare various sensor information with different scales.

  In step S92, the transition setting unit 52 sets the image order L = 2 and refers to the second image.

  In step S93, the transition setting unit 52 compares the average value of each sensor information calculated in step S91 with the value of each sensor information of the corresponding image, and increases the sensor information or the average value of a large value protruding from the average value. Lower sensor information is determined as characteristic sensor information.

In step S94, the transition setting unit 52 sets the type and effect of the transition between the corresponding images (between the image L-1 and the next image L) based on the sensor information that is the feature.
For example, when the sensor information that characterizes the image L is temperature information, when the temperature is higher / lower than the threshold value, a transition color is set, and a bright color such as white or red / calmness such as black or blue The transition to fade (white out / black out) with the selected color is set.

  In step S95, the transition setting unit 52 sets L = L + 1 and sets the reference target as the next image.

In step S96, the transition setting unit 52 determines whether L = total number of images.
If L is not the total number of images, NO is determined in step S96, and the process returns to step S93.
If L = total number of images, YES is determined in step S96, and the process returns to the main flow of the transition setting process.

The imaging apparatus 1 configured as described above includes a shooting control unit 51 and a transition setting unit 52.
The imaging control unit 51 acquires a plurality of images.
In addition, the imaging control unit 51 acquires sensor information and time information related to imaging a plurality of images acquired by the imaging control unit 51.
The transition setting unit 52 sets an effect at the time of image display switching based on sensor information and time information acquired by the imaging control unit 51 when a plurality of images are continuously displayed.
Thereby, in the imaging device 1, the display effect with a more realistic feeling can be set.

The transition setting unit 52 determines the relevance of images based on predetermined information between continuously displayed images.
In addition, the transition setting unit 52 sets an effect based on the determination result.
Thereby, in the imaging device 1, since the relevance of an image can be determined based on the predetermined information between images displayed continuously, a more realistic display effect can be set. .

The predetermined information includes information on the shooting time, the shooting position, and the image content.
Thereby, in the imaging device 1, since the relevance of the image can be determined based on the information of the shooting time, the shooting position, and the image content, a more realistic display effect can be set.

The transition setting unit 52 sets the type of effect and the strength of the effect based on the determination result.
Thereby, in the imaging device 1, the display effect with a more realistic feeling can be set.

The transition setting unit 52 sets an effect based on sensor information and time information of an image displayed after the consecutive images when it is determined that the consecutive images are not related.
Thereby, in the imaging device 1, it is possible to set a display effect with a more realistic feeling than a weight placed on the next image to be displayed.

The transition setting unit 52 sets an effect based on sensor information and time information of each successive image when it is determined that the successive images are relevant.
Thereby, in the imaging device 1, there exists a sense of unity which considered the image before and behind, and it can set the display effect with presence.

The imaging control unit 51 acquires sensor information and time information from a plurality of images.
Thereby, in the imaging device 1, since sensor information and time information are acquired from a plurality of images, it is possible to set various and more realistic display effects.

The imaging control unit 51 acquires sensor information output from an acceleration sensor, a temperature sensor, a sound sensor, an illuminance sensor, a GPS sensor, a pressure sensor, or a fingerprint sensor.
Thereby, in the imaging device 1, since transition according to the environment at the time of photographing can be set using various sensor information, a more realistic display effect can be set.

In addition, the imaging apparatus 1 includes a moving image generation unit 53 that combines a plurality of images into one moving image based on the set effect.
Thereby, in the imaging device 1, a moving image with a transition effect can be generated.

  In addition, this invention is not limited to the above-mentioned embodiment, The deformation | transformation in the range which can achieve the objective of this invention, improvement, etc. are included in this invention.

  In the above-described embodiment, the image sensor may be further utilized. In this case, when the distance to the subject is approaching, it is possible to zoom in, or when the color is the same at the same coordinates in the continuous display image, the portion can be zoomed in / zoomed out.

  In the above-described embodiment, the transition is added when the moving image is generated. However, the transition may be separately added after the moving image is generated. Alternatively, transition settings may be stored separately, and processing may be performed based on the settings when generating or displaying a moving image.

  Further, in the above-described embodiment, the transition is set by considering only the relationship between images. However, a similar switching effect is not selected in consideration of the entire moving image, or Conversely, a similar switching effect may be selected to create a sense of unity.

  Further, in the above-described embodiment, it may be configured to set a transition based on relevance between a pair of images that are front and back in the image order, and the transition setting is determined based on relevance from a plurality of images. It may be configured to do.

  In the above-described embodiment, the transition setting is changed depending on the presence or absence of the relevance between images. However, the transition setting is changed depending on the degree of relevance between images, the similarity of images, or the difference between images. You may comprise as follows.

In the above-described embodiment, the transition may be set based on one sensor information or a plurality of sensor information. When a plurality of sensor information is used, for example, it is bright and noisy. It may be set by combining a combination of transitions using sensor information related to illuminance, sound, and the like indicating that the environment has been changed.
For example, by combining a transition that fades white and a transition that emphasizes a sound source that emits sound, it is possible to display a moving image with higher presence.

  In the above-described embodiment, the sensor information from the sensing function (sensor unit 17) included in the imaging device 1 is used. However, as long as the environment around the imaging device 1 at the time of shooting is sensed. The sensor information may be acquired from the outside (for example, an external server, a wrist terminal, a sensing terminal, etc.).

  Further, in the above-described embodiment, the sensor information is stored in association with the captured image. However, for example, the sensor information may be associated with a date or an ID, or stored in image Exifable image file format (Exifable image file format) information. For example, the captured image itself may be provided with sensor information. The association between the captured image and the sensor information may be at the time of shooting or after the shooting.

  In the above-described embodiment, the sensor information may be configured to be used as an absolute value or a relative value before and after the image. For example, when the sensor information is used as an absolute value, the sensor information is the highest. You may comprise so that an image may be selected automatically and displayed. When used as a relative value, when performing image display or image editing, a transition may be set based on changes before and after sensor information.

  Further, in the above-described embodiment, a plurality of images are continuously displayed by moving images generated in advance, and a transition is sandwiched between the images. However, a slide show may be used to continuously display still images. Alternatively, it may be configured to display so as to sandwich a preset transition between images at the display timing.

  In the above-described embodiment, the present invention is applied to transitions between images. However, an image may be selected based on sensor information or an effect may be applied to a captured image.

  In the above-described embodiment, each sensor information of the entire selected image is normalized. However, the present invention is not limited to this, and only sensor information having a clearly large difference in the entire selected image is normalized. You may comprise.

  In the above-described embodiment, the sensor information that is characteristic is automatically selected from the sensor information of each selected image. However, the present invention is not limited to this, and the user can arbitrarily select sensor information that is characteristic. You may comprise as follows.

In the above-described embodiment, the imaging apparatus 1 to which the present invention is applied has been described using a digital camera as an example, but is not particularly limited thereto.
For example, the present invention can be applied to general electronic devices having a photographing processing function and a moving image generation processing function. Specifically, for example, the present invention can be applied to a notebook personal computer, a printer, a television receiver, a video camera, a portable navigation device, a mobile phone, a smartphone, a portable game machine, and the like.

The series of processes described above can be executed by hardware or can be executed by software.
In other words, the functional configuration of FIG. 3 is merely an example, and is not particularly limited. That is, it is sufficient that the imaging apparatus 1 has a function capable of executing the above-described series of processing as a whole, and what functional blocks are used to realize this function is not particularly limited to the example of FIG.
In addition, one functional block may be constituted by hardware alone, software alone, or a combination thereof.
The functional configuration in the present embodiment is realized by a processor that executes arithmetic processing, and the processor that can be used in the present embodiment is configured by various processing devices such as a single processor, a multiprocessor, and a multicore processor. In addition to the above, these various processing apparatuses and a combination of processing circuits such as ASIC (Application Specific Integrated Circuit) and FPGA (Field-Programmable Gate Array) are included.

When a series of processing is executed by software, a program constituting the software is installed on a computer or the like from a network or a recording medium.
The computer may be a computer incorporated in dedicated hardware. The computer may be a computer capable of executing various functions by installing various programs, for example, a general-purpose personal computer.

  The recording medium including such a program is not only constituted by the removable medium 31 of FIG. 1 distributed separately from the apparatus main body in order to provide the program to the user, but also in a state of being incorporated in the apparatus main body in advance. It is comprised with the recording medium etc. which are provided in. The removable medium 31 is composed of, for example, a magnetic disk (including a floppy disk), an optical disk, a magneto-optical disk, or the like. The optical disc is composed of, for example, a CD-ROM (Compact Disk-Read Only Memory), a DVD (Digital Versatile Disc), a Blu-ray (registered trademark) Disc (Blu-ray Disc), and the like. The magneto-optical disk is configured by an MD (Mini-Disk) or the like. In addition, the recording medium provided to the user in a state of being preliminarily incorporated in the apparatus main body includes, for example, the ROM 12 in FIG. 1 in which a program is recorded, the hard disk included in the storage unit 20 in FIG.

  In the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in time series along the order, but is not necessarily performed in time series, either in parallel or individually. The process to be executed is also included.

  As mentioned above, although several embodiment of this invention was described, these embodiment is only an illustration and does not limit the technical scope of this invention. The present invention can take other various embodiments, and various modifications such as omission and replacement can be made without departing from the gist of the present invention. These embodiments and modifications thereof are included in the scope and gist of the invention described in this specification and the like, and are included in the invention described in the claims and the equivalent scope thereof.

The invention described in the scope of claims at the beginning of the filing of the present application will be appended.
[Appendix 1]
Image acquisition means for acquiring a plurality of images;
Information acquisition means for acquiring sensor information or time information related to photographing a plurality of images acquired by the image acquisition means;
In the case of displaying a plurality of images continuously, setting means for setting the effect at the time of switching the display of the image based on the sensor information or the time information acquired by the information acquisition means;
An image processing apparatus comprising:
[Appendix 2]
A determination means for determining the relevance of the images based on predetermined information between images displayed in succession;
The setting means sets the effect based on a determination result by the determination means;
The image processing apparatus according to appendix 1, wherein:
[Appendix 3]
The predetermined information includes information on photographing time, photographing position, and image content.
The image processing apparatus according to Supplementary Note 2, wherein
[Appendix 4]
The setting means sets an effect type and an effect intensity based on a determination result by the determination means.
The image processing apparatus according to appendix 3, characterized in that:
[Appendix 5]
When the determination unit determines that the consecutive images are not relevant, the setting unit determines the effect based on the sensor information or the time information of the image displayed after the consecutive images. Set
The image processing apparatus according to appendix 3 or 4, characterized in that:
[Appendix 6]
The setting unit sets the effect based on the sensor information or the time information of each of the continuous images when the determination unit determines that the continuous images are relevant.
The image processing apparatus according to any one of appendices 3 to 4, wherein
[Appendix 7]
The information acquisition means acquires the sensor information or the time information from the plurality of images.
The image processing apparatus according to any one of supplementary notes 1 to 6, wherein:
[Appendix 8]
The information acquisition means acquires sensor information output from an acceleration sensor, a temperature sensor, a voice sensor, an illuminance sensor, a GPS sensor, a pressure sensor, or a fingerprint sensor.
Item 8. The image processing apparatus according to appendix 7.
[Appendix 9]
Based on the effect set by the setting means, comprising a synthesizing means for synthesizing the plurality of images into one moving image;
The image processing apparatus according to any one of appendices 1 to 8, wherein
[Appendix 10]
An image acquisition step of acquiring a plurality of images;
An information acquisition step of acquiring sensor information or time information related to the shooting of a plurality of images acquired by the image acquisition step;
In the case of displaying a plurality of images continuously, based on the sensor information or the time information acquired by the information acquisition step, a setting step for setting an effect at the time of switching the display of images;
An image processing method comprising:
[Appendix 11]
Computer
Image acquisition means for acquiring a plurality of images;
Information acquisition means for acquiring sensor information or time information related to photographing of a plurality of images acquired by the image acquisition means;
In the case of displaying a plurality of images continuously, setting means for setting the effect at the time of switching the display of the image based on the sensor information or the time information acquired by the information acquisition means,
A program characterized by functioning as

  DESCRIPTION OF SYMBOLS 1 ... Imaging device, 11 ... CPU, 12 ... ROM, 13 ... RAM, 14 ... Bus, 15 ... Input-output interface, 16 ... Imaging part, 17 ... Sensor unit, 18 ... input unit, 19 ... output unit, 20 ... storage unit, 21 ... communication unit, 22 ... drive, 31 ... removable media, 51 ... shooting control , 52... Transition setting unit, 53... Moving image generation unit, 71... Captured image storage unit, 72.

Claims (11)

Image acquisition means for acquiring a plurality of images;
Information acquisition means for acquiring sensor information or time information related to photographing a plurality of images acquired by the image acquisition means;
In the case of displaying a plurality of images continuously, setting means for setting the effect at the time of switching the display of the image based on the sensor information or the time information acquired by the information acquisition means;
An image processing apparatus comprising: A determination means for determining the relevance of the images based on predetermined information between images displayed in succession;
The setting means sets the effect based on a determination result by the determination means;
The image processing apparatus according to claim 1. The predetermined information includes information on photographing time, photographing position, and image content.
The image processing apparatus according to claim 2. The setting means sets an effect type and an effect intensity based on a determination result by the determination means.
The image processing apparatus according to claim 3. When the determination unit determines that the consecutive images are not relevant, the setting unit determines the effect based on the sensor information or the time information of the image displayed after the consecutive images. Set
The image processing apparatus according to claim 3, wherein the image processing apparatus is an image processing apparatus. The setting unit sets the effect based on the sensor information or the time information of each of the continuous images when the determination unit determines that the continuous images are relevant.
The image processing apparatus according to claim 3, wherein the image processing apparatus is an image processing apparatus. The information acquisition means acquires the sensor information or the time information from the plurality of images.
The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus. The information acquisition means acquires sensor information output from an acceleration sensor, a temperature sensor, a voice sensor, an illuminance sensor, a GPS sensor, a pressure sensor, or a fingerprint sensor.
The image processing apparatus according to claim 7. Based on the effect set by the setting means, comprising a synthesizing means for synthesizing the plurality of images into one moving image;
The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus. An image acquisition step of acquiring a plurality of images;
An information acquisition step of acquiring sensor information or time information related to the shooting of a plurality of images acquired by the image acquisition step;
In the case of displaying a plurality of images continuously, based on the sensor information or the time information acquired by the information acquisition step, a setting step for setting an effect at the time of switching the display of images;
An image processing method comprising: Computer
Image acquisition means for acquiring a plurality of images;
Information acquisition means for acquiring sensor information or time information related to photographing of a plurality of images acquired by the image acquisition means;
In the case of displaying a plurality of images continuously, setting means for setting the effect at the time of switching the display of the image based on the sensor information or the time information acquired by the information acquisition means,
A program characterized by functioning as

Images