JP2016100778A - Image processor, image processing method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processor capable of efficiently obtaining a single moving image having a time-continuity, which is constituted of plural moving images picked up independently.SOLUTION: The image processor selectively reproduces plural moving images, each of which is independently picked up by plural imaging apparatuses at different pick-up time, in a reproduction period of time corresponding to the pick-up time, in which entire period of time (t1-t2, t3-t4, etc.) or a part of period of time (t0-t1,t2-t3, etc.) of any of the plural moving images is aligned to the time axis; to thereby generate a new moving image which has the time continuity. Thus, plural moving images including time-inconsistency can be reproduced as a single moving image having time-consistency.SELECTED DRAWING: Figure 10

Description

  The present invention relates to an image processing apparatus, an image processing method, and a program suitable for use in image processing for moving images taken individually by a plurality of imaging devices.

  For example, at the production site of a television broadcast program, an editing operation is generally performed in which an editor manually switches a plurality of moving images individually shot by a plurality of cameras for the purpose of obtaining a desired effect. .

  In addition, as a technique for automatically switching moving images, for example, moving images simultaneously shot by a plurality of cameras installed in a moving area of a moving object are sequentially switched at intervals according to the speed of the moving object. A technique has been developed that sequentially displays the images (see Patent Document 1).

  According to such a technique, temporal continuity in which each moving image taken by a plurality of cameras is expressed by changing a shooting direction, a field angle, etc., of a series of movements of the same subject such as a moving object, for example. It can be easily reproduced as a single moving image. Here, having temporal continuity means that images of still frames (still images) constituting a moving image maintain a temporal relationship at the time of shooting.

Japanese Patent Laid-Open No. 2004-260781

  However, in the above technique, in order to reproduce the single moving image described above, it is indispensable to perform simultaneous shooting with all of the plurality of cameras, and a moving image with an unnecessarily large file size is required for each camera. There was a problem that the image had to be recorded.

  The present invention has been made in view of such a conventional problem, and is an image processing apparatus capable of efficiently obtaining a single moving image having temporal continuity composed of a plurality of individually captured moving images. An object is to provide an image processing method and a program.

  In order to solve the above-described problem, in the present invention, a plurality of moving images individually shot by a plurality of shooting devices and having different shooting periods correspond to a shooting period of each moving image by synchronizing time axes. A generation means for generating a new moving image having temporal continuity so as to be selectively reproduced during the reproduction period is provided.

  According to the present invention, it is possible to efficiently obtain a single moving image having temporal continuity composed of a plurality of individually captured moving images.

It is a block diagram which shows the moving image shooting system common to each embodiment. It is a block diagram of a digital camera exemplified as an image processing apparatus of the present invention. (A) is a conceptual diagram showing a priority order table, (b) is a conceptual diagram showing a connection order table. It is a flowchart which shows the operation | movement in the group imaging | photography mode in 1st Embodiment. It is a conceptual diagram which shows an example of the memory structure of the moving image file in 1st Embodiment. It is a flowchart which shows the operation | movement in the group reproduction | regeneration mode in 1st Embodiment. It is a flowchart which shows a reproduction | regeneration table creation process. It is a concept which shows an example of a reproduction | regeneration table. It is a concept which shows the other example of a reproduction | regeneration table. It is a schematic diagram which shows the moving image produced | generated in the group reproduction | regeneration mode in 1st Embodiment. It is a figure which shows an example of the moving image corresponding to Fig.10 (a). It is a schematic diagram which shows the moving image produced | generated in the group reproduction | regeneration mode in 1st Embodiment. It is a schematic diagram corresponding to FIG. 10 which shows the modification of 1st Embodiment. It is a schematic diagram corresponding to FIG. 10 which shows the other modification of 1st Embodiment. It is a flowchart which shows the operation | movement by the group imaging | photography mode in 2nd Embodiment. It is a conceptual diagram which shows an example of the memory structure of the moving image file in 2nd Embodiment. It is a flowchart which shows the operation | movement in the group reproduction | regeneration mode in 2nd Embodiment. It is a schematic diagram which shows the moving image produced | generated in the group reproduction mode in 2nd Embodiment.

  Hereinafter, embodiments of the present invention will be described.

  (Embodiment 1)

  FIG. 1 is a configuration diagram showing a moving image shooting system common to the embodiments of the present invention. This moving image photographing system includes a first camera 101, a second camera 102, and a third camera 103 exemplified as an image processing apparatus. In the present embodiment, the first to third cameras 101, 102, and 103 have the same configuration, and have a configuration that enables mutual wired or wireless communication. In the present embodiment, three cameras are included in the moving image shooting system. However, the number of cameras may be two or four or more.

  Here, the configuration of each camera will be described using the first camera 101 as an example. FIG. 2 is a diagram illustrating an electrical configuration of the first camera 101. The first camera 101 has a basic configuration similar to that of a general digital camera and can capture still images and moving images. The first camera 101 mainly includes the control unit 2 and the following units connected to the control unit 2. It consists of.

  The control unit 2 includes a CPU (Central Processing Unit) and its peripheral circuits, various control programs, a ROM (Read Only Memory) in which various other data are stored, a working RAM (Random Access memory), and a clock circuit. Etc., and controls each part of the first camera 101 according to the control program. Further, the control unit 2 functions as a built-in clock having a calendar function by counting the current time by a clock circuit and using the date data in this embodiment.

  The above control program includes AF (Auto Focus) control using a contrast detection method when shooting still images and moving images, AE (Auto Exposure) control including light amount adjustment during flash shooting, and AWB (Auto White Balance). The program used for control and the program for making the control part 2 perform the process mentioned later are contained.

  The various data stored in the ROM includes data constituting the priority table T1 shown in FIG. The priority table T1 is a table showing a plurality of predetermined objects and the priority of each object in the plurality of objects.

  Here, the plurality of objects are expected to be, for example, main subjects when shooting moving images, for example, the face of any unspecified person, the face of a specified person, an animal such as a dog or cat, It is an object such as an automobile and can be recognized from a moving image by using various known image recognition techniques.

  The power supply unit 3 includes a rechargeable battery and a DC / DC converter, and supplies power necessary for each operation to each unit of the first camera 101.

  The lens unit 4 includes a lens group including a focus adjustment lens and a zoom lens, a motor that drives the lens group, a diaphragm, and an actuator that opens and closes the diaphragm to adjust the opening.

  The imaging unit 5 performs predetermined analog processing on a CCD (Charge Coupled Device) or MOS (Complementary Meta10xide Semiconductor) type imaging device and an imaging signal output from the imaging device, and then converts the digital signal into a digital signal. It consists of AFE (Analog Front End). The imaging unit 5 sequentially captures the subject through the lens group of the lens unit 4 while the shooting mode is set in the first camera 101, and supplies the subject image data (imaging data) to the control unit 2. .

  The image data supplied to the control unit 2 is converted into RGB data for each pixel in the control unit 2 and further converted into YUV data including a luminance (Y) component and a color difference (UV) component, and then to the display unit 6. Supplied and displayed as a live view image on the display unit 6.

  The image data converted into the YUV data is compressed as still image data by the JPEG (Joint Photographic Expert Group) method or the like at the time of still image shooting, and various attribute information such as shooting date and time is added. The still image file is stored in the storage unit 7.

  Further, the image data converted into YUV data is sequentially compressed as moving image data in the control unit 2 by the MPEG (Motion Picture Experts Group) method or the like at the time of moving image shooting, and various attributes such as shooting date and time are obtained as in the case of a still image file. The information is added to the storage unit 7 as a moving image file.

  Still image data and moving image data recorded as a still image file and a moving image file in the storage unit 7 are reproduced as necessary. In other words, after being read and expanded by the control unit 2, it is displayed on the display unit 6 as a still image or a moving image.

  The display unit 6 includes, for example, a color liquid crystal display panel and a display driving circuit that drives the color liquid crystal display panel in accordance with image data supplied from the control unit 2. As described above, in the shooting mode, the subject image is displayed. Is displayed in live view, and in the playback mode, still images and moving images that have already been shot are displayed. The display unit 6 also displays character information based on various OSD (On Screen Display) display data supplied from the control unit 2.

  The storage unit 7 includes, for example, a flash memory built in the first camera 101, various memory cards that can be attached to and detached from the first camera 101, and a card interface that enables data input to and output from the memory card. Is done. As described above, the storage unit 7 stores still image and moving image files captured by the first camera 101. The storage unit 7 also stores data constituting a connection order table T2, which will be described later.

  The operation unit 8 includes a plurality of operation keys such as a power key, a shutter key, and a mode switching key used for switching between a photographing mode and a reproduction mode, which are basic operation modes in the first camera 101. The operation state of the operation key in the operation unit 8 is monitored by the control unit 2 as needed.

  The communication unit 9 captures image data (still image file or moving image file) between the second camera 102 and the third camera 103 via a wired or wireless communication line as necessary, and further via another communication device. Data communication including sending and receiving. Captured image data received from the second camera 102 or the third camera 103 by the communication unit 9 is also stored in the storage unit 7.

  The first to third cameras 101 to 103 configured as described above are provided with a group shooting mode as a lower operation mode of the moving image shooting mode and a group reproduction mode as an operation mode lower than the reproduction mode. It has been.

  In the group shooting mode, any one of the first to third cameras 101 to 103 is used as a master (parent) and another camera is used as a slave (child), and the first to third cameras 101 to 103 are used. Is an operation mode in which a moving image is shot by individually operating and all moving images (moving image files) shot and stored by a camera used as a slave are automatically stored in a camera used as a master. In the present embodiment, the first camera 101 is a master, the second and third cameras 102 and 103 are slaves, and the relationship is illustrated in FIG.

  The group playback mode is an operation for newly generating and displaying a single moving image having temporal continuity from a plurality of moving images captured by the first to third cameras 101 to 103 in the group shooting mode. This is an operation mode used in a camera used as a master in the group shooting mode. As described above, having temporal continuity means that the temporal relationship at the time of shooting is maintained for each frame image (still image) constituting the moving image.

  Hereinafter, the operation in the group shooting mode and the operation in the group reproduction mode in the first to third cameras 101 to 103 (hereinafter referred to as each camera) will be specifically described.

  First, the operation of each camera in the group shooting mode will be described. Here, it is assumed that the communication by the communication unit 9 is wireless communication. Also, when using the group shooting mode, it is assumed that the user first performs a setting operation to be used as a master with an arbitrary camera and then performs a setting operation to be used as a slave with another camera. Note that the number of users of each camera is not limited to one, and there may be a plurality of users.

  FIG. 4 is a flowchart showing the processing contents of the control unit 2 in each camera when the group shooting mode is set by the user.

  As shown in FIG. 4, when the group shooting mode is set, in each camera, the control unit 2 causes the user to perform a predetermined setting operation, so that the user's own camera is used as either a master or a slave. It is set whether to do (step SA1).

  When the user's own camera is set as the master by the user (step SA2: YES), the control unit 2 immediately starts communication by the communication unit 9, and sequentially confirms whether there is a connection request from another camera. Processing is started (step SA3).

  Then, when there is a connection request from another camera (step SA3: YES), the control unit 2 registers the camera having the connection request as a slave (step SA4). More specifically, the control unit 2 establishes a communicable state with another camera for which a connection request has been made, and a predetermined camera used for identification from the other camera. The ID is received, and the received camera ID is stored in the working RAM together with the connection order. At that time, the control unit 2 sets the connection order of its own camera as the master as the first, and sets the connection order of the other cameras as the second and the third in the connection order.

  Then, the connection order table T2 as shown in FIG. 2B is stored in the storage unit 7 by repeating the process of step SA4. In FIG. 2B, the camera set as the master is the first camera 101 and its camera ID is “CAM-A”, while the camera ID of the second camera 102 is “CAM-B”. In this example, the camera ID of the third camera 102 is “CAM-C”, and the second camera 102 and the third camera 103 are sequentially connected to the first camera 101.

  In addition, the control unit 2 performs photographing processing according to the user's request at any time in parallel with processing for confirming the presence / absence of a connection request from another camera (step SA5). This process is the same as that in the normal moving image shooting mode. That is, the control unit 2 starts moving image shooting in response to a user's shooting start instruction, and during shooting, ends moving image shooting in response to a user's shooting end instruction. This moving image shooting start and end processing is performed one or more times in response to a user instruction, and one or more moving image files are stored in the storage unit 7.

  Further, in parallel with the above-described processing, the control unit 2 sequentially confirms the presence / absence of a group shooting end instruction by the user, and performs the above-described processing until there is a group shooting end instruction (step SA6: NO). repeat.

  Then, when there is a group shooting end instruction from the user (step SA6: YES), the control unit 2 requests the other cameras registered as slaves to transmit all moving image files stored in the group shooting mode. (Step SA7).

  Thereafter, the control unit 2 receives all moving image files transmitted from other cameras, stores them in the storage unit 7 (step SA8), and ends the processing in the group shooting mode.

  In the process of step SA8, the control unit 2 stores the moving image file recorded by its own camera and the moving image file received from another camera used as a slave so as to be distinguishable.

  FIG. 5 is a diagram conveniently showing an example of a storage structure when a moving image file is stored in the storage unit 7 in the group shooting mode. The illustrated example is an example in the case where a different folder is created for each camera actually used for shooting and a moving image file is stored, and an example in which the above-described camera ID is used for the folder name. For example, “2012/08/01 9:22:02” following the moving image file name “CIM0001.mov” in the “CAM-A” folder is the moving image shooting start date and time.

  On the other hand, unlike the above case, when the user sets his camera as a slave by the user during the process of step SA1 (step SA2: NO), the control unit 2 immediately uses it to identify his camera. The camera ID to be transmitted is transmitted to another camera (step SA9). In such processing, the camera set as the slave establishes a communicable state with the master camera.

  Thereafter, the control unit 2 performs a photographing process according to the user's request as in the normal moving image photographing mode (step SA10). That is, the same processing as step SA5 when the own camera is set as the master is performed as needed. Through such processing, one or a plurality of moving image files are stored in the storage unit 7 even in the camera set as the slave.

  Further, in parallel with the processing, the control unit 2 sequentially confirms whether or not there is a transmission request for the moving image file from the camera set as the master, and until there is a transmission request (step SA11: NO), Repeat the process.

  Then, if there is a moving image file transmission request (step SA11: YES), the control unit 2 is not currently shooting a moving image, that is, if it is in a shooting standby state (step SA12: NO), until that time. All the moving image files stored in the group shooting mode are transmitted to the master camera (step SA14).

  In addition, if the moving image file transmission request is during moving image shooting (step SA12: YES), the control unit 2 automatically ends the shooting and newly stores the moving image file up to that point in the storage unit 7. After storing (step SA13), all moving image files including the same are transmitted to the master camera (step SA14). Thereby, the process by the group photographing mode is finished.

  In moving image shooting using the group shooting mode described above, the shooting positions, field angles, framing, and the like in the first to third cameras 101 to 103 do not need to be fixed and may change.

  Next, the group playback mode described above will be described. Here, an outline of a new moving image reproduced (displayed) in the group reproduction mode and a generation method thereof will be described prior to a specific operation in the group reproduction mode in each camera.

  As described above, a new moving image reproduced in the group reproduction mode is a moving image having temporal continuity using a plurality of moving images photographed by the first to third cameras 101 to 103 in the group photographing mode. It is.

  In addition, when generating the above-mentioned new moving images, the moving images shot by each camera are basically played back in synchronization with the time axis, and there are a plurality of moving images that are candidates for playback during the same playback period. In other words, in the case where all or part of a plurality of moving images exist as playback candidates in the same playback period, all or part of one moving image is set as a playback target according to a predetermined selection criterion. The above moving image is generated by reproduction.

  The above selection criterion is to reproduce a moving image having a priority order of an object existing in the moving image or a priority order in which the connection order of the cameras used for shooting the moving image is in order. The former priority order corresponds to that shown in the priority order table T1 shown in FIG. 3A, and the latter priority order corresponds to the connection order shown in the connection order table T2 shown in FIG. To do.

  FIG. 10A to FIG. 10C show a new moving image generated when the connection order of each camera used for shooting is used as a selection criterion, and a moving image shot by each camera. It is the model which showed the relationship so that it may flow from left to right temporally, and is an example in case the connection order of each camera is the order shown in FIG.3 (b). 10 (a) to 10 (c) represent a plurality of moving images photographed by each camera so as to be distinguishable with different patterns for each camera that photographed each. What is shown as “output” in the lower row is a new moving image that is finally generated.

  On the other hand, FIG. 12A shows a relationship between a new moving image generated when the priority order of objects existing in the moving image is used as a selection criterion and a moving image captured by each camera. It is a schematic diagram. This figure expresses a plurality of moving images taken by each camera in a distinguishable manner with a pattern according to the priority order (1st to 3rd) of an object existing in the moving image. What is shown as “output” at the bottom is a new moving image that is finally generated.

  Hereinafter, the operation of the camera in the group playback mode will be specifically described. Here, it is assumed that the first camera 101 with the camera ID “CAM-A” is used as a master during moving image shooting using the group shooting mode.

  6 and 7 are flowcharts showing the processing contents of the control unit 2 in the first camera 101 when the group playback mode is set by the user.

  As shown in FIG. 6, the control unit 2 starts the process when the group reproduction mode is set by the user, and first causes the user to set the above-described selection criteria (step SB1). At this time, as described above, the selection criteria that can be set by the user are either the priority order of the objects existing in the moving image or the connection order of the cameras used for shooting the moving image. is there.

  Thereafter, the control unit 2 executes a reproduction table creation process prior to generation of a new moving image (step SB2). The reproduction table creation process is a process for creating a reproduction table T3 as shown in FIGS. 8 and 9 in accordance with the selection criteria set by the user.

  Here, the reproduction table T3 is a reproduction start timing (display timing) of each moving image (entire period or partial period) when reproducing the whole period or a part of a plurality of moving pictures taken in the group shooting mode. ) And a moving image to be reproduced, and a reproduction position of the moving image, as shown in the figure, from the reproduction start timing, camera ID, moving image file name, and moving image data Composed.

  In the reproduction table creation processing, the control unit 2 performs the first reproduction from a plurality of moving images that are photographed by the first to third cameras 101 to 103 in the group photographing mode and stored as moving image files in the storage unit 7. The target moving image is determined and the reference time is determined (step SB101).

  In this processing, the control unit 2 sets a moving image having the earliest shooting start time among the plurality of moving images as a first reproduction target, sets a shooting start time of the moving image as a reference time, and sets the reproduction table. The first data constituting T3 is stored in the working RAM.

  That is, the control unit 2 sets the playback start timing (t0) as an initial value of 0 minute 00 seconds, sets the time within the movie as the shooting start time (reference time) of the playback target with the earliest shooting start time, and sets these as the playback target timing. It is stored in the working RAM together with the camera ID and the moving image file name.

  Although not shown in FIG. 7, when there are a plurality of moving images having the earliest shooting start time in the process of step SB101, the control unit 2 selects the moving image having the earliest priority determined based on the selection criterion as a reproduction target. And

  That is, if the selection criterion is the connection order of the cameras used for capturing the moving image, the control unit 2 selects the moving image with the earliest connection order as a reproduction target, and the selection criterion exists in the moving image. If the priority is an object, a moving image in which an object having the highest priority is present is set as a reproduction target. At that time, the control unit 2 detects an object having a predetermined priority for each of a plurality of moving images that are candidates for reproduction, and the moving image having the highest priority of the detected object is detected. Is the playback target.

  Subsequently, the control unit 2 executes the following processing while updating the reproduction time (elapsed time from the reference time), that is, while advancing the reproduction time by unit time (0.01 seconds) (step SB102).

  First, the control unit 2 determines whether there is a moving image whose shooting start time corresponds to the updated reproduction time among other moving images excluding the reproduction target (the first reproduction target at the beginning of the process). It is confirmed whether or not (step SB103).

  Here, if there is no corresponding moving image (step SB103: NO), the control unit 2 confirms whether or not the updated playback time has exceeded the previously set shooting end time of the playback target, and the playback time. Until the shooting end time is exceeded (step SB106: NO), the process returns to step SB102 and the playback time is updated.

  In addition, after updating the playback time, if there is another moving image whose shooting start time is the time corresponding to the updated playback time (step SB103: YES), the control unit 2 selects the moving image as a playback candidate. Then, it is further confirmed whether or not the priority order of the moving image is higher than the reproduction target (step SB104).

  If the priority of the reproduction candidate is lower than the reproduction target (step SB104: NO), the control unit 2 returns to the process of step SB102, and conversely, the priority of the reproduction candidate is higher than the reproduction target. If so (step SB104: YES), the reproduction candidate is set as the next reproduction target (step SB105).

  In such processing, the control unit 2 sets the playback start timing as the elapsed time from the reference time described above to the shooting start time of the moving image to be played back next, and the in-video time as the shooting start time of the next playback target. These are stored in the working RAM as the next data constituting the reproduction table T3 together with the next reproduction target camera ID and moving image file name.

Thereafter, the control unit 2 returns to the process of step SB102, updates the reproduction time, and repeats the above process.
Although not shown in the figure, when there are a plurality of other moving images (playback candidates) whose shooting start time is the time corresponding to the updated playback time in the process of step SB103 described above (here, the group is a group). Since there are three cameras used in the shooting mode and there are two playback candidates), the control unit 2 performs the following processing.

  That is, the control unit 2 checks whether or not the priority order of all playback candidates is higher than the playback target in the process of step SB104. If there is no playback candidate whose priority order is higher than the playback target, step SB102 is performed. Return to the process. Conversely, if there is at least one reproduction candidate whose priority is higher than that of the reproduction target, the control unit 2 performs the process of step SB105 described above, and at that time, if there is a reproduction candidate whose priority is higher than that of the reproduction target. If there are a plurality (two here), the moving image having the highest priority among them is set as the next reproduction target.

  On the other hand, if the updated playback time exceeds the shooting end time to be played back while repeating the playback time update (step SB106: YES), the control unit 2 performs the following processing.

  That is, if the playback target set immediately before is not a moving image that has been shot last when shooting in the group shooting mode is performed (step SB107: NO), the updated playback time is set. It is further confirmed whether or not there is another moving image corresponding to the shooting period, that is, another moving image being shot at the shooting time corresponding to the reproduction time (step SB108).

  If there is another moving image in which the updated reproduction time corresponds to the shooting period (step SB108: YES), the control unit 2 sets the moving image as the next reproduction target (step SB105). That is, if there are a plurality of corresponding moving images, the control unit 2 sets the moving image having the highest priority among them as the next reproduction target, and if there is one corresponding moving image, the moving image Is set as the playback target.

  In such processing, the control unit 2 sets the playback start timing as the elapsed time from the reference time described above to the shooting end time of the immediately preceding playback target, and sets the in-video time as the shooting end time of the immediately preceding playback target, Along with the camera ID and moving image file name to be reproduced, the next data constituting the reproduction table T3 is stored in the working RAM. Thereafter, the control unit 2 returns to the process of step SB102 and repeatedly executes the process described above.

  Unlike the above case, when there is no other moving image whose playback time after the update corresponds to the shooting period (step SB108: NO), the control unit 2 is a non-existing moving image and has a priority order. The dummy moving image treated as the lowest moving image is set as the next reproduction target (step SB109).

  In this process, the control unit 2 sets the playback start timing to a time corresponding to the shooting end time of the playback target set immediately before, and the playback start timing and the video file name indicating the dummy video (“ Only DUMMY.mov ") is stored in the working RAM as the next data constituting the reproduction table T3.

  Thereafter, the control unit 2 returns to the process of step SB102, updates the reproduction time, and repeatedly executes the process described above. Meanwhile, if there is another moving image (playback candidate) whose shooting start time is a time corresponding to the updated playback time (step SB103: YES), the priority of the playback candidate is a dummy video. (Step SB104: YES), the reproduction candidate is set as the next reproduction target (step SB105).

  In this process, the control unit 2 sets the playback start timing as the elapsed time from the reference time described above to the shooting start time of the next playback target, sets the in-video time as the shooting start time of the next playback target, and sets them as the next playback target. Along with the target camera ID and moving image file name, it is stored in the working RAM as the next data constituting the reproduction table T3.

  Thereafter, the control unit 2 returns to the process of step SB102, updates the reproduction time, and repeatedly executes the process described above.

  After that, the control unit 2 repeats the above-described processing, and when the updated playback time exceeds the shooting end time of the playback target set immediately before (step SB106: YES), the playback target is the group shooting. If it is a moving image that has been shot last when shooting is performed in the mode (step SB107: YES), the reproduction table creation processing is terminated at that time, and the processing returns to the processing in FIG.

  The reproduction table T3 as shown in FIGS. 8 and 9 is created by the reproduction table creation process. 8 shows an example in which the above-described dummy moving image is not included in the reproduction target, and FIG. 9 is an example in which the above-described dummy moving image is included in the reproduction target.

  On the other hand, when the above reproduction table creation processing is completed, the control unit 2 executes the processing after step SB3 shown in FIG. 6 according to the reproduction table T3.

  First, the control unit 2 starts reproduction of the first moving image and counting of reproduction time (elapsed time from the start of reproduction of the first moving image) (step SB3).

  In such processing, the control unit 2 confirms the camera ID and moving image file name of the moving image set as the first reproduction target in the reproduction table T3, and then reads out the moving image file specified by them from the storage unit 7. Then, expansion of the moving image file and display of each expanded frame image on the display unit 6 are started.

  Subsequently, the control unit 2 determines whether or not the next reproduction start timing shown in the reproduction table T3 has arrived, that is, whether or not the reproduction time that started counting in the process of step SB3 has reached the next reproduction start timing. Confirm (step SB4). The next playback start timing at the beginning of the process is the timing indicated by t1 in FIGS.

  Then, when the next playback start timing comes (step SB4: YES), the control unit 2 confirms whether or not the next playback target is a dummy video, and if the next playback target is not a dummy video (step SB4). (SB5: NO), reproduction of the next moving image is started (step SB6).

  Specifically, in the process of step SB6, the control unit 2 reads out the next reproduction target moving image file shown in the reproduction table T3 from the storage unit 7, and also displays the moving image file in the reproduction table T3. The processing to start playback from the frame corresponding to the current video time is started.

  As a result, if the next playback target is not a dummy video, the moving image displayed up to that point is the next playback target and is selected by the user while maintaining temporal continuity with it. The priority order corresponding to the selected criterion is switched to a moving image that is higher than the moving image being reproduced.

  Thereafter, the control unit 2 returns to the process of step SB4 and repeats the above-described processes until the reproduction of all moving images shown in the reproduction table T3 is completed (step SB8: NO).

  If the next reproduction target is a dummy moving image while repeating the processing from step SB4 onward (step SB5: YES), the control unit 2 displays the last frame image (still image) of the moving image reproduced immediately before. ) Is started (step SB7), and this is continued until the next playback start timing comes.

  Specifically, for example, when the reproduction table T3 created by the reproduction table creation processing is the one shown in FIG. 9 and the next reproduction start timing is the time indicated by t4, the control unit 2 In the period from the time point to the next reproduction start timing indicated by t5, that is, in the blank period in which the moving image to be reproduced is missing, the image of the last frame of the moving image captured by the first camera 101 (CAM-A) ( (Still image) is displayed continuously.

  Thereafter, the control unit 2 until the reproduction of all the moving images shown in the reproduction table T3 is completed, that is, until the reproduction of the last moving image set as the reproduction target is completed (step SB8: NO). Returning to the process of step SB4, the process described above is repeated.

  And the control part 2 complete | finishes the process by group reproduction | regeneration mode when the reproduction | regeneration of the last moving image is complete | finished (step SB8: YES).

  Through the processing described above, a single moving image having temporal continuity is newly generated from a plurality of moving images individually shot by the first to third cameras 101 to 103 using the group shooting mode. And displayed on the display unit 6.

  At that time, when the connection order of each camera is set by the user as the selection criterion described above, as the new moving image, for example, in the lowermost stage in FIGS. 10 (a) to 10 (c) described above. The moving image shown as “output” is displayed on the display unit 6. 10 (a) and 10 (b) correspond to FIG. 8, and FIG. 10 (c) corresponds to FIG. In other words, when there are moving images with overlapping actual shooting periods, a moving image in which a moving image with a higher priority (connection order) of the cameras used for shooting is reproduced during the playback period with overlapping shooting periods. It is displayed on the display unit 6.

  FIG. 11 shows a part of a plurality of moving images constituting the moving image shown as “output” in FIG. 10A, and the reproduction start timing t8 taken by the second camera 102 (CAM-B). It is a figure which shows the specific example of the moving image between -t9 and the moving image between t9-t10 image | photographed with the 1st camera 101 (CAM-A). Note that this example is an example in which the second camera 102 and the first camera 101 are shooting moving images of the same person at different angles of view from different shooting points.

  10 (a) and 10 (b) are examples in which the reproduction table T3 illustrated in FIG. 8 is used, while FIG. 10 (c) illustrates another reproduction illustrated in FIG. This is an example using the table T3, and there are blank periods A (t4 to t5) and B (t7 to t8) in which a moving image to be reproduced as a new moving image is missing. This is an example in which an image (still image) of the last frame of the immediately preceding moving image is continuously displayed.

  On the other hand, when the priority order of the object existing in the moving image is set by the user as the selection criterion described above, as a new moving image, for example, in the above-described FIG. A moving image indicated as “output” is displayed on the display unit 6. That is, when there are moving images that overlap the actual shooting periods, a moving image in which an object having a higher connection order exists as a subject is displayed on the display unit 6 during the reproduction period that overlaps the shooting periods.

  At that time, when a plurality of moving images having the same shooting period have an object having the same priority as a subject and any one of the plurality of moving images has been reproduced immediately before, the image shown in FIG. As shown in the figure, the same camera (here, the third camera 103 (CAM) is the moving image that was played back immediately before the playback period C in the latter half of the playback start timings t4 to t5 corresponding to the shooting period. The moving image taken in -C)) is continuously displayed.

  As described above, according to the present embodiment, when a single moving image having temporal continuity is obtained from a plurality of moving images individually captured by different cameras, the shooting periods of the plurality of moving images are different from each other. Even in this case, a single moving image having temporal continuity can be obtained without hindrance.

  For this reason, for example, a series of movements of the same subject such as a moving object is photographed by a plurality of cameras, and a series of movements of the same subject is captured using a moving image photographed individually by each camera. When a single moving image expressed while changing the above is obtained, it is not necessary to perform simultaneous photographing with all of a plurality of cameras.

  Therefore, it is not necessary to let all of the multiple cameras perform simultaneous shooting for a long time, and a single moving image having a temporal continuity composed of a plurality of moving images shot individually can be efficiently obtained. be able to.

  In addition, when there is no moving image corresponding to an arbitrary reproduction period of the new moving image among the plurality of moving images, the blank period (A, B in FIG. 10C) is the reproduction period. Since the last frame image (still image) of the immediately preceding moving image is continuously displayed, a single moving image having temporal continuity and having no blank period can be reliably obtained. At the same time, an effect of stop motion can be added to a newly generated moving image.

  In addition, when a new moving image is generated, if there are moving images that overlap the actual shooting periods, the reproduction target of the reproduction period that overlaps the shooting periods is determined based on the connection order of each camera and the object existing in the moving image. Selection is made based on priority, that is, a predetermined selection criterion. That is, the priority order of moving images is determined based on a predetermined selection criterion, and the moving image having the highest priority order is selected as a reproduction target. In other words, the reproduction target is selected so that a moving image with a relatively high priority is inserted within a reproduction period of a moving image with a relatively low priority. Therefore, a moving image having reproducibility can be generated as a single moving image having temporal continuity, and a moving image having contents assumed in advance by the user can be automatically generated.

  In addition, when the connection order of each camera is used as the selection criterion, when a new moving image is generated, if there are moving images that overlap the actual shooting period, the reproduction period overlaps the shooting period. A moving image having a higher priority of the camera used for shooting is automatically reproduced. Therefore, by using the connection order of each camera as a selection criterion, a moving image preferentially using a moving image taken by a more important camera is automatically used as a single moving image having temporal continuity. Can be obtained.

  In this embodiment, as the camera priority order, the connection order that is automatically assigned with the camera used as the master being the first is used. However, the camera priority order is not limited to this. You may make it set.

  In addition, when the priority order of the objects existing in the moving image is used as the selection criterion, when there are moving images in which the actual shooting periods overlap when generating a new moving image, the shooting periods overlap. During the reproduction period, a moving image in which an object having a higher connection order exists as a subject is automatically reproduced. Therefore, by using the priority order of the objects existing in the moving image as the selection criterion, a moving image in which a more important object is photographed is preferentially used as a single moving image having temporal continuity. A moving image can be obtained automatically.

  Moreover, as described above, when a plurality of moving images having the same shooting order exist as a subject in a plurality of moving images having overlapping shooting periods, and any one of the plurality of moving images is reproduced immediately before, the image is reproduced immediately before. The moving image that has been displayed is continuously displayed (see FIG. 12A). Therefore, a moving image having excellent continuity can be obtained as a single moving image having temporal continuity.

  Furthermore, since a plurality of selection criteria are prepared as selection criteria, and the selection criteria to be actually used can be designated as required by the user, the user's intention is obtained as a single moving image having temporal continuity. Can be automatically obtained.

  Here, when a plurality of selection criteria are prepared as the selection criteria as in the present embodiment, when selecting a playback target in a playback period in which a plurality of moving images overlap a shooting period, a plurality of selection criteria are selected. In other words, the reproduction target may be finally selected.

  For example, when the priority order of objects existing in a moving image is used as the selection criterion, and the same connection order exists as a subject in a plurality of moving images having overlapping shooting periods, the following selection criterion Alternatively, the connection order of each camera may be used, and among the plurality of moving images having overlapping shooting periods, a moving image having the earliest priority of the camera that has shot the moving image may be finally selected.

  FIG. 12B is a diagram corresponding to FIG. 12A showing the moving image generated in this case. In the above example, the present embodiment is performed during the reproduction period C from the reproduction start timing t4 to t5. Unlike a form, a moving image shot by a camera with priority 1, for example, the same object exists as a subject, but another moving image having a different angle of view, framing, or the like is reproduced.

  In such a case, it is possible to preferentially use a moving image in which a more important object is photographed and to automatically generate a moving image having a content assumed by the user in advance. Therefore, by applying a plurality of selection criteria in stages and finally selecting a playback target, a moving image that further reflects the user's intention is obtained as a single moving image having temporal continuity. Can be obtained automatically.

(Modification 1)
Further, unlike the above, when the priority order of the objects existing in the moving image is used as the selection criterion, and an object having the same connection order is present as a subject in a plurality of moving images having overlapping shooting periods. Can use a selection criterion based on the shooting state of the object as the next selection criterion. As such a selection criterion, for example, an area ratio of the object in the screen can be used, and in that case, a larger area ratio can be used as the selection criterion.

  FIG. 13A shows the face of a person (arbitrary or specific person) whose priority (priority 1) is the highest among a plurality of objects, and the area of the person's face in the screen It is a figure which shows the example of the moving image produced | generated when using that a ratio is larger as a selection reference | standard. Further, FIG. 13A shows that a person's face is present in the moving images first taken by the first camera 101 (CAM-A) and the second camera 101 (CAM-B), and FIG. This is an example in which the moving image of the first camera 101 (CAM-A) has a larger area ratio of the face F in the screen as shown in FIG.

  In this case, as shown in FIG. 13 (a), the first camera 101 (CAM-A) takes a picture during the reproduction period D from the reproduction start timing t2 to t3 when the photographing periods overlap in both moving images. The moving image is played back.

  Accordingly, by using the selection criterion based on the shooting state of the object as the next selection criterion described above, a moving image in which a more important moving image is preferentially used as a single moving image having temporal continuity. An image can be automatically generated.

(Modification 2)
On the other hand, in the present embodiment, a single moving image having temporal continuity is generated from only a plurality of moving images taken by the first to third cameras 101, 102, 103. Alternatively, the following may be used.

  For example, still image shooting can be performed while the group shooting mode is set as described above, and at the end of the group shooting mode, the still image file is transmitted together with the moving image file from the slave side to the master side camera. When a single moving image having temporal continuity is generated, a still image is selected as a reproduction candidate together with the moving image, and the still image is set as a reproduction target according to the selection criteria described above, and the still image is set for a predetermined period. It may be possible to continuously play back only. In this case, the still image reproduction period may be a period from a time position corresponding to the still image shooting time to a time position after a predetermined time (several seconds) has elapsed.

  FIG. 14 is a diagram showing an example of such a case, and the still image captured by the first camera 101 (CAM-A) having the highest priority, in which the connection order of each camera is used as the selection criterion described above. Is a diagram showing a case where the data is continuously reproduced for a certain period (predetermined time) T (t3 to t4, t10 to t11).

  As described above, when a still image is used together with a moving image as a reproduction candidate, it is possible to add an effect of stop motion that strongly reflects the user's intention to the newly generated moving image.

  In the present embodiment, in the previously described blank period (A and B in FIG. 10C) in which a moving image corresponding to the shooting time does not exist in a newly generated moving image, the immediately preceding moving image is displayed. The image of the last frame is continuously displayed, but the image reproduced during the blank period can be changed as appropriate.

  For example, during the blank period, another previously prepared moving image different from the plurality of moving images may be reproduced and displayed. Further, when the image to be reproduced in the blank period is a moving image, for example, the image of the last frame of the immediately preceding moving image is changed to the image of the final frame of the moving image to be reproduced immediately after the blank period. A moving image representing the changing process may be generated and displayed using a known morphing technique.

  On the other hand, in the present embodiment, when a single moving image having temporal continuity is generated, the above-described reproduction table T3 is created, and a plurality of moving images are selectively reproduced at a predetermined reproduction start timing in accordance therewith. I tried to do it. However, the creation of the playback table T3 is not essential. For example, during playback of a moving image to be displayed in advance, the next playback target, the playback start timing, and the like are sequentially determined so that the next playback target is played back. May be.

  In this embodiment, the camera used as the master is configured to perform only the process of displaying the newly generated moving image. However, the following may be used. For example, the newly generated moving image may be displayed and stored in the storage unit 7 or may be stored in the storage unit 7 without being displayed. Furthermore, a process of outputting the newly generated moving image to a plurality of other cameras and / or other devices used as slaves via the communication unit 9 in real time, for example, a transmission process via the communication unit 9 It may be done.

  In addition, a single moving image having temporal continuity is photographed by the first to third cameras 101, 102, 103 in the group photographing mode, and a plurality of images are collectively stored in the camera used as a master. Although the case where it produces | generates from a moving image was demonstrated, you may make it as follows.

  For example, a moving image (video file) taken by a plurality of other cameras on the slave side is transmitted in real time to the master side camera during the shooting, and the first moving image is being played back on the master side camera. Next, the next playback target is determined, the next playback target is played back, and thereafter, the next playback target is determined and played back during playback of the moving image that is the playback target in advance. Also good.

  Further, in the present embodiment, when generating a single moving image having temporal continuity, a moving image having the earliest shooting start time among a plurality of moving images shot in the group shooting mode is first reproduced. The shooting start time was set as a reference time. However, the reference time may be set to any time as long as it is between the shooting start time of the first captured moving image and the shooting end time of the last captured moving image. For example, the user may set the reference time as appropriate.

  In the present embodiment, a case has been described in which a plurality of individually captured moving images are supplied by communication from a slave-side camera having a group shooting mode as a moving image shooting mode to a master-side camera. In the present invention, the plurality of individually captured moving images may be captured by an arbitrary camera, and the moving image supply method is also arbitrary.

(Embodiment 2)
Next, a second embodiment of the present invention will be described. In the present embodiment, the first to third cameras 101, 102, and 103 shown in FIGS. 1 and 2 perform operations different from those of the first embodiment in the group shooting mode and the group reproduction mode.

  In this embodiment as well, communication by the communication unit 9 of the first to third cameras 101, 102, 103 is wireless communication, and when using the group shooting mode, the user is first set to use as a master with an arbitrary camera. It is assumed that after performing the operation, a setting operation to be used as a slave by another camera is performed.

  Hereinafter, the operation of each camera in the group shooting mode in this embodiment will be described. Also in the group shooting mode in the present embodiment, the camera ID of another camera used as a slave is stored in the camera used as a master together with the connection order. In the present embodiment, in response to the user operating the camera on the master side, the camera that performs moving image shooting is automatically switched in the order of connection.

  Here, when using the group shooting mode, the first camera 101 with the camera ID “CAM-A” is used as the master, while the second camera 102 with the camera ID “CAM-B”, the camera ID. It is assumed that the third camera 102 having “CAM-C” is used as a slave. Also, the connection order is CAM-A, CAM-B, and CAM-C, and the camera that shoots the moving image responds to the operation of the master by the user, and the connection order (CAM-A → CAM-B → CAM- C → CAM-A...

  FIG. 15 is a flowchart showing the processing contents of the control unit 2 in each camera when the group shooting mode is set.

  As shown in the figure, in the first camera 101 set as the master, the control unit 2 executes a camera registration process (step SC1).

  This process establishes a communicable state with the slave camera and records the camera ID of the slave camera in the order of connection in response to the connection request of the slave camera as in the first embodiment. It is processing. However, in the present embodiment, the control unit 2 accepts a connection request from the slave-side camera only for a certain period of time. Also in this embodiment, the control unit 2 sets the connection order of its own camera, which is the master, as No. 1 and sets the connection order of other cameras as No. 2 and No. 3 in the order of connection.

  Thereafter, the control unit 2 executes the following processing using the above connection order as the order of use of the cameras used for shooting.

  First, the control unit 2 initializes a serial number used for the file name of the moving image file (step SC2). Specifically, “0001” is set as the serial number. The serial number is a number that is incremented by 1 each time shooting is switched, corresponding to the number of shootings.

  Subsequently, the control unit 2 stands by until the user starts a shooting start instruction operation. If there is a shooting start instruction operation (step SC3: YES), it immediately starts shooting with its own camera (step SC4).

  Thereafter, when the user performs the first camera switching instruction operation (YES in step SC5), the control unit 2 captures the camera in his / her own camera (step SC6: YES). The start instruction signal and the serial number used for the file name of the moving image file are transmitted wirelessly (step SC7). When the first camera switching instruction operation is performed, the next camera in the order of use is the second camera in the connection order, and the serial number instructed to the camera is “second shooting” because the next shooting is the second shooting. 0002 ".

  In addition, the control unit 2 stops capturing the moving image in parallel with the above processing (step SC8), and the moving image captured by its own camera is stored in the storage unit 7 as a moving image file having a file name including a serial number. Store (step SC9).

  The file name of a specific moving image file is a predetermined prefix “CIMG” with a serial number written in four digits and is stored according to the first camera switching instruction operation. The name is “CIMG0001.mov” as shown in FIG. The moving image file is stored in a GROUP folder that is a specific folder used in the group shooting mode.

  Thereafter, the control unit 2 returns to the process of step SC5 until the user completes a photographing end instruction operation (step SC10: NO), and sequentially confirms the presence / absence of a camera switching instruction operation by the user.

  Then, when there is a second camera switching instruction operation by the user (step SC5: YES), the control unit 2 does not shoot the own camera (step SC6: NO), and the next shooting order is the own. Since it is not a camera (step SC11: NO), a shooting stop instruction signal is transmitted wirelessly to the camera currently shooting at that time, and shooting start and the next serial number are sent to the next camera in the order of use (step SC12). . That is, the control unit 2 instructs the second camera in the order of use to stop photographing, instructs the third camera in the order of use (connection order) to start photographing, and the next photographing is the third photographing. Therefore, “0003” is designated as the serial number.

  Thereafter, the control unit 2 returns to the process of step SC5 until the user completes a photographing end instruction operation (step SC10: NO), and sequentially confirms the presence / absence of a camera switching instruction operation by the user.

  Then, when the user performs the third camera switching instruction operation (step SC5: YES), the control unit 2 is not shooting the own camera (step SC6: NO), but the next shooting order is the own shooting order. Since the camera is a camera (step SC11: YES), a shooting stop instruction signal is wirelessly transmitted to the camera that is currently shooting, and shooting with its own camera is started (step SC13). At this time, the camera that transmits the shooting stop instruction signal is the third camera in the order of use, and although not shown, the control unit 2 takes the fourth shooting for the current camera, “0004” is set as the serial number.

  Thereafter, the control unit 2 returns to the process of step SC5 and repeats the above-described process until the photographing end instruction operation is performed by the user (step SC10: NO).

  In other words, the control unit 2 overlaps the shooting period by repeatedly switching the camera used for shooting between its own camera and each camera on the slave side in a predetermined order every time there is a camera switching instruction operation. Instead, let each camera shoot movies continuously. That is, the control unit 2 causes each camera to perform shooting without causing a blank period without shooting.

  At the same time, each time the camera used for shooting is switched, the control unit 2 increments the serial number used for the file name of the moving image file stored in each camera and causes the slave side camera to use it for the name of the moving image file. It is also used as a file name when moving images are stored as moving image files on the camera.

  Thereafter, when there is a photographing end instruction operation by the user (step SC10: YES), the control unit 2 transmits a photographing end instruction signal to the slave camera (step SC14), and processing in the group photographing mode. Exit.

  In parallel with the above, in the cameras set as slaves (second camera 101 and third camera 102), the control unit 2 performs the following processing.

  That is, the control unit 2 immediately executes a camera registration process when its own camera is set as a slave (step SD1). This process is a process of making a connection request to the master camera and transmitting the own camera ID to the master camera as in the first embodiment.

  Subsequently, when receiving a shooting start instruction signal from the master camera (step SD2: YES), the control unit 2 immediately starts moving image shooting (step SD3). At this time, the control unit 2 stores the serial number received from the master camera together with the imaging start instruction signal in the work RAM.

  When the control unit 2 receives the shooting stop instruction signal from the master camera (step SD4: YES), the control unit 2 immediately stops moving image shooting (step SD5) and then receives the serial number file received together with the shooting start instruction signal. Is stored (step SD6).

  That is, the control unit 2 stores, in the storage unit 7, the moving image captured up to that point as a moving image file having a file name using the received serial number.

  Also on the slave side, as shown in FIG. 16 (a), the file name of the moving image file is added with a serial number with a 4-digit prefix added to a predetermined prefix "CIMG", as with the camera set as the master. Is. The moving image file is stored in a GROUP folder used in the group shooting mode.

  That is, in the second camera 102 in the second shooting order, a moving image file such as “CIMG0002.mov” is stored in the GROUP folder, and in the third camera 102 in the third shooting order, “CIMG0003” is stored in the GROUP folder. A moving image file such as “.mov” is stored.

  Thereafter, the control unit 2 returns to the process of step SD2 and repeats the above-described process until it receives a photographing end instruction signal from the camera on the master side (step SD7: NO).

  After that, when receiving a shooting end instruction signal from the master camera (step SD7: YES), the control unit 2 is immediately in the group shooting mode if the camera is not shooting at that time (step SD8: YES). Terminate the process.

  Conversely, if the camera is currently shooting at that time (step SD8: YES), the control unit 2 immediately stops shooting (step SD9), and the moving image shot up to that point The moving image file having the file name using the serial number received together with the shooting start instruction signal is stored in the storage unit 7 (step SD10), and the processing in the group shooting mode is ended.

  With the above processing, in each camera on the slave side, video shooting is performed within a period in which the shooting period does not overlap with other cameras including the master side camera, and the captured moving image includes the master side camera. Is stored as a moving image file having a file name different from that of the camera.

  FIG. 16A is a conceptual diagram showing a storage structure of a moving image file in the first to third cameras 101, 102, and 103 (shown as camera IDs in the figure) when using the group shooting mode described above. This is an example in the case where 8 movie shootings are performed in the group shooting mode.

  Next, the operation of each camera in the group playback mode in this embodiment will be described. As in the first embodiment, the group playback mode in this embodiment is a single unit having temporal continuity using a plurality of moving images captured by the first to third cameras 101 to 103 in the group shooting mode. In this mode, a moving image is newly generated.

  However, unlike the first embodiment, the group playback mode in the present embodiment can be used not only in the camera used as a master but also in a camera used as a slave. In addition, all the moving image files stored in each camera need to be stored in a camera that uses the group playback mode. However, the method of storing is automatically transmitted / received as in the first embodiment. It may be performed manually.

  Hereinafter, the operation of the camera will be described on the assumption that the group playback mode is used by a camera (first camera 101) used as a master. Here, as illustrated in FIG. 16B, it is assumed that all the moving image files obtained by the respective cameras are stored in the GROUP folder in the storage unit 7.

  FIG. 17 is a flowchart showing the processing contents of the control unit 2 in the first camera 101 when the group playback mode is set by the user.

  As shown in FIG. 17, the control unit 2 starts the processing when the group playback mode is set by the user. First, the number of playback target moving image files stored in the GROUP folder in the storage unit 7. Is confirmed (step SE1).

  Next, the control unit 2 initializes the serial number, sets “1” to the first serial number (n) (step SE2), and then reproduces the moving image file having the first serial number (step SE3). That is, the control unit 2 reads out the moving image file stored in the GROUP folder and first stored in the group reproduction mode from the storage unit 7, expands the moving image file, and displays the expanded frame image display unit 6. Is displayed (step SE3).

  The control unit 2 increments the serial number (n) (step SE5) until the reproduction of all the moving image files stored in the GROUP folder is completed (step SE4: NO), and then sets a new serial number. A moving image file is reproduced (step SE3).

  Thereafter, the control unit 2 repeats the above process, and when the reproduction of all the moving image files stored in the GROUP folder is completed (step SE4: YES), the process in the group reproduction mode is terminated.

  By such processing, a single moving image having temporal continuity is newly generated from a plurality of moving images individually shot by the first to third cameras 101 to 103 using the group shooting mode. At the same time, it is displayed on the display unit 6.

  FIG. 18 shows a newly generated moving image and a moving image taken by each camera when there are eight reproduction target moving image files stored in the GROUP folder as shown in FIG. FIG. 10 is a schematic diagram showing the relationship with FIG. 10 and corresponding to FIG. 10A and the like shown in the first embodiment. The timings indicated by t1 to t7 in FIG. 18 during the reproduction period of the newly generated moving image correspond to the camera switching timing by the user at the time of shooting in the group shooting mode.

  As described above, also in the present embodiment, when a single moving image having temporal continuity is obtained from a plurality of moving images individually shot by different cameras, the shooting periods of the plurality of moving images are different from each other. Even so, a single moving image having temporal continuity can be obtained without hindrance.

  Therefore, as in the first embodiment, it is not necessary for all of the plurality of cameras to perform long-time simultaneous shooting, and a single unit having a temporal continuity composed of a plurality of moving images shot individually. Can be obtained efficiently.

  Moreover, in the group shooting mode of the present embodiment, the control unit 2 of the camera used as the master causes each camera to perform shooting sequentially without causing a blank period without shooting. Therefore, according to the present embodiment, a single moving image having temporal continuity and having no blank period can be obtained with certainty.

  In the present embodiment, in the group shooting mode, a file name including a serial number indicating the shooting order is used as a file name of a moving image file for recording a moving image shot by each camera. The images are played back in the shooting order indicated by the file name. Therefore, it is possible to simplify the processing when generating a single moving image having temporal continuity from each moving image without separately setting the playback order.

  In the present embodiment, the serial number indicating the shooting order is used as the file name of the moving image file. However, the present invention is not limited to this, and the file name of the moving image file may be a name having continuity indicating the shooting order. Any name can be used. Therefore, for example, as a file name of a moving image file, a file name including an alphabet indicating the shooting order in a predetermined digit position can be used. Alternatively, the shooting start time may be used as a file name, and playback may be performed in order of shooting time.

  Further, in the present embodiment, the camera that uses the group playback mode is configured to perform only the process of displaying the newly generated moving image. However, as in the first embodiment, for example, a newly generated moving image Processing for storing the image in the storage unit 7 may be performed, or processing for storing the image in the storage unit 7 without displaying the image may be performed. Furthermore, processing for outputting the newly generated moving image to other cameras and / or other devices in real time, for example, transmission processing via the communication unit 9 may be performed.

  Here, in the first embodiment and the second embodiment described above, the case where the present invention is applied to a digital camera has been described. However, the present invention provides a predetermined image processing function including a moving image reproduction process. If it is provided, it can be realized in other electronic devices other than the digital camera. The present invention can also be realized in a smartphone or a personal computer that is a multi-function mobile phone by supplying a predetermined application program, for example.

As mentioned above, although several embodiment of this invention and its modification were demonstrated, if these are in the range in which the effect of this invention is acquired, it can change suitably, and embodiment after change is also a claim. It is included in the scope of the invention described in the scope of the invention and the invention equivalent to the invention. The invention described in the scope of the claims of the present application will be appended below.
[Claim 1]
A plurality of moving images individually shot by a plurality of shooting devices with different shooting periods are selectively reproduced in a reproduction period corresponding to the shooting period of each moving image with the time axis synchronized. An image processing apparatus comprising generation means for generating a new moving image having continuity.
[Claim 2]
The generation unit synchronizes the time axis of a whole or a partial period of any one of the plurality of moving images based on a predetermined reference time and a shooting time, and a reproduction period corresponding to the shooting period The image processing apparatus according to claim 1, wherein the image processing apparatus selectively reproduces the image.
[Claim 3]
A selection unit configured to select a moving image to be reproduced based on a predetermined selection criterion from a plurality of moving images in which the shooting periods corresponding to the reproduction period overlap among the plurality of moving images;
The generation unit synchronizes the time axis of all or part of the moving image selected as the reproduction target by the selection unit based on a predetermined reference time and a photographing time, and sets the reproduction period corresponding to the photographing period. The image processing apparatus according to claim 1, wherein the image processing apparatus reproduces the image.
[Claim 4]
The image processing apparatus according to claim 3, wherein the selection unit selects a reproduction target by inserting a moving image having a higher priority within a reproduction period of a moving image having a lower priority.
[Claim 5]
The selection means uses the priority order set for each of the plurality of photographing apparatuses as the predetermined selection criterion, and the priority order of the photographing apparatuses used for photographing is high from the plurality of moving images having the photographing periods overlapping. The image processing apparatus according to claim 3 or 4, wherein a moving image is selected as the reproduction target.
[Claim 6]
The priority order set for each of the plurality of photographing devices is that the specific photographing device has the highest priority, and the priority order of the other photographing devices is the specific photographing device prior to photographing the plurality of moving images. The image processing apparatus according to claim 5, wherein the order of connection is connected to.
[Claim 7]
A detection means for detecting a predetermined object from overlapping portions of shooting periods in a plurality of moving images in which the shooting periods overlap;
The selection means uses a priority order of a predetermined object detected by the detection means as the predetermined selection criterion, and a moving image having a high priority order of a photographing apparatus used for photographing from a plurality of moving images having the photographing periods overlapping. The image processing apparatus according to claim 3, wherein an image is selected as the reproduction target.
[Claim 8]
The selection unit detects objects having the same priority order from overlapping portions of shooting periods in a plurality of moving images in which the shooting periods overlap by the detecting unit, and reproduces the moving image of the immediately preceding reproduction period in the plurality of moving images. The image processing apparatus according to claim 7, wherein when a moving image that is a target is included, the moving image is selected as the reproduction target.
[Claim 9]
9. The method according to claim 3, further comprising a determining unit that determines a selection criterion requested by a user from among a plurality of selection criteria as the predetermined selection criterion used by the selecting unit. The image processing apparatus according to item.
[Claim 10]
The selection means applies a plurality of selection criteria, which are the predetermined selection criteria, in a stepwise manner, so that a plurality of moving images in which a shooting period corresponding to the reproduction period is overlapped among the plurality of moving images are selected as reproduction targets. The image processing apparatus according to claim 3, wherein a moving image to be selected is finally selected.
[Claim 11]
The selection means uses the priority order set for each of a plurality of objects and the priority order set for each of the plurality of imaging devices as the predetermined selection criterion, and the imaging period is determined by the detection means. When objects having the same priority order are detected from a plurality of overlapping moving images, the moving image having the highest priority order of the photographing device used for shooting is reproduced from the plurality of moving images. The image processing apparatus according to claim 10, wherein the image processing apparatus is selected as a target.
[Claim 12]
When the predetermined object is detected by the detection means from overlapping portions of the shooting periods in the plurality of moving images in which the shooting periods overlap, the selection unit is configured to detect the moving image of each of the detected predetermined objects. The image processing apparatus according to claim 10, wherein one of a plurality of moving images having the same shooting period is selected as the reproduction target according to a predetermined selection criterion based on a shooting state.
[Claim 13]
The predetermined selection criterion based on the shooting state is an area ratio of the predetermined object in a moving image screen.
The image processing apparatus according to claim 12, wherein the selection unit selects, as the reproduction target, a moving image having a maximum area ratio of a moving image of a predetermined object detected by the detection unit.
[Claim 14]
The plurality of moving images having different shooting periods are stored as files with names having continuity indicating the shooting order, and are moving images whose shooting periods do not overlap each other,
The generating means generates a new moving image having temporal continuity by continuously playing a plurality of moving images having different shooting periods from each other in a shooting order indicated by a file name. The image processing apparatus according to claim 1.
[Claim 15]
It is provided in an imaging device that captures and stores moving images,
Shooting control means for performing shooting control for causing the shooting device and one or a plurality of other shooting devices that perform moving image shooting in cooperation with the shooting device to sequentially perform moving image shooting without overlapping shooting periods. When,
A name having continuity indicating a shooting order according to shooting control by the shooting control means as a name of a file for storing a moving image obtained by moving image shooting in the shooting device and the one or more other shooting devices. And a file name control means for adding
The generation unit generates the new moving image by continuously playing a plurality of moving images obtained by moving image shooting according to shooting control by the shooting control unit, with a shooting order indicated by a file name as a playback order. The image processing apparatus according to claim 14.
[Claim 16]
When there is a blank period in which a moving image to be reproduced is missing in the reproduction period of the new moving image, the generation means generates a predetermined moving image or a predetermined still image different from the plurality of moving images in the blank period. The image processing apparatus according to claim 1, wherein an image is reproduced.
[Claim 17]
The generating means uses a still image captured by the plurality of imaging devices in addition to the plurality of moving images as a reproduction candidate, and the entire period or a partial period of any one of the plurality of moving images and the still image The new moving image is generated by generating a new moving image having temporal continuity by selectively reproducing the image in a reproduction period corresponding to the shooting period while synchronizing the time axis. The image processing apparatus according to claim 1, wherein:
[Claim 18]
The generation unit is configured to capture a plurality of moving images that are individually captured and stored by the plurality of imaging devices, and a total period or a partial period of the plurality of moving images in synchronization with a time axis. The image processing apparatus according to claim 1, wherein the image processing apparatus selectively reproduces during a reproduction period corresponding to.
[Claim 19]
19. The image processing according to claim 1, further comprising storage control means for storing the new moving image generated by the generation means in a storage means as a single file. apparatus.
[Claim 20]
The image processing apparatus according to claim 1, further comprising a display unit that displays the new moving image generated by the generation unit.
[Claim 21]
A plurality of moving images individually shot by a plurality of shooting devices with different shooting periods are selectively reproduced in a reproduction period corresponding to the shooting period of each moving image with the time axis synchronized. An image processing method comprising a generation process for generating a new moving image having continuity.
[Claim 22]
On the computer,
A plurality of moving images individually shot by a plurality of shooting devices with different shooting periods are selectively reproduced in a reproduction period corresponding to the shooting period of each moving image with the time axis synchronized. A program for realizing a generation function for generating a new moving image having continuity.

2 control section 3 power supply section 4 lens section 5 imaging section 6 display section 7 storage section 8 operation section 9 communication section 101 first camera 102 second camera 103 third camera T1 priority order table T2 connection order table T3 reproduction table A Blank period B Blank period C Playback period F Face

Claims (22)

  A plurality of moving images individually shot by a plurality of shooting devices with different shooting periods are selectively reproduced in a reproduction period corresponding to the shooting period of each moving image with the time axis synchronized. An image processing apparatus comprising generation means for generating a new moving image having continuity.   The generation unit synchronizes the time axis of a whole or a partial period of any one of the plurality of moving images based on a predetermined reference time and a shooting time, and a reproduction period corresponding to the shooting period The image processing apparatus according to claim 1, wherein the image processing apparatus selectively reproduces the image. A selection unit configured to select a moving image to be reproduced based on a predetermined selection criterion from a plurality of moving images in which the shooting periods corresponding to the reproduction period overlap among the plurality of moving images;
The generation unit synchronizes the time axis of all or part of the moving image selected as the reproduction target by the selection unit based on a predetermined reference time and a photographing time, and sets the reproduction period corresponding to the photographing period. The image processing apparatus according to claim 1, wherein the image processing apparatus reproduces the image. The image processing apparatus according to claim 3, wherein the selection unit selects a reproduction target by inserting a moving image having a higher priority within a reproduction period of a moving image having a lower priority. The selection means uses the priority order set for each of the plurality of photographing apparatuses as the predetermined selection criterion, and the priority order of the photographing apparatuses used for photographing is high from the plurality of moving images having the photographing periods overlapping. The image processing apparatus according to claim 3 or 4, wherein a moving image is selected as the reproduction target.   The priority order set for each of the plurality of photographing devices is that the specific photographing device has the highest priority, and the priority order of the other photographing devices is the specific photographing device prior to photographing the plurality of moving images. The image processing apparatus according to claim 5, wherein the order of connection is connected to. A detection means for detecting a predetermined object from overlapping portions of shooting periods in a plurality of moving images in which the shooting periods overlap;
The selection means uses a priority order of a predetermined object detected by the detection means as the predetermined selection criterion, and a moving image having a high priority order of a photographing apparatus used for photographing from a plurality of moving images having the photographing periods overlapping. The image processing apparatus according to claim 3, wherein an image is selected as the reproduction target. The selection unit detects objects having the same priority order from overlapping portions of shooting periods in a plurality of moving images in which the shooting periods overlap by the detecting unit, and reproduces the moving image of the immediately preceding reproduction period in the plurality of moving images. The image processing apparatus according to claim 7, wherein when a moving image that is a target is included, the moving image is selected as the reproduction target.   9. The method according to claim 3, further comprising a determining unit that determines a selection criterion requested by a user from among a plurality of selection criteria as the predetermined selection criterion used by the selecting unit. The image processing apparatus according to item.   The selection means applies a plurality of selection criteria, which are the predetermined selection criteria, in a stepwise manner, so that a plurality of moving images in which a shooting period corresponding to the reproduction period is overlapped among the plurality of moving images are selected as reproduction targets. The image processing apparatus according to claim 3, wherein a moving image to be selected is finally selected. The selection means uses the priority order set for each of a plurality of objects and the priority order set for each of the plurality of imaging devices as the predetermined selection criterion, and the imaging period is determined by the detection means. When objects having the same priority order are detected from a plurality of overlapping moving images, the moving image having the highest priority order of the photographing device used for shooting is reproduced from the plurality of moving images. The image processing apparatus according to claim 10, wherein the image processing apparatus is selected as a target. When the predetermined object is detected by the detection means from overlapping portions of the shooting periods in the plurality of moving images in which the shooting periods overlap, the selection unit is configured to detect the moving image of each of the detected predetermined objects. The image processing apparatus according to claim 10, wherein one of a plurality of moving images having the same shooting period is selected as the reproduction target according to a predetermined selection criterion based on a shooting state. The predetermined selection criterion based on the shooting state is an area ratio of the predetermined object in a moving image screen.
The image processing apparatus according to claim 12, wherein the selection unit selects, as the reproduction target, a moving image having a maximum area ratio of a moving image of a predetermined object detected by the detection unit. The plurality of moving images having different shooting periods are stored as files with names having continuity indicating the shooting order, and are moving images whose shooting periods do not overlap each other,
The generating means generates a new moving image having temporal continuity by continuously playing a plurality of moving images having different shooting periods from each other in a shooting order indicated by a file name. The image processing apparatus according to claim 1. It is provided in an imaging device that captures and stores moving images,
Shooting control means for performing shooting control for causing the shooting device and one or a plurality of other shooting devices that perform moving image shooting in cooperation with the shooting device to sequentially perform moving image shooting without overlapping shooting periods. When,
A name having continuity indicating a shooting order according to shooting control by the shooting control means as a name of a file for storing a moving image obtained by moving image shooting in the shooting device and the one or more other shooting devices. And a file name control means for adding
The generation unit generates the new moving image by continuously playing a plurality of moving images obtained by moving image shooting according to shooting control by the shooting control unit, with a shooting order indicated by a file name as a playback order. The image processing apparatus according to claim 14.   When there is a blank period in which a moving image to be reproduced is missing in the reproduction period of the new moving image, the generation means generates a predetermined moving image or a predetermined still image different from the plurality of moving images in the blank period. The image processing apparatus according to claim 1, wherein an image is reproduced. The generating means uses a still image captured by the plurality of imaging devices in addition to the plurality of moving images as a reproduction candidate, and the entire period or a partial period of any one of the plurality of moving images and the still image The new moving image is generated by generating a new moving image having temporal continuity by selectively reproducing the image in a reproduction period corresponding to the shooting period while synchronizing the time axis. The image processing apparatus according to claim 1, wherein:   The generation unit is configured to capture a plurality of moving images that are individually captured and stored by the plurality of imaging devices, and a total period or a partial period of the plurality of moving images in synchronization with a time axis. The image processing apparatus according to claim 1, wherein the image processing apparatus selectively reproduces during a reproduction period corresponding to.   19. The image processing according to claim 1, further comprising storage control means for storing the new moving image generated by the generation means in a storage means as a single file. apparatus.   The image processing apparatus according to claim 1, further comprising a display unit that displays the new moving image generated by the generation unit.   A plurality of moving images individually shot by a plurality of shooting devices with different shooting periods are selectively reproduced in a reproduction period corresponding to the shooting period of each moving image with the time axis synchronized. An image processing method comprising a generation process for generating a new moving image having continuity. On the computer,
A plurality of moving images individually shot by a plurality of shooting devices with different shooting periods are selectively reproduced in a reproduction period corresponding to the shooting period of each moving image with the time axis synchronized. A program for realizing a generation function for generating a new moving image having continuity.

Images