JP2006340108A - Image processing unit, image processing method, program, and storage medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image processing unit capable of facilitating extraction of a partial image for creating a digest image to improve an edit property. <P>SOLUTION: A video camera 100 comprises: a camera section 101 for obtaining a dynamic image of an object as image data; a storage medium 105 for recording the image data as a dynamic image file, and a performance information input section 106 for obtaining a record value indicating performance information regarding a predetermined performance for evaluating the object. Every time the record value is updated, chapter information is written as image separating information in a management file for writing management information for managing the dynamic image file during recording in the storage medium 105 in order to partition the dynamic image during recording. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an image processing apparatus, an image processing method, a program, and a storage medium, and in particular, an image processing apparatus, an image processing method, and an image processing apparatus capable of searching for a desired image from a plurality of images using information related to the image. The present invention relates to a program and a storage medium.

  Currently, digital broadcasting or the like is possible by performing stream reproduction (in-stream playback) for reproducing a moving image in real time while transferring video data corresponding to the moving image (hereinafter referred to as “video stream”). In digital broadcasting, metadata including event definition information that defines an event in the video stream, structure information that defines the structure of the video stream, and the like is distributed as index information together with the video stream.

  A digest apparatus that creates a digest video from a video stream distributed by the digital broadcasting has been proposed (see, for example, Patent Document 1). The digest device sets a corresponding numerical value as a predetermined parameter based on an index in the video information, and generates numerical video information expressing the content of the video information by a change in the numerical value based on the index and the numerical value. It is configured. As a result, it is possible to determine which of the events in the video stream is an important event based on the change in the numerical value of the generated numerical video information, and from the video information without human intervention. A digest video can be easily created.

Also, in this digest apparatus, in order to cut out the video to be used as the digest video for the parameter type, the user's favorite event and the value assigned to the event, the total time of the digest video to be created, and the numerical value of the numerical video information It is possible to designate a peak point serving as a reference for the above, and it is possible to create a digest video reflecting the user's preference.
JP 2000-261754 A (paragraphs [0031] and [0109] to [0112], FIG. 1)

  However, in the digest device, when a digest video is created from a video of content in which similar scenes are repeated (hereinafter referred to as “continuous video”), a change in the numerical value of the numerical video information is small in the continuous video. For example, a continuous video shot by a car mounted on a racing car traveling around a single course, or a continuous video of a ski jumping event shot at a single location in a single venue, video for each lap or competitor There is little difference above. For this reason, it is difficult to create metadata to be added to the video stream and distributed based on the difference in the video. As a result, it is difficult to create a digest video by searching (extracting) a desired partial video to be used as a digest video from the continuous video based on the metadata.

  An object of the present invention is to provide an image processing apparatus, an image processing method, a program, and a storage medium, which can easily extract a partial video for creating a digest video and improve editability.

  In order to achieve the above object, an image processing apparatus of the present invention inputs an image to a predetermined storage medium in an image processing apparatus capable of searching for a desired image from a plurality of images using information related to the image. An image input unit that performs input of predetermined related information related to the image, and an image that divides the image being input as a divided image in synchronization with the input of the related information by the related information input unit The image forming apparatus includes: a dividing unit; and a metadata creating unit that creates metadata for associating the input related information with the divided image.

  In order to achieve the above object, an image processing method according to the present invention is an image processing method for searching for a desired image from a plurality of images using information related to the image. An image input step for inputting, a related information input step for inputting predetermined related information related to the image, and the image being input is divided into divided images in synchronization with the input of the related information in the related information input step. An image dividing step, and a metadata creating step for creating metadata for associating the input related information with the divided image.

  In order to achieve the above object, a program according to the present invention is a program that causes a computer to execute an image processing method for retrieving a desired image from a plurality of images using information related to the image. An image input module for inputting to a storage medium, a related information input module for inputting predetermined related information related to an image, and an image being input being divided in synchronization with the input of the related information by the related information input module An image dividing module that divides the image as an image, and a metadata creation module that creates metadata for associating the input related information with the divided image.

  In order to achieve the above object, a storage medium of the present invention stores the above program.

  According to the present invention, the input image is divided as a divided image in synchronization with the input of predetermined related information related to the image, and the divided image and the related information are associated one-to-one by creating metadata. In addition, it is possible to easily search and extract divided images based on related information using metadata, thereby improving editability when creating a digest video.

  Also, by creating a playlist in which the divided images are arranged in the reproduction order in which the rearrangement is performed according to the predetermined rearrangement condition based on the related information, the reproduction order of the divided images matches the reproduction order desired by the user. It is possible to simplify the creation of a digest video.

  Furthermore, by adding a partial image corresponding to a predetermined time continuous to the reproduction time of the divided image in the adjacent divided image adjacent to the divided image to the divided image as a marginal image, the reproduction time of the divided image is lengthened. And the editability of the divided images can be improved.

  Further, by configuring the metadata so that the prohibition information for prohibiting the addition of the marginal image can be written, the addition of the marginal image and the prohibition thereof can be easily set. Can be further improved.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a block diagram schematically showing a configuration of an image processing apparatus according to an embodiment of the present invention.

  A video camera 100 as an image processing apparatus according to the present embodiment has a shooting function for shooting a moving image of a subject and an input function for inputting the shot moving image to another device such as a video tape recorder.

  In FIG. 1, a video camera 100 includes a camera unit 101 that acquires a moving image of a subject as video data, and a signal that performs predetermined signal processing on a signal input from the camera unit 101 and converts the signal into a standardized video signal. A processing unit 102 and an image process for converting the video signal input from the signal processing unit 102 into a signal suitable for recording on a video tape recorder (hereinafter referred to as “video data”) and performing encoding processing and decoding processing Unit 103, a randomly accessible storage medium 105 such as a memory card or a disk medium, a media interface (media I / F) 104 for writing and reading video data and predetermined data to and from the storage medium 105, a subject Wireless communication or wired communication with recorded values indicating the grade information related to predetermined grades The obtained result information input unit 106, a microcomputer (hereinafter referred to as “microcomputer”) 107 that comprehensively controls the entire video camera 100, and image signals and audio that constitute video data input from the image processing unit 103 And an output unit 111 that outputs a signal to the outside.

  The camera unit 101 and the signal processing unit 102 realize the shooting function of the video camera 100. The storage medium 105 records the video data input via the media I / F 104 as one or a plurality of moving image files.

  The microcomputer 107 creates metadata including a plurality of related information related to the video data so as to be suitable for storage in the storage medium 105, and writes and reads metadata to and from the storage medium 105. A playlist creating unit 109 that creates a playlist in which a plurality of video data is arranged in a predetermined reproduction order, and a deletion list that creates a deletion list for setting a predetermined deletion order for the plurality of video data And a creation unit 110. Further, the metadata processing unit 108 is configured to write the recording value input from the grade information input unit 106 to the created metadata.

  FIG. 2 is a flowchart of metadata creation processing executed by the microcomputer 107 during moving image recording of the video camera 100 of FIG.

  In FIG. 2, first, the microcomputer 107 waits for the grade information input unit 106 to input a recorded value to the metadata processing unit 108, and the recorded value input from the grade information input unit 106 should be updated. When it is determined (YES in step S201), the chapter information is written as image delimiter information in the management file for writing management information for managing the moving image file being recorded by the storage medium 105 (step S202). At this time, the metadata processing unit 108 creates metadata including a recording value before update as related information related to the moving image file divided by the chapter information (step S203). The metadata associates the image divided by the chapter information with the information included in the metadata on a one-to-one basis, and makes it possible to determine the reproduction start point and the reproduction end point of the corresponding divided image. In subsequent step S204, the microcomputer 107 transmits the metadata created by the metadata processing unit 108 to the storage medium 105, stores it as a metadata file, and ends this processing.

  According to the process of FIG. 2, chapter information is written in the management file of the moving image file every time the recorded value measured objectively is updated (step S202), so that the moving image being recorded is easily divided. This makes it possible to improve editability when creating a playlist or digest video, which will be described later.

  Further, every time chapter information is written, metadata is created and saved (steps S203 and S204), so even if the difference in video before and after the recorded value is updated is measured objectively. Based on the recorded value, metadata that can determine the playback start point and playback end point of the corresponding partial video can be created, and the image divided by the chapter information and the information included in the metadata are one-to-one. Can be associated with each other, and editability when creating a playlist or digest video, which will be described later, can be further improved.

  A first example of the image processing apparatus according to this embodiment will be described below.

  The image processing apparatus according to the present embodiment is an in-vehicle camera of a racing car that goes around a single course in a circuit field.

  FIG. 3A is a diagram schematically showing the configuration of the circuit field, and FIG. 3B is a timing related to the photographing process of the in-vehicle camera of the racing car that circulates in the circuit field of FIG. 3A. It is a chart.

  In FIG. 3A, a course road surface 31 on which a racing car as a moving body can freely turn is provided in the circuit field. On the course road surface 31, a control line 35 indicating a starting point and an ending point serving as a reference for the circulation of the racing car is drawn, and a magnet 36 is embedded in the basement of the control line 35. On the course road surface 31, for example, two racing cars 30 and 75 go around.

  The racing car 30 includes a magnetic sensor 32 for sensing magnetism from the magnet 36, a stopwatch 33 for measuring a lap time in synchronization with a magnetic sensing signal from the magnetic sensor 32, and an in-vehicle camera connected to the stopwatch 33. As a video camera 34. The video camera 34 connected to the stopwatch 33 is configured in the same manner as the video camera 100 of FIG. 1, and the stopwatch 33 functions as the result information input unit 106.

  The racing car 75 is configured in the same manner as the racing car 30, and includes a magnetic sensor 72, a stopwatch 73, and a video camera 74 as an in-vehicle camera connected to the stopwatch 33.

  As shown in the timing chart of FIG. 3B, when recording (recording) of a moving image is started using the video camera 74, first, the media I / F 104 performs an I / F process from the camera unit 101. In order to record a moving image as video data in the storage medium 105, a moving image file having a file name “01.mpg” is created, and moving image shooting is started as shooting processing.

  The racing car 75 that has entered the round course road surface 31 passes on the control line 35. While the event that the racing car 75 passes on the control line 35 is occurring, for example, at the timing of time T1, the magnetic sensor 72 senses the magnetism of the magnet 36, and the stopwatch 73 is 1 Start measuring the lap time of the lap. In addition, the media I / F 104 writes chapter information indicating image separation information for the first round in the management file of the moving image file as the division process.

  Thereafter, the racing car 75 continues to circulate on the circuit course surface 31 and passes again on the control line 35 at the timing of time T2. At the timing of time T2, the magnetic sensor 72 senses the magnetism of the magnet 36, and the stopwatch 73 ends measuring the lap time for the first round and starts measuring the lap time for the second round. The measured first lap lap time is input to the microcomputer 107 as a recorded value.

  Further, at the timing of time T2, the media I / F 104 writes the chapter information indicating the image separation information for the second round in the management file of the moving image file as the division process. As a result, the video data 310a of the first video A can be specified in the moving image file.

  Further, at a timing after time T2 in FIG. 3B, the metadata processing unit 108 in the microcomputer 107 creates the metadata 400a shown in FIG. 4A associated with the video data 310a of the video A, It is stored in the storage medium 105 together with the moving image file.

  As shown in FIG. 4A, the same file name as the moving image file storing the video data 310a is given to the metadata 400a. In the metadata 400a, the file name, the recorded value as the measured lap time, the recording type indicating the type of the recorded value, and the recorded value are discontinuous at a time T shown in FIG. 3B. Recording continuity indicating whether it is normal or continuous in time by “OFF” or “ON”, and recording indicating information “75” regarding the racing car 75 as a generator of the recording value The start position and the end position are recorded as information indicating the generation position and the input position of the moving image with respect to the moving image file.

  Regarding the metadata 400a, “ON” or “OFF” selected in advance by the user is set in the recording continuity, and what is registered in advance by the user is set in the recording generator. Note that the recording continuity may be configured such that “ON” is automatically set when the stopwatch 73 is connected to the video camera 74 as the grade information input unit 106.

  Thereafter, the same processing as described above is performed at the times T3 and T4, for example, at the timing of time T3 and T4 until the end of recording in accordance with the circulation of the racing car 75. As a result, the video data 310b of the video B for the second round and the video data 310c of the video C for the third round are recorded in the video file, and the video data 310b of the video B is recorded on the storage medium 105 together with the video file. The metadata 400b shown in FIG. 4B and the metadata 400c shown in FIG. 4C related to the video data 310c of the video C are stored.

  Similarly, in the video camera 34, the same processing as described above is performed at the times T1, T2, T3, and T4 in the time from the start of recording to the end of recording in accordance with the lap of the racing car 30. . As a result, the moving image file with the file name “01.mpg” contains the video data 310d of the first round of video D, the video data 310e of the video E of the second round, and the video data 310f of the video F of the third round. 4D is recorded in the storage medium 105 together with the moving image file, the metadata 400d shown in FIG. 4D associated with the video data 310d of the video D, and the video data 310e of the video E shown in FIG. 4e and the metadata 400f shown in FIG. 4 (f) associated with the video data 310f of the video F are stored. For example, information “30” related to the racing car 30 is set in the record generator of the metadata 400d to 400f.

  FIG. 5 is a flowchart of the playlist creation process executed by the playlist creation unit 109 in FIG.

  This process is a process for creating a file (hereinafter referred to as “playlist”) in which video data 310a to 310c corresponding to videos A to C of a moving image file are arranged in a predetermined order.

  5, first, in step S1001, the metadata 400a to 400c shown in FIGS. 4A to 4C are read to determine whether or not the recording continuity is “ON” (step S1002). When the property is “ON”, a predetermined margin time set in advance for each of the video data 310a to 310c is read (step S1003). The extra time is a time added before and after the reproduction time of each video data 310a to 310c, and corresponds to a predetermined reproduction time of video data continuous before and after the reproduction time of each video data.

  In the subsequent step S1004, as shown in FIG. 3B, the marginal images 320a and 320a 'corresponding to the marginal time are added to the video A to create video data 300a. Similarly, marginal images 320b and 320b 'are added to video B to create video data 300b, and marginal images 320c and 320c' are added to video C to create video data 300c. Accordingly, the video data 300a corresponding to the video A can be started to be played back by the extra time set in the marginal image 320a from the video A in the first round, and the marginal image 320a ′ from the video A can be started. Thus, it is possible to end the reproduction delayed by the extra time set in (2), and the reproduction time of the video A can be extended more than the video data 310a. Similarly, the video data 300b corresponding to the video B and the video data 300c corresponding to the video C also have a longer playback time than the video data 310b and the video data 310c. When a marginal image is added, it is preferable to change the values of the start position and end position of the corresponding metadata or create corresponding new metadata.

  In the subsequent step S1005, a file in which the video data 300a to 300c to which the marginal images 320a to 320c ′ are added is arranged in a predetermined order, for example, the order in which the photographing times are early (the order in which the metadata start time is early) , Called “playlist”). This playlist is reproduced via the output unit 111 automatically or by a predetermined operation of the user.

  As a result of the determination in step S1002, when the recording continuity is “OFF”, the playlist is arranged in the order of the times when the video data 310a to 310c to which the marginal images 320a to 320c ′ are not added are photographed. Is created.

  According to the process of FIG. 5, since the marginal images 320a to 320c ′ are added to the video data 310a to 310c of the videos A to C (step S1004), when the created playlist is reproduced, the videos A to The user can grasp the state of the racing car 75 even during the time when the racing car 75 passes the control line 35, the time after the passing completely, etc. it can.

  Further, the video data to which the marginal image is added is arranged by executing the processing of FIG. 5 for the video data of the videos D to F corresponding to the metadata 400d to 400f of FIGS. It is possible to create a play list for the racing car 30.

  FIG. 6 is a diagram showing a state when the moving image file shot by the video camera 34 and the video camera 74 in FIG. 3A is copied to the third video camera.

  A third video camera 50 in FIG. 6 is configured in the same manner as the video camera 100 in FIG. 1 and includes a storage medium 105 of the video camera 50. The video camera 50 may be a video tape recorder that does not include the camera unit 101 and the signal processing unit 102 in FIG. Further, as shown in FIG. 6, the video camera 34 and the video camera 74 in FIG. 3A are connected to the video camera 50. Note that only one of the video camera 34 and the video camera 74 may be connected to the video camera 50.

  In FIG. 6, a moving image file to be copied is input from the connected video camera 74 to the storage medium 105 of the video camera 50 together with metadata 400 a to 400 c corresponding to the video data 310 a to 310 c of the videos A to C. The At this time, the metadata processing unit 108 of the microcomputer 107 of the video camera 50 changes the file name of the input moving image file and the file name of the metadata according to a predetermined change rule.

  Specifically, the file name of the metadata 400a ′ created in the storage medium 105 of the video camera 50 when the metadata 400a is input, the record value generator “75” of the input metadata, and the file name Change the file name to “75_01.mpg” combined with “01.mpg”. Note that the file name of the moving image file created (copied) in the storage medium 105 by inputting the moving image file from the video camera 74 is also changed in the same manner as the metadata. In other words, the change rule is to add the record generator of the input metadata to the head of the file name of the input metadata or moving image file.

  In addition, the metadata processing unit 108 of the video camera 50 inputs the metadata 400d ′ metadata file name created in the storage medium 105 of the video camera 50 by inputting the metadata 400d from the connected video camera 34. The file name “30_01.mpg” is a combination of the record value generator “30” of the input metadata and the file name “01.mpg”. Note that the file name of the moving image file created (copied) in the storage medium 105 by inputting the moving image file from the video camera 34 is also changed in the same manner as the metadata.

  As described with reference to FIG. 6, the video camera 50 creates metadata in which the file name of the input metadata is changed according to a predetermined change rule, so that the video created by the plurality of video cameras 34 and 74 is created. Even if the file names are the same, it is possible to prevent duplication of the metadata file name and the copied movie file name. As a result, the user does not need to change the file name of the copied moving image file, and the user operability can be improved.

  In the description using FIG. 6 above, the moving image file created by the video cameras 34 and 74 is copied to the video camera 50. However, the playlist created by the video cameras 34 and 74 may be copied. The video data 310a to 310c to be copied may be video data 300a to 300c to which marginal images 320a to 320c 'are added.

  The video camera 50 may also execute the playlist creation process of FIG. 5 for a plurality of copied moving image files, for example, two moving image files whose file names are “75_01.mpg” and “30_01.mpg”. Good. In this case, for example, as shown in FIG. 7, the start position of the metadata 400a of the moving image file with the file name “75_01.mpg” is the start position of the metadata 400d of the moving image file with the file name “30_01.mpg”. Therefore, a playlist in which the playlists in the playback order of the video data 300d, 300e, and 300f are combined with the playlists in the playback order of the video data 300a, 300b, and 300c is created. By reproducing this playlist, the user can grasp the state of the racing car 30 after grasping the state of the racing car 75.

  FIG. 8 is a flowchart of playlist change processing for changing the reproduction order of video data in the playlist as shown in FIG.

  In this process, the arrangement of the video data in the playlist of FIG. 7 created by the video camera 50 is any one of the arrangements shown in FIGS. 9A to 9C based on the recorded values. It is a process to change to one array. The video data will be described by taking video data to which a marginal image is added as an example.

  In FIG. 8, first, when the user desires to change the reproduction order of video data by specifying the order of recorded values of metadata as the sorting condition and rearranging the arrangement of video data in the playlist. (YES in step S1101), it is determined whether or not the reordering conditions specified by the user are in the ascending order of the recorded values of the metadata (step S1102), and when the reordering conditions are in ascending order, A metadata recorded value corresponding to all the video data in the playlist is read (step S1103), and a new playlist in which the video data array in the playlist is rearranged so that the metadata recorded values are in ascending order. After creating (step S1104), the process is terminated.

  FIG. 9A shows the playlist created in step S1104. In the playlist shown in FIG. 9A, the arrangement of the video data corresponding to the videos A to F is rearranged in the order from the smallest recorded value of the metadata, that is, from the fastest lap time of the racing cars 30 and 75.

  In addition, when the sorting condition specified by the user is not in ascending order of the recorded values of metadata (NO in step S1102) but in the descending order (YES in step S1105), all the videos in the playlist are included. The corresponding metadata recorded values are read (step S1106), a new playlist is created by rearranging the video data arrangement in the playlist so that the metadata recorded values are in descending order (step S1107). This process ends.

  FIG. 9B is a diagram showing the playlist created in step S1107. In the playlist shown in FIG. 9B, the arrangement of the video data corresponding to the videos A to F is rearranged in the descending order of the recorded values of the metadata, that is, the lap times of the racing cars 30 and 75 are late.

  In addition, the sorting condition specified by the user is not in the order of increasing or decreasing the recorded value of metadata (NO in step S1102 and step S1105), but in the order close to a predetermined reference value (specified value), and video When the user designates a reference value for rearranging the arrays A to F (step S1108), metadata recorded values corresponding to all the videos in the playlist are read (step S1109), and the metadata recording is performed. A new playlist is created by rearranging the arrangement of the video data in the playlist so that the values are in the order close to the designated reference value (step S1110), and the process is terminated.

  FIG. 9C is a diagram showing the playlist created in step S1110. In the playlist shown in FIG. 9C, the video A is recorded in the order in which the recorded value of the metadata is close to the designated reference value, that is, the lap time of the racing cars 30, 75 is close to the reference time, for example, “1 minute 55 seconds”. The arrangement of the video data corresponding to .about.F is rearranged.

  According to the process of FIG. 8, the arrangement of the video data in the playlist is rearranged based on the recorded values in the metadata measured and written objectively (steps S1104, S1107, S1110). A playlist in which the data arrangement is rearranged can be created, and the user can easily edit the playback order of videos in the playlist. Specifically, the reproduction order desired by the user is determined based on the arrangement of the video data in the playlist created by the processing of FIG. 5 (the order of the time when the video was taken (the order of the start time of the metadata is early)). For example, the order of recorded values measured objectively can be matched.

  In the processing of FIG. 8, the rearrangement targets are all the moving image files (videos A to F) in the playlist. However, the specified recording can be performed by configuring the metadata recording generator to be specified. You may limit to the moving image file relevant to a generating person. As a result, it is possible to create a playlist composed only of a designated recording generator, that is, a moving image file copied from a specific video camera.

  In steps S1104, S1107, and S1110, a new playlist is created. However, the created playlist may be rewritten without creating a new playlist.

  A second example of the image processing apparatus according to this embodiment will be described below.

  The image processing apparatus according to the present embodiment is a video camera that captures a ski jump competition held at a single venue at a single location.

  FIG. 10A is a diagram schematically showing the configuration of the venue where the ski jump competition is held, and FIG. 10B shows the ski jump competition held in the venue of FIG. 10A. It is a timing chart relevant to the imaging | photography process of the video camera which image | photographs.

  In the venue shown in FIG. 10 (a), a plurality of athletes 43 as subjects sequentially perform ski jump competitions. In the venue, a score display board 44 for displaying the score of the player 43, a display information server 45 for processing information to be displayed on the score display board 44 and displaying the score on the score display board 44, and display information A wireless LAN transmitter 46 connected to the server 45, a video camera 48 that captures a ski jump competition at a single location, and a wireless LAN receiver 47 connected to the video camera 48 are installed. The wireless LAN receiver 47 is connected to the wireless LAN transmitter 46 via wireless.

  In FIG. 10A, the display information server 45 distributes the score to the video camera 48 via the wireless LAN transmitter 46 and the wireless LAN receiver 47 in synchronization with the timing for displaying the score on the score display board 44. . Accordingly, the display information server 45, the wireless LAN transmitter 46, and the wireless LAN receiver 47 function as the performance information input unit 106 in FIG. 1, and the video camera 48 connected to them displays the video in FIG. The configuration is the same as that of the camera 100.

  As shown in the timing chart of FIG. 10B, when recording (recording) of a moving image is started using the video camera 48 at time T0, first, the media I / F 104 performs a camera unit as I / F processing. In order to record the moving image from 101 in the storage medium 105, a moving image file having a file name “02.mpg” is created, and moving image shooting is started as shooting processing.

  The athlete 43 starts ski jumping at a timing after time T0 and lands, and after landing, the recorded value (point) of the athlete 43 is measured, and a score corresponding to the point is distributed to the score display board 44. Displayed. This score is also distributed to the video camera 48 as a recorded value. While the event that the player 43 has landed and the score is distributed to the score display board 44 and the video camera 48 is occurring, for example, the time before the next player 43 starts the ski jump competition, for example, time At the timing of T1, the media I / F 104 writes the chapter information indicating the image separation information of the first round in the management file of the moving image file whose file name is “02.mpg” as the division process. Thereby, the video data of the first video α can be specified in the moving image file.

  Further, at the timing after time T1 in FIG. 10B, the metadata processing unit 108 in the microcomputer 107 creates the metadata shown in FIG. 11A associated with the video data of the video α, and stores the storage media. Save to 105.

  This metadata recording continuity is set to “OFF”. This is because the recorded value such as the lap time described in the first embodiment needs to be continuously measured at times before and after the recorded value is updated. This is because the score as a recorded value is measured between competitions. However, “ON” may be set for the recording continuity, or “ON” or “OFF” may be selectively set according to the recording type.

  In addition, a name or the like specifying each player 43 is registered in the recording time within the recording time. In addition, when registration of a recording person does not end within the recording time, each time chapter information is written and new metadata is created, the video player 43 corresponding to the new metadata can be distinguished. A numerical value or a character string (character) is registered as a record generator.

  Thereafter, in accordance with the number of competitions of the player 43, the same processing as described above is performed until the end of recording, for example, at timings T2 and T3. As a result, the video data of the third video γ of the video data of the second video β is recorded in the video file, and the storage media 105 is associated with the video data of the video β together with the video file in FIG. The metadata shown in FIG. 11C associated with the metadata shown in (b) and the video data of the video γ are stored.

  The moving image file including the video data of the videos α to γ photographed as described above is subjected to the processing shown in FIG. 5 to create a playlist in which these video data are arranged. In addition, since the recording continuity of the metadata is “OFF”, it is prohibited to add a marginal image to the video data of each video α to γ in the playlist. As can be seen from a comparison with the first embodiment, switching to either the addition of a marginal image or the prohibition of the addition is made according to the recording continuity of the metadata, so a playlist as a digest video is created. Editability can be improved.

  FIG. 12A and FIG. 12B are diagrams illustrating playlists created by performing the playlist change process of FIG.

  In the playlist shown in FIG. 12A, the arrangement of the video data corresponding to the videos α to γ is rearranged in ascending order of the recorded value of the metadata, that is, from the lowest score, as shown in FIG. In the playlist, the arrangement of the video data corresponding to the videos α to γ is rearranged in the descending order of the recorded value of the metadata, that is, in the descending order of the score.

  Hereinafter, modifications of the above embodiment will be described.

  In the above embodiment, chapter information is written in the management file of one moving image file every time the recorded value is updated (FIG. 2 and FIG. 3B), but in this modified example, the chapter information is written in one moving image file. Instead of writing information, a moving image file is newly created every time the recorded value is updated, as shown in FIG. 13 which is a timing chart of the photographing process performed in the circuit place similar to FIG. .

  FIG. 14 is a flowchart of metadata creation processing executed in the timing chart of FIG.

  In FIG. 14, first, the microcomputer 107 waits for the grade information input unit 106 to input a record value to the metadata processing unit 108. For example, the record input from the grade information input unit 106 at time T2 in FIG. When it is determined that the value is to be updated (YES in step S901), the file name in which the storage medium 105 has recorded the video data of the video A ′ between the times T1 and T2 in FIG. The moving image file “mpg” is closed (closed), and the storage medium 105 stores the closed moving image file (step S902).

  At this time, the metadata processing unit 108 creates metadata including the recorded value before update as related information related to the closed video file (step S903a), and the deletion list creation unit 110 is closed. A deletion list for setting a predetermined deletion order is created for one or more moving image files, and the moving image file with the closed file name “01.mpg” is stored in the deletion list (step S903b). When viewing this deletion list, as shown in FIG. 15 (a), the list shows that the content of the data is video A 'so that the data in each stored video file can be easily confirmed. It is preferable to be uploaded. Alternatively, the file name and metadata of the moving image file may be listed, or a still image that is a part of the data content may be listed.

  In subsequent step S904, the microcomputer 107 transmits the metadata created by the metadata processing unit 108 to the storage medium 105 and stores it as a metadata file.

  Subsequently, the microcomputer 107 creates (opens) a new moving image file, for example, a moving image file whose file name is “02.mpg” in the storage medium 105, and starts recording of the video data of the video B ′, for example. Continue shooting the subject.

  Further, the deletion list creation unit 110 rearranges the array by assigning deletion orders to the moving image files in the deletion list (step S906). The deletion order is determined according to a predetermined rearrangement condition based on the recorded value of the metadata, for example, in descending order of the recorded value. Examples of the rearrangement condition include the order in which the recording values are large and the order in which the recording values are small. When there is one moving image file stored in the deletion list, “1” is assigned as the deletion order of the moving image file as shown in FIG.

  In subsequent step S907, the microcomputer 107 determines whether or not the remaining capacity indicating the capacity of the video data that can be input to the recording medium 105 being recorded is equal to or less than a predetermined value, that is, whether or not the remaining capacity is small. As a result of the determination, when the remaining capacity of the storage medium 105 is sufficient (NO in step S907), the user selects the desired moving image file and presses a manual deletion instruction key (not shown) to select it. Manual deletion of video files is possible.

  When this manual deletion is not performed (NO in step S910), the process returns to step S901 to wait for the recording value to be input again, and when the recording value is updated at times T3 and T4 in FIG. Steps S902 to S906 are performed. As a result, video files with the file names “02.mpg” and “03.mpg” for recording the video data of video C and “D” are created in the storage medium 105, and FIG. A deletion list as shown in (c) is created.

  On the other hand, when the remaining capacity of the storage medium 105 decreases due to continuous shooting (YES in step S907), in accordance with the deletion order of the deletion list, specifically, from the top in the descending order of recorded values (n is The video file up to the 1st (integer) integer) (hereinafter referred to as “the top n”), for example, the video file of the top first video A ′ and its related metadata are deleted (step S908), and the deletion list is deleted. Is updated as shown in FIG. 15D (step S909), and this process is terminated.

  In addition, when the user presses the manual deletion command key to manually delete the moving image file of the video A ′, for example (YES in step S910), the selected moving image file of the video A ′ and metadata related thereto. Is deleted, and the deletion order in the deletion list is updated as shown in FIG. 15D (step S909), and this process is terminated.

  According to the process of FIG. 14, when the remaining capacity of the storage medium 105 is small (YES in step S907), the moving image file, for example, the moving image file of the video A ′ and the related items are determined according to the deletion order determined based on the recorded value. Since the metadata is deleted (step S908), the remaining capacity of the storage medium 105 can be reliably ensured, and a new moving image file such as the moving image of the video D ′ can be stored in the storage medium 105 having the reserved remaining capacity. You can create a file and continue shooting moving images. This can be said to have the same effect as when the moving image file of the new video D ′ is overwritten and recorded on the moving image file of the video A ′ to be deleted. Therefore, since the user can perform overwrite recording without performing manual deletion, the user's operability can be improved without interrupting the recording operation at time T4.

  Further, every time the recorded value measured objectively is updated, the moving image file being recorded is closed (step S902), and a new moving image file is created (step S905). In addition, it is possible to easily divide a moving image being recorded, and to improve editability when creating a playlist or a digest video.

  Further, since the metadata of the closed moving image file is created and saved every time a new moving image file is created (steps S903a and S904), the recorded image is updated before and after the recording value is updated, as in the process of FIG. Even if the difference is small, metadata can be created based on objectively measured recorded values, and the image file divided by closing and opening the video file and the information contained in the metadata Can be associated one-on-one, and editability when creating a playlist or digest video can be further improved.

  In the above modification, the reordering condition in the deletion list is based on the recorded value of the metadata, but may be based on information other than the recorded value, for example, specified by the start position and end position of the metadata. The order includes the longest recording time, the shortest recording time, the early start position of the metadata, and the late order. For example, by setting the order in which the start position of the metadata is early as the rearrangement condition, it is possible to delete from the moving image file having the oldest recorded time among the plurality of moving image files of the storage medium 105.

  The image processing apparatus according to the above embodiment is the video camera 100. However, the present invention is not limited to this, and image processing that can process still images and moving images corresponding to video data recorded on the storage medium 105 is possible. Any device may be used.

  In the above embodiment, the storage medium 105 is a randomly accessible memory card or disk medium. However, any storage medium may be used as long as it can store image data.

  Another object of the present invention is to supply a storage medium storing software program codes for realizing the functions of the above-described embodiments to a system or apparatus, and a computer (or CPU, MPU, etc.) of the system or apparatus. It is also achieved by reading and executing the program code stored in the storage medium.

  In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiment, and the program code and the storage medium storing the program code constitute the present invention.

  Examples of the storage medium for supplying the program code include a floppy (registered trademark) disk, a hard disk, a magneto-optical disk, a CD-ROM, a CD-R, a CD-RW, a DVD-ROM, a DVD-RAM, and a DVD. -RW, DVD + RW, magnetic tape, nonvolatile memory card, ROM, etc. can be used. Alternatively, the program code may be downloaded via a network.

  Further, by executing the program code read by the computer, not only the functions of the above embodiments are realized, but also an OS (operating system) running on the computer based on the instruction of the program code. This includes a case where part or all of the actual processing is performed and the functions of the above-described embodiments are realized by the processing.

  Further, after the program code read from the storage medium is written into a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, the function is determined based on the instruction of the program code. A case where the CPU of the expansion board or the function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing is also included.

  The image processing apparatus according to the embodiment of the present invention can be applied to an image processing apparatus for searching for a desired image from a plurality of images using information related to the image.

1 is a block diagram schematically showing a configuration of an image processing apparatus according to an embodiment of the present invention. 2 is a flowchart of metadata creation processing executed by a microcomputer during moving image recording of a video camera as the image processing apparatus of FIG. 1. It is a figure for demonstrating the 1st modification of the image processing apparatus which concerns on this Embodiment, (a) is a figure which shows the structure of a circuit field schematically, (b) is (a). It is a timing chart relevant to the imaging | photography process of the vehicle-mounted camera of the racing car which circulates in the circuit field. It is a figure which illustrates the metadata produced in 1st Example, (a)-(c) is linked | related with the moving image file image | photographed with the vehicle-mounted camera of the 1st racing car of Fig.3 (a). It is a figure which shows the metadata produced at the time T2, T3, and T4 in 3 (b), (d)-(f) is the moving image image | photographed with the vehicle-mounted camera of the 2nd racing car of Fig.3 (a). It is a figure which shows the metadata produced in association with a file at the time T2, T3, and T4 in FIG.3 (b). It is a flowchart of the playlist creation process performed by the playlist creation unit in FIG. It is a figure which shows the state when copying the moving image file image | photographed with two video cameras and video camera in Fig.3 (a) to a 3rd video camera. It is a figure which shows an example of the play list produced by the 3rd video camera of FIG. 8 is a flowchart of playlist change processing for changing the playback order of video data in the playlist as shown in FIG. FIG. 9 is a diagram illustrating a playlist created in the playlist change process of FIG. 8, (a) is a diagram showing the playlist created in step S1104 of FIG. 8, and (b) is a diagram of FIG. It is a figure which shows the play list produced by step S1107, (c) is a figure which shows the play list produced by step S1110 of FIG. It is a figure for demonstrating the 2nd modification of the image processing apparatus which concerns on this Embodiment, (a) is a figure which shows schematically the structure of the venue holding the ski jump competition, b) is a timing chart related to the shooting process of the video camera for shooting the ski jump competition held in the venue of (a). FIG. 11 is a diagram illustrating metadata created at times T1, T2, and T3 in FIG. 10B in the second embodiment. FIG. 9 is a diagram illustrating a playlist created by performing the playlist change process of FIG. 8, and (a) is a diagram illustrating playlists that are rearranged in ascending order of recorded values of metadata; ) Is a diagram showing playlists that are rearranged in descending order of recorded values of metadata. FIG. 6 is a timing chart of a photographing process performed in a circuit field similar to FIG. 3A in a modification of the embodiment of the present invention. It is a flowchart of the metadata creation process performed in the timing chart of FIG. It is a figure which illustrates the deletion list created in the modification of an embodiment of the invention, and (a)-(c) is a figure showing the deletion list created at time T2, T3, and T4 in FIG. Yes, (d) is a diagram showing the deletion list updated in step S909 of FIG.

Explanation of symbols

33, 73 Stopwatch 34, 48, 50, 74, 100 Video camera 45 Display information server 104 Storage media I / F
105 Storage Media 106 Grade Information Input Unit 107 Microcomputer
108 Metadata processing unit 109 Playlist creation unit 110 Delete list creation unit

Claims (26)

  In an image processing apparatus capable of retrieving a desired image from a plurality of images using information related to the image, image input means for inputting the image to a predetermined storage medium, and input of predetermined related information related to the image Related information input means, image dividing means for dividing the input image as a divided image in synchronization with the input of the related information by the related information input means, and associating the inputted related information with the divided image An image processing apparatus, comprising: a metadata creating unit that creates metadata for creating the metadata.   The image processing apparatus according to claim 1, further comprising: a playlist creation unit that creates a playlist in which the divided images are arranged in a predetermined playback order; and a playback unit that plays back the created playlist. .   The reproduction order change means for changing the reproduction order of the divided images by rearranging the arrangement of the divided images in the playlist according to a predetermined sorting condition based on the related information. The image processing apparatus described.   3. A marginal image adding unit that adds a partial image corresponding to a predetermined time continuous with a reproduction time of the divided image in an adjacent divided image adjacent to the divided image as a marginal image to the divided image. Or the image processing apparatus of 3.   The marginal image adding means selects at least one of a partial image corresponding to a predetermined time continuous after the reproduction time of the divided image and a partial image corresponding to a predetermined time continuous before the reproduction time of the divided image. The image processing apparatus according to claim 4, wherein the image processing apparatus is added to the divided image.   6. The image processing apparatus according to claim 4, wherein the metadata creation unit writes prohibition information for prohibiting addition of the margin image by the margin image addition unit into the created metadata.   The image processing apparatus according to claim 6, wherein the prohibition information includes discontinuity information indicating that the divided images and the adjacent divided images are temporally discontinuous.   The image processing apparatus according to claim 1, further comprising a deletion list creating unit that creates a deletion list for setting a predetermined deletion order for the divided images.   Deletion that deletes the divided images from the top of the predetermined deletion order to the predetermined number of the divided images when the remaining capacity indicating the capacity of the image that can be input to the predetermined storage medium is equal to or less than a predetermined value. 9. The image processing apparatus according to claim 8, further comprising means.   The image dividing means includes image separation information writing means for writing image separation information indicating execution of the division into a management file for writing management information for managing an image file storing the image being input. The image processing apparatus according to claim 1, wherein:   The image according to any one of claims 1 to 10, wherein the metadata creating unit writes information indicating an input start position and an input end position of the divided image with respect to the storage medium into the metadata. Processing equipment.   12. The input image according to claim 1, wherein the input image includes an image of a photographed subject, and the predetermined related information includes performance information relating to a predetermined score for evaluating the subject. The image processing apparatus according to item.   In an image processing method for retrieving a desired image from a plurality of images using information related to an image, an image input step for inputting the image to a predetermined storage medium, and predetermined related information related to the image A related information input step for inputting, an image dividing step for dividing the image being input as a divided image in synchronization with the input of the related information in the related information inputting step, and the related information input to the divided image. An image processing method comprising: a metadata creating step for creating metadata for associating.   The image processing method according to claim 13, further comprising: a playlist creation step for creating a playlist in which the divided images are arranged in a predetermined playback order; and a playback step for playing back the created playlist. .   15. The reproduction order changing step of changing the reproduction order of the divided images by rearranging the arrangement of the divided images in the playlist according to a predetermined sorting condition based on the related information. The image processing method as described.   15. A margin image adding step of adding a partial image corresponding to a predetermined time continuous with a reproduction time of the divided image in an adjacent divided image adjacent to the divided image as a margin image to the divided image. Or the image processing method of 15.   In the marginal image adding step, at least one of a partial image corresponding to a predetermined time continuous after the reproduction time of the divided image and a partial image corresponding to a predetermined time continuous before the reproduction time of the divided image is The image processing method according to claim 16, wherein the image processing method is added to the divided image.   18. The image processing method according to claim 16, wherein the metadata creating step writes prohibition information for prohibiting the addition of the margin image in the margin image adding step into the created metadata.   19. The image processing method according to claim 18, wherein the prohibition information includes discontinuity information indicating that the divided images and the adjacent divided images are temporally discontinuous.   20. The image processing method according to claim 13, further comprising a deletion list creation step of creating a deletion list for setting a predetermined deletion order for the divided images.   Deletion that deletes the divided images from the top of the predetermined deletion order to the predetermined number of the divided images when the remaining capacity indicating the capacity of the image that can be input to the predetermined storage medium is equal to or less than a predetermined value. 21. The image processing method according to claim 20, further comprising steps.   The image dividing step includes an image delimiter information writing step for writing image delimiter information indicating execution of the division into a management file for writing management information for managing an image file storing the image being input. The image processing method according to claim 13, wherein:   The image according to any one of claims 13 to 22, wherein the metadata creation step writes information indicating an input start position and an input end position of the divided image with respect to the storage medium in the metadata. Processing method.   The input image includes an image of a photographed subject, and the predetermined related information includes performance information relating to a predetermined result for evaluating the subject. The image processing method according to item.   In a program for causing a computer to execute an image processing method for retrieving a desired image from a plurality of images using information related to the image, an image input module for inputting the image to a predetermined storage medium, and an image A related information input module that inputs predetermined related information, an image division module that divides the input image as a divided image in synchronization with the input of the related information by the related information input module, and A program comprising: a metadata creation module for creating metadata for associating input related information.   A computer-readable storage medium storing the program according to claim 25.

Images