JP2007243259A - Image processing apparatus and method, program recording medium, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a technology of accurately applying prescribed processing to all images and reproducing the resulting images every time the images are reproduced without application of processing to original image data. <P>SOLUTION: A synchronization detection section 242 sequentially compares a reproduction position feature quantity with a searching position feature quantity, and registers a field number, a feature quantity of the reproduction position feature quantity, and setting information to a coincidence list 201 when a result of the comparison indicates coincidence. A difference calculation section 263a calculates a number of difference images on the basis of a difference between an identification number of an image at a processing position to which processing is applied and an identification number of an image registered in the coincidence list, an estimate section 263d adds the number of difference images to the identification number of the image registered in the coincidence list to estimate the feature quantity of the image at the processing position recorded on a data recording medium, a feature quantity setting information read section 263 reads setting information recorded on the data recording medium in cross reference with the estimated feature quantity from the data recording medium, and a reflection section 249 reflects the processing on the image on the basis of the setting information that is read. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an image processing apparatus and method, a program recording medium, and a program, and in particular, a predetermined process each time an image is reproduced by storing a process added to the image and an image feature amount in association with each other. The present invention relates to an image processing apparatus and method, a program recording medium, and a program that can accurately reproduce an image added with the above.

  Technologies for easily processing images are becoming widespread.

  Conventionally, in order to edit an image captured by a video camera or the like, a linear operation is performed in which original image data is reproduced, an operation for performing various processes is executed, and an image as a processing result is recorded on another recording medium. Editing was mainstream.

  Further, in the case of the linear editing as described above, when the original image data is COPY ONCE, there is a problem that the video once recorded in the VTR (Video Tape Recorder) is reproduced and the edited video cannot be recorded.

  Therefore, a method for storing an operation for instructing a process for editing an image has been proposed (see Patent Document 1).

JP 2003-202944 A

  However, in the case of linear editing, it is possible to edit according to the time code by simultaneously communicating the image and the time code indicating the time of the image. However, in consumer VTRs, the time code is in the VTR. , It is virtually impossible to convey the time code to the outside, and the image and the operation for instructing the processing for editing the image cannot be synchronized. It has been difficult to accurately process and display all the images while accurately synchronizing the images.

  The present invention has been made in view of such a situation, and in particular, by adding a process to be added to an image and storing the feature amount of the image in association with each other without adding a process to the original image data, Each time is reproduced, a predetermined process is accurately applied to all the images so that they can be reproduced.

  An image processing apparatus according to a first aspect of the present invention includes a reproduction position feature amount extraction unit that extracts a reproduction position feature amount from a reproduction position image as a reproduction position feature amount, and the image identification number. Search position feature quantity extraction means for sequentially extracting the feature quantities as search position feature quantities from a data recording medium in which setting information for performing processing on the image is recorded in association with the feature quantities; Comparison means for sequentially comparing the reproduction position feature quantity and the search position feature quantity, and if the comparison result matches, the identification number of the image and the setting information recorded in association with the reproduction position feature quantity The difference for calculating the number of difference images from the difference between the match list registration means for registering the address in the match list, the identification number of the image at the processing position to be processed, and the identification number of the image registered in the match list It is recorded on the data recording medium by image calculation means and the address of the setting information recorded in association with the identification number of the image registered in the match list, the number of difference images, and the reproduction position feature quantity. Estimating means for estimating the setting information address of the image at the processing position, reading means for reading setting information from the data recording medium from the setting information address estimated by the estimating means, and reading by the reading means. Reflecting means for reflecting the processing to the image at the reproduction position based on the set information that has been output.

  The feature amount extraction unit can extract an addition value of pixel values of pixels in a predetermined area constituting the image as a feature amount.

  When the comparison result matches, the match list registration unit records the identification number of the image, the address where the feature value of the playback position feature value is recorded, and the playback position feature value in association with each other. The setting information is recorded in the match list, and the estimating means adds the number of difference images to the identification number of the image registered in the match list, thereby The address at which the setting information of the processing position image is recorded can be estimated.

  The image identification number may include a frame number or a field number.

  The image processing method according to the first aspect of the present invention includes a reproduction position feature amount extraction step of extracting a reproduction position feature amount from a reproduction position image as a reproduction position feature amount, and the image identification number. A search position feature quantity extraction step for sequentially extracting the feature quantities as search position feature quantities from a data recording medium in which setting information for performing processing on the image is recorded in association with the feature quantities; A comparison step for sequentially comparing the reproduction position feature quantity and the search position feature quantity, and if the comparison result matches, the identification number of the image and the setting information recorded in association with the reproduction position feature quantity The difference image registration step for registering the address in the match list, the difference image between the identification number of the image at the processing position to be processed and the identification number of the image registered in the match list A difference image calculation step of calculating the number, and an identification number of the image registered in the match list, the number of difference images, and an address of setting information recorded in association with the reproduction position feature amount An estimation step of estimating the setting information address of the image at the processing position recorded on the medium, and a reading step of reading the setting information from the data recording medium from the setting information address estimated by the processing of the estimation step And a reflecting step of reflecting the processing to the image at the reproduction position based on the setting information read by the processing of the reading step.

  The program of the program recording medium according to the first aspect of the present invention includes a reproduction position feature amount extraction step for extracting a reproduction position feature amount from a reproduction position image as a reproduction position feature amount, and the image identification number. A search position feature quantity extraction step for sequentially extracting the feature quantities as search position feature quantities from a data recording medium in which setting information for performing processing on the images is recorded in association with the feature quantities of the images; A comparison step for sequentially comparing the reproduction position feature quantity and the search position feature quantity, and a setting recorded in association with the identification number of the image and the reproduction position feature quantity when the comparison result matches. A match list registration step for registering an address of information in a match list, an identification number of an image at a processing position to be processed, and an identification number of an image registered in the match list A difference image calculation step for calculating the number of difference images from the difference between them, an identification number of the image registered in the match list, the number of difference images, and an address of setting information recorded in association with the reproduction position feature amount To estimate the address of the setting information of the image at the processing position recorded on the data recording medium, and to set from the address of the setting information estimated by the processing of the estimation step from the data recording medium A reading step of reading information, and a reflecting step of reflecting the processing to the image at the reproduction position based on the setting information read by the processing of the reading step.

  The program according to the first aspect of the present invention includes a reproduction position feature amount extraction step for extracting a reproduction position feature amount from a reproduction position image as a reproduction position feature amount, and the image feature amount together with the image identification number. A search position feature amount extraction step for sequentially extracting the feature amounts as search position feature amounts from a data recording medium in which setting information for performing processing on the image is recorded in association with the image, and the reproduction position A comparison step for sequentially comparing the feature amount and the search position feature amount, and if the comparison result matches, an identification number of the image and an address of the setting information recorded in association with the reproduction position feature amount are The difference image is calculated based on the difference between the match list registration step registered in the match list, the identification number of the image at the processing position to be processed, and the identification number of the image registered in the match list. The data recording medium includes a difference image calculation step for calculating the image and an address of setting information recorded in association with the identification number of the image registered in the match list, the number of difference images, and the reproduction position feature amount An estimation step of estimating the setting information address of the image at the processing position recorded in the recording step; and a reading step of reading setting information from the setting information address estimated by the processing of the estimation step from the data recording medium; Then, based on the setting information read by the process of the reading step, the computer is caused to execute a process including a reflecting step for reflecting the process to the image at the reproduction position.

  The image processing apparatus according to the second aspect of the present invention provides a reproduction position feature quantity extracting means for extracting a reproduction position feature quantity from a reproduction position image as a reproduction position feature quantity, and the image identification number. Search position feature quantity extraction means for sequentially extracting the feature quantities as search position feature quantities from a data recording medium in which setting information for performing processing on the image is recorded in association with the feature quantities; Comparison means for sequentially comparing the reproduction position feature quantity and the search position feature quantity, and if the comparison result matches, the identification number of the image and the setting information recorded in association with the reproduction position feature quantity Matching list registration means for registering an address in a match list, a correspondence acquisition for acquiring a correspondence between an identification number of an image at a processing position to be processed and an identification number of an image registered in the match list And the setting information recorded in association with the identification number of the image registered in the match list, the correspondence relationship, and the reproduction position feature amount, and recorded on the data recording medium, Estimating means for estimating the setting information address of the image at the processing position, reading means for reading the setting information from the data recording medium from the setting information address estimated by the estimating means, and reading by the reading means Reflecting means for reflecting the processing to the image at the reproduction position based on the setting information.

  According to a second image processing method of the present invention, a reproduction position feature quantity extracting step for extracting a reproduction position feature quantity from a reproduction position image as a reproduction position feature quantity, and a feature quantity of the image together with an identification number of the image. A search position feature amount extraction step for sequentially extracting the feature amounts as search position feature amounts from a data recording medium in which setting information for performing processing on the image is recorded in association with the image, and the reproduction position A comparison step for sequentially comparing the feature amount and the search position feature amount, and if the comparison result matches, an identification number of the image and an address of the setting information recorded in association with the reproduction position feature amount are A matching list registration step for registering in a match list, an identification number of an image at a processing position to be processed, and an identification number of an image registered in the match list are acquired. Recorded on the data recording medium by the relationship acquisition step and the address of the setting information recorded in association with the identification number of the image registered in the match list, the correspondence relationship, and the reproduction position feature quantity An estimation step of estimating the setting information address of the image at the processing position; a reading step of reading setting information from the data recording medium from the setting information address estimated by the estimating means; and a process of the reading step A reflecting step of reflecting the process to the image at the reproduction position based on the read setting information.

  In the image processing apparatus, method, and program according to the first aspect of the present invention, a feature value at the playback position is extracted as a playback position feature value from the image at the playback position, and the feature of the image is used together with the identification number of the image. The feature amounts are sequentially extracted as search position feature amounts from a data recording medium in which setting information for performing processing on the image is recorded in association with the amount, and the reproduction position feature amount and the search position When the comparison is made with the feature amount sequentially and the comparison result matches, the identification number of the image and the address of the setting information recorded in association with the reproduction position feature amount are registered in the match list, and processing is added. The number of difference images is calculated from the difference between the identification number of the image at the processing position and the identification number of the image registered in the match list, and the identification number of the image registered in the match list; The address of the setting information of the image at the processing position recorded in the data recording medium is estimated from the number of recorded difference images and the address of the setting information recorded in association with the reproduction position feature amount, and The setting information is read from the estimated address of the setting information from the data recording medium, and the process is reflected on the image at the reproduction position based on the read setting information.

  In the image processing apparatus and method according to the second aspect of the present invention, the reproduction position feature quantity is extracted from the reproduction position image as the reproduction position feature quantity, and corresponds to the image feature quantity together with the image identification number. The feature amount is sequentially extracted as a search position feature amount from a data recording medium in which setting information for performing processing on the image is recorded, and the reproduction position feature amount and the search position feature amount are Are sequentially compared, and when the comparison result matches, the identification number of the image and the address of the setting information recorded in association with the reproduction position feature amount are registered in the match list, and the processing position to which processing is applied The correspondence relationship between the identification number of the image and the identification number of the image registered in the match list is acquired, and the identification number of the image registered in the match list, the correspondence relationship, and the reproduction The address of the setting information of the image at the processing position recorded in the data recording medium is estimated from the address of the setting information recorded in association with the position feature amount, and is estimated from the data recording medium Setting information is read from the address of the setting information, and processing is reflected on the image at the reproduction position based on the read setting information.

  The image processing apparatus of the present invention may be an independent apparatus or a block that performs image processing.

  According to the present invention, it is possible to accurately perform predetermined processing on an image and reproduce it every time an image is reproduced without adding processing to the original image data. Further, even when image data that cannot be duplicated is reproduced, it is possible to repeatedly reproduce it by adding the same processing each time it is reproduced.

  Further, according to the present invention, when setting information for processing an image is read in association with the feature amount of the image, and the process to the image is reflected based on the setting information, the processing is prolonged, It is possible to suppress a situation in which processing cannot be performed on an image, and it is possible to accurately reproduce all images by performing predetermined processing.

  Embodiments of the present invention will be described below. The correspondence relationship between the invention described in this specification and the embodiments of the invention is exemplified as follows. This description is intended to confirm that the embodiments supporting the invention described in this specification are described in this specification. Therefore, although there is an embodiment which is described in the embodiment of the invention but is not described here as corresponding to the invention, it means that the embodiment is not It does not mean that it does not correspond to the invention. Conversely, even if an embodiment is described herein as corresponding to an invention, that means that the embodiment does not correspond to an invention other than the invention. Absent.

  Further, this description does not mean all the inventions described in this specification. In other words, this description is for the invention described in the present specification, which is not claimed in this application, that is, for the invention that will be applied for in the future or that will appear and be added by amendment. It does not deny existence.

  That is, the image processing apparatus according to the first aspect of the present invention is a reproduction position feature quantity extraction unit (for example, the reproduction feature quantity extraction unit in FIG. 17) that extracts a reproduction position feature quantity from a reproduction position image as a reproduction position feature quantity. 102), and the feature quantity is retrieved from a data recording medium in which setting information for performing processing on the image is recorded in association with the feature quantity of the image together with the identification number of the image. Search position feature amount extraction means (for example, the search position feature amount extraction unit 104 in FIG. 17) that sequentially extracts as feature amounts, and comparison means (for example, FIG. 17) that sequentially compares the reproduction position feature amount and the search position feature amount. When the comparison result matches 17 comparison units 103), the matching list that registers the identification number of the image and the address of the setting information recorded in association with the reproduction position feature amount in the matching list The number of difference images is calculated from the difference between the registration means (for example, the match list registration unit 301 in FIG. 17), the identification number of the image at the processing position to be processed, and the identification number of the image registered in the match list. Difference image calculation means (for example, difference calculation unit 263c in FIG. 16) and setting information recorded in association with the identification number of the image registered in the match list, the number of difference images, and the reproduction position feature amount The estimation unit (for example, the estimation unit 263d in FIG. 16) that estimates the address of the setting information of the image at the processing position recorded in the data recording medium, and the estimation unit from the data recording medium Is read out by the reading means (for example, the feature amount setting information reading unit 263 in FIG. 16) and the reading means. Based on the setting information, and a reflecting unit for reflecting the process on the image of the playback position (e.g., reflecting part 249 in FIG. 16).

  The feature amount extraction unit can extract an addition value of pixel values of pixels in a predetermined area constituting the image as a feature amount.

  In the match list registration means (for example, the match list registration unit 301 in FIG. 17), when the comparison result matches, the identification number of the image, the address where the feature value of the reproduction position feature value is recorded, and The address where the setting information recorded in association with the reproduction position feature quantity is recorded is registered in the match list, and the estimation unit (for example, the estimation unit 263d in FIG. 16) registers the address in the match list. By adding the number of difference images to the identification number of the image, it is possible to estimate the address where the setting information of the image at the processing position of the data recording medium is recorded.

  The image identification number may include a frame number or a field number.

  An image processing method and program according to the first aspect of the present invention include a reproduction position feature amount extraction step (step S105 in the flowchart of FIG. 23) for extracting a reproduction position feature amount from a reproduction position image as a reproduction position feature amount. The feature quantity is sequentially used as a search position feature quantity from a data recording medium in which setting information for performing processing on the image is recorded in association with the image feature quantity together with the image identification number. A search position feature quantity extraction step (step S106 in the flowchart of FIG. 23) to be extracted, a comparison step (step S107 in the flowchart of FIG. 23) for sequentially comparing the reproduction position feature quantity and the search position feature quantity, and the comparison If the results match, they are recorded in association with the identification number of the image and the reproduction position feature quantity. A match list registration step (step S109 in the flowchart of FIG. 23) for registering the address of the setting information to be registered in the match list, the identification number of the image at the processing position to be processed, and the identification number of the image registered in the match list Difference image calculation step (step S137 in the flowchart of FIG. 26) for calculating the number of difference images from the difference between the image and the identification number of the image registered in the match list, the number of difference images, and the reproduction position feature amount An estimation step (step S138 in the flowchart of FIG. 26) for estimating the address of the setting information of the image at the processing position recorded on the data recording medium based on the address of the setting information recorded on the data, and the data The address of the setting information estimated by the process of the estimation step is recorded from the recording medium. A reading step for reading the setting information (step S142 in the flowchart of FIG. 26) and a reflecting step for reflecting the processing on the image at the reproduction position based on the setting information read by the processing of the reading step (FIG. Step S143) in the flowchart of FIG.

  The image processing apparatus according to the second aspect of the present invention is a reproduction position feature amount extraction means (for example, a reproduction feature amount extraction unit 102 in FIG. 17) that extracts a reproduction position feature amount from a reproduction position image as a reproduction position feature amount. And the search position feature amount from a data recording medium in which setting information for performing processing on the image is recorded in association with the image feature amount together with the image identification number. Search position feature quantity extraction means (for example, the search position feature quantity extraction unit 104 in FIG. 17) and comparison means (for example, FIG. 17) for sequentially comparing the reproduction position feature quantity and the search position feature quantity. When the comparison result matches the comparison unit 103), a match list registration that registers the identification number of the image and the address of the setting information recorded in association with the reproduction position feature amount in the match list Correspondence relationship acquisition means for acquiring a correspondence relationship between the stage (for example, the match list registration unit 301 in FIG. 17), the identification number of the image at the processing position to be processed, and the identification number of the image registered in the match list. (For example, the difference calculation unit 263c in FIG. 16) and the address of the setting information recorded in association with the identification number of the image registered in the match list, the correspondence relationship, and the reproduction position feature amount, An estimation unit (for example, the estimation unit 263d in FIG. 16) for estimating the address of the setting information of the image at the processing position recorded on the data recording medium, and the setting estimated by the estimation unit from the data recording medium Based on the reading means (for example, the feature amount setting information reading unit 263 in FIG. 16) for reading the setting information from the address of the information and the setting information read by the reading means. , And a reflecting unit for reflecting the process on the image of the playback position (e.g., reflecting part 249 in FIG. 16).

  The second image processing method of the present invention includes a reproduction position feature amount extraction step (step S105 in the flowchart of FIG. 23) for extracting a reproduction position feature amount from a reproduction position image as a reproduction position feature amount, and identification of the image. A search position that sequentially extracts the feature quantity as a search position feature quantity from a data recording medium in which setting information for applying processing to the image is recorded in association with the feature quantity of the image together with a number The comparison result coincides with the feature amount extraction step (step S106 in the flowchart of FIG. 23), the comparison step (step S107 in the flowchart of FIG. 23) for sequentially comparing the reproduction position feature amount and the search position feature amount. The address of the setting information recorded in association with the identification number of the image and the reproduction position feature quantity Acquires a correspondence relationship between the match list registration step (step S109 in the flowchart of FIG. 23) to be registered in the match list, the identification number of the image at the processing position to be processed, and the identification number of the image registered in the match list. Corresponding relationship acquisition step (step S137 in the flowchart of FIG. 26) and the address of the setting information recorded in association with the identification number of the image registered in the match list, the correspondence relationship, and the reproduction position feature quantity To estimate the address of the setting information of the image at the processing position recorded in the data recording medium (step S138 in the flowchart of FIG. 26), and the estimation means estimates the data from the data recording medium. Reading step for reading the setting information from the address of the setting information (FIG. 26). And step S142) in the flowchart, on the basis of the setting information read by the process of the reading step, and a reflection step of reflecting the process on the image of the playback position (step S143 in the flowchart of FIG. 26).

  First, the concept of an image processing apparatus to which the present invention is applied will be described with reference to FIGS. An image processing apparatus to which the present invention is applied performs processing instructed by a user on an image recorded in advance and displays the image. At this time, the image processing apparatus extracts the feature amount of the image, and accumulates the processing content information in association with the feature amount. Furthermore, when reproducing an image recorded in advance, the image processing apparatus reads out the stored processing content information, processes the image, and displays it.

  More specifically, the operation of the image processing apparatus 2 is roughly divided into two modes, a recording mode and a reproduction mode.

  In the recording mode, as shown in FIG. 1, the image processing apparatus 2 is reproduced by a DVD player or the like from a recording medium 1 on which content including moving images such as a DVD (Digital Versatile Disc) is recorded in advance. An image is displayed on the display unit 3. In this state, when the remote controller or the like is operated by a user or the like, for example, zooming, panning, tilting, or the like is instructed as processing for a desired image, the image processing apparatus 2 changes the operation content. In addition to generating the corresponding setting information, the process associated with the setting information is performed on the image and displayed on the display unit 3. Furthermore, the image processing apparatus 2 extracts feature amounts from the image, and accumulates setting information in the operation history storage unit 4 in association with the extracted feature amounts.

  Next, in the playback mode, as shown in FIG. 2, the image processing apparatus 2 reads an image to be played back by a DVD player or the like from a recording medium 1 in which content including moving images is recorded in advance. Extract features. At this time, the image processing apparatus 2 reads the setting information recorded in the operation history storage unit 4 in association with the feature amount in synchronization with the feature amount of the image read from the recording medium 1. Based on the setting information, the image is processed and displayed on the display unit 3.

  By the operation as described above, the image processing apparatus 2 accumulates only the processing contents for the pre-recorded image, and can repeatedly reproduce the image as the processing result without recording the image as the processing result. be able to. As a result, it is possible to repeat a processing process such as applying various image processes to an image recorded in advance, such as Copy Once, which has a limited number of copies.

  Details of the image processing apparatus 2 described with reference to FIGS. 1 and 2 will be described below.

  FIG. 3 is a diagram showing a configuration of an embodiment of an image processing apparatus 13 corresponding to the image processing apparatus 2 of FIGS.

  The image reproducing unit 12 decodes an image recorded in a state encoded in advance in a predetermined format on the recording medium 11 corresponding to the recording medium 1 of FIGS. 1 and 2, and sequentially extracts the feature amount extracting unit 41 and the delay as an image. Supplied to the unit 48.

  The feature amount extraction unit 41 extracts the feature amounts of the images sequentially supplied from the image reproduction unit 12 and supplies them to the synchronization detection unit 42 and the feature amount setting information recording unit 61 of the storage block 43. The configuration of the feature quantity extraction unit 41 will be described later in detail with reference to FIG.

  The remote controller 14 is composed of keys, buttons, etc., and is operated when the user designates the content of processing for an image desired by the user as shown in FIGS. 1 and 2, and an operation signal according to the operation of the user. Is generated, and a light emission pattern made of infrared rays or the like is generated according to the generated operation signal, and is emitted to the light receiving unit 44 of the image processing device 13.

  The light receiving unit 44 converts the operation signal of the remote controller 14 based on the light emission pattern of the remote controller 14 and supplies the operation signal to the operation information recognition unit 45. Based on the operation signal supplied from the light receiving unit 44, the operation information recognizing unit 45 recognizes the operation information associated with the processing for the image desired by the user, and outputs the operation signal as the recognition result. This is supplied to the setting information determination unit 46. The storage block 43 can be controlled to be turned on or off based on the operation information from the remote controller 14. For this reason, the operation information recognition unit 45 controls the on or off of the storage block 43. When the operation information is recognized, the operation information recognition unit 45 controls the operation of the storage block 43 to be turned on or off.

  Based on the operation information supplied from the operation information recognizing unit 45, the setting information determining unit 46 determines setting information for instructing the reflection unit 49 (to be described later) to process the image, and sets the feature amount. The information is supplied to the information recording unit 61 and the selection unit 47.

  The feature amount setting information recording unit 61 of the storage block 43 associates the feature amount supplied from the feature amount extraction unit 41 with the setting information supplied from the setting information determination unit 46, and stores the feature amount setting information storage unit. 62 (corresponding to the operation history storage unit 4 in FIGS. 1 and 2).

  The synchronization detection unit 42 is reproduced by the image reproduction unit 12 supplied from the feature amount extraction unit 41 among the feature amounts (search position feature amounts described later) accumulated in the feature amount setting information accumulation unit 62. The feature amount of the image (reproduction position feature amount described later) is searched, and when the same feature amount is detected, the detection result is supplied to the feature amount setting information reading unit 63 as the synchronization position of the image. The configuration of the synchronization detection unit 42 will be described in detail later with reference to FIG.

  When the feature amount setting information reading unit 63 acquires the feature amount (search position feature amount) detected as the synchronization position by the synchronization detection unit 42, the feature amount setting information reading unit 63 stores the feature amount in the feature amount setting information storage unit 62 in association with the feature amount. The set information is read and supplied to the selection unit 47. When the setting information is supplied from the setting information determination unit 46, the selection unit 47 sets the setting information determination unit even if the setting information is supplied from the feature amount setting information reading unit 63 at the same timing. The setting information from 46 is supplied to the reflection unit 49. In addition, when the setting information is not supplied from the setting information determination unit 46 and the setting information is supplied from the feature amount setting information reading unit 63, the selection unit 47 displays the setting information supplied from the feature amount setting information reading unit 63. Supply to the reflection unit 49. Further, when no setting information is supplied from either of them, the selection unit 47 does not supply the setting information to the reflection unit 49.

  The delay unit 48 temporarily stores and reflects the image supplied from the image reproduction unit 12 for the delay time in the processing of the feature amount extraction unit 41, the synchronization detection unit 42, the accumulation block 43, and the selection unit 47. To the unit 49. When the setting information is supplied from the selection unit 47, the reflection unit 49 reflects the processing for the image supplied from the delay unit 48 and displays it on the display unit 15. When the setting information is not supplied from the selection unit 47, the reflection unit 49 causes the display unit 15 to display the image supplied from the delay unit as it is.

  Next, a detailed configuration of the feature quantity extraction unit 41 will be described with reference to FIG.

  A DFF (D-type flip-flop) 81 stores the previous input signal and outputs it to the adder 82 at the timing when a clock signal (clk) from a clock signal generator (not shown) is input. When the input signal is outside the image data area of the image signal, the DFF 81 receives the reset signal, erases the input signal, and outputs it. That is, since the image signal is composed of a synchronous data area and an image data area as shown in FIG. 5, the field start point S, which is the origin of circles of horizontal samples and vertical lines in the figure. In the case of synchronous data outside the image data area, the reset signal is input in accordance with the position information sequentially input from, and the signal constituting the synchronous data is not output to the adder 82. That is, the DFF 81 supplies only the data in the image data area among the input signals constituting the image to the adder 82 in synchronization with the clock signal.

  The adder 82 adds the signal supplied from the DFF 81 and the signal supplied from the DFF 83 and outputs the result to the DFF 83. More specifically, the adder 82 extracts the lower 8 bits from the addition result of the signal supplied from the DFF 81 and the signal supplied from the DFF 83 and supplies the lower 8 bits to the DFF 83.

  The DFF 83 supplies the signal supplied from the adder 82 to the adder 82 and the output unit 84 at a timing when a clock signal (clk) generated from a clock generator (not shown) is input. Further, the DFF 83 receives the reset signal when the signal at the field start point (the origin of the round sample in the horizontal direction and the vertical line in the figure) S is input, and the input signal is erased and output. . That is, the DFF 83 supplies the output unit 84 with a value obtained by cumulatively adding only the data in the image data area from the input signals constituting the image by the adder 82.

  When the value of one field (or one frame) is supplied from the DFF 83, the output unit 84 outputs the value as a feature amount of an image for one field (or one frame). That is, the output unit 84 outputs the lower 8 bits of the value obtained by cumulatively adding only the data in the image data area by the adder 82 as the feature amount of the field (or frame). Note that the feature amount is not limited to the lower 8 bits of the value obtained by cumulatively adding only the data in the image data area (only the pixel value), as long as the information can identify the image in units of one field. For example, an addition result of only pixel values in a predetermined area near the center of the image data area may be used as it is.

  Next, a detailed configuration of the synchronization detection unit 42 will be described with reference to FIG.

  The feature amount buffers 101-1 to 101-3 temporarily store the supplied feature amounts, and also store the feature amounts stored so far in the reproduction position feature amount generation unit 102 and the subsequent feature amount buffers. Output sequentially to 101-2 and 101-3. Note that the feature value buffer 101-3 outputs only to the reproduction position feature value generation unit 102 because the subsequent feature value buffer 101 does not exist. The reproduction position feature quantity generation unit 102 sequentially acquires feature quantities for the past three fields including the latest feature quantities supplied from the feature quantity buffers 101-1 to 101-3 and collectively collects the reproduction position information. It is generated as (reproduction position feature amount) and output to the comparison unit 103. That is, the playback position feature value generation unit 102 generates a playback position feature value by using a total of four feature values from the latest field to the previous three fields as feature values for specifying the playback position.

  The search position feature value reading unit 104 sequentially reads four consecutive feature values stored in the feature value setting information storage unit 62 and supplies them to the comparison unit 103 and the detection unit 105 as search position feature values. The comparison unit 103 compares the reproduction position feature value supplied from the reproduction position feature value generation unit 102 with the search position feature value sequentially supplied from the search position feature value reading unit 104. When searching for a search position feature value that matches the reproduction position feature value, the comparison unit 103 considers that synchronization has been detected, and notifies the detection unit 105 that synchronization has been detected as a detection result. The detection unit 105 outputs the search position feature quantity supplied from the search position feature quantity reading unit 104 as a synchronization detection result at the timing when the synchronization is considered to be detected by the comparison unit 103.

  Next, recording processing by the image processing apparatus 13 in FIG. 3 will be described with reference to the flowchart in FIG. In the following description, it is assumed that the storage block 43 is controlled to be on.

  In step S1, the delay unit 48 determines whether a new image has been supplied from the image reproduction unit 12, and repeats the process until a new image is supplied.

  For example, when the image reproduction unit 12 reads an image recorded on the recording medium 11 and the delay unit 48 determines that a new image has been supplied, the delay unit 48 receives the supplied image in step S2. Is stored to temporarily delay one field. In the following, the description will be made assuming that the image is processed in units of one field. However, it goes without saying that the image is not limited to units of one field but may be processed in units of one frame, for example.

  In step S <b> 3, the feature amount extraction unit 41 performs a feature amount extraction process, and extracts the feature amount of the image for one field supplied from the image reproduction unit 12. That is, when the delay unit 48 temporarily stores a new image for delaying by one field, similarly, since the image for one field is also supplied to the feature amount extraction unit 41, the same timing is obtained. Thus, the same image is temporarily stored on the one hand due to delay, and the feature quantity is extracted on the other hand.

  Here, the feature amount extraction processing will be described with reference to the flowchart of FIG.

  In step S21, DFF 83 is reset by the field start point S (FIG. 5).

  In step S22, an unprocessed pixel is selected, and in step S23, it is determined whether it is outside the image data area. More specifically, for example, unprocessed pixels are sequentially read from the image for one field in the raster scan order, and it is determined whether or not the image data area is outside.

  As shown in FIG. 5, since the first pixel (the pixel at the field start point S) is out of the image data area because it is included in the synchronization data, DFF81 is reset in step S25 and 0 is used as the pixel value. Output. On the other hand, if the pixel to be processed is selected in the raster scan order and is within the image data area, for example, in step S24, the DFF 81 supplies the pixel value to the adder 82 at the generation timing of the clock signal.

  In step S <b> 26, the adder 82 adds the input pixel value and the signal supplied from the DFF 83 and supplies the result to the DFF 83.

  In step S27, the DFF 83 returns the lower 8 bits of the addition result supplied from the adder 82 to the adder 82 at the clock signal generation timing. At this time, the DFF 83 supplies the addition result to the output unit 84, but the output unit 84 does not output the addition result.

  In step S28, it is determined whether there is an unprocessed pixel. If there is an unprocessed pixel, the process returns to step S22. That is, the processes in steps S22 to S28 are repeated until all the pixels for one field are processed. If it is determined that all the pixels for one field have been processed, in step S29, the output unit 84 displays the addition result supplied from the DFF 83, that is, the cumulative addition result of the pixel values belonging to the image data area. The lower 8 bits are output as the feature amount of the image of one field.

  With the above processing, the lower 8 bits of the cumulative addition result of all the pixel values in the image data area are extracted as the feature quantity of the field from the image signal for one field.

  Now, the description returns to the flowchart of FIG.

  In step S4, the operation information recognition unit 45 determines whether or not the remote controller 14 has been operated by the user to instruct image processing. For example, when the user instructs the double zoom process while viewing the image displayed on the display unit 15, the light emission pattern of the remote controller 14 is received by the light receiving unit 44, and the light emission received by the light receiving unit 44. When the signal based on the pattern is supplied to the operation information recognition unit 45, the operation information recognition unit 45 determines that an operation has been performed, and the process proceeds to step S5.

  In step S <b> 5, the operation information recognition unit 45 recognizes the operation information based on the signal supplied from the light receiving unit 44 and supplies the operation information to the setting information determination unit 46 as a recognition result. The setting information determination unit 46 determines setting information for processing the image for the reflection unit 49 based on the operation information, and supplies the setting information to the feature amount setting information recording unit 61 and the selection unit 47. That is, in this case, since it is instructed to perform the double zoom process on the image, setting information for issuing an instruction to perform the double zoom process to the reflection unit 49 is determined, and the feature amount is determined. The information is supplied to the setting information recording unit 61 and the selection unit 47.

  In step S6, the feature amount setting information recording unit 61 causes the feature amount setting information storage unit 62 to record the feature amount supplied from the feature amount extraction unit 41, and associates the feature amount with the feature amount. The setting information supplied from 46 is recorded in the feature amount setting information storage unit 62, whereby the feature amount and the setting information are stored. More specifically, as shown in FIG. 9, when the feature amount C1 is recorded at a predetermined address A, a setting associated with the feature amount C1 at an m-fold address, that is, an address m × A. Information E1 is stored. Note that FIG. 9 shows the arrangement of addresses in which feature amounts and setting information are stored inside the feature amount setting information storage unit 62.

  Thereafter, when the feature amount setting information recording unit 61 stores the feature amount C2 in the address B in the same manner, the feature amount setting information recording unit 61 stores the corresponding setting information E2 in m × B, and further stores the feature amount C3 in the address C. Then, the corresponding setting information E3 is stored in m × C. By storing the setting information in association with the feature amount in this manner, if the feature amount is determined, the address of the setting information can be specified from the feature amount address. Therefore, the setting information for each feature amount in the setting information storage unit 62 It becomes possible to search smoothly. Note that the feature amount and the setting information are continuously recorded for a period in which the same process is continuously specified. That is, for example, the feature amounts C1 to C3 in FIG. 9 are not limited to feature amounts for one field, and feature amounts for the number of fields in a period in which processing is continuously specified are continuously recorded. ing. Similarly, for the setting information, for example, the setting information E1 to E3 in FIG. 9 is not limited to the feature amount for one field from the addresses associated with the feature amounts C1 to C3. Setting information on the number of fields in a period in which processing is continuously specified is continuously recorded.

  In step S <b> 7, since the setting information is supplied from the setting information determination unit 46, the selection unit 47 supplies the setting information supplied from the setting information determination unit 46 to the reflection unit 49. The reflection unit 49 applies processing to the image stored in the delay unit 48 based on the setting information supplied from the selection unit 47 to reflect the processing according to the instruction content from the user. Are displayed on the display unit 15.

  In step S <b> 8, the operation information recognition unit 45 determines whether or not an operation end is instructed. If it is determined that an operation end is instructed, the process ends. On the other hand, when it is determined that the end of the operation is not instructed, the process returns to step S1.

  That is, as long as the remote controller 14 is operated by the user and an instruction to perform processing on the image continues to be issued, the processing in steps S1 to S8 is repeated and associated with the feature amount together with the feature amount. Thus, the setting information accompanying the processing content is accumulated in the feature amount setting information accumulating unit 62. The operation state in which the steps S1 to S8 are repeated corresponds to the recording mode described with reference to FIGS.

  On the other hand, if it is determined in step S <b> 4 that the operation has not been performed, the process proceeds to step S <b> 9, and the feature amount setting information reading unit 63 does not supply setting information to the selection unit 47. As a result of this processing, the selection unit 47 is in a state where no setting information is supplied from either the setting information determination unit 46 or the feature amount setting information reading unit 63. It will not be supplied. As a result, the reflection unit 49 causes the display unit 15 to display the image for one field temporarily stored in the delay unit 48 as it is.

  Through the above processing, when the user operates the remote controller 14 to reproduce a pre-recorded image, and instructs the processing to be performed on the reproduced image, the user associates it with the feature amount of the received image. Thus, setting information indicating the processing content is accumulated.

  Next, reproduction processing by the image processing apparatus in FIG. 3 will be described with reference to the flowchart in FIG.

  In step S51, the delay unit 48 determines whether or not the next image has been supplied from the reproduction unit 12, and repeats the process until the next image is supplied. For example, when the recording medium 11 generated by the image recording process described above is reproduced by the reproducing unit 12 and image data is supplied, the delay unit 48 temporarily stores the supplied image in step S52. And delay.

  In step S53, the feature amount extraction unit 41 executes feature amount extraction processing, and extracts the feature amount of the supplied image for one field. The feature amount extraction process is the same as the feature amount extraction process described with reference to the flowchart of FIG.

  In step S54, the synchronization detection unit 42 executes synchronization detection processing to detect synchronization between the feature amount of the image being reproduced and the feature amount associated with the setting information for processing the image. .

  Here, the synchronization detection process will be described with reference to the flowchart of FIG.

  In step S81, the reproduction position feature value generation unit 102 of the synchronization detection unit 42 determines whether or not a feature value has been supplied from the feature value extraction unit 41, and repeats the processing until it is supplied. For example, when the feature amount is extracted by the feature amount extraction process in step S53 and the feature amount of the image currently being reproduced is supplied from the feature amount extraction unit 41, the process proceeds to step S82.

  In step S82, the search position feature amount reading unit 104 initializes a counter i for counting the feature amount of the search position to zero.

  In step S <b> 83, the reproduction position feature value generation unit 102 acquires the feature values that have been stored in the feature value buffers 101-1 to 101-3 while acquiring the supplied feature values. That is, when a feature amount is newly supplied, the feature amount buffer 101-1 supplies the feature amount stored so far to the reproduction position feature amount generation unit 102 and the feature amount buffer 101-2. Similarly, the feature amount buffer 101-2 stores the supplied feature amount and supplies the stored feature amount to the reproduction position feature amount generation unit 102 and the feature amount buffer 101-3. . Furthermore, the feature amount buffer 101-3 stores the feature amount supplied from the feature amount buffer 101-2 and supplies the feature amount stored so far to the reproduction position feature amount generation unit 102. As a result, the reproduction position feature value generation unit 102 is supplied with the latest field feature values and the feature values for the past three fields stored in the feature value buffers 101-1 to 101-3, respectively. become. Therefore, the playback position feature value generation unit 102 supplies the feature values for four fields including the field being played back to the comparison unit 103 as playback position feature values.

  In step S84, the search position feature value reading unit 104 reads out the feature values of four fields from the beginning position of the feature value stored in the feature value setting information storage unit 62 as the search position feature value, and reads and compares the feature values. 103 and the detection unit 105.

  In step S85, the comparison unit 103 includes a reproduction position feature amount including a total of four feature amounts for the past three fields including the field being reproduced supplied from the reproduction position feature amount generation unit 102, and a search position feature amount. The search position feature quantity that is supplied from the reading section 104 and is composed of the feature quantities of the four fields continuing from the i-th position from the head position of the feature quantity stored in the feature quantity setting information storage section 62 is compared.

  In step S86, the comparison unit 103 determines whether or not they match based on the comparison result. For example, if it is determined in step S86 that they do not match, in step S88, the search position feature value reading unit 104 determines the reproduction position feature value for all feature values stored in the feature value setting information storage unit 62. It is determined whether or not the comparison has been made. For example, if it is determined in step S88 that it has not been compared with all the feature values, the search position feature value reading unit 104 increments the counter i by 1 in step S89, and the process returns to step S84. That is, by this process, the processes of steps S84 to S86, S88, and S89 are repeated until the reproduction position feature quantity and the search position feature quantity do not match and are compared with all the accumulated feature quantities. The search position feature quantity composed of the feature quantities for four consecutive fields and the reproduction position feature quantity are repeated while sequentially shifting at an interval of one field.

  That is, the search position feature amount is, for example, four consecutive feature amounts among the feature amounts sequentially accumulated by the feature amount extraction unit 41 as shown in the upper right part of FIG. It is a lump. In FIG. 12, a vertically long rectangular cell in the figure indicates a feature amount for one field, and shaded portions G1 and G2 indicate that the same continuous feature amount is arranged. ing. Further, the reproduction position feature value is a block of feature values for four consecutive fields including the feature value being reproduced supplied from the feature value extraction unit 41 as shown in the lower right part of FIG. It is.

  For example, as shown in FIG. 12, in the case of being represented by the reproduction position feature amount G2, when compared with the search position feature amount G0, since it is not the same, it is not detected as a synchronization position. Furthermore, since comparison with all accumulated feature amounts has not been performed, the counter i is incremented by 1, and the search position feature amount G0 'and the reproduction position feature amount G2 are compared. In this way, the comparison with the reproduction position feature quantity G2 is repeated while the search position feature quantity is shifted by one field interval in the right direction in the drawing.

  In step S86, for example, when the reproduction position feature value G2 and the search position feature value G1 are compared, the search position feature value G1 has the same configuration as the reproduction position feature value G2. In step S87, the comparison unit 103 notifies the detection unit 105 that they match. Based on this notification, the detection unit 105 uses the head position of the search position feature value currently supplied from the current search position feature value reading unit 104, that is, the i-th feature value from the head position as the synchronization position information. This is supplied to the setting information reading unit 63.

  On the other hand, if it is determined in step S88 that the comparison with all the stored search position feature quantities has been completed, in step S90, the detection unit 105 has a search position feature quantity that matches the reproduction position feature quantity. Output that it is not synchronized.

  Through the above processing, the feature amount stored in the feature amount setting information storage unit 62 can be synchronized with the feature amount of the image being reproduced. That is, the synchronization detection unit 42 compares only the feature amount of the field being reproduced with the feature amount stored in the feature amount setting information storage unit 62, so that the feature amounts coincide by chance. In order to reduce the possibility that synchronization is detected at the wrong position, it is accurate by comparing not only the feature quantity of the currently played field but also 4 fields for the past 3 fields including the played field. Synchronous detection is implemented. In addition, by using feature quantities in this way, it is possible to set feature quantities instead of time codes in each field unit, and to perform synchronous detection in field units without using time codes. Is possible.

  Now, the description returns to the flowchart of FIG.

  In step S55, the feature amount setting information reading unit 63 determines whether or not a feature amount that matches the reproduction position feature amount of the field being reproduced is accumulated in the feature amount setting information accumulation unit 62. For example, when the synchronization position information has been supplied by the process of step S87 in the flowchart of FIG. 10, the feature quantity that matches the playback position feature quantity of the field being played back is stored in the feature quantity setting information storage unit 62. Therefore, the process proceeds to step S56.

  In step S <b> 56, the feature amount setting information reading unit 63 determines whether the setting information associated with the synchronized feature amount is accumulated in the feature amount setting information accumulation unit 62. That is, the feature amount can be stored in the feature amount setting information storage unit 62 even in the absence of the setting information, and thus the presence / absence of the setting information associated with the feature amount is determined by this process.

  For example, when it is determined in step S56 that the setting information associated with the feature amount is not accumulated, the feature amount setting information reading unit 63 does not supply the setting information to the selection unit 47 in step S57. . As a result of this processing, the selection unit 47 is in a state where no setting information is supplied from either the setting information determination unit 46 or the feature amount setting information reading unit 63. It will not be supplied. As a result, the reflection unit 49 causes the display unit 15 to display the image for one field temporarily stored in the delay unit 48 as it is.

  In step S58, it is determined whether or not termination has been instructed. If termination has been instructed, the process ends. If termination has not been instructed, the process returns to step S51.

  On the other hand, in step S56, for example, when it is determined that the setting information associated with the feature amount is stored, the feature amount setting information reading unit 63 in step S59 is more than the feature amount setting information storage unit 62. The setting information stored in association with the feature amount of the synchronization position information is read and supplied to the selection unit 47, and the process proceeds to step S60.

  In step S <b> 60, the selection unit 47 has no setting information from the setting information determination unit 46 and is supplied with setting information from the feature amount setting information reading unit 63, so that the selection unit 47 includes the feature amount setting information reading unit 63. Is supplied to the reflection unit 49. The reflection unit 49 reflects the process on the image for one field stored in the delay unit 48 based on the setting information and displays the image on the display unit 15.

  This process corresponds to the playback mode described with reference to FIGS.

  With the above processing, for example, processing as shown in FIG. 13 is possible. That is, when an image composed of the video indicated by the times t0 to t1 is recorded in the recording medium 11 in advance, the reproduction is started at the time t11 which is a timing after the time t0, and further at the times t101 to t102 later. When the user operates the remote controller 14 and gives an instruction to process an image, setting information associated with the feature quantity is accumulated in the feature quantity setting information storage unit 62 together with the feature quantity at the same timing. The

  Also, fast-forwarding is started at time t12, playback is started again at times t21 to t22, and then fast-forwarded to time t31. When playback is started at time t31, the user can remotely When the controller 14 is operated to instruct processing of an image, setting information associated with the feature amount is accumulated in the feature amount setting information storage unit 62 together with the feature amount at the same timing.

  Furthermore, after being played back until time t32, it is rewound until time t121, and playback is started. At time t131 to t132, when the user operates the remote controller 14 to instruct the processing of the image, the setting information associated with the feature quantity and the feature quantity at the same timing is displayed as the feature quantity setting information. The data is accumulated in the accumulation unit 62.

  After that, when the video is played back until the time t151 close to the head position and the remote controller 14 is not operated until the time t152, the time t101 to the time when the remote controller 14 is instructed to process the image. Synchronization position information is generated based on the reproduction position feature quantity at timings t102, times t131 to t132, and times t111 to t112, and setting information stored in association with the feature quantity of the synchronization position information is read. Thus, the processing based on the setting information is reflected in the image.

  In FIG. 13, the top level indicates that the scale for one video is from time t0 to time t1. In the second stage, as the first playback procedure, normal playback is performed from time t11 to t12, t21 to t22, t31 to t32, and fast-forward playback is performed from time t12 to t21 and t22 to 31. Is shown to have been implemented.

  The third row shows the operation timing of the remote controller 14 during the first playback, and the fourth row shows the timing when the setting information is recorded during the first playback. It is shown. In the third and fourth stages, the remote controller 14 is operated at times t101 to t102 and t111 to t112, and setting information corresponding to the operation of the remote controller 14 is recorded at the same timing. It is shown. When the setting information is recorded, processing corresponding to the setting information is performed, so that the processing desired by the user is reflected in the image at the same timing when the remote controller 14 is operated. It is displayed in the state.

  The fifth row shows the second-order playback procedure after the first-order playback procedure is finished and then rewinding to time t121 by a rewind operation, and normal playback is performed from time t121 to t122. Is shown to be implemented.

  The sixth row shows the operation timing of the remote controller 14 during the second playback, and the seventh row shows the timing when the setting information is recorded during the second playback. It is shown. The sixth and seventh stages indicate that the remote controller 14 is operated at times t131 to t132, and setting information corresponding to the operation of the remote controller 14 is recorded at the same timing. When the setting information is recorded, processing corresponding to the setting information is performed, so that the processing desired by the user is reflected in the image at the same timing when the remote controller 14 is operated. It is displayed in the state.

  The eighth row shows the third-order playback procedure after the second-order playback procedure is finished and then rewinding to time t151 by a rewind operation. Normal playback is performed from time t151 to t152. Is shown to be implemented.

  The ninth row shows the timing at which the synchronization processing by the synchronization detection unit 42 is executed during the third playback, and the tenth (bottom) is playing the third playback. The timing at which the setting information is reproduced (the setting information is reflected in the image) is shown. That is, in the 9th and 10th tiers, based on the setting information recorded by operating the remote controller 14 during the 1st and 2nd playback during the 3rd playback. It is shown that setting information recorded by operating the remote controller 14 at times t101 to t102, t111 to t112 and times t131 to t132, which are the same timing, is read out and reflected in the image. Yes.

  Note that the processing above the dotted line in FIG. 13 corresponds to the recording mode in FIGS. 1 and 2, and is the recording processing described with reference to the flowchart in FIG. 7 described above, and the processing below the dotted line is in the reproduction mode. It is the reproduction | regeneration processing demonstrated with reference to the flowchart of corresponding FIG.

  In the above description, the example using the integrated value of the pixel values of the image data area in the image signal for one field has been described. However, other feature values may be used, for example, a motion vector ( (Full screen motion and local motion), a value indicating how much a specific waveform pattern appears, an integrated value of pixel values in a reduced image, an integrated value of pixel values of a specific part of the image, and values using these for multiple fields Or a combination of these plural feature quantities.

  The setting information has been described by taking the zoom magnification as an example, but other information may be used, for example, a zoom parameter such as a zoom position (center position) or a combination of the zoom position and the zoom magnification. , Brightness, contrast, gamma correction, image quality setting parameters such as DRC (Digital Reality Creation) palette value (resolution setting value and noise setting value), or sound parameters such as volume and sound switching (switching language) May be used.

  Through the above processing, setting information is recorded in association with the feature amount, so that when a pre-recorded image is reproduced, a feature such as a time code in a field unit depends on the feature amount of the image being reproduced. By using the amount, it is possible to synchronize with the accumulated feature amount, and the processing is reflected on the image being reproduced by the setting information associated with the synchronized feature amount.

  As a result, editing processing based on the accumulated setting information can be reflected in the image without using a time code or the like. In addition, since only the feature amount and the setting information are recorded and no pre-recorded image is recorded, for example, even an image provided with restrictions such as Copy Once, It is possible to repeatedly play back the edited image.

  In the above processing, an example has been described in which the synchronization detection processing is executed for each field and the synchronization position information is supplied to the feature amount setting information reading unit 63 in the reproduction processing. By the way, the time spent for the synchronization detection process depends on the time until the search position feature quantity and the reproduction position feature quantity match, so the time spent for the process is not constant and there is no synchronized position. In this case, since all feature quantities are compared, the ratio of the time spent for the synchronization detection process out of the time spent for the process when executing the playback process for one field is increased. In some cases, it may be a rule of time spent in the reproduction process.

  However, as the above-described recording process is repeated, it is expected that the setting information stored in the feature amount setting information storage unit 62 in association with the feature amount will increase. Then, it is expected that the time spent for the synchronization detection process also increases in proportion to the amount of information stored in the feature amount setting information storage unit 62. That is, it is expected that the time spent for the reproduction process for one field will increase in proportion to the amount of information stored in the feature amount setting information storage unit 62. In some cases, the reproduction process for one field is executed. In the meantime, there is a possibility that the display time for one field may be exceeded, and there is a possibility that the image for each field cannot be accurately processed and reproduced.

  That is, when the amount of information stored in the feature amount setting information storage unit 62 is not so large and the synchronization detection process does not take much time, the time spent for the synchronization detection process as shown in FIG. All the fields will be reproduced accurately within the display time of. In FIG. 14 and FIG. 15, the numbers shown in the upper row are field numbers, showing the timing at which the images of each field are displayed, and the lower row shows the time required for the reproduction process. The shaded portion indicates the time when the reproduction process is being executed, and the plain portion indicates the waiting time.

  On the other hand, when the recording process is repeated and the amount of information stored in the feature amount setting information storage unit 62 becomes enormous, as shown in FIG. 15, the time spent for the playback process of one field is displayed for one field. Therefore, the image of all fields cannot be reproduced. That is, in FIG. 15, the playback process for the first field is completed within the display time, but the time for the second field is about 1.5 times the display time for one field for the playback process. Is spent, the third field is not replayed. In the fourth field, since the time required for reproduction processing is about three times or more the display time of one field, the fifth to seventh fields are not reproduced. Furthermore, although the playback process for the eighth field is completed within the display time, the time for the ninth field is also about three times as long as the display time for one field. Therefore, the 10th to 12th fields are not reproduced. In the thirteenth field, since the time required for reproduction processing is about one time or more than the display time of one field, the fourteenth field is not reproduced. As a result, only the first, second, fourth, eighth, ninth and thirteenth frames are reproduced.

  That is, there is a possibility that the image recorded on the recording medium 11 cannot be processed and displayed on all the fields accurately.

  Therefore, by separating the playback process described above into a synchronization detection process (a match list generation process described later) and a process related to reflection (a reflection process described later), only the skipped synchronization position information is used. By executing the reflection process while estimating the synchronization position, the process may be accurately applied to all fields.

  FIG. 16 shows a configuration example of the image processing apparatus 13 that separates the above-described reproduction processing into synchronization detection processing (match list generation processing described later) and reflection processing (reflection processing described later). The same components as those of the image processing apparatus 13 in FIG. 3 are denoted by the same reference numerals, and the description thereof will be omitted as appropriate.

  The light receiving unit 44, the operation information recognition unit 45, the selection unit 47, and the delay unit 48 of the image processing apparatus 13 in FIG. 16 are basically the same as those in the image processing apparatus in FIG.

  The feature amount extraction unit 241, the synchronization detection unit 242, the feature amount setting information recording unit 261 of the storage block 243, the feature amount setting information storage unit 262, the feature amount setting information reading unit 263, the setting information determination unit 246, and the reflection unit 249 are The basic function includes a feature amount extraction unit 41, a synchronization detection unit 42, a feature amount setting information recording unit 61 of a storage block 43, a feature amount setting information storage unit 62, a feature amount setting information reading unit 63, and a setting information determination unit. 46 and the reflection unit 49, but communicates additional information to each other via the bus 231, and shares the field number information of the image currently processed by each component included in the additional information. Is different. A mechanism for sharing field numbers will be described later with reference to FIGS. Further, the synchronization detection unit 242 generates the match list memory 201, and the feature amount setting information reading unit 263 is different in that the setting information is read from the feature amount setting information storage unit 262 based on the information in the match list memory 201. .

  The feature amount extraction unit 241 basically has the same function as the feature amount extraction unit 41, extracts feature amounts of images sequentially supplied from the image reproduction unit 12, extracts the synchronization detection unit 242, and This is supplied to the feature amount setting information recording unit 261 of the storage block 243. At this time, the feature quantity extraction unit 241 also supplies the feature quantity information together with the corresponding field number information.

  The synchronization detection unit 242 basically has the same function as that of the synchronization effect unit 42, but among the feature amounts (search position feature amounts described later) stored in the feature amount setting information storage unit 262, the feature amount The feature amount (reproduction position feature amount described later) of the image reproduced by the image reproduction unit 12 supplied from the extraction unit 241 is searched, and when the same feature amount is detected, the detection result is the synchronization position of the image. Is registered in the match list 201. In order to register the synchronization detection result in the match list 201 in the match list, the sync detection unit 242 is provided with a match list registration unit 301 in place of the detection unit 105 as shown in FIG. Reference numeral 301 registers the search position feature quantity supplied from the search position feature quantity reading unit 104 in the match list 201 as a synchronization detection result at a timing when it is considered that the comparison unit 103 has detected synchronization.

  The feature amount setting information recording unit 261 of the storage block 243 is associated with the feature amount associated with the field number supplied from the feature amount extracting unit 41 and the field number supplied from the setting information determining unit 46. The setting information is stored in the feature amount setting information storage unit 262 in association with the field number.

  The feature amount setting information reading unit 263 basically has the same function as the feature amount setting information reading unit 63, but acquires a feature amount (search position feature amount) registered as a synchronization position in the match list 201. Then, the setting information associated with the feature amount and stored in the feature amount setting information storage unit 262 is read and supplied to the selection unit 47.

  The update unit 263a of the feature amount setting information reading unit 263 performs update by deleting the unnecessary feature amount from the feature amounts registered as synchronization positions from the match list 201. The synchronization information selection unit 263b selects any one of the feature amounts registered as synchronization positions in the match list 201. The synchronization information selection unit 263b basically selects the latest synchronization information. The difference calculation unit 263c calculates the difference between the field number associated with the synchronization position information selected from the match list 201 and the field number of the field that the reflection unit 249 is to process, and supplies the difference to the estimation unit 263d. To do. The estimation unit 263d determines the field number of the field that the reflection unit 249 is to process based on the field number read from the match list and the difference information among the setting information stored in the feature amount setting information storage unit 262. The address of the feature amount setting information storage unit 262 in which the setting information corresponding to is stored is estimated.

  Next, a configuration example in which field numbers are shared will be described.

  The field number is shared with each node. In FIG. 16, the image reproduction unit 12 is handled as one node. Further, the feature quantity extraction unit 241, the synchronization detection unit 242, the storage block 243, and the setting information determination unit 246 are treated as the same node different from the image reproduction unit 12. That is, in the feature amount extraction unit 241, the synchronization detection unit 242, the accumulation block 243, and the setting information determination unit 246, the fields to be handled are always the same number. Furthermore, the reflection unit 249 is further managed with different field numbers as different nodes.

  Each node is provided with the additional information control unit 251 shown in FIG. 18 or the additional information control unit 271 shown in FIG.

  The additional information control unit 251 is provided in the foremost node, generates additional information Iad as meta information for each predetermined period of the image signal output from the above-described node, for example, for each field, and the additional information Iad is generated. The data is sent to the bus 231. As shown in FIG. 20, the additional information Iad is composed of a node number for identifying a node and a field number as an identifier. In this case, in FIG. 16, for example, the image reproduction unit 12 is provided.

  The additional information control unit 271 is provided in a node other than the first stage, and acquires additional information Iad transmitted through the bus 231. That is, the additional information control unit 271 is provided in a configuration other than the image reproduction unit 12.

  The field number generation unit 361 generates field numbers that are sequentially incremented for each field period based on the synchronization signal SYNCa supplied from the image reproduction unit 12. That is, when an image signal read from the recording medium 11 is input to the image reproduction unit 12, a field number is generated.

  The additional information writing processing unit 362 attaches a node number to the field number generated by the field number generating unit 361 to generate additional information, and writes the additional information to the FIFO unit 363 for each field period. The additional information read processing unit 364 reads the additional information Iad from the FIFO unit 363 based on the synchronization signal SYNCb synchronized with the image signal output from the image reproduction unit 12 and sends it to the bus 231.

  Here, the size of the FIFO unit 363 depends on the processing time of the devices constituting the node. That is, the size of the FIFO unit 363 depends on the processing time of the image reproduction unit 12. The additional information read processing unit 364 outputs the additional information Iad to the bus 231 in each field period.

  Next, the operation of the additional information control unit 251 will be described.

  When the synchronization signal SYNCa separated from the image signal SVin input to the image reproduction unit 12 is supplied, the field number generation unit 361 generates a field number that is sequentially incremented for each field period, and an additional information write processing unit 362. The additional information writing processing unit 362 generates additional information by adding the node number to the field number, and writes the additional information in the FIFO unit 363.

  Further, upon receiving the supply of the synchronization signal SYNCb when the image reproduction unit 12 outputs the image signal, the additional information read processing unit 364 reads the additional information Iad from the FIFO unit 363 based on the synchronization signal SYNCb, and the bus 231. To send.

  Next, a configuration example of the additional information control unit 271 will be described with reference to FIG.

  The additional information acquisition unit 381 receives the additional information Iad sent from the additional information control unit 251 through the bus 231 based on the synchronization signal SYNCc supplied from each node and synchronized with the timing at which the image signal is input. get. The additional information write processing unit 382 writes the additional information Iad acquired by the additional information acquisition unit 381 in the FIFO unit 383.

  The additional information read processing unit 364 reads the additional information Iad from the FIFO unit 363 based on the synchronization signal SYNCd supplied from each node and synchronized with the timing of outputting the processing result, and the control signal based on the additional information Iad. SCO is generated, and the operation of the node is controlled by this control signal SCO.

  In this case, the size of the FIFO unit 383 depends on the processing time of the feature amount extraction unit 241, the synchronization detection unit 242, the accumulation block 243, and the setting information determination unit 246. That is, the FIFO unit 383 so that the additional information Iad corresponding to the feature amount extraction unit 241, the synchronization detection unit 242, the accumulation block 243, and the setting information determination unit 246 is read from the FIFO unit 383 in each field period. The size of is set.

  Next, the operation of the additional information control unit 271 in FIG. 19 will be described.

  When the synchronization signal SYNCc synchronized with the input timing of the image signal is supplied from each node to the additional information acquisition unit 381, the additional information Iad is transmitted from the bus 231 in each field period based on the synchronization signal SYNCc. Is acquired. The additional information write processing unit 382 writes the additional information Iab into the FIFO unit 383.

  Further, when the synchronization signal SYNCd synchronized with the timing at which each node outputs the processing result is supplied, the additional information reading processing unit 384 reads the additional information Iad from the FIFO unit 383 based on the synchronization signal SYNCd. This additional information Iab corresponds to each field period of the processing result output by the feature amount extraction unit 241, the synchronization detection unit 242, the accumulation block 243, and the setting information determination unit 246.

  The additional information read processing unit 384 outputs a field number included in the additional information Iad read from the FIFO unit 383 in each field period.

  With the configuration as described above, each node, that is, the feature amount extraction unit 241, the synchronization detection unit 242, the accumulation block 243, the setting information determination unit 246, and the reflection unit 249 is processed by each node itself. The field number of the target image can be recognized. Further, by transmitting these pieces of information using the bus 231, even when handling different fields to be processed at the same timing, they can be mutually recognized.

  In the following description, it is assumed that each node, that is, each component, can recognize the field image of which field number is the processing target for each component as well as the other components.

  Next, recording processing by the image processing apparatus 13 in FIG. 16 will be described with reference to the flowchart in FIG. Note that the processing in steps S92, S93, S95, S98 to S100 in the flowchart of FIG. 21 is the same as the processing in steps S1, S2, S4, S7 to S9 in the flowchart of FIG. Shall.

  In step S91, the feature amount extraction unit 241 increments the field number counter N by 1. In step S92, the feature amount extraction unit 241 determines whether an image having the field number N has been input. For example, when an image having a field number N is input, the delay unit 48 delays the image having the field number N in step S93.

  In step S94, the feature amount extraction unit 241 performs feature amount extraction processing to extract feature amounts. This process is basically the same as the process in step S3. At this time, the feature quantity extraction unit 241 extracts the extracted feature quantities in association with field numbers for identifying individual fields. To do.

  In step S <b> 96, the operation information recognition unit 45 recognizes the operation information based on the signal supplied from the light receiving unit 44 and supplies the operation information to the setting information determination unit 46 as a recognition result. The setting information determination unit 246 determines setting information for processing the image for the reflection unit 249 based on the operation information, and associates it with the field number at that time to set the feature amount setting information recording unit 61. And supplied to the selector 47.

  In step S97, the feature amount setting information recording unit 261 causes the feature amount setting information storage unit 262 to record the feature amount associated with the field number supplied from the feature amount extracting unit 241 and based on the field number. Thus, the feature amount and the setting information are recorded by causing the feature amount setting information storage unit 262 to record the setting information associated with the field number supplied from the setting information determination unit 246 in association with the feature amount. And accumulate.

  That is, the feature amount associated with the field number supplied from the feature amount extraction unit 241 by the processing in step S96 is information as shown in the list L1 on the left side of FIG. In the list L1 on the left side of FIG. 22, field numbers are recorded on the left side, and feature quantities are recorded on the right side. For the list L1, 0x11 to 0xC4 are recorded from the top as field numbers, and 0x01, 0xF5, 0xA3, 0x58, 0x8A, 0x29, 0x40, 0x55, 0xC2,. ing.

  On the other hand, the setting information associated with the field number supplied from the setting information determination unit 246 by the process of step S97 is information as shown in the list L2 of FIG. 22, for example. That is, in the list L2 in FIG. 22, the field number is recorded on the left side and the setting information is recorded on the right side. For the list L2, field numbers 0x11 to 0xC4 are recorded from the top, and setting information corresponding to each is (100%, (0, 0)), (95%, (0, 0)), (90% , (0, 0)), (85%, (0, 0)), (80%, (0, 0)), (75%, (0, 0)), (75%, (5, 10) ), (75%, (10, 20)), (75%, (15, 30)), ..., (75%, (50, 100)) are recorded. In FIG. 22, the setting information is information indicating the zoom magnification and the zoom position. For example, (100%, (0, 0)) is the upper left of the image at the zoom position where the zoom magnification is 100%. The pixel position of (0, 0) is (0, 0).

  In the process of step S97, the feature amount setting information recording unit 261 uses the lists L1 and L2 shown in FIG. 22 to associate the setting information with the feature amount as shown in the list L3 and the feature amount setting information. The data is accumulated in the accumulation unit 262. That is, the feature amount setting information recording unit 261 associates with the feature amount 0x01 of the field number 0x11 of the list L1 in FIG. 22 to set the setting information (100%, (0, 0)) of the field number 0x11 of the same list L2. Is recorded as indicated by L3. That is, the setting information (100%, (0, 0)) is stored in the feature value setting information storage unit 262 in association with the feature value 0x01.

  Similarly, setting information (95%, (0, 0)) of the field number 0x12 of the same list L2 is recorded in association with the feature amount 0xF5 of the field number 0x12 of the list L1, so that the feature amount 0xF5 is recorded. The setting information (95%, (0, 0)) is stored in association with each other. Also, since the setting information (90%, (0, 0)) of the field number 0x13 of the same list L2 is recorded in association with the feature amount 0xA3 of the field number 0x13 of the list L1, it is associated with the feature amount 0xA3. Setting information (90%, (0, 0)) is accumulated. Further, since the setting information (85%, (0, 0)) of the field number 0x14 of the same list L2 is recorded in association with the feature amount 0x58 of the field number 0x14 of the list L1, it is associated with the feature amount 0x58. Setting information (85%, (0, 0)) is accumulated. Also, since the setting information (80%, (0, 0)) of the field number 0x15 of the same list L2 is recorded in association with the feature amount 0x8A of the field number 0x15 of the list L1, it is associated with the feature amount 0x8A. Setting information (80%, (0, 0)) is accumulated. Further, since the setting information (75%, (0, 0)) of the field number 0x16 of the same list L2 is recorded in association with the feature amount 0x29 of the field number 0x16 of the list L1, it is associated with the feature amount 0x29. Setting information (75%, (0, 0)) is accumulated. Also, since the setting information (75%, (5, 10)) of the field number 0x17 of the same list L2 is recorded in association with the feature amount 0x40 of the field number 0x17 of the list L1, it is associated with the feature amount 0x40. Setting information (75%, (5, 10)). Further, since the setting information (75%, (10, 20)) of the field number 0x18 of the same list L2 is recorded in association with the feature amount 0x55 of the field number 0x18 of the list L1, it is associated with the feature amount 0x55. Setting information (75%, (10, 20)) is accumulated. Also, since the setting information (75%, (15, 30)) of the field number 0x19 of the same list L2 is recorded in association with the feature amount 0xC2 of the field number 0x19 of the list L1, it is associated with the feature amount 0xC2. Setting information (75%, (15, 30)) is accumulated. Further, since the setting information (75%, (50, 100)) of the field number 0xC4 of the same list L2 is recorded in association with the feature amount 0x3F of the field number 0xC4 of the list L1, it is associated with the feature amount 0x3F. The setting information (75%, (50, 100)) is stored in the feature amount setting information storage unit 262, respectively.

  Further, when the feature amount setting information storage unit 262 stores the feature amount and the setting information in the feature amount setting information storage unit 262, the feature amount setting information recording unit 261 records so as to keep the address between the feature amounts constant. That is, when the feature amount setting information storage unit 262 records the feature amount of the field X at the address x, the feature amount setting information storage unit 262 records the feature amount of the field (X + 1) at the address x + s. As a result, the setting information is similarly recorded at equally spaced addresses. That is, when the feature amount of the field X is recorded at the address x, the setting information associated with the feature amount is recorded at the address x × Z, and the feature amount of the field (X + 1) is recorded at the address x + s. Since the setting information associated with the feature amount is recorded at the address (x + s) × Z, the setting information is also recorded at a constant (= s × Z) interval between fields. become.

  Through the above processing, when the user operates the remote controller 14 to instruct the processing to be performed on the reproduced image when reproducing the pre-recorded image, each of the feature amount and the setting information is set to the field number. Setting information indicating the processing content is stored in association with the feature amount of the received image for each identical field number supplied in the associated state.

  Next, the match list generation process by the synchronization detection unit 242 will be described with reference to the flowchart of FIG. Note that the processing of steps S104 to S108, S110, and S111 in the flowchart of FIG. 23 is the same as the processing of steps S82 to 86, S88, and S89 described with reference to the flowchart of FIG. Shall.

  That is, in step S101, the feature amount extraction unit 241 sets a counter N (not shown) to the current field number + 1 value. That is, the number of the field to be processed is incremented by 1.

  In step S102, the feature quantity extraction unit 241 determines whether an image of a field with field number N has been supplied, and repeats the process until an image with field number N is supplied. In step S102, when an image of field number N is supplied from the image reproduction unit 12, in step S103, the feature amount extraction unit 241 executes a feature amount extraction process, and the supplied image of field number N is displayed. The feature amount is extracted and supplied to the synchronization detection unit 242 and the accumulation block 243. The feature amount extraction process is the process described with reference to the flowchart of FIG.

  Further, the reproduction position feature quantity and the search position feature quantity are compared by the processing of steps S104 to S107. At this time, the search position feature value reading unit 104 sequentially extracts feature values from the feature value setting information storage unit 262 as the search position feature values. At this time, the field number and the feature value of the feature value to be read are stored. The address information in the feature quantity setting information storage unit 262 and the address information in which the corresponding setting information is recorded are also extracted.

  If the two match in step S108, that is, if synchronization is detected, the match list registration unit 301 registers feature quantity information as synchronization detection information in the match list 201. Return to S101. That is, as described above, the search position feature value reading unit 104 stores the feature number setting information storage unit in which the field number and the feature value of the feature value image to be read are stored together with the feature value as the search position feature value information. The address information in 262 and the address information where the corresponding setting information is recorded are also read. Therefore, the match list registration unit 301 stores the feature amount setting information in the match list 201 as shown in FIG. 24 in association with the field number of the feature amount image as the synchronization position information. Information on the address in the storage unit 262 and information on the address where the corresponding setting information is recorded are registered.

  If it is determined in step S108 that they do not match, the process proceeds to step S110, where it is determined whether or not all the accumulated feature quantities have been compared. If the comparison has not been performed, the counter i is incremented by 1 in step S111, and the process returns to step S106. That is, the reproduction position feature quantity and the search position feature quantity are compared until all the feature quantities are compared, and finally all the feature quantities are compared, that is, there are synchronized feature quantities. If it is determined that there is not, the process returns to step S101.

  In FIG. 24, 11, 7, and 4 are recorded as field numbers, and the feature amount that is the synchronization position information of the field with the field number 11 is recorded at the address 0x008402 in the feature amount setting information storage unit 262, and further supported. It is shown that the setting information to be recorded is recorded at address 0x043456, and the feature amount that is the synchronization position information of the field of field number 7 is recorded at address 0x00F8F8 in the feature amount setting information storage unit 262 and further corresponds It is shown that the setting information is recorded at the address 0x060F0F, and the feature amount that is the synchronization position information of the field with the field number 4 is recorded at the address 0x003690 in the feature amount setting information storage unit 262, and the corresponding setting It is shown that information is recorded at address 0x024680.

  Further, the latest information has a higher priority, and in FIG. 24, the information of the latest field number 11 having the highest priority is registered in the top row, and the information of the oldest field number 4 having the lower priority is registered. It is shown at the bottom.

  Further, as shown in FIG. 24, the match list 201 may not be registered for all field number fields. In other words, if the match list generation process is completed within the time for which an image of one field is displayed, there is a possibility that the synchronization position information is searched for all field numbers (required reproduction position feature value and search position). If the condition matches the feature value). However, when an enormous amount of feature amounts and setting information are recorded in the feature amount setting information storage unit 262, the number of times that the processes of steps S106 to S108, S110, and S111 described above are repeated may be enormous. Along with this, it is conceivable that the time spent for the match list generation process exceeds the display time of one field. As a result, the match list generation process may not be executed for each field, and as shown in FIG.

  In the process of step S101 in the flowchart of FIG. 23, it is not always necessary to add 1 to the current field number, and the current field number may be used as it is. That is, in the process of step S101 in the flowchart of FIG. 23, as shown in the upper part of FIG. 25, 1 is added to the field number at the time of completion of the process, so that the process is temporarily stopped at the time of completion. It is shown that the processing is started when a new field number is reached. That is, in the upper part of FIG. 25, the match list generation process for field number 1 is executed from the left, and the display time for field number 2 exceeds the display time for field number 1 and ends with the display time for field number 2. When proceeding, the process waits until the image of field number 3 is input by the processes of steps S101 and S102. Also, the match list generation process for field number 3 is executed and ends with the display time for field number 5, but when proceeding to the next process, the image for field number 6 is input by the processes of steps S101 and S102. It will be in the state of waiting for processing. Furthermore, the match list generation process for field number 6 is executed and ends at the display time for field number 8, but when proceeding to the next process, the image for field number 9 is input by the processes of steps S101 and S102. It will be in the state of waiting for processing. Also, the match list generation process for field number 9 is executed and ends with the display time for field number 12, but when proceeding to the next process, the image for field number 13 is input by the processes of steps S101 and S102. It will be in the state of waiting for processing. Further, the match list generation process for the field number 13 is executed and the display is completed for the display time of the field number 14, but when proceeding to the next process, the image of the field number 15 is input by the processes of steps S101 and S102. It will be in the state of waiting for processing.

  On the other hand, when the current field number is used as it is in the process of step S101, the process proceeds as shown in the lower part of FIG. That is, from the left, the match list generation process for field number 1 is executed, and when the display time for field number 1 exceeds the display time for field number 1 and ends with the display time for field number 2, Since the processing of the number is started, there is no waiting state for processing, and the matching list generation processing for the next field number 2 is started as it is. When the match list generation process for field number 2 is executed and ends at the display time for field number 4, when the process proceeds to the next process, the process for the field number at the end is started, so there is no waiting state for processing. The match list generation process for the next field number 4 is started as it is. When the match list generation process for field number 4 is executed and ends at the display time of field number 7, the match list generation process for field number 7 at the time of completion is started. When the match list generation process for field number 7 is executed and ends at the display time of field number 7, the match list generation process for field number 7 at the next end time is complete, so the next field number 8 is input. It will be in a waiting state until it is done. When the image of field number 8 is input, the match list generation process for field number 8 is executed. When the display time for field number 10 ends, the match list generation process for field number 10 at the time of termination is started. When the match list generation process for the field number 10 is executed and ends at the display time of the field number 12, the match list generation process for the field number 12 at the time of completion is started. The match list generation process for field number 12 is executed, and the process ends with the display time for field number 14.

  As described above, even if 1 is added to the current field number by the process of step S101, or the match list generation process is executed without adding 1, any process may be performed. .

  Next, the reflection process by the image processing apparatus 13 in FIG. 16 will be described with reference to the flowchart in FIG.

  In step S131, the reflection unit 249 increments the field number M of the field image to be processed by 1 by one.

  In step S132, the delay unit 48 determines whether or not the field image having the field number M has been input, and repeats the processing until it is determined that the field image has been input. For example, when an image having the field number M is input, the delay unit 48 stores the image having the field number M in order to temporarily delay the image in step S133.

  In step S134, the update unit 263a of the feature amount setting information reading unit 263 accesses the match list 201 and updates the match list 201. Here, the update of the match list 201 is to delete unnecessary information from the address of the feature amount associated with the field number registered in the match list 201 and the address of the setting information. Shows the process of organizing. The details of this process will be described later, and here, the update unit 263a proceeds with the description when there is no unnecessary information in the match list 201 and no change such as deletion is performed by the update process.

  In step S135, the synchronization information selection unit 263b accesses the match list 201 and determines whether the information recorded in the match list 201 is empty. For example, as shown in FIG. 24, if it is not empty, in step S136, the synchronization information selection unit 263a selects the synchronization information with the highest priority. That is, as described above, in the match list 201, since the highest level information has the highest priority, in the case of the match list 201 as shown in FIG. 24, the synchronization information selection unit 263a performs synchronization of the field number 11. Select information.

  In step S137, the difference calculation unit 263c calculates the difference D in the number of fields between the field number M to be processed by the reflection unit 249 and the field number N selected by the synchronization information selection unit 263b from the match list 201. To do.

  In step S138, the estimation unit 263d, based on the field number M that is the processing target of the reflection unit 249, the field number N that is the processing target of the synchronization information selection unit 263b from the match list 201, and the difference D, The address where the setting information of the field number M in the feature amount setting information storage unit 262 is stored is estimated.

  That is, for example, when the feature amount and setting information in the feature amount setting information storage unit 262 are stored as shown in FIG. 27, the address of the feature amount of the field number N is 0xF5, and the address of the setting information Is X. As described above, when the setting information address interval is S, for example, the setting information address of the field number M is X + S × D. Therefore, the estimation unit 263d estimates the address of the setting information of the field number M as X + S × D.

  In FIG. 27, the information in the range indicated by the dotted line is information stored in the feature amount setting information storage unit 262, and the information surrounded by the alternate long and short dash line is supplied by the feature amount extraction unit 241. It is information to come. Accordingly, the information shown in FIG. 27 is not actually stored in the feature amount setting information storage unit 262, but is illustrated as a combination for convenience of explanation.

  In step S139, the feature amount setting information reading unit 263 accesses the feature amount setting information storage unit 262, and determines whether or not the setting information is stored at the estimated address. That is, the feature amount can be stored in the feature amount setting information storage unit 262 even in the absence of the setting information, and thus the presence / absence of the setting information associated with the feature amount is determined by this process.

  In step S139, for example, when it is determined that the setting information associated with the feature amount is not accumulated, the feature amount setting information reading unit 263 does not supply the setting information to the selection unit 47 in step S140. . As a result of this processing, the selection unit 47 is in a state where no setting information is supplied from either the setting information determination unit 246 or the feature amount setting information reading unit 263. It will not be supplied. As a result, the reflection unit 249 displays the image for one field temporarily stored in the delay unit 48 on the display unit 15 as it is.

  In step S141, it is determined whether or not termination has been instructed. If termination has been instructed, the processing ends. If termination has not been instructed, the processing returns to step S131.

  On the other hand, in step S139, for example, when it is determined that the setting information associated with the feature amount is stored, in step S142, the feature amount setting information reading unit 263 determines from the feature amount setting information storage unit 262 that The setting information existing at the estimated address is read and supplied to the selection unit 47, and the process proceeds to step S143.

  In step S143, the selection unit 47 has no setting information from the setting information determination unit 246 and is supplied with setting information from the feature amount setting information reading unit 263. Therefore, the selection unit 47 includes the feature amount setting information reading unit 263. Is supplied to the reflection unit 249. The reflection unit 249 reflects the process on the image for one field of the field number M stored in the delay unit 48 based on the setting information, and displays the image on the display unit 15.

  With the above match list generation processing and reflection processing, for example, in the situation as shown in FIG. 28, the following processing is realized. In FIG. 28, the timing of the field number of the image supplied to the synchronization detection unit 242 is shown at the top, and the middle shows the timing of the match list generation process. Further, the bottom row shows the timing of the reflection process. Further, the difference between the field number of the image supplied to the synchronization detection unit 242 and the field number at the timing of the reflection process is due to a delay by the delay unit 48.

  Further, the match list generation process in the middle of FIG. 28 is started immediately after the field number 4 image is input at the timing when the field number 4 image is input and the field number 6 image is input. It is shown that Subsequently, it is shown that the match list generation process for the field number 7 is started at the timing when the image for the field number 7 is input, and ends immediately after the image for the field number 10 is input. Further, it is shown that the match list generation process for the field number 11 is started at the timing when the image for the field number 11 is input, and ends immediately after the image for the field number 12 is input. Further, it is shown that the match list generation process for the field number 13 is started at the timing when the image for the field number 13 is input, and ends immediately after the image for the field number 17 is input. Further, it is shown that the match list generation process for the field number 18 is started at the timing when the image for the field number 18 is input, and ends immediately after the image for the field number 20 is input.

  In this state, if the image to be processed by the reflection unit 249 has the field number M = 6 indicated by the star in FIG. 28, only the synchronization position information of the field number 4 is included in the match list 201 at this time. Will be registered. Therefore, in step S136 in the reflection process, information on the field N = 4 is acquired from the match list 201. Therefore, the difference becomes D = 2 (= MN = 6-4) by the process of step S137.

  For example, if the field interval of the setting information address is 8 (hexadecimal), as shown in FIG. 29, the setting information storage addresses for field numbers 4 to 7 are 0x001000, 0x001008, 0x001010, and 0x001018. Therefore, if it can be read from the match list 201 that the setting information of the field number 4 exists at the address 0x001000, the field interval 8 is multiplied by the difference D = 2, and if added, the address of the setting information of the field number 6 is It will be estimated as 0x001010.

  As a result, if it is executed in the above-described playback process, the process for searching the synchronization position information of the field number 4 will not be added to the field images of the field numbers 5 and 6. As described above, the reproduction process is separated into the match list generation process and the reflection process, and executed independently, so that the image such as the field number 4 for which the synchronization position information is required in the match list 201 is of course. As for the field numbers 5 and 6 for which the synchronization position information could not be obtained, it is possible to add processing to the image by estimating from the address of the synchronization position information of the field number being obtained. As a result, it is possible to reproduce an image by accurately processing all fields while estimating the synchronization positions of all fields using only the skipped synchronization position information.

  Next, the update process of the matching list 201 in step S134 will be described.

  As described above, the update of the match list 201 is the synchronization that is unnecessary among the address of the feature amount associated with the field number registered in the match list 201 and the synchronization position information of the address of the setting information. Although the process is to delete and organize the position information, the update that the synchronization position information is deleted from the match list 201 is performed only when one of the two conditions is satisfied.

  The first condition is a case where the synchronization position information registered in the match list 201 belongs to the tail end of the feature amount setting information storage unit 262. This is because, as described with reference to FIG. 27, the subsequent fields recorded in the feature amount setting information storage unit 262 based on the storage address of the setting information of the field number registered in the match list 201. In order to estimate the storage address of the number setting information, at the end, the difference D in the number of fields between the field number M to be processed by the reflection unit 249 and the field number N to be processed by the synchronization information selection unit 263b. This is because it is impossible to estimate the storage address of the setting information of the subsequent field number as much as required.

  The second condition is when the latest synchronization position information is estimated based on the synchronization position information immediately before the latest synchronization position information in the match list 201 and does not match. That is, as shown in the uppermost part of FIG. 28, the synchronization position information of field number 7 is obtained at the timing when the image of field number 10 is input. Here, as shown in FIG. The synchronization position information of the field number 7 estimated from the synchronization position information of the field number 4 that is the synchronization position information is compared with the synchronization position information of the field number 7 that is actually obtained. , Delete the synchronization position information of field number 4. In other words, there is no guarantee that the subsequent estimation can be correctly performed even if the synchronization position information that cannot be estimated accurately is registered in the match list 201.

  As described above, since the synchronization position information selected from the match list 201 is only the latest information, the previous synchronization position information is deleted by updating when new synchronization position information is obtained. However, since the process is not affected, the previous synchronization position information may be deleted each time the latest synchronization position information is registered.

  As described above, according to the present invention, it is possible to reproduce an image by accurately performing predetermined processing every time the image is reproduced without adding processing to the original image data. Further, even when image data that cannot be duplicated is reproduced, it is possible to repeatedly reproduce it by adding the same processing each time it is reproduced. Furthermore, when setting information for processing the image is read in association with the feature amount of the image and the processing to the image is reflected based on the setting information, it is not skipped without being processed in units of images. It is possible to reproduce the image by accurately applying a predetermined process.

  The series of processes described above can be executed by hardware, but can also be executed by software. When a series of processes is executed by software, a program constituting the software may execute various functions by installing a computer incorporated in dedicated hardware or various programs. For example, it is installed from a recording medium in a general-purpose personal computer or the like.

  FIG. 31 shows a configuration of an embodiment of a personal computer when the electrical internal configuration of the image processing apparatus 13 of FIGS. 3 and 16 is realized by software. A CPU 1001 of the personal computer controls the overall operation of the personal computer. Further, when an instruction is input from the input unit 1006 such as a keyboard or a mouse from the user via the bus 1004 and the input / output interface 1005, the CPU 1001 is stored in a ROM (Read Only Memory) 1002 correspondingly. Run the program. Alternatively, the CPU 1001 reads a program read from a removable disk 1021 including a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory connected to the drive 1010 and installed in the storage unit 1008 into a RAM (Random Access Memory). 1003 is loaded and executed. Thereby, the functions of the image processing apparatus 13 shown in FIGS. 3 and 16 are realized by software. Further, the CPU 1001 controls the communication unit 1009 to communicate with the outside and exchange data.

  As shown in FIG. 31, the recording medium on which the program is recorded is distributed to provide the program to the user separately from the computer. The magnetic disk (including the flexible disk) on which the program is recorded and the optical disk are distributed. (Including CD-ROM (Compact Disc-Read Only Memory), DVD (Digital Versatile Disk)), magneto-optical disk (including MD (Mini-Disc)), or removable media 1021 including semiconductor memory And a ROM 1002 on which a program is recorded and a hard disk included in the storage unit 1008 provided to the user in a state of being incorporated in the computer in advance.

  In this specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in time series in the order described, but of course, it is not necessarily performed in time series. Or the process performed separately is included.

It is a figure for demonstrating the concept of the image processing apparatus of this invention. It is a figure for demonstrating the concept of the image processing apparatus of this invention. It is a block diagram which shows the structure of one Embodiment of the image processing apparatus to which this invention is applied. It is a block diagram which shows the structural example of the feature-value extraction part of FIG. It is a figure explaining the structural example of an image signal. It is a block diagram which shows the structural example of the synchronous detection part of FIG. 4 is a flowchart for explaining recording processing by the image processing apparatus in FIG. 3. It is a flowchart explaining the feature-value extraction process of FIG. It is a figure explaining the feature-value extraction process of FIG. FIG. 4 is a flowchart for explaining reproduction processing by the image processing apparatus of FIG. 3. It is a flowchart explaining the synchronous detection process of FIG. It is a figure explaining the synchronous detection process of FIG. It is a figure explaining the operation | movement implement | achieved by the image processing by the image processing apparatus of FIG. It is a figure explaining the example of the operation | movement by which reproduction | regeneration processing is correctly implement | achieved for every field by reproduction | regeneration processing. It is a figure explaining the example of the operation | movement which cannot implement | achieve reproduction | regeneration processing correctly for every field by reproduction | regeneration processing. It is a figure explaining the other structural example of the image processing apparatus to which this invention is applied. It is a figure explaining the structural example of the synchronous detection part of FIG. It is a figure explaining the structural example of the additional information control part for sharing the field number of FIG. It is a figure explaining the other structural example of the additional information control part for sharing the field number of FIG. It is a figure explaining the additional information for sharing the field number of FIG. FIG. 17 is a flowchart for describing recording processing by the image processing apparatus of FIG. 16. FIG. It is a figure explaining the recording process by the image processing apparatus of FIG. It is a flowchart explaining the matching list production | generation process by the image processing apparatus of FIG. It is a figure explaining a matching list. It is a figure explaining the matching list production | generation process by the image processing apparatus of FIG. It is a flowchart explaining the reflection process by the image processing apparatus of FIG. It is a figure explaining the reflection process by the image processing apparatus of FIG. It is a figure explaining the reflection process by the image processing apparatus of FIG. It is a figure explaining the reflection process by the image processing apparatus of FIG. It is a figure explaining the reflection process by the image processing apparatus of FIG. It is a figure explaining a medium.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 11 Recording media, 12 Image reproduction part, 13 Image processing apparatus, 14 Remote controller, 15 Display part, 41 Feature-value extraction part, 42 Synchronization detection part, 43 Storage block, 44 Light-receiving part, 45 Operation information recognition part, 46 Setting information Determination unit, 47 selection unit, 48 delay unit, 49 reflection unit, 61 feature quantity setting information recording unit, 62 feature quantity setting information storage unit, 63 feature quantity setting information reading unit, 241 feature quantity extraction unit, 242 synchronization detection unit, 243 storage block, 246 setting information determination unit, 47 selection unit, 48 delay unit, 249 reflection unit, 261 feature amount setting information recording unit, 262 feature amount setting information storage unit, 263 feature amount setting information reading unit

Claims (9)

Reproduction position feature amount extraction means for extracting the reproduction position feature amount from the reproduction position image as a reproduction position feature amount;
The feature quantity is sequentially used as a search position feature quantity from a data recording medium in which setting information for performing processing on the image is recorded in association with the image feature quantity together with the image identification number. Search position feature amount extraction means for extracting;
Comparison means for sequentially comparing the reproduction position feature quantity and the search position feature quantity;
A match list registration means for registering, in the match list, an identification number of the image and an address of setting information recorded in association with the reproduction position feature amount when the comparison results match;
Difference image calculation means for calculating the number of difference images from the difference between the identification number of the image at the processing position to be processed and the identification number of the image registered in the match list;
The processing position recorded in the data recording medium by the address of the setting information recorded in association with the identification number of the image registered in the match list, the number of difference images, and the reproduction position feature quantity Estimating means for estimating the address of the setting information of the image,
Reading means for reading setting information from the address of the setting information estimated by the estimating means from the data recording medium;
Reflecting means for reflecting the process to the image at the reproduction position based on the setting information read by the reading means. The image processing apparatus according to claim 1, wherein the feature amount extraction unit extracts, as a feature amount, an added value of pixel values of pixels in a predetermined region constituting the image. When the comparison result matches, the match list registration unit records the identification number of the image, the address where the feature value of the reproduction position feature value is recorded, and the reproduction position feature value in association with each other. Register the address where the setting information is recorded in the match list,
The estimation means estimates an address at which setting information of an image at the processing position of the data recording medium is recorded by adding the number of difference images to an identification number of an image registered in the match list. Item 8. The image processing apparatus according to Item 1. The image processing apparatus according to claim 1, wherein the image identification number includes a frame number or a field number. A reproduction position feature amount extracting step of extracting a reproduction position feature amount from the reproduction position image as a reproduction position feature amount;
The feature quantity is sequentially used as a search position feature quantity from a data recording medium in which setting information for performing processing on the image is recorded in association with the image feature quantity together with the image identification number. A search position feature extraction step to extract;
A comparison step of sequentially comparing the reproduction position feature quantity and the search position feature quantity;
When the comparison results match, a match list registration step of registering in the match list the identification number of the image and the address of the setting information recorded in association with the reproduction position feature amount;
A difference image calculation step of calculating the number of difference images from the difference between the identification number of the image at the processing position to be processed and the identification number of the image registered in the match list;
The processing position recorded in the data recording medium by the address of the setting information recorded in association with the identification number of the image registered in the match list, the number of difference images, and the reproduction position feature quantity An estimation step for estimating the address of the setting information of the image,
A reading step of reading setting information from the address of the setting information estimated by the processing of the estimating step from the data recording medium;
And a reflecting step of reflecting the processing to the image at the reproduction position based on the setting information read by the reading step. A reproduction position feature amount extracting step of extracting a reproduction position feature amount from the reproduction position image as a reproduction position feature amount;
The feature quantity is sequentially used as a search position feature quantity from a data recording medium in which setting information for performing processing on the image is recorded in association with the image feature quantity together with the image identification number. A search position feature extraction step to extract;
A comparison step of sequentially comparing the reproduction position feature quantity and the search position feature quantity;
When the comparison results match, a match list registration step of registering in the match list the identification number of the image and the address of the setting information recorded in association with the reproduction position feature amount;
A difference image calculation step of calculating the number of difference images from the difference between the identification number of the image at the processing position to be processed and the identification number of the image registered in the match list;
The processing position recorded in the data recording medium by the address of the setting information recorded in association with the identification number of the image registered in the match list, the number of difference images, and the reproduction position feature quantity An estimation step for estimating the address of the setting information of the image,
A reading step of reading setting information from the address of the setting information estimated by the processing of the estimating step from the data recording medium;
A program recording medium on which a computer-readable program is recorded, including: a reflecting step of reflecting a process to the image at the reproduction position based on the setting information read by the reading step. A reproduction position feature amount extracting step of extracting a reproduction position feature amount from the reproduction position image as a reproduction position feature amount;
The feature quantity is sequentially used as a search position feature quantity from a data recording medium in which setting information for performing processing on the image is recorded in association with the image feature quantity together with the image identification number. A search position feature extraction step to extract;
A comparison step of sequentially comparing the reproduction position feature quantity and the search position feature quantity;
When the comparison results match, a match list registration step of registering in the match list the identification number of the image and the address of the setting information recorded in association with the reproduction position feature amount;
A difference image calculation step of calculating the number of difference images from the difference between the identification number of the image at the processing position to be processed and the identification number of the image registered in the match list;
The processing position recorded in the data recording medium by the address of the setting information recorded in association with the identification number of the image registered in the match list, the number of difference images, and the reproduction position feature quantity An estimation step for estimating the address of the setting information of the image,
A reading step of reading setting information from the address of the setting information estimated by the processing of the estimating step from the data recording medium;
A program that causes a computer to execute a process including a reflecting step of reflecting the process to the image at the reproduction position based on the setting information read by the reading step. Reproduction position feature amount extraction means for extracting the reproduction position feature amount from the reproduction position image as a reproduction position feature amount;
The feature quantity is sequentially used as a search position feature quantity from a data recording medium in which setting information for performing processing on the image is recorded in association with the image feature quantity together with the image identification number. Search position feature amount extraction means for extracting;
Comparison means for sequentially comparing the reproduction position feature quantity and the search position feature quantity;
A match list registration means for registering, in the match list, an identification number of the image and an address of setting information recorded in association with the reproduction position feature amount when the comparison results match;
A correspondence acquisition means for acquiring a correspondence between an identification number of an image at a processing position to be processed and an identification number of an image registered in the match list;
Based on the identification number of the image registered in the match list, the correspondence relationship, and the address of the setting information recorded in association with the reproduction position feature amount, the processing position recorded on the data recording medium An estimation means for estimating an address of image setting information;
Reading means for reading setting information from the address of the setting information estimated by the estimating means from the data recording medium;
Reflecting means for reflecting the process to the image at the reproduction position based on the setting information read by the reading means. A reproduction position feature amount extracting step of extracting a reproduction position feature amount from the reproduction position image as a reproduction position feature amount;
The feature quantity is sequentially used as a search position feature quantity from a data recording medium in which setting information for performing processing on the image is recorded in association with the image feature quantity together with the image identification number. A search position feature extraction step to extract;
A comparison step of sequentially comparing the reproduction position feature quantity and the search position feature quantity;
When the comparison results match, a match list registration step of registering in the match list the identification number of the image and the address of the setting information recorded in association with the reproduction position feature amount;
A correspondence acquisition step of acquiring a correspondence between the identification number of the image at the processing position to be processed and the identification number of the image registered in the match list;
Based on the identification number of the image registered in the match list, the correspondence relationship, and the address of the setting information recorded in association with the reproduction position feature amount, the processing position recorded on the data recording medium An estimation step for estimating an address of image setting information;
A reading step of reading setting information from the address of the setting information estimated by the estimating means from the data recording medium;
And a reflecting step of reflecting the processing to the image at the reproduction position based on the setting information read by the processing of the reading step.

Images