JP2013037286A - Video processing device, video processing method, and computer program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To accurately compose spatially divided videos from a video transmission device even if using a general-purpose video transmission device.SOLUTION: The video processing device detects a presence/absence of a change in a scene in each of a plurality of spatially-divided video input signals. After a change in a scene has been detected in the video input signal, when changes in all the video input signals are detected before the presence/absence of changes in the scenes are detected a predetermined number of times, the video processing device synchronously outputs frames immediately after the detection of the changes in the scenes.

Description

  The present invention relates to a video processing apparatus, a video processing method, and a computer program, and is particularly suitable for use in synthesizing space-divided video signals.

  In recent years, the resolution of display panels represented by LCD and PDP has been increased, and a high-resolution display panel having a resolution of 4k2k (3840x2160) exceeding the currently popular FHD (1920x1080) has been commercialized. Yes. Input of video signals to such a high-resolution display panel is realized by using a plurality of video input interfaces capable of transmitting FHD video signals. Typical examples of such video input interfaces include HD-SDI (High Definition Serial Digital Interface) and DVI (Digital Visual Interface). Each video input interface is responsible for video transmission of one area of the space-divided video area. As described above, when a high-resolution video is transmitted using a plurality of video input interfaces, the delay time may be different for each video input interface. As described above, a technique is disclosed in which even when a video signal is transmitted to a high-resolution display panel, even if the delay time of the transmission path is different, the spatially divided video is correctly synthesized and output. According to Patent Document 1, a technique is disclosed in which a frame number is assigned to an input video, and a video having the same frame number is synthesized at the time of synthesis and output to a display panel.

JP 2003-299046 A

However, when a video is synthesized based on a frame number assigned to a space-divided video, a function for putting the frame number on the transmission side is essential. Therefore, when a video transmission device that does not have a function of inserting a frame number is used, if the delay time of each video input interface is large, the spatially divided frame is different from the frame to be combined with the frame (spatial division). May be combined with the frame. Then, the output video is disturbed.
The present invention has been made in view of such problems, and an object of the present invention is to make it possible to correctly synthesize a space-divided video from a video transmission device even if a general-purpose video transmission device is used. To do.

  The video processing apparatus according to the present invention includes a plurality of video signal input means for receiving a video signal spatially divided into a plurality of areas, and two consecutive frames among the frames constituting the video signal spatially divided into the plurality of areas. Based on the result of comparing two frames, a detecting means for detecting a change in the scene in the video signal, and a plurality of images output in synchronization as videos of the plurality of regions based on the detection result by the detecting means Selection means for selecting a frame; storage means for storing each frame of the video signal spatially divided into the plurality of regions; reading means for reading a plurality of frames selected by the selection means from the storage means; Video output means for outputting a plurality of frames read by the reading means, and the selection means detects a change in the scene by the detection means. Is detected in each of the frames constituting the video signal space-divided into the plurality of regions, each frame constituting the video signal space-divided into the plurality of regions, The frame immediately after the change is detected is selected as a frame to be output in synchronization.

  According to the present invention, when a scene change is detected in each of the frames constituting the video signal spatially divided into a plurality of regions, the frame immediately after the scene change is detected is detected. Are selected as frames to be output in synchronization. Therefore, even if a general-purpose video transmission device is used, the space-divided video from the video transmission device can be correctly synthesized.

It is a figure which shows the structure of a video processing apparatus. It is a figure which shows the input / output timing of a video signal. It is a figure which shows the image | video based on a video signal. It is a flowchart explaining the process sequence of a video synchronous determination part. It is a figure which shows the statistics of a video signal.

An embodiment of the present invention will be described below with reference to the drawings.
FIG. 1 is a diagram illustrating an example of the configuration of the video processing apparatus 100.
The video processing apparatus 100 includes a first and second video signal input units 101 and 102, first and second scene change detection units 103 and 104, a data storage unit 105, and first and second synchronized video. The reading units 106 and 107, the first and second video signal output units 108 and 109, and the video synchronization determination unit 110 are configured. In addition, the video processing apparatus 100 is connected to the video display unit 120 via the first and second video signal output units 108 and 109. The video display unit 120 displays the video output from the video processing device 100.

  The first and second video signal input units 101 and 102 are video input interfaces, and input video signals from the outside. The first and second video signal input units 101 and 102 are configured by an interface of a digital video signal standard such as HDMI or DVI, for example, and input various video contents. In this embodiment, it is assumed that two space-divided video signals are input to the first and second video signal input units 101 and 102, respectively.

  The first and second scene change detection units 103 and 104 detect the presence or absence of a scene change in the video signals input from the first and second video signal input units 101 and 102. In the present embodiment, the first and second scene change detection units 103 and 104 calculate the statistics of the video signals input from the first and second video signal input units 101 and 102, respectively. The first and second scene change detection units 103 and 104 detect that there is a scene change when the difference between the statistics of two consecutive frames is equal to or greater than a threshold value. However, the method for detecting a scene change is not limited to such a method. For example, it may be as follows. First, motion vectors of two consecutive frames are detected. Then, based on the detection result of the motion vector, a correlation between two consecutive frames (for example, a correlation value that is an index indicating the degree of correlation) is calculated, and based on a result of comparing the calculated correlation with a threshold value. Detect the presence or absence of scene changes.

The data storage unit 105 stores the video signals input from the first and second video signal input units 101 and 102. The data storage unit 105 is a frame memory composed of a memory such as an SDRAM, for example.
The first and second synchronized video reading units 106 and 107 read from the data storage unit 105 the video signal of the frame specified by the video synchronization determination unit 110 described later. The first and second synchronized video reading units 106 and 107 output the read video signals to the first and second video signal output units 108 and 109, respectively. The first and second synchronous video reading units 106 and 107 are, for example, DMA controllers that read data at addresses specified by the video synchronization determination unit 110.

Based on the detection result of the presence or absence of a scene change in the first and second scene change detection units 103 and 104, the video synchronization determination unit 110 Specify the frame to be read.
The first and second video signal output units 108 and 109 are interfaces that output the video signals read by the first and second synchronous video reading units 106 and 107 to the display panel, respectively. The first and second video signal output units 108 and 109 are standard image interfaces to a display panel represented by, for example, LVDS (Low Voltage Differential Signaling).
The video display unit 120 displays the video by outputting the space-divided video signal to each display area. The video display unit 120 is a display panel represented by, for example, an LCD (Liquid Crystal Display) or a PDP (Plasma Display Panel).

  FIG. 2 is a diagram illustrating an example of input / output timings of a video signal input to the video processing apparatus 100 and a video signal output from the video processing apparatus 100. Specifically, FIG. 2A is a diagram showing an example of input / output timing of each video signal when correctly synthesized, and FIG. 2B is a diagram of each video signal when incorrectly synthesized. It is a figure which shows an example of the timing of input / output. FIG. 3 is a diagram illustrating an example of a video based on a video signal input / output by the video processing apparatus 100. Specifically, FIG. 3A is a diagram illustrating an example of the video signals of the first to third frames input to the video processing apparatus 100, and FIG. It is a figure which shows an example of the video signal of the 1st flame | frame-3rd frame output.

  In this embodiment, a video signal that is spatially divided into two areas is input to the video processing apparatus 100. However, the number of regions to be spatially divided is not limited, and a video signal that is spatially divided into three or more regions may be input to the video processing device 100. In this case, each processing unit (video signal input unit, scene change detection unit, synchronized video reading unit, and video signal output unit) is provided in the video processing apparatus 100 as many as the number of regions to be spatially divided. Is preferred. However, this is not always necessary. For example, when the number of regions to be spatially divided exceeds the number of processing units, the processing unit may process the video signal of each region by performing processing in time division.

In the example shown in FIG. 2, the video signals of the video divided into two areas are shown as a first video input signal and a second video input signal, respectively. Further, in the example shown in FIG. 2, it is shown that video signals for three frames are received by the video processing device 100 as the first and second video input signals.
In FIG. 2, 211, 212, and 213 are the first, second, and third frames of the first video input signal, respectively. 221, 222, and 223 are the first, second, and third frames of the second video input signal, respectively. Reference numerals 215 and 225 denote vertical synchronizing signals for the first and second video input signals, respectively.
On the other hand, 231, 232 and 233 are the first, second and third frames of the first video output signal, respectively. Reference numerals 241, 242, and 243 denote the first, second, and third frames of the second video output signal, respectively. Reference numerals 235 and 245 denote vertical synchronizing signals for the first and second video output signals, respectively.

  In FIG. 3A, reference numerals 300, 310, and 320 denote images showing the contents of the first, second, and third frames, respectively. Of the two areas that are spatially divided at the center of the video, the video signal in the left area as viewed in the figure is input to the first video signal input unit 101 as the first video input signal, and the video in the right area The signal is input to the second video signal input unit 102 as the second video input signal. In addition, a scene change occurs between the second frame and the third frame shown in FIG.

  In addition, as shown in FIG. 2, the first video input signal and the second video input signal have a video signal input skew (skew) T period due to the influence of an external video signal transmission path or the like. Input to the device 100. The video signal input skew T corresponds to the time difference between the timings at which the first and second video signal input units 101 and 102 input the first and second video input signals.

It is assumed that this video input skew T does not exceed half of the period of one frame of vertical synchronization signal. In this case, when a frame with a similar vertical synchronization signal is output in synchronization, as shown in FIG. 2A, the same frame as the frame that is spatially divided at the time of input is output in synchronization. For this reason, like the image 300 shown in FIG. 3A, the images in the respective areas are correctly combined and displayed without being disturbed.
On the other hand, it is assumed that the video signal input skew T exceeds half of the period of one frame of the vertical synchronization signal. In this case, as shown in FIG. 2B, the vertical synchronization signal of the first frame 221 of the second video input signal and the second frame 212 of the first video input signal approach each other. In such a case, if a plurality of frames having similar vertical synchronization signals are output in synchronization, a frame different from the frame that is spatially divided at the time of input is output in synchronization. For this reason, as in the image 350 shown in FIG. 3B, the images of the respective regions may be erroneously combined and the image may be displayed distorted (the frame 232 within the broken line in FIG. 2B). 241).

  In the present embodiment, the video processing apparatus 100 detects whether there is a scene change in each of the spatially divided frames. When the video processing apparatus 100 detects a scene change in each of the spatially divided frames, the frame immediately after the scene change (the first frame of the changed scene) is determined for each of the spatially divided frames. select. Then, the video processing apparatus 100 causes the video display unit 120 to output the video of the selected frame in synchronization. For this reason, even in the above-described case, it is possible to read frames that are spatially divided from the frames of the same video input signal as the video 320 shown in FIG. 3A and display them synchronously. An example of the processing procedure for doing this will be described in detail below.

  FIG. 4 is a flowchart for explaining an example of the processing procedure of the video synchronization determination unit 110. FIG. 5 is a diagram illustrating an example of the statistics of the video signal. Specifically, FIG. 5A is a diagram illustrating an example of the statistics of the video 300 of the first frame and the video input signal of the first frame. FIG. 5B is a diagram illustrating an example of the statistics of the video 310 of the second frame and the video input signal of the second frame. FIG. 5C is a diagram illustrating an example of the statistics of the video 320 of the third frame and the video input signal of the third frame.

  In the present embodiment, the video input signal of each area obtained by space division is further divided into a plurality of areas. And the average value of the brightness | luminance of the divided | segmented several area | region is quantized to the value of 0-9. In the present embodiment, a case where a value obtained by quantizing an average luminance value of a plurality of divided areas into a value of 0 to 9 is a statistic of a video signal will be described as an example. In the following description, “a value obtained by quantizing an average luminance value for each of a plurality of divided areas into a value of 0 to 9” will be referred to as a “statistic” as necessary. In this embodiment, the absolute value of the difference between frames of this statistic is taken, and the presence or absence of a scene change is detected based on the sum of the absolute values of the differences. However, the method for detecting the presence or absence of a scene change is not limited to such a method. As long as the method detects a scene change and specifies a frame to be displayed synchronously based on the detection result, the presence or absence of a scene change may be detected by any method.

An example of a method for synchronously displaying the images (frames) of two spatially divided areas using the flowchart of FIG. 4 and the statistics of the video signal of FIG. 5 will be described.
In step S401 of FIG. 4, the video synchronization determination unit 110 confirms whether or not a scene change has been detected based on the detection results of the first and second scene change detection units 103 and 104. The first and second scene change detection units 103 and 104 detect whether or not a scene change has occurred in the video signals input from the first and second video signal input units 101 and 102, respectively. At time t1 shown in FIG. 2A, the first video signal input unit 101 receives the first frame 211 and the second frame 212 of the first video input signal. An example of the scene change detection process of the first and second scene change detection units 103 and 104 at time t1 will be described in detail with reference to FIG.

  The first scene change detection unit 103 calculates a statistic 511 of the “first frame 211 of the first video input signal” input from the first video signal input unit 101. Similarly, the first scene change detection unit 103 calculates a statistic 512 of the second frame 212 of the first video input signal. There is a correlation between the statistics of “two consecutive frames” of the video input signal. Therefore, the first scene change detection unit 103 calculates the sum of the absolute values of the differences between these statistics 511 and 512. The difference between the statistics 511 and 512 is the difference between the statistics in the pixels corresponding to each other in the frame.

  Then, if the sum of the absolute values of the differences between the statistics 511 and 512 is less than the threshold, the first scene change detection unit 103 determines that no scene change has occurred because there is a correlation between frames. . On the other hand, if the sum of the absolute values of the differences between the statistics 511 and 512 is equal to or greater than the threshold, the first scene change detection unit 103 determines that a scene change has occurred because there is no correlation between frames. . In the present embodiment, this threshold is set to 100. That is, the first and second scene change detection units 103 and 104 detect the occurrence of a scene change if the sum of the differences in statistics is 100 or more. The sum of the absolute values of the differences between the statistics 511 and 512 shown in FIGS. 5A and 5B is 35. Therefore, the first scene change detection unit 103 does not detect a scene change. In addition, at time t1 shown in FIG. 2A, the video input signal for two frames is not input from the second video signal input unit 101. For this reason, a scene change is not detected by the second scene change detection unit 104.

Next, in step S402, the video synchronization determination unit 110 determines whether there is a scene change in one of the two spatially divided video input signals based on the confirmation result in step S401. At time t1 shown in FIG. 2A, no scene change has occurred. Therefore, the process proceeds to step S401.
Next, in step S401, the video synchronization determination unit 110 confirms again whether or not a scene change has been detected based on the detection results of the first and second scene change detection units 103 and 104.

  At time t <b> 2 in FIG. 2A, the first scene change detection unit 103 receives the third frame 213 of the first video input signal from the first video signal input unit 101. Therefore, the first scene change detection unit 103 calculates the difference between the statistics 512 of the second frame 212 of the first video input signal and the statistics 513 of the third frame 213 of the first video input signal. Calculate the sum of absolute values. The sum of absolute values of differences between the statistics 512 of the second frame 212 of the first video input signal and the statistics 513 of the third frame 213 of the first video input signal is 157, which is a threshold value. A value of 100 or more. Therefore, the first scene change detection unit 103 detects a scene change. The video synchronization determination unit 110 acquires the frame number where the scene change has occurred from the first scene change detection unit 103. Here, the video synchronization determination unit 110 acquires the frame number of the third frame 213 of the first video input signal.

  At time t2 in FIG. 2A, the second scene change detection unit 103 receives the first frame 221 and the second frame of the second video input signal from the second video signal input unit 102. 222 is entered. Therefore, the second scene change detection unit 104 calculates the difference between the statistic 521 of the first frame 221 of the second video input signal and the statistic 522 of the second frame 222 of the second video input signal. Calculate the sum of absolute values. The sum of absolute values of differences between the statistics 521 of the first frame 221 of the second video input signal and the statistics 522 of the second frame 222 of the second video input signal is 23, which is a threshold value. The value is less than 100. Therefore, the second scene change detection unit 104 does not detect a scene change.

Next, in step S402, the video synchronization determination unit 110 determines again whether there is a scene change in one of the two spatially divided video input signals based on the confirmation result in step S401. . At time t2 shown in FIG. 2A, the first scene change detection unit 103 detects a scene change. That is, the scene changes between the second frame 232 and the third frame 233 of the first video output signal, as in the videos 350 and 360 shown in FIG. For this reason, the process proceeds to step S403.
Next, in step S403, the video synchronization determination unit 110 performs the following processing based on the detection results by the first and second scene change detection units 103 and 104. That is, the video synchronization determination unit 110 confirms whether or not a scene change has been detected by a scene change detection unit other than the scene change detection unit that has detected a scene change. At time t2 shown in FIG. 2A, no scene change is detected by the second scene change detection unit 104.

Next, in step S404, the video synchronization determination unit 110 determines whether or not a scene change has been detected by a scene change detection unit other than the scene change detection unit that has detected a scene change based on the confirmation result in step S403. Judging. At time t2 shown in FIG. 2A, no scene change is detected by the second scene change detection unit 104. For this reason, the process proceeds to step S407.
In step S407, the video synchronization determination unit 110 detects the presence or absence of a scene change in another video input signal after a scene change is detected in any video input signal. It is determined whether or not only the number of frames has been performed.
Here, in this embodiment, the predetermined number of frames is three. However, the predetermined number of frames is not limited to 3, and may be 1 or more. The predetermined number of frames can be determined according to the capacity of the buffer memory included in the video processing apparatus 100, for example. In addition, the number of frames that can be regarded as a false detection of a scene change in any video input signal can be set to a predetermined number of frames. If no scene change is detected by any scene change detection unit other than the scene change detection unit that has detected the scene change in step S404, the process proceeds to step S403 without performing step S407. May be. That is, the process of step S407 in the flowchart of FIG. 4 is not necessarily performed.

If a scene change is detected in any one of the video input signals and then the presence or absence of a scene change in another video input signal is detected a predetermined number of times (a predetermined number of frames), the process proceeds to step S401. move on. And the process after step S401 is performed again.
On the other hand, when a scene change is detected in one of the video input signals and the detection of the presence or absence of a scene change in another video input signal is not performed a predetermined number of times (a predetermined number of frames), The process proceeds to step S403. In this case, since there is a possibility that a scene change has occurred in the video input signal before the space division, the detection of a scene change in another video input signal is awaited again without performing synchronization processing. At time t2 shown in FIG. 2 (a), after the scene change of the first video input signal, the presence / absence of the scene change of the second video input signal is not detected once. Therefore, the process proceeds to step S403.

  In step S403, the video synchronization determination unit 110 confirms whether or not a scene change has been detected by the second scene change detection unit 104 based on the detection result by the second scene change detection unit 104. At time t <b> 3 shown in FIG. 2A, the second scene change detection unit 103 receives the third frame 223 of the second video input signal from the second video signal input unit 102. Therefore, the second scene change detection unit 104 calculates the absolute difference between the statistic 522 of the second frame 212 of the second video input signal and the statistic 523 of the third frame 223 of the second video input signal. Calculate the sum of values. The sum of the absolute values of the difference between the statistic 522 of the second frame 212 of the second video input signal and the statistic 523 of the third frame 223 of the second video input signal is 154, which is a threshold value 100. It is the value of the above magnitude | size. Therefore, the second scene change detection unit 104 detects a scene change. The video synchronization determination unit 110 acquires the frame number where the scene change has occurred from the second scene change detection unit 104. Here, the video synchronization determination unit 110 acquires the frame number of the third frame 223 of the second video input signal.

In step S404, the video synchronization determination unit 110 determines whether or not a scene change has been detected by a scene change detection unit other than the scene change detection unit that has detected a scene change based on the confirmation result in step S403. Judge again. At time t3 shown in FIG. 2A, a scene change is detected by the second scene change detection unit 104. That is, the scene changes between the second frame 242 and the third frame 243 of the second video output signal as in the videos 360 and 370 shown in FIG. Therefore, the process proceeds to step S405.
In step S405, the video synchronization determination unit 110 selects the frame number of the frame immediately after the scene change. As described above, in the example illustrated in FIG. 2A, the frames immediately after the first and second scene change detection units 103 and 104 detect the scene change are the third frames 213 and 223. . Therefore, the video synchronization determination unit 110 selects the frame numbers of these third frames 213 and 223.

Next, in step S406, the video synchronization determination unit 110 notifies the first and second synchronized video reading units 106 and 107 of the frame number selected in step S405. Here, the video synchronization determination unit 110 notifies the first synchronized video reading unit 106 of the frame number of the third frame 213 of the first video signal, thereby the third of the first video signal. That the frame 213 is read out. Further, the video synchronization determination unit 110 notifies the second synchronized video reading unit 107 of the frame number of the third frame 223 of the second video signal, so that the third of the second video signal Notification of reading frame 223. The first and second synchronized video signal reading units 106 and 107 read the third frame 213 of the first video input signal and the third frame 223 of the second video input signal from the data storage unit 105, respectively.
The video input signals read by the first and second synchronized video signal reading units 106 and 107 are output to the video display unit 120 via the first and second video signal output units 108 and 109, respectively. That is, at time t4 shown in FIG. 2A, the third frame 233 of the first video output signal and the third frame 243 of the second video output signal are output. As a result, the video display unit 120 displays a video 370 shown in FIG. In this way, it is possible to correctly synthesize a video output signal in response to a scene change in the video input signal before space division.
Next, the process proceeds to step S401 again, and the video synchronization determination unit 110 confirms whether or not a scene change is detected.

  As described above, in the present embodiment, the presence or absence of a scene change is detected in each of a plurality of space-divided video input signals. After it is detected that there is a scene change in the video input signal, and it is detected that there is a scene change in all the video input signals before the presence or absence of the scene change is detected a predetermined number of times, The frame immediately after the scene change is detected is output in synchronization. Therefore, it is possible to correctly synthesize and output the image input signals that have been divided into spaces. This makes it possible to correctly synthesize video input signals even for video input signals transmitted by video transmission devices that do not have a special function such as assigning frame numbers to spatially divided video input signals. Become. Therefore, even if a general-purpose video transmission device is used, a high-resolution video can be provided by correctly synthesizing the video input signals that are spatially divided from the video transmission device.

  If the video signal input skew T is stable, the scene change need not be detected every frame when the frame to be synthesized is specified. For example, the first and second synchronized video reading units 106 and 107 record the frame number of the synthesis target frame specified by the video synchronization determination unit 110. Then, the first and second synchronized video reading units 106 and 107 read the frame having the frame number, and then increment the recorded frame number. Then, the first and second synchronized video reading sections 106 and 107 repeatedly read out the frame with the incremented frame number and increment the recorded frame number. In this way, it is possible to reduce the number of times of detecting the scene change and specifying the synthesis target frame to one.

  The above-described embodiments are merely examples of implementation in carrying out the present invention, and the technical scope of the present invention should not be construed in a limited manner. That is, the present invention can be implemented in various forms without departing from the technical idea or the main features thereof.

(Other examples)
The present invention is also realized by executing the following processing. That is, first, software (computer program) for realizing the functions of the above embodiments is supplied to a system or apparatus via a network or various storage media. Then, the computer (or CPU, MPU, etc.) of the system or apparatus reads and executes the computer program.

  100 video processing device, 103, 104 scene change detection unit, 110 video synchronization determination unit

Claims (7)

A plurality of video signal input means for receiving video signals spatially divided into a plurality of areas;
Detecting means for detecting a scene change in the video signal based on a result of comparing two consecutive frames among the frames constituting the video signal spatially divided into the plurality of regions;
Selection means for selecting a plurality of frames to be output in synchronization as videos of the plurality of areas based on a result of detection by the detection means;
Storage means for storing each frame of the video signal spatially divided into the plurality of regions;
Reading means for reading out a plurality of frames selected by the selection means from the storage means;
Video output means for outputting a plurality of frames read by the reading means,
When the detecting means detects that there is a scene change in each of the frames constituting the video signal spatially divided into the plurality of areas, the selection means detects the video signal spatially divided into the plurality of areas. A video processing apparatus that selects a frame immediately after it is detected that there is a change in the scene as a frame to be output synchronously.   The said detection means detects the change of the scene in the said video signal based on the correlation of the said 2 continuous frames, or the difference of the statistics of the said 2 continuous frames. Video processing equipment.   The selection means detects the presence or absence of a scene change by the detection means after the detection means detects that there is a scene change in any one of the video signals spatially divided into the plurality of regions. Before the predetermined number of times is performed, if the detection unit detects that there is a scene change in each of the frames constituting the video signal spatially divided into the plurality of regions, 2. Each frame constituting a space-divided video signal immediately after a change in the scene is detected is selected as a frame to be output in synchronization. 2. The video processing apparatus according to 2. A plurality of video signal input steps for receiving video signals spatially divided into a plurality of areas;
A detection step of detecting a scene change in the video signal based on a result of comparing two consecutive frames among the frames constituting the video signal spatially divided into the plurality of regions;
A selection step of selecting a plurality of frames that are output in synchronization as videos of the plurality of regions based on the detection result of the detection step;
An accumulation step of accumulating each frame of the video signal spatially divided into the plurality of regions in an accumulation unit;
A reading step of reading a plurality of frames selected by the selection step from the storage means;
A video output step of outputting a plurality of frames read by the read step,
In the selecting step, when the detection step detects that there is a scene change in each of the frames constituting the video signal spatially divided into the plurality of regions, the video signal spatially divided into the plurality of regions. And a frame immediately after it is detected that there is a change in the scene is selected as a frame to be output in synchronization.   5. The detection step according to claim 4, wherein a scene change in the video signal is detected based on a correlation between the two consecutive frames or a difference in statistics between the two consecutive frames. Video processing method.   In the selection step, in any one of the video signals divided into the plurality of areas, after the detection step detects that there is a scene change, the detection step detects whether there is a scene change. Before a predetermined number of times, if it is detected by the detection step that there is a scene change in each of the frames constituting the video signal spatially divided into the plurality of regions, 5. Each frame constituting a space-divided video signal, the frame immediately after detecting that there is a change in the scene, is selected as a frame to be output in synchronization. 5. The video processing method according to 5. A plurality of video signal input steps for receiving video signals spatially divided into a plurality of areas;
A detection step of detecting a scene change in the video signal based on a result of comparing two consecutive frames among the frames constituting the video signal spatially divided into the plurality of regions;
A selection step of selecting a plurality of frames that are output in synchronization as videos of the plurality of regions based on the detection result of the detection step;
An accumulation step of accumulating each frame of the video signal spatially divided into the plurality of regions in an accumulation unit;
A reading step of reading a plurality of frames selected by the selection step from the storage means;
Causing the computer to execute a video output step of outputting a plurality of frames read by the reading step;
In the selecting step, when the detection step detects that there is a scene change in each of the frames constituting the video signal spatially divided into the plurality of regions, the video signal spatially divided into the plurality of regions. A computer program that selects a frame immediately after it is detected that there is a change in the scene as a frame to be output in synchronization.

Images