JP3144285B2 - Video processing equipment - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a video processing for inputting a video including audio from a terrestrial broadcast, a satellite broadcast, a cable television, a video tape or the like and providing a video reproduction method suitable for a user at the time of reproduction. Related to the device.

[0002]

2. Description of the Related Art Conventionally, as a known broadcast receiving / recording / reproducing apparatus, there is JP-A-6-105280. Broadcast video is directly compressed in real time without VTR
The recorded video is recorded on the disk device, and after the compressed video is decompressed, a scene change of the video is detected to generate a thinned-out video, which is similarly stored in the disk device. The user can select a scene desired to be viewed in a short time from the culled video and reproduce the video from the middle of the program. This solves the problem that it has conventionally taken a lot of time to search for a program when making a scheduled recording with a home VTR.

[0003]

SUMMARY OF THE INVENTION First, Japanese Patent Application Laid-Open No. Hei 6-10
The configuration disclosed in Japanese Patent No. 5280 discloses a case in which video compression and reproduction are performed by a single system. A video to be viewed from a thinned image is searched, and it is assumed that a video recorded in any part can be reproduced immediately from a disk device. It is assumed. However, in reality, a server that stores compressed video and a client that plays video are connected to a computer network, and when the normal video playback is difficult due to the speed limit of the network, or when the computing function used by the client is limited It is sometimes difficult to reproduce the video. In this case, there is a problem that another means for reproducing the video is required after selecting the video to be viewed from the thinned image, that is, the index image. Also, in recent years, video has been provided to the Internet on a global scale by means such as a WWW browser, in which case it is almost impossible to know in advance the terminal status and the line capacity of the client side. This is a major issue.

Second, in the case of broadcast video, scene editing uses special editing effects such as wipe, dissolve, slide, etc. by editing work. The detection of a scene change such as an editing effect requires image processing of all frames of a video having 30 frames per second. In the case of real-time compression and accumulation of TV broadcasts, the MPE must satisfy the performance of capture and compression at a rate of 30 frames per second.
There is a G real-time encoder. However, MPEG real-time encoding processing is very burdensome and difficult to implement in software, while hardware is expensive and cannot be used in ordinary homes and offices. Therefore, in the configuration disclosed in Japanese Patent Application Laid-Open No. 6-105280,
There is a problem that an inexpensive system configuration cannot be obtained. In addition, the MPEG encoding method uses inter-frame compression, which hinders the user from freely performing display in the time direction, such as sampling, sampling, and the like.

[0005] Third, the operation of recording a news broadcast or the like at a fixed time every day by a system using a computer, taking it into a video server, indexing and processing it, etc., is very labor-intensive. Is required to be fully automated. At that time, the date and time when the broadcast was recorded by the system are often used as the video management information. However, in news programs and the like that are broadcast near midnight, news broadcasts for the previous day are often performed after midnight, and there is a problem that a difference occurs between the date of the video management information and the date of the news content.

An object of the present invention is to solve the above problems.

[0007]

In order to solve this problem, the present invention first deals with a case where a video cannot be normally reproduced and displayed depending on the line capacity of the network itself and the performance of the display terminal itself connected to the network. To do
In the video editing apparatus, an index image generating unit that generates an index image that is a scene head reduced image, a strobe picture generating unit that generates a strobe picture that is an equal time interval sampling of the reduced image, and a video specified by the index image And a creation unit for a cueing reproduction table that is information for speeding up random access to the data. On the display side, a decoder for reproducing compressed video, index image display means, and a strobe picture It is composed of a display terminal unit having a reproducing unit and a video display unit.

Next, a first encoder for capturing, recording, compressing and storing video for all frames using an intra-frame video coding algorithm (such as motion JPEG), a first disk device for storing compressed video, and a compression system The image processing apparatus includes a first decoder that expands and reproduces a video for each frame, a first video editing unit that includes a video output unit that sends the video to the outside, and a video scene change detection processing unit. First
The video editing section captures, compresses and records the video,
Next, the video scene can be detected with an accuracy of 30 frames per second by decompressing one frame at a time and processing each frame image. The scene change detection processing is not always performed in real time, and may require several hours. Further, the expanded video is sent to the next second video editing unit in any form of an analog signal or a digital signal. The video signal is then converted to an inter-frame video encoding algorithm (M
PEG), and a second video editing unit including a second disk device for storing compressed video and a cue reproduction table generation unit.

[0009] Further, the video input control unit obtains the television program information through a network or other means to deal with a change in the broadcast time of the program so that the broadcast contents and the program do not conflict even in the broadcast after midnight. For this purpose, the program is started before the start of the corresponding program, and then the encoder is started. Further, in order to reliably record the program, the recording is started before the start of the program, and the recording is performed for a longer time than the broadcast time of the program.

[0010]

DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention according to claim 1 of the present invention provides a video input control unit for inputting various video images, a disk device for storing the video image input by the video input control unit ,
Detecting a scene change of the stored video,
Index image file that collects the first image of the scene change
A first video editor for creating a file, and the first video
Video and index image files output from the editor
A second video editing unit for creating a strobe picture from the
Video and index image files via the network
And a strobe picture, and the index image
An index image display means for outputting, and the strobe picture
A strobe picture display means for outputting a channel;
Video, index image display means and storage
Displaying at least one of the outputs of the robo-picture display means
A video processing device comprising a display terminal unit comprising video display means, and has the effect of solving the problem of achieving both reliable scene change detection and a standard compression type encoder configuration.

[0011]

Further, the system generates and stores a strobe picture in addition to an index image and a compressed image in advance. The strobe picture is an image obtained by sampling the reduced-size video at equal time intervals, unlike the index image which is the scene top screen obtained by the scene detecting means. In a low-speed network or low-speed video terminal, the user can select a video from an index image and then perform strobe picture playback instead of normal playback, allowing the user to summarize the video regardless of network capacity limitations or lack of performance of the display terminal itself. Can be grasped quickly.

[0013]

[0014]

[0015]

[0016]

[0017] According to a second aspect of the invention, an image input control unit for acquiring video and television program information, the Internet
And a video editing unit for controlling the recording by changing the preset recording time based on the TV program information obtained through the TV program. It has an effect that it is possible to automatically cope with a change in broadcast time and to reliably record a target program video.

According to the third aspect of the present invention, there is provided the video camera according to the second aspect.
In the image processing apparatus, the acquisition of the TV program information can be performed at any time.
Characterized by acquiring and changing the recording time every interval
For example, broadcast of a specific program on each day of the week
Automatically responds to time changes, ensuring the desired program video
It has the effect of being able to record to

The invention described in claim 4 is the invention according to claim 3 or 4.
The video processing apparatus according to claim 1, wherein the acquired television program
Start recording to include the broadcast time of the TV program from the information
The feature is to set the time and recording end time longer
For example, for a specific program on each day of the week
It can automatically respond to changes in broadcast time,
Eliminate the effects of time errors caused by hardware devices,
This has the effect that the desired program video can be reliably recorded .

[0020]

[0021]

[0022]

According to a fifth aspect of the present invention, there is provided a wireless communication system comprising:
Compressed image, index image file and strobe copy
A decoder for inputting a structure and expanding the compressed image;
An index for outputting an image of the index image file
Image display means and a strobe for outputting the strobe picture.
Trobo picture display means, the decoder, and index
The output of the image display means and the strobe picture display means is small.
Video display means for displaying at least one.
Display terminal device such as Internet
A video display terminal connected to a computer network, bandwidth of the network itself and the network
Video corresponding to the user, such as the performance of the display terminal itself connected to
It has the effect of enabling data supply . Less than,
An embodiment of the present invention will be described with reference to FIGS.

(Embodiment 1) FIG. 1 shows the overall configuration of the present invention. A video input control unit 101 receives a broadcast wave such as a satellite broadcast and captures a video video signal by an encoder 102. The video is digitally compressed and stored on the disk 103. As the compression method of this encoder, any method can be used as long as it can perform real-time compression and can compress both video and audio. Video is a conventional VT
Since the recording is not performed via the R or the like, the image quality is not degraded due to the recording on the video tape, and the complicated control at the time of capture, such as cueing of the VTR, is not required. The video input control unit 101 starts the system at a predetermined recording start time, performs capture and compression, and stops the system at the recording end time, similarly to timer recording of a home VTR. Thus, a desired program can be recorded every day or every week. However, no matter how accurate the system clock is, the start time of a broadcast program fluctuates irregularly on a weekly basis due to the programming of the broadcast station, or the broadcast time suddenly changes on the day due to the effects of sports broadcasting. Or change. In the present invention, the video input control unit automatically and appropriately acquires television program information by a network, a video itself, or other means, thereby solving the first problem.
Each broadcast station publishes its own homepage using the Internet, but there is also a broadcast station that discloses a one-week program schedule in this information. This information can be automatically obtained by the system to know the start time of the desired program. As a result, information on a program change on a weekly basis can be obtained, and the video input control unit can reliably record the program. It is assumed that the recording start time of a desired program by acquiring and processing such information is stored in advance in the recording time table. Another problem in recording a program is that a small time delay occurs in the mechanism part of the system, such as a disk device,
Recording may start slightly after the correct time. Therefore, the video input control unit is pre-configured to start recording a few seconds before the start of the program and to record for a long time until a few seconds after the broadcast time of the program in order to reliably record the program.

As a problem in the management of recorded programs, even in the case of broadcasting after midnight, in order to prevent discrepancies between the broadcast contents and the program, the program is started before the start of the program, and then the encoder is started. Have been. FIG.
Will be described in detail. Today's news program (tentatively named "TOD") is broadcast every day at midnight as a 25-minute program.
Assume a system that records and manages it as Dmmdd. Here, mm is the month and dd is the date. If today is November 1, the file name will be TODNov1. The standard broadcast time of the program is 25 minutes from time 23:35, but the broadcast schedule for one week is irregular.
It shall be broadcast from 30. Conventionally, a recording time table for one week is prepared in order to automatically record such a program, a recording start time T_start of today is obtained from this table, a program for performing a recording process is started at time T_start, and a program for 25 minutes is started. Recording was being performed. However, since the file name determination units 201 and 202 are executed at the time of starting this program, if November 1 is a broadcasting day in a standard time zone, the name will be correctly named TODNov1, but if broadcasting is late on a weekday. , Becoming TODNov2, the news and date cannot be corresponded. Therefore, in the present invention, as shown in the lower part of FIG.
Is started, and the recording file name is determined from the current date. First program 203
Is the current recording start time T_Rec_ from the recording time table.
The start is checked, and the second program 204 for recording is automatically executed. Therefore, the file name is correctly TODNov1 even in the time zone when the news broadcast on November 1 is late. FIG. 3 shows the flow of this processing. The system is daily
It is started at the time of T_every, and after executing the initialization processing 301, the recording file name is determined from the current date as indicated by 302. Next, at 303, a recording time table not shown in FIG. 1 is read out, and today's recording start time T_Rec_start is read out until the time is reached. The process up to this point corresponds to the process 203 in FIG. T_r
After ec_start, recording is performed in process 304, that is, video capture and real-time compression are performed. Where recording time
T_Length is 2 for secure recording of the program as described above.
The time is longer than 5 minutes. In the process 305, a video editing process not shown in FIG. 2 performed after the recording in FIG.

When the recording process is completed, the news video is compressed and recorded on the first disk device 103 for 25 minutes. This is the first compressed video. The audio is captured at the same time and recorded and stored as a separate file. In addition, the first encoding / decoding is for accumulating a video for video processing and video editing, such as a scene change detection process, and is not actually seen by an end user. Therefore, rather than a video compression method with a high compression ratio using visual characteristics, a compression method that preserves information possessed by a video should be used. Therefore, a method such as motion JPEG that can compress and decompress with a simple hardware device and capture about 30 frames per second is adopted. This method has a low compression rate due to the intra-frame compression method, and is not a standard video compression method, and has drawbacks such as the inability to compress audio simultaneously. .

Hereinafter, a portion in which the video editing process of 305 is performed using the first video editing unit 113 and the second video editing unit 114 will be described. FIG. 4 is a flowchart of the video editing process of the step 305. The video output in the process 401 is that the video is digitally compressed by the first encoder 102 by recording, and the video stored in the first disk device 103 is read from the first disk device 103 by the first decoder 104. The data is decompressed in real time and sent from the video output unit 106 to the second video editing unit. Here, the video signal can be output as either a digital or analog video image. However, even when outputting as a digital signal, motion JPEG
In the case of using so-called lossy compression such as that described above, it is inevitable that image quality is degraded due to decompression and subsequent compression. In the present embodiment, the second encoder 107
Has a video capture function and a compression function as hardware. because of these reasons,
In the present embodiment, the video output unit 106 adopts a form in which the decompressed video is temporarily converted into an analog video signal and input to the second encoder 107 of the second video editing unit 114. As a result, the second encoding can be performed in real time, which contributes to a reduction in the overall processing time.

When the video signal is expanded to the second encoding and the second encoding is performed again, in order to make the start frame and the end frame of the video body digitized by the first and second encodings exactly coincide with each other, the marker video is converted to the video. Add a few seconds before the start and after the end. The marker is an image clearly different from the target image, such as a “color bar” for color adjustment. In the present embodiment, a color bar video is digitally generated for a length of about 10 seconds, and the video output unit outputs (1) a color bar video, (2) a first recorded video 25 minutes, and (3) a color bar video. The video is output continuously without gaps in the following order.

In synchronization with the video output of 401, the second video editing unit 114 captures the video signal by the second encoder 107 in process 402, compresses the video signal in real time, and stores the video signal in the second disk device 112. .
Unlike the first encoder, the second encoder 107 has a high compression rate using a standard moving image compression method and a high audio level under the premise that the end user performs video and audio reproduction on the display terminal unit 115. A method such as MPEG which can be compressed is used. However, real-time capture at 30 frames per second of MPEG and encoding that multiplexes video and audio require extremely high computational power and expensive hardware. In the present invention, hardware that encodes only video images that can be used in a normal workstation is assumed. On this premise, it is limited that a video input as a video signal is compressed into an MPEG video stream at a rate of about 18 frames per second (18 fps). Even in this case, sufficient video quality can be obtained in consideration of the performance and network capacity of the display terminal. FIG. 5 shows the contents of the process 402. The video signal and the audio signal are captured by the above-described hardware and digitally recorded separately as an MPEG video stream 501 and an audio file 502 in real time. Next, in an audio encoding process, the audio file is converted into an MPEG audio stream 503 by software, and an MPEG video stream and an MPEG audio stream are separately generated in the second disk device 112.

Next, in the system encoding process 403, the system encoder 108 multiplexes the video stream and the audio stream to create an MPEG system stream 504, and stores this in the second disk device 112 as a second compressed video. I do. The system stream is a standard format for synchronously reproducing video and audio in MPEG, and performs this processing in order to handle digital video on various machines on a network in general. The process of creating the system stream in the second video editing unit can be performed in parallel with the execution time of the scene change detection process described later, and the processing time can be reduced.

In parallel with the system encoding process, the first
A scene change detection process 404 is performed in the scene change detection unit 105 of the video editing unit 113. FIG. 6 outlines the scene change detection. A first compressed video 601 is expanded from the first disk device 103 for each frame, a predetermined scene change detection process 602 is performed, and finally a scene change detection result file 603, a digest data file 604, and a scene head reduction An index image file 605 in which images are collected is generated. A scene change is a switching point of an image. In particular, in a broadcast material, there are artificial scene changes due to various camera works and editing effects, and the detection is performed with high accuracy by making use of each characteristic. In the present invention, a total of four types of scene change detection methods are used in combination.

The short and long detection processing 606 targets a quick scene change such as a camera change in which a change from the previous image to the subsequent image is within 5 frames. The image is divided into 16 blocks, a color histogram is calculated for each block, and a similarity is calculated between consecutive frames. A point on the time axis where the similarity increases from a decrease to an increase is defined as a scene change candidate. The image movement type detection processing 607 is for detecting an editing effect of a type in which a previous image gradually moves and is removed and a subsequent image appears, such as “pull-out”. A scene change candidate is defined as a region in which the temporal change in the area (pixel change area) of a portion where the luminance difference between pixels is equal to or more than a specified value between successive frames is large and gradually decreases. Pixel synthesis type detection processing 608
Is for detecting an editing effect of a type that gradually changes while the preceding image and the succeeding image are combined, such as “dissolve”. A portion where the sum of the edge intensities of the image has a temporally downward convex shape is set as a scene change candidate. The pixel replacement type detection processing 609 is for detecting an editing effect, such as “wipe”, in which a previous image is gradually and largely replaced by a part of a subsequent image. The scene change location detected by these detection methods is stored in the scene change detection file 603, and is later used for generating an index image.

Here, the contents of the table of the scene change detection result file will be described with reference to (Table 1).

[0034]

[Table 1] In (Table 1), the top five rows are header information and have nothing to do with a scene change. In this file, when expressing the number of frames, all 30 frames /
Although used in the meaning of seconds, the expression "frame (30)" will be used hereafter to clearly express this. TOTAL 14400 is the total number of frames (30), and in this example, the video is 14400 frames (3
0), that is, 8 minutes. MFNUM is
This is information at the time of the second encoding, and indicates the number of all frames (30) of the second compressed video. As described above, in the second encoder, since compression of all frames cannot be expected, the number of frames is reduced to 8910. CBARS, C
The two items of BARE are the number of frames of the marker video before and after the video. These are items to be entered after marker image detection described later, and are blank immediately after scene change detection. The next FPS 17.97 is information at the time of the second encoding, and indicates the number of frames per second at the time of encoding. The TOTAL and (MFNUM-CBARS-CB
ARE) and the ratio of 30 to FPS are almost equal,
This FPS value is information obtained from the second encoder 107. The items after START are the items to be entered as a result of the scene change, from START (frame (30) number 000000) to TO (frame (30) number 000).
004) is one scene, a scene change is detected in the next CUT (frame (30) number 000005), and TO (frame number
It means that up to 6) is one continuous scene. The tags CUT, WIPE, DISLV, and OTHER correspond to the type of the detected scene change, and mean a short-time long type, a video replacement type, a pixel synthesis type, and a video movement type, respectively.

In the scene change detection processing, the frame in which the scene change is detected, that is, the first frame of the scene is reduced and stored. In this embodiment, the current frame image is
If the image is 640x480 pixels, it will be 1/4 length and width, or
160x120 pixels or 80x60 reduced by 1/8
The image is a pixel image. These images are separate image files, stored in the first disk device, and used for generating an index image later.

The scene change detection unit 105 creates a digest data file 604 at the same time. The digest data file is an information file for reducing redundant video portions and displaying the video effectively, similar to the case of reproducing a video with a strobe picture. Hereinafter, a case in which a strobe picture described later is created based on three frames per second will be described. At this time, the strobe picture is 10
It is created by sampling each frame (30) and reducing the resolution. Therefore, in the expanded image in FIG.
The similarity to the reference image is calculated one after another every 10 frames (30), which is a specified sampling interval, and when the similarity is equal to or less than the threshold value, the frame number is written to the digest data file, and at the same time, the reference image is set Switch to the image. Thereafter, a digest data file is created by repeating the above steps sequentially. Next, an index image creation process is performed. In the index image generation processing, when a scene change is detected, a plurality of reduced image groups that have been reduced and accumulated are combined into one file, and the second disk device 112
Is stored.

After the scene change detection processing is completed in the first video editing unit 113, the second video editing unit 114
A marker video detection process 404 is performed. This process is the first
After the video output from the video editing unit 113 as a video signal is received by the second video editing unit 114, it is necessary to clarify and correct the shift of the start frame position. The marker image detection by the marker image detection unit 109 will be described with reference to FIG. First, the second encoder 10
At 7, the video stream of the second compressed video 701 captured and compressed at a capture rate different from that of the first compressed video, for example, at a rate such as 18 fps, is sequentially expanded by the second decoder 116 from the beginning in the reproduction order.
After that, the frame at the rate of 18 fps is framed (18)
It will be expressed as At the time of output, this video has a marker video added at the beginning and end. Therefore, the top image 702
Is a marker video, and sequentially calculates the similarity between the next frame (18) and the leading image 702.
The frame (18) number S of the portion 703 where the similarity is equal to or less than the threshold value is detected, and is set as the number (18) of marker video frames at the head of the video. Next, the compressed video stream is expanded one frame at a time from the end in the reproduction order. Again, assuming that the last image 705 is a marker video, the similarity with the last image is sequentially calculated, and the frame numbers NE and all frames of the portion 704 where the similarity becomes equal to or less than the threshold value are calculated. (18) E is obtained from the number N and is set as the number of tail marker video frames (18). Next, CBARS and CBR, which are the two items described above, of the scene change detection result file
Although S and E are described in AE, the number of frames is frame (3
0), the frame number correction unit 70
At 6, the frame number is corrected. Since the frame number correction is described as FPS in the scene change detection result file 707 as shown in Table 1,

[0038]

(Equation 1) It is performed in. Thus, CBARS and CBARE are described, and the scene change detection result file 708 is completed again.

Next, the cueing reproduction table creation processing 405 is performed in the cueing reproduction table generation unit 108 of the second video editing unit 114. This is the first video editing unit 11
3 from the scene change frame number designated from the scene change detection result file in the second video editing unit 11
The second disk device 112 from the arbitrary frame of the system stream to the decoding start position while analyzing the second compressed video encoded to the system stream for the purpose of performing the start reproduction to the video at high speed in step 4. This is a process for creating a table for obtaining the above seek amount. FIG. 8 shows a cueing reproduction table creation process.

The cue reproduction table locates the second compressed video including the marker video according to the scene change frame number designated from the scene change detection result file. Become. In order to find the frame (18) of the scene to be searched from the scene top frame (30) in the scene change detection result file,

[0041]

(Equation 2) Is used. Reference numeral 801 denotes a system code detecting unit that reads an MPEG system stream, detects a pack start code and a packet start code included in the stream, stores the code positions thereof, and separates a video packet and an audio packet. Reference numeral 802 denotes a video packet analysis unit that analyzes a plurality of video packets as one system stream, and 803 denotes an audio packet analysis unit that analyzes a plurality of audio packets as one audio stream. 805
Is the picture code, GOP from multiple video packets
This is an intra-packet code detecting means for detecting a video packet including a code. Reference numeral 806 denotes a video frame calculation unit that counts the number of picture codes, and outputs the cumulative number of frames up to immediately before each GOP code and the picture codes after the GOP code in the packet each time a GOP code is detected. Reference numeral 807 denotes a video stream information storage unit that stores information such as parameters for decoding the video stream and total frames. 808 is GO at 805
Each time a P-code is detected, a video cueing / reproducing record creating means for summarizing the number of frames in a packet, the number of accumulated frames, the number of offset bytes from the head of a stream to a pack header, and the number of relative offset bytes from a pack header to a packet header. is there. From 809 to 812, the same analysis processing as described above is performed for audio. The table creation means 804 collects the above-mentioned video cue reproduction record and audio cue reproduction record and creates a table to generate a cue reproduction table file. The cue reproduction table file is composed of a plurality of fixed-length records that are easily accessed at random as described above, and the MP from the frame.
This file describes information enabling random access up to the EG system stream offset, and is a file for speeding up the start reproduction of the MPEG system stream video.

Next, in the strobe picture generation unit 110 of the second video editing unit 114, a strobe picture creation process 406 is performed. FIG. 9 is a diagram showing a strobe picture creation process. The strobe picture is a technique of sampling a video temporally, for example, at about three frames per second, and displaying the video on a film image, thereby instantly and spatially grasping the temporal flow of the video. Also,
This is used when it is desired to send a reduced video to be added to audio information even when the network communication capacity is small. Read the FPS again from the scene change detection result table file, and
The sampling interval n at the number of frames (18) is expressed by the following equation.
Ask for.

[0043]

(Equation 3) The sampled image is reduced and processed to about half the length and width and collected to generate a strobe picture file.
Thus, the video editing processing ends. When the above-described series of processing is executed, the following files are generated on the second disk device 112. (1) Second compressed video file (MPEG video stream) (2) Audio file (3) MPEG audio stream (4) MPEG system stream file (5) Scene change detection result table file (6) Digest data file (7) Start-up playback table file (8) Index image file (9) Strobe picture file Of these, the MPEG video stream of (1) becomes unnecessary when the MPEG system stream of (4) is generated. The other files are appropriately used by the display terminal. 10 and 11 show that the video editing is completed and each file is stored in the second disk device 1 in FIG.
12 shows the state stored therein. FIG. 10 assumes that the computer network can only secure a communication speed of about 10 MBPS, and that the display terminal is a PC or the like. The network is connected to various other machines as a private network. It is not realistic to distribute a video in a network in such a general network form because it puts pressure on other services. Displaying moving images while running general business applications as a display terminal PC (personal computer) is heavy. Therefore, in the present embodiment, the display terminal unit 115 has a function as a function of synchronizing the index image (no audio) display by the index image display unit 117, the strobe picture (no audio) display by the strobe picture display unit 118, and the strobe picture. Only video display. That is, the video display unit 1007 does not receive the second compressed video over the network. When high-quality moving image reproduction is required, a local image server is installed in each display terminal unit 115. As the local video server, a simple one is an analog optical disk or a medium on which a second compressed video file is copied, and it is assumed that video and audio are recorded in advance. The display terminal unit 115 reads the scene change detection result table file 1002 when the end user instructs the control unit 1001. Next, the server process 1003 transmits only the necessary portion of the index image file, and the client process 1004 receives the index image in the display terminal unit 115, and the video display unit 11
9 is displayed. The server process and the client process are provided to transmit only a necessary portion as a stream in real time without reading the entire large-capacity video file on the network. For example, when the user specifies a portion of a video to be searched for by an index image by the functions of the server process and the client process, the display control unit 1001 instructs the server process 1005 to send a strobe picture file from the corresponding frame. And server process 1
005 sends a strobe picture file from an arbitrary position to the network, and the client process 1006
The image display unit 1007 reads the strobe picture file and the audio file, and outputs the strobe picture to the image display unit and the audio to the speaker. At this time, it is of course possible to display only the strobe picture. In addition, if it is desired to prevent similar images from being arranged in the strobe picture display, it is possible to read the digest data file and display only strobe pictures having a low similarity to reduce the redundancy.

Further, if a local video server 1008 is provided, it is possible to obtain a high-quality moving image audio synchronous output of a video fetched from a frame number designated by an index image by instructing the local video server 1008. All of these display functions are controlled by the display control means together with the user interface, allowing the end user to freely access the video.

FIG. 11 shows that the computer network is 16
This is a system that uses a 0 MB ATM or the like and uses a high-performance workstation or the like as the display terminal unit 115, or a system in which the network itself is low but a video-only network is prepared. Here also, the index image display and the strobe picture display show the same data flow as in FIG. 10, but in the case of video display, the display control means reads the cue reproduction table file 1101 in advance. When the user specifies a portion to be searched and reproduced by an index image based on the index image, the server process 1003 seeks to an arbitrary position in the second compressed video file 1102 and sends the second compressed video file from the seek position. , The client process 1104 receives the compressed video and sends it to the third decoder 1105. The third decoder obtains the decoding start position of the cueing MPEG system stream from the cueing reproduction table, separates the stream into a video stream and an audio stream, and outputs a video image to a video display unit and audio to a speaker.

As described above, by specifying an index image, the end user can immediately search for a strobe picture, a strobe picture with audio, and a normal video from an arbitrary position in the video and reproduce it.

In the present embodiment, the video output unit 106 shown in FIG. 1 outputs video as analog video and audio signals, but digital output is also possible. In this case, the addition of the marker video in the video output unit 106 in the first video editing unit 113 and the marker video detection unit 109 in the second video editing unit 114 become unnecessary.
Also, the first disk device 103 and the second disk device 112 are separated for convenience, but may be the same. Further, the system encoder 108 in the second video editing unit 114 is unnecessary if the second encoder 107 creates up to a system stream.

The second decoder 116 and the third decoder may be the same.

[0049]

As described above, according to the present invention, first, in order to cope with a case where a video cannot be normally reproduced and displayed depending on the line capacity of the network itself and the performance of the display terminal connected to the network, a strobe picture is used. By means of reproduction and display, appropriate video data can be supplied to all users.

Next, the video is captured for all the frames using an intra-frame video encoding algorithm (such as motion JPEG) and optimized for the change detection processing means, and then the inter-frame video encoding algorithm (MPE).
G, etc.) to create a compressed video for user display by re-encoding, thereby enabling cost-effective and efficient video editing.

Further, the video input control section aims at completely unattended recording of the program, and the recording management information can cope with this even if the broadcast time of the program is changed for each day of the week.

[Brief description of the drawings]

FIG. 1 is a diagram showing a system configuration according to an embodiment of the present invention;

FIG. 2 is a diagram for coping with a change in recording time according to the embodiment;

FIG. 3 is a flowchart showing the entire operation of the system according to the embodiment;

FIG. 4 is a flowchart of a video editing process according to the embodiment;

FIG. 5 is a view showing a second encoding and a system encoding in the embodiment.

FIG. 6 is an exemplary view showing a scene change detection process in the embodiment.

FIG. 7 is an exemplary view showing strobe picture creation processing in the embodiment.

FIG. 8 is a view showing creation of a cue reproduction table in the embodiment.

FIG. 9 is a view showing strobe picture creation in the embodiment.

FIG. 10 is a diagram showing a data flow in the low-speed computer network in the embodiment.

FIG. 11 is a diagram showing a data flow in the high-speed computer network in the embodiment.

[Explanation of symbols]

 101 video input control unit 102 first encoder 103 first disk device 104 first decoder 105 scene change detection unit 106 video output unit 107 second encoder 108 system encoder 109 marker video detection unit 110 strobe picture generation unit 111 head Output / playback table generator 112 second disk device 113 first video editor 114 second video editor 115 display terminal 116 second decoder 117 index image display 118 strobe picture display 119 video display 120 3 decoders

──────────────────────────────────────────────────続 き Continuation of the front page (72) Koji Taniguchi 3-10-1, Higashi Mita, Tama-ku, Kawasaki City, Kanagawa Prefecture Inside Matsushita Giken Co., Ltd. (56) References JP-A-6-236593 (JP, A) JP-A-3-89786 (JP, A) JP-A-6-36389 (JP, A) JP-A-2-294957 (JP, A) JP-A-6-105280 (JP, A) JP-A-64-68084 ( JP, A) JP-A-2-32473 (JP, A) (58) Fields investigated (Int. Cl. ⁷ , DB name) H04N 5/76-5/956 H04N ⁷ /24-7/68 H04N 9 / 79-9/898 G11B 20/10-20/12

Claims (3)

(57) [Claims] 1. An image input control unit for inputting an image, a disk device for storing the image input by the image input control unit, and detecting a scene change of the stored image.
A first video editing unit for creating an index image file in which the first image of the scene change is collected;
And a second video editing unit that creates a strobe picture from the video output from the video editing unit and the index image file, and a compressed video, an index image file, and a strobe picture via a network, and output the index image. A display comprising: an index image display means; a strobe picture display means for outputting the strobe picture; and a video display means for displaying at least one of the video from the disk device, the output of the index image display means and the output of the strobe picture display means. A video processing device comprising a terminal unit. 2. A video input control unit for acquiring video and television program information, and a video editing unit for controlling recording by changing a preset recording time based on the television program information acquired via the Internet. A video processing device comprising: 3. A decoder which inputs a compressed video, an index image file and a strobe picture via a network, and expands the compressed video, an index image display means for outputting an image of the index image file, and the strobe picture. A display terminal device comprising: a strobe picture display unit for outputting; and a video display unit for displaying at least one of the outputs of the decoder, the index image display unit, and the strobe picture display unit.