JPH1188855A - Image transfer reproducing system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To remove noises generated by the initialization of a decoding board at the switching an image and to remove the disturbance of an image at the time of switching the image. SOLUTION: When a stored image is required, a client 1 acquires compressed video data from a main server 2, and when a real time image is required, acquires video data from a real time server 3 through the main server 2. The client 1 consists of a starting means 4 for receiving a request from a user and starting a system, an image reproducing means 5 for receiving the start from the means 4, communicating with the main server 2 and reproducing data received from the main server 2, a decoding means 6 for extending the received video data, and a display means 7 for executing processing for displaying the extended data. The decoding means 6 is a decoding board and initialized only when a client terminal is started.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to a system of a first computer (hereinafter, referred to as a server) and a second computer (hereinafter, referred to as a client) comprising a computer and a network. MPEG2 video (hereinafter simply referred to as stored video) and MPEG captured and encoded by a server-side camera
The present invention relates to a video transfer / playback system that transfers two videos (hereinafter, simply referred to as real-time video) to a client side and plays back and displays the video on a terminal.

[0002]

2. Description of the Related Art As is well known, MPEG2 is a digital video compression system standardized by the International Organization for Standardization (ISO). An encoding board for real-time compression (hereinafter simply referred to as "encoding") of a video object using the MPEG2 method, and real-time decompression (hereinafter referred to as "encoding") when displaying received data encoded in the MPEG2 format. Boards, which are simply called decoding). The conventional video transfer / playback system using these boards has been
When playing video from two video files on the terminal side,
The decode board was initialized so that the data of the previous video did not affect the next reproduction.

[0003]

However, at the time of this initialization, there is a problem that a loud noise is generated. Further, in the clear processing that does not go to complete initialization, there is a problem that the previous video appears momentarily on the screen when the video file is switched, and sometimes is disturbed (hereinafter referred to as “disturbance during video switching”).

[0004] It is an object of the present invention to provide a technique capable of removing noise of initialization of a decode board at the time of video switching and disturbance of video at the time of video switching.

The above and other objects and novel features of the present invention will become apparent from the description of the present specification and the accompanying drawings.

[0006]

The outline of a typical invention among the inventions disclosed in the present application will be briefly described as follows.

(1) A video transfer / reproduction system in which a server and a client are connected via a network, and a stored video or a real-time video is transferred from the server to the client and reproduced on the client. The generated real-time video data is received by communicating with the real-time video data generating means of the other computer using the first protocol, and further, the real-time video data is received by the real-time video data receiving means of the client according to the second protocol. A real-time video data transmitting unit for transmitting data; and a real-time video data transmitting unit for transmitting stored video data to a stored data receiving unit of a client by the second protocol. Real-time video data receiving means for receiving real-time video data transmitted by the second protocol, stored video data receiving means for receiving stored video data transmitted by the second protocol from a server, and a client Decoding means for initializing the decoding board when the terminal is started.

(2) In the video transfer / playback system according to (1), when the client switches the video when the client performs black video data storage means for storing black video data, Black data insertion control means for inserting the black video data stored in the black video data storage means in the buffer of the real-time video data receiving means or the stored video data receiving means so as to overlap the end of the video data before switching. And a video transfer / playback system having:

That is, according to the present invention, in order to eliminate the above problems, first, regarding the noise of the initialization of the decoding board at the time of video switching, the initialization is performed only when the terminal is started up.
When switching the video, the decoding board is not initialized. Further, with regard to the disturbance of the video at the time of video switching, a fixed dummy data is displayed for a short time at the time of switching, and the last video reproduced immediately before is not left.

[0010]

Embodiments of the present invention will be described below in detail with reference to the drawings.

In all the drawings for describing the embodiments, those having the same functions are denoted by the same reference numerals, and their repeated description will be omitted.

FIG. 1 is a system configuration diagram of one embodiment (embodiment) of the present invention, wherein 1 is a client composed of a computer, 2 is a main server composed of a computer, and 3 is a real-time video server. The client 1 acquires compressed video data (hereinafter, unless otherwise noted, video data indicates compressed data) from the main server 2 if the request is a stored video, and if the request is a real-time video, From the real-time server 3 via the main server 2,
Get video data. The client 1 receives a request from a user (not shown), activates the system, activates the system, receives activation from the activation unit 4, transmits / receives data to / from the main server 2, and reproduces the received data. Means 5, decoding means 6 for expanding the received video data, and display means 7 for processing the expanded data for display. The decompressed data from the display means 7 is
The image is sent to the monitor 8 and the image is displayed. The decoding means 6 includes a decoding board (not shown).

The video reproducing means 5 has a real-time video data receiving means 5a for receiving real-time video among video data transferred from the main server 2, and a stored video data receiving means 5b for receiving stored video data.
The real-time video data receiving means 5a and the stored video data receiving means 5b are both receiving means, but actually have a transmitting means for issuing a request from the client 1 to the main server 2.

The main server 2 is a main server of the present system, and includes a stored video file 9 in which video data is stored in advance in the MPEG2 format, a stored video data transmitting unit 10 for transmitting the stored video data to the client 1, and a real-time It has a real-time video data transmitting means 11 for relaying video data.

The real-time video server 3 transmits the data from the CCD camera 12 and the CCD camera 12 to the MPEG-2
It has real-time video data creation means 13 for encoding data.

A server corresponding to the client 1 is defined as a main server 2 irrespective of real-time video and stored video.
In addition, the protocol during this period is unified into one. This is intended to increase the common ratio of the transmission / reception compatible portions of the video reproducing means 5 and the main server 2 respectively.

FIG. 2 is a model diagram of the video transfer method of the present embodiment. FIG. 2 shows a plurality of video reproducing means 5 assuming that there are a plurality of users. In order for a client to reproduce high-definition video only when necessary, it is necessary to transfer a large amount of video data with high reliability and high speed, and to perform start / stop operations from the client side. Therefore, the transfer of the stored video is performed by the stored video data transmitting unit 10.
For the video reproducing means 5, the well-known TCP protocol starts up in response to a request from the client, and performs transmission confirmation between transmission and reception, error checking, retransmission at the time of error, and the like.

On the other hand, the real-time video is sent from the real-time video server 13 to the real-time video data transmitting means one after another, regardless of the request of the user. This transmission / reception protocol is a well-known UDP protocol,
Unlike the TCP protocol, delivery confirmation and error checking are not performed, so that the transfer rate is generally higher than that of the TCP protocol. By using the UDP protocol, high-bit-rate video data can be transferred from the real-time video data creating means 13, and as a result, the high-speed TCP data is transmitted between the real-time video data transmitting means 11 and the video reproducing means 5. Since the bit rate video data can be transferred and the TCP protocol, unlike the UDP protocol, real-time video can be extracted from the client when necessary.

FIGS. 3A and 3B are diagrams for explaining the video file switching method according to the present embodiment. FIG. 3A is a diagram illustrating a case where black data is not inserted, and FIG. 3B is a diagram illustrating a case where black data is inserted. As described above, the dummy video is inserted into the switching portion. This dummy video is MPEG2
And a data structure that can be reproduced without any disturbance. Here, since the image is a black image obtained when the CCD camera 12 is covered and photographed, the image is hereinafter referred to as black data. The black data is stored in the client terminal (black video data storage means). The timing of black data insertion, ie, video switching, can be known when the operator of the client terminal detects an operation to switch video. For example, when the user stops browsing the real-time video and looks at the stored video, the client terminal detects this timing and converts the black data to the video before switching in the buffer of the real-time video data receiving means or the stored video data receiving means. Overlay at the end of the data.

3A and 3B, reference numeral 41 denotes a video before switching, 42 denotes a new video after switching, and 43 denotes a video immediately before switching. Originally, the video data is transferred in the order of the video data 411 and the video data 421. Video 42
, A video 43 appears temporarily (usually about 0.3 seconds).

FIG. 3B shows a case where black data 441 is forcibly inserted after the previous video data 411. The new video starts with black data 441, and the previous video is not displayed like the video 43 in FIG. This is because the black data is inserted so as to replace the remaining portion of the previous video file on the buffer memory.

When decoding and reproducing the received MPEG2 video, the MPEG2 data structure,
It is a matter of course that it is performed based on the characteristics of the decode board and the like, and the disturbance and the like are minimized.

FIG. 4 is an explanatory diagram of initialization at the time of starting the terminal according to the present embodiment. As shown in FIG. 4, when the terminal is started (1), the display means 7 (2), the video reproduction means 5
(3) Each of the decoding means 6 (4) is initialized. The decoding means 6 includes a decoding board, which is also initialized at the same time (conventionally, the decoding means 6 is initialized each time it is used). With these initializations and startups, the client side becomes active (5),
The system enters a state of waiting for a request from the activation means of the system.

FIG. 5 is a diagram showing a processing sequence of the entire system of the present embodiment. FIG. 5 is an outline of the sequence from the start to the video display. When the client terminal is started, each unit starts by starting each server and the client program (1). In particular, in the present embodiment, when the client terminal is started, the decoding board in the decoding means 6 is initialized (2), and the program of the decoding means 6 is made resident by a normal method. When an instruction to reproduce the video 1 is issued from the activation unit 4 (3), a display instruction is sent from the video reproduction unit 5 to the display unit 7 (4).
Simultaneous storage / real-time video data transmission means 10, 1
1 sends a video 1 data transmission request (5). The obtained video 1 data (6) is sent to the decoding means 6 via the video reproducing means 5 (7) and is decoded there (8).
The decoded video 1 (9) is sent to the display means 7 and displayed (10). After the display of the video is stopped and terminated, the process waits for the next display instruction (not shown). In this state, when the next video 2 reproduction instruction is issued (11), the above processes (3) to (10) are repeated. Conventionally, the decoding means 6 has been initialized each time the result of the video reproduction instruction is received.

As can be understood from the above description, according to the present embodiment, the initialization of the decode board at the time of video switching is performed only when the terminal is started up. Only once. Therefore, no large noise is generated each time the video is switched.

At the same time, the decoding means 6 becomes a resident program, and the rising speed is high. In addition, since the same protocol was used between the client 1 and the main server 2 in consideration of the transfer and reproduction of the real-time video and the stored video, the protocol corresponding portions of the client 1 and the main server 2 could have many common elements.

Further, since the processing for inserting certain black data into the decoding means 6 after one video file has been reproduced and finished, the reproduction of the next video file is started after the black data is reproduced for a moment. The problem that the last part of the video file played back immediately before remains is eliminated.

As described above, the invention made by the present inventor is:
Although specifically described based on the embodiment, the present invention
It is needless to say that the present invention is not limited to the above-described embodiment, but can be variously modified without departing from the scope of the invention.

[0029]

As described above, according to the present invention, the initialization of the decode board at the time of video switching is performed only when the terminal is started up. Only the degree, no big noise is generated every time the video is switched.

Also, since the decoding means is a resident program at the same time, the start-up is fast, and the same protocol is used between the client and the main server in consideration of the transfer and reproduction of the real-time video and the stored video. In addition, the protocol corresponding part of the main server has many common elements.

[0031] Further, since one black file is inserted into the decoding means after one video file has been reproduced and completed, the reproduction of the next video file starts after the black data is reproduced for a moment. The problem that the last part of the video file that was being played back remains is eliminated.

[Brief description of the drawings]

FIG. 1 is a system configuration diagram of an embodiment (example) of the present invention.

FIG. 2 is a model diagram of a video transfer method according to the embodiment.

FIG. 3 is a diagram for explaining a video file switching method according to the embodiment.

FIG. 4 is an explanatory diagram of initialization at the time of terminal startup according to the present embodiment.

FIG. 5 is a diagram showing a processing sequence of the entire system of the present embodiment.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 ... Client, 2 ... Main server, 3 ... Real-time video server, 4 ... Start-up means, 5 ... Video reproducing means, 5a ... Real-time video data receiving means, 5b ... Stored video data receiving means, 6 ... Decoding means, 7 ... Display Means 8, monitor 9, stored video file 10, stored video data transmitting means 11, real-time video data transmitting means 12,
CCD camera, 13: real-time video data creation means, 14: black data storage means, 15: black data insertion control means, 41: video before switching, 42: new video after switching, 43: video immediately before switching.

Continuing from the front page (72) Inventor Mikihiro Unno 3-192-2 Nishi-Shinjuku, Shinjuku-ku, Tokyo Japan Telegraph and Telephone Corporation (72) Inventor Takashi Imai 3-2-1-2, Nishi-Shinjuku, Shinjuku-ku, Tokyo Nippon Telegraph and Telephone Telephone Co., Ltd. (72) Inventor Nobuhide Shiki 20-1 Sakuragaoka-cho, Shibuya-ku, Tokyo NTT Electronics Corporation (72) Inventor Toshimi Mizuma 20-1 Sakuragaoka-cho, Shibuya-ku, Tokyo NTT Electronics Inc. Inside the company (72) Inventor Masami Ujiie Inside NTT Electronics Electronics Co., Ltd. 20-1, Sakuragaoka-cho, Shibuya-ku, Tokyo

Claims (2)

[Claims] 1. A first computer (hereinafter, referred to as a server) and a second computer (hereinafter, referred to as a client) are connected via a network, and a stored image or a real-time image is transferred from the server to the client. Video playback system for playing back
The server receives real-time video data created by another computer by communicating with real-time video data creation means of the other computer using a first protocol. A real-time video data transmitting unit that transmits the real-time video data according to the second protocol; and a real-time video data transmitting unit that transmits the stored video data to the stored data receiving unit of the client according to the second protocol. The client includes a real-time video data receiving unit that receives real-time video data transmitted from the server according to the second protocol, and receives stored video data transmitted from the server according to the second protocol. Image transmission reproducing system characterized by having a storage video data receiving unit, and a decoding means for initializing a decoding board when the client terminal startup to. 2. The video transfer / playback system according to claim 1, wherein said client stores black video data in a black video data storage unit, and said black and white data is stored when said client switches video. Black data insertion control means for inserting the black video data stored in the video data storage means in the buffer of the real-time video data receiving means or the stored video data receiving means so as to overlap the end of the video data before switching. A video transfer / playback system comprising: