JP2008252705A - Animation transmission apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an animation transmission apparatus in which trouble of playback video and sound such as video freeze or sound interruption does not occur during viewing by a user. <P>SOLUTION: The apparatus includes: a scene data extraction section for extracting scene data pieces for a motion picture data piece; a scene data storage section for storing the scene data pieces; a load detection section for detecting the load of a network; a priority determination section for determining a transmission priority of the scene data pieces; and a transmission section for transmitting the scene data pieces via the network in accordance with the load of the network and the transmission priority. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a moving image transmitting apparatus, and more particularly to a moving image transmitting apparatus that performs streaming moving image transmission via a bidirectional network.

  Streaming video transmission (on-demand transmission) in which a video is streamed in response to a transmission request is widely performed via a bidirectional communication network typified by the Internet (see, for example, Patent Document 1).

  FIG. 1 shows a transmission device 8 such as a server device connected to the Internet (IP network) 5 and a client device 9 that is a client of the transmission device 8. The client device 9 is, for example, a so-called personal computer (PC), a telephone having an Internet connection function, a mobile phone, or other devices having an Internet connection function.

  The transmission device 8 performs streaming video transmission (distribution) in response to a transmission request from the client device 9. As the number of client devices 9 that are simultaneously connected to the transmission device 8 via the Internet 5 increases, the load on the client device 9 and the network (Internet 5) increases.

In the prior art, such an increase in the load on the network is dealt with by adjusting the quality of the moving image to be transmitted according to the load on the network and the server. However, regardless of the content of the transmission (distribution) content (moving image data), processing for reducing the amount of data sent to the network has been performed only for the purpose of reducing the load on the network and server and continuous playback on the client device. . Therefore, for example, transmissions that make the user feel stressed are often performed, for example, only audio data is transmitted in a climax scene of content and video data is not transmitted.
JP-A-10-164533 (5th page, FIG. 3)

  The present invention has been made in view of the above-described points, and the object of the present invention is to ensure that even when the load on the network is increased, the video is frozen or the sound is interrupted during user viewing. An example is to provide a streaming video transmission apparatus that does not cause inconveniences in playback video and audio.

  The moving image transmission apparatus according to the present invention includes a moving image data storage unit that stores one or more pieces of moving image data pieces, and a transmission / reception unit that transmits / receives data via a network, and responds to a transmission request received via a network. A video transmission device that transmits a video data fragment via a network, a scene data extraction unit that extracts a scene data fragment for the video data fragment, a scene data storage unit that stores the scene data fragment, and a network A load detection unit for detecting a load, a priority determination unit for determining a transmission priority of the scene data fragment, and a transmission unit for transmitting the scene data fragment via the network according to the network load and the transmission priority. It is characterized by having.

  Embodiments of the present invention will be described below with reference to the drawings.

[Configuration of video transmission device]
FIG. 2 is a block diagram schematically showing the configuration of the moving picture transmitting apparatus 10 according to the present invention. The moving picture transmitting apparatus 10 performs streaming moving picture transmission (distribution) in response to a moving picture transmission request from the client device 9 via the Internet (IP network) 5.

  The moving image transmitting apparatus 10 is configured as a video recording / reproducing apparatus such as an HDD recorder having an HDD (Hard Disk Drive), a DVD (Digital Versatile Disc) recorder, a Blu-ray recorder, or an HD-DVD recorder. Hereinafter, a case where the moving image transmission apparatus 10 is simply configured as a digital recorder having a storage unit (storage) will be described as an example. However, as a matter of course, it may be configured as a recorder (DVD recorder, Blu-ray recorder, HD-DVD recorder) that records and reproduces an optical recording medium in addition to the storage unit.

  A moving picture transmitting apparatus (hereinafter referred to as a digital recorder) 10 functions as a recording apparatus for recording video / audio data, and reproduces and outputs recorded moving picture digital data (hereinafter simply referred to as moving picture data). It also functions as a device.

  The digital recorder 10 is provided with a recording / reproducing unit 11. The recording / reproducing unit 11 is provided with an encoder, a multiplexing circuit (hereinafter referred to as a multiplexer MUX), a decoder, a demultiplexing circuit (hereinafter referred to as a demultiplexer DEMUX), and the like. When analog video / audio signals are input / output, an analog-digital converter (A / D converter), a digital-analog converter (D / A converter), and the like are provided.

  More specifically, a video signal (video signal) and an audio signal (audio signal) input to the recording / playback unit 11 are encoded (encoded) into predetermined compressed data such as MPEG by an encoder (not shown). . The encoded video data and encoded audio data from the encoder are multiplexed by the multiplexer MUX.

  The multiplexing of the encoded video data and the encoded audio data is executed under the control of the system controller 20. The system controller 20 is connected to each part of the digital recorder 10 via a signal bus (not shown), and is configured to control the entire digital recorder 10. In addition, the system controller 20 is provided with a RAM and a ROM (not shown) which are memories for storing data, commands, setting values and the like necessary for the system controller 20 to control the digital recorder 10. It is connected to the.

  The data multiplexed in the multiplexer MUX (hereinafter also referred to as multiplexed data) is transferred to the moving image storage unit 14 via the interface (I / F) circuit 12 and is converted into a moving image based on a control signal from the system controller 20. Stored as data (video content). The moving image storage unit 14 has, for example, an HDD.

  That is, the moving image storage unit 14 stores one or more video contents. Hereinafter, such video content is also referred to as “moving image data piece”.

  If a drive for an optical recording medium (for example, a Blu-ray disc) is provided, the data stored in the moving image storage unit 14 is transferred to the optical disk drive via the interface circuit 12 and recorded ( It may be configured such that data recorded on the optical disc can be transferred to the moving image storage unit 14 via the interface circuit 12 and stored.

  If the data input to the digital recorder 10 is predetermined compressed data (encoded data) such as MPEG, the compressed data is transferred to the moving image storage unit 14 via the interface circuit 12 under the control of the system controller 20. It may be configured to be stored directly in. Further, the input encoded data may be decoded so that data can be reproduced.

  Next, at the time of data reproduction, the system controller 20 reads the moving image data stored in the moving image storage unit 14. The read moving image data is supplied to the demultiplexer DMUX via the interface circuit 12 and separated into encoded video data and encoded audio data.

  The encoded video data and encoded audio data are decoded (decoded). For example, when the encoding is MPEG, MPEG decoding is performed. The decoded video signal and audio signal are output to an external display device or the like as digital data or after digital-analog conversion.

  Further, the recording / playback unit 11 is provided with a digest scene extraction unit 15 that extracts a digest scene (highlight scene) of input video / audio data and a digest scene storage unit 16 that stores the digest scene data. Yes.

  The digest scene extraction unit 15 extracts a digest scene of the moving image data in advance, and stores the digest scene in the digest scene storage unit 16 in association with the moving image data when the moving image data is stored in the moving image storage unit 14. The digest scene is a part of the moving image data, that is, a digest scene data piece, and is, for example, a moving image of several seconds to several tens of seconds with sound. Hereinafter, the digest scene data piece is also referred to as a “scene data piece”.

  The digest scene extraction unit 15 can set digest scene information for each of digest scene data (scene data pieces). That is, the transmission priority or weighting at the time of transmission (to be described later) of digest scene data can be set as the digest scene information. The digest scene extraction unit 15 determines the transmission priority or weighting, and stores the transmission priority in the digest scene storage unit 16 in association with each of the digest scene data (scene data pieces).

  Here, the transmission priority (or weighting) can be set or determined by various methods. For example, it can be set so as to respond to a change in the content (moving image data). For example, it is possible to determine the transmission priority by assuming that the content content has changed based on the magnitude of the change in the audio level and the magnitude of the change in the video luminance.

  The storage in the moving image storage unit 14 and the digest scene storage unit 16, the reading of data from the moving image storage unit 14 and the digest scene storage unit 16, the transfer and storage of these data, and the like are performed under the control of the system controller 20. The

In addition, an operation input unit 22 is provided, which receives operations and settings from the user and controls the system controller 20 based on the operations and settings. Information such as user operations / settings, the contents stored in the moving image storage unit 14 and the digest scene storage unit 16, and the execution status of various operations are displayed on the display unit 23. Alternatively, all or part of the information may be supplied to a display device (not shown) such as a TV device connected to the digital recorder 10 and displayed on the display device.
[Device configuration and operation for on-demand transmission]
As shown in FIG. 2, the digital recorder 10 is provided with a network transmission / reception unit 17 having an Internet connection function. The network transmitting / receiving unit 17 includes a receiving unit and a transmitting unit (not shown). The receiving unit of the network transmitting / receiving unit 17 receives a moving image transmission request (TR) from a client device such as a personal computer (PC) or a mobile phone via the Internet (IP network) 5.

  The system controller 20 searches the storage unit 14 for moving image data corresponding to the received moving image transmission request (TR) (that is, a moving image data piece, the same applies hereinafter). Then, the system controller 20 instructs the stream buffer device 18 (hereinafter also simply referred to as the buffer device 18) to send the searched moving image data from the storage unit 14 via the interface circuit 12. The buffer device 18 includes a buffer input unit 18A, a buffer memory 18B (hereinafter simply referred to as a buffer 18B), and a buffer output unit 18C.

  More specifically, the system controller 20 instructs the buffer input unit 18A to read the searched moving image data. The read moving image data is stored in the buffer 18B. Then, under the control of the system controller 20, the moving image data is sent from the buffer 18B to the buffer output unit 18C. The buffer output unit 18C performs packetization in order to send the moving image data from the buffer 18B to the network.

  Then, the transmission unit of the network transmitting / receiving unit 17 transmits the moving image data corresponding to the moving image transmission request TR to the client device via the IP network 5.

  Since the streaming transmission is a real-time process, the system controller 20 controls the buffer input unit 18A to read the moving image data into the buffer 18B at regular intervals so that the buffer 18B does not underflow. Similarly, the system controller 20 controls the buffer output unit 18C to send moving image data to the network at regular intervals so that moving image transmission to the client device is not delayed. That is, the system controller 20, the buffer device 18, and the network transmission / reception unit 17 function as a transmission unit that transmits moving image data via a network.

  Therefore, if the network load increases and packet transmission from the buffer output unit 18C is delayed, the occupation amount of the buffer 18B increases. In the worst case, the buffer 18B overflows.

  In other words, it is possible to determine the network load from the occupied amount of the buffer 18B. In the present embodiment, the system controller 20 is provided with a load detection unit 21. For example, the load detection unit 21 detects a network load from the occupation amount of the buffer 18B. When the load detection unit 21 detects that the network load has increased to a predetermined value or more, it stops normal video transmission and transmits a digest scene composed of video and audio based on the digest scene information described above. It is something to do.

  Various methods for the load detection unit 21 to detect the load on the network are conceivable. In addition to the above method, for example, it is conceivable to detect the load on the network based on the transmission bit rate, the rate of change thereof, the transmission elapsed time, and the like.

  The transfer of the stored digest scene data (scene data pieces) stored in the digest scene storage unit 16 is the same as the moving image data stored in the moving image storage unit 14 described above. That is, the digest scene data retrieved and read from the digest scene storage unit 16 under the control of the system controller 20 is stored in the buffer 18B via the interface circuit 12. The data is sent from the buffer 18B to the network under the control of the system controller 20.

  Next, with reference to the flowchart of FIG. 3 and FIG. 4, the moving image transmission control according to the network load will be described in detail.

  First, under the control of the system controller 20, moving image data corresponding to the received moving image transmission request is stored in the buffer 18B. The moving image data is sent to the network, and transmission to the client device 9 is started (step S11).

  Next, the load detection unit 21 detects a network load (NL). Then, it is determined whether or not the network load (NL) exceeds the first level E1 (step S12). If it is determined that the network load NL does not exceed the first level E1, it is determined that the network load is at a low level as shown in FIG. (Step S13).

  If it is determined in step S12 that the network load NL exceeds the first level E1, it is determined that the network load has reached a level that hinders transmission of moving image data. Next, it is determined whether or not the network load NL exceeds the second level E2 (step S14). When it is determined that the network load NL does not exceed the second level E2 (MODE-1), it is read from the digest scene storage unit 16 instead of transmitting the moving image data as shown in FIG. Digest scene data is transmitted (step S15).

  In this case, switching to digest scene data transmission (MODE-1) is performed, but digest scene data is transmitted based on the digest scene information.

  In the following, the transmission priority is set as the digest scene information, and two levels of the transmission priority “high” (priority A) and the transmission priority “low” (priority B) are set. explain.

  That is, in the transmission of the digest scene data (MODE-1), the digest scene data (scene data pieces) having both the transmission priority “high” (priority A) and “low” (priority B) are included. Sent. Therefore, the transmission interval is short, and more digest scene data is transmitted than in the case described later (MODE-2).

  Furthermore, when it is determined in step S14 that the network load NL exceeds the second level E2, it is further determined whether or not the network load NL exceeds the third level E3 (step S16).

  If it is determined in step S16 that the network load NL does not exceed the third level E3, digest scene data transmission (MODE-2) is executed as shown in FIG. 4 (step S16). ). In the digest scene data transmission (MODE-2), only digest scene data (scene data piece) having a transmission priority of “high” (priority A) is selected and transmitted. That is, as the network load NL increases, the digest scene data transmission interval becomes longer and the transmission data amount also becomes smaller.

  If it is determined in step S16 that the network load NL exceeds the third level E3, all transmissions including the transmission of digest scene data are stopped (step S18).

  As described above, in steps S13, S15, and S17, the transmission mode is switched to normal transmission, MODE-1 transmission, and MODE-2 transmission, respectively, or transmission is stopped in step S18. Then, the load detection unit 21 determines whether or not a predetermined load detection period has arrived, that is, whether or not it is the detection timing of the network load NL (step S19).

  If it is determined in step S19 that the network load is detected, the process proceeds to step S12, where the network load NL is detected, and steps S12 to S19 described above are repeated.

  If it is determined in step S19 that the detection timing is not network load, it is determined whether or not there is a transmission end request from the client device 9 (step S20). If there is a transmission end request, the transmission is ended (step S21), and this control routine is ended.

  In step S20, when it is determined that there is no transmission end request from the client device 9, the process proceeds to step S19, and it is determined whether or not it is network load detection timing.

  That is, from the start of transmission (step S11) to the end of transmission (step S21), a transmission mode (usually MODE-1, MODE-2, stop) corresponding to the load NL is selected at every detection interval of the network load NL. The

  In the above-described embodiment, the case where the mode for transmitting digest scene data is two-stage (MODE-1, MODE-2) has been described, but the present invention is not limited to this. For example, the transmission priority of digest scene data can be set in p stages (p is an integer, p> 2), and the transmission mode can be performed in multiple stages of MODE-1 to MODE-p. That is, according to the detected network load NL and the digest scene information (transmission priority), the digest scene data (scene data fragment) is selectively transmitted to adjust the transmission mode in multiple stages. You may comprise.

  As described above in detail, the network load is detected, and the moving image data or the digest scene data is transmitted based on the network load. Even when digest scene data is transmitted, the transmission amount of the digest scene data piece is changed according to the network load. The digest scene data piece to be transmitted is determined based on the digest scene information (priority) of each digest scene data piece.

  Therefore, the amount of data sent to the network can be adjusted according to the amount of network load, and even when the amount of data is reduced, a high-priority digest important for understanding the story of video data (content) Scene data can be transmitted with priority. Therefore, it is possible to provide a streaming video transmission apparatus that does not cause or minimizes inconveniences of reproduced video and audio during user viewing, such as video freeze and sound interruption.

2 is a block diagram showing a moving picture transmitting apparatus and a client device connected to an IP network 5. FIG. 1 is a block diagram schematically illustrating a configuration of a moving image transmission device in Embodiment 1. FIG. It is a flowchart shown about the procedure of the moving image transmission control according to network load. It is a figure which shows the moving image transmission mode according to network load.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Movie transmission apparatus 11 Recording / reproducing part 14 Movie storage part 15 Digest scene extraction part 16 Digest scene storage part 17 Network transmission / reception part 18 Buffer apparatus 18A Buffer input part 18B Buffer output part 20 System controller 21 Load detection part

Claims (5)

A moving image data storage unit for storing one or more moving image data pieces; and a transmission / reception unit for transmitting and receiving data via a network. The moving image data pieces are sent to the network in response to a transmission request received via the network. A video transmission device for transmitting via
A scene data extraction unit for extracting a scene data piece for the video data piece;
A scene data storage unit for storing the scene data pieces;
A load detector for detecting a load on the network;
A priority determination unit for determining the transmission priority of the scene data pieces;
A moving picture transmission apparatus comprising: a transmission unit configured to transmit the scene data pieces via the network according to a load on the network and the transmission priority.   The transmission unit includes a buffer unit that temporarily stores a moving image data piece to be transmitted through the network, and the load detection unit detects a load on the network based on an occupation amount of the buffer unit. The moving picture transmitting apparatus according to claim 1.   The moving image transmission apparatus according to claim 1, wherein the transmission unit adjusts the transmission amount of the scene data piece according to a load on the network.   The moving image transmission apparatus according to claim 1, wherein the transmission unit selectively transmits the scene data piece according to a load on the network and a transmission priority of the scene data piece.   2. The moving picture transmission apparatus according to claim 1, wherein the scene data piece is data accompanied with audio and video.

Images