WO2007116839A1 - Dispositif de reception video, systeme de distribution video et procede de reception video - Google Patents

Dispositif de reception video, systeme de distribution video et procede de reception video Download PDF

Info

Publication number
WO2007116839A1
WO2007116839A1 PCT/JP2007/057244 JP2007057244W WO2007116839A1 WO 2007116839 A1 WO2007116839 A1 WO 2007116839A1 JP 2007057244 W JP2007057244 W JP 2007057244W WO 2007116839 A1 WO2007116839 A1 WO 2007116839A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
delay
unit
digital signals
signal
Prior art date
Application number
PCT/JP2007/057244
Other languages
English (en)
Japanese (ja)
Inventor
Yoichi Nakamura
Eimei Nanma
Koji Maekawa
Original Assignee
Matsushita Electric Industrial Co., Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Matsushita Electric Industrial Co., Ltd. filed Critical Matsushita Electric Industrial Co., Ltd.
Publication of WO2007116839A1 publication Critical patent/WO2007116839A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/16—Analogue secrecy systems; Analogue subscription systems
    • H04N7/173—Analogue secrecy systems; Analogue subscription systems with two-way working, e.g. subscriber sending a programme selection signal
    • H04N7/17309—Transmission or handling of upstream communications
    • H04N7/17318—Direct or substantially direct transmission and handling of requests
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/426—Internal components of the client ; Characteristics thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4334—Recording operations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
    • H04N21/4621—Controlling the complexity of the content stream or additional data, e.g. lowering the resolution or bit-rate of the video stream for a mobile client with a small screen
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/64—Addressing
    • H04N21/6405—Multicasting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643—Communication protocols
    • H04N21/64322—IP

Definitions

  • Video receiving apparatus video distribution system, and video receiving method
  • the present invention relates to a video that can be used when a digital signal including video is simultaneously distributed to a plurality of receiving devices via a predetermined network, and processing such as playback and recording of video is performed by each receiving device.
  • the present invention relates to a receiving device, a video distribution system, and a video receiving method. Background art
  • each receiving apparatus can process the distributed digital signal and reproduce the video or the like in real time.
  • a plurality of independent videos may be simultaneously delivered to the same receiving device, and a plurality of independent videos may be displayed in real time on the screen of one receiving device.
  • a plurality of independent videos may be simultaneously delivered to the same receiving device, and a plurality of independent videos may be displayed in real time on the screen of one receiving device.
  • Patent Document 1 Japanese Patent Laid-Open No. 2002-351438
  • each server that is a distribution source includes a plurality of receiving devices that are distribution destinations. Since the upper limit of the data transfer rate at the time of transmission must be determined according to the request of a specific receiving device with the lowest capability, a low frame rate is specified by an instruction from one receiving device with low capability.
  • digital signals can be received only at a low data transfer rate, and high-quality images (for example, images with a high frame rate) cannot be reproduced. There was a situation.
  • the present invention has been made in view of the above circumstances, and even when a plurality of independent videos are simultaneously distributed to a plurality of receiving devices having different capabilities, each receiving device reproduces the video. It is an object of the present invention to provide a video receiving apparatus, a video distribution system, and a video receiving method capable of preventing a possible video quality from being deteriorated.
  • a video receiving apparatus is a receiving unit that sequentially receives the digital signals sequentially distributed to a plurality of receiving apparatuses with a plurality of digital signals including video.
  • a signal processing execution unit that performs signal processing on the plurality of digital signals, a delay detection unit that detects presence or absence of a delay when the signal processing is performed, and the delay detection unit detects the delay.
  • a processing content changing unit that performs thinning to exclude a part of information included in the plurality of digital signals is excluded from the signal processing target power.
  • the video information is thinned out for the digital signal to be processed, Since the amount of information to be processed is reduced, the quality of the output video is reduced, but there is a margin in the capacity of the processing unit. In this case, there is no effect on the delivery speed of the digital signal in the signal transmission path from each server to each receiving station. Therefore, the deterioration of the video quality actually occurs because of the processing delay. It is limited to the receiving station only and does not affect other receiving stations (client terminals such as other PCs or recording devices). Therefore, even when various receiving stations with different processing capabilities coexist, a high-quality video can always be reproduced at a receiving station with high processing capability.
  • the plurality of digital signals include time information based on at least one of video generation time and distribution time, and the delay detection unit performs the signal processing.
  • the delay detection unit performs the signal processing.
  • the presence or absence of delay is identified by comparing the change in the time information of the digital signal to be processed with the change in the current time, the presence or absence of the occurrence of delay is individually determined for each digital signal. Can be identified. Therefore, the video to be processed by the processing content changing means can be limited to only digital signals that are actually delayed.
  • the delay detection unit monitors the CPU operation rate when the signal processing is performed, and the CPU operation rate exceeds a predetermined first threshold value. As a configuration to detect the occurrence of the delay! /
  • the operating rate (or usage rate) of a processing element (such as a CPU) is monitored, and the presence or absence of a delay is identified by comparing this operating rate with a threshold value.
  • the delay can be detected even if the information is not included.
  • the operating rate of a CPU or the like can be detected, for example, by examining the time during which a meaningless instruction is executed within a certain period of time (idling time) and the actual processing time. Occupancy rate is
  • the load is excessive and it is expected that processing will be delayed.
  • the averaged operating rate becomes approximately 90%. It can be considered that a delay occurs.
  • the processing content changing unit is connected to the delay detecting unit. After detecting the recording delay, when the CPU utilization rate falls below a second predetermined threshold value smaller than the first threshold value, the digital signal is used to improve the video quality. It is configured.
  • the processing unit (CPU or the like) of the video receiving device may perform various processes in addition to the processing related to the received digital signal, and the digital video that one video receiving device receives and reproduces simultaneously. Since the number of signals and the bit rate of the data to be distributed may be changed as necessary, the ratio between the processing capability and the size of the load in the processing unit of the video receiving device changes dynamically. Therefore, even when special control is not performed, the operation state related to the presence or absence of a delay dynamically changes due to environmental changes accompanying changes in time. This configuration automatically restores the contents of the changed processing if the processing capacity is sufficient after thinning the video due to the occurrence of a delay. You can stop and improve the quality of the output video.
  • the delay detection unit detects the time interval of the distribution and the distribution of the plurality of digital signals.
  • the thinning-out is preferentially performed on a digital signal having the highest distribution bit rate based on the average information amount of the digital signal at the time of distribution.
  • the delay detecting unit detects a low priority digital signal having a predetermined priority among the plurality of digital signals. According to the image of the signal, the above-mentioned configuration is preferentially performed.
  • the processing content changing unit performs the thinning for each of the plurality of digital signals when the delay detecting unit detects the delay.
  • the delay detecting unit detects the delay.
  • the processing content changing unit performs the thinning for each of the plurality of digital signals when the delay detecting unit detects the delay.
  • the video reception device of the present invention includes a plurality of display units that display video included in each digital signal, and the processing content changing unit performs the display for each of the plurality of digital signals.
  • the thinning-out is performed so that the effective bit rate based on the frame rate and the average information amount of the frame when the image is displayed is smaller than a predetermined bit rate upper limit value.
  • the effective bit rate of the video to be processed is reduced by thinning the video, and the interval I is set so that the effective bit rate is within the upper limit of the bit rate. Since the control is performed, the load of one digital signal on the control unit can be limited by the upper limit of the bit rate.
  • the processing content changing unit preferentially performs the thinning out with respect to the digital signal having the lowest display resolution of the video among the plurality of digital signals. It is set as the structure which performs.
  • the video reception device of the present invention includes a signal storage unit that stores the digital signal received by the reception unit, and the signal processing execution unit includes the digital signal and the signal storage unit. The signal processing is performed on the stored digital signal.
  • the processing content changing unit includes at least one of the data.
  • the thinning is performed by at least one of the frame unit, the line unit, the pixel unit, and the data structure layer unit.
  • the video distribution system of the present invention is a video distribution system having one or more distribution servers that sequentially distribute a plurality of digital signals including video and a plurality of video reception devices that sequentially receive the digital signals.
  • the video receiving apparatus includes: a signal processing execution unit that performs signal processing including display on each of the digital signals; and a delay detection unit that identifies presence or absence of a delay when the signal processing is performed.
  • a processing content changing unit that performs thinning to exclude a part of information of the digital signal from the signal processing target for at least one digital signal when the delay detecting unit detects the delay It is said.
  • the distribution server distributes the digital signal having time information based on at least one of the generation time or distribution time of the video, and
  • the delay detection unit recognizes that the delay occurs when the change in the time information of the digital signal on which the signal processing is performed is delayed compared to the change in the current time.
  • each receiving station can identify whether or not a delay has occurred by using this time information.
  • the video receiving method of the present invention includes a step of sequentially receiving one or more distribution power distribution digital signals that sequentially distribute a plurality of digital signals including video to a plurality of receiving stations; A step of performing signal processing including display on each of the digital signals; a delay detecting step of identifying presence or absence of a delay when the signal processing is performed; When the delay is detected in the delay detecting step, a bow is performed to exclude a part of the information included in the digital signal from the signal processing target by using at least one digital signal.
  • the method includes the steps of:
  • the present invention prevents deterioration in the quality of video that can be played back by each receiving device even when a plurality of independent videos are simultaneously delivered to a plurality of receiving devices having different capabilities. It is possible to provide a video reception device, a video distribution system, and a video reception method that can be performed.
  • the processing content is automatically changed in a direction in which the quality of the video is lowered for at least one digital signal. For example, digital signals to be processed! If the video information is thinned out, the amount of information to be processed per unit time is reduced, so that the quality of the output video is reduced, but there is a margin in the capacity of the processing unit, and problems can be avoided.
  • FIG. 1 is a block diagram of a video distribution system in an embodiment of the present invention.
  • FIG. 2 is an operation flow diagram showing main control contents regarding video display in the client terminal of the video distribution system in the first embodiment of the present invention.
  • FIG. 3 is an operational flowchart showing the contents of main control relating to video display in a client terminal of a video distribution system in a second embodiment of the present invention.
  • FIG. 4 In the client terminal of the video distribution system according to the third embodiment of the present invention. It is an operation
  • movement flowchart which shows the content of the main control regarding a video display.
  • FIG. 5 is an operational flowchart showing the contents of main control relating to video display in a client terminal of a video distribution system in a fourth embodiment of the present invention.
  • FIG. 1 is a block diagram of a video distribution system according to an embodiment of the present invention. This block diagram is common to the first to fourth embodiments.
  • FIG. 2 is an operation flowchart showing the main control contents related to video display in the client terminal 40 in the first embodiment of the present invention.
  • the network 30 includes a plurality of client terminals 40.
  • an IP (Internet Protocol) network such as a home LAN (Local Area Network) Internet can be assumed.
  • a device that can be connected to a network such as a personal computer (PC) may be assumed.
  • the number of client terminals 40 need not be limited to two as shown in FIG.
  • the network camera 20 is a device that distributes video data obtained by shooting video to an arbitrary destination via the network 30 in almost real time.
  • the network camera 20 includes a video input unit 21, a video code key unit 22, and a video distribution unit 23.
  • the video input unit 21 captures a subject continuously or periodically using a built-in camera, and generates video data of a moving image in which a plurality of image frames are arranged in time series.
  • the video encoding unit 22 encodes the video data of the moving image output from the video input unit 21 for compression.
  • the video distribution unit 23 distributes the video data encoded by the video encoding unit 22 to a predetermined destination via the network 30 in almost real time. For example, by using a multicast protocol, the video distribution unit 23 can simultaneously distribute the same video data to a plurality of destinations (for example, 40 (1), 40 (2)).
  • the recorder 10 distributes video to an arbitrary destination via the network 30 in the same manner as the network camera 20. However, since the recorder 10 does not have a built-in camera, it receives video signals from the cameras 14 (1) and 14 (2) connected to the outside of the recorder 10 and distributes the video.
  • the recorder 10 includes a video receiving unit 11, a video encoding unit 12, and a video distribution unit 13. [0047] Each camera 14 (14 (1), 14 (2), ... shoots the subject continuously or periodically to generate video data of a video in which multiple image frames are arranged in time series. The number of cameras 14 need not be limited to two as shown in Fig. 1.
  • the video receiver 11 of the recorder 10 is a real-time output from each of the 14 connected cameras.
  • the video data is received and temporarily stored to prepare for data distribution, etc.
  • the video encoding unit 12 encodes the video data received by the video receiving unit 11 independently for each video.
  • the distribution unit 13 distributes the video data encoded by the video encoding unit 12 to an arbitrary destination independently for each video, and the video distribution unit 13 uses, for example, a multicast protocol. Simultaneously send the same video data to multiple destinations (for example, 40 (1), 40 (2)) Deliver it to.
  • the client terminal 40 (1) includes a video reception unit 41, a video accumulation data base 42, and a video display control unit 43.
  • the video receiving unit 41 has an interface function for communicating with the network 30, and also performs processing for receiving video data distributed from the recorder 10 and the network camera 20 that are servers.
  • the video storage database 42 is a large-capacity storage device, and temporarily stores received video data so that the video data distributed from the recorder 10 and the network camera 20 can be played back later if necessary. Perform the process.
  • the video display control unit 43 plays back the video data distributed from the recorder 10 or the network camera 20 in real time, or plays back the past video data stored in the video storage database 42 when necessary. Display processing to do this.
  • the function of the video display control unit 43 can be configured by hardware of a dedicated electronic circuit, or a predetermined program prepared in advance by a microprocessor (not shown) on the client terminal 40. It can also be realized by executing (Application).
  • one video display control unit 43 separately processes a plurality of N pieces of independent video data (N is an arbitrary positive number) and displays windows in different areas on the screen.
  • the display video is combined so that a plurality of videos can be displayed respectively.
  • a plurality of control units or application programs independent of each other can be prepared in advance, and each control unit can be configured to independently perform only one video data display process.
  • the video display controller 43 includes a video composite key management unit 101, a video composite key control unit 102, N (N is an arbitrary positive number) video composite units 103, N (N is an arbitrary (Positive number) composite video memory 104 and video composition display unit 105.
  • the video composite key management unit 101 manages the input of a plurality of video data to be displayed simultaneously on the screen.
  • the input of the video composite key management unit 101 includes one or more videos distributed from the recorder 10, videos distributed from the network camera 20, and videos distributed in the past and stored in the video storage database 42. Etc. are entered.
  • the video composite key control unit 102 is used for managing the display position and display size on the screen and for actual processing of each of a plurality of video data input via the video composite management unit 101.
  • the video composite key unit 103 and the composite video memory 104 to be assigned are allocated.
  • Each video composite section 103 performs processing for generating image information for display (decoding, etc.) and thinning to reduce video quality for one input video data. Do. Implementation thinning is performed in frame units, line units, pixel units, or data structure layer units.
  • Each composite video memory 104 has one display image information generated by the video composite section 103. Hold information temporarily.
  • the video composition display unit 105 performs composition processing for combining the image information held in the plurality of composite video memories 104 and displaying the information as a plurality of independent images on a plurality of windows on one screen. .
  • a plurality of videos synthesized by the video composition display unit 105 are simultaneously displayed on the screen of the display 50.
  • the display 50 is connected to the client terminal 40 (1).
  • the client terminals 40 (1) and 40 (2) are examples of video receiving apparatuses.
  • the recorder 10 and the network camera 20 are examples of distribution servers.
  • the video receiving unit 41 is an example of a receiving unit.
  • the video composite key control unit 102 is an example of a signal processing execution unit.
  • Part of the video composite management unit 101 is an example of a delay detection unit.
  • the video composite unit 103 is an example of a processing content changing unit.
  • the upper limit of the distribution rate of the video data distributed due to the influence of the client terminal 40 is determined, and the quality of the displayed video cannot be improved. Also, when video distribution is performed, unless a distribution protocol such as multicast is adopted, traffic on the network 30 will increase significantly, causing problems.
  • the distribution rate when distributing video data on the network 30 is as follows. Control is made to cope with the occurrence of delay by changing the contents of signal processing inside each client terminal 40 without changing it. For specific signal processing, the amount of information to be processed varies depending on the presence or absence of a bow on the video.
  • time information is included in the video data transmitted from the recorder 10 or the network camera 20 as the server.
  • time information it may be, for example, the time at which the video for each image frame was taken, the time at which the video was encoded, or the time at which the video was distributed. It may also be information on the relative elapsed time from the shooting start time. The process shown in Fig. 2 is described below.
  • the video composite key management unit 101 monitors a change in time information included in video data to be processed (step S11).
  • the video composite key management unit 101 acquires information on the current time from the clock circuit card provided in the client terminal 40 and monitors the change in the current time (step S12).
  • the video composite key management unit 101 detects a difference between the change in the time information regarding the video detected in step S11 and the change in the current time detected in step S12 (step S13).
  • the video composite key management unit 101 identifies the presence / absence of delay by comparing the difference obtained in step S13 with a predetermined threshold (step S14). In other words, when there is no delay, the above difference is a very small value. If the amount of processing is excessive compared to the processing capacity of the micro processor in the client terminal 40, the image of each frame is processed within the required time. Since each image frame to be processed is delayed because it becomes impossible, the above difference becomes large. If multiple video data are to be processed at the same time, execute the processing of steps S11 to S14 for each video data and each video data! / Recognize whether a delay has occurred.
  • the video composite key control unit 102 determines the amount of bow I to perform thinning when performing composite processing based on the above difference.
  • the video composite section 103 determines the amount of information about the video data to be processed in which the occurrence of delay is detected. Perform decimation to reduce (Step SI 5).
  • the video composite section 103 is step S
  • the processed video data of 15 is temporarily stored in the video composite memory 104.
  • actual thinning-out processing for example, the following processing is assumed.
  • the number of pixels in each frame can be reduced.
  • the video composition display unit 105 acquires the video data temporarily stored from the video composite memory 104 for the video thinned out in step S15, and performs the processing necessary for display. (Step S16).
  • Step S15 the amount of video data per unit time to be processed by the microphone processor is reduced, so that the processing capacity is increased and the delay is eliminated.
  • the video composite key management unit 101 monitors the presence / absence of delay by performing the same processing as steps S11 to S14 (step S17). Then, the video composite management unit 101 determines whether or not the delay has been eliminated (step S18). If the delay is eliminated, the display process is continued as it is. If the delay has not been eliminated, the video composite control unit 102 performs the interval I when performing the interval I in step S16. The processing parameters are changed so as to increase the volume (step S19), and then the processing of steps S15 to S18 is performed again. By repeating such processes of steps S15 to S19, the thinning amount can be increased stepwise.
  • the process shown in FIG. 2 since the presence or absence of the occurrence of delay can be identified for each of the plurality of video data, it is possible to perform the thinning only for the video in which the delay actually occurred.
  • the presence or absence of thinning can be controlled independently for each video, for example, as a process corresponding to the video display control unit 43, a plurality of independent application programs are started and each application program is independent.
  • One movie It can also be configured to process image data.
  • a distribution server such as one or more recorders 10 and a network camera 20 that sequentially distribute a plurality of digital signals including video
  • the client terminal 40 includes a video composite control unit 102 that performs signal processing including display on each digital signal, and signal processing
  • the video composite key management unit 101 that detects the presence or absence of a delay when the video composite key is executed and the video composite key management unit 101 detects a delay
  • the information of the digital signal is stored for at least one digital signal.
  • a video composite section 103 that performs thinning to exclude a part of the signal processing target power. Even when delivering simultaneously to client terminal 40, it is possible that each client terminal 40 is prevented from lowering the quality of the available playback video.
  • a video distribution system 200 according to the second embodiment of the present invention will be described.
  • FIG. 3 is an operation flowchart showing the main control contents regarding the video display in the client terminal 40 of the video distribution system 200 in the second embodiment. Processing different from the first embodiment will be described below.
  • FIG. 3 shows an outline of the contents of the control executed by the video display control unit 43 inside each client terminal 40.
  • the time information is not included in the video data transmitted by the recorder 10 or the network camera 20 as the server. Therefore, the processing relating to the detection of delay is greatly different from that of the first embodiment.
  • the usage rate (or operation) of the microprocessor (CPU) that executes the processing of the video display control unit 43 is determined by the part (not shown) that monitors the CPU usage rate of the client terminal 40 (1).
  • Rate) Px is calculated periodically (step S21).
  • the microprocessor is executing various instruction codes continuously. When there is no valid process to be processed, the microprocessor enters an idle state and executes only invalid instruction codes. And process When a request for an effective process to appear appears, the instruction codes of the prepared program are executed sequentially. Therefore, if the ratio of the idle period in the unit time is high, the usage rate Px becomes small, which means that there is a large margin in the processing capacity of the microprocessor.
  • the microphone processor itself can detect the usage rate Px by periodically monitoring the margin of processing capacity.
  • the video composite key management unit 101 compares the latest usage rate Px value detected in step S21 with a predetermined threshold value P1, and identifies the presence or absence of delay (step S22). .
  • a delay occurs when the usage rate Px approaches 100%, so it is assumed that a value of about 90% is used as the threshold value P1, for example.
  • the video composite key control unit 102 sets the thinning amount based on the CPU usage rate Px, and the video composite key unit 103 Among the plurality of target video data, thinning is performed preferentially for specific video data that meets a predetermined condition (step S23).
  • the video composite section 103 temporarily stores the video data after the processing of step S23 in the video composite memory 104.
  • conditions for specifying (selecting) priority video data for example, the following conditions are assumed.
  • the video data with the highest bit rate or frame rate at the time of distribution is preferentially selected.
  • the bit rate at the time of distribution can be calculated for each video based on the distribution time interval and the average amount of information per frame.
  • a priority is assigned to each of a plurality of areas on the screen prepared for displaying a plurality of videos, and the video data assigned to the lowest priority area is given priority.
  • the video data assigned to the region with the lowest display resolution is preferentially selected from the plurality of regions on the screen prepared for displaying a plurality of videos.
  • the video composition display unit 105 performs a process for displaying the video that has been thinned out in step S23 (step S24). For video that is not thinned out, the input video data is processed as it is.
  • step S21 the CPU usage rate Px is periodically calculated by the part monitoring the CPU usage rate (step S25).
  • step S23 Since the amount of video information to be processed is further reduced, the usage rate Px detected in step S25 is expected to be lower than in step S21.
  • the video composite key management unit 101 compares the usage rate Px detected in step S25 with a predetermined threshold value P2 to identify whether or not the delay has been eliminated (step S26). .
  • the video composition management unit 101 determines that the delay has been canceled if the usage rate Px is less than the threshold value P2, and determines that the delay has not been resolved if the usage rate Px is equal to or greater than the threshold value P2. To do.
  • the threshold value P2 is smaller than the threshold value P1. If the delay has not yet been resolved, the video composite key control unit 102 adjusts the parameter so as to increase the amount of thinning performed in step S23 (step S27), and then the processing in steps S23 to S26 is performed again. Is called. Each time the processes of steps S23 to S27 are repeated, the thinning amount increases stepwise.
  • the video display control unit 43 periodically calculates the CPU usage rate Px as in step S21. In order to check whether the state is stable, a plurality of usage rates Px are collected and averaged to obtain an average value Py (step S28).
  • the video composite key management unit 101 determines in advance the average value Py of the usage rate obtained in step S28 in order to check whether or not the processing capacity of the microprocessor has been stably secured. Compared with the threshold value P3 (step S29). For example, if the number of images to be displayed on the screen at the same time decreases, the amount of information to be processed by the microprocessor decreases, so the processing margin of the microprocessor increases and (Py ⁇ P3) become. The threshold value P3 is smaller than the threshold value P2. If there is room, proceed to the next step S30.
  • the video composite key control unit 102 sets the thinning-out amount based on the above average value Py of the CPU usage rate, and the video composite key control unit 103 performs the thinning-out in step S23. Decrease the amount of gap I for the assigned image by a certain amount (step S30). When the amount of bow I reaches 0 after the reduction (step S31), the process returns to step S21, and the CPU usage rate Px is periodically calculated again. If the thinning-out amount is not 0, steps S28 to S31 are performed again.
  • the video composite management unit 101 monitors the CPU operating rate when performing signal processing, and the CPU operating rate is predicted. A configuration that recognizes that there is a delay when the specified first threshold is exceeded. Thus, even if the time information is included in the distributed video, the occurrence of delay can be detected.
  • a video distribution system 300 according to the third embodiment of the present invention will be described. Since the configuration of the video distribution system 300 is the same as that in FIG. 1, the same reference numerals are used for the same parts, and the description and illustration of the configuration are omitted.
  • FIG. 4 is an operation flowchart showing the main control contents regarding the video display in the client terminal 40 of the video distribution system 300 in the third embodiment. In the present embodiment, only processing different from FIG. 3 will be described. FIG. 4 differs from FIG. 3 only in steps S23B, S27B, and S30B.
  • steps S21 to S22 are performed.
  • the video composite management unit 101 detects the occurrence of delay in step S22
  • the video composite control unit 102 sets the thinning amount based on the CPU usage rate Px
  • the video composite control unit 103 sets a plurality of processing targets. For each of the video data, perform a bow. The amount of space I is determined so that all the video data are evenly spaced (step S23B).
  • step S23B to step S26 is performed. If the video composite management unit 101 determines that the delay has been eliminated in step S26, the video composite control unit 102 increases the thinning amount parameter equally for all the video data to be processed (step S27B). Thereafter, the processing from step S23B to step S26 is performed again.
  • step S29 if the video composite key management unit 101 determines that there is room for processing by the microprocessor or the like, the video composite key control unit 102 reduces the thinning amount parameter equally for all video data to be processed ( Step S30B). Then, the process of step S31 is performed.
  • the video composite management unit 101 detects a plurality of digital signals.
  • the thinning amount that does not require selection of the video data to be thinned is also thinned equally for the entire video data.
  • the thinning amount can be calculated.
  • a video distribution system 400 according to the fourth embodiment of the present invention will be described.
  • FIG. 5 is an operation flow diagram showing the main control contents regarding the video display in the client terminal 40 of the video distribution system 400 in the fourth embodiment. In the present embodiment, only processing different from FIG. 3 will be described. FIG. 5 differs from FIG. 3 only in steps S41 to S44.
  • step S41 the effective bit rate Rx for each of the plurality of video data to be processed.
  • the effective bit rate Rx should be determined based on the frame rate for the video data to be displayed (or the data after the inter-bow I in the case of inter-bow I) and the average information amount of each frame Can do.
  • the video composite section 103 performs video thinning for each of the plurality of video data to be processed (step S42).
  • the bit rate upper limit Rmax is assigned in advance for each video to be displayed or each area on the screen on which the video is displayed. Determined based on That is, the video composite key control unit 102 determines the thinning amount so that the effective bit rate Rx is controlled within the bit rate upper limit value Rmax.
  • the video composite key control unit 102 recalculates the effective bit rate Rx for each video (step S43).
  • the video composite key management unit 101 compares the effective bit rate Rx obtained in step S43 and the bit rate upper limit value Rmax for each video (step S44). If the video composite key management unit 101 determines that the effective bit rate Rx is equal to or greater than the bit rate upper limit value Rmax, the processes of steps S42 to S44 are performed again. When the video composite key management unit 101 determines that the effective bit rate Rx is less than the bit rate upper limit value R max, the processing from step S24 to step S31 is performed. [0106] According to such a video distribution system 400 in the fourth embodiment of the present invention, it has a plurality of display units that display the video included in each digital signal, and the video composite unit 103 includes a plurality of display units.
  • thinning-out control can be performed independently for each video or for each display area. Therefore, when the distribution interval of each video data fluctuates or between multiple video data Even if there are variations in the control, stable control can be implemented. For example, even if the distribution interval fluctuates in one of multiple video data, stable operation is achieved because the amount of bow and the display status of other video are not affected. .
  • the present invention is capable of reproducing each receiving device even when a plurality of independent videos are simultaneously delivered to a plurality of receiving devices having different capabilities using a protocol such as multicast. This is useful for video receivers and video distribution systems that can prevent the video quality from degrading.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

Lorsque dans un dispositif de réception vidéo un processus de réception/reproduction d'un flux de données vidéo, qui est distribué en multidiffusion également à un autre dispositif de réception vidéo, ne peut être complété en un temps prédéterminé et la reproduction vidéo est retardée, la vidéo est allongée et reproduite.
PCT/JP2007/057244 2006-03-31 2007-03-30 Dispositif de reception video, systeme de distribution video et procede de reception video WO2007116839A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2006100411A JP2007274593A (ja) 2006-03-31 2006-03-31 映像受信装置及び映像配信システム並びに映像受信方法
JP2006-100411 2006-03-31

Publications (1)

Publication Number Publication Date
WO2007116839A1 true WO2007116839A1 (fr) 2007-10-18

Family

ID=38581132

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2007/057244 WO2007116839A1 (fr) 2006-03-31 2007-03-30 Dispositif de reception video, systeme de distribution video et procede de reception video

Country Status (2)

Country Link
JP (1) JP2007274593A (fr)
WO (1) WO2007116839A1 (fr)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6364838B2 (ja) * 2014-03-14 2018-08-01 日本電気株式会社 映像処理装置および映像処理方法
JP6604719B2 (ja) * 2014-11-25 2019-11-13 シャープ株式会社 受信装置、映像表示方法、及びプログラム

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06324662A (ja) * 1993-03-16 1994-11-25 Hitachi Ltd 映像表示制御方法、映像表示処理システム
JPH08163556A (ja) * 1994-11-30 1996-06-21 Canon Inc 映像通信装置および映像通信システム
JPH11177953A (ja) * 1997-12-12 1999-07-02 Fuji Xerox Co Ltd 会議端末装置
JPH11234684A (ja) * 1998-02-16 1999-08-27 Fuji Xerox Co Ltd 画像処理装置および画像通信システム
JPH11327522A (ja) * 1998-05-15 1999-11-26 Mitsubishi Electric Corp マルチディスプレイビデオ表示装置
JP2002532998A (ja) * 1998-12-11 2002-10-02 株式会社日立製作所 限定されたレンダリングリソースを用いて多重画像をレンダリングする方法及び装置

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06324662A (ja) * 1993-03-16 1994-11-25 Hitachi Ltd 映像表示制御方法、映像表示処理システム
JPH08163556A (ja) * 1994-11-30 1996-06-21 Canon Inc 映像通信装置および映像通信システム
JPH11177953A (ja) * 1997-12-12 1999-07-02 Fuji Xerox Co Ltd 会議端末装置
JPH11234684A (ja) * 1998-02-16 1999-08-27 Fuji Xerox Co Ltd 画像処理装置および画像通信システム
JPH11327522A (ja) * 1998-05-15 1999-11-26 Mitsubishi Electric Corp マルチディスプレイビデオ表示装置
JP2002532998A (ja) * 1998-12-11 2002-10-02 株式会社日立製作所 限定されたレンダリングリソースを用いて多重画像をレンダリングする方法及び装置

Also Published As

Publication number Publication date
JP2007274593A (ja) 2007-10-18

Similar Documents

Publication Publication Date Title
US10701370B2 (en) System and method for automatic encoder adjustment based on transport data
JP3801984B2 (ja) 帯域幅スケーラを含むマルチキャスト伝送システム
US7984179B1 (en) Adaptive media transport management for continuous media stream over LAN/WAN environment
US7580612B2 (en) Digital broadcast sending apparatus, receiving apparatus and digital broadcast system
US8630306B2 (en) Fast channel change apparatus and method for IPTV
EP2129126A1 (fr) Appareil de transmission, procédé de réception, et appareil de réception
US8089514B2 (en) Moving image communication device, moving image communication system and semiconductor integrated circuit used for communication of moving image
JP5043096B2 (ja) チャネル変更方法及びデジタル・ビデオ装置
US8254441B2 (en) Video streaming based upon wireless quality
US20070279683A1 (en) Communication Apparatus, Communication Method, Communication Transmission and Reception Apparatus, Communication Transmission and Reception Method, and Program
CA2451956A1 (fr) Commutation de flux video
US20060048193A1 (en) I-Picture insertion on request
US6992692B2 (en) System and method for providing video quality improvement
US20070127437A1 (en) Medium signal transmission method, reception method, transmission/reception method, and device
KR20140126372A (ko) 데이터, 멀티미디어 및 비디오 전송 갱신 시스템
JP2007325109A (ja) 配信サーバ、ネットワークカメラ、配信方法及びプログラム
EP2649794B1 (fr) Procédé et appareil pour gérer la distribution de contenu sur plusieurs dispositifs terminaux dans un système de médias collaboratifs
WO2003084225A1 (fr) Dispositif de liaison video, systeme de distribution video et procede de liaison video
WO2007116839A1 (fr) Dispositif de reception video, systeme de distribution video et procede de reception video
WO2004080077A1 (fr) Dispositif et procede de gestion de transmissions, support d'enregistrement et programme
US9363574B1 (en) Video throttling based on individual client delay
JP3259691B2 (ja) マルチキャストシステム、及び受信装置
JP5213130B2 (ja) データ配信システム、切替装置及びデータ配信方法
US20230034162A1 (en) Transmission apparatus and transmission method
JP2014103534A (ja) 画像伝送装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 07740680

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 07740680

Country of ref document: EP

Kind code of ref document: A1