WO2009122925A1 - Dynamic image conversion device, dynamic image delivery system, method for converting dynamic image and program - Google Patents

Dynamic image conversion device, dynamic image delivery system, method for converting dynamic image and program Download PDF

Info

Publication number
WO2009122925A1
WO2009122925A1 PCT/JP2009/055420 JP2009055420W WO2009122925A1 WO 2009122925 A1 WO2009122925 A1 WO 2009122925A1 JP 2009055420 W JP2009055420 W JP 2009055420W WO 2009122925 A1 WO2009122925 A1 WO 2009122925A1
Authority
WO
WIPO (PCT)
Prior art keywords
moving image
encoded data
operation signal
frame
request
Prior art date
Application number
PCT/JP2009/055420
Other languages
French (fr)
Japanese (ja)
Inventor
一輝 渡邉
一範 小澤
Original Assignee
日本電気株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 日本電気株式会社 filed Critical 日本電気株式会社
Priority to JP2010505591A priority Critical patent/JP5472094B2/en
Publication of WO2009122925A1 publication Critical patent/WO2009122925A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/78—Television signal recording using magnetic recording
    • H04N5/782—Television signal recording using magnetic recording on tape
    • H04N5/783—Adaptations for reproducing at a rate different from the recording rate
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/40—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream

Definitions

  • the present invention relates to a moving image conversion technique, and relates to a moving image conversion apparatus and a moving image distribution system for converting and distributing encoded data when a coded moving image compression-encoded bitstream is fast-forwarded and rewinded on a terminal side.
  • the present invention relates to a moving image conversion method and program.
  • ITU-T recommendation H.264 has been proposed as a moving image compression encoding method for efficiently transmitting moving image signals at a low bit rate.
  • H.H. MPEG-4 that is internationally standardized by H.263 or ISO / IEC is known.
  • H.264 has been internationally standardized by ITU-T and ISO / IEC.
  • H.264 / MPEG-4 AVC is attracting attention as a method that can transmit moving image signals more efficiently than the above-described moving image compression encoding method.
  • Video compression encoding methods There are two types of video compression encoding methods: intra prediction that encodes using only image data of the current frame, and inter prediction that encodes images of past and future frames.
  • DCT Discrete Cosine Transform
  • the first problem is that moving picture signals may be played back at intervals in the terminal.
  • the terminal has a large memory to temporarily buffer the data. It is necessary.
  • the reason is that in order to reproduce the video signal decoded by the terminal at intervals, it is necessary to store all the encoded data distributed or the video signal obtained by decoding all the encoded data. Because.
  • the second problem is that when the terminal reproduces the encoded data distributed via the network by fast-forwarding or rewinding, fast-forwarding or rewinding reproduction may not be performed smoothly.
  • the reason for this is that the current encoded data distribution technology needs to receive encoded data other than the frame to be displayed by fast-forward and rewind playback, so the amount of received data increases and it takes time to transmit data. It is.
  • the third problem is that when only a specific frame type is extracted, the speed of fast forward and rewind playback cannot be controlled. The reason is that the frame type interval used in fast forward and rewind playback is determined at the time of compression and cannot be adjusted during playback.
  • the fourth problem is that when only a specific frame type is extracted and decoded, the reproduced video may be disturbed.
  • the reason is that when only a specific frame type is extracted and decoded, the data referred to at the time of encoding may not exist in the extracted data, and thus inconsistency occurs at the time of decoding.
  • Patent Document 1 discloses a technique for extracting and distributing a necessary frame of moving image data by a user designation in a system for distributing moving image data from a distribution server connected to a network to a terminal.
  • Patent Document 2 discloses a configuration of a storage format conversion unit used at the time of moving image data jumping, skip reading reproduction, and reproduction from fast forward to normal.
  • Patent Document 1 Although only a part of moving image data on the distribution server can be distributed and the amount of data received by the terminal can be reduced, the user requests fast forward or rewind reproduction. There is no clear way to reduce the amount of data delivered by. Therefore, when fast forward or rewind playback is requested, all of the moving image data corresponding to this is distributed, and there is a problem that reduction of the amount of data to be distributed and smooth playback cannot be expected.
  • An object of the present invention is to provide a moving image conversion apparatus, a moving image distribution system, a moving image conversion method, and a program that do not require a large memory in a terminal when encoded data is distributed via a network. is there.
  • Another object of the present invention is to provide a moving image conversion apparatus, a moving image distribution system, a moving image conversion method, and a program that do not require the terminal to receive encoded data that is not required for fast forward and rewind reproduction. is there.
  • Another object of the present invention is to provide a moving image conversion device, a moving image distribution system, and a moving image that can perform fast forward and rewind reproduction regardless of the frame type of the encoded data when the terminal performs fast forward and rewind reproduction.
  • An image conversion method and program are provided.
  • Another object of the present invention is to provide a moving image conversion apparatus, a moving image distribution system, a moving image conversion method, and a program for improving the image quality of a fast-forwarding and rewinding moving image signal.
  • the moving image conversion apparatus is configured to extract encoded data of a necessary frame from encoded data of a received moving image in accordance with a request for an operation signal, and to transmit encoded data of the extracted frame to a terminal including.
  • the moving image conversion method includes a step of extracting encoded data of a necessary frame from encoded data of a received moving image according to a request for an operation signal, and a step of transmitting the encoded data of the extracted frame to a terminal including.
  • the moving image conversion program is a method for extracting encoded data of a necessary frame from encoded data of a received moving image according to a request for an operation signal to a computer, and extracting the encoded data of the extracted frame to a terminal. Execute the process to send.
  • the first effect is that the terminal does not need to provide a large memory when the encoded data is distributed via the network.
  • the second effect is that the terminal does not have to receive encoded data which is not necessary for fast forward and rewind reproduction.
  • the third effect is that when the terminal performs fast forward and rewind playback, fast forward and rewind playback can be performed without depending on the frame type of the encoded data.
  • the fourth effect is that it is possible to improve the image quality of the moving image signal for fast forward and rewind reproduction.
  • FIG. 5 is a block diagram illustrating a detailed configuration of the transcoder in FIG. 4. It is the flowchart which showed operation
  • FIG. 1 is a block diagram showing a detailed configuration in a moving image distribution system.
  • the moving image distribution system 100 includes a distribution server 101, a moving image conversion apparatus 102, and a terminal 103.
  • the distribution server 101 transmits the encoded data 105 to the moving image conversion apparatus 102 in accordance with the encoded data acquisition request 104 from the moving image conversion apparatus 102. At this time, the distribution server 101 has a function of transmitting encoded data to be transmitted in ascending or descending order in units of frames.
  • the encoded data acquisition request 104 includes encoded data acquisition order information necessary for selecting encoded data and performing operations such as playback, stop, pause, fast forward, and rewind playback.
  • the encoded data is requested to be sent in the order of the frame, and when performing rewind playback, the encoded data is requested to be sent in reverse order from the current frame.
  • the encoded data 105 includes parameter information (capability information) obtained when the moving image signal is compressed, in addition to the encoded data obtained by compressing the moving image signal.
  • capability information for example, DCI (Decoder Configuration Information), SPS (Sequence Parameter Set), PPS (Picture Parameter Set).
  • the moving image conversion apparatus 102 includes a first transmission / reception unit 108, a command analysis unit 109, a transcoder 110, and a second transmission / reception unit 111.
  • the first transmission / reception unit 108 receives the encoded data acquisition request 104 generated by the instruction analysis unit 109 and transmits it to the distribution server 101. Also, the encoded data 105 is received from the distribution server 101 and transmitted to the transcoder 110.
  • the command analysis unit 109 analyzes the operation signal 115 received from the second transmission / reception unit 111 and transmits the encoded data acquisition request 112 to the first transmission / reception unit 108 based on the analysis result. Further, the instruction analysis unit 109 transmits an encoded data conversion request 114 to the transcoder 110 based on the result of analyzing the operation signal 115.
  • the encoded data conversion request 114 sends the encoded data 113 received from the first transmission / reception unit 108 to the transcoder 110 at a fixed frame interval based on the fast forward or rewind playback speed requested by the operation signal 115. Request to extract by frame with a gap.
  • the transcoder 110 receives the encoded data 113 from the first transmission / reception unit 108, converts the received encoded data based on the content of the encoded data conversion request 114 from the instruction analysis unit 109, and converts the encoded data into the code It transmits to the 2nd transmission / reception part 111 as the quantization data 116.
  • FIG. A specific configuration of the transcoder 110 will be described later.
  • the second transmission / reception unit 111 receives the operation signal 106 transmitted from the terminal 103 and transmits it to the command analysis unit 109. Also, the encoded data 116 from the transcoder 110 is transmitted to the terminal 103 as the encoded data 107.
  • the operation signal 106 includes selection of encoded data, operation information for playback, stop, pause, fast forward and rewind playback, and speed information for fast forward and rewind playback.
  • the terminal 103 is a terminal where a user reproduces a moving image in a desired method, and the operation signal 106 is transmitted to the moving image conversion apparatus 102 in order to reproduce, stop, pause, fast forward, and rewind the desired encoded data. Send to.
  • the encoded data received from the moving image conversion apparatus 102 is decoded and displayed.
  • the moving image conversion apparatus 102 in the present embodiment may be in the distribution server 101 or may be installed in another place on the network.
  • FIG. 2 is a block diagram showing a detailed configuration of the transcoder 110 of FIG.
  • the transcoder 110 includes a reception buffer 201, an analysis unit 202, and a transmission buffer 203.
  • the reception buffer 201 transmits the encoded data 113 received from the first transmission / reception unit 108 to the analysis unit 202.
  • the analysis unit 202 Based on the encoded data conversion request 114 received from the instruction analysis unit 109, the analysis unit 202 extracts the encoded data 204 received from the reception buffer 201 in units of frames with a certain frame interval therebetween, and performs encoding.
  • the data 205 is transmitted to the transmission buffer 203.
  • the transmission buffer 203 transmits the encoded data 205 received from the analysis unit 202 to the second transmission / reception unit 111.
  • FIG. 3 is a flowchart showing the operation of the moving image conversion apparatus 102.
  • the command analysis unit 109 analyzes the content of the operation signal 115 (step S301).
  • the command analysis unit 109 identifies the encoded data requested by the terminal from the operation signal 115, and requests the distribution server 101 for the distribution (step S302).
  • step S303 a predetermined time-out period is waited for reception of the encoded data 105 from the distribution server 101 (step S303).
  • the command analysis unit 109 requests the transcoder 110 to convert the received encoded data according to the analysis result of the previous operation signal 115 (step S304). .
  • the encoded data is transmitted at predetermined frame intervals in accordance with the requested reproduction method, that is, the reproduction, stop, pause, fast forward, and rewind methods. Are extracted in units of frames (step S305). Then, the extracted encoded data is transmitted to the terminal 103 (step S306). In the terminal 103, the transmitted encoded data is decoded and reproduced by the requested method.
  • FIG. 4 is a block diagram showing the configuration of the moving image distribution system according to the second embodiment of the present invention.
  • the same components as those in the previous embodiment are denoted by the same reference numerals, and the description thereof is omitted.
  • the image distribution system 400 includes a distribution server 101, a moving image conversion device 401, and a terminal 103.
  • the moving image conversion device 401 includes a first transmission / reception unit 108, a command analysis unit 402, a transcoder 403, and a second transmission / reception unit 111. ing.
  • the command analysis unit 402 analyzes the operation signal 115 received from the second transmission / reception unit 111 and transmits the encoded data acquisition request 112 to the first transmission / reception unit 108 based on the analysis result. In addition, the command analysis unit 402 transmits an encoded data conversion request 404 to the transcoder 403 based on the result of analyzing the operation signal 115.
  • the encoded data conversion request 404 sends the encoded data 113 received from the first transmission / reception unit 108 to the transcoder 403 in a frame unit only for a specific frame type based on fast-forward and rewind reproduction of the operation signal 115. Request to extract.
  • a specific frame type at the time of fast-forward reproduction for example, a frame that has been intra-prediction coded and a frame that has been inter-prediction coded with reference to a past frame can be considered. Alternatively, only frames that have been intra prediction encoded may be used.
  • a specific frame type at the time of rewind reproduction a frame that has been intra-predictively encoded can be considered.
  • a part of a specific frame type is skipped and extracted.
  • determination information to be extracted for example, time information, frame type limitation, and the number of frames to be skipped are transmitted to the transcoder 403.
  • the transcoder 403 receives the encoded data 113 from the first transmission / reception unit 108, converts the received encoded data based on the content of the encoded data conversion request 404 from the instruction analysis unit 402, It transmits to the 2nd transmission / reception part 111 as the digitized data 405.
  • FIG. 5 is a block diagram showing a detailed configuration of the transcoder 403 according to the present embodiment.
  • the transcoder 403 includes a reception buffer 201, an analysis unit 501, and a transmission buffer 203.
  • the analysis unit 501 Based on the encoded data conversion request 404 received from the instruction analysis unit 402, the analysis unit 501 extracts only a specific frame type from the encoded data 204 received from the reception buffer 201 in units of frames and sends it to the transmission buffer 203. Send. If the encoded data conversion request 404 is requested to increase the speed of fast forward and rewind reproduction, the extracted frame is skipped and transmitted to the transmission buffer 203. For example, when the information of the time interval to skip is notified, the frame is extracted by calculating the number of frames to be skipped based on the time information of the capability information included in the encoded data.
  • the frame type notified by the encoded data conversion request 404 is extracted.
  • the number of frames to be skipped is notified by the encoded data conversion request 404, the number of frames to be skipped is extracted and extracted from the frame type extracted by fast forward and rewind playback.
  • encoded data of a specific frame type that appears after skipping the number of frames skipped from the received encoded data may be extracted.
  • the moving image conversion apparatus 401 in the present embodiment may also be provided in the distribution server 101 or may be installed in another place on the network.
  • FIG. 6 is a flowchart showing the operation of the moving image conversion apparatus 401.
  • the command analysis unit 402 analyzes the content of the operation signal 115 (step S601).
  • the command analysis unit 402 identifies the encoded data requested by the terminal from the operation signal 115, and requests the distribution server 101 for the distribution (step S602).
  • step S603 the reception of the encoded data 105 from the distribution server 101 is waited for a predetermined timeout period.
  • the command analysis unit 402 requests the transcoder 403 to convert the received encoded data according to the analysis result of the previous operation signal 115 (step S604). .
  • the transcoder 403 When the transcoder 403 receives this request from the instruction analysis unit 402, the received encoded data is extracted in frame units only for a specific frame type based on the requested reproduction method, that is, fast forward and rewind reproduction. (Step S605). Then, the extracted encoded data is transmitted to the terminal 103 (step S606). In the terminal 103, the transmitted encoded data is decoded and reproduced by the requested method.
  • FIG. 7 is a block diagram showing the configuration of the moving image distribution system according to the third embodiment of the present invention.
  • the same components as those in the previous embodiment are denoted by the same reference numerals, and the description thereof is omitted.
  • the image distribution system 700 includes a distribution server 710, a moving image conversion apparatus 701, and a terminal 103.
  • the moving image conversion apparatus 701 includes a first transmission / reception unit 108, a command analysis unit 704, a transcoder 705, and a second transmission / reception unit 111. ing.
  • the distribution server 710 transmits the encoded data 702 to the moving image conversion apparatus 701 in accordance with the encoded data acquisition request 104 from the moving image conversion apparatus 701.
  • the encoded data is transmitted in the order of frames or in reverse order.
  • frames that have been intra-prediction-coded are sent in order, starting with the frame that has been intra-prediction-coded, and then immediately before this intra-prediction-coded frame.
  • This function has a function of tracing back the intra-prediction encoded frame, and transmitting the frames up to the immediately preceding intra-prediction frame.
  • Fig. 10 illustrates this situation. That is, when there is a request for rewind playback from the terminal, the original encoded data order shown in FIG. 10A is the same as the frame distribution in the distribution server 710 as shown in FIG. The order is replaced and output.
  • the moving image conversion apparatus 701 includes a first transmission / reception unit 108, a command analysis unit 704, a transcoder 705, and a second transmission / reception unit 111.
  • the command analysis unit 704 analyzes the operation signal 115 received from the second transmission / reception unit 111 and transmits the encoded data acquisition request 112 to the first transmission / reception unit 108 based on the analysis result. Further, the instruction analysis unit 704 transmits an encoded data conversion request 707 to the transcoder 705 based on the result of analyzing the operation signal 115.
  • the encoded data conversion request 707 sends the encoded data 706 received from the first transmission / reception unit 108 to the transcoder 705 only for a specific frame type based on the fast-forward and rewind playback of the operation signal 115 or constant. It is requested to extract in frame units at a frame interval.
  • a specific frame type at the time of fast-forward reproduction for example, a frame that has been intra-prediction coded and a frame that has been inter-prediction coded with reference to a past frame can be considered. Alternatively, only frames that have been intra prediction encoded may be used.
  • a specific frame type at the time of rewind reproduction a frame that has been intra-predictively encoded can be considered.
  • a part of a specific frame type is skipped and extracted.
  • a frame other than a specific frame type is converted into a specific frame type.
  • determination information to be extracted and converted for example, time information, frame type limitation, and the number of frames to be skipped are transmitted to the transcoder 705.
  • the transcoder 705 receives the encoded data 706 from the first transmission / reception unit 108, converts the received encoded data based on the content of the encoded data conversion request 707 from the instruction analysis unit 704, It transmits to the 2nd transmission / reception part 111 as the digitized data 708.
  • FIG. 8 is a block diagram showing a detailed configuration of the transcoder 705 according to the present embodiment.
  • the transcoder 705 includes a reception buffer 201, a conversion control unit 800, an analysis unit 801, an image decoding unit 802, an image encoding unit 803, a switch 804, and a transmission buffer 203.
  • the conversion control unit 800 Based on the encoded data conversion request 707, the conversion control unit 800 transmits an encoded data extraction request 806 to the analysis unit 801, and transmits an encoded data conversion request 812 to the image encoding unit 803.
  • the encoded data extraction request 806 requests that the encoded data 805 received from the reception buffer 201 be extracted only in a specific frame type based on fast forward and rewind reproduction or in units of frames at a fixed frame interval. . In order to increase the speed of fast forward and rewind playback, it is requested to skip a part of a specific frame type. As determination information to be extracted and converted, for example, time information, frame type limitation, and the number of frames to be skipped are transmitted to the transcoder 705.
  • the analysis unit 801 Based on the encoded data extraction request 806 received from the conversion control unit 800, the analysis unit 801 extracts a specific frame type from the encoded data 805 from the reception buffer 201 or in units of frames at regular intervals. Transmit to the transmission buffer 203. If the encoded data conversion request 707 is requested to increase the speed of fast forward and rewind reproduction, the extracted frame is skipped and transmitted to the transmission buffer 203. For example, when the information of the time interval to skip is notified, the number of frames to be skipped is calculated and extracted based on the time information of the capability information included in the encoded data.
  • the frame type notified by the encoded data extraction request 806 is extracted.
  • the number of frames to be skipped is notified by the encoded data extraction request 806, the number of frames to be skipped is extracted and extracted from the frame type extracted by fast forward and rewind playback.
  • encoded data of a specific frame type that appears after skipping the number of frames skipped from the received encoded data may be extracted.
  • the analysis unit 801 transmits the extracted encoded data 811 to the switch 804. Also, the encoded data 805 received from the reception buffer 201 is transmitted to the image decoding unit 802. Further, the analysis unit 801 notifies the image encoding unit 803 of the analysis result 810 of the presence / absence of a prediction mismatch when the encoded data 805 received from the reception buffer 201 is analyzed and the capability information 809 included in the encoded data 805. It has the function to do.
  • the image decoding unit 802 has a function of decoding the encoded data 807 received from the analysis unit 801 and transmitting the generated moving image signal 808 to the image encoding unit 803.
  • the image encoding unit 803 encodes the moving image signal 808 received from the image decoding unit 802 based on the encoded data conversion request 812 received from the conversion control unit 800, and transmits the encoded data 813 to the switch 804.
  • the capability information 809 received from the analysis unit 801 is used to encode with the same capability information as the encoded data 702 received from the distribution server 710.
  • the capability information may be acquired from the image decoding unit 802.
  • the encoded data conversion request for example, when information of a time interval to skip is notified, the number of frames to be skipped is calculated and converted based on the time information of capability information.
  • the encoded data conversion request 707 is notified of the number of frames to be skipped, the frame type extracted by fast forward and rewind playback is extracted for each skipped number and converted.
  • the moving image signal 808 of the target frame is encoded based on the analysis result 810 from the analysis unit 801, and the encoded signal is transmitted to the switch 804.
  • the data 813 is transmitted.
  • An example of the conversion process for correcting the prediction mismatch is shown in FIG.
  • FIG. 11 (a) illustrates the extraction of general encoded data in which prediction mismatch correction is not performed
  • FIG. 11 (b) illustrates prediction mismatch correction according to the present embodiment
  • Fig. 4 illustrates extraction of encoded data.
  • the original encoded data includes a frame (interframe) constructed using an inter prediction method, and when a conversion for extracting only odd frames from this frame is performed, motion compensation is performed. A prediction frame is lost and a prediction mismatch occurs, and this causes disturbance of the reproduced moving image.
  • FIG. 11 shows the case where only odd frames are extracted, it is apparent that this conversion process is possible even when only even frames are extracted or when arbitrary frames are extracted.
  • the switch 804 transmits the encoded data 811 received from the analysis unit 801 and the encoded data 813 received from the image decoding unit 803 to the transmission buffer 203.
  • the moving image conversion apparatus 701 in the present embodiment may also be in the distribution server 101 or installed in another place on the network.
  • FIG. 9 is a flowchart showing the operation of the moving image conversion apparatus 701.
  • the command analysis unit 704 analyzes the contents of the operation signal 115 (step S901).
  • the command analysis unit 704 identifies the encoded data requested by the terminal from the operation signal 115, and requests the distribution server 710 for the distribution (step S902).
  • This request includes a request for transmitting encoded data in frame units in order or in reverse order.
  • the encoded data is transmitted in the order of frames or in reverse order.
  • step S903 it waits for a predetermined timeout period to receive the encoded data 702 from the distribution server 710 (step S903).
  • the command analysis unit 704 requests the transcoder 705 to convert the received encoded data according to the analysis result of the previous operation signal 115 (step S904). .
  • step S905 it is determined whether there is a request for correcting the prediction mismatch in the encoded data conversion request 812 (step S905). If there is a request, the received data is decoded to correct the prediction mismatch and re-encoded (step S905). S906).
  • the transcoder 705 When the transcoder 705 receives the encoded data conversion request from the instruction analysis unit 704, the received encoded data is framed only for a specific frame type based on the requested reproduction method, that is, fast forward and rewind reproduction. Extraction is performed in units (step S907).
  • the operation signal 115 includes a request to increase the speed of fast forward / rewind playback, a request is made to skip a part of a specific frame type.
  • determination information to be extracted and converted for example, time information, frame type limitation, and the number of frames to be skipped are transmitted to the transcoder 705.
  • the extracted encoded data is transmitted to the terminal 103 (step S908).
  • the transmitted encoded data is decoded and reproduced by the requested method.
  • the moving image conversion apparatus can be realized by a hardware configuration similar to that of a general computer apparatus.
  • a main memory such as a processing unit (1001), RAM (Random Access Memory), etc., a main storage unit 1002 used for a data work area and a temporary data save area, and communication for transmitting / receiving data to / from other nodes via a network Unit 1003, an input / output interface unit 1004 that transmits and receives data by connecting to an external device, and a ROM (Read Only) connected via the input / output interface unit 1004 Memory), an auxiliary storage unit 1005 which is a hard disk device composed of a non-volatile memory such as a magnetic disk, a semiconductor memory, a system bus 1006 for interconnecting the above components, an output device 1007 such as a display device, a keyboard, etc.
  • An input device 1008 is provided.
  • the moving image conversion apparatus implements its operation by mounting a circuit component that is a hardware component such as LSI (Large Scale Integration) incorporating the moving image conversion program that provides the above-described functions.
  • LSI Large Scale Integration
  • the moving image conversion program that provides the functions of the respective units included in the moving image conversion apparatus is stored in the auxiliary storage unit 1005, and the program is loaded into the main storage unit 1002 to load the CPU 1001. It is also possible to realize by software by executing the above.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

In the case where a terminal device reproduces a dynamic image delivers through a network, the terminal device extracts or converts to deliver only a specific frame out of the delivery stream, thereby making a fast-forwarding operation and a rewinding and reproducing operation possible. A Dynamic image conversion device includes a means for receiving an operation signal of a dynamic image from a terminal device, a means for analyzing the received operation signal, a means for requesting a delivery server that stores dynamic images to deliver a subject dynamic image, a means for receiving coded data of the dynamic image from the delivery server, a means for extracting coded data of a necessary frame from the coded data of the received dynamic image in accordance with a request of an operation signal, and a means for transmitting the coded data of the extracted frame to the terminal device.

Description

動画像変換装置、動画像配信システム、動画像変換方法及びプログラムMoving image conversion apparatus, moving image distribution system, moving image conversion method, and program
　本発明は、動画像変換技術に関し、符号化された動画像圧縮符号化ビットストリームを端末側で早送り、巻き戻しする際の符号化データの変換および配信を行う動画像変換装置、動画像配信システム、動画像変換方法及びプログラムに関する。 The present invention relates to a moving image conversion technique, and relates to a moving image conversion apparatus and a moving image distribution system for converting and distributing encoded data when a coded moving image compression-encoded bitstream is fast-forwarded and rewinded on a terminal side. The present invention relates to a moving image conversion method and program.
　近年、動画像信号を低ビットレートで効率良く伝送するための動画像圧縮符号化方式として、ＩＴＵ－Ｔ勧告Ｈ．２６１及びＨ．２６３、またはＩＳＯ／ＩＥＣで国際標準化されているＭＰＥＧ-４が知られている。また、ＩＴＵ－ＴとＩＳＯ／ＩＥＣで国際標準化されたＨ．２６４／ＭＰＥＧ－４　ＡＶＣが、上記の動画像圧縮符号化方式よりも動画像信号を効率良く伝送できる方式として注目を浴びている。 In recent years, ITU-T recommendation H.264 has been proposed as a moving image compression encoding method for efficiently transmitting moving image signals at a low bit rate. 261 and H.H. MPEG-4 that is internationally standardized by H.263 or ISO / IEC is known. In addition, H.264 has been internationally standardized by ITU-T and ISO / IEC. H.264 / MPEG-4 AVC is attracting attention as a method that can transmit moving image signals more efficiently than the above-described moving image compression encoding method.
　動画像圧縮符号化方式には、現在フレームの画像データのみを用いて符号化するイントラ予測によるものと、過去や未来のフレームの画像を参照して符号化するインター予測によるものとがある。 There are two types of video compression encoding methods: intra prediction that encodes using only image data of the current frame, and inter prediction that encodes images of past and future frames.
　イントラ予測による方式は、入力画像フレームを符号化するときに、マクロブロックと呼ばれる単位毎にDCT (Discrete Cosine Transform)を行った後、DCT係数を可変長符号化する。もしくは、マクロブロックやマクロブロックを更に細かく分割したブロック毎に、左や上といった近傍のブロックの画素を用いて予測を行い、予測残差信号に対してDCTやDIT(Discrete
Integer Transform)を行った後、DCT係数、またはDIT係数を可変長符号化する。 In the method based on intra prediction, when an input image frame is encoded, DCT (Discrete Cosine Transform) is performed for each unit called a macroblock, and then a DCT coefficient is variable-length encoded. Alternatively, for each block obtained by further subdividing a macroblock or macroblock, prediction is performed using pixels of neighboring blocks such as the left and top, and DCT or DIT (Discrete) is applied to the prediction residual signal.
After performing (Integer Transform), the DCT coefficient or DIT coefficient is variable-length encoded.
　一方、インター予測による方式は、入力画像フレームを符号化するときに、過去、または未来のフレームの復号画素との間で、動き補償予測を行って予測残差信号を求め、これに対してDCTまたはDITを行った後、動きベクトルやDCT係数等を可変長符号化する。
特開２００２－３７４５１５号公報 特開平０９－２７５５４５号公報 On the other hand, in the method based on inter prediction, when an input image frame is encoded, a prediction residual signal is obtained by performing motion compensation prediction between decoded pixels of past or future frames, and DCT Alternatively, after DIT, motion vectors, DCT coefficients, etc. are variable length encoded.
JP 2002-374515 A JP 09-275545 A
　上述したような動画像圧縮符号化方式で符号化されたデータ（符号化データ）を、ネットワーク上のサーバーから端末側に配信し再生する場合は、符号化データを基の動画像信号へ復号する必要が生じるが、この場合以下のような問題があることが指摘されている。 When the data (encoded data) encoded by the moving image compression encoding method as described above is distributed and reproduced from the server on the network to the terminal side, the encoded data is decoded into a moving image signal based on the encoded data. Although it is necessary, it has been pointed out that there are the following problems.
　第１の問題点は、端末で動画像信号を間隔をあけて再生される場合があるが、このような場合にはそれらのデータを一時的にバッファリングするために端末に多大なメモリを持つ必要があることである。その理由は、端末で復号した動画像信号を間隔をあけて再生するためには配信されたすべての符号化データ、もしくはすべての符号化データを復号した動画像信号を保存しておく必要があるためである。 The first problem is that moving picture signals may be played back at intervals in the terminal. In such a case, the terminal has a large memory to temporarily buffer the data. It is necessary. The reason is that in order to reproduce the video signal decoded by the terminal at intervals, it is necessary to store all the encoded data distributed or the video signal obtained by decoding all the encoded data. Because.
　第２の問題点は、ネットワークを介して配信された符号化データを端末が早送りや巻き戻しで再生する場合に、早送りや巻き戻し再生が円滑に行われない場合があることである。その理由は、現行の符号化データの配信技術では早送り、巻き戻し再生で表示するフレーム以外の符号化データも受信する必要があるため、受信データ量が多くなりデータ伝送に相応の時間を要するからである。 The second problem is that when the terminal reproduces the encoded data distributed via the network by fast-forwarding or rewinding, fast-forwarding or rewinding reproduction may not be performed smoothly. The reason for this is that the current encoded data distribution technology needs to receive encoded data other than the frame to be displayed by fast-forward and rewind playback, so the amount of received data increases and it takes time to transmit data. It is.
　第３の問題点は、特定のフレームタイプのみを抽出した場合、早送り、巻き戻し再生のスピードを制御できないことである。その理由は、早送り、巻き戻し再生で使うフレームタイプの間隔は圧縮する時点で決められてしまい、その再生時には調整できないからである。 The third problem is that when only a specific frame type is extracted, the speed of fast forward and rewind playback cannot be controlled. The reason is that the frame type interval used in fast forward and rewind playback is determined at the time of compression and cannot be adjusted during playback.
　第４の問題点は、特定のフレームタイプのみを抽出して復号する場合、再生映像が乱れてしまう場合があることである。その理由は、特定のフレームタイプのみを抽出して復号する場合、符号化時に参照していたデータが抽出されたデータの中に存在しないことがあるので復号時に不整合が生じるからである。 The fourth problem is that when only a specific frame type is extracted and decoded, the reproduced video may be disturbed. The reason is that when only a specific frame type is extracted and decoded, the data referred to at the time of encoding may not exist in the extracted data, and thus inconsistency occurs at the time of decoding.
　上記の問題点に関連して、特開２００２－３７４５１５号公報（特許文献１）、特開平０９－２７５５４５号公報（特許文献２）等に記載される技術が存在する。特許文献１には、ネットワーク接続された配信サーバーから端末に動画像データを配信するシステムにおいて、ユーザ指定により動画像データの必要フレームを抽出し、配信する技術が開示されている。また、特許文献２には、動画像データのジャンプ、飛ばし読み再生時、早送りから通常に戻る再生時に用いる蓄積フォーマット変換部の構成が開示されている。 In connection with the above problems, there are technologies described in Japanese Patent Application Laid-Open No. 2002-374515 (Patent Document 1), Japanese Patent Application Laid-Open No. 09-275545 (Patent Document 2), and the like. Patent Document 1 discloses a technique for extracting and distributing a necessary frame of moving image data by a user designation in a system for distributing moving image data from a distribution server connected to a network to a terminal. Patent Document 2 discloses a configuration of a storage format conversion unit used at the time of moving image data jumping, skip reading reproduction, and reproduction from fast forward to normal.
　しかしながら特許文献１に開示の技術では、配信サーバー上の一部の動画像データのみを配信して端末で受信するデータ量を少なくすることはできるものの、ユーザが早送りや巻き戻し再生を要求する場合での配信データ量を少なくする方法は明示されていない。従って、早送りや巻き戻し再生を要求する場合には、これに相応する動画像データのすべてが配信されることとなって、配信するデータ量の削減や円滑な再生は期待できないという問題がある。 However, in the technique disclosed in Patent Document 1, although only a part of moving image data on the distribution server can be distributed and the amount of data received by the terminal can be reduced, the user requests fast forward or rewind reproduction. There is no clear way to reduce the amount of data delivered by. Therefore, when fast forward or rewind playback is requested, all of the moving image data corresponding to this is distributed, and there is a problem that reduction of the amount of data to be distributed and smooth playback cannot be expected.
　また、特許文献２に開示の技術では、ジャンプや飛ばし読みなどシーケンスと異なる順番でフレーム再生する場合、読み出したブロックが直前のブロックと符号化シーケンス上連続するか否かを示す情報を復号化単位毎に設け、新旧ブロック領域に今までと異なる値を設定する必要がある。このため、処理に時間を要すると共に配信データ量を少なくするのが困難である。 In the technique disclosed in Patent Document 2, when frames are reproduced in an order different from the sequence such as jumping or skipping reading, information indicating whether or not the read block is continuous with the immediately preceding block in the coding sequence is used as a decoding unit. It is necessary to set a different value for each of the new and old block areas. For this reason, it takes time for processing and it is difficult to reduce the amount of distribution data.
（発明の目的）
　本発明の目的は、ネットワークを介して符号化データを配信する場合に、端末に多大なメモリを設ける必要のない動画像変換装置、動画像配信システム、動画像変換方法及びプログラムを提供することである。 (Object of invention)
An object of the present invention is to provide a moving image conversion apparatus, a moving image distribution system, a moving image conversion method, and a program that do not require a large memory in a terminal when encoded data is distributed via a network. is there.
　本発明の他の目的は、端末が早送り、巻き戻し再生に必要が無い符号化データを受信しなくても良い動画像変換装置、動画像配信システム、動画像変換方法及びプログラムを提供することである。 Another object of the present invention is to provide a moving image conversion apparatus, a moving image distribution system, a moving image conversion method, and a program that do not require the terminal to receive encoded data that is not required for fast forward and rewind reproduction. is there.
　本発明の他の目的は、端末が早送り、巻き戻し再生を行う際に、その符号化データのフレームタイプに依存せず、早送り、巻き戻し再生を行える動画像変換装置、動画像配信システム、動画像変換方法及びプログラムを提供することである。 Another object of the present invention is to provide a moving image conversion device, a moving image distribution system, and a moving image that can perform fast forward and rewind reproduction regardless of the frame type of the encoded data when the terminal performs fast forward and rewind reproduction. An image conversion method and program are provided.
　本発明の他の目的は、早送り、巻き戻し再生の動画像信号の画質を向上させる動画像変換装置、動画像配信システム、動画像変換方法及びプログラムを提供することである。 Another object of the present invention is to provide a moving image conversion apparatus, a moving image distribution system, a moving image conversion method, and a program for improving the image quality of a fast-forwarding and rewinding moving image signal.
　本発明による動画像変換装置は、操作信号の要求に従って、受信した動画像の符号化データから必要なフレームの符号化データを抽出する手段と、抽出したフレームの符号化データを端末に送信する手段を含む。 The moving image conversion apparatus according to the present invention is configured to extract encoded data of a necessary frame from encoded data of a received moving image in accordance with a request for an operation signal, and to transmit encoded data of the extracted frame to a terminal including.
　本発明による動画像変換方法は、操作信号の要求に従って、受信した動画像の符号化データから必要なフレームの符号化データを抽出するステップと、抽出したフレームの符号化データを端末に送信するステップを含む。 The moving image conversion method according to the present invention includes a step of extracting encoded data of a necessary frame from encoded data of a received moving image according to a request for an operation signal, and a step of transmitting the encoded data of the extracted frame to a terminal including.
　本発明による動画像変換プログラムは、コンピュータに、操作信号の要求に従って、受信した動画像の符号化データから必要なフレームの符号化データを抽出する処理と、抽出したフレームの符号化データを端末に送信する処理を実行させる。 The moving image conversion program according to the present invention is a method for extracting encoded data of a necessary frame from encoded data of a received moving image according to a request for an operation signal to a computer, and extracting the encoded data of the extracted frame to a terminal. Execute the process to send.
　第１の効果は、ネットワークを介して符号化データを配信する場合に、端末が多大なメモリを設ける必要がないことである。 The first effect is that the terminal does not need to provide a large memory when the encoded data is distributed via the network.
　第２の効果は、端末が早送り、巻き戻し再生に必要が無い符号化データを受信しなくても良いことである。 The second effect is that the terminal does not have to receive encoded data which is not necessary for fast forward and rewind reproduction.
　第３の効果は、端末が早送り、巻き戻し再生を行う際に符号化データのフレームタイプに依存せずに、早送り、巻き戻し再生を行えることである。 The third effect is that when the terminal performs fast forward and rewind playback, fast forward and rewind playback can be performed without depending on the frame type of the encoded data.
　第４の効果は、早送り、巻き戻し再生の動画像信号の画質を向上させることができることである。
  The fourth effect is that it is possible to improve the image quality of the moving image signal for fast forward and rewind reproduction.
本発明の第１の実施の形態に係る動画像配信システムにおける構成を示したブロック図である。It is the block diagram which showed the structure in the moving image delivery system which concerns on the 1st Embodiment of this invention. 図１のトランスコーダにおける詳細な構成を示すブロック図である。It is a block diagram which shows the detailed structure in the transcoder of FIG. 動画像変換装置の動作を示したフローチャートである。It is the flowchart which showed operation | movement of the moving image converter. 本発明の第２の実施の形態に係る動画像配信システムにおける構成を示したブロック図である。It is the block diagram which showed the structure in the moving image delivery system which concerns on the 2nd Embodiment of this invention. 図４のトランスコーダの詳細な構成を示すブロック図である。FIG. 5 is a block diagram illustrating a detailed configuration of the transcoder in FIG. 4. 動画像変換装置の動作を示したフローチャートである。It is the flowchart which showed operation | movement of the moving image converter. 本発明の第３の実施の形態に係る動画像配信システムにおける構成を示すブロック図である。It is a block diagram which shows the structure in the moving image delivery system which concerns on the 3rd Embodiment of this invention. 図７のトランスコーダの詳細な構成を示すブロック図である。It is a block diagram which shows the detailed structure of the transcoder of FIG. 動画像変換装置の動作を示したフローチャートである。It is the flowchart which showed operation | movement of the moving image converter. 端末から巻き戻し再生の要求があった場合のフレームの配信順位を説明するための図である。It is a figure for demonstrating the delivery order of the flame | frame when there exists a request | requirement of rewind reproduction | regeneration from a terminal. 予測ミスマッチを補正する変換処理について説明するための図である。It is a figure for demonstrating the conversion process which correct | amends a prediction mismatch. 本発明の実施の形態による動画像変換装置のハードウェア構成例を示すブロック図である。It is a block diagram which shows the hardware structural example of the moving image converter by embodiment of this invention.
（第１の実施の形態）
　次に、本発明の第１の実施の形態について図面を参照して詳細に説明する。 (First embodiment)
Next, a first embodiment of the present invention will be described in detail with reference to the drawings.
（第１の実施の形態の構成）
　図１、図２を参照して、本実施の形態における動画像配信システムの全体構成について詳細に説明する。図１は動画像配信システムにおける詳細な構成を示したブロック図である。動画像配信システム１００は、配信サーバー１０１、動画像変換装置１０２、端末１０３を備えている。 (Configuration of the first embodiment)
With reference to FIGS. 1 and 2, the entire configuration of the moving image distribution system in the present embodiment will be described in detail. FIG. 1 is a block diagram showing a detailed configuration in a moving image distribution system. The moving image distribution system 100 includes a distribution server 101, a moving image conversion apparatus 102, and a terminal 103.
　配信サーバー１０１は、動画像変換装置１０２からの符号化データ取得要求１０４に従って、動画像変換装置１０２へ符号化データ１０５を送信する。また、この際、配信サーバー１０１は送信する符号化データをフレーム単位に昇順または降順で送信する機能を有している。 The distribution server 101 transmits the encoded data 105 to the moving image conversion apparatus 102 in accordance with the encoded data acquisition request 104 from the moving image conversion apparatus 102. At this time, the distribution server 101 has a function of transmitting encoded data to be transmitted in ascending or descending order in units of frames.
　符号化データ取得要求１０４は、符号化データの選択や、再生、停止、一時停止、早送り、巻き戻し再生の操作を行うために必要な符号化データの取得順序情報を含む。再生、早送り再生を行う場合は、符号化データをそのフレームの順番通りに送る様に要求し、巻き戻し再生を行う場合は、現在のフレームから逆順に符号化データを送る様に要求する。 The encoded data acquisition request 104 includes encoded data acquisition order information necessary for selecting encoded data and performing operations such as playback, stop, pause, fast forward, and rewind playback. When performing playback or fast-forward playback, the encoded data is requested to be sent in the order of the frame, and when performing rewind playback, the encoded data is requested to be sent in reverse order from the current frame.
　符号化データ１０５は、動画像信号を圧縮した符号化データの他に、動画像信号を圧縮したときのパラメータの情報（能力情報）を含む。能力情報としては、例えばＤＣＩ(Decoder Configuration Infomation)やＳＰＳ(Sequence Parameter Set)、ＰＰＳ(Picture
Parameter Set)がある。 The encoded data 105 includes parameter information (capability information) obtained when the moving image signal is compressed, in addition to the encoded data obtained by compressing the moving image signal. As the capability information, for example, DCI (Decoder Configuration Information), SPS (Sequence Parameter Set), PPS (Picture
Parameter Set).
　動画像変換装置１０２は、第１送受信部１０８、命令解析部１０９、トランスコーダ１１０、第２送受信部１１１を含む。 The moving image conversion apparatus 102 includes a first transmission / reception unit 108, a command analysis unit 109, a transcoder 110, and a second transmission / reception unit 111.
　第１送受信部１０８は、命令解析部１０９で生成された符号化データ取得要求１０４を受信し、配信サーバー１０１へ送信する。また、配信サーバー１０１から符号化データ１０５を受信して、トランスコーダ１１０に送信する。 The first transmission / reception unit 108 receives the encoded data acquisition request 104 generated by the instruction analysis unit 109 and transmits it to the distribution server 101. Also, the encoded data 105 is received from the distribution server 101 and transmitted to the transcoder 110.
　命令解析部１０９は、第２送受信部１１１から受信した操作信号１１５を解析し、解析した結果に基づいて符号化データ取得要求１１２を第１送受信部１０８に送信する。また、命令解析部１０９は、操作信号１１５を解析した結果に基づき、トランスコーダ１１０へ符号化データ変換要求１１４を送信する。 The command analysis unit 109 analyzes the operation signal 115 received from the second transmission / reception unit 111 and transmits the encoded data acquisition request 112 to the first transmission / reception unit 108 based on the analysis result. Further, the instruction analysis unit 109 transmits an encoded data conversion request 114 to the transcoder 110 based on the result of analyzing the operation signal 115.
　符号化データ変換要求１１４は、トランスコーダ１１０に対して、第１送受信部１０８から受信した符号化データ１１３を、操作信号１１５が要求する早送りまたは巻き戻し再生の速度に基づいて、一定のフレーム間隔を空けてフレーム単位で抽出する様に要求する。 The encoded data conversion request 114 sends the encoded data 113 received from the first transmission / reception unit 108 to the transcoder 110 at a fixed frame interval based on the fast forward or rewind playback speed requested by the operation signal 115. Request to extract by frame with a gap.
　トランスコーダ１１０は、第１送受信部１０８からの符号化データ１１３を受信し、命令解析部１０９からの符号化データ変換要求１１４の内容に基づいて、受信した符号化データを変換し、これを符号化データ１１６として第２送受信部１１１へ送信する。トランスコーダ１１０の具体的な構成については後述する。 The transcoder 110 receives the encoded data 113 from the first transmission / reception unit 108, converts the received encoded data based on the content of the encoded data conversion request 114 from the instruction analysis unit 109, and converts the encoded data into the code It transmits to the 2nd transmission / reception part 111 as the quantization data 116. FIG. A specific configuration of the transcoder 110 will be described later.
　第２送受信部１１１は、端末１０３から送信された操作信号１０６を受信して命令解析部１０９へ送信する。また、トランスコーダ１１０からの符号化データ１１６を符号化データ１０７として端末１０３へ送信する。 The second transmission / reception unit 111 receives the operation signal 106 transmitted from the terminal 103 and transmits it to the command analysis unit 109. Also, the encoded data 116 from the transcoder 110 is transmitted to the terminal 103 as the encoded data 107.
　操作信号１０６には、符号化データの選択や、再生、停止、一時停止、早送り、巻き戻し再生の操作情報、早送り、巻き戻し再生の速度情報が含まれる。 The operation signal 106 includes selection of encoded data, operation information for playback, stop, pause, fast forward and rewind playback, and speed information for fast forward and rewind playback.
　端末１０３は、ユーザが動画像をその所望する方法で再生する端末であり、所望の符号化データを再生、停止、一時停止、早送り、巻き戻しするために、操作信号１０６を動画像変換装置１０２に送信する。そして、動画像変換装置１０２から受信した符号化データを復号し表示する機能を有する。 The terminal 103 is a terminal where a user reproduces a moving image in a desired method, and the operation signal 106 is transmitted to the moving image conversion apparatus 102 in order to reproduce, stop, pause, fast forward, and rewind the desired encoded data. Send to. The encoded data received from the moving image conversion apparatus 102 is decoded and displayed.
　本実施の形態における動画像変換装置１０２は、配信サーバー１０１の中にあっても良いし、ネットワーク上の他の場所に設置されても良い。 The moving image conversion apparatus 102 in the present embodiment may be in the distribution server 101 or may be installed in another place on the network.
　図２は、図１のトランスコーダ１１０における詳細な構成を示すブロック図である。図においてトランスコーダ１１０は、受信バッファ２０１、解析部２０２、送信バッファ２０３を備えている。 FIG. 2 is a block diagram showing a detailed configuration of the transcoder 110 of FIG. In the figure, the transcoder 110 includes a reception buffer 201, an analysis unit 202, and a transmission buffer 203.
　受信バッファ２０１は、第１送受信部１０８から受信した符号化データ１１３を解析部２０２へ送信する。 The reception buffer 201 transmits the encoded data 113 received from the first transmission / reception unit 108 to the analysis unit 202.
　解析部２０２は、命令解析部１０９から受信した符号化データ変換要求１１４に基づいて、受信バッファ２０１から受信した符号化データ２０４を、一定のフレーム間隔を空けてフレーム単位で抽出して、符号化データ２０５として送信バッファ２０３へ送信する。 Based on the encoded data conversion request 114 received from the instruction analysis unit 109, the analysis unit 202 extracts the encoded data 204 received from the reception buffer 201 in units of frames with a certain frame interval therebetween, and performs encoding. The data 205 is transmitted to the transmission buffer 203.
　送信バッファ２０３は、解析部２０２から受信した符号化データ２０５を第２送受信部１１１へ送信する。 The transmission buffer 203 transmits the encoded data 205 received from the analysis unit 202 to the second transmission / reception unit 111.
（第１の実施の形態による動作）
　次に、図３に沿って、端末から動画像の配信要求があった場合の、第１の実施の形態における動画像変換装置１０２における動作について説明する。図３は動画像変換装置１０２の動作を示したフローチャートである。 (Operation according to the first embodiment)
Next, the operation in the moving image conversion apparatus 102 in the first embodiment when there is a moving image distribution request from the terminal will be described with reference to FIG. FIG. 3 is a flowchart showing the operation of the moving image conversion apparatus 102.
　図において、端末１０３からの動画像の配信要求があると、命令解析部１０９において、その操作信号１１５の内容が解析される（ステップＳ３０１）。命令解析部１０９は操作信号１１５から端末によって要求されている符号化データを特定し、配信サーバー１０１にその配信を要求する（ステップＳ３０２）。 In the figure, when there is a moving image distribution request from the terminal 103, the command analysis unit 109 analyzes the content of the operation signal 115 (step S301). The command analysis unit 109 identifies the encoded data requested by the terminal from the operation signal 115, and requests the distribution server 101 for the distribution (step S302).
　次いで、配信サーバー１０１からの符号化データ１０５の受信を所定のタイムアウト期間待つ（ステップＳ３０３）。符号化データが配信サーバー１０１から送信されてくると、命令解析部１０９は、先の操作信号１１５の解析結果に従って、トランスコーダ１１０に対して受信した符号化データの変換を要求する（ステップＳ３０４）。 Next, a predetermined time-out period is waited for reception of the encoded data 105 from the distribution server 101 (step S303). When the encoded data is transmitted from the distribution server 101, the command analysis unit 109 requests the transcoder 110 to convert the received encoded data according to the analysis result of the previous operation signal 115 (step S304). .
　トランスコーダ１１０が命令解析部１０９からのこの要求を受けると、その要求されている再生方法、すなわち再生、停止、一時停止、早送り、巻き戻しの各方法に準じて、符号化データを一定フレーム間隔を空けてフレーム単位で抽出する（ステップＳ３０５）。そして、この抽出された符号化データを端末１０３へ送信する（ステップＳ３０６）。端末１０３においてはこの送信された符号化データは、復号化されその要求されている方法で再生される。 When the transcoder 110 receives this request from the instruction analysis unit 109, the encoded data is transmitted at predetermined frame intervals in accordance with the requested reproduction method, that is, the reproduction, stop, pause, fast forward, and rewind methods. Are extracted in units of frames (step S305). Then, the extracted encoded data is transmitted to the terminal 103 (step S306). In the terminal 103, the transmitted encoded data is decoded and reproduced by the requested method.
（第１の実施の形態の効果）
　以上説明したように、本実施の形態によれば、少ない演算量で、端末に多大なメモリを搭載せず、かつ端末で不要な符号化データを受信しなくても早送り、巻き戻しを行えるといった効果がある。 (Effects of the first embodiment)
As described above, according to this embodiment, it is possible to perform fast forwarding and rewinding with a small amount of computation, without installing a large amount of memory in the terminal, and without receiving unnecessary encoded data at the terminal. effective.
（第２の実施の形態）
（第２の実施の形態の構成）
　次に、本発明の第２の実施の形態について、図４～図６を参照して詳細に説明する。図４は、本発明の第２の実施の形態に係る動画像配信システムにおける構成を示すブロック図である。なお、以下では、先の実施の形態と同じ構成部分には同じ符号を付してその説明については省略する。 (Second Embodiment)
(Configuration of Second Embodiment)
Next, a second embodiment of the present invention will be described in detail with reference to FIGS. FIG. 4 is a block diagram showing the configuration of the moving image distribution system according to the second embodiment of the present invention. In the following, the same components as those in the previous embodiment are denoted by the same reference numerals, and the description thereof is omitted.
　画像配信システム４００は、配信サーバー１０１、動画像変換装置４０１、端末１０３を備え、動画像変換装置４０１は、第１送受信部１０８、命令解析部４０２、トランスコーダ４０３、第２送受信部１１１を備えている。 The image distribution system 400 includes a distribution server 101, a moving image conversion device 401, and a terminal 103. The moving image conversion device 401 includes a first transmission / reception unit 108, a command analysis unit 402, a transcoder 403, and a second transmission / reception unit 111. ing.
　命令解析部４０２は、第２送受信部１１１から受信した操作信号１１５を解析し、解析した結果に基づいて符号化データ取得要求１１２を第１送受信部１０８に送信する。また、命令解析部４０２は、操作信号１１５を解析した結果に基づき、トランスコーダ４０３へ符号化データ変換要求４０４を送信する。 The command analysis unit 402 analyzes the operation signal 115 received from the second transmission / reception unit 111 and transmits the encoded data acquisition request 112 to the first transmission / reception unit 108 based on the analysis result. In addition, the command analysis unit 402 transmits an encoded data conversion request 404 to the transcoder 403 based on the result of analyzing the operation signal 115.
　符号化データ変換要求４０４は、トランスコーダ４０３に対して、第１送受信部１０８から受信した符号化データ１１３を、操作信号１１５の早送り、巻き戻し再生に基づいて、特定のフレームタイプのみフレーム単位で抽出する様に要求する。このとき、早送り再生のときの特定のフレームタイプとしては、例えばイントラ予測符号化されたフレーム及び、過去のフレームを参照してインター予測符号化されたフレームが考えられる。もしくは、イントラ予測符号化されたフレームのみのものでも良い。巻き戻し再生のときの特定のフレームタイプとしては、イントラ予測符号化されたフレームが考えられる。また、早送り、巻き戻し再生の速度を上げる場合は、特定のフレームタイプを一部飛ばして抽出する。抽出する判断情報としては、例えば時間情報、フレームタイプの限定、フレームをスキップする枚数をトランスコーダ４０３に送信する。 The encoded data conversion request 404 sends the encoded data 113 received from the first transmission / reception unit 108 to the transcoder 403 in a frame unit only for a specific frame type based on fast-forward and rewind reproduction of the operation signal 115. Request to extract. At this time, as a specific frame type at the time of fast-forward reproduction, for example, a frame that has been intra-prediction coded and a frame that has been inter-prediction coded with reference to a past frame can be considered. Alternatively, only frames that have been intra prediction encoded may be used. As a specific frame type at the time of rewind reproduction, a frame that has been intra-predictively encoded can be considered. In order to increase the speed of fast forward and rewind playback, a part of a specific frame type is skipped and extracted. As determination information to be extracted, for example, time information, frame type limitation, and the number of frames to be skipped are transmitted to the transcoder 403.
　トランスコーダ４０３は、第１送受信部１０８からの符号化データ１１３を受信し、命令解析部４０２からの符号化データ変換要求４０４の内容に基づいて、受信した符号化データを変換し、これを符号化データ４０５として第２送受信部１１１へ送信する。 The transcoder 403 receives the encoded data 113 from the first transmission / reception unit 108, converts the received encoded data based on the content of the encoded data conversion request 404 from the instruction analysis unit 402, It transmits to the 2nd transmission / reception part 111 as the digitized data 405.
　図５は、本実施の形態に係るトランスコーダ４０３の詳細な構成を示すブロック図である。トランスコーダ４０３は、受信バッファ２０１、解析部５０１、送信バッファ２０３から構成される。 FIG. 5 is a block diagram showing a detailed configuration of the transcoder 403 according to the present embodiment. The transcoder 403 includes a reception buffer 201, an analysis unit 501, and a transmission buffer 203.
　解析部５０１は、命令解析部４０２から受信した符号化データ変換要求４０４に基づいて、受信バッファ２０１から受信した符号化データ２０４から、特定のフレームタイプのみをフレーム単位で抽出して送信バッファ２０３へ送信する。また、符号化データ変換要求４０４で早送り、巻き戻し再生の速度を上げる様に要求があった場合は、抽出するフレームを一部飛ばして送信バッファ２０３へ送信する。例えば、読み飛ばす時間間隔の情報が通知された場合、符号化データに含まれる能力情報の時間情報を基にして、読み飛ばすフレーム枚数を計算することにより、フレームを抽出する。 Based on the encoded data conversion request 404 received from the instruction analysis unit 402, the analysis unit 501 extracts only a specific frame type from the encoded data 204 received from the reception buffer 201 in units of frames and sends it to the transmission buffer 203. Send. If the encoded data conversion request 404 is requested to increase the speed of fast forward and rewind reproduction, the extracted frame is skipped and transmitted to the transmission buffer 203. For example, when the information of the time interval to skip is notified, the frame is extracted by calculating the number of frames to be skipped based on the time information of the capability information included in the encoded data.
　フレームタイプを限定する場合は、符号化データ変換要求４０４で通知されたフレームタイプのみを抽出する。フレームをスキップする枚数が符号化データ変換要求４０４で通知された場合は、早送り、巻き戻し再生で抽出するフレームタイプからスキップする枚数毎に抜き出して抽出する。もしくは、受信した符号化データの中からフレームスキップする枚数分読み飛ばした後に現れる特定のフレームタイプの符号化データを抽出するようにしても良い。 When limiting the frame type, only the frame type notified by the encoded data conversion request 404 is extracted. When the number of frames to be skipped is notified by the encoded data conversion request 404, the number of frames to be skipped is extracted and extracted from the frame type extracted by fast forward and rewind playback. Alternatively, encoded data of a specific frame type that appears after skipping the number of frames skipped from the received encoded data may be extracted.
　本実施の形態における動画像変換装置４０１も、配信サーバー１０１の中に設けても良いし、ネットワーク上の他の場所に設置されても良い。 The moving image conversion apparatus 401 in the present embodiment may also be provided in the distribution server 101 or may be installed in another place on the network.
（第２の実施の形態の動作）
　次に、図６に沿って、端末から動画像の配信要求があった場合の、第２の実施の形態における動画像変換装置４０１における動作について説明する。図６は動画像変換装置４０１の動作を示したフローチャートである。 (Operation of Second Embodiment)
Next, the operation in the moving image conversion apparatus 401 in the second embodiment when there is a moving image distribution request from the terminal will be described with reference to FIG. FIG. 6 is a flowchart showing the operation of the moving image conversion apparatus 401.
　図において、端末１０３からの動画像の配信要求があると、命令解析部４０２において、その操作信号１１５の内容が解析される（ステップＳ６０１）。命令解析部４０２は操作信号１１５から端末によって要求されている符号化データを特定し、配信サーバー１０１にその配信を要求する（ステップＳ６０２）。 In the figure, when there is a moving image distribution request from the terminal 103, the command analysis unit 402 analyzes the content of the operation signal 115 (step S601). The command analysis unit 402 identifies the encoded data requested by the terminal from the operation signal 115, and requests the distribution server 101 for the distribution (step S602).
　次いで、配信サーバー１０１からの符号化データ１０５の受信を所定のタイムアウト期間待つ（ステップＳ６０３）。符号化データが配信サーバー１０１から送信されてくると、命令解析部４０２は、先の操作信号１１５の解析結果に従って、トランスコーダ４０３に対して受信した符号化データの変換を要求する（ステップＳ６０４）。 Next, the reception of the encoded data 105 from the distribution server 101 is waited for a predetermined timeout period (step S603). When the encoded data is transmitted from the distribution server 101, the command analysis unit 402 requests the transcoder 403 to convert the received encoded data according to the analysis result of the previous operation signal 115 (step S604). .
　トランスコーダ４０３が命令解析部４０２からのこの要求を受けると、その要求されている再生方法、すなわち早送り、巻き戻し再生に基づいて、受信した符号化データを、特定のフレームタイプのみフレーム単位で抽出する（ステップＳ６０５）。そして、この抽出された符号化データを端末１０３へ送信する（ステップＳ６０６）。端末１０３においてはこの送信された符号化データは、復号化されその要求されている方法で再生される。 When the transcoder 403 receives this request from the instruction analysis unit 402, the received encoded data is extracted in frame units only for a specific frame type based on the requested reproduction method, that is, fast forward and rewind reproduction. (Step S605). Then, the extracted encoded data is transmitted to the terminal 103 (step S606). In the terminal 103, the transmitted encoded data is decoded and reproduced by the requested method.
（第２の実施の形態の効果）
　以上説明したように、本実施の形態によれば、少ない演算量で、端末に多大なメモリを搭載せず、かつ端末で不要な符号化データを受信しなくても早送り、巻き戻しを行える効果がある。なお、本実施の形態では、第１の実施の形態の構成に比べて解析部５０１での処理量が増える傾向があるが、端末で早送り、巻き戻しするための符号化データを復号する場合にその画質を向上させることができるという利点がある。 (Effect of the second embodiment)
As described above, according to the present embodiment, it is possible to perform fast forwarding and rewinding with a small amount of computation, without installing a large amount of memory in the terminal, and without receiving unnecessary encoded data at the terminal. There is. In this embodiment, the amount of processing in the analysis unit 501 tends to increase as compared with the configuration of the first embodiment. However, when decoding encoded data for fast forward and rewind at a terminal, There is an advantage that the image quality can be improved.
（第３の実施の形態）
（第３の実施の形態の構成）
　次に、本発明の第３の実施の形態について、図７～図１１を参照して詳細に説明する。図７は、本発明の第３の実施の形態に係る動画像配信システムにおける構成を示すブロック図である。なお、以下では、先の実施の形態と同じ構成部分には同じ符号を付してその説明については省略する。 (Third embodiment)
(Configuration of the third embodiment)
Next, a third embodiment of the present invention will be described in detail with reference to FIGS. FIG. 7 is a block diagram showing the configuration of the moving image distribution system according to the third embodiment of the present invention. In the following, the same components as those in the previous embodiment are denoted by the same reference numerals, and the description thereof is omitted.
　画像配信システム７００は、配信サーバー７１０、動画像変換装置７０１、端末１０３を備え、動画像変換装置７０１は、第１送受信部１０８、命令解析部７０４、トランスコーダ７０５、第２送受信部１１１を備えている。 The image distribution system 700 includes a distribution server 710, a moving image conversion apparatus 701, and a terminal 103. The moving image conversion apparatus 701 includes a first transmission / reception unit 108, a command analysis unit 704, a transcoder 705, and a second transmission / reception unit 111. ing.
　配信サーバー７１０は、動画像変換装置７０１からの符号化データ取得要求１０４に従って、動画像変換装置７０１へ符号化データ７０２を送信する。また、この際、符号化データをフレーム単位に順序通り、もしくは逆順に送信する機能を有している。特に、巻き戻しを行う場合は、イントラ予測符号化されたフレームを先頭にして次のイントラ予測符号化フレームの直前までのフレームを順序通りに送信した後、このイントラ予測符号化フレームの１つ前のイントラ予測符号化フレームに遡り、遡ったイントラ予測フレームを先頭にしてその直前までのフレームを送信する機能を有している。 The distribution server 710 transmits the encoded data 702 to the moving image conversion apparatus 701 in accordance with the encoded data acquisition request 104 from the moving image conversion apparatus 701. At this time, the encoded data is transmitted in the order of frames or in reverse order. In particular, when rewinding is performed, frames that have been intra-prediction-coded are sent in order, starting with the frame that has been intra-prediction-coded, and then immediately before this intra-prediction-coded frame. This function has a function of tracing back the intra-prediction encoded frame, and transmitting the frames up to the immediately preceding intra-prediction frame.
　図１０は、この様子を図解したものである。すなわち、端末から巻き戻し再生の要求があった場合、同図（ａ）に示した、もとの符号化データ順序は、配信サーバー７１０において、同図（ｂ）に示すように、フレームの配信順位の置き換えが行われ、これが出力される。 Fig. 10 illustrates this situation. That is, when there is a request for rewind playback from the terminal, the original encoded data order shown in FIG. 10A is the same as the frame distribution in the distribution server 710 as shown in FIG. The order is replaced and output.
　図７に戻り、動画像変換装置７０１は、第１送受信部１０８、命令解析部７０４、トランスコーダ７０５、第２送受信部１１１から構成される。 Returning to FIG. 7, the moving image conversion apparatus 701 includes a first transmission / reception unit 108, a command analysis unit 704, a transcoder 705, and a second transmission / reception unit 111.
　命令解析部７０４は、第２送受信部１１１から受信した操作信号１１５を解析し、解析した結果に基づいて符号化データ取得要求１１２を第１送受信部１０８に送信する。また、命令解析部７０４は、操作信号１１５を解析した結果に基づき、トランスコーダ７０５へ符号化データ変換要求７０７を送信する。 The command analysis unit 704 analyzes the operation signal 115 received from the second transmission / reception unit 111 and transmits the encoded data acquisition request 112 to the first transmission / reception unit 108 based on the analysis result. Further, the instruction analysis unit 704 transmits an encoded data conversion request 707 to the transcoder 705 based on the result of analyzing the operation signal 115.
　符号化データ変換要求７０７は、トランスコーダ７０５に対して、第１送受信部１０８から受信した符号化データ７０６を、操作信号１１５の早送り、巻き戻し再生に基づいて特定のフレームタイプのみ、あるいは、一定のフレーム間隔でフレーム単位に抽出する様に要求する。このとき、早送り再生のときの特定のフレームタイプとしては、例えばイントラ予測符号化されたフレーム及び、過去のフレームを参照してインター予測符号化されたフレームが考えられる。もしくは、イントラ予測符号化されたフレームのみのものでも良い。巻き戻し再生のときの特定のフレームタイプとしては、イントラ予測符号化されたフレームが考えられる。また、早送り、巻き戻し再生の速度を上げる場合は、特定のフレームタイプを一部飛ばして抽出する。早送り、巻き戻し再生の速度を落とす場合は、特定のフレームタイプ以外のフレームを特定のフレームタイプに変換する。抽出、変換する判断情報としては、例えば時間情報、フレームタイプの限定、フレームをスキップする枚数をトランスコーダ７０５に送信する。 The encoded data conversion request 707 sends the encoded data 706 received from the first transmission / reception unit 108 to the transcoder 705 only for a specific frame type based on the fast-forward and rewind playback of the operation signal 115 or constant. It is requested to extract in frame units at a frame interval. At this time, as a specific frame type at the time of fast-forward reproduction, for example, a frame that has been intra-prediction coded and a frame that has been inter-prediction coded with reference to a past frame can be considered. Alternatively, only frames that have been intra prediction encoded may be used. As a specific frame type at the time of rewind reproduction, a frame that has been intra-predictively encoded can be considered. In order to increase the speed of fast forward and rewind playback, a part of a specific frame type is skipped and extracted. When reducing the speed of fast forward and rewind playback, a frame other than a specific frame type is converted into a specific frame type. As determination information to be extracted and converted, for example, time information, frame type limitation, and the number of frames to be skipped are transmitted to the transcoder 705.
　トランスコーダ７０５は、第１送受信部１０８からの符号化データ７０６を受信し、命令解析部７０４からの符号化データ変換要求７０７の内容に基づいて、受信した符号化データを変換し、これを符号化データ７０８として第２送受信部１１１へ送信する。 The transcoder 705 receives the encoded data 706 from the first transmission / reception unit 108, converts the received encoded data based on the content of the encoded data conversion request 707 from the instruction analysis unit 704, It transmits to the 2nd transmission / reception part 111 as the digitized data 708.
　図８は、本実施の形態に係るトランスコーダ７０５の詳細な構成を示すブロック図である。トランスコーダ７０５は、受信バッファ２０１、変換制御部８００、解析部８０１、画像復号部８０２、画像符号化部８０３、スイッチ８０４、送信バッファ２０３から構成される。 FIG. 8 is a block diagram showing a detailed configuration of the transcoder 705 according to the present embodiment. The transcoder 705 includes a reception buffer 201, a conversion control unit 800, an analysis unit 801, an image decoding unit 802, an image encoding unit 803, a switch 804, and a transmission buffer 203.
　変換制御部８００は、符号化データ変換要求７０７に基づいて、解析部８０１へ符号化データ抽出要求８０６を送信し、画像符号化部８０３へ符号化データ変換要求８１２を送信する。 Based on the encoded data conversion request 707, the conversion control unit 800 transmits an encoded data extraction request 806 to the analysis unit 801, and transmits an encoded data conversion request 812 to the image encoding unit 803.
　符号化データ抽出要求８０６は、受信バッファ２０１から受信した符号化データ８０５を、早送り、巻き戻し再生に基づいて特定のフレームタイプのみ、あるいは、一定のフレーム間隔でフレーム単位に抽出する様に要求する。また、早送り、巻き戻し再生の速度を上げる場合は、特定のフレームタイプを一部飛ばして抽出する様に要求する。抽出、変換する判断情報としては、例えば時間情報、フレームタイプの限定、フレームをスキップする枚数をトランスコーダ７０５に送信する。 The encoded data extraction request 806 requests that the encoded data 805 received from the reception buffer 201 be extracted only in a specific frame type based on fast forward and rewind reproduction or in units of frames at a fixed frame interval. . In order to increase the speed of fast forward and rewind playback, it is requested to skip a part of a specific frame type. As determination information to be extracted and converted, for example, time information, frame type limitation, and the number of frames to be skipped are transmitted to the transcoder 705.
　解析部８０１は、変換制御部８００から受信した符号化データ抽出要求８０６に基づいて、受信バッファ２０１からの符号化データ８０５から、特定のフレームタイプのみ、もしくは一定の間隔でフレーム単位に抽出して送信バッファ２０３へ送信する。また、符号化データ変換要求７０７で早送り、巻き戻し再生の速度を上げる様に要求があった場合は、抽出するフレームを一部飛ばして送信バッファ２０３へ送信する。例えば、読み飛ばす時間間隔の情報が通知された場合、符号化データに含まれる能力情報の時間情報を基にして、読み飛ばすフレーム枚数を計算して抽出する。 Based on the encoded data extraction request 806 received from the conversion control unit 800, the analysis unit 801 extracts a specific frame type from the encoded data 805 from the reception buffer 201 or in units of frames at regular intervals. Transmit to the transmission buffer 203. If the encoded data conversion request 707 is requested to increase the speed of fast forward and rewind reproduction, the extracted frame is skipped and transmitted to the transmission buffer 203. For example, when the information of the time interval to skip is notified, the number of frames to be skipped is calculated and extracted based on the time information of the capability information included in the encoded data.
　フレームタイプを限定する場合は、符号化データ抽出要求８０６で通知されたフレームタイプのみを抽出する。フレームをスキップする枚数が符号化データ抽出要求８０６で通知された場合は、早送り、巻き戻し再生で抽出するフレームタイプからスキップする枚数毎に抜き出して抽出する。もしくは、受信した符号化データの中からフレームスキップする枚数分読み飛ばした後に現れる特定のフレームタイプの符号化データを抽出しても良い。 When limiting the frame type, only the frame type notified by the encoded data extraction request 806 is extracted. When the number of frames to be skipped is notified by the encoded data extraction request 806, the number of frames to be skipped is extracted and extracted from the frame type extracted by fast forward and rewind playback. Alternatively, encoded data of a specific frame type that appears after skipping the number of frames skipped from the received encoded data may be extracted.
　解析部８０１は、抽出した符号化データ８１１をスイッチ８０４へ送信する。また、受信バッファ２０１から受信した符号化データ８０５を画像復号部８０２へ送信する。更に、解析部８０１は、受信バッファ２０１から受信した符号化データ８０５を解析したときの予測ミスマッチの有無の解析結果８１０や、符号化データ８０５に含まれる能力情報８０９を画像符号化部８０３へ通知する機能を有する。 The analysis unit 801 transmits the extracted encoded data 811 to the switch 804. Also, the encoded data 805 received from the reception buffer 201 is transmitted to the image decoding unit 802. Further, the analysis unit 801 notifies the image encoding unit 803 of the analysis result 810 of the presence / absence of a prediction mismatch when the encoded data 805 received from the reception buffer 201 is analyzed and the capability information 809 included in the encoded data 805. It has the function to do.
　画像復号部８０２は、解析部８０１から受信した符号化データ８０７を復号し、生成した動画像信号８０８を画像符号化部８０３へ送信する機能を有する。 The image decoding unit 802 has a function of decoding the encoded data 807 received from the analysis unit 801 and transmitting the generated moving image signal 808 to the image encoding unit 803.
　画像符号化部８０３は、変換制御部８００から受信した符号化データ変換要求８１２に基づいて、画像復号部８０２から受信した動画像信号８０８を符号化し、符号化データ８１３をスイッチ８０４へ送信する。この符号化を実行する際、解析部８０１から受信した能力情報８０９を用いて、配信サーバー７１０から受信した符号化データ７０２と同じ能力情報で符号化する。なお、能力情報は画像復号部８０２から取得しても良い。 The image encoding unit 803 encodes the moving image signal 808 received from the image decoding unit 802 based on the encoded data conversion request 812 received from the conversion control unit 800, and transmits the encoded data 813 to the switch 804. When executing this encoding, the capability information 809 received from the analysis unit 801 is used to encode with the same capability information as the encoded data 702 received from the distribution server 710. The capability information may be acquired from the image decoding unit 802.
　符号化データ変換要求としては、例えば、読み飛ばす時間間隔の情報が通知された場合、能力情報の時間情報を基にして、読み飛ばすフレーム枚数を計算して変換する。フレームをスキップする枚数が符号化データ変換要求７０７で通知された場合は、早送り、巻き戻し再生で抽出するフレームタイプからスキップする枚数毎に抜き出して変換する。 As the encoded data conversion request, for example, when information of a time interval to skip is notified, the number of frames to be skipped is calculated and converted based on the time information of capability information. When the encoded data conversion request 707 is notified of the number of frames to be skipped, the frame type extracted by fast forward and rewind playback is extracted for each skipped number and converted.
　また、符号化データ変換要求８１２で予測ミスマッチを補正する要求がされると、解析部８０１からの解析結果８１０に基づいて、対象となるフレームの動画像信号８０８を符号化して、スイッチ８０４へ符号化データ８１３を送信する。予測ミスマッチを補正する変換処理については、図１１に一例を示す。 When the encoded data conversion request 812 requests correction of the prediction mismatch, the moving image signal 808 of the target frame is encoded based on the analysis result 810 from the analysis unit 801, and the encoded signal is transmitted to the switch 804. The data 813 is transmitted. An example of the conversion process for correcting the prediction mismatch is shown in FIG.
　図１１（ａ）は予測ミスマッチの補正が行われない、一般的な符号化データの抽出を図示したものであり、同図（ｂ）は本実施の形態に係る予測ミスマッチの補正が行われた符号化データの抽出を図示したものである。同図（ａ）において、もとの符号化データにはインター予測による方式を用いて構築されたフレーム（インターフレーム）が存在し、ここから奇数フレームのみを抽出する変換を行った場合、動き補償予測のフレームが失われて予測ミスマッチが生じ、これが再生動画像の乱れとなる。一方、本実施の形態に係る同図（ｂ）では、画像符号化部８０３において、抽出後に存在するフレームを予想に使うよう再符号化が行われるので、再生動画像の乱れの問題は生じない。なお、図１１では、奇数フレームのみを抽出した場合について記載しているが、本変換処理は偶数フレームのみを抽出した場合や、任意のフレームを抽出した場合でも可能であることは明らかである。 FIG. 11 (a) illustrates the extraction of general encoded data in which prediction mismatch correction is not performed, and FIG. 11 (b) illustrates prediction mismatch correction according to the present embodiment. Fig. 4 illustrates extraction of encoded data. In FIG. 6A, the original encoded data includes a frame (interframe) constructed using an inter prediction method, and when a conversion for extracting only odd frames from this frame is performed, motion compensation is performed. A prediction frame is lost and a prediction mismatch occurs, and this causes disturbance of the reproduced moving image. On the other hand, in the same figure (b) which concerns on this Embodiment, in the image coding part 803, since re-encoding is performed so that the frame which exists after extraction may be used in anticipation, the problem of disorder of a reproduction | regeneration moving image does not arise. . Although FIG. 11 shows the case where only odd frames are extracted, it is apparent that this conversion process is possible even when only even frames are extracted or when arbitrary frames are extracted.
　図８に戻り、スイッチ８０４は、解析部８０１から受信した符号化データ８１１や、画像復号化部８０３から受信した符号化データ８１３を送信バッファ２０３へ送信する。 Returning to FIG. 8, the switch 804 transmits the encoded data 811 received from the analysis unit 801 and the encoded data 813 received from the image decoding unit 803 to the transmission buffer 203.
　本実施の形態における動画像変換装置７０１も、配信サーバー１０１の中にあっても良いし、ネットワーク上の他の場所に設置されても良い。 The moving image conversion apparatus 701 in the present embodiment may also be in the distribution server 101 or installed in another place on the network.
（第３の実施の形態の動作）
　次に、図９に沿って、端末から動画像の配信要求があった場合の、第３の実施の形態における動画像変換装置７０１における動作について説明する。図９は動画像変換装置７０１の動作を示したフローチャートである。 (Operation of the third embodiment)
Next, the operation in the moving image conversion apparatus 701 in the third embodiment when there is a moving image distribution request from the terminal will be described with reference to FIG. FIG. 9 is a flowchart showing the operation of the moving image conversion apparatus 701.
　図において、端末１０３からの動画像の配信要求があると、命令解析部７０４において、その操作信号１１５の内容が解析される（ステップＳ９０１）。命令解析部７０４は操作信号１１５から端末によって要求されている符号化データを特定し、配信サーバー７１０にその配信を要求する（ステップＳ９０２）。この要求には、符号化データをフレーム単位に順序通り、もしくは逆順に送信する要求が含まれる。配信サーバー７１０側では、この要求に従って、符号化データをフレーム単位に順序通り、もしくは逆順に送信する。 In the figure, when there is a moving image distribution request from the terminal 103, the command analysis unit 704 analyzes the contents of the operation signal 115 (step S901). The command analysis unit 704 identifies the encoded data requested by the terminal from the operation signal 115, and requests the distribution server 710 for the distribution (step S902). This request includes a request for transmitting encoded data in frame units in order or in reverse order. On the distribution server 710 side, in accordance with this request, the encoded data is transmitted in the order of frames or in reverse order.
　次いで、配信サーバー７１０からの符号化データ７０２の受信を所定のタイムアウト期間待つ（ステップＳ９０３）。符号化データが配信サーバー７１０から送信されてくると、命令解析部７０４は、先の操作信号１１５の解析結果に従って、トランスコーダ７０５に対して受信した符号化データの変換を要求する（ステップＳ９０４）。 Next, it waits for a predetermined timeout period to receive the encoded data 702 from the distribution server 710 (step S903). When the encoded data is transmitted from the distribution server 710, the command analysis unit 704 requests the transcoder 705 to convert the received encoded data according to the analysis result of the previous operation signal 115 (step S904). .
　次いで、符号化データ変換要求８１２で予測ミスマッチを補正する要求があるか判断され（ステップＳ９０５）、要求がある場合、受信データを復号化して予測ミスマッチの補正を行いこれを再符号化する（ステップＳ９０６）。 Next, it is determined whether there is a request for correcting the prediction mismatch in the encoded data conversion request 812 (step S905). If there is a request, the received data is decoded to correct the prediction mismatch and re-encoded (step S905). S906).
　トランスコーダ７０５が命令解析部７０４からの符号化データ変換要求を受けると、その要求されている再生方法、すなわち早送り、巻き戻し再生に基づいて、受信した符号化データを、特定のフレームタイプのみフレーム単位で抽出する（ステップＳ９０７）。 When the transcoder 705 receives the encoded data conversion request from the instruction analysis unit 704, the received encoded data is framed only for a specific frame type based on the requested reproduction method, that is, fast forward and rewind reproduction. Extraction is performed in units (step S907).
　また、早送り、巻き戻し再生の速度を上げる要求が操作信号１１５に含まれている場合は、特定のフレームタイプを一部飛ばして抽出する様に要求する。抽出、変換する判断情報として、例えば時間情報、フレームタイプの限定、フレームをスキップする枚数がトランスコーダ７０５に送信される。そして、この抽出された符号化データを端末１０３へ送信する（ステップＳ９０８）。端末１０３においてはこの送信された符号化データは、復号化されその要求されている方法で再生される。 If the operation signal 115 includes a request to increase the speed of fast forward / rewind playback, a request is made to skip a part of a specific frame type. As determination information to be extracted and converted, for example, time information, frame type limitation, and the number of frames to be skipped are transmitted to the transcoder 705. Then, the extracted encoded data is transmitted to the terminal 103 (step S908). In the terminal 103, the transmitted encoded data is decoded and reproduced by the requested method.
（第３の実施の形態の効果）
　以上説明したように、本実施の形態によれば、少ない演算量で、端末に多大なメモリを搭載せず、かつ端末で不要な符号化データを受信しなくても早送り、巻き戻しを行える効果がある。なお、本実施の形態では、第１および第２の実施の形態の構成に比べてトランスコーダ７０５での処理量が増える傾向があるが、端末で早送り、巻き戻しするための符号化データを復号する場合に予測ミスマッチによる画質劣化を抑え、かつ早送り、巻き戻し再生の速度調節が柔軟に行えるといった効果がある。 (Effect of the third embodiment)
As described above, according to the present embodiment, it is possible to perform fast forwarding and rewinding with a small amount of computation, without installing a large amount of memory in the terminal, and without receiving unnecessary encoded data at the terminal. There is. In this embodiment, the amount of processing in the transcoder 705 tends to increase as compared with the configurations of the first and second embodiments, but encoded data for fast forward and rewind at the terminal is decoded. In this case, the image quality deterioration due to the prediction mismatch can be suppressed, and the speed of fast forward and rewind playback can be adjusted flexibly.
　ここで、上記各実施の形態による動画像変換装置のハードウェア構成について、図１２を参照して説明する。 Here, the hardware configuration of the moving image conversion apparatus according to each of the above embodiments will be described with reference to FIG.
　図１２を参照すると、動画像変換装置は、一般的なコンピュータ装置と同様のハードウェア構成によって実現することができ、ＣＰＵ（Central
Processing Unit）１００１、ＲＡＭ（Random Access Memory）等のメインメモリであり、データの作業領域やデータの一時退避領域に用いられる主記憶部１００２、ネットワークを介して他のノードとデータの送受信を行う通信部１００３、外部装置と接続してデータの送受信を行う入出力インタフェース部１００４、入出力インタフェース部１００４を介して接続されるＲＯＭ（Read Only
Memory）、磁気ディスク、半導体メモリ等の不揮発性メモリから構成されるハードディスク装置である補助記憶部１００５、上記各構成要素を相互に接続するシステムバス１００６、ディスプレイ装置等の出力装置１００７及びキーボード等の入力装置１００８を備えている。 Referring to FIG. 12, the moving image conversion apparatus can be realized by a hardware configuration similar to that of a general computer apparatus.
A main memory such as a processing unit (1001), RAM (Random Access Memory), etc., a main storage unit 1002 used for a data work area and a temporary data save area, and communication for transmitting / receiving data to / from other nodes via a network Unit 1003, an input / output interface unit 1004 that transmits and receives data by connecting to an external device, and a ROM (Read Only) connected via the input / output interface unit 1004
Memory), an auxiliary storage unit 1005 which is a hard disk device composed of a non-volatile memory such as a magnetic disk, a semiconductor memory, a system bus 1006 for interconnecting the above components, an output device 1007 such as a display device, a keyboard, etc. An input device 1008 is provided.
　本実施の形態による動画像変換装置は、上述した各機能を提供する動画像変換プログラムを組み込んだ、ＬＳＩ（Large Scale Integration）等のハードウェア部品である回路部品を実装することにより、その動作をハードウェア的に実現することは勿論として、動画像変換装置が備える各手段の機能を提供する動画像変換プログラムを、補助記憶部１００５に格納し、そのプログラムを主記憶部１００２にロードしてＣＰＵ１００１で実行することにより、ソフトウェア的に実現することも可能である。 The moving image conversion apparatus according to the present embodiment implements its operation by mounting a circuit component that is a hardware component such as LSI (Large Scale Integration) incorporating the moving image conversion program that provides the above-described functions. As a matter of course, the moving image conversion program that provides the functions of the respective units included in the moving image conversion apparatus is stored in the auxiliary storage unit 1005, and the program is loaded into the main storage unit 1002 to load the CPU 1001. It is also possible to realize by software by executing the above.
　以上好ましい実施の形態をあげて本発明を説明したが、本発明は必ずしも、上記実施の形態に限定されるものではなく、その技術的思想の範囲内において様々に変形して実施することができる。 Although the present invention has been described with reference to the preferred embodiments, the present invention is not necessarily limited to the above embodiments, and various modifications can be made within the scope of the technical idea. .
　この出願は、２００８年３月３１日に出願された日本出願特願２００８－０９０３５６を基礎とする優先権を主張し、その開示の全てをここに取り込む。 This application claims priority based on Japanese Patent Application No. 2008-090356 filed on Mar. 31, 2008, the entire disclosure of which is incorporated herein.

Claims (25)

  1. 　操作信号の要求に従って、受信した動画像の符号化データから必要なフレームの符号化データを抽出する手段と、
    　前記抽出したフレームの符号化データを前記端末に送信する手段と
    　を備えることを特徴とする動画像変換装置。     Means for extracting encoded data of a necessary frame from encoded data of a received moving image in accordance with a request for an operation signal;
    Means for transmitting encoded data of the extracted frame to the terminal.
  2. 　動画像の前記操作信号を前記端末から受信する手段と、
    　前記受信した操作信号を解析する手段と、
    　前記操作信号の要求に従って、動画像を蓄積した配信サーバーに対象の動画像の配信を要求する手段と、
    　前記配信サーバーから動画像の符号化データを受信する手段とをさらに備えることを特徴とする請求項１に記載の動画像変換装置。     Means for receiving the operation signal of a moving image from the terminal;
    Means for analyzing the received operation signal;
    Means for requesting distribution of the target moving image to the distribution server storing the moving image according to the request of the operation signal;
    The moving image conversion apparatus according to claim 1, further comprising means for receiving encoded data of the moving image from the distribution server.
  3. 　前記操作信号の要求に従って、前記抽出されたフレームの符号化データを並び替える手段を更に備えることを特徴とする請求項１又は請求項２に記載の動画像変換装置。 3. The moving image conversion apparatus according to claim 1, further comprising means for rearranging the encoded data of the extracted frames in accordance with a request for the operation signal.
  4. 　前記必要なフレームの符号化データを抽出する手段が、前記受信した動画像の符号化データから特定のフレームタイプの符号化データのみを抽出することを特徴とする請求項１から請求項３の何れかに記載の動画像変換装置。 The means for extracting encoded data of the necessary frame extracts only encoded data of a specific frame type from the encoded data of the received moving image. A moving image conversion apparatus according to claim 1.
  5. 　前記必要なフレームの符号化データを抽出する手段が、前記受信した動画像の符号化データから一定のフレーム間隔で前記符号化データを抽出することを特徴とする請求項１から請求項４の何れかに記載の動画像変換装置。 The means for extracting the encoded data of the necessary frame extracts the encoded data from the encoded data of the received moving image at a constant frame interval. A moving image conversion apparatus according to claim 1.
  6. 　前記必要なフレームの符号化データを抽出する手段が、読み飛ばす時間間隔の情報に基づいて、前記特定のフレームタイプの符号化データを一部飛ばして抽出することを特徴とする請求項４に記載の動画像変換装置。 5. The encoded data of the necessary frame is extracted by skipping a part of the encoded data of the specific frame type based on information of a time interval to skip. Video conversion device.
  7. 　前記受信した動画像の符号化データを復号する手段と、
    　前記操作信号の要求に従って、前記復号した動画像のデータを再構成し符号化する手段とを更に備えることを特徴とする請求項１から請求項６の何れかに記載の動画像変換装置。     Means for decoding the encoded data of the received moving image;
    7. The moving image conversion apparatus according to claim 1, further comprising means for reconstructing and encoding the decoded moving image data in accordance with a request for the operation signal.
  8. 　前記復号した動画像のデータを再構成し符号化する手段が、データ上の予測ミスマッチを補正する手段を含むことを特徴とする請求項７に記載の動画像変換装置。 8. The moving picture conversion apparatus according to claim 7, wherein the means for reconstructing and encoding the decoded moving picture data includes means for correcting a prediction mismatch on the data.
  9. 　　蓄積した動画像を符号化して配信する配信サーバーと、符号化された動画像を受信し復号して再生する端末と、請求項１から請求項８に記載の動画像変換装置を、ネットワークで相互接続してなる動画像配信システム。 9. A distribution server that encodes and distributes the stored moving image, a terminal that receives the encoded moving image, decodes and reproduces it, and the moving image conversion apparatus according to claim 1 through claim 8 via a network. Connected video distribution system.
  10. 　操作信号の要求に従って、受信した動画像の符号化データから必要なフレームの符号化データを抽出するステップと、
    　前記抽出したフレームの符号化データを前記端末に送信するステップと
    を含むことを特徴とする動画像変換方法。     Extracting encoded data of a necessary frame from encoded data of a received moving image in accordance with a request for an operation signal;
    Transmitting the encoded data of the extracted frame to the terminal.
  11. 　動画像の前記操作信号を端末から受信するステップと、
    　前記受信した操作信号を解析するステップと、
    　前記操作信号の要求に従って、動画像を蓄積した配信サーバーに対象の動画像の配信を要求するステップと、
    　前記配信サーバーから動画像の符号化データを受信するステップと
    　をさらに含むことを特徴とする請求項１０に記載の動画像変換方法。     Receiving the operation signal of the moving image from the terminal;
    Analyzing the received operation signal;
    In accordance with the request for the operation signal, requesting distribution of the target moving image to the distribution server storing the moving image;
    The moving image conversion method according to claim 10, further comprising: receiving encoded data of the moving image from the distribution server.
  12. 　前記操作信号の要求に従って、前記抽出されたフレームの符号化データを並び替えるステップを更に含むことを特徴とする請求項１０又は請求項１１に記載の動画像変換方法。 The moving image conversion method according to claim 10 or 11, further comprising a step of rearranging the encoded data of the extracted frames in accordance with a request for the operation signal.
  13. 　前記必要なフレームの符号化データを抽出するステップにおいて、前記受信した動画像の符号化データから特定のフレームタイプの符号化データのみを抽出することを特徴とする請求項１０から請求項１２の何れかに記載の動画像変換方法。 13. The method according to claim 10, wherein in the step of extracting the encoded data of the necessary frame, only encoded data of a specific frame type is extracted from the encoded data of the received moving image. The moving image conversion method according to claim 1.
  14. 　前記必要なフレームの符号化データを抽出するステップにおいて、前記受信した動画像の符号化データから一定のフレーム間隔で前記符号化データを抽出することを特徴とする請求項１０から請求項１３の何れかに記載の動画像変換方法。 14. The method according to claim 10, wherein in the step of extracting the encoded data of the necessary frame, the encoded data is extracted from the encoded data of the received moving image at a constant frame interval. The moving image conversion method according to claim 1.
  15. 　前記必要なフレームの符号化データを抽出するステップにおいて、読み飛ばす時間間隔の情報に基づいて、前記特定のフレームタイプの符号化データを一部飛ばして抽出することを特徴とする請求項１３に記載の動画像変換方法。 14. The step of extracting encoded data of the necessary frame includes extracting a part of the encoded data of the specific frame type based on information of a time interval to skip. Video conversion method.
  16. 　前記受信した動画像の符号化データを復号するステップと、
    　前記操作信号の要求に従って、前記復号した動画像のデータを再構成し符号化するステップと、
    を更に含むことを特徴とする請求項１０から請求項１５の何れかに記載の動画像変換方法。     Decoding the encoded data of the received moving image;
    Reconstructing and encoding the decoded video data in accordance with the operation signal request;
    The moving image conversion method according to claim 10, further comprising:
  17. 　前記復号した動画像のデータを再構成し符号化するステップが、データ上の予測ミスマッチを補正するステップを備えることを特徴とする請求項１６に記載の動画像変換方法。 The moving image conversion method according to claim 16, wherein the step of reconstructing and encoding the decoded moving image data includes a step of correcting a prediction mismatch on the data.
  18. 　コンピュータに、
    　操作信号の要求に従って、受信した動画像の符号化データから必要なフレームの符号化データを抽出する処理と、
    　前記抽出したフレームの符号化データを前記端末に送信する処理と、を実行させることを特徴とする動画像変換プログラム。     On the computer,
    A process of extracting encoded data of a necessary frame from encoded data of a received moving image in accordance with a request for an operation signal;
    And a process of transmitting encoded data of the extracted frame to the terminal.
  19. 　前記コンピュータに、
    　動画像の前記操作信号を端末から受信する処理と、
    　前記受信した操作信号を解析する処理と、
    　前記操作信号の要求に従って、動画像を蓄積した配信サーバーに対象の動画像の配信を要求する処理と、
    　前記配信サーバーから動画像の符号化データを受信する処理をさらに実行させることを特徴とする請求項１８に記載の動画像変換プログラム。     In the computer,
    A process of receiving the operation signal of the moving image from the terminal;
    Processing for analyzing the received operation signal;
    In accordance with the request for the operation signal, a process for requesting distribution of the target moving image to the distribution server storing the moving image;
    19. The moving image conversion program according to claim 18, further comprising executing processing for receiving encoded data of the moving image from the distribution server.
  20. 　前記操作信号の要求に従って、前記抽出されたフレームの符号化データを並び替える処理を更に含むことを特徴とする請求項１８又は請求項１９に記載の動画像変換プログラム。 The moving image conversion program according to claim 18 or 19, further comprising a process of rearranging the encoded data of the extracted frames in accordance with a request for the operation signal.
  21. 　前記必要なフレームの符号化データを抽出する処理において、前記受信した動画像の符号化データから特定のフレームタイプの符号化データのみを抽出することを特徴とする請求項１８から請求項２０の何れかに記載の動画像変換プログラム。 21. Any one of claims 18 to 20, wherein in the process of extracting the encoded data of the necessary frame, only encoded data of a specific frame type is extracted from the encoded data of the received moving image. The moving image conversion program described in Crab.
  22. 　前記必要なフレームの符号化データを抽出する処理において、前記受信した動画像の符号化データから一定のフレーム間隔で前記符号化データを抽出することを特徴とする請求項１８から請求項２１の何れかに記載の動画像変換プログラム。 The encoded data of the necessary frame is extracted from the encoded data of the received moving image at a predetermined frame interval in the process of extracting the encoded data of the necessary frame. The moving image conversion program described in Crab.
  23. 　前記必要なフレームの符号化データを抽出する処理において、読み飛ばす時間間隔の情報に基づいて、前記特定のフレームタイプの符号化データを一部飛ばして抽出することを特徴とする請求項２１に記載の動画像変換プログラム。 23. The process of extracting encoded data of the necessary frame, wherein a part of the encoded data of the specific frame type is skipped and extracted based on information of a time interval to be skipped. Video conversion program.
  24. 　前記受信した動画像の符号化データを復号する処理と、
    　前記操作信号の要求に従って、前記復号した動画像のデータを再構成し符号化する処理と、
    を更に含むことを特徴とする請求項１９から請求項２３の何れかに記載の動画像変換プログラム。     A process of decoding the encoded data of the received moving image;
    Processing to reconstruct and encode the decoded moving image data in accordance with the operation signal request;
    The moving image conversion program according to any one of claims 19 to 23, further comprising:
  25. 　前記復号した動画像のデータを再構成し符号化する処理が、データ上の予測ミスマッチを補正する処理を備えることを特徴とする請求項２４に記載の動画像変換プログラム。
          25. The moving picture conversion program according to claim 24, wherein the process of reconstructing and encoding the decoded moving picture data includes a process of correcting a prediction mismatch on the data.
PCT/JP2009/055420 2008-03-31 2009-03-19 Dynamic image conversion device, dynamic image delivery system, method for converting dynamic image and program WO2009122925A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2010505591A JP5472094B2 (en) 2008-03-31 2009-03-19 Moving image conversion apparatus, moving image distribution system, moving image conversion method, and program

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2008-090356 2008-03-31
JP2008090356 2008-03-31

Publications (1)

Publication Number Publication Date
WO2009122925A1 true WO2009122925A1 (en) 2009-10-08

Family

ID=41135308

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2009/055420 WO2009122925A1 (en) 2008-03-31 2009-03-19 Dynamic image conversion device, dynamic image delivery system, method for converting dynamic image and program

Country Status (2)

Country Link
JP (1) JP5472094B2 (en)
WO (1) WO2009122925A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012015928A (en) * 2010-07-05 2012-01-19 Hitachi Consumer Electronics Co Ltd Video transmission device
GB2499485A (en) * 2012-02-16 2013-08-21 Bosch Gmbh Robert System for providing trick play operating modes for video streams at the request of a client device.
JP2020162039A (en) * 2019-03-27 2020-10-01 日本電気株式会社 Data relay device, data relay method, and program

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001028748A (en) * 1999-07-12 2001-01-30 Sony Corp Data reproduction transmitter and data reproduction transmission method
JP2005184254A (en) * 2003-12-17 2005-07-07 Mitsubishi Electric Corp Special video data processing method, special video data processing apparatus, and special video data processing system

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001028748A (en) * 1999-07-12 2001-01-30 Sony Corp Data reproduction transmitter and data reproduction transmission method
JP2005184254A (en) * 2003-12-17 2005-07-07 Mitsubishi Electric Corp Special video data processing method, special video data processing apparatus, and special video data processing system

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012015928A (en) * 2010-07-05 2012-01-19 Hitachi Consumer Electronics Co Ltd Video transmission device
GB2499485A (en) * 2012-02-16 2013-08-21 Bosch Gmbh Robert System for providing trick play operating modes for video streams at the request of a client device.
JP2013168941A (en) * 2012-02-16 2013-08-29 Robert Bosch Gmbh Video system for displaying image data, method, and computer program, and coder device
US9467691B2 (en) 2012-02-16 2016-10-11 Robert Bosch Gmbh Video system for displaying image data, method and computer program
GB2499485B (en) * 2012-02-16 2019-06-26 Bosch Gmbh Robert Video system for representing pictorial data,process and computer program
JP2020162039A (en) * 2019-03-27 2020-10-01 日本電気株式会社 Data relay device, data relay method, and program
JP7310212B2 (en) 2019-03-27 2023-07-19 日本電気株式会社 Data relay device, data relay method and program

Also Published As

Publication number Publication date
JPWO2009122925A1 (en) 2011-07-28
JP5472094B2 (en) 2014-04-16

Similar Documents

Publication Publication Date Title
JP3923898B2 (en) Image coding method and apparatus
JP5090158B2 (en) VIDEO INFORMATION RECORDING DEVICE, VIDEO INFORMATION RECORDING METHOD, VIDEO INFORMATION RECORDING PROGRAM, AND RECORDING MEDIUM CONTAINING VIDEO INFORMATION RECORDING PROGRAM
JP4983917B2 (en) Moving image distribution system, conversion device, and moving image distribution method
CN100555332C (en) Use comprises that the prediction of a plurality of macro blocks and nonanticipating picture are to picture sequence Methods for Coding and device
KR101147744B1 (en) Method and Apparatus of video transcoding and PVR of using the same
JP5472094B2 (en) Moving image conversion apparatus, moving image distribution system, moving image conversion method, and program
KR101817272B1 (en) Dynamic image predictive encoding and decoding device, method, and program
CN101888545B (en) Compression coding method for signal source with low code rate
JP2016158282A (en) Moving image prediction decoding method and moving image prediction decoding apparatus
KR101099261B1 (en) Device and Method for encoding, Storage medium storing the same
JP4462559B2 (en) Trick playback content creation method and device, trick playback compressed video data transmission method and device, and trick playback content creation program
KR20160088951A (en) Video prediction encoding device, video prediction encoding method, video prediction encoding program, video prediction decoding device, video prediction decoding method, and video prediction decoding program
US11490121B2 (en) Transform device, decoding device, transforming method, and decoding method
KR101054644B1 (en) Motion Estimation Based Image Coding / Decoding Apparatus and Method
JP2009290387A (en) Encoder, decoder and recording reproducing device
JP2005159832A (en) Signal processor
CN102577130A (en) Transcoder from first MPEG stream to second MPEG stream
KR20100010605A (en) A transfer device of encoded data of analog camera signals on networks and a method for composing images therefor
JP2003309803A (en) Video stream editor
JP2007151163A (en) Image decoding method and apparatus

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 09726761

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2010505591

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 09726761

Country of ref document: EP

Kind code of ref document: A1