KR101141020B1 - System and method for detecting an error of result in fast video ingesting - Google Patents

Abstract

According to the present invention, when performing ingestion such as image size and transmission rate, encoding, metadata insertion, packaging process, etc., on image data provided from a content provider (CP) to service high speed image data to a user terminal. The present invention relates to a fast image ingestion error detection method and system for detecting an ingestion error based on verification original data.

A high speed video ingestion error detection method of a content server according to the present invention is a high speed video ingestion error detection method of a content server providing content including video and audio to a user terminal through a communication network. Converting video and audio of the original content for servicing to the output signal standard; (b) generating and storing original data for verification by converting a smaller resolution of the converted video and audio; (c) when encoding the video and audio of the original content, change the video and audio to the same resolution as the verification original data, and then calculate and store a first MSE with the verification original data for each frame. Making; (d) generating the encoded video and audio as packet content; And (e) determining as an ingestion error when the calculated first MSE value is less than or equal to a specific value.

According to the present invention, it is possible to automate error detection during ingestion of a high speed image, thereby increasing the ingestion efficiency of the high speed image.

Description

System and method for detecting an error of result in fast video ingesting}

The present invention relates to a method and a system for detecting an error of an ingestion result of a high speed video. More particularly, the present invention relates to a video data provided from a content provider (CP) to service high speed video data to a user terminal. Ingestion error detection method and system for detecting ingestion error based on original data for verification when performing ingestion such as size, transmission rate, encoding, metadata insertion, and packaging process It is about.

Typically, video and audio signals are converted to digital formats according to established algorithms or schemes, and then compressed, encoded and multiplexed (multiplexed). The compressed digital signal, i.e., the bitstream, comprises a video portion, an audio portion and other information portions, which are stored in a transmission line or stored on a recording medium and transmitted to a playback device.

That is, the content including the video and audio provided from the content provider (CP) is converted into a form that can be serviced to the terminal through an ingesting system (Ingesting System) to service the user terminal. That is, basic resolution, frame rate conversion, video / audio encoding, metadata insertion, and packaging are performed.

On the other hand, in a digital player for playing multimedia data multiplexed with video data and audio data, such as a user terminal or computer system incorporating a DVD system, a digital VCR, or a multimedia player solution, decoding means for reproducing the above bitstream. This is provided.

However, in a content server that provides content including video or audio, a problem occurs in playback when a user terminal serves a video in which an error occurs when the above-described ingestion process is performed. To prevent this, the final result is played back and the user finally checks it.

However, since most of the videos provided by the content server to the user terminal are large or massive, the user checks each one in order to ingest it.

An object of the present invention for solving the above problems, the size and transmission rate of the image data, the encoding, metadata insertion, packaging process for the image data provided from the content provider (CP) to service high-speed image data to the user terminal High speed video ingestion error detection method and system, content server and its high speed video ingestion error detection method, user to detect ingestion error based on original data for verification when performing ingestion. A terminal and a fast image ingestion error detection method thereof are provided.

In the high-speed video ingestion error detection system according to the present invention for achieving the above object, the verification for each frame after changing to the same resolution as the original data for verification, when ingesting the original content including video and audio A content server that calculates an MSE with the original data and determines an ingestion error if the calculated MSE value is less than or equal to a specific value; And a user terminal for receiving, decoding, and displaying the ingested content from the content server.

Here, the verification original data is obtained by converting video and audio according to an output signal standard with respect to the original content, and converting a smaller resolution to original data of the converted video and audio.

On the other hand, the content server according to the present invention for achieving the above object, the video / audio conversion unit for converting the video and audio of the original content in accordance with the output signal standard to service the user terminal; A verification data generator for converting the converted video and audio to a smaller resolution to generate and store verification original data; When encoding video and audio of the original content, the video / audio encoder converts the video and audio to the same resolution as the verification original data and calculates and stores an MSE with the verification original data for each frame. ; A packet generator for generating the encoded video and audio content in packet units; And a controller for determining an ingestion error when the calculated MSE value is equal to or less than a specific value.

In addition, a decoding check unit for checking whether the content can be played in the user terminal; A video / audio checker to check whether video and audio are normally played when the content is playable; A content information database storing information about the original content or video, audio, and metadata of the content; And a metadata confirmation unit for confirming whether the video information of the content information database and the metadata information of the ingested video match.

The content information database stores information such as resolution, frame rate, sampling rate, and number of channels of the original content or the video and audio of the content.

The control unit may further include a first MSE value of a low resolution original content and a content obtained as a result of encoding at the time of ingesting the original content, the final content that is ingested, and a low resolution original content as a result of decoding the ingested final content. The second MSE value of the content is compared to determine an ingestion error when the difference of the compared values is equal to or less than a specific value.

On the other hand, the user terminal according to the present invention for achieving the above object, a communication unit for communicating with the content server; A signal information confirmation unit confirming ingestion signal information with respect to the content received from the content server; A video / audio decoding unit for decoding video and audio of the content; A verification data storage unit for storing verification original data received from the content server; A content verification unit which converts the video and audio of the content into the resolution of the verification original data, compares it with the verification original data, and calculates an MSE value with the verification original data; And a controller configured to determine that the content is an ingestion error when the calculated MSE value is less than or equal to a specific value, and to transmit a message indicating that there is an ingestion error to the content server.

The signal information checking unit may be further configured to determine whether the signal information such as the resolution, frame rate, sampling rate, number of channels, and the like of the video and audio is identical to the signal information during ingestion from the bitstream of the received content. Check with

On the other hand, the high-speed video ingestion error detection method of the content server according to the present invention for achieving the above object, the high-speed video ingestion error detection of the content server for providing content including video and audio to the user terminal through a communication network A method, comprising: (a) converting video and audio of an original content for serving a user terminal to an output signal standard; (b) converting the converted video and audio to a smaller resolution to generate and store original data for verification; (c) when encoding the video and audio of the original content, change the video and audio to the same resolution as the verification original data, and then calculate and store a first MSE with the verification original data for each frame. Making; (d) generating the encoded video and audio as packet content; And (e) determining as an ingestion error when the calculated first MSE value is less than or equal to a specific value.

(F) checking whether the signal information of video and audio is the same as the signal information at the ingestion from the bitstream of the ingested content; (g) decoding the video and audio of the bitstream; (h) converting the decoded video and audio to the same resolution as the verification original data and comparing the same to calculate a second MSE value; And (i) if the difference between the calculated second MSE value and the first MSE value at the time of encoding of the step (c) is greater than or equal to a specific value, determining an ingestion error.

In the step (f), the signal information includes a resolution, a frame rate, a sampling rate, the number of channels, and the like.

In step (g), the elementary stream and the metadata of the bitstream are extracted and stored as original data, and if a non-stress syntax syntax error of the elementary stream is detected, it is determined as an ingestion error.

On the other hand, the high speed video ingestion error detection method of the user terminal according to the present invention for achieving the above object, as a high speed video ingestion error detection method of the user terminal for receiving and displaying the content from the content server through a communication network, ( a) receiving the content and the original data for verification from the content server; (b) confirming ingestion signal information for the received content; (c) decoding the video and audio of the content; (d) converting the video and audio of the content to the resolution of the original data for verification, comparing the original data for verification, and calculating a first MSE value with the original data for verification; And (e) determining that the content is an ingestion error when the calculated first MSE value is less than or equal to a specific value, and transmitting a message indicating that the received content has an ingestion error to the content server. Include.

Also, in the step (b), the original data for verification is used to determine whether the signal information such as the resolution, frame rate, sampling rate, number of channels, and the like of video and audio is the same as the signal information during ingestion from the bitstream of the received content. Confirm on the basis.

In addition, if a bitstream syntax error of the elementary stream is detected in the bitstream of the received content of step (c), it is determined to be an ingestion error.

And, in the step (e), if the difference between the first MSE value and the second MSE value at the time of encoding the original data for verification is greater than or equal to a specific value, it is determined to be an ingestion error, and the ingestion error to the received content. A message indicating that there is a message is transmitted to the content server.

On the other hand, the fast image ingestion error detection method of the content server according to the present invention can be recorded as a program on a recording medium such as a CD or USB memory.

According to the present invention, the user terminal is a signal information, such as the resolution of the video and audio (frame rate), sampling rate (channel rate), the number of channels from the bitstream of the received content is signal information when ingesting Verification can be made based on the original data for verification.

In addition, the user terminal may convert the video and audio of the content to the resolution of the original data for verification through the content verification unit, compare the original data for verification, and calculate a MSE (Mean Square Error) value with the original data for verification. .

In addition, it is possible to automate error detection during ingestion of a high speed image, thereby increasing the ingestion efficiency of the high speed image.

As the ingestion error is detected based on the original data for verification, the quality of the received content can be improved.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the like elements throughout. Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram schematically showing the configuration of a fast image ingestion error detection system according to an embodiment of the present invention.

Referring to FIG. 1, the fast image ingestion error detection system 100 according to the present invention includes a user terminal 110, a communication network 120, and a content server 130.

The user terminal 110 receives, decodes, and displays the content ingested from the content server 130 through the communication network 120. In this case, the user terminal 110 may be a computer terminal or a mobile terminal.

The communication network 120 may be a wired communication network including the Internet or a wireless communication network including a mobile communication network.

The content server 130 is a server that provides content such as multimedia data to the user terminal 110 through the communication network 120.

In addition, when ingesting the original content including video and audio, the content server 130 changes the resolution to the same resolution as the raw data for verification, and then the verification original for each frame. Mean Square Error (MSE) with the data is calculated and determined as an Ingesting Error if the calculated MSE value is below a specified value.

Here, the verification original data is obtained by converting video and audio according to an output signal standard with respect to the original content, and converting the resolution smaller with respect to the original data of the converted video and audio.

2 is a configuration diagram schematically showing an internal configuration of a user terminal according to an embodiment of the present invention.

Referring to FIG. 2, the user terminal 110 according to the present invention includes a communication unit 210, a signal information checking unit 220, a video / audio decoding unit 230, a verification data storage unit 240, and a control unit ( 250, a content verification unit 260, an input unit 270, and a display unit 280.

The communication unit 210 communicates with the content server 130.

The signal information checker 220 checks the ingesting signal information on the content received from the content server 130. In addition, the signal information checking unit 220 ingests signal information such as resolution, frame rate, sampling rate, and number of channels from the bitstream of the received content. Check on the basis of the original data for verification whether it is the same as city signal information.

The video / audio decoding unit 230 decodes video and audio of the content.

The verification data storage unit 240 stores the verification original data received from the content server 130.

The content verification unit 260 converts the video and audio of the content into the resolution of the verification original data, compares the verification original data, and calculates an MSE value with the verification original data.

If the calculated MSE value is less than or equal to a specific value, the controller 250 determines that the content is an ingestion error, and controls to transmit a message indicating that there is an ingestion error to the content server 130.

The input unit 270 receives data from a user.

The display unit 280 displays the operation state of the terminal or displays the received content on the screen.

3 is a configuration diagram schematically showing an internal configuration of a content server according to an embodiment of the present invention.

Referring to FIG. 3, the content server 130 according to the present invention includes a communication unit 310, a video / audio converter 320, a verification data generator 330, a video / audio encoder 340, and a packet generator. The unit 350 includes a decoding confirmation unit 360, a control unit 370, a video / audio confirmation unit 372, a metadata confirmation unit 374, and a content information database 380.

The communication unit 310 communicates with the user terminal 110 through the communication network 120.

The video / audio converter 320 converts the video and audio of the original content according to the output signal standard to serve the user terminal 110.

The verification data generation unit 330 converts the resolution of the converted video and audio into smaller resolutions to generate and store raw data for verification.

When encoding the video and audio of the original content, the video / audio encoder 340 changes the video and audio to the same resolution as the original data for verification, and then, for each frame, a square error of MSE with the original data for verification. Calculate and save).

The packet generator 350 generates encoded video and audio as packet content.

The decoding check unit 360 checks whether the content can be played in the user terminal 110.

The controller 370 includes a controller that determines an ingestion error when the calculated MSE value is equal to or less than a specific value. In addition, the controller 370, when ingesting the original content, decodes the first MSE value of the low resolution original content and the content obtained as the encoding result and the final content ingested, and the low resolution original content. The second MSE value of the content is compared to determine an ingestion error when the difference of the compared values is equal to or less than a specific value.

The video / audio checker 372 confirms whether video and audio are normally played when the content is playable.

The metadata checking unit 374 checks whether the video information of the content information database 380 and the metadata information of the ingested video match.

The content information database 380 stores information about original content or video, audio, and metadata of the content.

In addition, the content information database 380 stores information such as resolution, frame rate, sampling rate, and number of channels of the original content or the video and audio of the content.

4 is a flowchart illustrating a method of detecting a fast image ingestion error of a content server according to an exemplary embodiment of the present invention.

Referring to FIG. 4, the content server 130 converts video and audio of original content for service to the user terminal 110 according to an output signal standard (S402).

Subsequently, the content server 130 converts the resolution of the converted video and audio to a smaller size to generate and store original data for verification (S404).

Subsequently, when encoding the video and audio of the original content, the content server 130 changes the video and audio to the same resolution as the original data for verification, and then, for each frame, the first server MSE (Mean Square) with the original data for verification. Error) is calculated and stored (S406).

Subsequently, the content server 130 generates encoded video and audio as packet content (S408).

When the calculated first MSE value is equal to or less than a specific value (S410), the content server 130 determines that it is an ingestion error (S412).

5 is a flowchart illustrating an operation of a decoding check unit in a content server according to an exemplary embodiment of the present invention.

Referring to FIG. 5, the content server 130 operates as follows through the decoding verification unit 360. That is, the content server 130 checks whether the signal information of the video and the audio is the same as the signal information at the ingestion from the bitstream of the ingested content (S510). In this case, the signal information includes a resolution, a frame rate, a sampling rate, the number of channels, and the like.

Next, if the signal information of the video and audio of the ingested content is the same as the signal information at the ingesting (S512), the content server 130 decodes the video and audio of the bitstream (S520).

At this time, the content server 130 extracts and stores the elementary stream and the metadata of the bitstream as original data, and determines that the bitstream syntax error of the elementary stream is an ingestion error. do.

Subsequently, the content server 130 converts the decoded video and audio to the same resolution as the verification original data and compares the same to calculate a second MSE value (S530).

The content server 130 checks whether the difference between the calculated second MSE value and the first MSE value at the time of encoding is equal to or greater than a specific value (S540). If the content server 130 is greater than or equal to a specific value (S542), the content server 130 determines an ingestion error. (S550).

6 is a flowchart illustrating a method of detecting a fast image ingestion error of a user terminal according to another exemplary embodiment of the present invention.

6, the user terminal 110 according to the present invention receives the content and the original data for verification from the content server 130 (S610).

Subsequently, the user terminal 110 checks ingestion signal information with respect to the received content (S620).

At this time, the user terminal 110, the signal information such as the resolution, frame rate, sampling rate, the number of channels, etc. of the video and audio from the bit stream of the received content is ingested signal information Verify based on original data for verification.

Subsequently, the user terminal 110 decodes video and audio of the content (S630).

In this case, the user terminal 110 determines that an ingestion error is detected when a bitstream syntax error of the elementary stream is detected in the bitstream of the received content.

Subsequently, the user terminal 110 converts the video and audio of the content into the resolution of the original data for verification, compares the original data for verification, and calculates a first MSE value with the original data for verification (S640).

Subsequently, when the calculated first MSE value is equal to or less than a specific value (S650), the user terminal 110 determines that the content is an ingestion error (S660).

The user terminal 110 transmits a message indicating that there is an ingestion error in the received content to the content server 130 (S670).

In this case, if the difference between the first MSE value and the second MSE value at the time of encoding the original data for verification is greater than or equal to a specific value, the user terminal 110 determines that the ingestion error is generated, and indicates that there is an ingestion error in the received content. The message is transmitted to the content server 130.

As described above, according to the present invention, ingestion such as image size and transmission rate, encoding, metadata insertion, and packaging process for image data provided from a content provider (CP) to provide high-speed image data to a user terminal is provided. High speed video ingestion error detection method and system, content server and its high speed video ingestion error detection method, user terminal and its high speed enabling ingesting error to be detected based on original data for verification when performing ingesting) A video ingestion error detection method can be realized.

As those skilled in the art to which the present invention pertains may implement the present invention in other specific forms without changing the technical spirit or essential features, the embodiments described above should be understood as illustrative and not restrictive in all aspects. Should be. The scope of the present invention is shown by the following claims rather than the detailed description, and all changes or modifications derived from the meaning and scope of the claims and their equivalents should be construed as being included in the scope of the present invention. do.

The present invention can be applied to a service and a system for transmitting content including video data from a content server to a user terminal.

In addition, the present invention may be applied to a content server performing an ingestion process for transmitting content to a mobile terminal.

In addition, the present invention may be applied to a mobile communication system including a content server that serves content using a mobile communication network or a mobile terminal that receives and displays content.

1 is a block diagram schematically showing the configuration of a fast image ingestion error detection system according to an embodiment of the present invention.

2 is a configuration diagram schematically showing an internal configuration of a user terminal according to an embodiment of the present invention.

3 is a configuration diagram schematically showing an internal configuration of a content server according to an embodiment of the present invention.

4 is a flowchart illustrating a method of detecting a fast image ingestion error of a content server according to an exemplary embodiment of the present invention.

5 is a flowchart illustrating an operation of a decoding check unit in a content server according to an exemplary embodiment of the present invention.

6 is a flowchart illustrating a method of detecting a fast image ingestion error of a user terminal according to another exemplary embodiment of the present invention.

<Description of Symbols for Main Parts of Drawings>

100: high speed image ingestion error detection system 110: user terminal

120: communication network 130: content server

210: communication unit 220: signal information confirmation unit

230: video / audio decoding unit 240: verification data storage unit

250: control unit 260: content verification unit

270: input unit 280: display unit

310: communication unit 320: video / audio conversion unit

330: Verification data generation unit 340: Video / audio encoder

350: packet generation unit 360: decoding confirmation unit

370: control unit 372: video / audio confirmation unit

374: metadata verification unit 380: content information database

Claims (17)

When ingesting the original content including video and audio, change to the same resolution as the raw data for verification and measure the square error of the MSE with the original data for verification for each frame. A content server for determining an ingesting error if the calculated MSE value is less than or equal to a specific value; And A user terminal for receiving, decoding and displaying the ingested content from the content server; High speed image ingestion error detection system comprising a. The method of claim 1, The verification original data is obtained by converting video and audio according to an output signal standard with respect to the original content, and converting a smaller resolution to original data of the converted video and audio. Error detection system. A video / audio converter for converting video and audio of original content to an output signal standard for serving a user terminal; A verification data generator for converting the converted video and audio to a smaller resolution and generating and storing raw data for verification; When encoding the video and audio of the original content, change the video and audio to the same resolution as the verification original data, and calculate and store MSE (Mean Square Error) with the verification original data for each frame. Video / audio encoders; A packet generator for generating the encoded video and audio content in packet units; And A controller for determining an ingestion error when the calculated MSE value is less than or equal to a specific value; Content server comprising a. The method of claim 3, wherein A decoding confirmation unit confirming whether or not the content is playable in the user terminal; A video / audio checker to check whether video and audio are normally played when the content is playable; A content information database storing information about the original content or video, audio, and metadata of the content; And A metadata checking unit which checks whether the video information of the content information database and the metadata information of the ingested video match; Content server, characterized in that it further comprises. The method of claim 4, wherein The content information database stores information including a resolution, a frame rate, a sampling rate, and the number of channels of the original content or the video and audio of the content. Content server. The method of claim 3, wherein The controller may further include the first MSE value of the low resolution original content and the content obtained as a result of the encoding when encoding the original content, and the resultant content and the low resolution original content as the result of decoding the ingested final content. And comparing the second MSE values to determine an ingestion error when the difference is less than or equal to a specific value. A communication unit for communicating with a content server; A signal information confirmation unit confirming ingestion signal information with respect to the content received from the content server; A video / audio decoding unit for decoding video and audio of the content; A verification data storage unit for storing verification original data received from the content server; A content verification unit which converts the video and audio of the content into the resolution of the verification original data, compares it with the verification original data, and calculates an MSE value with the verification original data; And A controller configured to determine that the content is an ingestion error when the calculated MSE value is less than or equal to a specific value, and to transmit a message indicating that there is an ingestion error to the content server; User terminal comprising a. The method of claim 7, wherein The signal information checking unit may include signal information including resolution, frame rate, sampling rate, and number of channels from the bitstream of the received content. User terminal, characterized in that for verifying whether the same as the original data for verification. A fast image ingestion error detection method of a content server that provides content including video and audio to a user terminal through a communication network, (a) converting video and audio of original content for service to the user terminal according to an output signal standard; (b) generating and storing original data for verification by converting a smaller resolution of the converted video and audio; (c) when encoding the video and audio of the original content, after changing the video and audio to the same resolution as the verification original data, for each frame, a first MSE (Mean Square Error) with the verification original data; Calculating and storing; (d) generating the encoded video and audio as packet content; And (e) determining an ingestion error when the calculated first MSE value is equal to or less than a specific value; High speed image ingestion error detection method of a content server comprising a. The method of claim 9, (f) confirming whether signal information of video and audio is identical to signal information at ingestion from the bitstream of the ingested content; (g) decoding the video and audio of the bitstream; (h) converting the decoded video and audio to the same resolution as the verification original data and comparing the same to calculate a second MSE value; And (i) determining an ingestion error if the difference between the calculated second MSE value and the first MSE value at the time of encoding (c) is greater than or equal to a specific value; High speed image ingestion error detection method of a content server comprising a. 11. The method of claim 10, And in step (f), the signal information includes a resolution, a frame rate, a sampling rate, and the number of channels. 11. The method of claim 10, In step (g), the elementary stream and the metadata of the bitstream are extracted and stored as original data, and if a bitstream syntax error of the elementary stream is detected, an ingestion error is determined. High speed image ingestion error detection method of a content server, characterized in that. A fast image ingestion error detection method of a user terminal for receiving and displaying content from a content server through a communication network, (a) receiving the content and the original data for verification from the content server; (b) confirming ingestion signal information for the received content; (c) decoding the video and audio of the content; (d) converting the video and audio of the content to the resolution of the original data for verification, comparing the original data for verification, and calculating a first MSE value with the original data for verification; And (e) determining that the content is an ingestion error when the calculated first MSE value is less than or equal to a specific value, and transmitting a message indicating that the received content has an ingestion error to the content server; High speed image ingestion error detection method of a user terminal comprising a. The method of claim 13, In the step (b), the signal information including the resolution, frame rate, sampling rate, and number of channels from the bitstream of the received content is signaled when ingesting. The high speed image ingestion error detection method of the user terminal, characterized in that for verifying whether the same as the information based on the original data for verification. The method of claim 13, And detecting a bitstream syntax error of an elementary stream in the bitstream of the received content of step (c), determining that the ingestion error is an ingestion error. The method of claim 13, In the step (e), if the difference between the first MSE value and the second MSE value at the time of encoding the verification original data is greater than or equal to a specific value, it is determined to be an ingestion error, and the received content has an ingestion error. High speed image ingestion error detection method of a user terminal, characterized in that for transmitting a message informing to the content server. A medium recording a high speed image ingestion error detection method of a content server that provides content including video and audio to a user terminal through a communication network. (a) converting video and audio of original content for service to the user terminal according to an output signal standard; (b) generating and storing original data for verification by converting a smaller resolution of the converted video and audio; (c) when encoding the video and audio of the original content, after changing the video and audio to the same resolution as the verification original data, for each frame, a first MSE (Mean Square Error) with the verification original data; Calculating and storing; (d) generating the encoded video and audio as packet content; And (e) determining an ingestion error when the calculated first MSE value is equal to or less than a specific value; A computer-readable recording medium recording a high speed image ingestion error detection method of a content server including a program.

Images