CN110557592B - HDMI multimedia data quality evaluation method, device and system - Google Patents
HDMI multimedia data quality evaluation method, device and system Download PDFInfo
- Publication number
- CN110557592B CN110557592B CN201910871107.6A CN201910871107A CN110557592B CN 110557592 B CN110557592 B CN 110557592B CN 201910871107 A CN201910871107 A CN 201910871107A CN 110557592 B CN110557592 B CN 110557592B
- Authority
- CN
- China
- Prior art keywords
- multimedia data
- hdmi
- multimedia
- quality
- evaluating
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/015—High-definition television systems
Abstract
The invention provides a method, a device and a system for evaluating the quality of HDMI multimedia data, wherein the method is applied to an HDMI multimedia data quality evaluation system and comprises the following steps: step S1: receiving multimedia data transmitted by a multimedia terminal; step S2: and evaluating the received multimedia data and outputting an evaluation result. By the scheme, the quality of the HDMI multimedia transmission data content can be measured, so that the quality defect of the HDMI transmission data can be found in time.
Description
Technical Field
The invention relates to the field of multimedia, in particular to a method and a device for evaluating the quality of HDMI multimedia data.
Background
A High Definition Multimedia Interface (HDMI) is a fully digital video and audio transmission Interface, and can transmit uncompressed audio and video signals. The HDMI can be used for set-top boxes, DVD players, personal computers, video players, comprehensive amplifiers, digital audio devices, televisions and other equipment. HDMI can send audio frequency and video signal simultaneously, because audio frequency and video signal adopt same wire rod, simplifies the installation degree of difficulty of system's circuit greatly.
The multimedia transmission capability of HDMI is very important for multimedia terminals such as set-top boxes, televisions, and advertising machines. However, in the prior art, even if a professional HMDI test instrument is adopted, it is difficult to find the abnormal phenomenon existing in the HDMI transmission multimedia, and the professional HMDI test instrument only pays attention to whether the transmission signal meets the standard, but does not pay attention to the content of the HDMI transmission. Therefore, image anomaly, audio anomaly and video anomaly of the HDMI in the prior art can not be quantitatively measured generally.
Disclosure of Invention
Therefore, a technical scheme for evaluating the quality of the HDMI multimedia data needs to be provided to solve the problem that the quality of the content of the HDMI multimedia transmission data cannot be measured in the prior art.
In order to achieve the above object, the inventor provides an HDMI multimedia data quality evaluation method, which is applied to an HDMI multimedia data quality evaluation system, and the method includes the following steps:
step S1: receiving multimedia data transmitted by a multimedia terminal;
step S2: and evaluating the received multimedia data and outputting an evaluation result.
Further, before step S1, the method further includes:
entering a multimedia data quality evaluation mode after detecting that the connection with the multimedia terminal is established;
and receiving a test command, and starting a multimedia test item corresponding to the test command through CEC.
Further, the test command is an image single-item test command, and the method comprises the following steps:
receiving pure color image data transmitted by a multimedia terminal and displaying a corresponding picture;
and evaluating the picture unicity and the color value consistency of the display picture, and outputting an image quality related evaluation result.
Further, the test command is an audio single-item test command, and the method comprises the following steps:
receiving audio data transmitted by a multimedia terminal;
and detecting the received audio information, identifying abnormal sound segment information in the audio information, and outputting an audio quality related evaluation result according to the abnormal sound segment information.
Further, the test command is a video single-item test command, and the method comprises the following steps:
receiving video data transmitted by a multimedia terminal; the video data is the video data with the preset frame rate, the received video information is detected, abnormal frame information in the video information is identified, and a video quality related evaluation result is output according to the abnormal frame information.
Further, each frame of the video data with the preset frame rate is provided with identification information.
Further, the test command is a plurality of test commands, the multimedia data includes at least two of image, audio and video, the method includes:
receiving multimedia data and preprocessing the multimedia data to divide the multimedia data into a plurality of items of test data;
evaluating the multiple items of test data respectively to obtain an intermediate evaluation result;
and calculating to obtain the final evaluation result of the multimedia data according to each intermediate evaluation intermediate result and the corresponding weight value.
Further, the method comprises:
loading a multimedia data quality evaluation model, and evaluating the received multimedia data through the multimedia data quality evaluation model; the multimedia data quality evaluation model is obtained through deep learning algorithm training.
The inventor also provides an HDMI multimedia data quality evaluating device, which processes the multimedia data transmitted by the multimedia terminal according to the method.
The invention further provides an HDMI multimedia data quality evaluation system, which comprises a multimedia terminal and an HDMI multimedia data quality evaluation device, wherein the multimedia terminal is connected with the HDMI multimedia data quality evaluation device, and the HDMI multimedia data quality evaluation device is the device as described above.
The method, the device and the system for evaluating the quality of the HDMI multimedia data are applied to an HDMI multimedia data quality evaluating system, and the method comprises the following steps: step S1: receiving multimedia data transmitted by a multimedia terminal; step S2: and evaluating the received multimedia data and outputting an evaluation result. By the scheme, the quality of the HDMI multimedia transmission data content can be measured, so that the quality defect of the HDMI transmission data can be found in time.
Drawings
Fig. 1 is a flowchart of an HDMI multimedia data quality evaluation method according to an embodiment of the present invention;
fig. 2 is a flowchart of an HDMI multimedia data quality evaluation method according to another embodiment of the present invention;
fig. 3 is a flowchart of an HDMI multimedia data quality evaluation method according to another embodiment of the present invention;
fig. 4 is a flowchart of an HDMI multimedia data quality evaluation method according to another embodiment of the present invention;
fig. 5 is a flowchart of an HDMI multimedia data quality evaluation method according to another embodiment of the present invention;
fig. 6 is a flowchart of an HDMI multimedia data quality evaluation method according to another embodiment of the present invention;
fig. 7 is a schematic diagram of an HDMI multimedia data quality evaluating apparatus according to an embodiment of the present invention;
fig. 8 is a schematic diagram of an HDMI multimedia data quality evaluation system according to an embodiment of the present invention.
Description of reference numerals:
10. HDMI multimedia data quality evaluating device;
101. a processor; 102. HDMI-RX;
20. a multimedia terminal.
Detailed Description
To explain technical contents, structural features, and objects and effects of the technical solutions in detail, the following detailed description is given with reference to the accompanying drawings in conjunction with the embodiments.
Fig. 1 is a flowchart of an HDMI multimedia data quality evaluation method according to another embodiment of the present invention. The method is applied to an HDMI multimedia data quality evaluation device, and comprises the following steps:
step S1: and receiving the multimedia data transmitted by the multimedia terminal. The multimedia terminal can be a set-top box, a television or an advertising machine and the like. The multimedia data may be any one or more of video data, audio data, image data.
Step S2: and evaluating the received multimedia data and outputting an evaluation result. By evaluating the multimedia data, whether the data transmitted by the current multimedia terminal is played normally can be known, so that the HDMI transmission quality can be judged, and if the received multimedia data is closer to the multimedia data which is actually played (namely the multimedia data played on the terminal), the better the HDMI transmission quality is, otherwise, the worse the HDMI transmission quality is.
As shown in fig. 2, before step S1, the method further includes:
firstly, step S201 is entered, and after the connection with the multimedia terminal is detected, a multimedia data quality evaluation mode is entered. In this embodiment, after the multimedia terminal is connected to the device through the HDMI cable, the device is considered to enter the multimedia data evaluation mode. And under the multimedia data evaluation mode, the device evaluates the multimedia data transmitted by the multimedia terminal, and further judges the quality of the HDMI transmitted multimedia data according to the evaluation result.
The flow then proceeds to step S202 to receive a test command, and a multimedia test item corresponding to the test command is started through CEC. The multimedia test item refers to a test program adapted to the current transmission content, for example, if an image is played by the current multimedia terminal, the multimedia test item refers to a test program for evaluating the image. HDMI-CEC is a control protocol for HDMI, enabling HDMI-capable devices to control each other over an HDMI cable. CEC is an abbreviation for Consumer Electronics Control. With HDMI-CEC, the TV, Blu-ray/DVD, and speaker can be operated by a single remote controller.
As shown in fig. 3, the test command is an image single test command, and the method includes the following steps:
firstly, the method comprises the steps of S301 receiving pure color image data transmitted by a multimedia terminal and displaying a corresponding picture; and then, the step S302 is carried out to evaluate the image unicity and the color value consistency of the display image and output the image quality related evaluation result.
For example, if the multimedia terminal plays a red frame, and the frame received and displayed by the device contains other color frames besides red, it indicates that the current display frame is not consistent with the frame played by the multimedia terminal, and therefore, the quality effect of the HDMI line transmission data can be evaluated specifically according to the ratio of the number of pixels of other colors in the display frame. The fewer the pixel points of other colors, the more similar the current display picture is to the original picture played by the multimedia terminal, the higher the quality of the HDMI cable in the image transmission, and the higher the score is correspondingly.
As shown in fig. 4, the test command is an audio single-item test command, and the method includes the following steps: firstly, step S401 is entered to receive audio data transmitted by the multimedia terminal; and then, step S402 is carried out to detect the received audio information, abnormal sound segment information in the audio information is identified, and an audio quality related evaluation result is output according to the abnormal sound segment information.
The abnormal segments include, but are not limited to: noise, sound break, abnormal sampling rate, abnormal tone and other problems. The recognition of the speech segment abnormality, the recognition of the abnormal audio being prior art, is identified by the AI model and will not be discussed here. The more abnormal sound segments, the worse the quality of the HDMI transmission audio data is, the lower the score is, and conversely, the less abnormal sound segments, the higher the quality of the HDMI transmission audio data is, the higher the score is.
As shown in fig. 5, the test command is a video single-item test command, and the method includes the following steps: firstly, entering step S501 to receive video data transmitted by a multimedia terminal; the video data is video data with a preset frame rate; and then, step S502 is carried out to detect the received video information, abnormal frame information in the video information is identified, and a video quality related evaluation result is output according to the abnormal frame information.
The abnormal frame information includes but is not limited to: green screen, screen splash, noise, tearing, black screen, frame rate mismatch, and the like. The identification of abnormal frame information is realized by an AI model, and the identification of the abnormal frame of the video is the prior art and is not discussed herein. The more the abnormal frame information, the worse the quality of the HDMI transmission video data, the lower the score, on the contrary, the less the abnormal frame information, the higher the quality of the HDMI transmission video data, the higher the score.
Preferably, each frame of the video data with the preset frame rate is provided with identification information. The identification information is a physical quantity for distinguishing each frame of image, and the identification information is preferably a digital number.
As shown in fig. 6, the test command is a plurality of test commands, the multimedia data includes at least two of images, audio, and video, and the method includes:
firstly, step S601 is entered to receive multimedia data and preprocess the multimedia data to divide the multimedia data into a plurality of items of test data;
then, the step S602 is entered to evaluate the multiple items of test data respectively to obtain an intermediate evaluation result;
and then, the step S603 is carried out to obtain the final evaluation result of the multimedia data according to the intermediate evaluation intermediate results and the corresponding weight values.
Preferably, the final evaluation result is obtained by fusing the AI model, the input of the fused AI model is the score of the image, the score of the video, the score of the audio, the video abnormal type and the audio abnormal type, and the output of the fused AI model is the multimedia quality comprehensive index. The multimedia quality comprehensive index, namely the final evaluation result of the multimedia data, can be used for representing the transmission quality of the HDMI multimedia data. The fusion AI can be used for pre-configuring respective weighted values of the image, the video and the audio scores and then carrying out comprehensive evaluation according to the scores obtained by the image, the video and the audio scores so as to determine the overall transmission quality of the HDMI.
In certain embodiments, the method comprises: loading a multimedia data quality evaluation model, and evaluating the received multimedia data through the multimedia data quality evaluation model; the multimedia data quality evaluation model is obtained through deep learning algorithm training. The specific training mode is as follows: the multimedia data quality evaluation model receives a large number of multimedia data samples, the samples comprise video abnormity types, audio abnormity types and image abnormity types, and the evaluation model with high abnormity identification accuracy is obtained by continuously training, learning and correcting.
As shown in fig. 7, the inventor further provides an HDMI multimedia data quality evaluating apparatus, which processes the multimedia data transmitted by the multimedia terminal according to the method described above. The apparatus 10 comprises a processor 101, preferably a combination of CPU and NPU units, and an HMDI-RX 102, preferably a receiving end of HDMI, which can be used to receive multimedia data transmitted from a multimedia terminal. The embedded neural Network Processor (NPU) adopts a data-driven parallel computing architecture, and is particularly good at processing massive multimedia data such as videos and images. When the evaluation device is designed, the CPU, the NPU and the HDMI-RX can be integrated on a single chip, or the CPU and the HDMI-RX can be integrated on one chip and simultaneously realized in a mode of externally connecting an NPU computing bar.
As shown in fig. 8, the inventor further provides an HDMI multimedia data quality evaluating system, which includes a multimedia terminal 20 and an HDMI multimedia data quality evaluating apparatus 10, where the multimedia terminal 20 is connected to the HDMI multimedia data quality evaluating apparatus 10, and the HDMI multimedia data quality evaluating apparatus 10 is the apparatus described above.
The invention provides a method, a device and a system for evaluating the quality of HDMI multimedia data, wherein the method is applied to an HDMI multimedia data quality evaluation system and comprises the following steps: step S1: receiving multimedia data transmitted by a multimedia terminal; step S2: and evaluating the received multimedia data and outputting an evaluation result. By the scheme, the quality of the HDMI multimedia transmission data content can be measured, so that the quality defect of the HDMI transmission data can be found in time.
It should be noted that, although the above embodiments have been described herein, the invention is not limited thereto. Therefore, based on the innovative concepts of the present invention, the technical solutions of the present invention can be directly or indirectly applied to other related technical fields by making changes and modifications to the embodiments described herein, or by using equivalent structures or equivalent processes performed in the content of the present specification and the attached drawings, which are included in the scope of the present invention.
Claims (8)
1. An HDMI multimedia data quality evaluation method is applied to an HDMI multimedia data quality evaluation device, and comprises the following steps:
entering a multimedia data quality evaluation mode after detecting that the connection with the multimedia terminal is established;
receiving a test command, and starting a multimedia test item corresponding to the test command through CEC; the test command is a plurality of test commands;
receiving multimedia data transmitted by a multimedia terminal; the multimedia data comprises at least two items of images, audios and videos;
receiving multimedia data and preprocessing the multimedia data to divide the multimedia data into a plurality of items of test data;
evaluating the multiple items of test data respectively to obtain an intermediate evaluation result;
calculating to obtain a final evaluation result of the multimedia data according to each intermediate evaluation intermediate result and the corresponding weight value; and the final evaluation result is obtained by fusing an AI model, the input of the fused AI model is the score of the image, the score of the video, the score of the audio, the video abnormal type and the audio abnormal type, and the fused AI model is output as the final evaluation result of the multimedia data.
2. The method for evaluating the quality of the HDMI multimedia data according to claim 1, wherein the test command is a single image test command, the method comprising the steps of:
receiving pure color image data transmitted by a multimedia terminal and displaying a corresponding picture;
and evaluating the picture unicity and the color value consistency of the display picture, and outputting an image quality related evaluation result.
3. The method for evaluating the quality of the HDMI multimedia data according to claim 1, wherein the test command is an audio single test command, the method comprising the steps of:
receiving audio data transmitted by a multimedia terminal;
and detecting the received audio information, identifying abnormal sound segment information in the audio information, and outputting an audio quality related evaluation result according to the abnormal sound segment information.
4. The method for evaluating the quality of the HDMI multimedia data according to claim 1, wherein the test command is a single video test command, the method comprising the steps of:
receiving video data transmitted by a multimedia terminal; the video data is video data with a preset frame rate,
and detecting the received video information, identifying abnormal frame information in the video information, and outputting a video quality related evaluation result according to the abnormal frame information.
5. The method for evaluating the quality of the HDMI multimedia data according to claim 4, wherein each frame of the video data with the preset frame rate is provided with identification information.
6. The method for evaluating the quality of the HDMI multimedia data according to claim 1, wherein the method comprises:
loading a multimedia data quality evaluation model, and evaluating the received multimedia data through the multimedia data quality evaluation model; the multimedia data quality evaluation model is obtained through deep learning algorithm training.
7. An HDMI multimedia data quality evaluating apparatus, wherein the apparatus processes multimedia data transmitted by a multimedia terminal according to the method of any one of claims 1 to 6.
8. An HDMI multimedia data quality evaluating system, comprising a multimedia terminal and an HDMI multimedia data quality evaluating device, wherein the multimedia terminal is connected to the HDMI multimedia data quality evaluating device, and the HDMI multimedia data quality evaluating device is the device according to claim 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910871107.6A CN110557592B (en) | 2019-09-16 | 2019-09-16 | HDMI multimedia data quality evaluation method, device and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910871107.6A CN110557592B (en) | 2019-09-16 | 2019-09-16 | HDMI multimedia data quality evaluation method, device and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110557592A CN110557592A (en) | 2019-12-10 |
| CN110557592B true CN110557592B (en) | 2021-12-17 |
Family
ID=68738528
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910871107.6A Active CN110557592B (en) | 2019-09-16 | 2019-09-16 | HDMI multimedia data quality evaluation method, device and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110557592B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103209337A (en) * | 2013-03-18 | 2013-07-17 | 福州瑞芯微电子有限公司 | High-Definition Multimedia Interface (HDMI) transmission controller testing method and device |
| CN104135661A (en) * | 2014-08-21 | 2014-11-05 | 太仓市同维电子有限公司 | OTT set top box testing method |
| CA2855027C (en) * | 2011-11-08 | 2017-01-24 | Kt Corporation | A technique for encoding and decoding video by interpolating a reference picture block by applying different interpolation tap filters in vertical and horizontal directions to thereference block |
| CN108235004A (en) * | 2018-03-20 | 2018-06-29 | 百度在线网络技术（北京）有限公司 | Video playing performance test methods, device and system |
| CN109447048A (en) * | 2018-12-25 | 2019-03-08 | 苏州闪驰数控系统集成有限公司 | A kind of artificial intelligence early warning system |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN205450134U (en) * | 2015-12-16 | 2016-08-10 | Tcl通力电子（惠州）有限公司 | HDMI -CEC function detection circuitry and HDMI -CEC functional test frock |
| CN106341686B (en) * | 2016-09-13 | 2018-06-26 | 广州视源电子科技股份有限公司 | The ARC test methods of electronic equipment and the signal generator for ARC tests |
-
2019
- 2019-09-16 CN CN201910871107.6A patent/CN110557592B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CA2855027C (en) * | 2011-11-08 | 2017-01-24 | Kt Corporation | A technique for encoding and decoding video by interpolating a reference picture block by applying different interpolation tap filters in vertical and horizontal directions to thereference block |
| CN103209337A (en) * | 2013-03-18 | 2013-07-17 | 福州瑞芯微电子有限公司 | High-Definition Multimedia Interface (HDMI) transmission controller testing method and device |
| CN104135661A (en) * | 2014-08-21 | 2014-11-05 | 太仓市同维电子有限公司 | OTT set top box testing method |
| CN108235004A (en) * | 2018-03-20 | 2018-06-29 | 百度在线网络技术（北京）有限公司 | Video playing performance test methods, device and system |
| CN109447048A (en) * | 2018-12-25 | 2019-03-08 | 苏州闪驰数控系统集成有限公司 | A kind of artificial intelligence early warning system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110557592A (en) | 2019-12-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101500114B (en) | Electronic device, method for responding to message | |
| US5920340A (en) | Method and apparatus for self-testing of a multimedia subsystem | |
| CN101496398B (en) | AV device | |
| WO2019119854A1 (en) | Method and system for adjusting video playing definition | |
| US20060176397A1 (en) | Displaying an intended video image | |
| CN102006441A (en) | HDMI system with Ethernet and method for displaying connection condition of HDMI cable the same | |
| US20070157274A1 (en) | System and method for testing multimedia device | |
| US6442712B1 (en) | Apparatus and method utilized to automatically test a computer | |
| KR100737312B1 (en) | Dvi/hdmi output device and control method thereof | |
| CN105979370A (en) | Method and device for configuring image model | |
| KR100688981B1 (en) | Media Player, Control Method Thereof And Media Play System Comprising Therof | |
| CN110557592B (en) | HDMI multimedia data quality evaluation method, device and system | |
| US11233985B2 (en) | Method for video quality detection and image processing circuit using the same | |
| US20160094842A1 (en) | Detection system and detection method of multimedia interface | |
| CN105975299A (en) | Channel switching apparatus, programmed data detection method and system as well as data programming method and system | |
| CN112601080B (en) | Method for judging television monochromatic field signal | |
| CN108076351B (en) | Audio and video data encoding method and device and electronic equipment | |
| TWI497981B (en) | Method and apparatus for testing video signals | |
| CN101996613B (en) | Output testing method, system and platform of electronic device | |
| KR20180100873A (en) | Electronic apparatus for playing substitutional advertisement and method for controlling method thereof | |
| KR100373756B1 (en) | Apparatus for image displaing with image signal input terminal of common and Method for image displaing thereof | |
| CN220629392U (en) | Video and audio transmission extension system | |
| KR101047466B1 (en) | System and apparatus of analyzing audio and video signal and the method thereof | |
| CN110381308A (en) | A kind of system for testing live video treatment effect | |
| KR101369390B1 (en) | Image reproducing apparatus with decision function of audio and video input signal and method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 350003 building 18, No.89, software Avenue, Gulou District, Fuzhou City, Fujian Province Applicant after: Ruixin Microelectronics Co., Ltd Address before: 350003 building 18, No.89, software Avenue, Gulou District, Fuzhou City, Fujian Province Applicant before: FUZHOU ROCKCHIP ELECTRONICS Co.,Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |