CN113065879A

CN113065879A - Data stream quality inspection method and system

Info

Publication number: CN113065879A
Application number: CN202110486367.9A
Authority: CN
Inventors: 沈超建; 张锦元; 林晓锐; 邓泳
Original assignee: Industrial and Commercial Bank of China Ltd ICBC
Current assignee: Industrial and Commercial Bank of China Ltd ICBC
Priority date: 2021-04-30
Filing date: 2021-04-30
Publication date: 2021-07-02

Abstract

The embodiment of the application provides a data stream quality inspection method and a data stream quality inspection system, which can be used in the technical field of cloud computing or other technical fields, and the method comprises the following steps: in the data stream recording process, the quality inspection terminal acquires the currently recorded data stream and sends the data stream to the quality inspection server; the quality inspection server executes a first quality inspection according to the data stream to obtain a first quality inspection result; the quality inspection terminal returns the first quality inspection result to the data stream recording terminal; the quality inspection terminal additionally acquires a path of data stream, sends the data stream to the quality inspection server, performs quality inspection by using high-performance computing resources such as a CPU (central processing unit), a GPU (graphic processing unit), a TPU (thermoplastic polyurethane), and the like of the quality inspection server, ensures that quality inspection is finished in a short time after recording is finished, and avoids the need that a client returns to a business place again for additional recording, thereby improving the experience of the client and the operation efficiency.

Description

Data stream quality inspection method and system

Technical Field

The application relates to the technical field of cloud computing, in particular to a data flow quality inspection method and system.

Background

In order to protect consumers, when supervising organizations such as bank insurance prisoners and certificate prisoners require financial institutions to sell their own or substitute for products such as financial, fund and insurance, the selling process needs to be synchronized by recording (double recording for short) to prevent misleading selling and private selling of 'flyer bill' and the like. The financial institution needs to ensure that the double-recording content meets the requirements of the regulatory institution and the self double-recording process, such as: the customer manager confirms the identity of the customer and introduces the customer by self, introduces the product conditions (such as issuing subject, warranty attribute, income level, risk condition, commission charge and the like), is positioned on the same picture with the customer, has customer signature in a key link, judges whether the customer manager says banned words or not and the like.

At present, financial institutions generally check in a mode of manually playing double-recorded videos, on one hand, the financial institutions are time-consuming and labor-consuming, the quality inspection of all double-recorded videos cannot be guaranteed to be completed hundred percent, meanwhile, the quality inspection standards cannot be unified, and the risk that manual quality inspection passes but does not meet the requirements of supervision or internal systems exists; on the other hand, only a post-inspection mode can be adopted, and for found unqualified double records, the client needs to return to a business place for additional recording, so that the client experience is poor, and the operation efficiency is not high. In recent years, some financial institutions utilize an artificial intelligence technology to automatically check video files stored in a centralized manner after double recording is finished, so that although the labor input of quality inspection is reduced and the quality inspection standard is unified, the method is limited by double recording time consumption, time consumption of links of uploading, centrally storing and downloading the double-recorded video files into a quality inspection queue, quality inspection and the like, the timeliness of quality inspection is insufficient, and the quality inspection can be finished generally within a plurality of hours or even within 2 days after double recording is finished. For the automatic quality inspection, the customer still needs to return to the business place again for additional recording, and the problems of poor customer experience and poor operation efficiency are not solved.

Disclosure of Invention

Aiming at the problems in the prior art, the application provides a data stream quality inspection method and a data stream quality inspection system, when recording is started, a data stream in the recording process is additionally acquired for quality inspection, the quality inspection is finished within a short time (for example, 1 minute) after the recording is finished, unqualified quality inspection points can be re-recorded on site, the condition that a customer needs to carry out re-recording in a business place for the second time is avoided, and the customer experience and the operation efficiency are improved.

In order to solve the technical problem, the application provides the following technical scheme:

in a first aspect, the present application provides a data stream quality inspection method, executed by a quality inspection terminal, including:

in the data stream recording process, acquiring a currently recorded data stream;

sending the currently recorded data stream to a quality inspection server so that the quality inspection server executes a first quality inspection to obtain a first quality inspection result;

and returning the first quality inspection result to the data stream recording terminal.

Further, the data flow quality detection method further comprises:

performing a second quality inspection on the data stream to obtain a second quality inspection result, wherein the quality inspection operations of the first quality inspection and the second quality inspection are different;

and returning the second quality inspection result to the data stream recording terminal.

Further, the data stream comprises an audio data stream, the step of performing a first quality check by the quality check server comprises performing at least a part of the step of performing a quality check;

wherein, the quality inspection step comprises:

converting the audio data stream into text data;

comparing the text data converted from the audio data stream with data in a preset forbidden word database to obtain forbidden word similarity, and if the forbidden word similarity is lower than a set threshold, judging that the audio data stream is qualified in quality inspection;

and comparing the text data after the audio data stream conversion with a preset standard phonetics template to obtain phonetics similarity, and if the phonetics similarity is higher than a set threshold, judging that the audio data stream quality inspection is qualified.

Further, the data stream comprises an audio data stream, and the step of performing a first quality check by the quality check server comprises performing a part of the quality check step;

said performing a second quality check on said data stream comprises performing another portion of said quality check step;

wherein, the quality inspection step comprises:

converting the audio data stream into text data;

Further, the data stream comprises a video data stream, and the step of performing a first quality check by the quality check server comprises performing at least a part of the step of performing a quality check;

wherein, the quality inspection step comprises:

performing picture detection on a picture obtained by frame extraction of the video data stream, and if the picture information is higher than a set threshold value, judging that the quality of the video data stream is qualified;

and detecting the motion of the person in the picture of the picture obtained by frame extraction of the video data stream, and if the motion information of the person in the picture is higher than a set threshold value, judging that the quality of the video data stream is qualified.

Further, the data stream comprises a video data stream, and the step of performing a first quality check by the quality check server comprises performing a part of the quality check step;

wherein, the quality inspection step comprises:

In a second aspect, the present application provides a data stream quality inspection method, executed by a quality inspection server, including:

receiving a data stream sent by a quality inspection terminal, wherein the data stream is a current recorded data stream acquired by the quality inspection terminal in a data stream recording process;

executing a first quality inspection according to the data stream to obtain a first quality inspection result;

and sending the first quality inspection result to a quality inspection terminal so that the quality inspection terminal returns the first quality inspection result to a data stream recording terminal.

Further, the data stream includes an audio data stream, and the performing a first quality check according to the data stream includes:

performing at least a portion of the quality testing step;

wherein, the quality inspection step comprises:

converting the audio data stream into text data;

Further, the data stream includes a video data stream, and the performing a first quality check according to the data stream includes:

performing at least a portion of the quality testing step;

wherein, the quality inspection step comprises:

In a third aspect, the present application provides a data stream quality inspection method, including:

in the data stream recording process, a quality inspection terminal acquires a currently recorded data stream;

sending the currently recorded data stream to a quality inspection server;

the quality inspection server executes a first quality inspection according to the currently recorded data stream to obtain a first quality inspection result;

and the quality inspection terminal returns the first quality inspection result sent by the quality inspection server to the data stream recording terminal.

Further, the data flow quality detection method further comprises:

the quality inspection terminal performs second quality inspection on the data stream to obtain a second quality inspection result, wherein the quality inspection operations of the first quality inspection and the second quality inspection are different;

and the quality inspection terminal returns the second quality inspection result to the data stream recording terminal.

In a fourth aspect, the present application provides a quality inspection terminal, including:

a data acquisition module: in the data stream recording process, acquiring a currently recorded data stream;

a data transmission module: sending the currently recorded data stream to a quality inspection server so that the quality inspection server executes a first quality inspection to obtain a first quality inspection result;

a first result return module: and returning the first quality inspection result to the data stream recording terminal.

Further, the quality inspection terminal further includes:

the second quality inspection module: performing a second quality inspection on the data stream to obtain a second quality inspection result, wherein the quality inspection operations of the first quality inspection and the second quality inspection are different;

a second result returning module: and returning the second quality inspection result to the data stream recording terminal.

In a fifth aspect, the present application provides a quality inspection server, including:

a data receiving module: receiving a data stream sent by a quality inspection terminal, wherein the data stream is a current recorded data stream acquired by the quality inspection terminal in a data stream recording process;

the first quality inspection module: executing a first quality inspection according to the data stream to obtain a first quality inspection result;

a first result sending module: and sending the first quality inspection result to a quality inspection terminal so that the quality inspection terminal returns the first quality inspection result to a data stream recording terminal.

In a sixth aspect, the present application provides a data stream quality inspection system, including a quality inspection terminal and a quality inspection server;

the quality inspection terminal acquires a currently recorded data stream in the data stream recording process and sends the currently recorded data stream to a quality inspection server;

the quality inspection server executes first quality inspection according to the currently recorded data stream to obtain a first quality inspection result, and sends the first quality inspection result to the quality inspection terminal;

and the quality inspection terminal returns the first quality inspection result to the data stream recording terminal.

In a seventh aspect, the present application provides a data stream quality inspection system, including a quality inspection terminal and a quality inspection server;

the quality inspection terminal acquires the currently recorded data stream in the data stream recording process, and performs second quality inspection on the data stream to obtain a second quality inspection result;

the quality inspection server executes first quality inspection according to the data stream sent by the quality inspection terminal to obtain a first quality inspection result, and sends the first quality inspection result to the quality inspection terminal, wherein the quality inspection operations of the first quality inspection and the second quality inspection are different;

and the quality inspection terminal returns the first quality inspection result and the second quality inspection result to the data stream recording terminal.

In an eighth aspect, the present application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the data stream quality inspection method when executing the program.

In a ninth aspect, the present application provides a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the method of data flow quality detection.

According to the technical scheme, the data flow quality inspection method and system provided by the application comprise the following steps: in the data stream recording process, the quality inspection terminal acquires the currently recorded data stream and sends the data stream to the quality inspection server; the quality inspection server executes a first quality inspection according to the data stream to obtain a first quality inspection result; the quality inspection terminal returns the first quality inspection result to the data stream recording terminal; the quality inspection terminal additionally acquires a path of data stream, sends the data stream to the quality inspection server, performs quality inspection by using high-performance computing resources such as a CPU (central processing unit), a GPU (graphic processing unit), a TPU (thermoplastic polyurethane), and the like of the quality inspection server, ensures that quality inspection is finished in a short time after recording is finished, and avoids the need that a client returns to a business place again for additional recording, thereby improving the experience of the client and the operation efficiency.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 is a schematic flow chart of a quality inspection terminal in a data flow quality inspection method in an embodiment of the present application.

Fig. 2 is a schematic diagram of a quality inspection process of an audio data stream in the data stream quality inspection method in the embodiment of the present application.

Fig. 3 is a schematic diagram of a quality inspection process of a video data stream in a data stream quality inspection method according to an embodiment of the present application.

Fig. 4 is a schematic flow chart of a quality inspection server in the data stream quality inspection method in the embodiment of the present application.

Fig. 5 is a schematic flow chart of a data flow quality inspection method in an embodiment of the present application.

Fig. 6 is a schematic structural diagram of a quality inspection terminal in an embodiment of the present application.

Fig. 7 is a schematic structural diagram of a quality inspection server in the embodiment of the present application.

Fig. 8 is a schematic structural diagram of a data flow quality inspection system in an embodiment of the present application.

Fig. 9 is a schematic flow chart of the data flow quality inspection system in the embodiment of the present application.

Fig. 10 is a schematic structural diagram of an electronic device in an embodiment of the present application.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

It should be noted that the data flow quality detection method and system disclosed in the present application may be used in the technical field of cloud computing, and may also be used in any field other than the technical field of cloud computing.

In one or more embodiments of the present application, the data stream may be an audio data stream or a video data stream, or may be an audio-video mixed data stream. The quality inspection contents of the audio and video data streams comprise that a customer manager confirms the identity of the customer and introduces the customer by self, product conditions (such as a release subject, a warranty attribute, a profit level, risk conditions, commission charge and the like) are introduced, the customer manager and the customer are positioned on the same picture, key links have customer signatures, whether the customer manager says banners or not and the like.

In view of the problem that the existing data stream quality inspection generally needs to be finished for several hours or even 2 nd day after the recording is finished, so that the customer experience and the operation efficiency are not good, the application provides a data stream quality inspection method, a data stream quality inspection system, electronic equipment and a computer readable storage medium, a quality inspection terminal sends a data stream to a quality inspection server, quality inspection is performed by using high-performance computing resources such as a quality inspection server CPU, a GPU and a TPU, the quality inspection is guaranteed to be finished in a short time after the recording is finished, the need that the customer returns to a business place again for additional recording is avoided, and therefore the customer experience and the operation efficiency are improved.

Based on the above, the present application further provides a quality inspection terminal and a quality inspection server for implementing the data stream quality inspection method provided in one or more embodiments of the present application, where the quality inspection terminal may be in communication connection with a client terminal device, the client terminal device includes a recording peripheral device, a recording terminal module, and a recording server, and the recording terminal module additionally sends the data stream and quality inspection task information in the data stream recording process to the quality inspection terminal through memory copy and other manners.

The quality inspection terminal may receive a currently recorded data stream and a data stream quality inspection instruction from the client terminal device, and obtain task information required for quality inspection from the data stream quality inspection instruction, for example: the quality inspection terminal can transmit the data stream and the quality inspection task information to the quality inspection server, the quality inspection server performs data stream quality inspection, the quality inspection task information can be distributed according to the self-computing performance, quality inspection items which can be supported by self-computing resources are reserved on the terminal side for execution, other quality inspection items are deployed to the quality inspection server for execution, and after all quality inspection items are executed, the quality inspection terminal returns a quality inspection result to the client terminal equipment.

It will be appreciated that the client devices may include smart phones, tablet electronic devices, portable computers, desktop computers, Personal Digital Assistants (PDAs), and the like.

In another practical application scenario, the quality inspection terminal may be merged with a recording terminal module in the client terminal device, and a portion for performing quality inspection on the data stream may be executed at the quality inspection terminal as described above, or all operations may be completed in the client terminal device. The selection may be specifically performed according to the processing capability of the client device, the limitation of the user usage scenario, and the like. This is not a limitation of the present application.

The client device may have a communication module (i.e., a communication unit), and may be communicatively connected to the quality inspection terminal to implement the data stream transmission. For example, the communication unit may transmit the data stream and the data stream quality inspection command to the quality inspection terminal, so that the quality inspection terminal performs quality inspection on the data stream according to the quality inspection command. The communication unit can also receive a quality inspection result returned by the quality inspection terminal.

The quality inspection terminal and the client device may communicate using any suitable network protocol, including network protocols not yet developed at the filing date of the present application. The network protocol may include, for example, a TCP/IP protocol, a UDP/IP protocol, an HTTP protocol, an HTTPS protocol, or the like. Of course, the network Protocol may also include, for example, an RPC Protocol (Remote Procedure Call Protocol), a REST Protocol (Representational State Transfer Protocol), and the like used above the above Protocol.

According to the data stream quality inspection method, the data stream quality inspection system, the electronic device and the computer readable storage medium, when recording is started, one path of data stream in the recording process is additionally acquired for quality inspection, quality inspection can be completed within a short time (for example: 1 minute) after recording is completed, unqualified quality inspection points can be re-recorded on site, the situation that a customer needs to make a second recording in a business place is avoided, and customer experience and operation efficiency are improved.

The following embodiments and application examples are specifically and respectively described.

In order to solve the problem that the existing data stream quality inspection generally needs to be completed within several hours or even 2 nd day after the recording is completed, which leads to poor customer experience and operation efficiency, the present application provides an embodiment of a data stream quality inspection method, which is executed by a quality inspection terminal with reference to fig. 1, and specifically includes the following contents:

step S100: in the data stream recording process, acquiring a currently recorded data stream;

step S200: sending the currently recorded data stream to a quality inspection server so that the quality inspection server executes a first quality inspection to obtain a first quality inspection result;

step S300: and returning the first quality inspection result to the data stream recording terminal.

It can be understood that, in the recording process, the recording terminal sends the currently recorded data stream and the quality inspection information to the quality inspection terminal every set time length, the quality inspection terminal processes the data stream and sends the processed data stream and the quality inspection information to the quality inspection server, the quality inspection server performs all or partial quality inspection on the processed data stream according to the quality inspection information, after the quality inspection is completed, the quality inspection result is transmitted to the quality inspection terminal, the quality inspection terminal returns the quality inspection result to the recording terminal, and the data stream with unqualified quality inspection is re-recorded.

When the data stream is an audio data stream, the quality inspection terminal performs recoding and other processing on the audio data in the aspects of coding format, sampling rate, code stream and the like according to the requirement of the voice-to-text function; when the data stream is a video data stream, the quality inspection terminal performs frame extraction processing on the video data stream according to a preset frequency, and converts the video data stream into pictures; and when the data stream is a double-recording video stream, the quality inspection terminal performs separation pretreatment on the double-recording video stream to obtain separated audio data and separated video data, and then performs the treatment on the separated audio data and the separated video data respectively.

As can be seen from the above description, in the data stream quality inspection method provided in the embodiment of the present application, the quality inspection terminal additionally obtains one data stream, and sends the data stream to the quality inspection server, and performs quality inspection by using high-performance computing resources such as the CPU, the GPU, and the TPU of the quality inspection server, so as to ensure that quality inspection is completed in a short time after recording is completed, and avoid requiring the customer to return to the business place again for additional recording, thereby improving the customer experience and the operation efficiency.

In order to further improve the detection efficiency of the data stream quality inspection, in an embodiment of the data stream quality inspection method provided by the present application, a preferred manner of the data stream quality inspection is provided, referring to fig. 1, where the data stream quality inspection method further includes the following contents:

step S400: performing a second quality inspection on the data stream to obtain a second quality inspection result, wherein the quality inspection operations of the first quality inspection and the second quality inspection are different;

step S500: and returning the second quality inspection result to the data stream recording terminal.

It can be understood that some quality inspection items in the quality inspection information can be quickly finished or have low requirements on processing performance, quality inspection can be directly finished at the quality inspection terminal, and other quality inspection items which take longer time or have high requirements on processing performance can be forwarded to the quality inspection server for quality inspection.

As can be seen from the above description, in the data stream quality inspection method provided in this embodiment of the present application, the quality inspection terminal additionally obtains one data stream, and the quality inspection function is reasonably deployed between the quality inspection terminal and the quality inspection server in combination with the performance of the quality inspection terminal, and the quality inspection is performed on some quality inspection items that consume longer time or require higher requirements by using high-performance computing resources such as the quality inspection server CPU, GPU, TPU, and the like, and other quality inspection items that can be quickly completed or require lower processing performance are executed at the quality inspection terminal, so that the time required for quality inspection of the data stream is further shortened, quality inspection is guaranteed to be completed in a short time after recording is completed, and the need for the customer to return to a business place again for additional recording is avoided, thereby improving the customer experience and the operation efficiency.

In order to further improve the detection efficiency of the data stream quality inspection, in an embodiment of the data stream quality inspection method provided by the present application, a method for performing quality inspection on an audio data stream is provided, where step S200 in the data stream quality inspection method specifically includes the following contents:

the data stream comprises an audio data stream, and the step of performing a first quality check by the quality check server comprises performing at least a part of the step of performing the quality check;

wherein the quality inspection step, referring to fig. 2, comprises:

step S001: converting the audio data stream into text data;

step S002: comparing the text data converted from the audio data stream with data in a preset forbidden word database to obtain forbidden word similarity, and if the forbidden word similarity is lower than a set threshold, judging that the audio data stream is qualified in quality inspection;

step S003: and comparing the text data after the audio data stream conversion with a preset standard phonetics template to obtain phonetics similarity, and if the phonetics similarity is higher than a set threshold, judging that the audio data stream quality inspection is qualified.

It can be understood that, when the performance of the quality inspection terminal is weak, the quality inspection server may perform all or part of the quality inspection steps on the audio data stream according to actual needs, for example, compare the similarity between the text and the standard speech template and the forbidden language through natural language processing, keyword matching, etc., determine whether the similarity exceeds a preset qualified threshold, determine that the quality inspection is qualified if the similarity exceeds the preset qualified threshold, and determine that the quality inspection is unqualified if the similarity is lower than the threshold.

As can be seen from the above description, in the data stream quality inspection method provided in the embodiment of the present application, the quality inspection terminal processes the audio data stream, sends the processed audio data stream to the quality inspection server, performs quality inspection by using high-performance computing resources such as the CPU, the GPU, and the TPU of the quality inspection server, ensures that quality inspection is completed in a short time after recording is completed, and avoids the need for the customer to return to the business place again for additional recording, thereby improving the customer experience and the operation efficiency.

In order to further improve the detection efficiency of the data stream quality inspection, in an embodiment of the data stream quality inspection method provided by the present application, a method for performing quality inspection on an audio data stream is provided, and steps S200 and S400 in the data stream quality inspection method specifically include the following contents:

the data stream comprises an audio data stream, and the step of performing a first quality inspection by the quality inspection server comprises performing a part of the step of performing the quality inspection;

wherein the quality inspection step, referring to fig. 2, comprises:

step S001: converting the audio data stream into text data;

It can be understood that after receiving the audio data stream sent by the recording terminal, the quality inspection terminal can reasonably distribute the quality inspection tasks between itself and the quality inspection server according to its own performance, and retain the quality inspection tasks which can be supported by its own computing resources and have large data volume in the terminal, and other quality inspection tasks are deployed to the quality inspection server, thereby achieving the purposes of reducing network transmission delay and improving quality inspection timeliness. For example, the quality inspection terminal performs voice-to-text conversion on the recoded audio data, compares the similarity between the text and the forbidden words by means of keyword matching and the like, and judges whether the similarity exceeds a preset qualified threshold, if so, the quality inspection is qualified, and if not, the similarity is unqualified. And the quality inspection server compares the similarity of the text and the standard dialect template by a natural language processing mode to judge whether the similarity exceeds a preset qualified threshold, if so, the quality inspection is qualified, and if not, the quality inspection is unqualified.

It can be known from the above description that, in the data stream quality inspection method provided in the embodiment of the present application, the quality inspection terminal additionally obtains one data stream, and the quality inspection function is reasonably deployed between the quality inspection terminal and the quality inspection server in combination with the performance of the quality inspection terminal, and the quality inspection is performed on some quality inspection items that are time-consuming or require a high requirement by using high-performance computing resources such as the quality inspection server CPU, GPU, TPU, and the like, and other quality inspection items that can be completed quickly or require a low processing performance are executed at the quality inspection terminal, so that the time required for quality inspection of the data stream is further shortened, quality inspection is guaranteed to be completed within a short time after recording is completed, and the need for the client to return to a business place for additional recording is avoided, thereby improving the experience of the client and the operation efficiency.

In order to further improve the detection efficiency of the data stream quality inspection, in an embodiment of the data stream quality inspection method provided by the present application, a method for performing quality inspection on a video data stream is provided, where step S200 in the data stream quality inspection method specifically includes the following contents:

the data stream comprises a video data stream, and the step of performing a first quality check by the quality check server comprises performing at least a part of the step of performing the quality check;

wherein the quality inspection step, referring to fig. 3, comprises:

step S004: performing picture detection on a picture obtained by frame extraction of the video data stream, and if the picture information is higher than a set threshold value, judging that the quality of the video data stream is qualified;

step S005: and detecting the motion of the person in the picture of the picture obtained by frame extraction of the video data stream, and if the motion information of the person in the picture is higher than a set threshold value, judging that the quality of the video data stream is qualified.

It can be understood that, when the performance of the quality inspection terminal is weak, the quality inspection server may perform all or part of quality inspection steps on the video data stream according to actual needs, for example, for a picture obtained by frame extraction, a target detection algorithm based on deep learning, a behavior recognition algorithm are adopted to detect face information, certificate/product data, signature actions, handwriting and the like in the picture, so as to determine whether a customer manager and a customer are located on the same picture, whether the customer manager displays the certificate or the product data, whether the customer has the signature actions, whether the client has the handwriting signature and the like, and compare the result with a preset threshold, and when the confidence of the detection result is greater than the threshold, the quality inspection is determined to be qualified, and when the confidence of the detection result is less than the threshold, the quality inspection is. The mainstream target detection methods include R-CNN, YOLO, SSD and the like, and the behavior recognition algorithms include C3D, CNN + LSTM, Two-Stream and the like.

As can be seen from the above description, in the data stream quality inspection method provided in the embodiment of the present application, the quality inspection terminal processes the video data stream, sends the processed video data stream to the quality inspection server, and performs quality inspection by using high-performance computing resources such as the CPU, the GPU, and the TPU of the quality inspection server, so as to ensure that quality inspection is completed in a short time after recording is completed, and avoid requiring the customer to return to the business place again for additional recording, thereby improving the customer experience and the operation efficiency.

In order to further improve the detection efficiency of the data stream quality inspection, in an embodiment of the data stream quality inspection method provided by the present application, a method for performing quality inspection on a video data stream is provided, and steps S200 and S400 in the data stream quality inspection method specifically include the following contents:

the data stream comprises a video data stream, and the step of performing a first quality check by the quality check server comprises performing a part of the quality check step;

wherein the quality inspection step, referring to fig. 3, comprises:

It can be understood that after receiving the video data stream sent by the recording terminal, the quality inspection terminal can reasonably distribute the quality inspection tasks between itself and the quality inspection server according to the performance of itself, the quality inspection tasks which can be supported by the computing resources of itself and have large data volume are reserved at the terminal, and other quality inspection tasks are deployed to the quality inspection server, so that the purposes of reducing network transmission delay and improving quality inspection timeliness are achieved. Such as: the detection of whether the customer manager and the customer are positioned on the same picture is deployed at the terminal, and the other detection is deployed at the real-time quality inspection server.

It can be known from the above description that, in the data stream quality inspection method provided in the embodiment of the present application, the quality inspection terminal additionally obtains a video data stream, and the quality inspection function is reasonably deployed between the quality inspection terminal and the quality inspection server in combination with the performance of the quality inspection terminal, and the quality inspection is performed on some quality inspection items that are time-consuming or require a high requirement by using high-performance computing resources such as the quality inspection server CPU, GPU, TPU, and the like, and other quality inspection items that can be completed quickly or require a low requirement for processing performance are executed at the quality inspection terminal, so that the time required for quality inspection of the data stream is further shortened, quality inspection is guaranteed to be completed within a short time after recording is completed, and the need for the client to return to a business place for additional recording is avoided, thereby improving the experience of the client and the operation efficiency.

In order to solve the problem that the existing data stream quality inspection generally needs to be completed within several hours or even 2 nd day after the recording is completed, which results in poor customer experience and operation efficiency, the present application provides an embodiment of a data stream quality inspection method, which is executed by a quality inspection server with reference to fig. 4, and specifically includes the following contents:

step S600: receiving a data stream sent by a quality inspection terminal, wherein the data stream is a current recorded data stream acquired by the quality inspection terminal in a data stream recording process;

step S700: executing a first quality inspection according to the data stream to obtain a first quality inspection result;

step S800: and sending the first quality inspection result to a quality inspection terminal so that the quality inspection terminal returns the first quality inspection result to a data stream recording terminal.

The quality inspection terminal performs different processing according to different types of data streams, and when the data streams are audio data streams, the quality inspection terminal performs recoding and other processing on the audio data in the aspects of coding format, sampling rate, code stream and the like according to the requirement of the voice-to-text function; when the data stream is a video data stream, the quality inspection terminal performs frame extraction processing on the video data stream according to a preset frequency, and converts the video data stream into pictures; and when the data stream is a double-recording video stream, the quality inspection terminal performs separation pretreatment on the double-recording video stream to obtain separated audio data and separated video data, and then performs the treatment on the separated audio data and the separated video data respectively.

As can be seen from the above description, in the data stream quality inspection method provided in the embodiment of the present application, the quality inspection server performs quality inspection by using high-performance computing resources such as its CPU, GPU, TPU, and the like, thereby ensuring that quality inspection is completed within a short time after recording is completed, and avoiding the need for the customer to return to the place of business again for additional recording, thereby improving customer experience and operation efficiency.

In order to further improve the detection efficiency of the data stream quality inspection, in an embodiment of the data stream quality inspection method provided by the present application, a preferred manner of the data stream quality inspection is provided, and step S700 in the data stream quality inspection method specifically includes the following contents:

the data stream comprises an audio data stream, and the performing of the first quality inspection according to the data stream comprises:

performing at least a portion of the quality testing step;

wherein the quality inspection step, referring to fig. 2, comprises:

step S001: converting the audio data stream into text data;

In order to further improve the detection efficiency of the data stream quality inspection, in an embodiment of the data stream quality inspection method provided by the present application, a method for performing quality inspection on a video data stream is provided, where step S700 in the data stream quality inspection method specifically includes the following contents:

the data stream comprises a video data stream, and the performing of the first quality inspection according to the data stream comprises:

performing at least a portion of the quality testing step;

wherein the quality inspection step, referring to fig. 3, comprises:

In order to solve the problem that the existing data stream quality inspection generally needs to be completed within several hours or even 2 nd day after the recording is completed, which results in poor customer experience and operation efficiency, the present application provides an embodiment of a data stream quality inspection method, and referring to fig. 5, the data stream quality inspection method specifically includes the following contents:

step S110: in the data stream recording process, a quality inspection terminal acquires a currently recorded data stream;

step S120: sending the currently recorded data stream to a quality inspection server;

step S130: the quality inspection server executes a first quality inspection according to the currently recorded data stream to obtain a first quality inspection result;

step S140: and the quality inspection terminal returns the first quality inspection result sent by the quality inspection server to the data stream recording terminal.

In order to further improve the detection efficiency of the data stream quality inspection, in an embodiment of the data stream quality inspection method provided by the present application, a preferred manner of the data stream quality inspection is provided, and referring to fig. 5, the data stream quality inspection method further includes the following steps:

step S150: the quality inspection terminal performs second quality inspection on the data stream to obtain a second quality inspection result, wherein the quality inspection operations of the first quality inspection and the second quality inspection are different;

step S160: and the quality inspection terminal returns the second quality inspection result to the data stream recording terminal.

In terms of software, in order to solve the problem that the existing data stream quality inspection generally needs to be completed within several hours or even 2 nd day after the recording is completed, which leads to poor customer experience and poor operation efficiency, the present application provides an embodiment of a quality inspection terminal for executing all or part of the contents in the data stream quality inspection method, and referring to fig. 6, the quality inspection terminal specifically includes the following contents:

the data acquisition module 10: in the data stream recording process, acquiring a currently recorded data stream;

the data transmission module 11: sending the currently recorded data stream to a quality inspection server so that the quality inspection server executes a first quality inspection to obtain a first quality inspection result;

first result return module 12: and returning the first quality inspection result to the data stream recording terminal.

It can be understood that, in the recording process, the recording terminal sends the currently recorded data stream and the quality inspection information to the data acquisition module 10 every set time length, the data transmission module 11 sends the data stream and the quality inspection information to the quality inspection server, the quality inspection server performs all or partial quality inspection on the processed data stream according to the quality inspection information, after the quality inspection is completed, the quality inspection result is transmitted to the first result returning module 12, the first result returning module 12 returns the quality inspection result to the recording terminal, and the data stream with the unqualified quality inspection is re-recorded.

As can be seen from the above description, in the quality inspection terminal provided in the embodiment of the present application, the quality inspection terminal additionally obtains one data stream, and sends the data stream to the quality inspection server, and performs quality inspection by using high-performance computing resources such as the quality inspection server CPU, the GPU, and the TPU, so as to ensure that quality inspection is completed in a short time after recording is completed, and avoid requiring the customer to return to the business place again for additional recording, thereby improving the customer experience and the operation efficiency.

In order to further improve the detection efficiency of the data stream quality inspection, in an embodiment of the quality inspection terminal provided in the present application, a preferred method of the data stream quality inspection is provided, referring to fig. 6, where the quality inspection terminal further includes the following contents:

the second quality inspection module 13: performing a second quality inspection on the data stream to obtain a second quality inspection result, wherein the quality inspection operations of the first quality inspection and the second quality inspection are different;

the second result returning module 14: and returning the second quality inspection result to the data stream recording terminal.

It can be understood that the specific functions of the quality inspection terminal can be reasonably distributed between the quality inspection terminal and the quality inspection server according to the performance of the quality inspection terminal, quality inspection items which can be supported by the computing resources on the terminal side and have large data volume are reserved at the quality inspection terminal, and other quality inspection items are deployed to the quality inspection server, so that the aims of reducing network transmission delay and improving quality inspection timeliness are fulfilled. The second quality inspection module 13 comprises an audio quality inspection unit and a video quality inspection unit, and for an audio data stream, the audio quality inspection unit performs voice conversion on recoded audio data into a text, compares the similarity of the text with a standard speech template and an illegal language in the modes of natural language processing, keyword matching and the like, judges whether the similarity exceeds a preset qualified threshold value, judges that the quality inspection is qualified if the similarity exceeds the preset qualified threshold value, and judges that the quality inspection is unqualified if the similarity is lower than the threshold value; aiming at the video data stream, the video quality inspection unit adopts a target detection algorithm and a behavior recognition algorithm based on deep learning to detect face information, certificate/product data, signature action, handwriting and the like in the picture aiming at the picture obtained by frame extraction, so as to judge whether a customer manager and a client are positioned on the same picture, whether the customer manager displays the certificate or the product data, whether the client has the signature action, whether the client has the handwriting signature and the like, and compare the result with a preset threshold, when the confidence coefficient of the detection result is greater than the threshold, the quality inspection is qualified, and when the confidence coefficient of the detection result is lower than the threshold, the quality inspection is unqualified.

It can be known from the above description that the quality inspection terminal provided in the embodiment of the present application, in combination with the performance of the quality inspection terminal and the quality inspection server, reasonably deploys the quality inspection function, performs quality inspection on some quality inspection items that consume a long time or require a high performance by using high performance computing resources such as the quality inspection server CPU, GPU, TPU, and the like, and performs quality inspection on other quality inspection items that can be completed quickly or require a low processing performance at the quality inspection terminal, thereby further shortening the time required for quality inspection of data streams, ensuring that quality inspection is completed in a short time after recording is completed, and avoiding the need for the customer to return to a business place again for additional recording, thereby improving the customer experience and the operation efficiency.

In order to further improve the accuracy of the quality inspection of the data stream, in an embodiment of the quality inspection terminal provided in the present application, a preferred manner of processing the data stream is provided, referring to fig. 6, and the quality inspection terminal further includes a data processing module 15.

It is understood that the data processing module 15 includes an audio and video separation unit, an audio preprocessing unit, and a video preprocessing unit. The data processing module 15 processes the data stream according to different types of the data stream, when the data stream is an audio data stream, the data processing module 15 calls an audio preprocessing unit, and the audio preprocessing unit performs recoding and other processing on the audio data in the aspects of coding format, sampling rate, code stream and the like according to the requirement of a voice-to-text function; when the data stream is a video data stream, the data processing module 15 calls a video preprocessing unit, and the video preprocessing unit performs frame extraction processing on the video data stream according to a preset frequency and converts the video data stream into pictures; when the data stream is a dual-recording video stream, the data processing module 15 calls an audio/video separation unit, an audio preprocessing unit and a video preprocessing unit, the audio/video separation unit performs separation preprocessing on the dual-recording video stream to obtain separated audio data and separated video data, the audio preprocessing unit and the video preprocessing unit perform the processing on the separated audio data and the separated video data respectively, and the audio/video separation and preprocessing can be realized based on function functions provided by FFMPEG, OPENCV and the like.

As can be seen from the above description, the quality inspection terminal provided in the embodiment of the present application performs data processing on a data stream, and then performs a quality inspection operation, so as to avoid network resource occupation and transmission delay caused by transmitting a video with a large data volume to a quality inspection server, and further improve the timeliness of quality inspection.

In order to solve the problem that the existing data stream quality inspection generally needs to be completed within several hours or even 2 nd day after the recording is completed, which results in poor customer experience and operation efficiency, the present application provides an embodiment of a quality inspection server, which specifically includes the following contents, referring to fig. 7:

the data receiving module 20: receiving a data stream sent by a quality inspection terminal, wherein the data stream is a current recorded data stream acquired by the quality inspection terminal in a data stream recording process;

first quality inspection module 21: executing a first quality inspection according to the data stream to obtain a first quality inspection result;

the first result transmission module 22: and sending the first quality inspection result to a quality inspection terminal so that the quality inspection terminal returns the first quality inspection result to a data stream recording terminal.

It can be understood that, in the recording process, the recording terminal sends the currently recorded data stream and the quality inspection information to the quality inspection terminal every set time length, the quality inspection terminal processes the data stream, the data receiving module 20 receives the processed data stream sent by the quality inspection terminal, the first quality inspection module 21 performs all or part of quality inspection on the processed data stream according to the quality inspection information, after the quality inspection is completed, the first result sending module 22 transmits the quality inspection result to the quality inspection terminal, the quality inspection terminal returns the quality inspection result to the recording terminal, and the data stream with unqualified quality inspection is re-recorded. The first quality inspection module 21 comprises an audio quality inspection unit and a video quality inspection unit, and for an audio data stream, the audio quality inspection unit performs voice conversion on recoded audio data into a text, compares the similarity of the text with a standard speech template and an illegal language in the modes of natural language processing, keyword matching and the like, judges whether the similarity exceeds a preset qualified threshold value, judges that the quality inspection is qualified if the similarity exceeds the preset qualified threshold value, and judges that the quality inspection is unqualified if the similarity is lower than the threshold value; aiming at the video data stream, the video quality inspection unit adopts a target detection algorithm and a behavior recognition algorithm based on deep learning to detect face information, certificate/product data, signature action, handwriting and the like in the picture aiming at the picture obtained by frame extraction, so as to judge whether a customer manager and a client are positioned on the same picture, whether the customer manager displays the certificate or the product data, whether the client has the signature action, whether the client has the handwriting signature and the like, and compare the result with a preset threshold, when the confidence coefficient of the detection result is greater than the threshold, the quality inspection is qualified, and when the confidence coefficient of the detection result is lower than the threshold, the quality inspection is unqualified.

As can be seen from the above description, the quality inspection server provided in the embodiment of the present application performs quality inspection by using high performance computing resources such as the CPU, the GPU, and the TPU of the server itself, so that the quality inspection is guaranteed to be completed in a short time after the recording is completed, and the need for the customer to return to the place of business again for additional recording is avoided, thereby improving the customer experience and the operation efficiency.

In some embodiments, the quality inspection server further includes a storage unit 23, and the storage unit 23 can correlate the quality inspection result for subsequent query and statistical analysis.

In order to solve the problem that the existing data stream quality inspection generally needs to be completed within several hours or even 2 nd day after the recording is completed, which results in poor customer experience and operation efficiency, the present application provides an embodiment of a data stream quality inspection system, see fig. 8, the data stream quality inspection system specifically includes a quality inspection terminal 30 and a quality inspection server 31:

it can be understood that the quality inspection terminal 30 can process the recorded data stream, the quality inspection terminal 30 can reasonably distribute between the quality inspection terminal 30 and the quality inspection server 31 according to the performance of the terminal side, the quality inspection items which can be supported by the computing resources of the terminal side and have large data volume are retained in the quality inspection terminal 30, and other quality inspection items are deployed to the quality inspection server 31, so that the purposes of reducing network transmission delay and improving the timeliness of quality inspection are achieved. If the terminal performance is weak, the data stream quality inspection function of the quality inspection terminal 30 can be transferred to the quality inspection server 31, and only the data processing function of the quality inspection terminal 30 is reserved. The quality inspection terminal 30 finally integrates the quality inspection result sent by the quality inspection server 31, and returns the quality inspection result to the recording terminal, and the quality inspection terminal 30 can be deployed in combination with the recording terminal, and can be deployed independently of the recording terminal when the performance of the recording terminal is not enough to complete the basic necessary functions. The quality inspection server 31 receives the quality inspection request forwarded by the quality inspection server 31, completes quality inspection by using high-performance computing power of the quality inspection server 31, and returns a quality inspection result.

As can be seen from the above description, in the data stream quality inspection system provided in the embodiment of the present application, the quality inspection terminal additionally obtains one data stream, and sends the data stream to the quality inspection server, and performs quality inspection by using high-performance computing resources such as the quality inspection server CPU, the GPU, and the TPU, so as to ensure that quality inspection is completed in a short time after recording is completed, and avoid requiring the customer to return to the business place again for additional recording, thereby improving the customer experience and the operation efficiency.

In order to further improve the efficiency of data flow quality inspection, in an embodiment of the data flow quality inspection system provided in the present application, referring to fig. 8, the data flow quality inspection system further includes: a dual-recording peripheral 32, a dual-recording terminal module 33 and a dual-recording server 34.

It can be understood that the dual recording peripheral 32 includes an audio and video acquisition device such as a camera and a microphone, and is configured to acquire image and sound information of a customer manager and a customer, and then return the relevant audio and video stream to the dual recording terminal module 33, and the dual recording peripheral 32 may be external hardware, and is connected to the dual recording terminal module 2 through a wired or wireless interface such as a USB or a bluetooth, and may also be embedded hardware of the dual recording terminal module 33. The dual recording terminal module 33, a program interface of the dual recording system, and a customer manager may perform dual recording by clicking a related menu, obtain audio/video stream information of the dual recording peripheral 32 to form a dual recording file, and additionally provide a real-time dual recording video stream and quality inspection task information to the quality inspection terminal 30 by means of memory copy and the like. The dual-recording terminal module 33 may be in a B/S mode or a C/S mode, and is generally disposed on a desktop/notebook computer, a tablet computer, a smart phone, and other devices. The dual-recording server 34, a server of the dual-recording system, provides the service functions required by the dual-recording, and displays the service functions to the client manager through the dual-recording terminal module 33, for example: user and authority management, double-recording product information management, double-recording management, client information query and the like.

As can be seen from the above description, the data stream quality inspection system provided in the embodiment of the present application, on one hand, by additionally obtaining a real-time dual-recording video stream, implements synchronous quality inspection when dual recording is started, and avoids a delay caused by waiting for dual recording to be completed and uploading a video file before quality inspection is started in a conventional mode; on the other hand, partial quality testing items are arranged on the terminal side according to the terminal performance and deployed to the server side, so that the time consumption of transmission is reduced, the pressure of the server side is reduced, and the timeliness of quality testing is further improved, so that the quality testing can be completed in a short time after double recording is completed, a client does not leave at the moment, additional recording can be performed on non-compliance items, and the client experience and the business efficiency are improved.

The data stream quality inspection system will be described in detail with reference to the following embodiments, and refer to fig. 9.

S1101: the dual-recording peripheral collects video and audio data of a customer manager and a customer.

S1102: and the double-recording terminal module acquires double-recording video data.

S1103: the data acquisition module additionally acquires a real-time double-recording video stream and task information (such as double-recorded product information, quality inspection items and the like) required by quality inspection from the double-recording terminal.

S1104: the audio and video separation unit separates the real-time double-recording data into audio data and video data.

S1105: the audio preprocessing unit recodes the audio data in aspects of coding format, sampling rate, code stream and the like according to the needs.

S1106: and the video preprocessing unit performs frame extraction according to a preset frequency to form a picture aiming at the separated video data.

S1107: the audio quality inspection unit performs audio quality inspection according to the deployed functions, and for the terminal performance deficiency, part or all of the quality inspection functions may be deployed in the S1110 of the quality inspection server.

S1108: the video quality inspection unit performs quality inspection on the frame-extracted picture, and for the insufficient terminal performance, part or all of the quality inspection functions can be deployed in S1111 of the quality inspection server.

S1109: the transmission unit receives the quality inspection task information and corresponding information such as audio/text/pictures.

S1110: and the audio quality inspection unit performs quality inspection according to the audio quality inspection rule.

S1111: the video quality inspection unit performs quality inspection according to the video quality inspection rule.

S1112: the storage unit stores the quality inspection result for subsequent query and statistical analysis.

Meanwhile, the quality inspection result of the quality inspection server can be returned to the quality inspection terminal, and the quality inspection result is returned to the double-recording terminal after the quality inspection result is integrated with the results of all quality inspection items, so that a customer manager can check the quality inspection result.

In terms of hardware, in order to solve the problem that the existing data stream quality inspection generally needs to be completed within several hours or even 2 nd day after the recording is completed, which results in poor customer experience and poor operation efficiency, the present application provides an embodiment of an electronic device for implementing all or part of the contents in the data stream quality inspection method, where the electronic device specifically includes the following contents:

fig. 10 is a schematic block diagram of a system configuration of an electronic device 9600 according to an embodiment of the present application. As shown in fig. 10, the electronic device 9600 can include a central processor 9100 and a memory 9140; the memory 9140 is coupled to the central processor 9100. Notably, this fig. 10 is exemplary; other types of structures may also be used in addition to or in place of the structure to implement telecommunications or other functions.

In one embodiment, the data flow qualification function may be integrated into a central processor. Wherein the central processor may be configured to control:

In another embodiment, the data flow quality inspection system may be configured separately from the central processor 9100, for example, the data flow quality inspection system may be configured as a chip connected to the central processor 9100, and the data flow quality inspection function is realized by the control of the central processor.

As shown in fig. 10, the electronic device 9600 may further include: a communication module 9110, an input unit 9120, an audio processor 9130, a display 9160, and a power supply 9170. It is noted that the electronic device 9600 also does not necessarily include all of the components shown in fig. 10; in addition, the electronic device 9600 may further include components not shown in fig. 10, which can be referred to in the prior art.

As shown in fig. 10, a central processor 9100, sometimes referred to as a controller or operational control, can include a microprocessor or other processor device and/or logic device, which central processor 9100 receives input and controls the operation of the various components of the electronic device 9600.

The memory 9140 can be, for example, one or more of a buffer, a flash memory, a hard drive, a removable media, a volatile memory, a non-volatile memory, or other suitable device. The information relating to the failure may be stored, and a program for executing the information may be stored. And the central processing unit 9100 can execute the program stored in the memory 9140 to realize information storage or processing, or the like.

The input unit 9120 provides input to the central processor 9100. The input unit 9120 is, for example, a key or a touch input device. Power supply 9170 is used to provide power to electronic device 9600. The display 9160 is used for displaying display objects such as images and characters. The display may be, for example, an LCD display, but is not limited thereto.

The memory 9140 can be a solid state memory, e.g., Read Only Memory (ROM), Random Access Memory (RAM), a SIM card, or the like. There may also be a memory that holds information even when power is off, can be selectively erased, and is provided with more data, an example of which is sometimes called an EPROM or the like. The memory 9140 could also be some other type of device. Memory 9140 includes a buffer memory 9141 (sometimes referred to as a buffer). The memory 9140 may include an application/function storage portion 9142, the application/function storage portion 9142 being used for storing application programs and function programs or for executing a flow of operations of the electronic device 9600 by the central processor 9100.

The memory 9140 can also include a data store 9143, the data store 9143 being used to store data, such as contacts, digital data, pictures, sounds, and/or any other data used by an electronic device. The driver storage portion 9144 of the memory 9140 may include various drivers for the electronic device for communication functions and/or for performing other functions of the electronic device (e.g., messaging applications, contact book applications, etc.).

The communication module 9110 is a transmitter/receiver 9110 that transmits and receives signals via an antenna 9111. The communication module (transmitter/receiver) 9110 is coupled to the central processor 9100 to provide input signals and receive output signals, which may be the same as in the case of a conventional mobile communication terminal.

Based on different communication technologies, a plurality of communication modules 9110, such as a cellular network module, a bluetooth module, and/or a wireless local area network module, may be provided in the same electronic device. The communication module (transmitter/receiver) 9110 is also coupled to a speaker 9131 and a microphone 9132 via an audio processor 9130 to provide audio output via the speaker 9131 and receive audio input from the microphone 9132, thereby implementing ordinary telecommunications functions. The audio processor 9130 may include any suitable buffers, decoders, amplifiers and so forth. In addition, the audio processor 9130 is also coupled to the central processor 9100, thereby enabling recording locally through the microphone 9132 and enabling locally stored sounds to be played through the speaker 9131.

Embodiments of the present application further provide a computer-readable storage medium capable of implementing all steps in the data stream quality inspection method in the foregoing embodiments, where the computer-readable storage medium stores a computer program, and the computer program, when executed by a processor, implements all steps of the data stream quality inspection method in the foregoing embodiments, where the execution subject is a server or a client, for example, the processor implements the following steps when executing the computer program:

As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (devices), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

The principle and the implementation mode of the invention are explained by applying specific embodiments in the invention, and the description of the embodiments is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims

1. A data flow quality detection method, which is executed by a quality detection terminal, comprises the following steps:

2. The data flow qualification method of claim 1 further comprising:

3. The data stream quality inspection method of claim 1, wherein the data stream comprises an audio data stream, and wherein the step of performing a first quality inspection by the quality inspection server comprises performing at least a portion of the step of performing a quality inspection;

wherein, the quality inspection step comprises:

converting the audio data stream into text data;

4. The data stream quality inspection method of claim 2, wherein the data stream comprises an audio data stream, and wherein the step of performing a first quality inspection by the quality inspection server comprises performing a portion of the quality inspection step;

wherein, the quality inspection step comprises:

converting the audio data stream into text data;

5. The data stream quality inspection method of claim 1, wherein the data stream comprises a video data stream, and wherein the step of performing a first quality inspection by the quality inspection server comprises performing at least a portion of the step of performing a quality inspection;

wherein, the quality inspection step comprises:

6. The data stream quality inspection method of claim 2, wherein the data stream comprises a video data stream, and wherein the step of performing a first quality inspection by the quality inspection server comprises performing a portion of the quality inspection step;

wherein, the quality inspection step comprises:

7. A data stream quality inspection method, which is executed by a quality inspection server, comprises the following steps:

8. The data stream quality inspection method of claim 7, wherein the data stream comprises an audio data stream, and wherein performing a first quality inspection based on the data stream comprises:

performing at least a portion of the quality testing step;

wherein, the quality inspection step comprises:

converting the audio data stream into text data;

9. The data stream quality inspection method of claim 7, wherein the data stream comprises a video data stream, and wherein performing a first quality inspection based on the data stream comprises:

performing at least a portion of the quality testing step;

wherein, the quality inspection step comprises:

10. A method for data stream quality inspection, comprising:

sending the currently recorded data stream to a quality inspection server;

11. The data flow qualification method of claim 10 further comprising:

12. A quality inspection terminal, comprising:

13. The quality inspection terminal of claim 12, further comprising:

14. A quality control server, comprising:

15. A data stream quality inspection system is characterized by comprising a quality inspection terminal and a quality inspection server;

16. A data stream quality inspection system is characterized by comprising a quality inspection terminal and a quality inspection server;

17. An electronic device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor implements the data flow quality inspection method of any one of claims 1 to 11 when executing the program.

18. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the method for data flow quality inspection according to any one of claims 1 to 11.