WO2019085584A1

WO2019085584A1 - Multimedia data processing and acquiring method, collection terminal and processing apparatus

Info

Publication number: WO2019085584A1
Application number: PCT/CN2018/100418
Authority: WO
Inventors: 洪泽
Original assignee: 格力电器（武汉）有限公司; 珠海格力电器股份有限公司
Priority date: 2017-10-30
Filing date: 2018-08-14
Publication date: 2019-05-09
Also published as: CN107770280B; CN107770280A

Abstract

Disclosed are a multimedia data processing and acquiring method, a collection terminal and a processing apparatus. The method comprises: acquiring original multimedia data; detecting, based on received pre-set configuration information sent by a multimedia data processing apparatus, whether there is target multimedia data, in the original multimedia data, matching pre-set target multimedia data in the pre-set configuration information; if so, acquiring the target multimedia data, and a detection result characterizing that the target multimedia data exists in the original multimedia data; and sending the target multimedia data and/or the detection result to the multimedia data processing apparatus. By means of the technical solution, the timeliness and the integrity of mass data transmission to a multimedia data processing apparatus by means of a multimedia data collection terminal via a network can be greatly improved, and at the same time, the occupancy on a network transmission bandwidth by junk data can be effectively reduced.

Description

Multimedia data processing and acquisition method, acquisition terminal and processing device

Related application

The present application claims priority to the Japanese Patent Application Serial No. No. No. No. No. No. No. No. No. No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No.

Technical field

The present application relates to the field of data processing, and in particular, to a multimedia data processing and acquisition method, an acquisition terminal, and a processing device.

Background technique

With the development and application of multimedia data acquisition technology, multimedia data acquisition terminals can be used to obtain clearer, smoother and more complete multimedia data, such as clearer, smoother and complete images, audio, video and other data. While the quality of the collected multimedia data is improved, the amount of collected multimedia data has also multiplied, and higher requirements have been placed on the storage, transmission and analysis of the data.

In the traditional processing mode, an external multiple multimedia data collection terminal, such as an imaging device, separately collects image, audio or video data, and encodes the collected data into certain specific pictures, audio or video formats, and transmits the data to the network through the network. The center or cloud platform processes the collected data in the data center, such as license plate recognition, violation detection, face recognition, speed detection, and speech recognition.

The traditional processing method will send almost all the collected data to the data center, which contains a lot of redundant and invalid data, which takes up a lot of network bandwidth, and will be discarded after the data center processing.

It can be seen that there are at least the following technical problems in the prior art: the multimedia data collection terminal only has the multimedia data collection function, and the collected data is sent to the multimedia data processing device, so that the data received by the multimedia data processing device contains a large amount of invalid data. , occupying storage space and transmission bandwidth, reducing the efficiency of multimedia data transmission and processing.

Summary of the invention

The embodiment of the present application provides a multimedia data processing and acquiring method, a collecting terminal, and a processing device, which are used to solve the problem that the multimedia data collecting terminal in the prior art only has a multimedia data collecting function, and the collected data is sent to the multimedia data processing device. The data received by the multimedia data processing device contains a large amount of invalid data, occupies storage space and transmission bandwidth, and reduces the technical problem of efficiency of multimedia data transmission and processing.

In a first aspect, an embodiment of the present application provides a multimedia data processing method, which is applied to a multimedia data collection terminal, and the method includes:

Obtain original multimedia data;

And detecting, according to the preset configuration information sent by the received multimedia data processing device, whether the target multimedia data that matches the preset target multimedia data in the preset configuration information exists in the original multimedia data;

When yes, acquiring the target multimedia data, and detecting a detection result of the parameter information of the target multimedia data;

Transmitting the target multimedia data and/or the detection result to the multimedia data processing device.

Optionally, after the obtaining the target multimedia data and the detecting result of the parameter information of the target multimedia data, the method further includes:

The non-target multimedia data of the original multimedia data except the target multimedia data is stored locally.

Optionally, after the non-target multimedia data of the target multimedia data is stored locally in the original multimedia data, the method further includes:

Deleting the non-target multimedia data after a preset period of time; or

After a predetermined period of time, when the occupancy rate of the multimedia data channel for transmitting the multimedia data to the multimedia data processing device is not greater than the first threshold, the non-target multimedia data is transmitted to the multimedia data processing device.

Optionally, the sending the target multimedia data and/or the detection result to the multimedia data processing device includes:

Transmitting the target multimedia data and the detection result to the multimedia data processing device simultaneously; or

When the occupancy rate of the multimedia data channel for transmitting the multimedia data to the multimedia data processing device is greater than the first threshold, the detection result is transmitted to the multimedia data processing device by using the multimedia data channel, when used for the multimedia data processing device Sending the target multimedia data to the multimedia data processing device by using the multimedia data channel when the occupation rate of the multimedia data channel transmitting the multimedia data is not greater than the first threshold; or

Transmitting the detection result to the multimedia data processing device, and if receiving the control command sent by the multimedia data processing device for characterizing uploading the target multimedia data, transmitting the target multimedia data to the multimedia data processing Device.

Optionally, the original multimedia data includes original image data, original audio data, or original video data;

The target multimedia data includes target image data, target audio data, or target video data.

In a second aspect, an embodiment of the present application provides a multimedia data acquiring method, which is applied to a multimedia data processing device, and the method includes:

And sending the preset configuration information to the multimedia data collection terminal, so that the multimedia data collection terminal detects, according to the preset configuration information, whether the preset target multimedia in the preset configuration information exists in the original multimedia data collected by the multimedia data collection terminal. Data matching target multimedia data;

Receiving, by the multimedia data collection terminal, the target multimedia data and/or the detection result of the parameter information used to represent the target multimedia data after determining that the target multimedia data exists in the original multimedia data.

Optionally, receiving, by the multimedia data collection terminal, after determining that the target multimedia data exists in the original multimedia data, sending the target multimedia data and/or detecting parameter information used to represent the target multimedia data The results include:

Receiving the detection result that is sent by the multimedia data collection terminal after determining that the target multimedia data exists in the original multimedia data; sending a control command for characterizing uploading the target multimedia data, and receiving the multimedia data collection The target multimedia data transmitted by the terminal based on the control command.

In a third aspect, an embodiment of the present application provides a multimedia data processing apparatus, where the apparatus includes:

a first acquiring module, configured to acquire original multimedia data;

a detecting module, configured to detect, according to the preset configuration information sent by the received multimedia data processing device, whether the target multimedia data that matches the preset target multimedia data in the preset configuration information exists in the original multimedia data;

a second acquiring module, configured to: when yes, acquire the target multimedia data, and represent a detection result of the parameter information of the target multimedia data;

And a first sending module, configured to send the target multimedia data and/or the detection result to the multimedia data processing apparatus.

Optionally, the device further includes:

a storage module, configured to: after the obtaining the target multimedia data, and characterizing the detection result of the parameter information of the target multimedia data, storing the non-target multimedia data of the original multimedia data except the target multimedia data local.

Optionally, the device further includes: a deleting module and a second sending module, after the non-target multimedia data of the target multimedia data is stored locally in the original multimedia data: the deleting module is configured to: Deleting the non-target multimedia data after a preset period of time; or

The second sending module is configured to send the non-target multimedia data to the non-target multimedia data when the occupation rate of the multimedia data channel for transmitting the multimedia data to the multimedia data processing device is not greater than the first threshold value after a preset time period The multimedia data processing device.

Optionally, the first sending module includes:

a first sending submodule, configured to simultaneously send the target multimedia data and the detection result to the multimedia data processing device; or

a second sending submodule, configured to send the detection result to the multimedia data processing device by using the multimedia data channel when an occupation rate of the multimedia data channel for transmitting the multimedia data to the multimedia data processing device is greater than a first threshold Transmitting the target multimedia data to the multimedia data processing device by using the multimedia data channel when an occupation rate of a multimedia data channel for transmitting multimedia data to the multimedia data processing device is not greater than a first threshold; or

a third sending submodule, configured to send the detection result to the multimedia data processing device, if the control command sent by the multimedia data processing device for characterizing uploading the target multimedia data is received, the target multimedia is Data is sent to the multimedia data processing device.

In a fourth aspect, an embodiment of the present application provides a multimedia data acquiring apparatus, where the apparatus includes:

The first sending module is configured to send the preset configuration information to the multimedia data collecting terminal, so that the multimedia data collecting terminal detects whether the original multimedia data collected by the multimedia data collecting terminal exists and the preset configuration based on the preset configuration information. Target multimedia data in which the preset target multimedia data matches in the information;

a receiving module, configured to receive, by the multimedia data collecting terminal, the target multimedia data that is sent after determining the target multimedia data in the original multimedia data, and/or parameter information used to represent the target multimedia data Test results.

Optionally, the receiving module includes:

a first receiving submodule, configured to receive the detection result sent by the multimedia data collection terminal;

Sending a control command for characterizing uploading the target multimedia data;

And a second receiving submodule, configured to receive the target multimedia data that is sent by the multimedia data collection terminal according to the control command.

In a fifth aspect, an embodiment of the present application provides a computer apparatus, where the apparatus includes a processor, where the processor is configured to implement a method as described in the first aspect or the second aspect when executing a computer program stored in a memory A step of.

In a sixth aspect, an embodiment of the present application provides a computer readable storage medium having stored thereon a computer program, wherein the computer program is executed by a processor to implement the first aspect or the second aspect embodiment The steps of the method.

One or more technical solutions provided in the embodiments of the present application have at least the following technical effects or advantages:

The technical solution provided by the embodiment of the present application can greatly improve the efficiency and integrity of the multimedia data collection terminal when transmitting large amounts of data to the multimedia data processing device through the network, and can effectively reduce the occupation of the network transmission bandwidth by the garbage data. The important data is preferentially transmitted and processed to reduce the burden of data storage and data processing of the data processing device. It is also possible to use the method of first storing and then transmitting to improve the utilization of the network transmission bandwidth and achieve balanced transmission.

DRAWINGS

FIG. 1 is a flowchart of a multimedia data processing method according to an embodiment of the present application;

2 is a flowchart of a method for acquiring multimedia data according to an embodiment of the present application;

FIG. 3 is a schematic diagram of a multimedia data collection terminal according to an embodiment of the present application;

4 is a schematic diagram of a multimedia data processing apparatus according to an embodiment of the present application;

FIG. 5 is a schematic diagram of an entire system according to an embodiment of the present application.

Detailed ways

In order to solve the above technical problem, the general idea of the technical solution in the embodiment of the present application is as follows:

The multimedia data processing and obtaining method, the collecting terminal, and the processing device acquire the original multimedia data; and based on the preset configuration information sent by the received multimedia data processing device, detecting whether the original multimedia data exists in the preset configuration information The target multimedia data matched with the target multimedia data; when yes, acquiring the target multimedia data, and characterizing the detection result of the target multimedia data in the original multimedia data; and the target multimedia data and / or the detection result is sent to the multimedia data processing device. By adopting the technical solution, the time efficiency and integrity of the multimedia data collection terminal transmitting large quantities of data to the multimedia data processing device through the network can be greatly improved, and the occupation of the network transmission bandwidth by the garbage data can be effectively reduced.

In order to better understand the above technical solutions, the above technical solutions will be described in detail below in conjunction with the drawings and specific embodiments.

As shown in FIG. 1 , a first embodiment of the present application provides a multimedia data processing method, which is applied to a multimedia data collection terminal, and the method includes:

S101. Acquire original multimedia data.

S102, detecting, according to preset configuration information sent by the received multimedia data processing device, whether the target multimedia data that matches the preset target multimedia data in the preset configuration information exists in the original multimedia data;

S103, when yes, acquiring the target multimedia data, and detecting a detection result of the parameter information of the target multimedia data;

S104. Send the target multimedia data and/or the detection result to the multimedia data processing device.

For step S101, the original multimedia data collected by the multimedia data collection terminal is, for example, original image data, original audio data, or original video data. The multimedia data collection terminal is, for example, a video camera, a camera, a recording device, or the like. After performing step S101 and before step S102, the method may further comprise: performing basic denoising processing on the original image data, the original audio data or the original video data, for example, performing basic denoising on the image data collected by the camera, and white Basic processing such as balancing, resulting in high quality image data. Of course, the detection of step S102 can also be performed directly on the original image data, the original audio data or the original video data.

For the step S102, specifically, the multimedia data processing device sends the preset configuration information to the multimedia data collection terminal, and performs function configuration on the multimedia data collection terminal, wherein the preset configuration information may include preset target multimedia data and a preset algorithm model. . The multimedia data collection terminal performs multimedia data detection according to the preset configuration information sent by the received multimedia data processing device, and the multimedia data collection terminal detects whether the original multimedia data exists in the preset configuration information by using a preset algorithm model. The preset target multimedia data matches the target multimedia data.

The multimedia data collection terminal can acquire the configuration information of the multimedia data processing device in real time, update the local program according to the configuration information, create a new data algorithm model, process the original multimedia data to obtain new results, and finally send a new result to data center. For example, when a convolutional neural network algorithm is used, the multimedia data collection terminal can continuously update the convolutional neural network structure, the number of layers, the number of neurons per layer, the connection weights between the neurons in each layer, and the activation according to the received configuration information. Functions, etc.

The function configuration is specifically, for example, when the violation condition of the red light is required to be recognized, the multimedia data processing device sends the target image data including the preset red light and the preset algorithm model of the preset red light to the preset data. The original image data collected by the multimedia data collection terminal is detected by using an algorithm model of the preset red light, and whether the target image data matching the target image data of the preset red light is detected in the original image data. Here is only an example. In addition to performing red light detection, the multimedia data collection terminal can also perform other traffic violations (such as speed detection, etc.). At the same time, the multimedia data collection terminal can also detect the face image in the video or image data, and can also perform voice recognition, remote sound collection, etc., for example, detection of illegal content in the voice, etc., and will not be exemplified herein.

For step S103, specifically, the target multimedia data includes target image data, target audio data, or target video data. For example, when there is target image data matching the target image data of the preset red light in the image data collected by the multimedia data collecting terminal, the target image data and the detection result of the parameter information for characterizing the target image data are acquired. . For example, the target image data is acquired, and the detection result of the parameter information (for example, the behavior information of the red light and the license plate number information) for characterizing the target data image. Similarly, here is only an example, the multimedia data collection terminal can obtain the target image information and the detection result of other traffic violations in addition to the target image information and the detection result of the illegal action of the red light.

At the same time, the multimedia data collection terminal can also detect the face image in the video or image data, and can also perform voice recognition, such as detection of illegal content in the voice, etc., and acquire target video data or target audio data and used to represent the target video. The detection result of the parameter information of the data or the target audio data. For example, in voice detection, target audio data and user information, terminal information, and the like for characterizing illegal voices involved in the target audio data are obtained.

For step S104, it specifically includes the following implementation manners:

In the first mode, the target multimedia data and the detection result are simultaneously sent to the multimedia data processing device. For example, the multimedia data collection terminal transmits to the multimedia data processing device through the network. If the network transmission bandwidth occupancy rate is not high, that is, when the network is not busy or even idle, the target multimedia data and the detection result may be simultaneously sent to the multimedia data processing. The apparatus, for example, simultaneously transmits the aforementioned target image data matching the target image data of the preset red light and the detection result of the parameter information for characterizing the target image data to the multimedia data processing apparatus.

Method 2, when the occupation rate of the multimedia data channel for transmitting the multimedia data to the multimedia data processing device is greater than the first threshold, transmitting the detection result to the multimedia data processing device by using the multimedia data channel, when used for the multimedia When the occupation rate of the multimedia data channel of the multimedia data transmitted by the data processing device is not greater than the first threshold, the target multimedia data is transmitted to the multimedia data processing device by using the multimedia data channel.

For example, the multimedia data collection terminal transmits to the multimedia data processing device through the multimedia data channel. If the network transmission bandwidth occupancy rate of the multimedia data channel is high, for example, greater than the first threshold, that is, when the network is busy, the detection result may be first sent to the multimedia. The data processing device transmits the target multimedia data to the multimedia data processing device when the network is not busy. Specifically, if the first threshold is 80%, and the network transmission bandwidth occupancy rate is 95%, which is greater than the first threshold, the network is busy, and the detection result is first sent to the multimedia data processing device. When the network is not busy, for example, when the network transmission bandwidth occupancy rate is 60%, the target multimedia data is transmitted to the multimedia data processing device. The first threshold can be set according to the actual working conditions.

For example, when the multimedia data channel is busy, the detection result of the parameter information (which may include the parameter information of the red light behavior and the license plate number information) for characterizing the target image data is transmitted to the multimedia data processing device; when the multimedia data channel is not busy And transmitting the target image data (image data of the collected red light) matching the target image data of the preset red light to the multimedia data processing device.

And sending, by the multimedia data processing device, the target multimedia data to the Multimedia data processing device.

For example, the multimedia data collection terminal transmits to the multimedia data processing device through the multimedia data channel. If the network transmission bandwidth occupancy rate of the multimedia data channel is high, for example, greater than the first threshold, that is, when the network is busy, the detection result may be first sent to the multimedia. The data processing device transmits the target multimedia data to the multimedia data processing device upon receiving the control command sent by the multimedia data processing device for characterizing uploading the target multimedia data. Specifically, if the first threshold is 80%, and the network transmission bandwidth occupancy rate is 95%, which is greater than the first threshold, the network is busy, and the detection result is first sent to the multimedia data processing device. Serving, if receiving a control command sent by the multimedia data processing device for characterizing uploading the target multimedia data, transmitting the target multimedia data to the multimedia data processing device. The first threshold can be set according to the actual working conditions.

For example, when the multimedia data channel is busy, the detection result of the parameter information (the parameter information including the behavior of the red light lamp and the license plate number information) for characterizing the target image data is transmitted to the multimedia data processing device; and the multimedia data is received. When the control command sent by the processing device for characterizing the uploading of the target image data is used, the target image data (image data of the collected red light) matched with the target image data of the preset red light is transmitted to the multimedia data processing device.

After performing step S102 and before performing step S103, the method may further include:

The non-target multimedia data of the original multimedia data except the target multimedia data is stored locally. The non-target multimedia data includes non-target image data, non-target audio data, or non-target video data.

For the presence of local non-target multimedia data, the processing method can be determined by negotiation with the multimedia data processing device.

For example, after a predetermined period of time, the multimedia data collection terminal may delete the non-target multimedia data. The specific deletion period can be determined through negotiation with the multimedia data processing device, for example, deleting the storage content 3 months before every 3 months, or determining the amount of data stored locally, for example, when the local storage amount is full, The original stored original multimedia data is deleted first.

Or, after a predetermined period of time, when the occupation rate of the multimedia data channel for transmitting the multimedia data to the multimedia data processing device is not greater than the first threshold (for example, the network of the multimedia data channel is idle), sending the non- Target multimedia data to the multimedia data processing device. Then, the multimedia data processing device decides how to handle the non-target multimedia data.

In addition to the non-target multimedia data, the target multimedia data and the detection result can be temporarily stored locally for the multimedia data processing device to further process the demand. That is to say, the storage of the multimedia data can be negotiated by the multimedia data collection terminal and the multimedia data processing device. If the useless information is saved for a certain period of time, the device automatically saves the storage space of the terminal. It is also possible to transmit information to the multimedia data processing device during the period when the network is not busy, in preparation for further processing by the multimedia data processing device. The original multimedia data may be encoded in consideration of factors such as data transmission bandwidth and storage space, for example, encoding original picture data into Jpeg, H264, H265, and the like.

That is to say, the processing and/or storage of multimedia data can be realized in the multimedia data collection terminal and the multimedia data processing device, and achieve the purpose of distributed processing and distributed storage.

As shown in FIG. 2, the second embodiment of the present application provides a multimedia data acquiring method, which is applied to a multimedia data processing apparatus, where the method includes:

S201, the preset configuration information is sent to the multimedia data collection terminal, so that the multimedia data collection terminal detects, according to the preset configuration information, whether the original multimedia data collected by itself and the preset in the preset configuration information Target multimedia data matched by the target multimedia data;

S202. Receive the detection result of the target multimedia data and/or the parameter information used to represent the target multimedia data after the multimedia data collection terminal determines that the target multimedia data exists in the original multimedia data.

For step S201, the method specifically includes:

The multimedia data processing device sends preset configuration information to the multimedia data collection terminal, and performs function configuration on the multimedia data collection terminal. The preset configuration information may include preset target multimedia data and a preset algorithm model. The multimedia data collection terminal performs multimedia data detection according to the preset configuration information sent by the received multimedia data processing device, and the multimedia data collection terminal detects whether the original multimedia data exists in the preset configuration information by using a preset algorithm model. The preset target multimedia data matches the target multimedia data.

For example, the multimedia data data processing device is connected to each multimedia data collection terminal through a multimedia data channel, and the multimedia data data processing device can perform corresponding configuration on the terminal for different user requirements.

For example, in a scene where only face recognition is required, each multimedia data collection terminal detects whether a human face matches a face desired by the multimedia data data processing apparatus. The center may send the relevant model used by the face recognition and the preset matching parameter data to one or more multimedia data collection terminals.

For step S202, the method specifically includes:

And if the multimedia data collection terminal determines that the target multimedia data exists in the original multimedia data, the multimedia data collection terminal sends the detection result of the target multimedia data and/or the parameter information used to represent the target multimedia data to Multimedia data data processing device.

Wherein the original multimedia data includes original image data, original audio data or original video data;

For example, one or more multimedia data collection terminals detect a human face in real time, and when the conditions are met, the detection result and the collected image data are transmitted to the multimedia data processing device.

For example, in the scenario of violation detection, the multimedia data collection terminal performs detections such as red light, overspeed, and pressure line. The multimedia data data processing device sends the corresponding pattern recognition model and the preset matching parameter to the collection terminal, and the multimedia data collection terminal detects the real-time according to the configuration. When an abnormal behavior is detected, the detected result and the original multimedia data are transmitted to the multimedia data processing device.

In addition, the multimedia data processing device can control and upgrade the multimedia data collection terminal in real time to meet different needs.

The multimedia data processing device upgrades the corresponding multimedia data collection terminal according to requirements, adopts a new algorithm and model, and expects to obtain new effective results. For example, in the vehicle-related identification of roads, it is mainly some tests related to vehicle violations. At this time, because some important events need to find someone as soon as possible, the parameters and models related to the face recognition can be sent to corresponding multimedia. Data collection terminal.

After receiving the new algorithm and model, the multimedia data collection terminal runs according to the new algorithm and detects it in real time. After detecting the result, the corresponding detection result and the original data are transmitted to the multimedia data processing device.

In the recognition algorithm using data training, such as convolutional neural networks. The digital multimedia data processing device can receive all the data collected by the multimedia data collecting terminal, train the model, and continuously enhance the intelligence level of the model. After the trained model meets the requirements, the multimedia data processing device sends the corresponding model parameters to all the collection terminals, and upgrades the multimedia data collection terminal to further enhance the intelligence of the multimedia data collection terminal.

As shown in FIG. 3, a third embodiment of the present application provides a multimedia data collection terminal, where the device includes:

The first obtaining module 301 is configured to acquire original multimedia data.

The detecting module 302 is configured to detect, according to preset configuration information sent by the received multimedia data processing device, whether the target multimedia data that matches the preset target multimedia data in the preset configuration information exists in the original multimedia data. ;

a second obtaining module 303, configured to: when yes, acquire the target multimedia data, and represent a detection result of the parameter information of the target multimedia data;

The first sending module 304 is configured to send the target multimedia data and/or the detection result to the multimedia data processing apparatus.

The multimedia data collection terminal is, for example, a camera, a camera, a recording device, a monitoring device, and the like. For the first acquisition module 301, the original multimedia data collected is, for example, original image data, original audio data or original video data, and the like. After the original multimedia data is collected, basic denoising processing is performed on the original image data, the original audio data or the original video data, for example, basic processing such as denoising and white balance is performed on the image data collected by the camera, and the high processing is performed. Quality image data. Of course, the second image acquisition module 203 can also directly detect the original image data, the original audio data, or the original video data.

For the detection module 302, specifically, the multimedia data processing device sends preset configuration information to the multimedia data collection terminal, and performs function configuration on the multimedia data collection terminal, wherein the preset configuration information may include preset target multimedia data and a preset algorithm. model. The detecting module 302 in the multimedia data collecting terminal performs multimedia data detection according to the preset configuration information sent by the received multimedia data processing device, and the multimedia data collecting terminal uses a preset algorithm model to detect whether the original multimedia data exists and The target multimedia data matched by the preset target multimedia data in the preset configuration information.

The function configuration is specifically, for example, when the violation condition of the red light is required to be recognized, the multimedia data processing device sends the target image data including the preset red light and the preset algorithm model of the preset red light to the preset data. The detecting module 302 detects the original image data collected by the multimedia data collecting terminal by using an algorithm model of the preset red light, and detects whether there is target image data matching the target image data of the preset red light in the original image data. For example, the detection module 302 in the multimedia data collection terminal can perform detection of other traffic violations (such as speed detection, etc.) in addition to performing red light detection. At the same time, the multimedia data collection terminal can also detect the face image in the video or image data, and can also perform voice recognition, remote sound collection, etc., for example, detection of illegal content in the voice, etc., and will not be exemplified herein.

The second obtaining module 303, specifically, the target multimedia data includes target image data, target audio data, or target video data. For example, when there is target image data matching the target image data of the preset red light in the image data collected by the first obtaining module 301, the second obtaining module 303 acquires the target image data and is used to represent the target image data. The detection result of the parameter information. For example, the second acquisition module 303 acquires target image data, and parameter information for characterizing the target data image, such as behavior information of the red light and detection result of the license plate number information. Similarly, here is only an example, the multimedia data collection terminal can obtain the target image information and the detection result of other traffic violations in addition to the target image information and the detection result of the illegal action of the red light.

At the same time, the multimedia data collection terminal can also detect the face image in the video or image data, and can also perform voice recognition, such as detection of illegal content in the voice, etc., and the second obtaining module 303 acquires the target video data or the target audio data and A detection result for characterizing the target video data or the parameter information of the target audio data. For example, in voice detection, target audio data and user information, terminal information, and the like for characterizing illegal voices involved in the target audio data are obtained.

For the first sending module 304, it may specifically include a first sending submodule, a second sending submodule or a third sending submodule, where:

And a first sending submodule, configured to simultaneously send the target multimedia data and the detection result to the multimedia data processing apparatus. For example, the multimedia data collection terminal transmits to the multimedia data processing device through the network. If the network transmission bandwidth occupancy rate is not high, that is, when the network is not busy or even idle, the first sending submodule can simultaneously send the target multimedia data and the detection result to The multimedia data processing apparatus transmits, for example, the target image data matching the target image data of the preset red light and the detection result of the parameter information for characterizing the target image data to the multimedia data processing apparatus.

a second sending submodule, configured to send the detection result to the multimedia data processing device by using the multimedia data channel when an occupation rate of the multimedia data channel for transmitting the multimedia data to the multimedia data processing device is greater than a first threshold And when the occupancy rate of the multimedia data channel for transmitting the multimedia data to the multimedia data processing device is not greater than the first threshold, the target multimedia data is transmitted to the multimedia data processing device by using the multimedia data channel.

For example, the multimedia data collection terminal transmits the multimedia data processing device to the multimedia data processing device. If the network transmission bandwidth occupancy rate of the multimedia data channel is high, for example, greater than the first threshold, that is, when the network is busy, the second sending submodule can first detect the detection result. Sending to the multimedia data processing device, when the network is not busy, the second sending submodule transmits the target multimedia data to the multimedia data processing device.

For example, when the multimedia data channel is busy, the second sending sub-module transmits the detection result of the parameter information (the parameter information that may include the behavior of the red light and the license plate number information) for characterizing the target image data to the multimedia data processing device; When the data channel is not busy, the second transmitting sub-module transmits the foregoing target image data (image data of the collected red light) matching the target image data of the preset red light to the multimedia data processing device.

For example, the multimedia data collection terminal transmits the multimedia data processing device to the multimedia data processing device. If the network transmission bandwidth occupancy rate of the multimedia data channel is high, for example, greater than the first threshold, that is, when the network is busy, the third sending submodule can first detect the detection result. Sending to the multimedia data processing device, when receiving the control command sent by the multimedia data processing device for characterizing uploading the target multimedia data, the third sending submodule transmits the target multimedia data to the multimedia data processing device.

For example, when the multimedia data channel is busy, the third transmitting sub-module transmits the detection result of the parameter information (the parameter information that may include the behavior of the red light and the license plate number information) for characterizing the target image data to the multimedia data processing device; When the control command sent by the multimedia data processing device for characterizing the uploading of the target image data is sent, the third transmitting sub-module matches the target image data that matches the target image data of the preset red light (the collected red light The image data) is sent to the multimedia data processing device.

The device further includes a storage module, a deletion module, and a second sending module. After the detecting module 302 detects whether the target multimedia data matches the preset target multimedia data in the preset configuration information, And before the second obtaining module 303 acquires the target multimedia data and the detection result of the parameter information of the target multimedia data, the storage module stores the non-target multimedia data of the original multimedia data except the target multimedia data. local. The non-target multimedia data includes non-target image data, non-target audio data, or non-target video data.

For example, after a predetermined period of time, the deletion module in the multimedia data collection terminal may delete the non-target multimedia data. The specific deletion period can be determined through negotiation with the multimedia data processing device. For example, the negotiation takes a period of one month or three months (may also be a period of days and hours, for example, a period of 30 days, 720 hours, etc.), The target multimedia data is deleted. Assume that for the stored non-target data, the deletion is performed after the period of one month of storage. It can also be determined according to the amount of data stored locally. For example, when the local storage amount is full, the original stored original multimedia data can be deleted first.

Or, after a predetermined period of time, when the occupation rate of the multimedia data channel for transmitting the multimedia data to the multimedia data processing device is not greater than the first threshold (for example, the network of the multimedia data channel is idle), the second sending module Transmitting the non-target multimedia data to the multimedia data processing device. Then, the multimedia data processing device decides how to handle the non-target multimedia data.

As shown in FIG. 4, Embodiment 4 of the present application provides a multimedia data processing apparatus, where the apparatus includes:

The first sending module 401 is configured to send preset configuration information to the multimedia data collecting terminal, so that the multimedia data collecting terminal detects, according to the preset configuration information, whether the original multimedia data collected by itself is present and the preset Target multimedia data matching the preset target multimedia data in the configuration information;

The receiving module 402 is configured to receive the target multimedia data that is sent by the multimedia data collection terminal after determining that the target multimedia data exists in the original multimedia data, and/or parameter information used to represent the target multimedia data. Test results.

The original multimedia data includes original image data, original audio data or original video data, and the like;

The target multimedia data includes target image data, target audio data or target video data, and the like.

For the first sending module 401, specifically, the first sending module 401 sends preset configuration information to the multimedia data collecting terminal, and performs function configuration on the multimedia data collecting terminal, wherein the preset configuration information may include preset target multimedia data and Preset algorithm model. The multimedia data collection terminal performs multimedia data detection according to the preset configuration information sent by the received multimedia data processing device, and the multimedia data collection terminal detects whether the original multimedia data exists in the preset configuration information by using a preset algorithm model. The preset target multimedia data matches the target multimedia data.

For example, the first sending module 401 in the multimedia data processing device is connected to each multimedia data collecting terminal through a multimedia data channel, and the multimedia data data processing device can perform specific configuration on the terminal for different user requirements.

For the receiving module 402, specifically, if the multimedia data collecting terminal determines that the target multimedia data exists in the original multimedia data, the multimedia data collecting terminal uses the target multimedia data and/or is used to represent the target multimedia data. The detection result of the parameter information is sent to the multimedia data data processing apparatus, that is, the receiving module 402 receives the target multimedia data and/or the detection result of the parameter information for characterizing the target multimedia data.

As shown in FIG. 5, it is a schematic diagram of a system including a multimedia data collection terminal and a multimedia data processing device, which includes a control center 11, a remote browser 12, a data center 13, and a display 14. Terminals 1-N are multimedia data collection terminals. Each multimedia data collection terminal communicates with the multimedia data processing device via a network (IP Network).

A fifth embodiment of the present invention provides a computer device, characterized in that the device comprises a processor, and the processor is configured to implement the steps of the method according to the first embodiment or the second embodiment when the computer program is executed in the memory. .

A sixth embodiment of the present invention provides a computer readable storage medium having stored thereon a computer program, wherein the computer program is executed by a processor to implement the steps of the method as described in the first embodiment or the second embodiment.

The technical solutions in the foregoing embodiments of the present application have at least the following technical effects or advantages:

While the preferred embodiment of the present application has been described, it will be apparent that those skilled in the art can make further changes and modifications to the embodiments. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and the modifications and

It will be apparent to those skilled in the art that various modifications and changes can be made in the present application without departing from the spirit and scope of the application. Thus, it is intended that the present invention cover the modifications and variations of the present invention.

Claims

A multimedia data processing method is applied to a multimedia data collection terminal, and the method includes:

Obtain original multimedia data;

And detecting, according to the preset configuration information sent by the received multimedia data processing device, whether the target multimedia data that matches the preset target multimedia data in the preset configuration information exists in the original multimedia data;

When yes, acquiring the target multimedia data, and detecting a detection result of the parameter information of the target multimedia data;

Transmitting the target multimedia data and/or the detection result to the multimedia data processing device.
The method according to claim 1, wherein after the obtaining the target multimedia data and characterizing the detection result of the parameter information of the target multimedia data, the method further comprises:

The non-target multimedia data of the original multimedia data except the target multimedia data is stored locally.
The method of claim 2, after the storing the non-target multimedia data of the target multimedia data in the original multimedia data locally, the method further comprises:

Deleting the non-target multimedia data after a preset period of time; or

After a predetermined period of time, when the occupancy rate of the multimedia data channel for transmitting the multimedia data to the multimedia data processing device is not greater than the first threshold, the non-target multimedia data is transmitted to the multimedia data processing device.
The method of claim 1, wherein the transmitting the target multimedia data and/or the detection result to the multimedia data processing device comprises:

Transmitting the target multimedia data and the detection result to the multimedia data processing device simultaneously; or

When the occupancy rate of the multimedia data channel for transmitting the multimedia data to the multimedia data processing device is greater than the first threshold, the detection result is transmitted to the multimedia data processing device by using the multimedia data channel, when used for the multimedia data processing device Sending the target multimedia data to the multimedia data processing device by using the multimedia data channel when the occupation rate of the multimedia data channel transmitting the multimedia data is not greater than the first threshold; or

Transmitting the detection result to the multimedia data processing device, and if receiving the control command sent by the multimedia data processing device for characterizing uploading the target multimedia data, transmitting the target multimedia data to the multimedia data processing Device.
A method according to any one of claims 1 to 4, wherein:

The original multimedia data includes original image data, original audio data, or original video data;

The target multimedia data includes target image data, target audio data, or target video data.
A multimedia data acquisition method is applied to a multimedia data processing device, and the method includes:

And sending the preset configuration information to the multimedia data collection terminal, so that the multimedia data collection terminal detects, according to the preset configuration information, whether the preset target multimedia in the preset configuration information exists in the original multimedia data collected by the multimedia data collection terminal. Data matching target multimedia data;

Receiving, by the multimedia data collection terminal, the target multimedia data and/or the detection result of the parameter information used to represent the target multimedia data after determining that the target multimedia data exists in the original multimedia data.
The method according to claim 6, wherein the multimedia data collection terminal receives the target multimedia data and/or uses the representation data after determining that the target multimedia data exists in the original multimedia data. The detection result of the parameter information of the target multimedia data includes:

Receiving, by the multimedia data collection terminal, the detection result that is sent after determining that the target multimedia data exists in the original multimedia data;

Sending a control command for characterizing uploading the target multimedia data, and receiving the target multimedia data that is sent by the multimedia data collection terminal based on the control command.
A method according to any of claims 6-7, characterized in that:

The original multimedia data includes original image data, original audio data, or original video data;

The target multimedia data includes target image data, target audio data, or target video data.
A multimedia data processing device, characterized in that the device comprises:

a first acquiring module, configured to acquire original multimedia data;

a detecting module, configured to detect, according to the preset configuration information sent by the received multimedia data processing device, whether the target multimedia data that matches the preset target multimedia data in the preset configuration information exists in the original multimedia data;

a second acquiring module, configured to: when yes, acquire the target multimedia data, and represent a detection result of the parameter information of the target multimedia data;

And a first sending module, configured to send the target multimedia data and/or the detection result to the multimedia data processing apparatus.
The device of claim 9 wherein said device further comprises:

a storage module, configured to: after the obtaining the target multimedia data, and characterizing the detection result of the parameter information of the target multimedia data, storing the non-target multimedia data of the original multimedia data except the target multimedia data local.
The apparatus according to claim 10, wherein said apparatus further comprises a deletion module and a second transmission module, and storing said non-target multimedia data of said target multimedia data in said original multimedia data locally after that:

The deleting module is configured to delete the non-target multimedia data after a preset period of time; or

The second sending module is configured to send the non-target multimedia data to the non-target multimedia data when the occupation rate of the multimedia data channel for transmitting the multimedia data to the multimedia data processing device is not greater than the first threshold value after a preset time period The multimedia data processing device.
The device of claim 9, wherein the first sending module comprises:

a first sending submodule, configured to simultaneously send the target multimedia data and the detection result to the multimedia data processing device; or

a second sending submodule, configured to send the detection result to the multimedia data processing device by using the multimedia data channel when an occupation rate of the multimedia data channel for transmitting the multimedia data to the multimedia data processing device is greater than a first threshold Transmitting the target multimedia data to the multimedia data processing device by using the multimedia data channel when an occupation rate of a multimedia data channel for transmitting multimedia data to the multimedia data processing device is not greater than a first threshold; or

a third sending submodule, configured to send the detection result to the multimedia data processing device, if the control command sent by the multimedia data processing device for characterizing uploading the target multimedia data is received, the target multimedia is Data is sent to the multimedia data processing device.
A device according to any one of claims 9-12, wherein:

The original multimedia data includes original image data, original audio data, or original video data;

The target multimedia data includes target image data, target audio data, or target video data.
A multimedia data acquisition device, characterized in that the device comprises:

The first sending module is configured to send the preset configuration information to the multimedia data collecting terminal, so that the multimedia data collecting terminal detects whether the original multimedia data collected by the multimedia data collecting terminal exists and the preset configuration based on the preset configuration information. Target multimedia data in which the preset target multimedia data matches in the information;

a receiving module, configured to receive, by the multimedia data collecting terminal, the target multimedia data that is sent after determining the target multimedia data in the original multimedia data, and/or parameter information used to represent the target multimedia data Test results.
The apparatus of claim 14, wherein the receiving module comprises:

a first receiving submodule, configured to receive the detection result sent by the multimedia data collection terminal;

Sending a control command for characterizing uploading the target multimedia data;

And a second receiving submodule, configured to receive the target multimedia data that is sent by the multimedia data collection terminal according to the control command.
Apparatus according to any of claims 14-15, wherein:

The original multimedia data includes original image data, original audio data, or original video data;

The target multimedia data includes target image data, target audio data, or target video data.
A computer apparatus, characterized in that the apparatus comprises a processor for performing the steps of the method of any one of claims 1-8 when the computer program is stored in a memory.
A computer readable storage medium having stored thereon a computer program, wherein the computer program, when executed by a processor, implements the steps of the method of any of claims 1-8.