CN112312208A - Multimedia information processing method and device, storage medium and electronic equipment - Google Patents
Multimedia information processing method and device, storage medium and electronic equipment Download PDFInfo
- Publication number
- CN112312208A CN112312208A CN202010583099.8A CN202010583099A CN112312208A CN 112312208 A CN112312208 A CN 112312208A CN 202010583099 A CN202010583099 A CN 202010583099A CN 112312208 A CN112312208 A CN 112312208A
- Authority
- CN
- China
- Prior art keywords
- multimedia information
- information
- target
- file
- multimedia
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000010365 information processing Effects 0.000 title abstract description 5
- 238000003672 processing method Methods 0.000 title abstract description 5
- 238000012545 processing Methods 0.000 claims abstract description 69
- 238000000034 method Methods 0.000 claims abstract description 60
- 230000002159 abnormal effect Effects 0.000 claims description 20
- 238000004590 computer program Methods 0.000 claims description 6
- 238000007781 pre-processing Methods 0.000 claims 1
- 238000012544 monitoring process Methods 0.000 abstract description 9
- 238000010586 diagram Methods 0.000 description 12
- 238000004891 communication Methods 0.000 description 9
- 230000006835 compression Effects 0.000 description 4
- 238000007906 compression Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 230000005236 sound signal Effects 0.000 description 4
- 238000000605 extraction Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000005856 abnormality Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44204—Monitoring of content usage, e.g. the number of times a movie has been viewed, copied or the amount which has been watched
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0241—Advertisements
- G06Q30/0242—Determining effectiveness of advertisements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
- H04N21/43632—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network involving a wired protocol, e.g. IEEE 1394
- H04N21/43635—HDMI
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/812—Monomedia components thereof involving advertisement data
Abstract
The disclosure relates to a multimedia information processing method, a multimedia information processing device, a storage medium and electronic equipment, and relates to the technical field of electronic information, wherein the method comprises the following steps: the method comprises the steps of obtaining multimedia information collected by terminal equipment within a specified duration, wherein the multimedia information comprises at least one of audio information, video information and image information, conducting preset processing on the multimedia information according to the type of the multimedia information to obtain a target file, sending the target file to a server to enable the server to judge whether the target file is matched with the specified target information, and receiving and displaying a matching result of the target file and the target information sent by the server. According to the method and the device, the terminal equipment is used for collecting different types of multimedia information and processing the multimedia information according to different types, so that the server can determine whether the target file corresponding to the multimedia information is matched with the specified target information, the application range of the terminal equipment can be expanded, and the monitoring and management efficiency of the multimedia information can be improved.
Description
Technical Field
The present disclosure relates to the field of electronic information technologies, and in particular, to a method and an apparatus for processing multimedia information, a storage medium, and an electronic device.
Background
With the continuous development of electronic information technology, enterprises and merchants increasingly invest in advertising, and advertising modes of advertisers show a diversified trend. When an advertiser advertises, the designated advertisement can be played in a corresponding time interval through a multimedia platform (such as television, broadcast, internet and the like). In order to avoid the loss of economic benefits of advertisers caused by missed broadcasting, interrupted broadcasting, unqualified broadcasting time and broadcasting times of advertisements, the advertisers can monitor advertisements played by each media platform (such as different television channels, broadcasting frequency bands, internet webpages and the like) after advertisement putting so as to determine whether each media platform plays a specified advertisement in a corresponding time period.
Disclosure of Invention
In order to overcome the problems in the related art, an object of the present disclosure is to provide a method, an apparatus, a storage medium, and an electronic device for processing multimedia information.
In order to achieve the above object, according to a first aspect of embodiments of the present disclosure, there is provided a method for processing multimedia information, the method including:
acquiring multimedia information collected by terminal equipment within a specified duration, wherein the multimedia information comprises at least one of audio information, video information and image information;
according to the type of the multimedia information, performing preset processing on the multimedia information to obtain a target file;
sending the target file to a server so that the server judges whether the target file is matched with the specified target information;
and receiving and displaying a matching result of the target file and the target information sent by the server.
Optionally, after the acquiring the multimedia information collected by the terminal device within the specified duration, the method further includes:
determining the state of the multimedia information according to the acquisition time of each data in the multimedia information;
and if the state of the multimedia information is an abnormal state, sending first prompt information, wherein the first prompt information is used for indicating that the process of acquiring the multimedia information by the terminal equipment is abnormal.
Optionally, after the acquiring the multimedia information collected by the terminal device within the specified duration, the method further includes:
playing the multimedia information; and/or the presence of a gas in the gas,
and acquiring and displaying the quality of the multimedia information.
Optionally, after the performing the preset processing on the multimedia information according to the type of the multimedia information to obtain the target file, the method further includes:
acquiring the network connection state of the terminal equipment;
the sending the target file to a server includes:
and sending the target file to the server under the condition that the network connection state is a normal state.
Optionally, the performing preset processing on the multimedia information according to the type of the multimedia information to obtain a target file includes:
if the multimedia information is audio information, compressing the multimedia information according to a preset audio coding rule to obtain a target audio file;
if the multimedia information is video information, compressing the multimedia information according to a preset video coding rule to obtain a target video file;
if the multimedia information is image information, compressing the multimedia information according to a preset image coding rule to obtain a target image file;
the target file comprises at least one of the target audio file, the target video file and the target image file.
According to a second aspect of the embodiments of the present disclosure, there is provided an apparatus for processing multimedia information, the apparatus comprising:
the system comprises a first acquisition module, a second acquisition module and a third acquisition module, wherein the first acquisition module is used for acquiring multimedia information acquired by terminal equipment within a specified duration, and the multimedia information comprises at least one of audio information, video information and image information;
the processing module is used for presetting the multimedia information according to the type of the multimedia information so as to obtain a target file;
the sending module is used for sending the target file to a server so that the server judges whether the target file is matched with the specified target information;
and the display module is used for receiving and displaying the matching result of the target file and the target information sent by the server.
Optionally, the apparatus further comprises:
the determining module is used for determining the state of the multimedia information according to the acquisition time of each data in the multimedia information after the multimedia information acquired by the terminal equipment within the specified duration is acquired;
and the prompt module is used for sending first prompt information if the state of the multimedia information is an abnormal state, wherein the first prompt information is used for indicating that the process of acquiring the multimedia information by the terminal equipment is abnormal.
Optionally, the apparatus further comprises:
the playing module is used for playing the multimedia information after the multimedia information collected by the terminal equipment in the specified duration is obtained;
and the display module is used for acquiring and displaying the quality of the multimedia information.
Optionally, the apparatus further comprises:
the second obtaining module is used for obtaining the network connection state of the terminal equipment after the multimedia information is subjected to preset processing according to the type of the multimedia information so as to obtain a target file;
the sending module is used for:
and sending the target file to the server under the condition that the network connection state is a normal state.
Optionally, the processing module includes:
the audio processing submodule is used for compressing the multimedia information according to a preset audio coding rule if the multimedia information is audio information so as to obtain a target audio file;
the video processing submodule is used for compressing the multimedia information according to a preset video coding rule to obtain a target video file if the multimedia information is video information;
the image processing submodule is used for compressing the multimedia information according to a preset image coding rule if the multimedia information is image information so as to obtain a target image file;
the target file comprises at least one of the target audio file, the target video file and the target image file.
According to a third aspect of embodiments of the present disclosure, there is provided a computer readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of the method described in the first aspect of embodiments of the present disclosure.
According to a fourth aspect of the embodiments of the present disclosure, there is provided an electronic apparatus including:
a memory having a computer program stored thereon;
a processor for executing the computer program in the memory to implement the steps of the method in the first aspect of an embodiment of the disclosure.
According to the technical scheme, the method comprises the steps of firstly obtaining multimedia information collected by terminal equipment within a specified duration, wherein the multimedia information comprises at least one of audio information, video information and image information, then conducting preset processing on the multimedia information according to the type of the multimedia information to obtain a target file, then sending the target file to a server to enable the server to judge whether the target file is matched with the specified target information, and finally receiving and displaying a matching result of the target file and the target information sent by the server. According to the method and the device, the terminal equipment is used for collecting different types of multimedia information and processing the multimedia information according to different types, so that the server can determine whether the target file corresponding to the multimedia information is matched with the specified target information, the application range of the terminal equipment can be expanded, and the monitoring and management efficiency of the multimedia information can be improved.
Additional features and advantages of the disclosure will be set forth in the detailed description which follows.
Drawings
The accompanying drawings, which are included to provide a further understanding of the disclosure and are incorporated in and constitute a part of this specification, illustrate embodiments of the disclosure and together with the description serve to explain the disclosure without limiting the disclosure. In the drawings:
FIG. 1 is a flow chart illustrating a method of processing multimedia information in accordance with an exemplary embodiment;
FIG. 2 is a flow chart illustrating another method of processing multimedia information in accordance with an exemplary embodiment;
FIG. 3 is a flow chart illustrating another method of processing multimedia information in accordance with an exemplary embodiment;
FIG. 4 is a flow chart illustrating another method of processing multimedia information in accordance with an exemplary embodiment;
FIG. 5 is a flow chart illustrating another method of processing multimedia information in accordance with an exemplary embodiment;
FIG. 6 is a block diagram illustrating an apparatus for processing multimedia information in accordance with an exemplary embodiment;
FIG. 7 is a block diagram illustrating another apparatus for processing multimedia information in accordance with an illustrative embodiment;
FIG. 8 is a block diagram illustrating another apparatus for processing multimedia information in accordance with an illustrative embodiment;
FIG. 9 is a block diagram illustrating another apparatus for processing multimedia information in accordance with an illustrative embodiment;
FIG. 10 is a block diagram illustrating another apparatus for processing multimedia information in accordance with an illustrative embodiment;
FIG. 11 is a block diagram illustrating an electronic device in accordance with an example embodiment.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of methods and apparatus consistent with certain aspects of the present disclosure, as detailed in the appended claims.
Before introducing the method, the apparatus, the storage medium, and the electronic device for processing multimedia information provided by the present disclosure, an application scenario related to each embodiment of the present disclosure is first introduced. The application scenario may include a terminal device and a server. The terminal device and the server can transmit information through a physical connection line or a Wireless communication technology, for example, the terminal device and the server can transmit information through a physical connection line such as a network cable and an optical fiber, and can also realize information interaction through a Wireless communication technology such as WLAN (english: Wireless Local area network, chinese: Wireless Local area network), bluetooth, ZigBee (chinese: ZigBee protocol), and the like. The terminal device may be a mobile terminal such as a tablet computer, a smart television, a PDA (Personal Digital Assistant, chinese), a portable computer, or a fixed terminal such as a desktop computer. The server may include, but is not limited to: an entity server, a server cluster or a cloud server, etc.
Fig. 1 is a flow chart illustrating a method of processing multimedia information, as shown in fig. 1, according to an exemplary embodiment, the method comprising the steps of:
And 102, performing preset processing on the multimedia information according to the type of the multimedia information to acquire a target file.
For example, when monitoring multimedia information, the multimedia information collected by the terminal device within a specified duration may be obtained first. For example, the multimedia information may be obtained through preset control Software, where the control Software may be a control program run on the terminal device, or may also be an SDK (english: Software Development Kit, chinese: Software Development Kit) installed on the terminal device, and the like, and the disclosure is not limited thereto. The multimedia information may include audio information, video information, image information, and the like. The terminal equipment can be respectively provided with a broadcast receiving device, a video acquisition device and an image acquisition device. The broadcast receiving device can be used for collecting audio information, the video collecting device can be used for collecting video information, and the image collecting device can be used for collecting image information. The video acquisition device may include a first acquisition device for acquiring a video stream of the digital set-top box, and a second acquisition device for acquiring a video stream of an OTT (Over the top) device. The first acquisition device is connected with the digital set-top box through a video bus to acquire a video stream (namely, a digital television signal) received by the digital set-top box. The second acquisition device is connected with the OTT television or the OTT television box to acquire the video stream received by the OTT television or the OTT television box.
The audio information may include information that different radio stations play within a specified time period. In the case of acquiring the audio information, for example, the broadcast receiving apparatus may be tuned to a frequency of a specific broadcast station to acquire the audio information of the specific broadcast station. The audio information collected by the broadcast receiving device in the same time duration can be one or more, that is, the broadcast receiving device can simultaneously collect the audio information of different broadcast stations. For example, according to the requirement of information monitoring, the information played by the first broadcast station and the second broadcast station between 8:00 am and 9:00 am on 17 th of 2020 needs to be acquired, then the frequencies corresponding to the first broadcast station and the second broadcast station may be set on the broadcast receiving apparatus, respectively, and then the broadcast receiving apparatus is controlled to acquire the information played by the first broadcast station and the second broadcast station from 8:00 am on 17 th of 6 th of 2020 until 9:00 am on 17 th of 6 th of 2020 finishes acquiring. The video information may include information that is broadcast on different television channels for any duration. When video information is collected, for example, a television, an OTT device (e.g., a smart television), or the like may be tuned to a specified television channel, and then an HDMI (english: High Definition Multimedia Interface, chinese: High Definition Multimedia Interface) of a set-top box of the television, an intelligent box of the OTT device, or the like is connected to a video collection device through a video bus, so as to collect the video information of the specified television channel. In another implementation, the video acquisition device may be connected to the HDMI of each of the set-top boxes, the smart boxes, and the like, and then video information of different tv channels within a specified duration may be acquired by the video acquisition device according to specific requirements. The video information collected by the video collecting device in the same time length can be one or more, namely the video collecting device can simultaneously collect the video information of different television channels. The image information may include information that different web pages are displayed for a specified length of time. When the image information is collected, for example, different webpages can be accessed through the terminal device according to the requirement of information monitoring, then the image information of the specified webpage within the specified duration is collected through the image collecting device, and for example, the content of the specified webpage can be subjected to screenshot operation according to the preset time interval to obtain the image information. The image information collected by the image collecting device in the same time period can be one or more, namely, the image collecting device can simultaneously collect the image information of different webpages. It should be noted that, when audio information, video information and image information need to be acquired simultaneously, the broadcast receiving device, the video acquisition device and the image acquisition device can acquire information simultaneously, so that the terminal device can acquire multiple multimedia information simultaneously, the acquisition efficiency of the multimedia information is improved, and multiple acquisition devices do not need to be deployed. Further, after the multimedia information is acquired, the state of the multimedia information can be determined according to whether the data in the multimedia information is complete, and if the state is an abnormal state, prompt information can be sent to prompt a manager that the process of acquiring the multimedia information by the terminal equipment is abnormal, so that the multimedia information can be normally acquired.
After the multimedia information is acquired, the multimedia information can be subjected to preset processing according to the type of the multimedia information so as to acquire a target file. Specifically, when the multimedia information is audio information, the audio information may be subjected to preset processing according to a processing rule corresponding to the audio information, so as to obtain a target file. For example, the processing rule corresponding to the audio information may be RIFF (Resource exchange file format, chinese) file specification, and then the target file may be Wave format, and the processing rule may also be a compression standard corresponding to an audio layer in MPEG (Moving Picture Experts Group, chinese) file, and then the target file may be MP3 format, which is not specifically limited by this disclosure. When the multimedia information is video information, the video information can be subjected to preset processing according to a processing rule corresponding to the video information to obtain a target file. For example, the processing rule corresponding to the video information may be a standard of ASF (english: Advanced Systems Format, chinese: Advanced streaming Format), and then the target file may be in WMV Format, and the processing rule may also be a compression standard corresponding to a video layer in MPEG, and then the target file may be in MP4 Format, which is not limited in this disclosure. When the multimedia information is image information, the image information can be subjected to preset processing according to a processing rule corresponding to the image information to obtain a target file. For example, the processing rule corresponding to the image information may be a still image coding standard JPEG (english: joint photographic Experts Group), and the target file may be in a JPEG format, which is not specifically limited by the present disclosure.
After the target file is acquired, the target file and identification information such as acquisition time, acquisition duration, and a name of a collection object (for example, a name of a television channel, a name of a broadcasting station, and a web site) corresponding to the target file may be stored in a storage module (for example, a hard disk) of the terminal device according to a type of the multimedia information, so that an administrator may search and play the corresponding target file. The acquisition time represents the time for starting to acquire the multimedia information in the target file, and the acquisition duration represents the duration for acquiring the multimedia information in the target file. For example, the target file can be searched through a human-computer interaction interface of the control software according to the identification information, and after the target file is found, a player corresponding to the target file can be opened through the control software to play the target file. The player may be, for example, an audio player, a video player, a picture viewer, etc. provided on the terminal device.
And 104, receiving and displaying a matching result of the target file and the target information sent by the server.
For example, after the target file is obtained, the target file and the identification information corresponding to the target file may be sent to a server according to a preset file format, and the server receives the target file and the identification information corresponding to the target file. For example, the target file and the identification information corresponding to the target file may be compressed according to a preset format to obtain the target compressed file, and then the target compressed file is sent to the server when the network connection state of the terminal device is normal, and after receiving the target compressed file, the server may decompress the target compressed file first to obtain the target file and the identification information corresponding to the target file. After the server acquires the target file and the identification information corresponding to the target file, the server can acquire the target information corresponding to the target file according to the identification information, and then judge whether the target file is matched with the specified target information. The target information is information pre-stored in the server according to the requirement of multimedia information monitoring. The target information may include designated audio information, designated video information, designated image information, and the like. If the characteristics of the target file are the same as those of the target information, it can be determined that the target file is matched with the target information, and if the characteristics of the target file are not the same as those of the target information, it can be determined that the target file is not matched with the target information. The features of the target file can be obtained through a preset feature extraction algorithm, wherein the features can be audio features (such as zero-crossing rate, spectrogram, and the like), video features (such as color features, texture features, and the like), image features (such as color features, texture features, and the like). The feature extraction algorithm may be, for example, an HMM (Hidden Markov Model, chinese) algorithm, an LBP (Local Binary Patterns, chinese) algorithm, an HOG (Histogram of Oriented gradients, chinese) algorithm, or the like. After determining whether the target file is matched with the specified target information, the server may first store the target file, the identification information corresponding to the target file, and the matching result (matching or not), and then send the matching result and the identification information corresponding to the target file to the terminal device. In this way, the terminal device may display the matching result of the target file corresponding to the identification information and the target information after receiving the matching result and the identification information.
In summary, in the disclosure, multimedia information collected by a terminal device within a specified duration is first obtained, where the multimedia information includes at least one of audio information, video information, and image information, then, according to a type of the multimedia information, the multimedia information is subjected to a preset process to obtain a target file, and then, the target file is sent to a server, so that the server determines whether the target file matches the specified target information, and finally, a matching result between the target file sent by the server and the target information is received and displayed. According to the method and the device, the terminal equipment is used for collecting different types of multimedia information and processing the multimedia information according to different types, so that the server can determine whether the target file corresponding to the multimedia information is matched with the specified target information, the application range of the terminal equipment can be expanded, and the monitoring and management efficiency of the multimedia information can be improved.
Fig. 2 is a flow chart illustrating another method of processing multimedia information according to an exemplary embodiment, as shown in fig. 2, after step 101, the method further includes:
and 105, determining the state of the multimedia information according to the acquisition time of each datum in the multimedia information.
And 106, if the state of the multimedia information is an abnormal state, sending first prompt information, wherein the first prompt information is used for indicating that the process of acquiring the multimedia information by the terminal equipment is abnormal.
For example, after the multimedia information is acquired, the state of the multimedia information may be determined according to the acquisition time of each data in the multimedia information, that is, whether the multimedia information is normally acquired is determined according to whether the data in the multimedia information is complete. The state of the multimedia information may include a normal state and an abnormal state. When determining the state of the multimedia information, for example, it may be determined whether each acquisition time of the multimedia information includes data of the multimedia information, then statistics may be performed on a duration of the acquisition time continuously not including the data, and if the duration exceeds a preset duration, the state of the multimedia information may be determined to be an abnormal state. If the duration is less than or equal to the preset duration, the state of the multimedia information can be determined to be a normal state. In another implementation manner, the duration of the acquisition time without data in the preset time period may also be counted, and then the state of the multimedia information is determined according to the duration. When the state of the multimedia information is determined to be an abnormal state, first prompt information can be sent out to prompt a manager that the process of acquiring the multimedia information by the terminal equipment is abnormal. For example, when the state of the multimedia information is determined to be an abnormal state, the first prompt information in a voice form can be sent out through a loudspeaker of the terminal device, the first prompt information in a text form can be displayed through a display screen of the terminal device, and the first prompt information can be sent out by flashing a special indicator lamp and the like. And then, the multimedia information can be preset directly according to the type of the multimedia information, or when the state of the multimedia information is determined to be a normal state, the multimedia information can be preset according to the type of the multimedia information, which is not limited in the disclosure.
Fig. 3 is a flow chart illustrating another method of processing multimedia information according to an exemplary embodiment, as shown in fig. 3, after step 101, the method further includes:
For example, after the multimedia information is acquired, the multimedia information can be played on the terminal device through the control software. For example, the acquired multimedia information includes audio information 1, audio information 2, video information 1, video information 2 and image information 1, then 5 windows can be displayed on the display screen through the control software, and each window can display identification information such as the type of each multimedia information, the acquisition time, the acquisition duration, and the name of the acquisition object (e.g., the name of a television channel, the name of a radio station, and a web site). Wherein, the window 1 and the window 2 are audio playing windows, and the window 3, the window 4 and the window 5 are video playing windows, so that the multimedia information in the video information 1, the video information 2 and the image information 1 can be respectively displayed through the window 3, the window 4 and the window 5.
When the multimedia information is played, the control software can also respectively acquire the quality of each piece of multimedia information, and the quality of the multimedia information can be understood as the definition degree of the multimedia information. If the multimedia information is audio information, when the noise of the audio information is lower than the preset noise intensity, the quality of the audio information can be determined to be clear, otherwise, the quality of the audio information can be determined to be unclear. If the multimedia information is video information or image information, when the resolution of the video information or the image information is higher than a preset resolution threshold, the quality of the video information or the image information can be determined to be clear, otherwise, the quality of the video information or the image information can be determined to be unclear. Thus, after the quality of the multimedia information is obtained, the quality of each multimedia information can be displayed (for example, displayed clearly or not) on the window corresponding to each multimedia information.
Fig. 4 is a flow chart illustrating another method of processing multimedia information, according to an exemplary embodiment, as shown in fig. 4, after step 102, the method further includes:
and step 108, acquiring the network connection state of the terminal equipment.
Step 103 is for:
and under the condition that the network connection state is a normal state, sending the target file to the server.
For example, after the target file is obtained, the network connection state of the terminal device may be further obtained. The network connection state may include a normal state and an abnormal state. The target file can be sent to the server when the network connection state is a normal state, and the network connection state can be continuously acquired when the network connection state is an abnormal state until the target file is sent to the server when the network connection state is a normal state.
Fig. 5 is a flowchart illustrating another multimedia information processing method according to an exemplary embodiment, and as shown in fig. 5, the implementation manner of step 102 may include:
And 1023, if the multimedia information is image information, compressing the multimedia information according to a preset image coding rule to obtain a target image file.
The target file comprises at least one of a target audio file, a target video file and a target image file.
For example, after the multimedia information is acquired, the multimedia information may be subjected to a preset process according to the type of the multimedia information to acquire the target file. The target files may include a target audio file, a target video file, a target image file. If the multimedia information is audio information, the multimedia information can be compressed according to a preset audio coding rule to obtain a target audio file. The audio encoding rule may be a compression standard corresponding to an audio layer in MPEG, or may be a RIFF file specification, and the like, and then the target audio file may be in an MP3 format, or may be in a Wave format, and the like. If the multimedia information is video information, the multimedia information can be compressed according to a preset video coding rule to obtain a target video file. The video encoding rule may be a compression standard corresponding to a video layer in MPEG, or may be a standard of ASF, and the like, and the target video file may be in MP4 format, or may be in WMV format, and the like. If the multimedia information is image information, the multimedia information can be compressed according to a preset image coding rule to obtain a target image file. The image encoding rule may be a standard such as JPEG, and the target image file may be in JPEG format or the like.
In summary, in the disclosure, multimedia information collected by a terminal device within a specified duration is first obtained, where the multimedia information includes at least one of audio information, video information, and image information, then, according to a type of the multimedia information, the multimedia information is subjected to a preset process to obtain a target file, and then, the target file is sent to a server, so that the server determines whether the target file matches the specified target information, and finally, a matching result between the target file sent by the server and the target information is received and displayed. According to the method and the device, the terminal equipment is used for collecting different types of multimedia information and processing the multimedia information according to different types, so that the server can determine whether the target file corresponding to the multimedia information is matched with the specified target information, the application range of the terminal equipment can be expanded, and the monitoring and management efficiency of the multimedia information can be improved.
Fig. 6 is a block diagram illustrating an apparatus for processing multimedia information according to an exemplary embodiment, and as shown in fig. 6, the apparatus 200 includes:
the first obtaining module 201 is configured to obtain multimedia information collected by a terminal device within a specified duration, where the multimedia information includes at least one of audio information, video information, and image information.
The processing module 202 is configured to perform preset processing on the multimedia information according to the type of the multimedia information to obtain a target file.
A sending module 203, configured to send the target file to the server, so that the server determines whether the target file matches the specified target information.
And the display module 204 is configured to receive and display a matching result between the target file and the target information sent by the server.
Fig. 7 is a block diagram illustrating another apparatus for processing multimedia information according to an exemplary embodiment, and as shown in fig. 7, the apparatus 200 further includes:
the determining module 205 is configured to determine a state of the multimedia information according to a collection time of each data in the multimedia information after the multimedia information collected by the terminal device within a specified time duration is obtained.
The prompt module 206 is configured to send first prompt information if the state of the multimedia information is an abnormal state, where the first prompt information is used to indicate that an abnormality occurs in a process of acquiring the multimedia information by the terminal device.
Fig. 8 is a block diagram illustrating another apparatus for processing multimedia information according to an exemplary embodiment, and as shown in fig. 8, the apparatus 200 further includes:
the playing module 207 is configured to play the multimedia information after acquiring the multimedia information acquired by the terminal device within a specified duration.
And the display module 204 is used for acquiring and displaying the quality of the multimedia information.
Fig. 9 is a block diagram illustrating another apparatus for processing multimedia information according to an exemplary embodiment, and as shown in fig. 9, the apparatus 200 further includes:
the second obtaining module 208 is configured to obtain the network connection state of the terminal device after performing preset processing on the multimedia information according to the type of the multimedia information to obtain the target file.
The sending module 203 is configured to:
and under the condition that the network connection state is a normal state, sending the target file to the server.
Fig. 10 is a block diagram illustrating another apparatus for processing multimedia information according to an exemplary embodiment, and as shown in fig. 10, the processing module 202 includes:
the audio processing sub-module 2021 is configured to, if the multimedia information is audio information, compress the multimedia information according to a preset audio coding rule to obtain a target audio file.
The video processing sub-module 2022 is configured to, if the multimedia information is video information, compress the multimedia information according to a preset video coding rule to obtain a target video file.
The image processing sub-module 2023 is configured to, if the multimedia information is image information, compress the multimedia information according to a preset image coding rule to obtain a target image file.
The target file comprises at least one of a target audio file, a target video file and a target image file.
With regard to the apparatus in the above-described embodiment, the specific manner in which each part performs the operation has been described in detail in the embodiment related to the method, and will not be described in detail here.
In summary, in the disclosure, multimedia information collected by a terminal device within a specified duration is first obtained, where the multimedia information includes at least one of audio information, video information, and image information, then, according to a type of the multimedia information, the multimedia information is subjected to a preset process to obtain a target file, and then, the target file is sent to a server, so that the server determines whether the target file matches the specified target information, and finally, a matching result between the target file sent by the server and the target information is received and displayed. According to the method and the device, the terminal equipment is used for collecting different types of multimedia information and processing the multimedia information according to different types, so that the server can determine whether the target file corresponding to the multimedia information is matched with the specified target information, the application range of the terminal equipment can be expanded, and the monitoring and management efficiency of the multimedia information can be improved.
FIG. 11 is a block diagram illustrating an electronic device 300 in accordance with an example embodiment. As shown in fig. 11, the electronic device 300 may include: a processor 301 and a memory 302. The electronic device 300 may also include one or more of a multimedia component 303, an input/output (I/O) interface 304, and a communication component 305.
The processor 301 is configured to control the overall operation of the electronic device 300, so as to complete all or part of the steps in the above-mentioned method for processing multimedia information. The memory 302 is used to store various types of data to support operation at the electronic device 300, such as instructions for any application or method operating on the electronic device 300 and application-related data, such as contact data, transmitted and received messages, pictures, audio, video, and the like. The Memory 302 may be implemented by any type of volatile or non-volatile Memory device or combination thereof, such as Static Random Access Memory (SRAM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Erasable Programmable Read-Only Memory (EPROM), Programmable Read-Only Memory (PROM), Read-Only Memory (ROM), magnetic Memory, flash Memory, magnetic disk or optical disk. The multimedia components 303 may include a screen and an audio component. Wherein the screen may be, for example, a touch screen and the audio component is used for outputting and/or inputting audio signals. For example, the audio component may include a microphone for receiving external audio signals. The received audio signal may further be stored in the memory 302 or transmitted through the communication component 305. The audio assembly also includes at least one speaker for outputting audio signals. The I/O interface 304 provides an interface between the processor 301 and other interface modules, such as a keyboard, mouse, buttons, etc. These buttons may be virtual buttons or physical buttons. The communication component 305 is used for wired or wireless communication between the electronic device 300 and other devices. Wireless Communication, such as Wi-Fi, bluetooth, Near Field Communication (NFC), 2G, 3G, 4G, NB-IOT, eMTC, or other 5G, etc., or a combination of one or more of them, which is not limited herein. The corresponding communication component 305 may therefore include: Wi-Fi module, Bluetooth module, NFC module, etc.
In an exemplary embodiment, the electronic Device 300 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components, and is used for executing the above-mentioned processing method of multimedia information.
In another exemplary embodiment, there is also provided a computer-readable storage medium including program instructions, which when executed by a processor, implement the steps of the above-described method of processing multimedia information. For example, the computer readable storage medium may be the memory 302 including the program instructions, which are executable by the processor 301 of the electronic device 300 to perform the method for processing the multimedia information.
Although the preferred embodiments of the present disclosure have been described in detail with reference to the accompanying drawings, the present disclosure is not limited to the specific details of the embodiments, and other embodiments of the present disclosure can be easily conceived by those skilled in the art within the technical spirit of the present disclosure after considering the description and practicing the present disclosure, and all fall within the protection scope of the present disclosure.
It should be noted that the various technical features described in the above embodiments can be combined in any suitable way without contradiction, and in order to avoid unnecessary repetition, the disclosure does not need to be separately described in various possible combinations, and should be considered as the disclosure of the disclosure as long as the concepts of the disclosure are not violated.
Claims (10)
1. A method for processing multimedia information, the method comprising:
acquiring multimedia information collected by terminal equipment within a specified duration, wherein the multimedia information comprises at least one of audio information, video information and image information;
according to the type of the multimedia information, performing preset processing on the multimedia information to obtain a target file;
sending the target file to a server so that the server judges whether the target file is matched with the specified target information;
and receiving and displaying a matching result of the target file and the target information sent by the server.
2. The method according to claim 1, wherein after the acquiring the multimedia information collected by the terminal device within the specified time period, the method further comprises:
determining the state of the multimedia information according to the acquisition time of each data in the multimedia information;
and if the state of the multimedia information is an abnormal state, sending first prompt information, wherein the first prompt information is used for indicating that the process of acquiring the multimedia information by the terminal equipment is abnormal.
3. The method according to claim 1, wherein after the acquiring the multimedia information collected by the terminal device within the specified time period, the method further comprises:
playing the multimedia information; and/or the presence of a gas in the gas,
and acquiring and displaying the quality of the multimedia information.
4. The method according to claim 1, wherein after the pre-setting processing is performed on the multimedia information according to the type of the multimedia information to obtain the target file, the method further comprises:
acquiring the network connection state of the terminal equipment;
the sending the target file to a server includes:
and sending the target file to the server under the condition that the network connection state is a normal state.
5. The method according to claim 1, wherein the pre-processing the multimedia information according to the type of the multimedia information to obtain the target file comprises:
if the multimedia information is audio information, compressing the multimedia information according to a preset audio coding rule to obtain a target audio file;
if the multimedia information is video information, compressing the multimedia information according to a preset video coding rule to obtain a target video file;
if the multimedia information is image information, compressing the multimedia information according to a preset image coding rule to obtain a target image file;
the target file comprises at least one of the target audio file, the target video file and the target image file.
6. An apparatus for processing multimedia information, the apparatus comprising:
the system comprises a first acquisition module, a second acquisition module and a third acquisition module, wherein the first acquisition module is used for acquiring multimedia information acquired by terminal equipment within a specified duration, and the multimedia information comprises at least one of audio information, video information and image information;
the processing module is used for presetting the multimedia information according to the type of the multimedia information so as to obtain a target file;
the sending module is used for sending the target file to a server so that the server judges whether the target file is matched with the specified target information;
and the display module is used for receiving and displaying the matching result of the target file and the target information sent by the server.
7. The apparatus of claim 6, further comprising:
the determining module is used for determining the state of the multimedia information according to the acquisition time of each data in the multimedia information after the multimedia information acquired by the terminal equipment within the specified duration is acquired;
and the prompt module is used for sending first prompt information if the state of the multimedia information is an abnormal state, wherein the first prompt information is used for indicating that the process of acquiring the multimedia information by the terminal equipment is abnormal.
8. The apparatus of claim 6, further comprising:
the playing module is used for playing the multimedia information after the multimedia information collected by the terminal equipment in the specified duration is obtained;
and the display module is used for acquiring and displaying the quality of the multimedia information.
9. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 5.
10. An electronic device, comprising:
a memory having a computer program stored thereon;
a processor for executing the computer program in the memory to carry out the steps of the method of any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010583099.8A CN112312208A (en) | 2020-06-23 | 2020-06-23 | Multimedia information processing method and device, storage medium and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010583099.8A CN112312208A (en) | 2020-06-23 | 2020-06-23 | Multimedia information processing method and device, storage medium and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112312208A true CN112312208A (en) | 2021-02-02 |
Family
ID=74336491
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010583099.8A Pending CN112312208A (en) | 2020-06-23 | 2020-06-23 | Multimedia information processing method and device, storage medium and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112312208A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115348463A (en) * | 2022-07-11 | 2022-11-15 | 西安诺瓦星云科技股份有限公司 | Display screen monitoring method, system, device, electronic equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120117584A1 (en) * | 2010-11-01 | 2012-05-10 | Gordon Donald F | Method and System for Presenting Additional Content at a Media System |
| US9516378B1 (en) * | 2015-12-17 | 2016-12-06 | Ichen Ltd | System and method for detecting and monitoring advertisements in broadcasted media |
| CN109600669A (en) * | 2017-09-30 | 2019-04-09 | 北京国双科技有限公司 | A kind of object plays monitoring method, device, storage medium and processor |
| CN110234022A (en) * | 2019-05-30 | 2019-09-13 | 阿里巴巴集团控股有限公司 | A kind of video prison broadcasting method, device, system and equipment |
| CN110264235A (en) * | 2019-05-07 | 2019-09-20 | 阿里巴巴集团控股有限公司 | Advertisement detecting method, system, device and electronic equipment |
| CN111245853A (en) * | 2020-01-16 | 2020-06-05 | 平安银行股份有限公司 | Multimedia advertisement playing method and related product |
-
2020
- 2020-06-23 CN CN202010583099.8A patent/CN112312208A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120117584A1 (en) * | 2010-11-01 | 2012-05-10 | Gordon Donald F | Method and System for Presenting Additional Content at a Media System |
| US9516378B1 (en) * | 2015-12-17 | 2016-12-06 | Ichen Ltd | System and method for detecting and monitoring advertisements in broadcasted media |
| CN109600669A (en) * | 2017-09-30 | 2019-04-09 | 北京国双科技有限公司 | A kind of object plays monitoring method, device, storage medium and processor |
| CN110264235A (en) * | 2019-05-07 | 2019-09-20 | 阿里巴巴集团控股有限公司 | Advertisement detecting method, system, device and electronic equipment |
| CN110234022A (en) * | 2019-05-30 | 2019-09-13 | 阿里巴巴集团控股有限公司 | A kind of video prison broadcasting method, device, system and equipment |
| CN111245853A (en) * | 2020-01-16 | 2020-06-05 | 平安银行股份有限公司 | Multimedia advertisement playing method and related product |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115348463A (en) * | 2022-07-11 | 2022-11-15 | 西安诺瓦星云科技股份有限公司 | Display screen monitoring method, system, device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10476925B2 (en) | Media stream cue point creation with automated content recognition | |
| US10698952B2 (en) | Using digital fingerprints to associate data with a work | |
| CN112087633B (en) | Video decoding method, device and storage medium | |
| US11463776B2 (en) | Video playback processing method, terminal device, server, and storage medium | |
| CN108495185A (en) | A kind of video title generation method and device | |
| US11706481B2 (en) | Media content identification on mobile devices | |
| CN105100911A (en) | Intelligent multimedia system and method | |
| US20160164970A1 (en) | Application Synchronization Method, Application Server and Terminal | |
| KR101991188B1 (en) | Promotion information processing method, device, and apparatus, and non-volatile computer storage medium | |
| CN112015926B (en) | Search result display method and device, readable medium and electronic equipment | |
| WO2017011798A1 (en) | Detection of common media segments | |
| CN103607635A (en) | Method, device and terminal for caption identification | |
| CN103517135A (en) | Method, system and television capable of playing MP4-format video files continuously | |
| US10560730B2 (en) | Electronic apparatus and operating method thereof | |
| CN112312208A (en) | Multimedia information processing method and device, storage medium and electronic equipment | |
| CN111008287A (en) | Audio and video processing method and device, server and storage medium | |
| CN107391661B (en) | Recommended word display method and device | |
| CN114430491A (en) | Live broadcast-based data processing method and device | |
| CN111031354B (en) | Multimedia playing method, device and storage medium | |
| CN112235592A (en) | Live broadcast method, live broadcast processing method, device and computer equipment | |
| AU2012353108A2 (en) | Advertisement providing apparatus and method for providing advertisements | |
| CN117544814B (en) | Data processing method, device, equipment and readable medium based on law enforcement recorder | |
| JP7158564B2 (en) | Information processing device, server device, user device and information processing system | |
| US11250267B2 (en) | Method and apparatus for processing information associated with video, electronic device, and storage medium | |
| CN114697763A (en) | Video processing method, device, electronic equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210202 |