CN113301393B - Method, device, system and storage medium for playing and interacting streaming media data - Google Patents

Method, device, system and storage medium for playing and interacting streaming media data Download PDF

Info

Publication number
CN113301393B
CN113301393B CN202110440368.XA CN202110440368A CN113301393B CN 113301393 B CN113301393 B CN 113301393B CN 202110440368 A CN202110440368 A CN 202110440368A CN 113301393 B CN113301393 B CN 113301393B
Authority
CN
China
Prior art keywords
streaming media
micro
target
media data
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110440368.XA
Other languages
Chinese (zh)
Other versions
CN113301393A (en
Inventor
张淮清
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Yingshuo Intelligent Technology Co ltd
Original Assignee
Shenzhen Yingshuo Intelligent Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Yingshuo Intelligent Technology Co ltd filed Critical Shenzhen Yingshuo Intelligent Technology Co ltd
Priority to CN202110440368.XA priority Critical patent/CN113301393B/en
Publication of CN113301393A publication Critical patent/CN113301393A/en
Application granted granted Critical
Publication of CN113301393B publication Critical patent/CN113301393B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/239Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
    • H04N21/2393Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • H04N21/2187Live feed
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/231Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
    • H04N21/23109Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion by placing content in organized collections, e.g. EPG data repository
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/232Content retrieval operation locally within server, e.g. reading video streams from disk arrays
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/254Management at additional data server, e.g. shopping server, rights management server
    • H04N21/2541Rights Management
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25866Management of end-user data
    • H04N21/25875Management of end-user data involving end-user authentication
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47202End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting content on demand, e.g. video on demand
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/475End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845Structuring of content, e.g. decomposing content into time segments
    • H04N21/8455Structuring of content, e.g. decomposing content into time segments involving pointers to the content, e.g. pointers to the I-frames of the video stream
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

The invention relates to the field of online education, and discloses a method, a device, a system and a storage medium for playing and interacting streaming media data, which are used for improving the playing efficiency and the playing speed of the streaming media data. The playing and interaction method of the streaming media data comprises the following steps: acquiring a target terminal identifier, a micro-class resource identifier and a domain name identifier for requesting micro-class resources from a micro-class resource access request; extracting target streaming media data from a preset content distribution network according to the micro class resource identifier and the domain name identifier; streaming the target streaming media data to the target terminal based on the target terminal identification, so that the target terminal decodes and plays the target streaming media data without a plug-in; and in the playing process of the target streaming media data, character information input by a target user is acquired, stroke order identification is carried out on the character information through a preset optical character identification model, interaction request information is obtained, and micro-class interaction operation is carried out on the target user according to the interaction request information.

Description

Method, device, system and storage medium for playing and interacting streaming media data
Technical Field
The present invention relates to the field of online education, and in particular, to a method, apparatus, system, and storage medium for playing and interacting streaming media data.
Background
Streaming media data refers to a media form that streams audio, video, and/or multimedia files over a network. Compared with the network playing form of watching after downloading, the streaming media data can realize that the user can watch continuous audio and video information while downloading, and does not need to wait for the whole file to be downloaded.
At present, streaming media data has been widely used in online education to realize audio and video playing services. However, in the existing online education, the playing of the streaming media data on the browser is realized in a plug-in mode, so that the playing security is poor, and the problems of playing delay and low interaction efficiency of the online education exist in the streaming media data due to the limitation of the network transmission speed or the streaming media data distribution speed.
Disclosure of Invention
The invention provides a method, a device, a system and a storage medium for playing and interacting streaming media data, which are used for improving the playing efficiency and playing speed of the streaming media data and improving the interaction efficiency of online education.
In order to achieve the above object, a first aspect of the present invention provides a method for playing and interacting streaming media data, including: receiving a micro-class resource access request sent by a target terminal, and acquiring a target terminal identifier, a micro-class resource identifier and a domain name identifier for requesting micro-class resources from the micro-class resource access request; extracting target streaming media data from a preset content distribution network according to the micro-class resource identifier and the domain name identifier, wherein the target streaming media data is used for indicating micro-class audio/video data on-line live broadcast or on-demand; streaming the target streaming media data to the target terminal based on the target terminal identification so that the target terminal plays the target streaming media data without plug-in decoding; and in the playing process of the target streaming media data, character information input by a target user is acquired, stroke order identification is carried out on the character information through a preset optical character identification model, interaction request information is obtained, and micro-class interaction operation is carried out on the target user according to the interaction request information.
In a possible implementation manner, the receiving the micro-class resource access request sent by the target terminal, and obtaining the target terminal identifier, the micro-class resource identifier and the domain name identifier for requesting the micro-class resource from the micro-class resource access request, includes: receiving a micro-class resource access request sent by a target terminal, and performing identity verification on the micro-class resource access request to obtain a verification result, wherein the micro-class resource access request is a micro-class resource live broadcast request or a micro-class resource on-demand request; when the verification result is that verification fails, intercepting the micro-class resource access request, setting access refusal description information for the micro-class resource access request, and recording the micro-class resource access request and the access refusal description information in a preset operation log in an associated manner; and when the verification result is that verification is successful, carrying out flow limiting, parameter analysis and data verification processing on the micro class resource access request in sequence based on a preset message queue to obtain verified request data, wherein the verified request data comprises a target terminal identifier, a micro class resource identifier and a domain name identifier for requesting micro class resources.
In a possible implementation manner, the extracting, according to the micro-class resource identifier and the domain name identifier, target streaming media data from a preset content distribution network, where the target streaming media data is used for indicating micro-class audio/video data on-line live broadcast or on demand, includes: performing dynamic domain name resolution according to the domain name identifier to obtain a target host address, wherein the target host address is used for indicating an internet protocol address of a target edge node in a preset content distribution network, and the preset content distribution network is a content distribution network based on point-to-point; and carrying out resource retrieval on the target edge node according to the micro-class resource identifier and the Internet protocol address of the target edge node to obtain target streaming media data, wherein the target streaming media data is used for indicating micro-class audio and video data on-line live broadcast or on-demand.
In a possible implementation manner, the streaming the target streaming media data to the target terminal based on the target terminal identifier, so that the target terminal plays the target streaming media data without plug-in decoding, includes: acquiring anti-theft chain information and a target streaming media address corresponding to the target streaming media data, and generating the streaming media address to be played according to the target streaming media address and the anti-theft chain information; transmitting the streaming media address to be played to the target terminal based on the target terminal identifier, so that the target terminal performs audio and video anti-theft chain authentication on the streaming media address to be played to obtain an authentication result; and acquiring an authentication result sent by the target terminal, and streaming or sequentially streaming the target streaming media data to the target terminal in real time when the authentication result is that the authentication is passed, so that the target terminal plays the streamed target streaming media data to a target user in a preset plug-in-free mode.
In a possible implementation manner, in the process of playing the target streaming media data, character information input by a target user is obtained, stroke order recognition is performed on the character information through a preset optical character recognition model, interaction request information is obtained, and micro-class interaction operation is performed with the target user according to the interaction request information, and the method includes: in the playing process of the target streaming media data, receiving character information input by a target user, wherein the character information is used for indicating dot matrix image data containing English letters, numbers, punctuation marks, single characters, formulas, words and/or sentences; performing stroke order recognition and correction processing on the dot matrix image data through a preset optical character recognition model to obtain interaction request information, and determining interaction response information according to the interaction request information, wherein the interaction response information comprises online learning evaluation information, online test scoring information, online answering information and online course recommendation information; pushing the interaction response information to the target terminal according to the interaction request information, so that the target terminal displays the interaction response information to the target user.
In a possible implementation manner, before the receiving the micro-class resource access request sent by the target terminal and obtaining the target terminal identifier, the micro-class resource identifier and the domain name identifier for requesting the micro-class resource from the micro-class resource access request, the method for playing and interacting the streaming media data further includes: obtaining a plurality of stream media files, and respectively and sequentially carrying out micro-class resource classification, content auditing, audio and video code stream conversion and release processing on the plurality of stream media files to obtain a plurality of released stream media data, wherein the plurality of released stream media data comprise the target stream media data; storing the plurality of published streaming media data into a preset database, and distributing the plurality of published streaming media data into the preset content distribution network.
In a possible implementation manner, after the obtaining a plurality of streaming media files and sequentially performing micro-class resource classification, content auditing, audio and video code stream conversion and publishing processing on the plurality of streaming media files respectively, obtaining a plurality of published streaming media data, before the plurality of published streaming media data includes the target streaming media data, the playing and interaction method of the streaming media data further includes: acquiring writing handwriting data of an intelligent pen, and storing the writing handwriting data into a preset database; and acquiring micro-class audio data corresponding to the handwriting data, and performing audio-video coding on the handwriting data and the micro-class audio data to obtain a plurality of streaming media files, wherein each streaming media file is an audio-video file with a preset video format.
The second aspect of the present invention provides a device for playing and interacting streaming media data, comprising: the receiving module is used for receiving a micro-class resource access request sent by a target terminal and acquiring a target terminal identifier, a micro-class resource identifier and a domain name identifier for requesting micro-class resources from the micro-class resource access request; the extraction module is used for extracting target streaming media data from a preset content distribution network according to the micro-class resource identifier and the domain name identifier, wherein the target streaming media data is used for indicating micro-class audio/video data on-line live broadcast or on-demand; the transmission module is used for streaming the target streaming media data to the target terminal based on the target terminal identification so that the target terminal can play the target streaming media data without plug-in decoding; the identification module is used for acquiring character information input by a target user in the playing process of the target streaming media data, carrying out stroke order identification on the character information through a preset optical character identification model to obtain interaction request information, and carrying out micro-class interaction operation with the target user according to the interaction request information.
In a possible implementation manner, the receiving module is specifically configured to: receiving a micro-class resource access request sent by a target terminal, and performing identity verification on the micro-class resource access request to obtain a verification result, wherein the micro-class resource access request is a micro-class resource live broadcast request or a micro-class resource on-demand request; when the verification result is that verification fails, intercepting the micro-class resource access request, setting access refusal description information for the micro-class resource access request, and recording the micro-class resource access request and the access refusal description information in a preset operation log in an associated manner; and when the verification result is that verification is successful, carrying out flow limiting, parameter analysis and data verification processing on the micro class resource access request in sequence based on a preset message queue to obtain verified request data, wherein the verified request data comprises a target terminal identifier, a micro class resource identifier and a domain name identifier for requesting micro class resources.
In a possible embodiment, the extraction module is specifically configured to: performing dynamic domain name resolution according to the domain name identifier to obtain a target host address, wherein the target host address is used for indicating an internet protocol address of a target edge node in a preset content distribution network, and the preset content distribution network is a content distribution network based on point-to-point; and carrying out resource retrieval on the target edge node according to the micro-class resource identifier and the Internet protocol address of the target edge node to obtain target streaming media data, wherein the target streaming media data is used for indicating micro-class audio and video data on-line live broadcast or on-demand.
In a possible embodiment, the transmission module is specifically configured to: acquiring anti-theft chain information and a target streaming media address corresponding to the target streaming media data, and generating the streaming media address to be played according to the target streaming media address and the anti-theft chain information; transmitting the streaming media address to be played to the target terminal based on the target terminal identifier, so that the target terminal performs audio and video anti-theft chain authentication on the streaming media address to be played to obtain an authentication result; and acquiring an authentication result sent by the target terminal, and streaming or sequentially streaming the target streaming media data to the target terminal in real time when the authentication result is that the authentication is passed, so that the target terminal plays the streamed target streaming media data to a target user in a preset plug-in-free mode.
In a possible embodiment, the identification module is specifically configured to: in the playing process of the target streaming media data, receiving character information input by a target user, wherein the character information is used for indicating dot matrix image data containing English letters, numbers, punctuation marks, single characters, formulas, words and/or sentences; performing stroke order recognition and correction processing on the dot matrix image data through a preset optical character recognition model to obtain interaction request information, and determining interaction response information according to the interaction request information, wherein the interaction response information comprises online learning evaluation information, online test scoring information, online answering information and online course recommendation information; pushing the interaction response information to the target terminal according to the interaction request information, so that the target terminal displays the interaction response information to the target user.
In a possible implementation manner, the device for playing and interacting streaming media data further includes: the conversion module is used for converting the final training model into a model file of a target version according to a preset model file type; the processing module is used for acquiring a plurality of stream media files, and respectively and sequentially carrying out micro-class resource classification, content auditing, audio and video code stream conversion and release processing on the plurality of stream media files to obtain a plurality of released stream media data, wherein the plurality of released stream media data comprise the target stream media data; and the distribution module is used for storing the plurality of published streaming media data into a preset database and distributing the plurality of published streaming media data into the preset content distribution network.
In a possible implementation manner, the device for playing and interacting streaming media data further includes: the acquisition module is used for acquiring writing handwriting data of the intelligent pen and storing the writing handwriting data into a preset database; the coding module is used for acquiring micro-class audio data corresponding to the handwriting data, and carrying out audio and video coding on the handwriting data and the micro-class audio data to obtain a plurality of streaming media files, wherein each streaming media file is an audio and video file with a preset video format.
The third aspect of the present invention provides a system for playing and interacting streaming media data, comprising a server, a content distribution network device, an intelligent pen and a terminal; the server is connected with the content distribution network equipment, the intelligent pen and the terminal through a network; the server comprises a wireless communication module, a data processing module and a data storage module; the wireless communication module is used for receiving data transmitted by the intelligent pen in a preset wireless connection mode; the data processing module is used for sequentially carrying out optical character recognition and micro-class interaction operation according to the data transmitted by the intelligent pen, and carrying out streaming media data distribution and transmission processing on the preset content distribution network equipment; the data storage module is used for establishing a mapping relation between the data subjected to the optical character recognition processing and the data generated by the micro-class interactive operation and storing the mapping relation; the content distribution network device is used for storing, distributing and transmitting streaming media data; the intelligent pen comprises a writing module, a tracking module, a wireless transmitting module, a temperature sensing module and an alarm module; the writing module is in signal connection with the tracking module and is used for recording writing handwriting data of a user on a preset writing board or paper with a preset dot matrix; the tracking module is in signal connection with the wireless transmitting module and is used for tracking and processing the writing point position and writing direction of writing handwriting data to obtain data transmitted by the intelligent pen; the wireless transmitting module is connected with the wireless communication module and is used for transmitting the data transmitted by the intelligent pen to the data processing module in the preset wireless connection mode; the temperature sensing module is in signal connection with the writing module and is used for detecting the working state of the intelligent pen; the alarm module is in signal connection with the temperature sensing module and is used for prompting the user to stop writing when the working state of the intelligent pen is abnormal; the terminal is used for decoding and playing the streaming media data transmitted by the content distribution network equipment without a plug-in unit, and displaying the data after the optical character recognition processing and the data generated by the micro-class interactive operation.
A fourth aspect of the present invention provides a computer readable storage medium having instructions stored therein, which when executed on a computer, cause the computer to perform the above-described method of playing and interacting streaming media data.
In the technical scheme provided by the invention, a micro-class resource access request sent by a target terminal is received, and a target terminal identifier, a micro-class resource identifier and a domain name identifier for requesting micro-class resources are acquired from the micro-class resource access request; extracting target streaming media data from a preset content distribution network according to the micro-class resource identifier and the domain name identifier, wherein the target streaming media data is used for indicating micro-class audio/video data on-line live broadcast or on-demand; streaming the target streaming media data to the target terminal based on the target terminal identification so that the target terminal plays the target streaming media data without plug-in decoding; and in the playing process of the target streaming media data, character information input by a target user is acquired, stroke order identification is carried out on the character information through a preset optical character identification model, interaction request information is obtained, and micro-class interaction operation is carried out on the target user according to the interaction request information. In the embodiment of the invention, the target streaming media data is extracted from the preset content distribution network through the micro-class resource identifier and the domain name identifier, so that the distribution efficiency of the streaming media data is improved; streaming the target streaming media data to the target terminal based on the target terminal identification, so that the target terminal can play the target streaming media data without plug-in decoding, low-delay or delay-free playing of micro-class audio and video can be realized, and the playing efficiency and the playing speed are improved; and carrying out stroke order recognition on character information input by a target user through a preset optical character recognition model to obtain interaction request information, and carrying out micro-class interaction operation with the target user according to the interaction request information, so that the interaction efficiency of online education is improved.
Drawings
FIG. 1 is a schematic diagram of an embodiment of a method for playing and interacting streaming media data according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of another embodiment of a method for playing and interacting streaming media data according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of an embodiment of a device for playing and interacting streaming media data according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of another embodiment of a device for playing and interacting streaming media data according to an embodiment of the present invention;
fig. 5 is a schematic diagram of an embodiment of a system for playing and interacting streaming media data according to an embodiment of the present invention.
Detailed Description
The embodiment of the invention provides a method, a device, a system and a storage medium for playing and interacting streaming media data, which are used for improving the playing efficiency and playing speed of the streaming media data and improving the interaction efficiency of online education.
The terms "first," "second," "third," "fourth" and the like in the description and in the claims and in the above drawings, if any, are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments described herein may be implemented in other sequences than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or system that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed or inherent to such process, method, article, or system.
For easy understanding, the following describes a specific flow of an embodiment of the present invention, referring to fig. 1, and an embodiment of a method for playing and interacting streaming media data in an embodiment of the present invention includes:
101. and receiving a micro-class resource access request sent by the target terminal, and acquiring a target terminal identifier, a micro-class resource identifier and a domain name identifier for requesting micro-class resources from the micro-class resource access request.
The target terminal identifier is used for indicating a target terminal represented by a unique identifier, the micro-class resource identifier is used for indicating micro-class audio/video on live broadcast or on demand, and the domain name identifier is used for storing each edge node in the content distribution network of the micro-class audio/video. Specifically, the server receives a micro-class resource access request sent by the target terminal, intercepts the micro-class resource access request, acquires the estimated user access quantity, judges whether the estimated user access quantity is larger than a preset threshold, if the estimated user access quantity is larger than or equal to the preset threshold, the server adds the micro-class resource access request into a preset message queue, and analyzes the micro-class resource access request according to the writing sequence of the queue to obtain a target terminal identifier, a micro-class resource identifier and a domain name identifier for requesting micro-class resources. For example, the preset threshold is 100.
It should be noted that, the preset threshold is used for indicating whether the server performs the current limiting processing on the micro-class resource access request, so as to ensure that each preset service in the server operates normally when the high concurrency request is processed.
It can be understood that the execution body of the present invention may be a device for playing and interacting streaming media data, and may also be a target terminal or a server, which is not limited herein. The embodiment of the invention is described by taking a server as an execution main body as an example.
102. And extracting target streaming media data from a preset content distribution network according to the micro-class resource identifier and the domain name identifier, wherein the target streaming media data are used for indicating micro-class audio/video data on-line live broadcast or on-demand.
Specifically, the server acquires a node configuration list corresponding to a preset content distribution network; the server performs optimal search on the node configuration list according to the domain name identification based on a preset nearest neighbor searching algorithm to obtain a target edge node, the server accesses the target edge node according to the micro-class resource identifier, and the target streaming media data is used for indicating micro-class audio/video data on-line live broadcast or on-demand. The node configuration list includes a plurality of pieces of edge node information capable of providing corresponding streaming media data for the target terminal, and each piece of edge node information may include an identifier of each edge node and a forgetting protocol address, which is not limited herein.
It should be noted that, the server may further determine a content distribution network node (i.e., a target edge node) corresponding to the target terminal according to a preset load balancing policy, so as to reduce a network load of a micro-class resource access request in online education, shorten a service delay time, and improve transmission efficiency of streaming media data.
103. Streaming the target streaming media data to the target terminal based on the target terminal identification so that the target terminal decodes and plays the target streaming media data without a plug-in.
Specifically, the server streams the target streaming media data (i.e., the on-demand recorded broadcast or live streaming media data) to the target terminal according to the target terminal identifier (e.g., the target terminal address) through the edge node in the preset content distribution network, so that the target terminal does not have a plug-in unit to decode and play the target streaming media data. The method and the device realize low-delay or delay-free playing of micro-class audio and video data and improve user experience. Further, the server may perform data transmission on the target streaming media data in a preset real-time streaming manner or a preset sequential streaming manner.
It should be noted that, the server may also send the node information list of the subsequent micro-class resource of the target streaming media data to the target terminal, so that the target user can download or play the subsequent micro-class resource of the target streaming media data according to the node information list.
104. And in the playing process of the target streaming media data, character information input by a target user is acquired, stroke order identification is carried out on the character information through a preset optical character identification model, interaction request information is obtained, and micro-class interaction operation is carried out on the target user according to the interaction request information.
In the process of playing the target streaming media data, the character information input by the target user may include information such as course approval data, course test data, course question data, and course evaluation data of the target user, which is not limited herein. The preset optical character recognition model is a pre-trained model.
Specifically, in the process of playing the target streaming media data, the server receives character information input by the target user in real time, wherein the character information is a character image to be identified (i.e., dot matrix image data), for example, a dot matrix pen collects character information formed by writing the target user on paper with a dot code, and transmits the character information to the server through a preset wireless connection mode, and the preset wireless connection mode comprises a Bluetooth connection mode, which is not limited in detail herein; the method comprises the steps that a server obtains preset image processing parameters, and the server performs background separation and noise filtering processing on a character image to be identified according to the preset image processing parameters to obtain a preprocessed character image; the server performs stroke order recognition on the preprocessed text image through a preset optical character recognition model to obtain interaction request information (namely, characters in the preprocessed text image), and performs micro-class interaction operation with a target user according to the interaction request information so as to realize an interaction classroom. For example, the target terminal presents test questions to the target user, and the server acquires answer information of the target user and generates answer progress, correct and wrong conditions and the like according to the answer information. Further, the server acquires micro-class interaction operation time in real time, and performs screen capturing processing based on the micro-class interaction operation time to obtain a target screen capturing picture; and the server performs optical character recognition on the target screen capturing picture to obtain online education information, and stores the online education information based on the micro-class interaction operation moment.
It should be noted that, the server extracts text information related to the target streaming media data; the server calculates the similarity between the interaction request information and the text information and judges whether the similarity is larger than a preset threshold value or not; if the similarity is greater than or equal to a preset threshold value, the server determines that the interaction request information and the text information are matched; if the similarity is smaller than a preset threshold, the server determines that the interaction request information and the text information are not matched, generates warning information and pushes the warning information to the target terminal so as to prompt a target user to input correct character information.
In the embodiment of the invention, the target streaming media data is extracted from the preset content distribution network through the micro-class resource identifier and the domain name identifier, so that the distribution efficiency of the streaming media data is improved; streaming the target streaming media data to the target terminal based on the target terminal identification, so that the target terminal can play the target streaming media data without plug-in decoding, low-delay or delay-free playing of micro-class audio and video can be realized, and the playing efficiency and the playing speed are improved; and carrying out stroke order recognition on character information input by a target user through a preset optical character recognition model to obtain interaction request information, and carrying out micro-class interaction operation with the target user according to the interaction request information, so that the interaction efficiency of online education is improved.
Referring to fig. 2, another embodiment of a method for playing and interacting streaming media data according to an embodiment of the present invention includes:
201. and acquiring a plurality of stream media files, and respectively and sequentially carrying out micro-class resource classification, content auditing, audio and video code stream conversion and release processing on the plurality of stream media files to obtain a plurality of released stream media data, wherein the plurality of released stream media data comprise target stream media data.
Specifically, firstly, a server receives a plurality of uploaded streaming media files; the server sets micro class classification labels for the plurality of stream media files to obtain a plurality of classified stream media files. For example, the plurality of streaming media files include A, B, C, D and E, the server sets the micro class classification labels of a and E to english class labels media_eng, the server sets the micro class classification label of B to chinese class labels media_chn, and the server sets the micro class classification labels of C and D to math class labels media_math. The class labels of the streaming media files may further include a go course label and a program course label, which are not limited herein. The naming format of the class label may include english characters, underlines, and numbers, and is not limited in detail herein.
Secondly, the server separates the voice information, the video information and the subtitle information corresponding to each classified streaming media file from the classified streaming media files, and performs sensitive information screening and auditing on the voice information, the video information and the subtitle information corresponding to each classified streaming media file through a preset trained model to obtain a plurality of audited streaming media files. For example, the server sets a streaming media file that does not comply with internet regulations as an audit failed streaming media file. Further, the server marks and inspects the failed stream media file and waits for receiving the revised stream media file, and the server carries out the review operation on the revised stream media file until the audit is passed, so that the safety of the content of the stream media file is ensured, and the content auditing efficiency is improved.
And then, the server performs audio and video code stream conversion and release processing on the stream media files passing the verification to obtain a plurality of released stream media data, wherein the released stream media data comprise target stream media data. Further, the server sequentially judges whether the video format of each stream media file passing through verification is a preset format, if the video format of each stream media file passing through verification is not the preset format, the server decodes, repacks, packs, repacks and the like each stream media file passing through verification to obtain a plurality of stream media files after transcoding, and the server sets the release state corresponding to each stream media file after transcoding as the released state to obtain a plurality of stream media data after releasing. The video format that each streaming media file can support may support real-time streaming protocol (real time streaming protocol, RTSP), real-time messaging protocol (real time messaging protocol, RTMP), and hypertext transfer protocol (hypertext transfer protocol, HTTP), and may also support other protocols, which are not limited herein. For example, the server transcodes a streaming media file supporting RTSP play into a streaming media file supporting HTTP play.
Optionally, before the step 201, the server acquires writing handwriting data of the smart pen, and stores the writing handwriting data into a preset database; the server acquires micro-class audio data corresponding to the handwriting data, and performs audio-video coding on the handwriting data and the micro-class audio data to obtain a plurality of streaming media files, wherein each streaming media file is an audio-video file with a preset video format. The preset video format may be a standard mp4 format or a flv format, which is not limited herein. That is, the server synthesizes handwriting data and micro-lesson audio data into an audio-video file, which refers to micro-lesson audio-video data for on-demand. Further, the synthesized micro-class audio data may also include a virtual reality scene to implement an interactive class under the virtual reality scene.
202. Storing the plurality of published streaming media data into a preset database, and distributing the plurality of published streaming media data into a preset content distribution network.
The preset content delivery network may serve the CDN for a single content delivery network, or may be a PCDN network (i.e., a peer-to-peer content delivery network) constructed by a peer-to-peer P2P and the CDN, which is not limited herein. PCDN is a low-cost content delivery network service that is built by mining mass fragmented idle resources that utilize telecommunications edge networks.
Specifically, the server stores a plurality of published streaming media data into a preset file directory (may also be a preset file server) respectively, so as to obtain storage path information corresponding to each published streaming media data, the server updates the storage path information corresponding to the published streaming media data into a preset database, and the preset database can support a read-write separation mode, so that the data query efficiency is improved; the server receives a file distribution request; the server extracts a plurality of published streaming media data from a preset database according to the file distribution request, and distributes the plurality of published streaming media data to a target edge node in a preset content distribution network.
203. And receiving a micro-class resource access request sent by the target terminal, and acquiring a target terminal identifier, a micro-class resource identifier and a domain name identifier for requesting micro-class resources from the micro-class resource access request.
The target terminal identifier may be a network protocol address of the target terminal, or may be a name of the target terminal, which is not limited herein, and there is a correspondence between the target terminal identifier, the micro class resource identifier, and the domain name identifier for requesting the micro class resource.
Optionally, the server receives the micro-class resource access request sent by the target terminal, and performs identity verification on the micro-class resource access request to obtain a verification result, where the micro-class resource access request is a micro-class resource live broadcast request or a micro-class resource on demand request, for example, the micro-class resource access request carries a user token, the server performs identity verification through the user token to obtain the verification result, if the verification result is a preset value, the server determines that the verification result is verification success, if the verification result is not the preset value, the server determines that the verification result is verification failure, where the preset value may use 1 or logic true to indicate that the verification result is verification success, and the preset value may use 0 or logic false to indicate that the verification result is verification failure, which is not limited herein. The harm of illegal network access to data security is reduced, and the robustness of the program is improved. When the verification result is verification failure, the server intercepts the micro-class resource access request, sets refusal access description information for the micro-class resource access request, and correlates and records the micro-class resource access request and the refusal access description information into a preset operation log, and further, the server can also scan the preset operation log at regular time to obtain statistical report information, wherein the statistical report information is used for counting verification failure times and analyzing request failure information. And when the verification result is that the verification is successful, the server sequentially carries out flow limiting, parameter analysis and data verification processing on the micro-class resource access request based on a preset message queue to obtain verified request data, wherein the verified request data comprises a target terminal identifier, a micro-class resource identifier and a domain name identifier for requesting micro-class resources. It should be noted that, the server can ensure the normal operation and production of the service by limiting the current through the preset message queue.
Further, the server writes the micro-class resource access request into a preset message queue, and sequentially processes the micro-class resource access request through the preset message queue according to the writing sequence, specifically, the server performs parameter analysis on the micro-class resource access request to obtain an analysis result, performs data verification processing on the analysis result to obtain verified request data, wherein the verified request data comprises a target terminal identifier, a micro-class resource identifier and a domain name identifier for requesting micro-class resources.
204. And extracting target streaming media data from a preset content distribution network according to the micro-class resource identifier and the domain name identifier, wherein the target streaming media data are used for indicating micro-class audio/video data on-line live broadcast or on-demand.
The target streaming media data are in one-to-one correspondence with the micro-class resource identifiers, and are stored on edge nodes corresponding to domain name identifiers in a preset content distribution network. Optionally, the server performs dynamic domain name resolution according to the domain name identifier to obtain a target host address, further, the server combines the domain name identifier into a domain name to be resolved according to a preset domain name combination rule, performs dynamic domain name resolution on the domain name to be resolved to obtain the target host address, and determines whether the domain name to be resolved is normally accessed according to the target host address, wherein the target host address is used for indicating an internet protocol address of a target edge node in a preset content distribution network, the preset content distribution network is a point-to-point based content distribution network (i.e., a PCDN network), network resources are saved based on the point-to-point content distribution network, and bandwidth pressure is reduced; when the server determines that the domain name to be resolved is normally accessed, the server performs resource retrieval on the target edge node according to the micro-class resource identifier and the Internet protocol address of the target edge node to obtain target streaming media data, wherein the target streaming media data is used for indicating micro-class audio/video data of online live broadcast or on-demand.
It should be noted that, the server stores in advance, in a preset content distribution network, live broadcast code streams corresponding to micro-class audio/video data for online live broadcast, sets corresponding channel metadata information (that is, micro-class resource identifiers), receives a micro-class resource access request including the channel metadata information sent by the terminal, and extracts target streaming media data for online live broadcast from the preset content distribution network according to the micro-class resource access request including the channel metadata information. The live broadcast code stream supports low-delay and smooth-play live broadcast multi-code rate.
205. Streaming the target streaming media data to the target terminal based on the target terminal identification so that the target terminal decodes and plays the target streaming media data without a plug-in.
The target streaming media data includes audio and video streaming data, which is not limited herein. It should be noted that, streaming mainly refers to a technical overview of streaming media (such as video, audio or multimedia files) transmitted through a network, and generally includes real-time streaming and sequential streaming. Wherein in embodiments of the present invention, the server adapts real-time streaming to live target streaming media data and applies sequential streaming to on-demand target streaming media data.
Optionally, the server obtains the anti-theft link information and a target streaming media address corresponding to the target streaming media data, and generates a streaming media address to be played according to the target streaming media address and the anti-theft link information, where the streaming media address to be played is used for indicating address information of the target streaming media data of live broadcast or on demand, and the anti-theft link information refers to that an authentication string is added to the target streaming media address, and may be a domain name anti-theft link or other anti-theft links, and is not limited in this specific area. The server adopts the anti-theft chain information to ensure the safe transmission of the target streaming media data and realize the control of the playing authority of the target streaming media data; the server sends the streaming media address to be played to the target terminal based on the target terminal identification, so that the target terminal performs audio and video anti-theft chain authentication on the streaming media address to be played to obtain an authentication result; and the server acquires an authentication result sent by the target terminal, and when the authentication result is that the authentication is passed, the server streams or sequentially streams the target streaming media data to the target terminal in real time, so that the target terminal plays the streamed target streaming media data to a target user in a preset plug-in-free mode. The preset plug-in-free mode specifically means that the server transmits target streaming media data to a preset browser in the target terminal through a full duplex communication protocol websocket, the preset browser decodes the target streaming media data through a scripting language javascript or a virtual instruction set architecture webempty, and then the preset browser performs real-time audio and video playing processing by using canvas and/or a 3D drawing protocol webgl, so that the playing efficiency and the playing fluency of the streaming media data are improved.
Further, the server can also return the target streaming media data with the lowest code rate corresponding to the streaming media address to be played according to different network transmission rates of the target terminal, so as to improve the playing speed of the streaming media data.
206. And in the playing process of the target streaming media data, character information input by a target user is acquired, stroke order identification is carried out on the character information through a preset optical character identification model, interaction request information is obtained, and micro-class interaction operation is carried out on the target user according to the interaction request information.
The character information input by the target user is used to indicate the character information input by the target user through handwriting, for example, the target user directly inputs the character information through handwriting in a target terminal (for example, a terminal such as a smart tablet computer or a mobile phone) or the target user inputs the character information through handwriting in a smart pen (for example, a dot matrix pen). The smart pen is in signal connection with the target terminal (for example, signal connection is performed through a Bluetooth protocol).
Optionally, the server receives character information input by the target user during the playing process of the target streaming media data, where the character information is used to indicate dot matrix image data including english letters, numbers, punctuation marks, single characters, formulas, words and/or sentences. The server performs stroke order recognition and correction processing on the dot matrix image data through a preset optical character recognition model to obtain interaction request information, and determines interaction response information according to the interaction request information. For example, when the interactive request information is course question information (i.e., a preset application scenario), the server executes a preset packaging function corresponding to the course question information, so as to find a question (i.e., a target question) with the highest similarity to the interactive request information from the database through a preset text similarity recall algorithm, and obtain an answer (i.e., a target answer) corresponding to the question with the highest similarity to the interactive request information, and set the target answer as the interactive response information. The interactive response information includes online learning evaluation information, online test scoring information, online answer information and online course recommendation information, and the interactive response information may also include other interactive information, which is not limited herein. And pushing the interaction response information to the target terminal by the server according to the interaction request information, so that the target terminal displays the interaction response information to the target user. The interactive response information may be text information, image information, animation information or voice information at the target terminal, which is not limited herein.
It should be noted that, the character information input by the target user may also include user voice information, the server may also perform voice recognition on the user voice information to obtain a recognition result, determine corresponding response information according to the recognition result, and display the corresponding response information on the target terminal. For example, the server acquires the online english dialogue voice information of the target user, and the server displays different evaluation levels, for example, excellent excel, good, try again, etc., to the target user according to the online english dialogue information.
Further, the server can record the live micro-class audio/video data on line to obtain recorded micro-class audio/video and playback time period, and store the recorded micro-class audio/video data and playback time period, so that a target user can perform on-demand operation on the recorded micro-class audio/video according to the review time period.
In the embodiment of the invention, the target streaming media data is extracted from the preset content distribution network through the micro-class resource identifier and the domain name identifier, so that the distribution efficiency of the streaming media data is improved; streaming the target streaming media data to the target terminal based on the target terminal identification, so that the target terminal can play the target streaming media data without plug-in decoding, low-delay or delay-free playing of micro-class audio and video can be realized, and the playing efficiency and the playing speed are improved; and carrying out stroke order recognition on character information input by a target user through a preset optical character recognition model to obtain interaction request information, and carrying out micro-class interaction operation with the target user according to the interaction request information, so that the interaction efficiency of online education is improved.
The method for playing and interacting streaming media data in the embodiment of the present invention is described above, and the device for playing and interacting streaming media data in the embodiment of the present invention is described below, referring to fig. 3, an embodiment of the device for playing and interacting streaming media data in the embodiment of the present invention includes:
a receiving module 301, configured to receive a micro-class resource access request sent by a target terminal, and obtain a target terminal identifier, a micro-class resource identifier, and a domain name identifier for requesting a micro-class resource from the micro-class resource access request;
the extracting module 302 is configured to extract, according to the micro-class resource identifier and the domain name identifier, target streaming media data from a preset content distribution network, where the target streaming media data is used to indicate micro-class audio/video data that is live broadcast or on demand on line;
a transmission module 303, configured to stream the target streaming media data to the target terminal based on the target terminal identifier, so that the target terminal does not have a plug-in to decode and play the target streaming media data;
the recognition module 304 is configured to obtain character information input by a target user during the playing process of the target streaming media data, recognize the stroke order of the character information through a preset optical character recognition model, obtain interaction request information, and perform micro-class interaction operation with the target user according to the interaction request information.
In the embodiment of the invention, the target streaming media data is extracted from the preset content distribution network through the micro-class resource identifier and the domain name identifier, so that the distribution efficiency of the streaming media data is improved; streaming the target streaming media data to the target terminal based on the target terminal identification, so that the target terminal can play the target streaming media data without plug-in decoding, low-delay or delay-free playing of micro-class audio and video can be realized, and the playing efficiency and the playing speed are improved; and carrying out stroke order recognition on character information input by a target user through a preset optical character recognition model to obtain interaction request information, and carrying out micro-class interaction operation with the target user according to the interaction request information, so that the interaction efficiency of online education is improved.
Referring to fig. 4, another embodiment of a device for playing and interacting streaming media data according to an embodiment of the present invention includes:
a receiving module 301, configured to receive a micro-class resource access request sent by a target terminal, and obtain a target terminal identifier, a micro-class resource identifier, and a domain name identifier for requesting a micro-class resource from the micro-class resource access request;
the extracting module 302 is configured to extract, according to the micro-class resource identifier and the domain name identifier, target streaming media data from a preset content distribution network, where the target streaming media data is used to indicate micro-class audio/video data that is live broadcast or on demand on line;
A transmission module 303, configured to stream the target streaming media data to the target terminal based on the target terminal identifier, so that the target terminal does not have a plug-in to decode and play the target streaming media data;
the recognition module 304 is configured to obtain character information input by a target user during the playing process of the target streaming media data, recognize the stroke order of the character information through a preset optical character recognition model, obtain interaction request information, and perform micro-class interaction operation with the target user according to the interaction request information.
Optionally, the receiving module 301 may be further specifically configured to:
receiving a micro-class resource access request sent by a target terminal, and performing identity verification on the micro-class resource access request to obtain a verification result, wherein the micro-class resource access request is a micro-class resource live broadcast request or a micro-class resource on-demand request;
when the verification result is that verification fails, intercepting the micro-class resource access request, setting access refusal description information for the micro-class resource access request, and recording the micro-class resource access request and the access refusal description information in a preset operation log in an associated manner;
and when the verification result is that the verification is successful, carrying out flow limiting, parameter analysis and data verification processing on the micro-class resource access request in sequence based on a preset message queue to obtain verified request data, wherein the verified request data comprises a target terminal identifier, a micro-class resource identifier and a domain name identifier for requesting the micro-class resource.
Optionally, the extracting module 302 may be further specifically configured to:
performing dynamic domain name resolution according to the domain name identification to obtain a target host address, wherein the target host address is used for indicating an Internet protocol address of a target edge node in a preset content distribution network, and the preset content distribution network is a point-to-point based content distribution network;
and carrying out resource retrieval on the target edge node according to the micro-class resource identifier and the Internet protocol address of the target edge node to obtain target streaming media data, wherein the target streaming media data is used for indicating micro-class audio and video data on-line live broadcast or on-demand.
Optionally, the transmission module 303 may be further specifically configured to:
acquiring target streaming media addresses corresponding to the anti-theft link information and the target streaming media data, and generating streaming media addresses to be played according to the target streaming media addresses and the anti-theft link information;
and sending the streaming media address to be played to the target terminal based on the target terminal identification, so that the target terminal carries out audio and video anti-theft authentication on the target streaming media data according to the streaming media address to be played, and playing the streamed target streaming media data to a target user when the authentication passes.
Optionally, the identification module 304 may be further specifically configured to:
In the playing process of the target streaming media data, receiving character information input by a target user, wherein the character information is used for indicating dot matrix image data containing English letters, numbers, punctuation marks, single characters, formulas, words and/or sentences;
performing stroke order recognition and correction processing on the dot matrix image data through a preset optical character recognition model to obtain interaction request information, and determining interaction response information according to the interaction request information, wherein the interaction response information comprises online learning evaluation information, online test scoring information, online answering information and online course recommendation information;
pushing the interaction response information to the target terminal according to the interaction request information, so that the target terminal displays the interaction response information to the target user.
Optionally, the playing and interaction device of the streaming media data further includes:
the processing module 305 is configured to obtain a plurality of streaming media files, and sequentially perform micro-class resource classification, content auditing, audio/video code stream conversion and publishing processing on the plurality of streaming media files, to obtain a plurality of published streaming media data, where the plurality of published streaming media data includes target streaming media data;
the distribution module 306 is configured to store a plurality of published streaming media data in a preset database, and distribute the plurality of published streaming media data to a preset content distribution network.
Optionally, the playing and interaction device of the streaming media data further includes:
the obtaining module 307 is configured to obtain writing handwriting data of the smart pen, and store the writing handwriting data into a preset database;
the encoding module 308 is configured to obtain micro-class audio data corresponding to the handwriting data, and perform audio/video encoding on the handwriting data and the micro-class audio data to obtain a plurality of streaming media files, where each streaming media file is an audio/video file with a preset video format.
In the embodiment of the invention, the target streaming media data is extracted from the preset content distribution network through the micro-class resource identifier and the domain name identifier, so that the distribution efficiency of the streaming media data is improved; streaming the target streaming media data to the target terminal based on the target terminal identification, so that the target terminal can play the target streaming media data without plug-in decoding, low-delay or delay-free playing of micro-class audio and video can be realized, and the playing efficiency and the playing speed are improved; and carrying out stroke order recognition on character information input by a target user through a preset optical character recognition model to obtain interaction request information, and carrying out micro-class interaction operation with the target user according to the interaction request information, so that the interaction efficiency of online education is improved.
The foregoing details of the playing and interaction device of the streaming media data in the embodiment of the present invention are described in fig. 3 and fig. 4 from the modularization perspective, and the following details of the playing and interaction system of the streaming media data in the embodiment of the present invention from the hardware processing perspective.
Fig. 5 is a schematic structural diagram of a system for playing and interacting streaming media data according to an embodiment of the present invention, where the system 500 for playing and interacting streaming media data may have a relatively large difference due to different configuration or performance, and the system 500 for playing and interacting streaming media data may include a server 501, a content distribution network device 502, a smart pen 503 and a terminal 504; the server 501 is in network connection with a content distribution network device 502, a smart pen 503 and a terminal 504; the server 501 includes a wireless communication module 5011, a data processing module 5012, and a data storage module 5013; the wireless communication module 5011 is configured to receive data transmitted by the smart pen through a preset wireless connection mode, where the preset wireless connection mode includes a wireless WIFI mode and a bluetooth mode, and is not limited herein specifically; the data processing module 5012 is configured to sequentially perform optical character recognition and micro-class interaction according to data transmitted by the smart pen, and perform streaming media data distribution and transmission processing on the content distribution network device 502; the data storage module 5013 is used for establishing a mapping relation between the data after the optical character recognition processing and the data generated by the micro-class interactive operation and storing the mapping relation; a content distribution network device 502 for storing, distributing and transmitting streaming media data; the smart pen 503 includes a writing module 5031, a tracking module 5032, a wireless transmitting module 5033, a temperature sensing module 5034, and an alarm module 5035; the writing module 5031 is connected with the tracking module signal 5032 and is used for recording writing handwriting data of a user on a preset writing board or paper with a preset dot matrix; the tracking module 5032 is connected with the wireless transmitting module signal 5033 and is used for tracking and processing the writing point position and writing direction of writing handwriting data to obtain character information input by a user; the wireless transmitting module 5033 is in signal connection with the wireless communication module 5011 and is used for transmitting the data input by the intelligent pen to the data processing module 5012 in a preset wireless connection mode; the temperature sensing module 5034 is connected with the writing module signal 5031 and is used for detecting the working state of the intelligent pen; the alarm module 5035 is connected with the temperature sensing module signal 5034 and is used for prompting a user to stop writing when the working state of the intelligent pen is abnormal; and the terminal 504 is used for decoding and playing the streaming media data transmitted by the content distribution network equipment without a plug-in unit, and displaying the data after the optical character recognition processing and the data generated by micro-class interaction operation.
It will be appreciated by those skilled in the art that the streaming media data play-and-interaction system 500 structure shown in fig. 5 does not constitute a limitation of the streaming media data play-and-interaction system 500 and may include more or fewer modules than shown, or may combine certain modules, or may be a different arrangement of modules.
The invention also provides a computer readable storage medium, which can be a nonvolatile computer readable storage medium, and can also be a volatile computer readable storage medium, wherein the computer readable storage medium stores instructions, and when the instructions run on a computer, the instructions cause the computer to execute the steps of the streaming media data playing and interaction method.
It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the above-described systems, apparatuses and units may refer to corresponding procedures in the foregoing method embodiments, which are not repeated herein.
The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied essentially or in part or all of the technical solution or in part in the form of a software product stored in a storage medium, including instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a read-only memory (ROM), a random access memory (random access memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
The above embodiments are only for illustrating the technical solution of the present invention, and not for limiting the same; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims (10)

1. The playing and interaction method of the streaming media data is characterized by comprising the following steps:
receiving a micro-class resource access request sent by a target terminal, and acquiring a target terminal identifier, a micro-class resource identifier and a domain name identifier for requesting micro-class resources from the micro-class resource access request, wherein the micro-class resource access request is intercepted, the estimated user access amount is acquired, whether the estimated user access amount is greater than or equal to a preset threshold value is judged, and if the estimated user access amount is greater than or equal to the preset threshold value, the micro-class resource access request is added into a preset message queue;
Extracting target streaming media data from a preset content distribution network according to the micro-class resource identifier and the domain name identifier, wherein the target streaming media data are used for indicating micro-class audio/video data on-line live broadcast or on-demand, and the node configuration list is optimally searched according to the domain name identifier based on a preset nearest neighbor search algorithm by acquiring a node configuration list corresponding to the preset content distribution network to obtain a target edge node, and accessing the target edge node according to the micro-class resource identifier and searching out the target streaming media data;
streaming the target streaming media data to the target terminal based on the target terminal identification so that the target terminal plays the target streaming media data without plug-in decoding;
and in the playing process of the target streaming media data, character information input by a target user is acquired, stroke order identification is carried out on the character information through a preset optical character identification model, interaction request information is obtained, and micro-class interaction operation is carried out on the target user according to the interaction request information.
2. The method for playing and interacting streaming media data according to claim 1, wherein the receiving the micro-class resource access request sent by the target terminal and obtaining the target terminal identifier, the micro-class resource identifier and the domain name identifier for requesting the micro-class resource from the micro-class resource access request include:
Receiving a micro-class resource access request sent by a target terminal, and performing identity verification on the micro-class resource access request to obtain a verification result, wherein the micro-class resource access request is a micro-class resource live broadcast request or a micro-class resource on-demand request;
when the verification result is that verification fails, intercepting the micro-class resource access request, setting access refusal description information for the micro-class resource access request, and recording the micro-class resource access request and the access refusal description information in a preset operation log in an associated manner;
and when the verification result is that verification is successful, carrying out flow limiting, parameter analysis and data verification processing on the micro class resource access request in sequence based on a preset message queue to obtain verified request data, wherein the verified request data comprises a target terminal identifier, a micro class resource identifier and a domain name identifier for requesting micro class resources.
3. The method for playing and interacting streaming media data according to claim 1, wherein the extracting target streaming media data from a preset content distribution network according to the micro-class resource identifier and the domain name identifier, where the target streaming media data is used for indicating micro-class audio/video data on-line live broadcast or on-demand, includes:
Performing dynamic domain name resolution according to the domain name identifier to obtain a target host address, wherein the target host address is used for indicating an internet protocol address of a target edge node in a preset content distribution network, and the preset content distribution network is a content distribution network based on point-to-point;
and carrying out resource retrieval on the target edge node according to the micro-class resource identifier and the Internet protocol address of the target edge node to obtain target streaming media data, wherein the target streaming media data is used for indicating micro-class audio and video data on-line live broadcast or on-demand.
4. The method for playing and interacting streaming media data according to claim 1, wherein streaming the target streaming media data to the target terminal based on the target terminal identifier, so that the target terminal plays the target streaming media data without plug-in decoding, includes:
acquiring anti-theft chain information and a target streaming media address corresponding to the target streaming media data, and generating a streaming media address to be played according to the target streaming media address and the anti-theft chain information;
transmitting the streaming media address to be played to the target terminal based on the target terminal identifier, so that the target terminal performs audio and video anti-theft chain authentication on the streaming media address to be played to obtain an authentication result;
And acquiring an authentication result sent by the target terminal, and streaming or sequentially streaming the target streaming media data to the target terminal in real time when the authentication result is that the authentication is passed, so that the target terminal plays the streamed target streaming media data to a target user in a preset plug-in-free mode.
5. The method for playing and interacting streaming media data according to claim 1, wherein in the process of playing the target streaming media data, character information input by a target user is obtained, stroke order recognition is performed on the character information through a preset optical character recognition model, interaction request information is obtained, and micro-class interaction operation is performed with the target user according to the interaction request information, comprising:
in the playing process of the target streaming media data, receiving character information input by a target user, wherein the character information is used for indicating dot matrix image data containing English letters, numbers, punctuation marks, single characters, formulas, words and/or sentences;
performing stroke order recognition and correction processing on the dot matrix image data through a preset optical character recognition model to obtain interaction request information, and determining interaction response information according to the interaction request information, wherein the interaction response information comprises online learning evaluation information, online test scoring information, online answering information and online course recommendation information;
Pushing the interaction response information to the target terminal according to the interaction request information, so that the target terminal displays the interaction response information to the target user.
6. The method for playing and interacting streaming media data according to any one of claims 1-5, wherein before receiving a micro-class resource access request sent by a target terminal and obtaining a target terminal identifier, a micro-class resource identifier, and a domain name identifier for requesting a micro-class resource from the micro-class resource access request, the method for playing and interacting streaming media data further comprises:
obtaining a plurality of stream media files, and respectively and sequentially carrying out micro-class resource classification, content auditing, audio and video code stream conversion and release processing on the plurality of stream media files to obtain a plurality of released stream media data, wherein the plurality of released stream media data comprise the target stream media data;
storing the plurality of published streaming media data into a preset database, and distributing the plurality of published streaming media data into the preset content distribution network.
7. The method for playing and interacting with streaming media data according to claim 6, wherein, before the obtaining a plurality of streaming media files and sequentially performing micro-class resource classification, content auditing, audio/video code stream conversion and publishing processing on the plurality of streaming media files respectively, obtaining a plurality of published streaming media data, the method for playing and interacting with streaming media data further comprises:
Acquiring writing handwriting data of an intelligent pen, and storing the writing handwriting data into a preset database;
and acquiring micro-class audio data corresponding to the writing handwriting data, and performing audio-video coding on the writing handwriting data and the micro-class audio data to obtain a plurality of streaming media files, wherein each streaming media file is an audio-video file with a preset video format.
8. The device for playing and interacting the streaming media data is characterized by comprising the following components:
the receiving module is used for receiving a micro-class resource access request sent by a target terminal, and acquiring a target terminal identifier, a micro-class resource identifier and a domain name identifier for requesting micro-class resources from the micro-class resource access request, wherein the micro-class resource access request is intercepted, the estimated user access amount is acquired, whether the estimated user access amount is larger than or equal to a preset threshold value is judged, and if the estimated user access amount is larger than or equal to the preset threshold value, the micro-class resource access request is added into a preset message queue;
the extraction module is used for extracting target streaming media data from a preset content distribution network according to the micro-class resource identifier and the domain name identifier, wherein the target streaming media data are used for indicating micro-class audio/video data on-line live broadcast or on demand, and the node configuration list is optimally searched according to the domain name identifier based on a preset nearest neighbor search algorithm by acquiring the node configuration list corresponding to the preset content distribution network, so as to obtain a target edge node, and the target edge node is accessed according to the micro-class resource identifier and the target streaming media data are searched;
The transmission module is used for streaming the target streaming media data to the target terminal based on the target terminal identification so that the target terminal can play the target streaming media data without plug-in decoding;
the identification module is used for acquiring character information input by a target user in the playing process of the target streaming media data, carrying out stroke order identification on the character information through a preset optical character identification model to obtain interaction request information, and carrying out micro-class interaction operation with the target user according to the interaction request information.
9. A system for playing and interacting streaming media data, characterized in that the system for playing and interacting streaming media data comprises a server, a content distribution network, a smart pen and a terminal for implementing the method for playing and interacting streaming media data according to any one of claims 1-7;
the server is connected with the content distribution network, the intelligent pen and the terminal network;
the server comprises a wireless communication module, a data processing module and a data storage module; wherein, the liquid crystal display device comprises a liquid crystal display device,
the wireless communication module is used for receiving the data transmitted by the intelligent pen in a preset wireless connection mode;
The data processing module is used for sequentially carrying out optical character recognition and micro-class interaction operation according to the data transmitted by the intelligent pen, and carrying out streaming media data distribution and transmission processing on the content distribution network;
the data storage module is used for establishing a mapping relation between the data subjected to the optical character recognition processing and the data generated by the micro-class interactive operation and storing the mapping relation;
the content distribution network is used for storing, distributing and transmitting streaming media data;
the intelligent pen comprises a writing module, a tracking module, a wireless transmitting module, a temperature sensing module and an alarm module; wherein, the liquid crystal display device comprises a liquid crystal display device,
the writing module is in signal connection with the tracking module and is used for recording writing handwriting data of a user on a preset writing board or paper with a preset dot matrix;
the tracking module is in signal connection with the wireless transmitting module and is used for tracking and processing the writing point position and writing direction of writing handwriting data to obtain data transmitted by the intelligent pen;
the wireless transmitting module is in signal connection with the wireless communication module and is used for transmitting the data transmitted by the intelligent pen to the data processing module in the preset wireless connection mode;
The temperature sensing module is in signal connection with the writing module and is used for detecting the working state of the intelligent pen;
the alarm module is in signal connection with the temperature sensing module and is used for prompting the user to stop writing when the working state of the intelligent pen is abnormal;
the terminal is used for decoding and playing the streaming media data transmitted by the content distribution network without a plug-in unit, and displaying the data after the optical character recognition processing and the data generated by the micro-class interactive operation.
10. A computer readable storage medium having stored thereon a computer program, wherein the computer program when executed by a processor implements a method of playing and interacting streaming media data according to any of claims 1-7.
CN202110440368.XA 2021-04-22 2021-04-22 Method, device, system and storage medium for playing and interacting streaming media data Active CN113301393B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110440368.XA CN113301393B (en) 2021-04-22 2021-04-22 Method, device, system and storage medium for playing and interacting streaming media data

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110440368.XA CN113301393B (en) 2021-04-22 2021-04-22 Method, device, system and storage medium for playing and interacting streaming media data

Publications (2)

Publication Number Publication Date
CN113301393A CN113301393A (en) 2021-08-24
CN113301393B true CN113301393B (en) 2023-06-30

Family

ID=77320109

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110440368.XA Active CN113301393B (en) 2021-04-22 2021-04-22 Method, device, system and storage medium for playing and interacting streaming media data

Country Status (1)

Country Link
CN (1) CN113301393B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114363289B (en) * 2021-12-22 2023-08-01 天翼阅读文化传播有限公司 Virtual network intelligent scheduling system based on rule engine
CN115134659A (en) * 2022-06-15 2022-09-30 阿里巴巴云计算(北京)有限公司 Video editing and configuring method and device, browser, electronic equipment and storage medium

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104980771A (en) * 2014-04-09 2015-10-14 中国电信股份有限公司 Method and system for stream media-on-demand through internet protocol television (IPTV)
WO2018089033A1 (en) * 2016-11-14 2018-05-17 Google Llc Systems and methods for providing interactive streaming media
CN108600777B (en) * 2018-04-09 2021-02-12 北京大米科技有限公司 Streaming media playback server and client
CN110166831B (en) * 2018-07-23 2021-10-15 腾讯科技(深圳)有限公司 Method, device, storage medium and computer equipment for playing back streaming media file
CN112507806B (en) * 2020-11-19 2022-05-27 深圳市鹰硕教育服务有限公司 Intelligent classroom information interaction method and device and electronic equipment

Also Published As

Publication number Publication date
CN113301393A (en) 2021-08-24

Similar Documents

Publication Publication Date Title
US10701440B2 (en) Identification and presentation of content associated with currently playing television programs
US8959202B2 (en) Generating statistics of popular content
CN113301393B (en) Method, device, system and storage medium for playing and interacting streaming media data
CN102196313B (en) Method and device for continuous playing of cross-platform breakpoint as well as method and device for continuous playing of breakpoint
US8839309B2 (en) Methods and systems for displaying contextually relevant information from a plurality of users in real-time regarding a media asset
CN101256568B (en) Method, system and apparatus for providing multimedia resource
JP2014518048A (en) Mechanism for embedding metadata in video and broadcast television
WO2021114845A1 (en) Interactive service processing method, system and device, and storage medium
WO2016053370A1 (en) Methods and apparatus to measure exposure to streaming media
CN103166681A (en) Information transmission method and system in short-distance scene
US10909174B1 (en) State detection of live feed
CN103688553A (en) Using a closed caption stream for device metadata
US11234029B2 (en) Methods and apparatus to generate reference signatures from streaming media
US20170187837A1 (en) Ad download method, the client and the server
CN113038153B (en) Financial live broadcast violation detection method, device, equipment and readable storage medium
WO2016050113A1 (en) Service implementation method and device and storage medium
CN112995698A (en) Video playing method, client, service platform and intelligent conference system
CN113571048B (en) Audio data detection method, device, equipment and readable storage medium
US11936705B2 (en) Systems and methods for providing audio-video streams with alternative content
CN114139491A (en) Data processing method, device and storage medium
CN106937127B (en) Display method and system for intelligent search preparation
CN108023856B (en) Information sharing method and device
CN113225570B (en) Playing processing method based on global virtual data view and related equipment
CN109587517B (en) Multimedia file playing method and device, server and storage medium
US20180176631A1 (en) Methods and systems for providing an interactive second screen experience

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: Room 301, building D, Hongwei Industrial Zone, No.6 Liuxian 3rd road, Xingdong community, Xin'an street, Bao'an District, Shenzhen City, Guangdong Province

Applicant after: Shenzhen Yingshuo Intelligent Technology Co.,Ltd.

Address before: Room 301, building D, Hongwei Industrial Zone, No.6 Liuxian 3rd road, Xingdong community, Xin'an street, Bao'an District, Shenzhen City, Guangdong Province

Applicant before: Shenzhen YINGSHUO Education Service Co.,Ltd.

CB02 Change of applicant information
GR01 Patent grant
GR01 Patent grant