CN109769138B - Audio and video recognition system based on Internet - Google Patents
Audio and video recognition system based on Internet Download PDFInfo
- Publication number
- CN109769138B CN109769138B CN201910162655.1A CN201910162655A CN109769138B CN 109769138 B CN109769138 B CN 109769138B CN 201910162655 A CN201910162655 A CN 201910162655A CN 109769138 B CN109769138 B CN 109769138B
- Authority
- CN
- China
- Prior art keywords
- video
- module
- audio
- playing
- protocol
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4334—Recording operations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44204—Monitoring of content usage, e.g. the number of times a movie has been viewed, copied or the amount which has been watched
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/4508—Management of client data or end-user data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
- H04N21/6437—Real-time Transport Protocol [RTP]
Abstract
The invention discloses an internet-based audio and video identification system, which comprises a data acquisition module, a data playing module, a video monitoring module, a video storage module, a video retrieval module and a video statistics module, wherein the data acquisition module is used for acquiring audio and video data; the data acquisition module is connected with the data playing module and comprises an audio and video extraction unit, a protocol analysis unit, a media decoding unit and a user management unit; the data playing module is respectively connected with the video monitoring module and the video storage module; the video storage module is respectively connected with the video retrieval module and the video statistics module. The method plays the acquired audio and video information through the video playing module, has a diversified playing mode, and improves the monotonicity of the video playing mode; the functions of video query and statistics can be increased by storing, retrieving and counting the audio and video; through the video monitoring module, the audio and video programs transmitted by the internet can be monitored, and the management of the audio and video contents is improved.
Description
The present application is a divisional application of the following applications: the invention relates to an internet-based audio and video identification system and a method thereof, wherein the application date is 2016, 12 and 12 months, and the application number is 201611137782.9.
Technical Field
The invention belongs to the technical field of internet, relates to an audio and video identification method, and particularly relates to an audio and video identification system based on the internet.
Background
Along with the increasing popularization of the Internet, more and more audios and videos are published on the Internet, the domestic websites represent online video websites such as a heat network, a potato network, a Tencent video network and the like, the video websites provide service items such as video on demand, audio on demand, MTV playing, music playing and the like for users, the rise of the Internet audio and video websites enables the personalized requirements of the users to be fully met, the audio and video playing programs not only improve the life pleasure of people, but also increase the knowledge of people, and the supervision difficulty is brought while massive audio and video programs are uploaded and shared.
At present, the main internet audio and video identification mostly adopts a search engine mode, namely, a searcher is used for capturing web pages of audio and video programs on the internet, an index database of the programs is established through the operation of the search engine, a user searches information meeting the requirements of the user in the program search database and plays the information, and the internet audio and video identification method adopting the search engine mode can obtain a large number of audio and video web pages by using smaller network resources, but cannot monitor audio and video data transmitted by the internet in real time.
Disclosure of Invention
The invention aims to provide an internet-based audio and video identification system, which analyzes and decodes the protocols of audio and video through a data acquisition module, so that a video playing module can play audio and video with different protocols, and the problem that the audio and video information in internet transmission data streams cannot be monitored in real time is solved by monitoring the played audio and video information through a video monitoring module.
The purpose of the invention can be realized by the following technical scheme:
the audio and video identification system based on the Internet comprises a data acquisition module, a data playing module, a video monitoring module, a video storage module, a video retrieval module and a video statistics module;
the data acquisition module is connected with the data playing module and comprises an audio and video extraction unit, a protocol analysis unit, a media decoding unit and a user management unit, wherein the audio and video extraction unit is used for extracting a transmission protocol of the played audio and video and sending the extracted transmission protocol to the protocol analysis unit; the protocol analysis unit is used for analyzing the transmission protocol of the received audio and video information; the media decoding unit is used for decoding the protocol of the received audio and video information; the user management unit is used for managing the credit of the user;
the data playing module is respectively connected with the video monitoring module and the video storage module, and is used for playing the audio and video stored in the video storage module according to the division of each protocol;
the video monitoring module is used for monitoring the played audio and video information in real time and storing the monitored audio and video information to the video storage module;
the video storage module is respectively connected with the video retrieval module and the video statistics module and is used for storing the acquired audio and video information;
the video retrieval module is used for screening the audio and video information stored in the video storage module;
the video counting module is used for counting the audios and videos stored in the video storage module under each protocol and counting the quantity of all the audios and videos in the video storage module.
Furthermore, the user management unit comprises user registration, user login, inquiry and editing, and is used for identity registration of the user, verifying the identity of a registrant after successful registration, inquiring the authority of the user and editing audio and video contents in the authority range.
Furthermore, the playing modes of the video playing module include random playing, alternate playing and repeated playing.
Further, the types of protocols are TP, UDP, TCP, HTTP and RTP protocols.
An internet-based audio and video recognition method comprises the following steps:
s1, acquiring a data packet of the network;
s2, the protocol analysis unit analyzes and judges the acquired protocol;
s3, if the data packets are valid, sequencing the audio and video information according to the size of the acquired data packets; if the obtained data packet is an invalid data packet, no sequencing processing is carried out;
s4, storing the effective audio and video;
s5, carrying out statistical analysis on the audio and video quantity of different protocol packets in the audio and video storage module every 10S, and updating the user information of the online client every 30S;
s6, sending the audio and video data packet to a user client, and buffering the received audio and video by the client;
s7, selecting an audio and video playing mode at the client by the user;
and S8, after the audio and video playing is finished, sending a finishing instruction to the client, and selecting to play a new audio and video or pause by the client.
The invention has the beneficial effects that: according to the invention, different protocols of the audio and video can be analyzed through the data acquisition module, and the protocols can be decoded, so that the audio and video of different protocols can be played at the client of the user; the video playing module can play the acquired audio and video information, and has a sequential, random and repeated diversified playing mode, so that the monotonicity of the video playing mode is improved; the functions of video query and statistics can be increased by storing, retrieving and counting the audio and video; through the video monitoring module, the audio and video programs transmitted by the internet can be monitored, and the management of the audio and video contents is improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a diagram of an internet-based audio and video recognition system according to the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, the invention relates to an internet-based audio/video recognition system, which comprises a data acquisition module, a data playing module, a video monitoring module, a video storage module, a video retrieval module and a video statistics module;
the data acquisition module is connected with the data playing module and comprises an audio and video extraction unit, a protocol analysis unit, a media decoding unit and a user management unit, wherein the audio and video extraction unit is used for extracting a transmission protocol of the played audio and video and sending the extracted audio and video protocol to the protocol analysis unit; the protocol analysis unit is used for analyzing the transmission protocol of the received audio and video information, ensuring that different protocols can be disclosed, and simultaneously sending the analysis result to the media decoding unit; the media decoding unit is used for decoding the protocol of the received audio and video information; the user management unit is used for managing the information of the user, and the managed content comprises user registration and login, inquiry and editing, wherein the user registration and login is used for identity registration of the user, after the registration is successful, the identity of a registrant is verified, and meanwhile, the user authority can be inquired and the audio and video content which can be collected in the user authority range can be edited.
The data playing module is respectively connected with the video monitoring module and the video storage module, and is used for playing the audio and video stored in the video storage module according to the division of each protocol, and the playing adopts the modes of random playing, alternate playing and repeated playing;
the video monitoring module is used for monitoring the played audio and video information in real time and storing the monitored audio and video information to the video storage module;
the video storage module is respectively connected with the video retrieval module and the video statistics module, and is used for storing the acquired audio and video information and dividing the stored audio and video according to the types of protocols, wherein the stored audio and video comprises TP, UDP, TCP, HTTP and RTP protocols;
the video retrieval module is used for screening the audio and video information stored in the video storage module;
the video counting module is used for counting the audios and videos under each protocol stored in the video storage module and counting the quantity of all the audios and videos in the video storage module.
An audio and video recognition method based on the Internet comprises the following steps:
s1, acquiring a data packet of the network;
s2, the protocol analysis unit analyzes and judges the acquired protocol;
s3, if the data packets are valid, sequencing the audio and video information according to the size of the acquired data packets; if the obtained data packet is an invalid data packet, no sequencing processing is carried out;
s4, storing the effective audio and video;
s5, carrying out statistical analysis on the audio and video quantity of different protocol packets in the audio and video storage module every 10S, and updating the user information of the online client every 30S;
s6, sending the audio and video data packet to a user client, and buffering the received audio and video by the client;
s7, selecting an audio and video playing mode at the client by the user;
and S8, after one of the audios and videos is played, sending a completion instruction to the client, and selecting to play a new audio and video or pause by the client.
And for different time when any audio/video data packet is sent to the user client, buffering is performed according to the arrival time, so that the problem of poor playing fluency caused by directly playing the audio/video information is avoided.
According to the invention, different protocols of the audio and video can be analyzed through the data acquisition module, and the protocols can be decoded, so that the audio and video of different protocols can be played at the client of the user; the video playing module can play the acquired audio and video information, and has a sequential, random and repeated diversified playing mode, so that the monotonicity of the video playing mode is improved; the functions of video query and statistics can be increased by storing, retrieving and counting the audio and video; through the video monitoring module, the audio and video programs transmitted by the internet can be monitored, and the management of the audio and video contents is improved.
The foregoing is merely exemplary and illustrative of the principles of the present invention and various modifications, additions and substitutions of the specific embodiments described herein may be made by those skilled in the art without departing from the principles of the present invention or exceeding the scope of the claims set forth herein.
Claims (1)
1. Audio and video identification system based on internet its characterized in that: the system comprises a data acquisition module, a data playing module, a video monitoring module, a video storage module, a video retrieval module and a video counting module;
the data acquisition module is connected with the data playing module and comprises an audio and video extraction unit, a protocol analysis unit, a media decoding unit and a user management unit, wherein the audio and video extraction unit is used for extracting a transmission protocol of the played audio and video and sending the extracted transmission protocol to the protocol analysis unit; the protocol analysis unit is used for analyzing the transmission protocol of the received audio and video information; the media decoding unit is used for decoding the protocol of the received audio and video information; the user management unit is used for managing the information of the user, and the managed content comprises user registration and login, inquiry and editing, wherein the user registration and login is used for carrying out identity registration on the user;
the data playing module is respectively connected with the video monitoring module and the video storage module, and is used for playing the audio and video stored in the video storage module according to the division of each protocol, and the playing modes comprise random playing, alternate playing and repeated playing;
the video monitoring module is used for monitoring the played audio and video information in real time and storing the monitored audio and video information to the video storage module;
the video storage module is respectively connected with the video retrieval module and the video statistics module and is used for storing the acquired audio and video information;
the video retrieval module is used for screening the audio and video information stored in the video storage module;
the video counting module is used for counting the audio and video under each protocol stored in the video storage module and counting the quantity of all the audio and video in the video storage module, and the types of the protocols comprise TP, UDP, TCP, HTTP and RTP protocols.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910162655.1A CN109769138B (en) | 2016-12-12 | 2016-12-12 | Audio and video recognition system based on Internet |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910162655.1A CN109769138B (en) | 2016-12-12 | 2016-12-12 | Audio and video recognition system based on Internet |
| CN201611137782.9A CN106535006B (en) | 2016-12-12 | 2016-12-12 | A kind of audio-video identifying system Internet-based and its method |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611137782.9A Division CN106535006B (en) | 2016-12-12 | 2016-12-12 | A kind of audio-video identifying system Internet-based and its method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109769138A CN109769138A (en) | 2019-05-17 |
| CN109769138B true CN109769138B (en) | 2021-11-12 |
Family
ID=58343056
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611137782.9A Active CN106535006B (en) | 2016-12-12 | 2016-12-12 | A kind of audio-video identifying system Internet-based and its method |
| CN201910162655.1A Active CN109769138B (en) | 2016-12-12 | 2016-12-12 | Audio and video recognition system based on Internet |
Family Applications Before (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611137782.9A Active CN106535006B (en) | 2016-12-12 | 2016-12-12 | A kind of audio-video identifying system Internet-based and its method |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN106535006B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112347334B (en) * | 2020-09-22 | 2023-05-23 | 中国科学院信息工程研究所 | Active-passive combination-based audio and video website user entry identification method and system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101394408A (en) * | 2008-10-15 | 2009-03-25 | 中山大学 | Protocol managing system used for digital video monitoring system |
| CN102223260A (en) * | 2010-04-19 | 2011-10-19 | 中国移动通信集团重庆有限公司 | Method, system and device for testing transmission quality of IPTV (Internet Protocol Television) video data streams |
| CN102244813A (en) * | 2011-06-24 | 2011-11-16 | 百视通网络电视技术发展有限责任公司 | Video playing method and internet television terminal applying same |
| CN102638727A (en) * | 2012-04-20 | 2012-08-15 | 江苏奇异点网络有限公司 | Website video player system |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030099200A1 (en) * | 2001-11-27 | 2003-05-29 | Amplify.Net, Inc. | Parallel limit checking in a hierarchical network for bandwidth management traffic-shaping cell |
| US7487116B2 (en) * | 2005-12-01 | 2009-02-03 | International Business Machines Corporation | Consumer representation rendering with selected merchandise |
| US20080178230A1 (en) * | 2006-12-05 | 2008-07-24 | Crackle, Inc. | Video sharing platform providing for public and private sharing and distributed downloads of videos |
| JP4943513B2 (en) * | 2006-12-20 | 2012-05-30 | トムソン リサーチ ファンディング コーポレイション | Video data loss recovery system using low bit rate stream of IPTV |
| EP2250749A2 (en) * | 2008-02-05 | 2010-11-17 | StratosAudio, Inc. | Systems, methods, and devices for scanning broadcasts |
| CN101895750B (en) * | 2010-07-13 | 2012-05-30 | 上海未来宽带技术及应用工程研究中心有限公司 | Set-top box and PC-oriented real-time streaming media server and working method |
| CN101938626B (en) * | 2010-09-15 | 2013-10-30 | 杭州海康威视数字技术股份有限公司 | Video session terminal, system, and method |
-
2016
- 2016-12-12 CN CN201611137782.9A patent/CN106535006B/en active Active
- 2016-12-12 CN CN201910162655.1A patent/CN109769138B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101394408A (en) * | 2008-10-15 | 2009-03-25 | 中山大学 | Protocol managing system used for digital video monitoring system |
| CN102223260A (en) * | 2010-04-19 | 2011-10-19 | 中国移动通信集团重庆有限公司 | Method, system and device for testing transmission quality of IPTV (Internet Protocol Television) video data streams |
| CN102244813A (en) * | 2011-06-24 | 2011-11-16 | 百视通网络电视技术发展有限责任公司 | Video playing method and internet television terminal applying same |
| CN102638727A (en) * | 2012-04-20 | 2012-08-15 | 江苏奇异点网络有限公司 | Website video player system |
Non-Patent Citations (1)
| Title |
|---|
| 网络视频监控服务器的设计与实现;窦心春;《中国优秀硕士学位论文全文数据库 信息科技辑》;20150415(第4期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106535006B (en) | 2019-04-09 |
| CN109769138A (en) | 2019-05-17 |
| CN106535006A (en) | 2017-03-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101728122B1 (en) | Method for recommending users in social network and the system thereof | |
| CN105230035B (en) | The processing of the social media of time shift multimedia content for selection | |
| CN104918066B (en) | Verifying video content method and system | |
| CN103686231B (en) | Method and system for integrated management, failure replacement and continuous playing of film | |
| CN105095211B (en) | The acquisition methods and device of multi-medium data | |
| CN101517550B (en) | Social and interactive applications for mass media | |
| CN106415546B (en) | For the system and method in local detection institute consumer video content | |
| US20090271524A1 (en) | Associating User Comments to Events Presented in a Media Stream | |
| KR20140138804A (en) | Enhancing live broadcast viewing through display of filtered internet information streams | |
| CN104615627B (en) | A kind of event public feelings information extracting method and system based on microblog | |
| CN101540874A (en) | Interactive TV program recommendation method based on collaborative filtration | |
| CN103165151B (en) | Method for broadcasting multimedia file and device | |
| CN103442290A (en) | Information providing method and system based on television terminal users and voices | |
| KR101541495B1 (en) | Apparatus, method and computer readable recording medium for analyzing a video using the image captured from the video | |
| US9294796B2 (en) | Inserting personalized information into digital content | |
| CN106303591B (en) | A kind of video recommendation method and device | |
| Mujtaba et al. | Client-driven personalized trailer framework using thumbnail containers | |
| CN109769138B (en) | Audio and video recognition system based on Internet | |
| CN107172178B (en) | A kind of content delivery method and device | |
| CN106791961B (en) | Video preference information processing method, device and system | |
| CN106027673B (en) | The control and training method, device that resource pushes in advance | |
| CN114139491A (en) | Data processing method, device and storage medium | |
| TWI526059B (en) | An apparatus and method for selecting clips | |
| CN103227942A (en) | Intelligent authorization method for digital television | |
| CN115866280A (en) | Live webcast user behavior analysis method, device and equipment based on big data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20211026 Address after: 250000 Room 502, building 3, science and Technology Industrial Park, Shandong University, No. 2600, Yingxiu Road, Jinan area, pilot Free Trade Zone, Jinan, Shandong Province Applicant after: Shandong Yuanlian Information Technology Co.,Ltd. Address before: Room 506, 5 / F, building 9, 972 Moganshan Road, Gongshu District, Hangzhou City, Zhejiang Province 310000 Applicant before: HANGZHOU HONGSHENG INFORMATION TECHNOLOGY Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |