CN109067777B - Hadoop-based mobile terminal video-on-demand system - Google Patents
Hadoop-based mobile terminal video-on-demand system Download PDFInfo
- Publication number
- CN109067777B CN109067777B CN201811071189.8A CN201811071189A CN109067777B CN 109067777 B CN109067777 B CN 109067777B CN 201811071189 A CN201811071189 A CN 201811071189A CN 109067777 B CN109067777 B CN 109067777B
- Authority
- CN
- China
- Prior art keywords
- module
- video
- file
- streaming media
- hadoop
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
- H04L65/612—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for unicast
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/2866—Architectures; Arrangements
- H04L67/2871—Implementation details of single intermediate entities
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention relates to the technical field of video processing, in particular to a hadoop-based mobile end video-on-demand system. The system comprises a mobile client, a Servlet streaming media server, a Webmanage management module, a Webservice system module and a Hadoop distribution storage module, wherein the Hadoop distribution storage module comprises an HSFS file module and a Fuse module; the hadoop-based mobile end video-on-demand system can solve the problem that the current mobile end cannot smoothly play video files based on the hadoop storage technology.
Description
Technical Field
The invention relates to the technical field of video processing, in particular to a hadoop-based mobile end video-on-demand system.
Background
With the continuous progress of scientific technology and the continuous development of network technology, video on demand has become an emerging multimedia network service, and has become an indispensable part of the life of people in both learning, life and daily entertainment, so that the video on demand brings great visual and auditory enjoyment to people, meets the requirements of people on videos, and is widely applied in the world. However, the video-on-demand system has a high requirement on storage, so generally, a Hadoop distributed file storage system is preferred to establish a Hadoop cluster to store massive video files.
The Chinese patent granted publication No. CN207124647U is named as a video on demand system based on a hodoop and Red5, and is a system for sharing and learning online education videos based on a Hadoop cloud service platform, wherein the video on demand function developed based on an HDFS storage system and a Red5 streaming media server is used. However, since the previous video stream playing is based on red5 and the RTMP Protocol, but the mobile phone does not support the jwPlayer player to play the Real Time Messaging Protocol (RTMP) stream, and if the red5 needs to play the RTMP stream, the current player can only be used with the jwPlayer, the reason mentioned above causes that the existing video can only be played on the PC side.
At present, the larger the requirement of a mobile client such as a mobile phone end for playing videos is, the video software developed based on the hadoop technology cannot well request videos at the mobile end at present.
Disclosure of Invention
The invention aims to: aiming at the problems in the background art, the hadoop-based mobile end video-on-demand system is provided, and the problem that the current mobile end cannot smoothly play video files based on the hadoop storage technology can be solved.
In order to achieve the purpose, the technical scheme adopted by the invention is as follows:
a mobile end video on demand system based on Hadoop comprises a mobile client, a Servlet streaming media server, a Webmanage management module, a Webservice system module and a Hadoop distribution storage module, wherein the Hadoop distribution storage module comprises an HDFS file module and a Fuse module;
the mobile client: the server is used for sending a video playing request, receiving query feedback information returned by the Webmanage management module, receiving a streaming media file transmitted by the Servlet streaming media server and playing the streaming media file;
the Webmanage management module: responding to a video playing request of the mobile client, transmitting the video playing request to a Webservice system module, and transmitting query feedback information returned by the Webservice system module to the mobile client;
the Webservice system module: receiving a video playing request transmitted by the Webmanage management module, accessing the HDFS file module, performing identity authentication, and returning query feedback information to the Webmanage management module, wherein the query feedback information comprises the following items: when the identity is verified and the request video exists in the HDFS file module, an encrypted playing path is returned, when the identity is verified but the request video does not exist in the HDFS file module, a video file absence prompt is returned, and an unauthorized playing prompt is not returned through identity authentication;
the Servlet streaming media server: calling an encrypted playing path of the mobile client, decrypting the encrypted playing path, accessing a Fuse module to obtain a video file, converting the video file into a streaming media file, caching the streaming media file, and transmitting the streaming media file to the mobile client;
the Hadoop distribution storage module is: the HDFS file module is used for storing media files and user information files, and the Fuse module is used for transmitting the files in the HDFS file module to the Servlet streaming media server to convert the files into streaming media files.
Preferably, the player of the mobile client is a chplayer.
Preferably, the Servlet streaming media server is developed based on RESTFul API, and includes a buffer area for buffering the video file.
Further preferably, the Servlet streaming media server is developed based on a Hadoop API, and includes a controller package module and a files module, where the controller package module is configured to access the HDFS file module and decrypt the encrypted playback path and convert the video file into a streaming media file, and the files module is configured to obtain the encrypted playback path and provide a decryption tool for decryption.
Further preferably, the Webservice system module packages the operation data into a client method and provides the client method to the webmanagement module, and the webmanagement module packages the client method into an RESTFul API interface.
Preferably, the RESTFul API interface is configured to affect the video playing request of the client.
Preferably, the mobile client is a mobile phone client.
In summary, due to the adoption of the technical scheme, the invention has the beneficial effects that:
the system uses the webservice system module as a middleware to perform access control and identity authentication of the HDFS of the user; the Servlet streaming media server is used for converting the video file stored on the Hadoop distribution storage module into streaming media, buffer buffering is carried out, the streaming media is directly returned to the mobile client in a streaming mode, and the mobile client can play the video file by using a plug-in supporting more platforms. The mobile client has low requirement on playing plug-ins, the browser can play as long as the browser supports HTML5 and flash plug-ins, a large number of Open-source Player plug-ins exist on the network, and many Open-source Player plug-ins supporting HTML5 and flash can be selected according to personal preferences, but the playing plug-ins of the chplayer are selected in consideration of user experience problems, such as Open Standard Media (OSM) Player, Dailymotion HTML5 Video, FryPlayer and the like. The problem that the video file cannot be played or cannot be smoothly played at the mobile client side based on the hadoop storage technology at present is well solved.
The Webservice system module provides a client method for the Webmanager management module to package externally, the Webmanager management module packages the client method into an RESTFul API interface, the RESTFul API interface is provided for the mobile client, the mobile client can communicate with the Webmanager management module by using the ajax request, and the method is efficient and quick in information transmission response.
Drawings
Fig. 1 is a structural frame diagram of a hadoop-based mobile video-on-demand system according to a preferred embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, a Hadoop-based mobile-end video-on-demand system includes a mobile client 10, a Servlet streaming media server 50, a Webmanage management module 20, a Webservice system module 30, and a Hadoop distribution storage module 40, where the Hadoop distribution storage module 40 includes an HDFS file module 401 and a Fuse module 402;
the mobile client 10 is configured to send a video playing request, receive query feedback information returned by the webmanager management module 20, receive a streaming media file transmitted by the Servlet streaming media server 50, and play the streaming media file;
the Webmanage management module 20 responds to the video playing request of the mobile client and transmits the video playing request to the Webservice system module 30, and transmits query feedback information returned by the Webservice system module 30 to the mobile client 10;
the Webservice system module 30 receives the video playing request transmitted by the webmanager management module 20, accesses the HDFS file module 402, performs identity authentication, and returns query feedback information to the webmanager management module 20. The returned query feedback information includes the following conditions: when the identity is verified and the request video exists in the HDFS file module 402, an encrypted playing path is returned, when the identity is verified but the request video does not exist in the HDFS file module 402, a video file prompt is returned, and an unauthorized playing prompt is not returned through identity authentication;
the Servlet streaming media server 50 calls an encrypted playing path of the mobile client 10 based on RESTFul API interface development, decrypts the encrypted playing path, accesses the Fuse module 401 to acquire a video file and converts the video file into a streaming media file, caches the streaming media file and transmits the streaming media file to the mobile client 10;
the HDFS file module 402 in the Hadoop distribution storage module 40 is configured to store a media file and a user information file, and the Fuse module 401 is configured to transmit the file in the HDFS file module 402 to the Servlet streaming media server 50 to convert the file into a streaming media file.
Preferably, the Servlet streaming media server 50 is developed based on a Hadoop API, and includes a controller package module 501 and an utils module 502, where the controller package module 501 is configured to access the HDFS file module 402 and decrypt an encrypted playing path and convert a video file into a streaming media file, and the utils module 502 is configured to obtain the encrypted playing path and provide a decryption tool for decryption.
The Webservice system module 30 packages the operation data into a client method, and provides the client method to the webmanagement module 20, and the webmanagement module packages the client method into an RESTFul API interface. The RESTFul API interface is used to influence the video playing request of the client 10. The Servlet streaming server 50 includes a buffer for buffering video files.
In this embodiment, the player of the mobile client 10 is a chplayer. The mobile client is a mobile phone client.
The working flow of the embodiment is as follows:
the mobile client 10 sends a video playing request, the Webservice management module 20 responds to the video playing request of the mobile client and transmits the video playing request to the Webservice system module 30, and the Webservice system module 30 receives the video playing request transmitted by the Webservice management module 20, accesses the HDFS file module 402, performs identity authentication and then returns query feedback information to the Webservice management module 20. The webmanagement module 20 receives and delivers the query feedback information to the mobile client 10. The returned query feedback information includes the following conditions: and returning an encrypted playing path when the identity is verified and the requested video exists in the HDFS file module 402, returning a video file prompt when the identity is verified but the requested video does not exist in the HDFS file module 402, and not returning a no-permission playing prompt through identity authentication.
If the query feedback information is an encrypted playing path, the Servlet streaming media server 50 calls the encrypted playing path of the mobile client 10, decrypts the encrypted playing path, accesses the Fuse module 401 to acquire a video file and converts the video file into a streaming media file, caches the streaming media file and transmits the streaming media file to the mobile client 10; the mobile client 10 receives the streaming media file transmitted by the Servlet streaming server 50 and plays the file.
The above description is intended to describe in detail the preferred embodiments of the present invention, but the embodiments are not intended to limit the scope of the claims of the present invention, and all equivalent changes and modifications made within the technical spirit of the present invention should fall within the scope of the claims of the present invention.
Claims (5)
1. A mobile end video-on-demand system based on Hadoop is characterized by comprising a mobile client, a Servlet streaming media server, a Webmanage management module, a Webservice system module and a Hadoop distribution storage module, wherein the Hadoop distribution storage module comprises an HDFS file module and a Fuse module;
the mobile client: the server is used for sending a video playing request, receiving query feedback information returned by the Webmanage management module, receiving a streaming media file transmitted by the Servlet streaming media server and playing the streaming media file;
the Webmanage management module: responding to a video playing request of the mobile client, transmitting the video playing request to a Webservice system module, and transmitting query feedback information returned by the Webservice system module to the mobile client;
the Webservice system module: receiving a video playing request transmitted by the Webmanage management module, accessing the HDFS file module, performing identity authentication, and returning query feedback information to the Webmanage management module, wherein the query feedback information comprises the following items: when the identity is verified and the request video exists in the HDFS file module, an encrypted playing path is returned, when the identity is verified but the request video does not exist in the HDFS file module, a video file absence prompt is returned, and an unauthorized playing prompt is not returned through identity authentication; the Webservice system module separates video playing service and identity authentication service by adopting a tangent-oriented aop technology and Threadlocal multithreading; the Webservice system module packages the operation data into a client method and provides the client method to the Webmanager management module, and the Webmanager management module packages the client method into an RESTFul API interface;
the Servlet streaming media server: calling an encrypted playing path of the mobile client, decrypting the encrypted playing path, accessing a Fuse module to obtain a video file, converting the video file into a streaming media file, caching the streaming media file, and transmitting the streaming media file to the mobile client; the Servlet streaming media server comprises a controller packet module and an utils module, wherein the controller packet module is used for accessing the HDFS file module, decrypting the encrypted playing path and converting the video file into a streaming media file, and the utils module is used for obtaining the encrypted playing path and providing a decryption tool for decryption;
the Hadoop distribution storage module is: the HDFS file module is used for storing media files and user information files, and the Fuse module is used for transmitting the files in the HDFS file module to the Servlet streaming media server to convert the files into streaming media files.
2. The hadoop-based mobile-end video-on-demand system according to claim 1, wherein the player of the mobile client is a chplayer.
3. The hadoop-based mobile-end video-on-demand system according to claim 1, wherein the Servlet streaming media server is developed based on RESTFul API interface and comprises a buffer for buffering video files.
4. The hadoop-based mobile video-on-demand system according to claim 1, wherein the RESTFul API interface is configured to affect the video playing request of the client.
5. The hadoop-based mobile-end video-on-demand system according to claim 1, wherein the mobile client is a mobile phone client.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811071189.8A CN109067777B (en) | 2018-09-14 | 2018-09-14 | Hadoop-based mobile terminal video-on-demand system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811071189.8A CN109067777B (en) | 2018-09-14 | 2018-09-14 | Hadoop-based mobile terminal video-on-demand system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109067777A CN109067777A (en) | 2018-12-21 |
| CN109067777B true CN109067777B (en) | 2021-09-03 |
Family
ID=64761576
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811071189.8A Active CN109067777B (en) | 2018-09-14 | 2018-09-14 | Hadoop-based mobile terminal video-on-demand system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109067777B (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105187855A (en) * | 2015-07-14 | 2015-12-23 | 中国科学院信息工程研究所 | Video-on-demand system based on Hadoop and Red5 and method |
| CN105979273A (en) * | 2016-05-06 | 2016-09-28 | 苏州清云网络科技有限公司 | Cloud monitor and cloud operation of intelligent commercial TVs based on big data and cloud computation |
| CN107104986A (en) * | 2017-06-13 | 2017-08-29 | 柳州市盛景科技有限公司 | A kind of video on-demand system based on hadoop and Red5 |
| CN107566852A (en) * | 2017-09-19 | 2018-01-09 | 苏州耀马影视制作有限公司 | A kind of Educational VOD System based on Web |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101568063B1 (en) * | 2013-11-06 | 2015-11-10 | 건국대학교 산학협력단 | Method for transcoding mutimedia, and hadoop-based mulimedia transcoding system operating the same |
-
2018
- 2018-09-14 CN CN201811071189.8A patent/CN109067777B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105187855A (en) * | 2015-07-14 | 2015-12-23 | 中国科学院信息工程研究所 | Video-on-demand system based on Hadoop and Red5 and method |
| CN105979273A (en) * | 2016-05-06 | 2016-09-28 | 苏州清云网络科技有限公司 | Cloud monitor and cloud operation of intelligent commercial TVs based on big data and cloud computation |
| CN107104986A (en) * | 2017-06-13 | 2017-08-29 | 柳州市盛景科技有限公司 | A kind of video on-demand system based on hadoop and Red5 |
| CN107566852A (en) * | 2017-09-19 | 2018-01-09 | 苏州耀马影视制作有限公司 | A kind of Educational VOD System based on Web |
Non-Patent Citations (1)
| Title |
|---|
| 基于云平台的移动端视频播放系统的设计与实现;黄斌杰;《中国硕士学位论文全文数据库信息科技辑》;20150630;第2-4章 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109067777A (en) | 2018-12-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11665170B2 (en) | Systems and methods for connecting a public device to a private device with pre-installed content management applications | |
| US12075124B2 (en) | Systems and methods for real-time adaptive bitrate transcoding and transmission of transcoded media | |
| CN109906107B (en) | Cloud game based on browser | |
| US8645504B2 (en) | Dynamic chunking for delivery instances | |
| CN104396263B (en) | For the method and system of the real-time multiplexing transformation of streaming content | |
| CN106254900B (en) | System and method for automatically generating top index file | |
| CA2988320C (en) | Http live streaming (hls) video client synchronization | |
| US11153323B2 (en) | Systems and methods for connecting a public device to a private device using mirroring applications | |
| US20130080268A1 (en) | Multi-platform media syndication customization | |
| US20130080579A1 (en) | Dynamically-executed syndication services | |
| US20120028712A1 (en) | Distributed cloud gaming method and system where interactivity and resources are securely shared among multiple users and networks | |
| US11153324B2 (en) | Systems and methods for connecting a public device to a private device without pre-installed content management applications | |
| CA2867161C (en) | Dynamic chunking for delivery instances | |
| CN111093094A (en) | Video transcoding method, device and system, electronic equipment and readable storage medium | |
| US11128739B2 (en) | Network-edge-deployed transcoding methods and systems for just-in-time transcoding of media data | |
| US10630692B2 (en) | Systems and methods for connecting a public device to a private device providing a pre-installed content management application | |
| US20170140443A1 (en) | Dynamic manifest generation for delivery instances | |
| US10750248B1 (en) | Method and apparatus for server-side content delivery network switching | |
| CN109167790B (en) | Hadoop-based cross-platform video-on-demand system | |
| CN109067777B (en) | Hadoop-based mobile terminal video-on-demand system | |
| JP6887382B2 (en) | Media distribution and management systems and equipment | |
| FR3068852A1 (en) | METHOD FOR MANAGING THE RIGHT OF ACCESS TO DIGITAL CONTENT | |
| CN208739148U (en) | A kind of mobile terminal video on-demand system based on hadoop | |
| EP3292698B1 (en) | Http live streaming (hls) video client synchronization | |
| US11870830B1 (en) | Embedded streaming content management |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP01 | Change in the name or title of a patent holder | ||
| CP01 | Change in the name or title of a patent holder |
Address after: 545000 No. 120, floor 2, building 2, No. 29, Xinliu Avenue, Liunan District, Liuzhou City, Guangxi Zhuang Autonomous Region Patentee after: Guangxi Jinyun Technology Co.,Ltd. Address before: 545000 No. 120, floor 2, building 2, No. 29, Xinliu Avenue, Liunan District, Liuzhou City, Guangxi Zhuang Autonomous Region Patentee before: GUANGXI BENYUN TECHNOLOGY Co.,Ltd. |