WO2022057469A1

WO2022057469A1 - Method and system for online playback and downloading prevention of web client audio, device, and medium

Info

Publication number: WO2022057469A1
Application number: PCT/CN2021/109611
Authority: WO
Inventors: 王凯
Original assignee: 苏州浪潮智能科技有限公司
Priority date: 2020-09-21
Filing date: 2021-07-30
Publication date: 2022-03-24
Also published as: CN112153042A

Abstract

Disclosed in the present invention is a method and system for the online playback and downloading prevention of a Web client audio, a device, and a medium. The method comprises: starting a websocket server at a server end, and establishing a communication connection between the websocket server and a browser; in response to receiving an audio playback request sent by the browser end, splitting, at the server end, an audio file to be played into a plurality of subaudio files according to the request; encoding the subaudio files to convert same into a binary file format suitable for streaming media transmission, and sending the encoded subaudio files to the browser end by means of the websocket server; and in response to the browser end receiving binary file streams transmitted by the websocket server, asynchronously decoding the binary file stream subaudio files and playing same. In the present invention, the websocket server is used to transmit the split audio files, thereby ensuring the security of the audio files.

Description

Method, system, device and medium for preventing download of online audio playback on web

This application claims to be submitted to the State Intellectual Property Office of China on September 21, 2020, the application number is 202010996328.9, and the title of the invention is "The method, system, device and medium for preventing download of audio online on the Web". The entire contents of which are incorporated herein by reference.

technical field

The present invention relates to the field of audio playback, and more particularly, to a method, system, computer equipment and computer for preventing download of audio online playing on a Web (World Wide Web, a global wide area network, a network service established on the Internet). Readable storage medium.

Background technique

With the development of online music services, more and more users install music playing software on mobile or computer devices. Most of these software use real-time streaming to complete the transmission of audio and video files. In terms of copyright protection, users can be restricted from malicious downloads through user permission verification and original file preservation strategies. But it requires the user to have software installed on the mobile or computer device to do so.

When users use browsers to play audio and video online, the usual practice is to use flash (a creation software that integrates animation creation and application development) and other technologies to achieve online playback. With the development of browsers, flash technology is gradually used by HTML5. (HyperText Markup Language 5, hypertext markup language, a language description method for building web content), but audio must specify the source file address of the audio file, which points to an audio file stored on the server. For files, the download function can be limited in the browser through certain technical solutions, but the user cannot see the download button and other operations, but those with certain technical capabilities can still view the browser's DOM (Document Object Model, document object). model) element or viewing the form of the audio cache file to obtain the complete original file of the audio, which is not conducive to copyright protection.

SUMMARY OF THE INVENTION

In view of this, the purpose of the embodiment of the present invention is to propose a method, system, computer equipment and computer-readable storage medium for preventing download of audio online on the Web side, by using the websocket server to transmit the divided audio file, so that the audio The source file will not be preset in the browser's DOM file through the audio tag, nor will the complete audio data file be stored in the browser's cache. Ordinary users and technicians cannot obtain the server address of the audio data file from the DOM. The original audio data file cannot be restored, thereby ensuring that the original audio file is not maliciously obtained by other persons, thereby achieving the purpose of protecting the audio copyright.

Based on the above purpose, one aspect of the embodiments of the present invention provides a method for preventing download of audio online on a Web side, including the following steps: starting a websocket server on a server side, and establishing a communication connection between the websocket server and a browser ; In response to receiving the audio playback request sent by the browser, at the server side, the audio file that needs to be played is divided into a plurality of sub-audio files according to the request; The sub-audio files are encoded to be converted to be suitable for streaming media The transmitted binary file format, and the encoded sub-audio file is sent to the browser through the websocket server; and in response to the browser receiving the binary file stream transmitted by the websocket server, to the browser A binary file streams sub-audio files for asynchronous decoding and playback.

In some embodiments, dividing the audio file that needs to be played on the server side into multiple sub-audio files according to the request includes: on the server side, according to the size of the audio file, the audio file is divided according to a predefined number of bytes. file is split.

In some implementation manners, sending the encoded sub-audio files to the browser through the websocket server includes: obtaining a predefined number of the sub-audio files from the websocket server each time to be used in the The browser side caches audio of a predefined length.

In some implementation manners, acquiring a predefined number of the sub-audio files from the websocket server each time to cache audio of a predefined length on the browser side includes: judging whether the total length of the audio is less than a first a threshold; and in response to the total length of the audio being less than the first threshold, obtaining all sub-audio files of the audio.

In some embodiments, acquiring a predefined number of the sub-audio files from the websocket server each time to cache audio of a predefined length on the browser side includes: determining the audio frequency according to the total length of the audio Predefining a length, and judging whether the predefined length is greater than a second threshold; and in response to the predefined length being greater than the second threshold, setting the predefined length to the second threshold.

In some embodiments, the method further includes: in response to the user changing the playback progress of the current audio on the browser side, recalculating the predefined length according to the new audio playback position selected by the user.

In some embodiments, the method further includes: judging whether the ratio of the current playback progress to the pre-defined length of this cache reaches a third threshold; and in response to the ratio of the current playback progress to the pre-defined length of this cache reaching the third threshold Three thresholds to get the next audio of a predefined length.

In another aspect of the embodiments of the present invention, there is also provided a system for preventing download of online audio playback on the Web side, including: a connection module, configured to enable a websocket server on the server side, and establish a connection between the websocket server and the browser. A communication connection; a splitting module, configured to split the audio file to be played into a plurality of sub-audio files on the server side according to the request in response to receiving an audio playback request sent by the browser; an encoding module, configured to Encoding the sub-audio file to convert it into a binary file format suitable for streaming media transmission, and sending the encoded sub-audio file to the browser through the websocket server; and a decoding module, configured for In response to the browser side receiving the binary file stream transmitted by the websocket server, the binary file stream sub-audio file is asynchronously decoded and played.

In yet another aspect of the embodiments of the present invention, there is also provided a computer device, comprising: at least one processor; and a memory, where the memory stores computer instructions that can be executed on the processor, and the instructions are executed by the processor. The processor implements the steps of the above method when executed.

In yet another aspect of the embodiments of the present invention, a computer-readable storage medium is also provided, where the computer-readable storage medium stores a computer program that implements the above method steps when executed by a processor.

The invention has the following beneficial technical effects: by using the websocket server to transmit the divided audio file, the audio source file will not be preset in the DOM file of the browser through the audio tag, nor will it be completely stored in the browser cache. Ordinary users and technical personnel cannot obtain the server address of the audio data file from the DOM, nor can they restore the original audio data file, thus ensuring that the original audio file is not maliciously obtained by other personnel, thus achieving the protection of audio Copyright purpose.

Description of drawings

In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the following briefly introduces the accompanying drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. For those of ordinary skill in the art, other embodiments can also be obtained according to these drawings without creative efforts.

Fig. 1 is a schematic diagram of an embodiment of a method for preventing downloading of audio online on a Web side provided by the present invention;

2 is a schematic diagram of the hardware structure of an embodiment of a computer device for preventing downloading of audio online on a Web side provided by the present invention;

3 is a schematic diagram of a computer-readable storage medium for preventing downloading of audio online on a Web side provided by the present invention;

FIG. 4 is a schematic structural diagram of a system for preventing downloading of audio online at the web end provided by the present invention.

detailed description

In order to make the objectives, technical solutions and advantages of the present invention more clearly understood, the embodiments of the present invention will be further described in detail below with reference to the specific embodiments and the accompanying drawings.

It should be noted that all expressions using "first" and "second" in the embodiments of the present invention are for the purpose of distinguishing two entities with the same name but not the same or non-identical parameters. It can be seen that "first" and "second" It is only for the convenience of expression and should not be construed as a limitation to the embodiments of the present invention, and subsequent embodiments will not describe them one by one.

Based on the above purpose, in a first aspect of the embodiments of the present invention, an embodiment of a method for preventing download of audio online at a web end is proposed. FIG. 1 shows a schematic diagram of an embodiment of a method for preventing downloading of audio online on a Web side provided by the present invention. As shown in Figure 1, the embodiment of the present invention includes the following steps:

S1. Open the websocket server on the server side, and establish a communication connection between the websocket server and the browser;

S2, in response to receiving the audio playback request sent by the browser, at the server side, the audio file to be played is divided into a plurality of sub-audio files according to the request;

S3. Encode the sub-audio file to convert it into a binary file format suitable for streaming media transmission, and send the encoded sub-audio file to the browser through the websocket server; and

S4. In response to the browser receiving the binary file stream transmitted by the websocket server, asynchronously decode and play the sub-audio file of the binary file stream.

Streaming Media technology refers to a technology that compresses a series of media data and transmits it in segments in a streaming manner to realize real-time transmission of video and audio on the network for viewing. Streaming media actually refers to a new media transmission method, including sound stream, video stream, text stream, image stream, animation stream, etc., rather than a new media. Streaming is a general term for technologies that transmit media (audio, video, etc.) over a network. There are two main ways to implement streaming: progressive streaming and real time streaming.

Open the websocket server on the server side, and establish a communication connection between the websocket server and the browser. The invention relies on the real-time streaming transmission mode in the streaming media transmission mode, and establishes a continuous and stable connection between the browser and the server through the websocket. The server side will enable the websocket server, the browser side will create a websocket connection through JavaScript, the server side will send the audio file data to be played to the websocket server, the browser side will monitor the created websocket connection, and when it receives the audio file sent by the server side data, perform the corresponding operation. WebSocket is a protocol for full-duplex communication over a single TCP (Transmission Control Protocol) connection. WebSocket makes data exchange between client and server easier, allowing the server to actively push data to the client. In the WebSocket API (Application Programming Interface), the browser and the server only need to complete a handshake once, and a persistent connection can be created directly between the two, and two-way data transmission can be performed.

In response to receiving the audio playback request sent by the browser, the server divides the audio file to be played into multiple sub-audio files according to the request. To ensure the stability and real-time performance of data transmission, the audio file can be divided into multiple sub-audio files for transmission.

In some embodiments, dividing the audio file that needs to be played on the server side into multiple sub-audio files according to the request includes: on the server side, according to the size of the audio file, the audio file is divided according to a predefined number of bytes. file is split. The server divides the audio file according to the total size of the audio file and according to the predefined number of bytes. The split audio file will not affect the normal playback of the audio, that is, to ensure that the audio file is not broken. Number of divided files = total file size / number of predefined bytes.

The sub-audio file is encoded to be converted into a binary file format suitable for streaming media transmission, and the encoded sub-audio file is sent to the browser through the websocket server. On the server side, the split audio file is encoded, and the encoded audio file format is a binary file stream, which meets the streaming media transmission requirements.

In response to the browser side receiving the binary file stream transmitted by the websocket server, it asynchronously decodes and plays the sub-audio file of the binary file stream. On the client (ie browser), the binary file stream sent from the server is received, and when it is detected that the transmission of a file stream is completed, the AudioContext.decodeAudioData() method provided by the Web Audio API (network audio interface) is called to decode the binary file. Streaming audio files for asynchronous decoding.

In some implementation manners, sending the encoded sub-audio files to the browser through the websocket server includes: obtaining a predefined number of the sub-audio files from the websocket server each time to be used in the The browser side caches audio of a predefined length. Since the audio playback of the browser depends on the network environment, the quality of the network status has a great impact on the audio playback quality and user experience, and it is not very good for the network environment, so pre-cache is required. Automatically detect the current audio playback progress. When the audio is loaded and played for the first time, a specified number of audio split files can be obtained from the server at one time, and the audio of a predefined length can be cached in the browser in advance.

In some implementation manners, acquiring a predefined number of the sub-audio files from the websocket server each time to cache audio of a predefined length on the browser side includes: judging whether the total length of the audio is less than a first a threshold; and in response to the total length of the audio being less than the first threshold, obtaining all sub-audio files of the audio. For example, the first threshold may be one minute, and when the total length of the audio is less than one minute, all sub-audio files of the audio file are acquired from the server at one time.

In some embodiments, acquiring a predefined number of the sub-audio files from the websocket server each time to cache audio of a predefined length on the browser side includes: determining the audio frequency according to the total length of the audio Predefining a length, and judging whether the predefined length is greater than a second threshold; and in response to the predefined length being greater than the second threshold, setting the predefined length to the second threshold. The predefined length can be calculated according to the total length of the audio, which is usually 20% of the total length of the audio. The second threshold can be, for example, five minutes. When the calculated predefined length is greater than five minutes, the predefined length is limited to five minutes. Calculate the percentage of the total audio length can be modified through the configuration file.

In some embodiments, the method further includes: in response to the user changing the playback progress of the current audio on the browser side, recalculating the predefined length according to the new audio playback position selected by the user. If the user changes the current audio playback progress on the browser side, that is, jumps to a certain time point in the audio to perform the playback action, the audio data file can be re-obtained from the server according to the audio playback position selected by the user, and the predefined length can be re-created. calculate. If the user jumps to a place that has been pre-cached, it can be played directly.

In some embodiments, the method further includes: judging whether the ratio of the current playback progress to the pre-defined length of this cache reaches a third threshold; and in response to the ratio of the current playback progress to the pre-defined length of this cache reaching the third threshold Three thresholds to get the next audio of a predefined length. For example, the third threshold may be 70%. When it is detected that the current playback progress accounts for 70% of the pre-defined length of the current cache, a data request is sent to the server, and the audio file of the pre-defined length is obtained again, and The obtained audio file is parsed and saved in the browser's cache (usually computer memory or temporary file directory), ready for continued playback. If the length of the remaining unplayed audio is less than the predefined length, the server transmits all the remaining unplayed audio data files to the browser.

The embodiment of the present invention relies on the real-time streaming transmission mode in the streaming media transmission mode, establishes a continuous and stable connection between the browser and the server through the websocket, and the server divides the audio file into sub-files according to the size of the audio file according to the specified bytes, When the browser initiates an audio playback request, the server encodes the segmented audio sub-file segments, and then pushes the encoded audio sub-file data to the browser. The browser receives the encoded audio file data and decodes the data. Operation, realize the playback of audio files by calling the Web Audio API. The present invention also includes audio pre-buffering technology, which ensures the real-time performance of audio playback and solves the problem of audio playback delay. By dividing and encoding the audio files, the present invention ensures that the audio source files are not directly accessed by the user, and the user cannot obtain the original audio files from the DOM elements of the web page or the browser cache, so as to achieve the real-time online playback of the audio and prevent downloading and protect the audio. Copyright purpose.

It should be particularly pointed out that the various steps in the various embodiments of the above-mentioned method for preventing downloading of audio online on the Web side can be crossed, replaced, added, and deleted. The method for preventing download by playing should also belong to the protection scope of the present invention, and the protection scope of the present invention should not be limited to the embodiments.

As shown in FIG. 4 , based on the above purpose, in a second aspect of the embodiments of the present invention, a system 500 for preventing download of online audio playback on the Web side is proposed, including: a connection module 501 configured to enable a websocket server on the server side , and establish a communication connection between the websocket server and the browser; the segmentation module 502 is configured to respond to receiving the audio playback request sent by the browser, at the server according to the request to play the audio that needs to be played The file is divided into a plurality of sub-audio files; the encoding module 504 is configured to encode the sub-audio files to be converted into a binary file format suitable for streaming media transmission, and use the websocket server to encode the encoded sub-audio files. and the decoding module 503 is configured to asynchronously decode and play the sub-audio files of the binary file stream in response to the browser side receiving the binary file stream transmitted by the websocket server.

In some embodiments, the splitting module 502 is configured to: split the audio file according to a predefined number of bytes on the server side according to the size of the audio file.

In some embodiments, the system further includes: a cache module configured to obtain a predefined number of the sub-audio files from the websocket server each time to cache audio of a predefined length on the browser side.

In some embodiments, the caching module is further configured to: determine whether the total length of the audio is less than a first threshold; and in response to the total length of the audio being less than the first threshold, acquire all sub-audio files of the audio.

In some embodiments, the caching module is further configured to: determine the predefined length according to the total length of the audio, and determine whether the predefined length is greater than a second threshold; and respond to the predefined length greater than a second threshold, the predefined length is set to the second threshold.

In some embodiments, the system further includes: a recalculation module configured to recalculate the predefined length according to the new audio playback position selected by the user in response to the user changing the playback progress of the current audio on the browser side.

In some embodiments, the system further includes: a judging module configured to judge whether the current playback progress accounts for the pre-defined length of the current cache and reaches a third threshold; When the ratio of the defined length reaches the third threshold, the next audio of the predefined length is obtained.

Based on the above objective, in a third aspect of the embodiments of the present invention, a computer device is provided, including: at least one processor; and a memory, where the memory stores computer instructions that can be executed on the processor, and the instructions are executed by the processor to The following steps are implemented: S1, open the websocket server on the server side, and establish a communication connection between the websocket server and the browser; S2, in response to receiving an audio playback request sent by the browser side, the server side will play according to the request. The audio file is divided into multiple sub-audio files; S3, encode the sub-audio file to convert it into a binary file format suitable for streaming media transmission, and send the encoded sub-audio file to the browser through the websocket server; and S4, respond On the browser side, the binary file stream transmitted by the websocket server is received, and the sub-audio file of the binary file stream is asynchronously decoded and played.

In some embodiments, the step further includes: in response to the user changing the playback progress of the current audio on the browser side, recalculating the predefined length according to the new audio playback position selected by the user.

In some embodiments, the steps further include: judging whether the ratio of the current playback progress to the pre-defined length of this cache reaches a third threshold; and in response to the ratio of the current playback progress to the pre-defined length of this cache reaching the third threshold Three thresholds to get the next audio of a predefined length.

As shown in Figure 2, it is a schematic diagram of the hardware structure of an embodiment of the computer device provided by the present invention for the above-mentioned Web-side audio online playback to prevent downloading.

Taking the device shown in FIG. 2 as an example, the device includes a processor 301 and a memory 302 , and may further include an input device 303 and an output device 304 .

The processor 301 , the memory 302 , the input device 303 and the output device 304 may be connected by a bus or in other ways, and the connection by a bus is taken as an example in FIG. 2 .

The memory 302, as a non-volatile computer-readable storage medium, can be used to store non-volatile software programs, non-volatile computer-executable programs and modules, such as the Web-side audio online playback prevention download in the embodiment of the present application. The method corresponds to the program instruction/module. The processor 301 executes various functional applications and data processing of the server by running the non-volatile software programs, instructions and modules stored in the memory 302, that is, the method for preventing download of online audio playback on the Web side according to the above method embodiment. .

The memory 302 can include a stored program area and a stored data area, wherein the stored program area can store the application program required by the operating system and at least one function; the stored data area can store the data created according to the use of the method for preventing downloading of audio online on the Web side. data etc. Additionally, memory 302 may include high speed random access memory, and may also include nonvolatile memory, such as at least one magnetic disk storage device, flash memory device, or other nonvolatile solid state storage device. In some embodiments, memory 302 may optionally include memory located remotely from processor 301, which may be connected to local modules via a network. Examples of such networks include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

The input device 303 can receive input information such as user name and password. The output device 304 may include a display device such as a display screen.

One or more program instructions/modules corresponding to the method for preventing downloading of audio online on the Web side are stored in the memory 302, and when executed by the processor 301, the method for online audio online playback on the Web side in any of the above-mentioned method embodiments is executed to prevent downloading. .

Any embodiment of the computer device that executes the above-mentioned method for preventing downloading of audio online at the web end can achieve the same or similar effects as any of the foregoing method embodiments corresponding to it.

As shown in FIG. 3 , the present invention further provides a computer-readable storage medium 400 , where the computer-readable storage medium 400 stores a computer program 402 for executing the above method when executed by the processor 401 .

Finally, it should be noted that those of ordinary skill in the art can understand that all or part of the process in the method of the above-mentioned embodiment can be implemented by instructing the relevant hardware through a computer program. In a computer-readable storage medium, when the program is executed, it may include the processes of the foregoing method embodiments. The storage medium of the program may be a magnetic disk, an optical disk, a read-only memory (Read-Only Memory, ROM), or a random access memory (Random Access Memory, RAM) or the like. The above computer program embodiments can achieve the same or similar effects as any of the foregoing method embodiments corresponding thereto.

The above are exemplary embodiments of the present disclosure, but it should be noted that various changes and modifications may be made without departing from the scope of the disclosure of the embodiments of the present invention as defined in the claims. The functions, steps and/or actions of the method claims in accordance with the disclosed embodiments described herein need not be performed in any particular order. Furthermore, although elements disclosed in the embodiments of the present invention may be described or claimed in the singular, unless explicitly limited to the singular, the plural may also be construed.

It should be understood that, as used herein, the singular form "a" is intended to include the plural form as well, unless the context clearly supports an exception. It will also be understood that "and/or" as used herein is meant to include any and all possible combinations of one or more of the associated listed items.

The above-mentioned embodiments of the present invention disclose the serial numbers of the embodiments only for description, and do not represent the advantages and disadvantages of the embodiments.

Those of ordinary skill in the art can understand that all or part of the steps of implementing the above embodiments can be completed by hardware, or can be completed by instructing relevant hardware through a program, and the program can be stored in a computer-readable storage medium. The storage medium can be a read-only memory, a magnetic disk or an optical disk, and the like.

Those of ordinary skill in the art should understand that the discussion of any of the above embodiments is only exemplary, and is not intended to imply that the scope (including the claims) disclosed by the embodiments of the present invention is limited to these examples; under the idea of the embodiments of the present invention , the technical features in the above embodiments or different embodiments can also be combined, and there are many other changes in different aspects of the above embodiments of the present invention, which are not provided in detail for the sake of brevity. Therefore, any omission, modification, equivalent replacement, improvement, etc. made within the spirit and principle of the embodiments of the present invention should be included within the protection scope of the embodiments of the present invention.

Claims

A method for preventing downloading of audio online on a Web side, comprising the following steps:

Open the websocket server on the server side, and establish a communication connection between the websocket server and the browser;

In response to receiving the audio playback request sent by the browser, at the server, the audio file that needs to be played is divided into a plurality of sub-audio files according to the request;

encoding the sub-audio file to convert into a binary file format suitable for streaming media transmission, and sending the encoded sub-audio file to the browser through the websocket server; and

In response to the browser side receiving the binary file stream transmitted by the websocket server, the binary file stream sub-audio file is asynchronously decoded and played.
The method according to claim 1, wherein the dividing the audio file to be played into multiple sub-audio files on the server side according to the request comprises:

On the server side, according to the size of the audio file, the audio file is divided according to a predefined number of bytes.
The method according to claim 1, wherein sending the encoded sub-audio file to the browser through the websocket server comprises:

Each time a predefined number of the sub-audio files are obtained from the websocket server to cache audio of a predefined length on the browser side.
The method according to claim 3, wherein the acquiring a predefined number of the sub-audio files from the websocket server each time to cache the audio of the predefined length on the browser side comprises:

determining whether the total length of the audio is less than a first threshold; and

In response to the total length of the audio being less than the first threshold, all sub-audio files of the audio are obtained.
The method according to claim 3, wherein the acquiring a predefined number of the sub-audio files from the websocket server each time to cache the audio of the predefined length on the browser side comprises:

determining the predefined length according to the total length of the audio, and judging whether the predefined length is greater than a second threshold; and

In response to the predefined length being greater than a second threshold, the predefined length is set to the second threshold.
The method of claim 5, further comprising:

In response to the user changing the playback progress of the current audio on the browser side, the predefined length is recalculated according to the new audio playback position selected by the user.
The method of claim 3, further comprising:

Determine whether the ratio of the current playback progress to the predefined length of the current cache reaches a third threshold; and

In response to the ratio of the current playback progress to the current buffered predefined length reaching the third threshold, acquire the audio of the next predefined length.
A system for preventing downloading of audio online on a Web side, comprising:

a connection module, configured to open the websocket server on the server side, and establish a communication connection between the websocket server and the browser;

A splitting module, configured to split the audio file to be played into a plurality of sub-audio files on the server side according to the request in response to receiving the audio playback request sent by the browser;

an encoding module, configured to encode the sub-audio file to be converted into a binary file format suitable for streaming media transmission, and send the encoded sub-audio file to the browser through the websocket server; and

The decoding module is configured to asynchronously decode and play the sub-audio files of the binary file stream in response to the browser receiving the binary file stream transmitted by the websocket server.
A computer equipment, characterized in that, comprising:

at least one processor; and

a memory storing computer instructions executable on the processor, the instructions implementing the steps of the method of any one of claims 1-7 when executed by the processor.
A computer-readable storage medium storing a computer program, characterized in that, when the computer program is executed by a processor, the steps of the method of any one of claims 1-7 are implemented.