CN114339301A - Dynamic sound effect switching method and system based on different scenes - Google Patents
Dynamic sound effect switching method and system based on different scenes Download PDFInfo
- Publication number
- CN114339301A CN114339301A CN202111470914.0A CN202111470914A CN114339301A CN 114339301 A CN114339301 A CN 114339301A CN 202111470914 A CN202111470914 A CN 202111470914A CN 114339301 A CN114339301 A CN 114339301A
- Authority
- CN
- China
- Prior art keywords
- sound effect
- video
- online
- scheme
- background service
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000000694 effects Effects 0.000 title claims abstract description 318
- 238000000034 method Methods 0.000 title claims abstract description 52
- 238000004891 communication Methods 0.000 claims abstract description 21
- 230000008569 process Effects 0.000 claims description 17
- 230000008859 change Effects 0.000 claims description 10
- 230000036316 preload Effects 0.000 claims description 6
- 238000005070 sampling Methods 0.000 claims description 4
- 230000002708 enhancing effect Effects 0.000 claims description 3
- 230000000875 corresponding effect Effects 0.000 description 15
- 238000010586 diagram Methods 0.000 description 4
- 238000012545 processing Methods 0.000 description 3
- 238000013475 authorization Methods 0.000 description 2
- 230000001276 controlling effect Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000003139 buffering effect Effects 0.000 description 1
- 230000004069 differentiation Effects 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 230000033764 rhythmic process Effects 0.000 description 1
- 230000007480 spreading Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Landscapes
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention provides a dynamic sound effect switching method and a system thereof based on different scenes, wherein the method comprises the following steps: when a user starts to play an online video by using online video software preset on equipment, the background service establishes communication with the online video software; the background service acquires video information of a current online video from online video software; uploading the video information to a sound effect algorithm library which stores a plurality of sound effect schemes, analyzing the video information, searching the sound effect scheme matched with the video information to obtain an online sound effect scheme, and outputting the sound effect of the online sound effect scheme through a loudspeaker; and when the end of the current online video playing is detected, the background service controls the loudspeaker to stop outputting the sound effect. The method and the device have the advantages that online videos and offline videos are taken into consideration, the optimal sound effect scheme is recommended for the user, dynamic sound effect switching under different scenes is realized, sound effect scenes matched with the videos are created, and the viewing experience of the user is greatly improved.
Description
Technical Field
The invention relates to the field of algorithm recommendation, in particular to a dynamic sound effect switching method and system based on different scenes.
Background
In 2021, 27 th month 8, the 48 th statistical report of the development status of the china internet was issued by the information center for the china internet (CNNIC) in kyo. The report shows that the scale of the netizens in China reaches 10.11 hundred million by 6 months in 2021, and the popularization rate of the internet reaches 71.6 percent compared with 2175 thousand by 12 months in 2020. Billions of users access the internet, forming the most huge and vigorous digital society worldwide. By 12 months in 2020, the network video user scale in China reaches 9.27 hundred million, which is 7633 ten thousand in 3 months in 2020, and accounts for 93.7% of the whole netizen. Wherein the short video users have the scale of 8.73 hundred million, and the short video users are increased by 1.00 hundred million in 3 months in 2020, and account for 88.3 percent of the whole netizen.
The network video is a dynamic image distributed in a video file format such as WMV, RM, RMVB, FLV, MOV and the like on the network, and includes various movie programs, news, advertisements, FLASH animation, self-timer DV, chat video, game video, surveillance video and the like. As the personal value view and the network behavior characteristics of the netizens become more complicated and diversified in the future, the video consumption structure of the netizens also has the characteristic of diversification. The diversification of the video consumption demand structure drives the competition pattern of the Chinese network video market to develop towards two directions of pursuing scale and pursuing differentiation.
With the popularization and development of the internet, the network videos are increased explosively, the video updating rate is increased day by day, the videos on each large video website are various, and the updating speed is high. However, how to improve the video viewing experience of the user has become a hot issue.
For sound box products, the sound effect has great significance for different media scenes. For example, when listening to music, the user can switch to a special sound effect for music, and when watching videos, the user can adjust different video sound effects according to the types of the videos, so that the user experience can be greatly improved.
When a user uses the electronic equipment to watch videos on a video website or video software, the electronic equipment cannot provide corresponding sound effects and cannot create a sound effect scene matched with the videos, and the user can only listen to the audio of the videos. For some videos, if a user uses a single sound effect to view the videos, the user may feel tired in viewing and is not favorable for viewing and spreading of the videos.
Therefore, there is a need for a solution to the above problem by providing a dynamic audio switching scheme when watching video.
Disclosure of Invention
Based on the problems in the prior art, the invention provides a dynamic sound effect switching method and a dynamic sound effect switching system based on different scenes. The specific scheme is as follows:
a dynamic sound effect switching method based on different scenes comprises the following steps:
when a user starts to play an online video by using online video software preset on equipment, background service of the equipment establishes communication with the online video software;
in the video loading process, the background service acquires video information of a current online video from the online video software;
uploading the video information to a sound effect algorithm library stored with a plurality of sound effect schemes, analyzing the video information, searching the sound effect scheme matched with the video information to obtain an online sound effect scheme, and outputting the sound effect of the online sound effect scheme through a loudspeaker;
and when the end of the current online video playing is detected, the background service controls the loudspeaker to stop outputting the sound effect.
In a specific embodiment, the method further comprises the following steps:
when a user starts to play an offline video by using video playing software preset on equipment, starting playing background service and analysis background service of the equipment in the video loading process;
the playing background service performs audio decoding and video decoding on the current offline video, and plays the current offline video;
the analysis background service preloads the audio information of the current off-line video and sends the audio information to the sound effect algorithm library before playing the current off-line video;
the sound effect algorithm library selects a preset general sound effect scheme, analyzes the audio waveform in the audio information, adjusts the preset general sound effect scheme according to the change condition of the audio waveform to obtain an off-line sound effect scheme, and outputs the sound effect of the off-line sound effect scheme through a loudspeaker during formal playing;
when the end of the current off-line video playing is detected, the playing background service ends the service, and the analysis background service controls the loudspeaker to stop outputting the sound effect.
In one embodiment, adjusting the sound effect scheme includes: and adjusting the treble effect, the bass effect, the sampling rate, the echo, the volume and the sound channel switching of the sound effect scheme.
In an embodiment, the adjusting the sound effect scheme specifically includes:
setting a high peak value and a medium peak value, and analyzing the audio waveform;
in the audio waveform, if the waveform is always higher than the high peak value in a continuous time period, enhancing the high-pitched effect in the sound effect scheme in the time period;
in the audio waveform, if the waveform tends to be smooth and close to the middle peak value in a continuous time period, the bass effect in the sound effect scheme in the time period is enhanced.
In a specific embodiment, the video information includes the number of channels supported by audio, whether Dolby Atmos is supported, and the video type.
In a specific embodiment, in the sound effect algorithm library, the sound effect scheme is in a matching relationship with online videos of various video types in advance;
the sound effect algorithm library searches a sound effect scheme which has a matching relation with the video type by analyzing the video type of the current online video;
and adjusting the sound effect scheme according to the number of channels supported by the audio and the Dolby Atmos, so as to obtain the on-line sound effect scheme.
In one embodiment, a plurality of customized sound effect schemes are pre-stored in the sound effect algorithm library, and the customized schemes can be manually adjusted and manually switched.
In one embodiment, the background service establishes communication with the online video software through the Linux native communicator.
The utility model provides a dynamic audio switching system based on under different scenes, includes online video module, online video module specifically includes:
a communication unit: the device comprises a background service and online video software, wherein the background service is used for establishing communication with the online video software when a user starts to play an online video by using the online video software preset on the device;
an information acquisition unit: the system comprises a background service and an online video software, wherein the background service is used for acquiring video information of a current online video from the online video software in a video loading process;
the online sound effect unit: the system comprises a sound effect algorithm library, a speaker, a video information acquisition module, a sound effect analysis module and a sound effect analysis module, wherein the sound effect algorithm library is used for uploading the video information to a sound effect algorithm library which stores a plurality of sound effect schemes, analyzing the video information, searching the sound effect scheme matched with the video information to obtain an online sound effect scheme, and outputting the sound effect of the online sound effect scheme through the speaker;
a first end unit: and the background service is used for controlling the loudspeaker to stop sound effect output when the current online video playing is detected to be finished.
In a specific embodiment, the method further comprises the following steps:
a starting unit: when a user starts to play an offline video by using video playing software preset on equipment, the user is used for starting playing background services and analyzing background services of the equipment in the video loading process;
a decoding unit: the system comprises a playing background service, a video decoding module and a video decoding module, wherein the playing background service is used for carrying out audio decoding and video decoding on the current offline video and playing the current offline video;
a preloading unit: the audio information of the current off-line video is preloaded through the analysis background service and is sent to the sound effect algorithm library before the current off-line video is played;
an off-line sound effect unit: the system comprises a sound effect algorithm library, a speaker, a preset universal sound effect scheme and an off-line sound effect scheme, wherein the sound effect algorithm library is used for selecting the preset universal sound effect scheme, analyzing the sound wave form in the sound information, adjusting the preset universal sound effect scheme according to the change condition of the sound wave form to obtain the off-line sound effect scheme, and outputting the sound effect of the off-line sound effect scheme through the speaker during formal playing;
a second ending unit: and when the end of the current online video playing is detected, the playing background service ends the service, and the analysis background service controls the loudspeaker to stop outputting the sound effect.
Has the advantages that:
the invention provides a dynamic sound effect switching method and a system thereof based on different scenes, which are used for considering both online videos and offline videos, recommending an optimal sound effect scheme for a user, realizing dynamic sound effect switching under different scenes, creating a sound effect scene matched with the videos and greatly improving the viewing experience of the user. The method has the advantages that the video information can be acquired from related video manufacturers according to the characteristics that the video information can be acquired from the online video, the sound effect scheme is matched according to the video information, the matching degree of the sound effect scheme and the online video is high, the fitting degree is large, and a good sound effect atmosphere can be provided for a user. Aiming at the characteristic that the offline video is difficult to acquire video information, the sound effect scheme is automatically adjusted by means of the audio waveform, the waveform change and the peak value condition are analyzed, and sound effect parameters such as high and low sound effects are automatically adjusted, so that the dynamic sound effect switching of the offline video is realized.
In order to make the aforementioned and other objects, features and advantages of the present invention comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present invention and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained according to the drawings without inventive efforts.
FIG. 1 is a flow chart of a dynamic sound effect switching method for online video according to embodiment 1 of the present invention;
fig. 2 is a flowchart of a dynamic sound effect switching method for offline video according to embodiment 1 of the present invention;
FIG. 3 is a schematic diagram illustrating a dynamic sound effect switching principle of an online video according to embodiment 1 of the present invention;
FIG. 4 is a schematic diagram illustrating a dynamic sound effect switching principle of an offline video according to embodiment 1 of the present invention;
FIG. 5 is a structural composition diagram of an online video module according to embodiment 2 of the present invention;
fig. 6 is a structural diagram of an offline video module according to embodiment 2 of the present invention.
Reference numerals:
1-an online video module; 2-an off-line video module; 11-a communication unit; 12-an information acquisition unit; 13-an online sound effect unit; 14-a first termination unit; 21-a start-up unit; 22-a preload unit; 23-a decoding unit; 24-off-line sound effect unit; 25-second end unit.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Example 1
The embodiment provides a dynamic sound effect switching method based on different scenes, the flow steps are as described in the specification and attached figures 1 and 2, and the specific scheme is as follows:
a dynamic sound effect switching method based on different scenes comprises dynamic sound effect switching of online videos and dynamic sound effect switching of offline videos. The dynamic sound effect switching of the online video is shown in the attached figure 1 of the specification, and comprises the following steps:
101. when a user starts to play an online video by using online video software preset on equipment, the background service of the equipment establishes communication with the online video software;
102. in the video loading process, the background service acquires video information of a current online video from online video software;
103. uploading the video information to a sound effect algorithm library which stores a plurality of sound effect schemes, analyzing the video information, searching the sound effect scheme matched with the video information to obtain an online sound effect scheme, and outputting the sound effect of the online sound effect scheme through a loudspeaker;
104. and when the end of the current online video playing is detected, the background service controls the loudspeaker to stop outputting the sound effect.
The dynamic sound effect switching of the off-line video is shown in the attached figure 2 of the specification, and comprises the following steps:
201. when a user starts to play an offline video by using video playing software preset on equipment, starting playing background service and analysis background service of the equipment in the video loading process;
202. the analysis background service preloads the audio information of the current offline video before playing the current offline video and sends the audio information to a sound effect algorithm library;
203. the playing background service performs audio decoding and video decoding on the current offline video, and plays the current offline video;
204. the sound effect algorithm library selects a preset general sound effect scheme, analyzes the sound wave form in the sound information, adjusts the preset general sound effect scheme according to the change condition of the sound wave form to obtain an off-line sound effect scheme, and outputs sound effects of the off-line sound effect scheme through a loudspeaker during formal playing;
205. when the end of the current off-line video playing is detected, the playing background service ends, and the analysis background service controls the loudspeaker to stop outputting sound effect.
In this embodiment, the dynamic sound effect switching method mainly aims at the online video and the offline video. The video is divided into an online video and an offline video according to the video source. The online video mainly comprises online video software and an online video website, the online video can accurately obtain related information such as video types, and the video information of the online video can be obtained only by establishing cooperative communication with corresponding video manufacturers. The sources of the offline videos are various, such as videos stored locally, videos transmitted by non-video websites, videos stored in an external storage medium, and the like. Offline videos often cannot accurately know the related information of the videos. The dynamic sound effect switching method provided by the embodiment selects different modes for processing based on the sound effect algorithm library according to the relevant characteristics of the online video and the offline video.
The sound effect algorithm library is stored with a plurality of sound effect schemes, including a sound effect scheme of online video matched with the video type, a preset general sound effect scheme aiming at offline video and a user-defined sound effect scheme. The sound effect switching of the off-line video and the on-line video can be automatically realized through an algorithm, and the algorithm can recommend the optimal sound effect scheme of the current video for the user to experience. When the user does not want to use the sound effect recommended by the algorithm, the user-defined sound effect scheme can be manually switched and manually adjusted. The custom sound effect scheme may add and subtract sound effects according to the user's preference. Meanwhile, the user-defined sound effect also supports the user to set a sound effect scheme by himself, namely the user edits the sound effect by himself. The setting of self-defined sound effect has kept user's autonomy.
Regarding online video, the present embodiment takes online video acquired from online video software as an example. In practical applications, it is necessary to establish information acquisition-related authorization with the vendor of the online video software. When some video is clicked by the video software, the detailed video information of the video needs to be additionally acquired besides the video can be normally played. The sound effect switching principle of the online video is shown in the attached figure 3 of the specification.
101. When a user starts playing an online video by using online video software preset on equipment, background service of the equipment establishes communication with the online video software. In this embodiment, the device is configured with a corresponding background service, and the background service is automatically initialized when the device is started. When a user starts corresponding online video software, the background service establishes communication with the online video software at the first time. In practical applications, the device will issue an authorization request, and if the user agrees to the request, the subsequent dynamic sound effect switching operation will be performed. If the user does not need the dynamic sound effect switching function, the system can be closed at any time.
In this embodiment, the device background service establishes communication with the online video software through the communication mechanism of Linux itself.
102. In the video loading process, the background service acquires video information of the current online video from the online video software. After the communication connection is established, when a user clicks a certain video to play online, the online video software requests the video information related to the video together when requesting the video from the server by using the video loading time. And the background is informed of the relevant information for serving the video through a pre-established communication mechanism.
Since the interface of the video software and the equipment transmission also utilizes the characteristics of the system, the speed is very fast, and the user does not have any great influence and can not feel stuck. Since the amount of data transferred by the process is not too large and the data is initially loaded into local storage, the process is controlled to within 1 second to reduce the perception of the user.
103. The method comprises the steps of uploading video information to a sound effect algorithm library stored with multiple sound effect schemes, analyzing the video information, searching the sound effect schemes matched with the video information to obtain an online sound effect scheme, and outputting the online sound effect scheme through a loudspeaker.
In this embodiment. The video information includes the number of channels supported by the audio, whether Dolby Atmos is supported, the video type, and the like. In the sound effect algorithm library, a sound effect scheme is matched with online videos of various video types in advance. The sound effect algorithm library can obtain a corresponding sound effect scheme only by matching the video type. Because the online video can accurately acquire the video type, the corresponding sound effect scheme can be matched according to the video type. For example, the video type is a war film, and the sound effect scheme can be set to be compact and shocking sound effects, so that the reality sense of the scene is enhanced. Particularly, partial videos exist, and corresponding sound effect schemes can be configured in advance according to the audio characteristics of the videos. For example, a battle scene and a slow rhythm scenario exist in one war film, and corresponding sound effects can be matched according to each scenario of the film to obtain a set of complete sound effect schemes with high fitting degree and store the sound effect schemes in a sound effect algorithm library. When the sound effect algorithm library is matched with the film, the corresponding sound effect can be played.
However, with the update of video resources, it is difficult to configure all videos into sound effect schemes with high fitting degree, so that the sound effect schemes corresponding to most videos are not highly fitted, and the algorithm needs to be adjusted by itself. The sound effect scheme matched according to the video type is only the initial sound effect scheme, and the sound effect video of the online video needs to be adjusted to further approach the actual video scene. The sound effect adjusting scheme comprises the following steps: and adjusting the treble effect, bass effect, sampling rate, echo, volume level and sound channel switching of the sound effect scheme.
For example, many video scene effects are represented by audio, and video scenes can be fed back by audio waveforms. The sound effect algorithm library adjusts the sound effect scheme by analyzing the audio waveform, and enhances the corresponding effect in a certain continuous wave band so as to realize the adjustment of the sound effect scheme. Alternatively, the online video does not support Dolby Atmos, and can be adaptively compensated for sound. On-line video often only needs to be slightly adjusted according to the number of channels supported by the audio, whether Dolby Atmos is supported or not and the like because the on-line video already has a sound effect scheme, and in off-line video, the audio effect scheme cannot be matched according to the video type because the video type is unknown, so that the adjustment needs to be carried out by means of audio waveforms.
104. And when the end of the current online video playing is detected, the background service controls the loudspeaker to stop outputting the sound effect. In this embodiment, the end of the playing includes two situations, namely the end of the playing and the pause of the playing, and as long as the video is not being played, the corresponding sound effect is not output. Preferably, the speaker is located on the device.
Regarding dynamic sound effect switching of offline video, sound effect optimization may be different from online video based on the unknown nature of the offline video. The sound effect switching principle of the off-line video is shown in the attached figure 4 of the specification.
201. When a user starts to play an offline video by using video playing software preset on the device, the playing background service and the analysis background service of the device are started in the video loading process.
Because the offline video cannot acquire the corresponding video information, when the user clicks to play the offline video, the operation is executed through two background services of the device. The playing background service is mainly responsible for normally playing the offline video, and the analyzing background service needs to buffer the audio state of the video and adjust the sound effect scheme.
202. And the analysis background service preloads the audio information of the current offline video before playing the current offline video and sends the audio information to the sound effect algorithm library. Since the offline video cannot acquire video information such as video types, the sound effect can only be adjusted by analyzing the audio information. Preferably, the parsing background service completes the acquisition of the sound effect scheme before the offline video playing. In practical application, the running process of analyzing the background service is about ten seconds ahead of the formally played content of the video, the advance time can be set according to practical conditions, and the advance time can be understood as the buffering time of the online video.
203. And the playing background service performs audio decoding and video decoding on the current offline video and plays the current offline video. The playing background service is responsible for normal audio and video decoding and correctly playing the pictures and sound of the video. And after the background playing service carries out video decoding, playing video frames to form video pictures. And after audio decoding, playing the audio.
204. And the sound effect algorithm library selects a preset general sound effect scheme, analyzes the sound frequency waveform in the sound frequency information, adjusts the preset general sound effect scheme according to the change condition of the sound frequency waveform to obtain an off-line sound effect scheme, and outputs the sound effect of the off-line sound effect scheme through a loudspeaker during formal playing. Because the off-line video can not configure the corresponding sound effect scheme in advance, a sound effect scheme with wide compatibility can be preset, or a sound effect scheme can be obtained within a time period according to the audio waveform.
In this embodiment, the audio algorithm library is preset with a general audio scheme, and the preset general audio scheme has strong adjustability and wide compatibility. The sound effect algorithm library adjusts the sound effect scheme by analyzing the audio waveform. The sound effect adjusting scheme comprises the following steps: and adjusting the treble effect, bass effect, sampling rate, echo, volume level and sound channel switching of the sound effect scheme.
Take adjusting high and low tones as an example. Setting a high peak value and a medium peak value, and analyzing an audio waveform; in the audio waveform, if the waveform is always higher than a high peak value in a continuous time period, which indicates the current tense moment, the high-pitched effect in the time period in the sound effect scheme is enhanced; in the audio waveform, if there is a continuous time period in which the waveform tends to be gentle and close to the middle peak, the bass effect in the sound effect scheme in the time period is enhanced. Based on the limitations and the unknowns of the offline video, the realized related operations can be more only fine-tuned relative to the analysis of the online video, so as to achieve the effect of enhancing the sound effect.
205. When the end of the current offline video playing is detected, the playing background service ends, and the analysis background service controls the loudspeaker to stop outputting the sound effect. In this embodiment, the end of the playing includes two situations, namely the end of the playing and the pause of the playing, and as long as the video is not being played, the corresponding sound effect is not output.
The embodiment provides a dynamic sound effect switching method based on different scenes, which considers both online videos and offline videos, recommends an optimal sound effect scheme for a user, realizes dynamic sound effect switching in different scenes, creates a sound effect scene matched with the videos, and greatly improves viewing experience of the user. The method has the advantages that the video information can be acquired from related video manufacturers according to the characteristics that the video information can be acquired from the online video, the sound effect scheme is matched according to the video information, the matching degree of the sound effect scheme and the online video is high, the fitting degree is large, and a good sound effect atmosphere can be provided for a user. Aiming at the characteristic that the offline video is difficult to acquire video information, the sound effect scheme is automatically adjusted by means of the audio waveform, the waveform change and the peak value condition are analyzed, and sound effect parameters such as high and low sound effects are automatically adjusted, so that the dynamic sound effect switching of the offline video is realized.
Example 2
In this embodiment, on the basis of embodiment 1, a dynamic sound effect switching system based on different scenes is provided, and the dynamic sound effect switching method of embodiment 1 is systematized. The components of each module of the system are as described in the specification, attached figures 5 and 6, and the specific scheme is as follows:
a dynamic sound effect switching system based on different scenes comprises an online video module 1, wherein the online video module 1 specifically comprises a communication unit 11, an information acquisition unit 12, an online sound effect unit 13 and a first end unit 14, and is specifically shown in the attached figure 5 of the specification. The method specifically comprises the following steps:
the communication unit 11: the device is used for establishing communication between background service of the device and online video software when a user starts playing the online video by using the online video software preset on the device;
the information acquisition unit 12: the system comprises a background service module, a video loading module, a video processing module and a video processing module, wherein the background service module is used for acquiring video information of a current online video from online video software through a background service in a video loading process;
the on-line sound effect unit 13: the system comprises a sound effect algorithm library, a loudspeaker and a video server, wherein the sound effect algorithm library is used for uploading video information to a sound effect algorithm library which stores a plurality of sound effect schemes, analyzing the video information, searching the sound effect scheme matched with the video information to obtain an online sound effect scheme, and outputting the sound effect of the online sound effect scheme through the loudspeaker;
first end unit 14: and the background service is used for controlling the loudspeaker to stop sound effect output when the current online video playing is detected to be finished.
The dynamic sound effect switching system further includes an offline video module 2, where the offline video module 2 includes a starting unit 21, a preloading unit 22, a decoding unit 23, an offline sound effect unit 24, and a second ending unit 25, as shown in fig. 6 of the specification. The method specifically comprises the following steps:
the starting unit 21: when a user starts to play an offline video by using video playing software preset on equipment, the user is used for starting playing background services and analyzing background services of the equipment in the video loading process;
the preload unit 22: the system comprises a background service server, a sound effect algorithm library and a video server, wherein the background service server is used for pre-loading audio information of a current off-line video and sending the audio information to the sound effect algorithm library by analyzing background service before the current off-line video is played;
the decoding unit 23: the system is used for carrying out audio decoding and video decoding on the current offline video through playing background service, and playing the current offline video;
offline sound effect unit 24: the off-line sound effect scheme is obtained by selecting a preset general sound effect scheme in a sound effect algorithm library, analyzing an audio waveform in audio information, adjusting the preset general sound effect scheme according to the change condition of the audio waveform, and outputting sound effects of the off-line sound effect scheme through a loudspeaker during formal playing;
second end unit 25: and when the current online video playing is detected to be finished, the playing background service is finished, and the analysis background service controls the loudspeaker to stop outputting the sound effect.
The present embodiment provides a dynamic sound effect switching system based on different scenes, and the dynamic sound effect switching method of embodiment 1 is systematized, so that it has higher practicability.
The invention provides a dynamic sound effect switching method and a system thereof based on different scenes, which are used for considering both online videos and offline videos, recommending an optimal sound effect scheme for a user, realizing dynamic sound effect switching under different scenes, creating a sound effect scene matched with the videos and greatly improving the viewing experience of the user. The method has the advantages that the video information can be acquired from related video manufacturers according to the characteristics that the video information can be acquired from the online video, the sound effect scheme is matched according to the video information, the matching degree of the sound effect scheme and the online video is high, the fitting degree is large, and a good sound effect atmosphere can be provided for a user. Aiming at the characteristic that the offline video is difficult to acquire video information, the sound effect scheme is automatically adjusted by means of the audio waveform, the waveform change and the peak value condition are analyzed, and sound effect parameters such as high and low sound effects are automatically adjusted, so that the dynamic sound effect switching of the offline video is realized.
It will be understood by those skilled in the art that the modules or steps of the invention described above may be implemented by a general purpose computing device, they may be centralized on a single computing device or distributed across a network of computing devices, and optionally they may be implemented by program code executable by a computing device, such that it may be stored in a memory device and executed by a computing device, or it may be separately fabricated into various integrated circuit modules, or it may be fabricated by fabricating a plurality of modules or steps thereof into a single integrated circuit module. Thus, the present invention is not limited to any specific combination of hardware and software.
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments illustrated herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
The above disclosure is only a few specific implementation scenarios of the present invention, however, the present invention is not limited thereto, and any variations that can be made by those skilled in the art are intended to fall within the scope of the present invention.
Claims (10)
1. A dynamic sound effect switching method based on different scenes is characterized by comprising the following steps:
when a user starts to play an online video by using online video software preset on equipment, background service of the equipment establishes communication with the online video software;
in the video loading process, the background service acquires video information of a current online video from the online video software;
uploading the video information to a sound effect algorithm library stored with a plurality of sound effect schemes, analyzing the video information, searching the sound effect scheme matched with the video information to obtain an online sound effect scheme, and outputting the sound effect of the online sound effect scheme through a loudspeaker;
and when the end of the current online video playing is detected, the background service controls the loudspeaker to stop outputting the sound effect.
2. The dynamic sound effect switching method according to claim 1, further comprising:
when a user starts to play an offline video by using video playing software preset on equipment, starting playing background service and analysis background service of the equipment in the video loading process;
the playing background service performs audio decoding and video decoding on the current offline video, and plays the current offline video;
the analysis background service preloads the audio information of the current off-line video and sends the audio information to the sound effect algorithm library before playing the current off-line video;
the sound effect algorithm library selects a preset general sound effect scheme, analyzes the audio waveform in the audio information, adjusts the preset general sound effect scheme according to the change condition of the audio waveform to obtain an off-line sound effect scheme, and outputs the sound effect of the off-line sound effect scheme through a loudspeaker during formal playing;
when the end of the current off-line video playing is detected, the playing background service ends the service, and the analysis background service controls the loudspeaker to stop outputting the sound effect.
3. The dynamic sound effect switching method according to claim 2, wherein adjusting the sound effect scheme comprises: and adjusting the treble effect, the bass effect, the sampling rate, the echo, the volume and the sound channel switching of the sound effect scheme.
4. The dynamic sound effect switching method according to claim 3, wherein adjusting the sound effect scheme specifically comprises:
setting a high peak value and a medium peak value, and analyzing the audio waveform;
in the audio waveform, if the waveform is always higher than the high peak value in a continuous time period, enhancing the high-pitched effect in the sound effect scheme in the time period;
in the audio waveform, if the waveform tends to be smooth and close to the middle peak value in a continuous time period, the bass effect in the sound effect scheme in the time period is enhanced.
5. The method of claim 1 wherein the video information includes the number of channels supported by audio, whether Dolby Atmos is supported, and the video type.
6. The dynamic sound effect switching method according to claim 5, wherein in the sound effect algorithm library, the sound effect scheme is in a matching relationship with online videos of various video types in advance;
the sound effect algorithm library searches a sound effect scheme which has a matching relation with the video type by analyzing the video type of the current online video;
and adjusting the sound effect scheme according to the number of channels supported by the audio and the Dolby Atmos, so as to obtain the on-line sound effect scheme.
7. The dynamic sound effect switching method according to claim 1 or 2, wherein a plurality of customized sound effect schemes are pre-stored in the sound effect algorithm library, and the customized schemes can be manually adjusted and manually switched.
8. The dynamic sound effect switching method according to claim 1 or 2, wherein the background service establishes communication with the online video software through a Linux native communicator.
9. The utility model provides a dynamic audio switching system based on under different scenes which characterized in that, includes online video module, online video module specifically includes:
a communication unit: the device comprises a background service and online video software, wherein the background service is used for establishing communication with the online video software when a user starts to play an online video by using the online video software preset on the device;
an information acquisition unit: the system comprises a background service and an online video software, wherein the background service is used for acquiring video information of a current online video from the online video software in a video loading process;
the online sound effect unit: the system comprises a sound effect algorithm library, a speaker, a video information acquisition module, a sound effect analysis module and a sound effect analysis module, wherein the sound effect algorithm library is used for uploading the video information to a sound effect algorithm library which stores a plurality of sound effect schemes, analyzing the video information, searching the sound effect scheme matched with the video information to obtain an online sound effect scheme, and outputting the sound effect of the online sound effect scheme through the speaker;
a first end unit: and the background service is used for controlling the loudspeaker to stop sound effect output when the current online video playing is detected to be finished.
10. The dynamic sound effect switching system according to claim 9, further comprising:
a starting unit: when a user starts to play an offline video by using video playing software preset on equipment, the user is used for starting playing background services and analyzing background services of the equipment in the video loading process;
a decoding unit: the system comprises a playing background service, a video decoding module and a video decoding module, wherein the playing background service is used for carrying out audio decoding and video decoding on the current offline video and playing the current offline video;
a preloading unit: the audio information of the current off-line video is preloaded through the analysis background service and is sent to the sound effect algorithm library before the current off-line video is played;
an off-line sound effect unit: the system comprises a sound effect algorithm library, a speaker, a preset universal sound effect scheme and an off-line sound effect scheme, wherein the sound effect algorithm library is used for selecting the preset universal sound effect scheme, analyzing the sound wave form in the sound information, adjusting the preset universal sound effect scheme according to the change condition of the sound wave form to obtain the off-line sound effect scheme, and outputting the sound effect of the off-line sound effect scheme through the speaker during formal playing;
a second ending unit: and when the end of the current online video playing is detected, the playing background service ends the service, and the analysis background service controls the loudspeaker to stop outputting the sound effect.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111470914.0A CN114339301A (en) | 2021-12-03 | 2021-12-03 | Dynamic sound effect switching method and system based on different scenes |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111470914.0A CN114339301A (en) | 2021-12-03 | 2021-12-03 | Dynamic sound effect switching method and system based on different scenes |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114339301A true CN114339301A (en) | 2022-04-12 |
Family
ID=81047732
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111470914.0A Pending CN114339301A (en) | 2021-12-03 | 2021-12-03 | Dynamic sound effect switching method and system based on different scenes |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114339301A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101808208A (en) * | 2009-02-17 | 2010-08-18 | 深圳Tcl新技术有限公司 | Television and method for setting sound effect mode of same |
| CN105898364A (en) * | 2016-05-26 | 2016-08-24 | 北京小米移动软件有限公司 | Video playing processing method, device, terminal and system |
| CN105959482A (en) * | 2016-06-16 | 2016-09-21 | 广东欧珀移动通信有限公司 | Scene sound effect control method and electronic device |
| CN108322817A (en) * | 2018-02-12 | 2018-07-24 | 深圳创维－Rgb电子有限公司 | A kind of audio mode switching method, device and electronic equipment |
| CN112235633A (en) * | 2020-10-16 | 2021-01-15 | 深圳创维－Rgb电子有限公司 | Output effect adjusting method, device, equipment and computer readable storage medium |
-
2021
- 2021-12-03 CN CN202111470914.0A patent/CN114339301A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101808208A (en) * | 2009-02-17 | 2010-08-18 | 深圳Tcl新技术有限公司 | Television and method for setting sound effect mode of same |
| CN105898364A (en) * | 2016-05-26 | 2016-08-24 | 北京小米移动软件有限公司 | Video playing processing method, device, terminal and system |
| CN105959482A (en) * | 2016-06-16 | 2016-09-21 | 广东欧珀移动通信有限公司 | Scene sound effect control method and electronic device |
| US20200336875A1 (en) * | 2016-06-16 | 2020-10-22 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Scenario-based sound effect control method and electronic device |
| CN108322817A (en) * | 2018-02-12 | 2018-07-24 | 深圳创维－Rgb电子有限公司 | A kind of audio mode switching method, device and electronic equipment |
| CN112235633A (en) * | 2020-10-16 | 2021-01-15 | 深圳创维－Rgb电子有限公司 | Output effect adjusting method, device, equipment and computer readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11616818B2 (en) | Distributed control of media content item during webcast | |
| CN111064972A (en) | Live video control method based on IPV9 | |
| US20190069047A1 (en) | Methods and systems for sharing live stream media content | |
| CN111064973A (en) | Live broadcast system based on IPV9 | |
| CN104125229B (en) | The player method of Streaming Media and playing device | |
| CN112839238B (en) | Screen projection playing method and device and storage medium | |
| CN102802044A (en) | Video processing method, terminal and subtitle server | |
| CN104602133A (en) | Multimedia file shearing method and terminal as well as server | |
| US20160134900A1 (en) | Streaming media processing method, apparatus, and system | |
| CN103747287A (en) | Video playing speed regulation method and system applied to flash | |
| US10523899B2 (en) | System and method for providing and interacting with coordinated presentations | |
| CN112752109B (en) | Video playing control method and system | |
| CN111343477B (en) | Data transmission method and device, electronic equipment and storage medium | |
| US11758245B2 (en) | Interactive media events | |
| CN106789976A (en) | The player method of media file, service end, client and system | |
| US20220394328A1 (en) | Consolidated Watch Parties | |
| US20150268808A1 (en) | Method, Device and System for Multi-Speed Playing | |
| JP7290260B1 (en) | Servers, terminals and computer programs | |
| CN112770168A (en) | Video playing method and related device and equipment | |
| CN113923502B (en) | Live video playing method and device | |
| CN106331763B (en) | Method for seamlessly playing fragmented media file and device for implementing method | |
| CN113645472A (en) | Interaction method and device based on playing object, electronic equipment and storage medium | |
| US12010161B1 (en) | Browser-based video production | |
| CN114339301A (en) | Dynamic sound effect switching method and system based on different scenes | |
| KR102051985B1 (en) | Synchronization of Media Rendering in Heterogeneous Networking Environments |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |