CN110062276A - Processing method, device and the electronic equipment and storage medium of audio, video data - Google Patents
Processing method, device and the electronic equipment and storage medium of audio, video data Download PDFInfo
- Publication number
- CN110062276A CN110062276A CN201910186326.0A CN201910186326A CN110062276A CN 110062276 A CN110062276 A CN 110062276A CN 201910186326 A CN201910186326 A CN 201910186326A CN 110062276 A CN110062276 A CN 110062276A
- Authority
- CN
- China
- Prior art keywords
- audio
- video data
- information
- volume
- state
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/233—Processing of audio elementary streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
Abstract
The disclosure is about a kind of processing method of audio, video data, device and electronic equipment and storage medium, it is related to audio-video processing technology field, wherein, the described method includes: obtaining the second information of the audio, video data when the broadcast state of audio, video data to be processed is converted to preset first state by preset second state；The volume of audio, video data is gradually increased to the first information volume got in advance in the first information got according to the second information and in advance, the volume that the first information volume includes the broadcast state of audio, video data when being first state.The disclosure is converted to interrupt status by state in playing in the broadcast state of audio, video data, and when being converted to state in broadcasting by interrupt status, by carrying out relevant treatment to the first information got and the second information, the volume of audio, video data is gradually increased to initial volume, avoid the manual operation of user, the operating procedure for reducing user, optimizes user experience.
Description
Technical field
This disclosure relates to audio-video processing technology field more particularly to the processing method of audio, video data, device and electronics
Equipment and storage medium.
Background technique
With the development of internet technology, listen to music or see that online video has become the important composition of people's daily life
Part.But the performance of playback equipment etc. of network state and music or video by internet is influenced, it may appear that sound
Happy or video playing is interrupted, and then continues the case where playing again.When music or video playing are interrupted, sound disappears, and continues to play
Shi Shengyin occurs suddenly, is easy that user is enabled to get a fright.Alternatively, one is first in the case where playing collection of music or video collection
Music or a video playing finish, and when continuing to play next song or next video, sound occurs suddenly, are also easy to enable
User receives scaring.
In the related technology, on the one hand, after music or video playing are interrupted, before continuing broadcasting, alternatively, current
After music or current video finish, before playing next song or next video, usually turned down manually by user
Broadcast sound volume is turned up volume after playing wait continue again, increases the operating procedure of user, user experience is poor.Another party
Face, after continuing broadcasting, broadcast sound volume is turned down by user manually, but the mode of operation lags, there is also increase operating procedure
And the problem of user experience difference.
Summary of the invention
To overcome the problems in correlation technique, present disclose provides a kind of processing methods of audio, video data, device
And electronic equipment and storage medium.
According to the first aspect of the embodiments of the present disclosure, a kind of processing method of audio, video data is provided, comprising: when wait locate
When the broadcast state of the audio, video data of reason is converted to preset first state by preset second state, the audio-video is obtained
Second information of data；The first information got according to second information and in advance, is gradually increased the audio, video data
Volume to the first information volume got in advance, first information volume includes the broadcast state of the audio, video data
Volume when for the first state.
Optionally, the step of obtaining the first information in advance, comprising: when the broadcast state of the audio, video data is by institute
When stating first state and being converted to second state, the first information of the audio, video data is obtained.
Optionally, described when the broadcast state of the audio, video data is converted to second state by the first state
When, the step of obtaining the first information of the audio, video data, comprising: when the broadcast state of the audio, video data is by described
When one state is converted to second state, the first time information and first volume letter of the audio, video data are obtained
Breath；Wherein, the first time information include the audio, video data broadcast state be converted to by the first state it is described
Real time point and data-frame times point when the second state.
Optionally, it is described be converted to when the broadcast state of audio, video data to be processed by preset second state it is preset
When first state, the step of obtaining the second information of the audio, video data, comprising: when the broadcast state of the audio, video data
When being converted to the first state by second state, the second temporal information, the second volume of the audio, video data are obtained
Information and third temporal information；Wherein, second temporal information includes the broadcast state of the audio, video data by described
Two-state is converted to the real time point when first state, and the sound is gradually increased including described in second information volume
The audio, video data is gradually increased including described in the initial volume of the process of the volume of video data, the third temporal information
Volume process time span.
Optionally, the step of second information volume for obtaining the audio, video data, comprising: Xiang Suoshu audio-video number
According to playback equipment send volume acquisition instruction, and receive and returned according to the volume acquisition instruction from the playback equipment
Second information volume；Wherein, second information volume is in preset time period, and the associated terminal of the playback equipment obtains
The average value for the environmental volume got.
Optionally, the step of second information volume for obtaining the audio, video data, comprising: to the audio-video
The playback equipment of data sends the failure of volume acquisition instruction, or does not receive and obtained from the playback equipment according to the volume
When instructing second information volume returned, it is calculated according to first information volume and preset volume coefficient described
Second information volume.
Optionally, the step of third temporal information for obtaining the audio, video data, comprising: when according to described second
Between information, the first time information and preset time coefficient, the third temporal information is calculated.
Optionally, the first information got according to second information and in advance, is gradually increased the audio-video
The step of volume of data to the first information volume got in advance, comprising: the volume adjustment by the audio, video data is
Second information volume；Since the data-frame times point in the first time information, in the third temporal information
The volume of the audio, video data is gradually increased by second information volume as first information volume.
Optionally, it is described first that the volume by the audio, video data is gradually increased by second information volume
The step of information volume, comprising: according to first information volume, second information volume and preset volume adjustment threshold value
Determine volume adjustment stage numerical value；It is determined between volume adjustment according to the third temporal information and the volume adjustment stage numerical value
Every the time；Using the volume adjustment interval time as the period, by the volume of the audio, video data by second information volume
It is stepped up the volume adjustment threshold value, until the volume of the audio, video data is first information volume；Wherein,
The volume adjustment stage numerical value is used to indicate the volume of the audio, video data in each period increased numerical value.
Optionally, the first state includes state in playing, and second state includes interrupt status.
According to the second aspect of an embodiment of the present disclosure, a kind of processing unit of audio, video data is provided, comprising: obtain mould
Block is configured as being converted to preset first state by preset second state when the broadcast state of audio, video data to be processed
When, obtain the second information of the audio, video data；Module is improved, is configured as getting according to second information and in advance
The first information, the volume of the audio, video data is gradually increased to the first information volume got in advance, first sound
Amount information include the audio, video data broadcast state be the first state when volume.
Optionally, the acquisition module is additionally configured to the broadcast state when the audio, video data by first shape
When state is converted to second state, the first information of the audio, video data is obtained.
Optionally, the acquisition module is configured as the broadcast state when the audio, video data by the first state
When being converted to second state, the first time information and first information volume of the audio, video data are obtained；Wherein,
The first time information includes that the broadcast state of the audio, video data is converted to second state by the first state
When real time point and data-frame times point.
Optionally, the acquisition module is configured as the broadcast state when the audio, video data by second state
When being converted to the first state, the second temporal information, the second information volume and third time of the audio, video data are obtained
Information；Wherein, second temporal information includes that the broadcast state of the audio, video data is converted to institute by second state
Real time point when first state is stated, second information volume includes the volume that the audio, video data is gradually increased
Process initial volume, the third temporal information includes the process of the volume that the audio, video data is gradually increased
Time span.
Optionally, the acquisition module is configured as sending volume to the playback equipment of the audio, video data and obtaining referring to
It enables, and receives second information volume returned from the playback equipment according to the volume acquisition instruction；Wherein, described
Second information volume is the average value for the environmental volume that the associated terminal of the playback equipment is got in preset time period.
Optionally, the acquisition module is configured as sending volume acquisition to the playback equipment of the audio, video data
Instruction failure, or second information volume returned from the playback equipment according to the volume acquisition instruction is not received
When, second information volume is calculated according to first information volume and preset volume coefficient.
Optionally, the acquisition module is configured as according to second temporal information, the first time information and pre-
If time coefficient, the third temporal information is calculated.
Optionally, the raising module, comprising: adjusting submodule is configured as the volume tune of the audio, video data
Whole is second information volume；Submodule is improved, the data-frame times point being configured as from the first time information is opened
Begin, it is described that the volume of the audio, video data is gradually increased by second information volume in the third temporal information
First information volume.
Optionally, the raising submodule, be configured as according to first information volume, second information volume and
Preset volume adjustment threshold value determines volume adjustment stage numerical value；According to the third temporal information and the volume adjustment stage
Numerical value determines volume adjustment interval time；Using the volume adjustment interval time as the period, by the volume of the audio, video data
The volume adjustment threshold value is stepped up by second information volume, until the volume of the audio, video data is described first
Until information volume；Wherein, the volume adjustment stage numerical value is used to indicate the volume of the audio, video data each described
Period increased numerical value.
Optionally, the first state includes state in playing, and second state includes interrupt status.
According to the third aspect of an embodiment of the present disclosure, a kind of electronic equipment is provided, comprising: processor；For storing
State the memory of processor-executable instruction；Wherein, the processor is configured to executing audio-video as described in relation to the first aspect
The processing method of data.
According to a fourth aspect of embodiments of the present disclosure, a kind of non-transitorycomputer readable storage medium is provided, institute is worked as
When stating instruction in storage medium and being executed by the processor of mobile terminal, so that the mobile terminal execution is as described in relation to the first aspect
Audio, video data processing method.
According to a fifth aspect of the embodiments of the present disclosure, a kind of computer program product is provided, comprising: when the computer
When instruction in program product is executed by the processor of server, so that server executes audio-video number as described in relation to the first aspect
According to processing method.
The technical scheme provided by this disclosed embodiment can include the following benefits:
The embodiment of the present disclosure provide audio, video data processing scheme, when video data to be processed broadcast state by
When second state is converted to first state, the second information of audio, video data is obtained, and then according to the first letter got in advance
The volume of audio, video data is gradually increased to the first information volume got in advance, first information volume in breath and the second information
Volume when broadcast state including audio, video data is first state.
Technical solution in the embodiment of the present disclosure, in practical applications, network state is bad or the performance of playback equipment
When insufficient, the broadcast state of audio, video data is converted to interrupt status by state in playing, alternatively, in playing audio-video set number
In the case where, current audio data or video data are finished, and waiting plays next audio data or video automatically
When data, the broadcast state of audio, video data is converted to interrupt status, the available first information by state in playing；In network
When the performance recovery of state or playback equipment, the broadcast state of audio, video data is converted to state in broadcasting by interrupt status, can
To obtain the second information.By the relevant treatment to the first information and the second information, the volume of audio, video data is gradually increased
To initial volume, which can be the broadcast sound volume of audio, video data in the first state.The embodiment of the present disclosure is in sound
The broadcast state of video data is converted to interrupt status by state in playing, and when being converted to state in broadcasting by interrupt status,
By carrying out relevant treatment to the first information got and the second information, the volume of audio, video data is gradually increased to initial
Volume avoids the manual operation of user, reduces the operating procedure of user, optimizes user experience.
It should be understood that above general description and following detailed description be only it is exemplary and explanatory, not
The disclosure can be limited.
Detailed description of the invention
The drawings herein are incorporated into the specification and forms part of this specification, and shows and meets implementation of the invention
Example, and be used to explain the principle of the present invention together with specification.
Fig. 1 is a kind of flow chart of the processing method of audio, video data shown according to an exemplary embodiment.
Fig. 2 is the flow chart of the processing method of another audio, video data shown according to an exemplary embodiment.
Fig. 3 is a kind of flow chart of the method for regulation of sound volume of audio, video data shown according to an exemplary embodiment.
Fig. 4 is a kind of block diagram of the processing unit of audio, video data shown according to an exemplary embodiment.
Fig. 5 is a kind of electronic equipment for being handled audio, video data shown according to an exemplary embodiment
Block diagram.
Fig. 6 is a kind of frame of device for being handled audio, video data shown according to an exemplary embodiment
Figure.
Specific embodiment
Example embodiments are described in detail here, and the example is illustrated in the accompanying drawings.Following description is related to
When attached drawing, unless otherwise indicated, the same numbers in different drawings indicate the same or similar elements.Following exemplary embodiment
Described in embodiment do not represent all embodiments consistented with the present invention.On the contrary, they be only with it is such as appended
The example of method and apparatus being described in detail in claims, some aspects of the invention are consistent.
Fig. 1 is a kind of flow chart of the processing method of audio, video data shown according to an exemplary embodiment, such as Fig. 1 institute
Show, the processing method of audio, video data can be used in mobile terminal, include the following steps.
In step s 11, it is converted to when the broadcast state of audio, video data to be processed by preset second state default
First state when, obtain the second information of audio, video data.
Audio, video data in the embodiment of the present disclosure can be audio-video collective data, if audio, video data is audio-video collection
Data J is closed, includes audio data yp1, yp2 and yp3 in audio-video collective data J, also includes in audio-video collective data J
Video data sp1, sp2.Alternatively, audio, video data can be multiple audio datas, the multiple videos in audio-video collective data
Data.If audio, video data is audio data yp1.The embodiment of the present disclosure does not make specifically type, the quantity etc. of audio, video data
Limitation.
In a kind of preferred embodiment of the disclosure, the second state in the broadcast state of audio, video data can be interruption
State, the interrupt status can be the states such as halted state, halted state.First state in the broadcast state of audio, video data
It can be state in broadcasting.It is to be understood that state in the second state, that is, non-broadcasting in the broadcast state of audio, video data, this
Open embodiment is not specifically limited the title etc. of first state and the second state.
The second information in the embodiment of the present disclosure may include the second temporal information, the second information volume and third time letter
Breath.Wherein, the second temporal information may include when the broadcast state of audio, video data is converted to first state by the second state
Real time point, the second information volume may include the initial volume of the process of the subsequent volume that audio, video data is gradually increased,
Third temporal information may include the time span of the process of the subsequent volume that audio, video data is gradually increased.
In step s 12, the first information got according to the second information and in advance, is gradually increased the sound of audio, video data
It measures to the first information volume got in advance.
In the embodiment of the present disclosure, the first information may include first time information and the first information volume.Wherein, first when
Between information may include real time point sum number when the broadcast state of audio, video data is converted to the second state by first state
According to frame time point, the first information volume may include audio, video data broadcast state be first state when volume.Gradually
During the volume for improving audio, video data, audio, video data can be smoothly increased to one from a lower volume
Suitable volume.
Fig. 2 is a kind of flow chart of the processing method of audio, video data shown according to an exemplary embodiment, such as Fig. 2 institute
Show, the processing method of audio, video data can be used in mobile terminal, include the following steps.
In the step s 21, when first thread starts playing audio-video data, the second thread is created.
First thread in the embodiment of the present disclosure can be used for playing audio-video data, which can be set in sound
In the operating system of the playback equipment of video data, in playing audio-video data or before playing audio-video data, starting the
One thread utilizes first thread playing audio-video data.In practical applications, first thread can be playing audio-video data
Application program automatically creates on startup, and first thread may be the thread where the application program of playing audio-video data.
The embodiment of the present disclosure is not specifically limited the title, number, priority etc. of first thread.
The purpose for creating the second thread is, is monitored using broadcast state of second thread to audio, video data.?
In practical application, the second thread can be created when starting first thread, first can also be utilized after starting first thread
Thread starts to create the second thread when playing audio-video data.Second thread of creation can be mutually independent with first thread
Two threads, it can be understood as, operation, stopping, the closing of the operation and the second thread such as operation, stopping, closing of first thread
Equal operations are not interfere with each other.Preferably, first thread can be transmitted with the second thread communication, i.e. first thread to the second thread
Data, signaling etc., the second thread can also transmit data, signaling etc. to first thread.The embodiment of the present disclosure is to creating the second line
Technological means used by journey, and, title, number, priority of the second thread etc. are not specifically limited.
After the second thread creation finishes, it can use the second thread and execute following steps:
In step S22, when the broadcast state of audio, video data is converted to the second state by first state, sound view is obtained
The first information of frequency evidence.
The broadcast state of audio, video data can be obtained by the second thread monitor, audio, video data in the embodiment of the present disclosure
Broadcast state can be divided into first state and the second state, moreover, the broadcast state of audio, video data can in first state and
It is converted between second state.In practical applications, the second thread can periodically or in real time refer to first thread transmission state acquisition
It enables, first thread can return to the broadcast state of audio, video data to the second thread according to state acquisition instruction.Alternatively, First Line
Journey can be periodically or in real time actively to the broadcast state of the second thread transmission audio, video data.First state and the second state can be with
It is utilized respectively preset character string to be indicated, such as " 001 " is utilized to indicate first state, " 000 " is utilized to indicate the second state.This
Open embodiment is not specifically limited the form of expression etc. of first state and the second state.
In a kind of preferred embodiment of the disclosure, the first information may include the first information volume and believe at the first time
Breath.Wherein, the volume that the first information volume can be the broadcast state of audio, video data when being first state, for example, audio-video
Volume of the data M1 in first state is y1, and volume of the audio, video data M1 in the second state is y2, then the first volume is believed
Breath is y1.First time information may include the reality when broadcast state of audio, video data is converted to the second state by first state
Border time point and data-frame times point, for example, the broadcast state of audio, video data M1 is in real time point t1 by first state
The second state is converted to, and is played to the dt1 frame of audio, video data M1 in real time point t1, then first time information includes
Real time point t1 and data-frame times point dt1.
It should be noted that the first information volume in the embodiment of the present disclosure can be the application journey of playing audio-video data
The information volume of sequence, or the information volume of the playback equipment of audio, video data, the information volume and broadcasting of application program
The information volume of equipment can be identical or not identical.It further illustrates in the first time information in the embodiment of the present disclosure
Data-frame times point and real time point, as data-frame times point of the n-th frame in entire audio, video data be " 00 (and when): 12
(dividing): 28 (seconds): 33 (milliseconds) ", real time point when being played to n-th frame be " morning 08 (and when): 31 (minutes): 22 (seconds) ",
The embodiment of the present disclosure is not specifically limited content, the format etc. of the first information volume and first time information.
In a kind of preferred embodiment of the disclosure, when the broadcast state of audio, video data is converted to second by first state
When state, other than the first information of available audio, video data, can also obtain the broadcast state of audio, video data by
First state is converted to the information such as the reason of the second state, for example, the local network connection of the playback equipment of audio, video data is disconnected
Open, the server end of audio, video data occurs abnormal etc., the embodiment of the present disclosure is to the broadcast state of audio, video data by the first shape
State is converted to the reason of the second state and is not specifically limited.
In step S23, when the broadcast state of audio, video data is converted to first state by the second state, sound view is obtained
Second information of frequency evidence.
The broadcast state of audio, video data first can be converted to the second state by first state, then turn again from the second state
It is changed to first state.In a kind of preferred embodiment of the disclosure, the second information may include the second information volume, the second time
Information and third temporal information.Wherein, the second information volume may include the mistake of the subsequent volume that audio, video data is gradually increased
Initial volume in journey.Second temporal information may include that the broadcast state of audio, video data is converted to the first shape by the second state
Real time point when state, for example, the broadcast state of audio, video data M1 is converted in real time point t2 by the second state
First state, then the second temporal information includes real time point t2, and real time point t2 can be real time point.When third
Between information may include the subsequent volume that audio, video data is gradually increased process time span.
It should be noted that if above-mentioned first information volume is the information volume of the application program of playing audio-video data,
Then the second information volume can set for the information volume of application program of playing audio-video data or the broadcasting of audio, video data
Standby information volume.If above-mentioned first information volume is the information volume of the playback equipment of audio, video data, the second volume letter
Breath can be the information volume of the playback equipment of the information volume or audio, video data of the application program of playing audio-video data.
No matter which kind of information volume the first information volume and the second information volume are, the first information volume and the second information volume can be with
It is indicated using decibel.
In a kind of preferred embodiment of the disclosure, when obtaining the second information volume, it can use the second thread and regarded to sound
The playback equipment of frequency evidence sends volume acquisition instruction, and playback equipment obtains according to volume acquisition instruction and returns to the second volume letter
Breath.Second information volume can be the average value of the environmental volume where the associated terminal of playback equipment in preset time period.
For example, preset time period is 1 second, the associated terminal of playback equipment can be the microphone built in playback equipment, or with
The voice collection device of playback equipment connection, then the second information volume can be Mike's elegance of playback terminal in 1 second period
The playback terminal collected environmental volume at ambient average value, alternatively, voice collection device is adopted in 1 second period
The voice collection device collected environmental volume at ambient average value.
In a kind of preferred embodiment of the disclosure, when obtaining the second information volume, if the broadcasting to audio, video data
Equipment sends the failure of volume acquisition instruction, or does not receive the second volume returned from playback equipment according to volume acquisition instruction
Then the second information volume can be calculated according to the first information volume and preset volume coefficient in information, specifically, can incite somebody to action
First information volume and volume multiplication obtain the second information volume.Wherein, volume coefficient can be for greater than 0 and less than 1
The specific value of any number, volume coefficient can be configured according to the actual situation, and the embodiment of the present disclosure is to volume coefficient
Numerical value and unit etc. are not specifically limited.
It, can be according to the second temporal information, the when obtaining third temporal information in a kind of preferred embodiment of the disclosure
Third temporal information is calculated in one temporal information and preset time coefficient, specifically, the second temporal information can be subtracted
The real time in first time information, then by the difference of the real time point in the second temporal information and first time information, multiply
Third temporal information is obtained with time coefficient.Wherein, time coefficient is any number greater than 0 and less than 1, the tool of time coefficient
Body numerical value can be configured according to the actual situation, and the embodiment of the present disclosure does not limit the numerical value of time coefficient and unit etc. specifically
System.
In step s 24, the volume of audio, video data is gradually increased to the first volume with the second information according to the first information
Information.
This step S24 can carry out relevant treatment to the first information and the second information, it is intended that determination is gradually increased
Initial volume, termination volume and time span during the volume of audio, video data.It specifically, can be by audio, video data
Volume adjustment be the second information volume, i.e., using the second information volume as initial volume.Can using the first information volume as
Terminate volume.It can be using the third temporal information corresponding period as time span.It, can during volume is gradually increased
With the data-frame times point since first time information, within the third temporal information corresponding period, by audio, video data
Volume be gradually increased by the second information volume as the first information volume.
In a kind of preferred embodiment of the disclosure, the volume of audio, video data is being gradually increased by the second information volume
When for the first information volume, can first it be determined according to the first information volume, the second information volume and preset volume adjustment threshold value
Volume adjustment stage numerical value determines volume adjustment interval time further according to third temporal information and volume adjustment stage numerical value, most
Afterwards using volume adjustment interval time as the period, the volume of audio, video data is stepped up volume adjustment threshold by the second information volume
Value, until the volume of audio, video data is the first information volume.It specifically, can be by the second information volume and the first volume
The difference of information obtains volume adjustment stage numerical value divided by volume adjustment threshold value.By third temporal information divided by the volume adjustment stage
Numerical value obtains volume adjustment interval time.For example, preset volume adjustment threshold value can be 5 decibels, third temporal information is corresponding
Period when it is 1.2 seconds a length of, the second information volume be 25 decibels, the first information volume be 50 decibels, i.e., in 1.2 second time
The interior volume by audio, video data progressively increases to 50 decibels by 25 decibels.Volume adjustment stage numerical value is (50-25)/5=5,
The volume of audio, video data is progressively increased to 50 decibels by 25 decibels according to 5 stages.Volume adjustment interval time is
1.2/5=0.24 seconds, i.e., increase by 5 decibels every 0.24 second volume by audio, video data.
It should be noted that above-mentioned first state can be state in broadcasting, i.e., in the first state, audio, video data can
With smooth playing；Second state can be interrupt status, i.e., in the second condition, audio, video data can not smooth playing, be in
Pause, stopping or buffer status etc..
Based on the related description of the above-mentioned processing method embodiment about audio, video data, a kind of audio-video number is described below
According to method for regulation of sound volume, as shown in figure 3, when the player thread of audio, video data starts playing audio-video data, creation
Observer's thread, observer's thread are seen for being monitored to the broadcast state of player thread playing audio-video data
The person's of examining thread and player thread are mutually indepedent.When occurring that network speed is slow or the abnormal feelings such as the overlong time of load audio, video data
When condition, the playing process of player thread interrupt audio, video data, observer's thread can obtain the correlation of abnormal conditions at this time
Information, and, broadcast sound volume decibels d0 of the audio, video data before interrupting playing process, and interrupt playing process when
Between stab s0, timestamp s0 may include real time point and data-frame times point.When network speed restores normal or audio-video number
After loaded, player thread will not immediately continue with playing audio-video data, but observer's thread records lower network
Restore normal or audio, video data loaded timestamp s1, timestamp s1 may include real time point, by observer
Thread controls the broadcast sound volume of audio, video data, and then, player thread restores normal play audio, video data.Wherein, it observes
When person's thread controls the broadcast sound volume of audio, video data, it can be obtained and be played by the microphone of the playback equipment of audio, video data
Under the use environment of equipment, for a period of time such as the appropriate decibels d1 in 1 second, if appropriate decibel can not be obtained by microphone
Number d1, then can obtain appropriate decibels d1 multiplied by coefficient x (0 < x < 1) by broadcast sound volume decibels d0.And by timestamp
The difference of real time point in s1 and timestamp s0 obtains period g1 multiplied by coefficient y (0 < y < 1).Then, observer's thread
Can by the volume adjustment of player thread be appropriate decibels d1, since the data-frame times point in timestamp s0, when
Between the volume of audio, video data is gradually increased to broadcast sound volume decibels d0 by appropriate decibels d1 in section g1, so far, observation
Person's thread completes the control process to the broadcast sound volume of audio, video data.Player thread can be according to broadcast sound volume decibels d0
Normal play audio, video data.It should be noted that the technical solution in the embodiment of the present disclosure is in addition to that can be directed to an audio
Data or video data carry out volume adjustment in the case where playing and interrupting, can also be in audio-video collective data
One audio data or video data finish, and carry out sound in the case where waiting next audio data or video data to be played
Amount adjustment.
The processing method for the audio, video data that the embodiment of the present disclosure provides, starts playing audio-video data in first thread
When, the second thread is created, which can be mutually indepedent with first thread, which is audio-video collective data
Or multiple audio datas, multiple video datas in audio-video collective data.In the second thread, when the broadcasting of audio, video data
When state is converted to the second state by first state, the first information of audio, video data is obtained；When the broadcast state of video data
When being converted to first state by the second state, the second information of audio, video data is obtained, and then to the first information and the second information
Relevant treatment is carried out, the volume of audio, video data is gradually increased.
First thread in the embodiment of the present disclosure is responsible for playing audio-video data, and the second thread and first thread are independent, bears
Duty is monitored the broadcast state of audio, video data.In practical applications, network state is bad or the performance of playback equipment
When insufficient, the broadcast state of audio, video data is converted to interrupt status by state in playing, alternatively, in playing audio-video set number
In the case where, current audio data or video data are finished, and waiting plays next audio data or video automatically
When data, the broadcast state of audio, video data is converted to interrupt status, available first letter of the second thread by state in playing
Breath；In the performance recovery of network state or playback equipment, the broadcast state of audio, video data is converted to broadcasting by interrupt status
Middle state, available second information of the second thread.By the second thread to the relevant treatment of the first information and the second information, with
The volume of audio, video data is gradually increased to initial volume, which can be audio, video data broadcasting in the first state
Playback amount.The embodiment of the present disclosure is converted to interrupt status by state in playing in the broadcast state of audio, video data, and by interrupting
When state is converted to state in broadcasting, relevant treatment is carried out to the first information got and the second information by the second thread,
Volume audio, video data is gradually increased avoids the manual operation of user, reduces the operation step of user to initial volume
Suddenly, user experience is optimized.
Fig. 4 is a kind of block diagram of the processing unit of audio, video data shown according to an exemplary embodiment.Reference Fig. 4,
The apparatus may include obtain module 41 and improve module 42.Wherein, the acquisition module 41 and the raising module 42 connection
And/or communication.
The acquisition module 41 is configured as the broadcast state when audio, video data to be processed by preset second state
When being converted to preset first state, the second information of the audio, video data is obtained；The raising module 42, is configured as root
The volume of the audio, video data is gradually increased to getting in advance in the first information got according to second information and in advance
The first information volume, first information volume include the audio, video data broadcast state be the first state when
Volume.
In a kind of preferred embodiment of the disclosure, the acquisition module 41 is additionally configured to when the audio, video data
Broadcast state when being converted to second state by the first state, obtain the first information of the audio, video data.
In a kind of preferred embodiment of the disclosure, the acquisition module 41 is configured as when the audio, video data
When broadcast state is converted to second state by the first state, obtain the audio, video data first time information and
First information volume；Wherein, the first time information includes the broadcast state of the audio, video data by described first
State is converted to the real time point and data-frame times point when second state.
In a kind of preferred embodiment of the disclosure, the acquisition module 41 is configured as when the audio, video data
When broadcast state is converted to the first state by second state, obtain the audio, video data the second temporal information,
Second information volume and third temporal information；Wherein, second temporal information includes the broadcast state of the audio, video data
The real time point when first state is converted to by second state, second information volume is gradually mentioned including described
The sound is gradually increased including described in the initial volume of the process of the volume of the high audio, video data, the third temporal information
The time span of the process of the volume of video data.
In a kind of preferred embodiment of the disclosure, the acquisition module 41 is configured as to the audio, video data
Playback equipment sends volume acquisition instruction, and receives from the playback equipment according to volume acquisition instruction return
Second information volume；Wherein, second information volume is in preset time period, and the associated terminal of the playback equipment is got
Environmental volume average value.
In a kind of preferred embodiment of the disclosure, the acquisition module 41 is configured as to the audio, video data
Playback equipment send the failure of volume acquisition instruction, or do not receive from the playback equipment according to the volume acquisition instruction
When second information volume returned, described second is calculated according to first information volume and preset volume coefficient
Information volume.
In a kind of preferred embodiment of the disclosure, the acquisition module 41 is configured as being believed according to second time
Breath, the first time information and preset time coefficient, are calculated the third temporal information.
In a kind of preferred embodiment of the disclosure, the raising module 42, comprising: the tune for being connected with each other and/or communicating
Whole submodule 421 and raising submodule 422.Wherein, the adjusting submodule 421 is configured as the audio, video data
Volume adjustment is second information volume；The raising submodule 422, the number being configured as from the first time information
Start according to frame time point, in the third temporal information by the volume of the audio, video data by second information volume by
Gradually rise to first information volume.
In a kind of preferred embodiment of the disclosure, the raising submodule 422 is configured as according to first volume
Information, second information volume and preset volume adjustment threshold value determine volume adjustment stage numerical value；When according to the third
Between information and the volume adjustment stage numerical value determine volume adjustment interval time；It is week with the volume adjustment interval time
The volume of the audio, video data is stepped up the volume adjustment threshold value by second information volume by the phase, until described
Until the volume of audio, video data is first information volume；Wherein, the volume adjustment stage numerical value is for indicating described
The volume of audio, video data is in each period increased numerical value.
In a kind of preferred embodiment of the disclosure, the first state includes state in playing, the second state packet
Include interrupt status.
About the device in above-described embodiment, wherein modules execute the concrete mode of operation in related this method
Embodiment in be described in detail, no detailed explanation will be given here.
Fig. 5 is a kind of electronic equipment for being handled audio, video data shown according to an exemplary embodiment
500 block diagram.Electronic equipment 500 can be mobile phone, computer, digital broadcasting terminal, messaging device, game control
Platform, tablet device, Medical Devices, body-building equipment, personal digital assistant etc..Electronic equipment 500 may include with next or more
A component: processing component 502, memory 504, power supply module 506, multimedia component 508, audio component 510, input/output
(I/O) interface 512, sensor module 514 and communication component 516.
The integrated operation of the usual controlling electronic devices 500 of processing component 502, such as with display, call, data are logical
Letter, camera operation and record operate associated operation.Processing component 502 may include one or more processors 520 to hold
Row instruction, to perform all or part of the steps of the methods described above.In addition, processing component 502 may include one or more moulds
Block, convenient for the interaction between processing component 502 and other assemblies.For example, processing component 502 may include multi-media module, with
Facilitate the interaction between multimedia component 508 and processing component 502.
Memory 504 is configured as storing various types of data to support the operation in electronic equipment 500.These data
Example include any application or method for being operated on electronic equipment 500 instruction, contact data, telephone directory
Data, message, picture, video etc..Memory 504 can by any kind of volatibility or non-volatile memory device or it
Combination realize, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM) is erasable
Except programmable read only memory (EPROM), programmable read only memory (PROM), read-only memory (ROM), magnetic memory, fastly
Flash memory, disk or CD.
Power supply module 506 provides electric power for the various assemblies of electronic equipment 500.Power supply module 506 may include power supply pipe
Reason system, one or more power supplys and other with for electronic equipment 500 generate, manage, and distribute the associated component of electric power.
Multimedia component 508 includes the screen of one output interface of offer between the electronic equipment 500 and user.
In some embodiments, screen may include liquid crystal display (LCD) and touch panel (TP).If screen includes touch surface
Plate, screen may be implemented as touch screen, to receive input signal from the user.Touch panel includes one or more touches
Sensor is to sense the gesture on touch, slide, and touch panel.The touch sensor can not only sense touch or sliding
The boundary of movement, but also detect duration and pressure associated with the touch or slide operation.In some embodiments,
Multimedia component 508 includes a front camera and/or rear camera.When electronic equipment 500 is in operation mode, as clapped
When taking the photograph mode or video mode, front camera and/or rear camera can receive external multi-medium data.It is each preposition
Camera and rear camera can be a fixed optical lens system or have focusing and optical zoom capabilities.
Audio component 510 is configured as output and/or input audio signal.For example, audio component 510 includes a Mike
Wind (MIC), when electronic equipment 500 is in operation mode, when such as call mode, recording mode, and voice recognition mode, microphone
It is configured as receiving external audio signal.The received audio signal can be further stored in memory 504 or via logical
Believe that component 516 is sent.In some embodiments, audio component 510 further includes a loudspeaker, is used for output audio signal.
I/O interface 512 provides interface between processing component 502 and peripheral interface module, and above-mentioned peripheral interface module can
To be keyboard, click wheel, button etc..These buttons may include, but are not limited to: home button, volume button, start button and lock
Determine button.
Sensor module 514 includes one or more sensors, for providing the state of various aspects for electronic equipment 500
Assessment.For example, sensor module 514 can detecte the state that opens/closes of electronic equipment 500, the relative positioning of component, example
As the component be electronic equipment 500 display and keypad, sensor module 514 can also detect electronic equipment 500 or
The position change of 500 1 components of electronic equipment, the existence or non-existence that user contacts with electronic equipment 500, electronic equipment 500
The temperature change of orientation or acceleration/deceleration and electronic equipment 500.Sensor module 514 may include proximity sensor, be configured
For detecting the presence of nearby objects without any physical contact.Sensor module 514 can also include optical sensor,
Such as CMOS or ccd image sensor, for being used in imaging applications.In some embodiments, which may be used also
To include acceleration transducer, gyro sensor, Magnetic Sensor, pressure sensor or temperature sensor.
Communication component 516 is configured to facilitate the communication of wired or wireless way between electronic equipment 500 and other equipment.
Electronic equipment 500 can access the wireless network based on communication standard, such as WiFi, carrier network (such as 2G, 3G, 4G or 5G),
Or their combination.In one exemplary embodiment, communication component 516 receives via broadcast channel and comes from external broadcasting management
The broadcast singal or broadcast related information of system.In one exemplary embodiment, the communication component 516 further includes that near field is logical
(NFC) module is believed, to promote short range communication.For example, radio frequency identification (RFID) technology, infrared data association can be based in NFC module
Meeting (IrDA) technology, ultra wide band (UWB) technology, bluetooth (BT) technology and other technologies are realized.
In the exemplary embodiment, electronic equipment 500 can be by one or more application specific integrated circuit (ASIC), number
Word signal processor (DSP), digital signal processing appts (DSPD), programmable logic device (PLD), field programmable gate array
(FPGA), controller, microcontroller, microprocessor or other electronic components are realized, for executing the above method.
In the exemplary embodiment, a kind of non-transitorycomputer readable storage medium including instruction, example are additionally provided
It such as include the memory 504 of instruction, above-metioned instruction can be executed by the processor 520 of electronic equipment 500 to complete the above method.Example
Such as, the non-transitorycomputer readable storage medium can be ROM, random access memory (RAM), CD-ROM, tape, soft
Disk and optical data storage devices etc..
Fig. 6 is a kind of device 600 for being handled audio, video data shown according to an exemplary embodiment
Block diagram.For example, device 600 may be provided as a server or electronic equipment.Referring to Fig. 6, device 600 includes processing component
622, it further comprise one or more processors, and the memory resource as representated by memory 632, it can for storing
By the instruction of the execution of processing component 622, such as application program.The application program stored in memory 632 may include one
Or it is more than one each correspond to one group of instruction module.In addition, processing component 622 is configured as executing instruction, to hold
The processing method of the above-mentioned audio, video data of row.
Device 600 can also include the power management that a power supply module 626 is configured as executive device 600, and one has
Line or radio network interface 650 are configured as device 600 being connected to network and input and output (I/O) interface 558.Dress
Setting 600 can operate based on the operating system for being stored in memory 632, such as Windows ServerTM, Mac OS XTM,
UnixTM, LinuxTM, FreeBSDTM or similar.
The embodiment of the present disclosure can also provide a kind of computer program product, the instruction in the computer program product
When being executed by the processor of server, device or electronic equipment, so that server, device or electronic equipment are able to carry out above-mentioned sound
The processing method of video data.
Those skilled in the art after considering the specification and implementing the invention disclosed here, will readily occur to of the invention its
Its embodiment.This application is intended to cover any variations, uses, or adaptations of the invention, these modifications, purposes or
Person's adaptive change follows general principle of the invention and including the undocumented common knowledge in the art of the disclosure
Or conventional techniques.The description and examples are only to be considered as illustrative, and true scope and spirit of the invention are by following
Claim is pointed out.
It should be understood that the present invention is not limited to the precise structure already described above and shown in the accompanying drawings, and
And various modifications and changes may be made without departing from the scope thereof.The scope of the present invention is limited only by the attached claims.
Claims (10)
1. a kind of processing method of audio, video data characterized by comprising
When the broadcast state of audio, video data to be processed is converted to preset first state by preset second state, obtain
Second information of the audio, video data；
The volume of the audio, video data is gradually increased to preparatory in the first information got according to second information and in advance
The first information volume got, first information volume include that the broadcast state of the audio, video data is first shape
Volume when state.
2. the processing method of audio, video data according to claim 1, which is characterized in that obtain the first information in advance
The step of, comprising:
When the broadcast state of the audio, video data is converted to second state by the first state, the sound view is obtained
The first information of frequency evidence.
3. the processing method of audio data according to claim 2, which is characterized in that described when the audio, video data
When broadcast state is converted to second state by the first state, the step of the first information of the audio, video data is obtained
Suddenly, comprising:
When the broadcast state of the audio, video data is converted to second state by the first state, the sound view is obtained
The first time information of frequency evidence and first information volume；
Wherein, the first time information include the audio, video data broadcast state be converted to by the first state it is described
Real time point and data-frame times point when the second state.
4. the processing method of audio, video data according to claim 3, which is characterized in that described to work as audio-video to be processed
When the broadcast state of data is converted to preset first state by preset second state, the second of the audio, video data is obtained
The step of information, comprising:
When the broadcast state of the audio, video data is converted to the first state by second state, the sound view is obtained
The second temporal information, the second information volume and the third temporal information of frequency evidence；
Wherein, second temporal information include the audio, video data broadcast state be converted to by second state it is described
Real time point when first state, second information volume include the volume that the audio, video data is gradually increased
The initial volume of process, the third temporal information include the process of the volume that the audio, video data is gradually increased when
Between length.
5. the processing method of audio, video data according to claim 4, which is characterized in that described to obtain the audio-video number
According to the second information volume the step of, comprising:
Volume acquisition instruction is sent to the playback equipment of the audio, video data, and is received from the playback equipment according to
Second information volume that volume acquisition instruction returns；
Wherein, second information volume is the ambient sound that the associated terminal of the playback equipment is got in preset time period
The average value of amount.
6. the processing method of audio, video data according to claim 5, which is characterized in that described to obtain the audio-video number
According to the second information volume the step of, comprising:
The failure of volume acquisition instruction is being sent to the playback equipment of the audio, video data, or is not receiving and is set from the broadcasting
When standby second information volume returned according to the volume acquisition instruction, according to first information volume and preset sound
Second information volume is calculated in coefficient of discharge.
7. the processing method of audio, video data according to claim 4, which is characterized in that described to obtain the audio-video number
According to third temporal information the step of, comprising:
According to second temporal information, the first time information and preset time coefficient, when the third is calculated
Between information.
8. a kind of processing unit of audio, video data characterized by comprising
Obtain module, be configured as the broadcast state when audio, video data to be processed be converted to by preset second state it is default
First state when, obtain the second information of the audio, video data；
Module is improved, the first information got according to second information and in advance is configured as, the sound view is gradually increased
The volume of frequency evidence to the first information volume got in advance, first information volume includes broadcasting for the audio, video data
Put volume when state is the first state.
9. a kind of electronic equipment characterized by comprising
Processor；
For storing the memory of the processor-executable instruction；
Wherein, the processor is configured to executing the processing side of the audio, video data as described in any one of claims 1 to 7
Method.
10. a kind of non-transitorycomputer readable storage medium, which is characterized in that when the instruction in the storage medium is by moving
When the processor of terminal executes, so that audio, video data of the mobile terminal execution as described in any one of claims 1 to 7
Processing method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910186326.0A CN110062276A (en) | 2019-03-12 | 2019-03-12 | Processing method, device and the electronic equipment and storage medium of audio, video data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910186326.0A CN110062276A (en) | 2019-03-12 | 2019-03-12 | Processing method, device and the electronic equipment and storage medium of audio, video data |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110062276A true CN110062276A (en) | 2019-07-26 |
Family
ID=67316799
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910186326.0A Pending CN110062276A (en) | 2019-03-12 | 2019-03-12 | Processing method, device and the electronic equipment and storage medium of audio, video data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110062276A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112689173A (en) * | 2020-12-23 | 2021-04-20 | 海信视像科技股份有限公司 | Display device and volume control method |
| CN114125545A (en) * | 2021-11-29 | 2022-03-01 | 北京达佳互联信息技术有限公司 | Video information processing method and device, electronic equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160126910A1 (en) * | 2004-05-15 | 2016-05-05 | Sonos, Inc. | Power Increase Based on Packet Type |
| CN105653236A (en) * | 2016-01-29 | 2016-06-08 | 北京小米移动软件有限公司 | Sound volume control method and device and mobile terminal |
| CN105679342A (en) * | 2015-12-30 | 2016-06-15 | 广东欧珀移动通信有限公司 | Control method and device of playing device |
| CN106126179A (en) * | 2016-06-24 | 2016-11-16 | 联想(北京)有限公司 | A kind of information processing method and electronic equipment |
| CN106302930A (en) * | 2016-08-31 | 2017-01-04 | 上海与德通讯技术有限公司 | The control method of a kind of volume and adjusting means |
| CN108769798A (en) * | 2018-06-01 | 2018-11-06 | 深圳市茁壮网络股份有限公司 | A kind of method of adjustment and system of volume |
-
2019
- 2019-03-12 CN CN201910186326.0A patent/CN110062276A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160126910A1 (en) * | 2004-05-15 | 2016-05-05 | Sonos, Inc. | Power Increase Based on Packet Type |
| CN105679342A (en) * | 2015-12-30 | 2016-06-15 | 广东欧珀移动通信有限公司 | Control method and device of playing device |
| CN105653236A (en) * | 2016-01-29 | 2016-06-08 | 北京小米移动软件有限公司 | Sound volume control method and device and mobile terminal |
| CN106126179A (en) * | 2016-06-24 | 2016-11-16 | 联想(北京)有限公司 | A kind of information processing method and electronic equipment |
| CN106302930A (en) * | 2016-08-31 | 2017-01-04 | 上海与德通讯技术有限公司 | The control method of a kind of volume and adjusting means |
| CN108769798A (en) * | 2018-06-01 | 2018-11-06 | 深圳市茁壮网络股份有限公司 | A kind of method of adjustment and system of volume |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112689173A (en) * | 2020-12-23 | 2021-04-20 | 海信视像科技股份有限公司 | Display device and volume control method |
| CN114125545A (en) * | 2021-11-29 | 2022-03-01 | 北京达佳互联信息技术有限公司 | Video information processing method and device, electronic equipment and storage medium |
| CN114125545B (en) * | 2021-11-29 | 2024-03-12 | 北京达佳互联信息技术有限公司 | Video information processing method, device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6811758B2 (en) | Voice interaction methods, devices, devices and storage media | |
| CN110634483B (en) | Man-machine interaction method and device, electronic equipment and storage medium | |
| CN108538291A (en) | Sound control method, terminal device, cloud server and system | |
| CN107105314A (en) | Video broadcasting method and device | |
| EP3933570A1 (en) | Method and apparatus for controlling a voice assistant, and computer-readable storage medium | |
| CN106371802A (en) | Terminal volume control method and device | |
| CN104320688A (en) | Video play control method and device | |
| CN107147957B (en) | Video broadcasting method and device | |
| CN109348239A (en) | Piece stage treatment method, device, electronic equipment and storage medium is broadcast live | |
| RU2666626C1 (en) | Playback state controlling method and device | |
| EP3779968A1 (en) | Audio processing | |
| CN109451341A (en) | Video broadcasting method, video play device, electronic equipment and storage medium | |
| CN110730360A (en) | Video uploading and playing methods and devices, client equipment and storage medium | |
| CN111696553A (en) | Voice processing method and device and readable medium | |
| CN110349578A (en) | Equipment wakes up processing method and processing device | |
| CN110062276A (en) | Processing method, device and the electronic equipment and storage medium of audio, video data | |
| WO2021051588A1 (en) | Data processing method and apparatus, and apparatus used for data processing | |
| CN106254633B (en) | Handset mode method of adjustment and device | |
| US11553019B2 (en) | Method, apparatus, electronic device and storage medium for acquiring programs in live streaming room | |
| CN108766427B (en) | Voice control method and device | |
| CN112217987B (en) | Shooting control method and device and storage medium | |
| CN112509596A (en) | Wake-up control method and device, storage medium and terminal | |
| CN108874450A (en) | Wake up the method and device of voice assistant | |
| CN110798721B (en) | Episode management method and device and electronic equipment | |
| CN113655984A (en) | Audio playback control method, audio playback control device, and computer storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190726 |