CN109286841A - Film sound effect treatment method and Related product - Google Patents
Film sound effect treatment method and Related product Download PDFInfo
- Publication number
- CN109286841A CN109286841A CN201811209949.7A CN201811209949A CN109286841A CN 109286841 A CN109286841 A CN 109286841A CN 201811209949 A CN201811209949 A CN 201811209949A CN 109286841 A CN109286841 A CN 109286841A
- Authority
- CN
- China
- Prior art keywords
- video
- outdoor
- indoor
- audio
- scene
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
- H04N21/4394—Processing of audio elementary streams involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
- H04N21/4398—Processing of audio elementary streams involving reformatting operations of audio signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
Abstract
The embodiment of the present application discloses a kind of film sound effect treatment method and Related product, and described method includes following steps: determining film video to be played, extracts video requency frame data and audio frame number evidence in film video；The indoor scene section and outdoor scene section determined in video requency frame data is analyzed video requency frame data, scene interval corresponding indoor period and the outdoor period in outdoor scene section in extraction chamber；When film video is played to the indoor period, the audio frame number of indoor period is played according to using interior 3D audio strategy, when film video is played to the outdoor period, the audio frame number of outdoor period is played according to using outdoor 3D audio strategy.Technical solution provided by the present application has the advantages that user experience is high.
Description
Technical field
This application involves Audiotechnica fields, and in particular to a kind of film sound effect treatment method and Related product.
Background technique
With a large amount of popularization and applications of electronic equipment (such as mobile phone, tablet computer), the application that electronic equipment can be supported
More and more, function is stronger and stronger, and electronic equipment develops towards diversification, personalized direction, becomes in user's life not
The appliance and electronic that can lack, the frequency applications that film class is applied as electronic equipment, the video of existing film are based on around vertical
Body sound, equipment of the effect based on audio is played of audio, for example, the effect that speaker, earphone play the same video is i.e. different,
The actual scene played for film is embodied by video, processing is not distinguished to audio, therefore existing film plays
Audio indistinguishable film scene, influence user experience.
Summary of the invention
The embodiment of the present application provides a kind of film sound effect treatment method and Related product, can be according to the actual field of film
Scape handles audio, promotes user experience.
In a first aspect, the embodiment of the present application provides a kind of film sound effect treatment method, described method includes following steps:
It determines film video to be played, extracts video requency frame data and audio frame number evidence in film video；
The indoor scene section and outdoor scene section determined in video requency frame data is analyzed video requency frame data, in extraction chamber
Scene interval corresponding indoor period and the outdoor period in outdoor scene section；
When film video is played to the indoor period, to the audio frame number of indoor period according to using interior 3D audio plan
It slightly plays, when film video is played to the outdoor period, to the audio frame number of outdoor period according to using outdoor 3D audio plan
Slightly play.
Second aspect, provides a kind of film sound-effect processing equipment, and the film sound-effect processing equipment includes:
Acquiring unit extracts video requency frame data and audio in film video for determining film video to be played
Frame data；
Resolution unit, for analyzing video requency frame data the indoor scene section and the outdoor scene that determine in video requency frame data
Section, scene interval corresponding indoor period and the outdoor period in outdoor scene section in extraction chamber；
Broadcast unit, for being adopted to the audio frame number evidence of indoor period when film video is played to the indoor period
It is played with indoor 3D audio strategy, when film video is played to the outdoor period, the audio frame number evidence of outdoor period is adopted
It is played with outdoor 3D audio strategy.
The third aspect, the embodiment of the present application provide a kind of electronic equipment, including processor, memory, communication interface, and
One or more programs, wherein said one or multiple programs are stored in above-mentioned memory, and are configured by above-mentioned
It manages device to execute, above procedure is included the steps that for executing the instruction in the embodiment of the present application first aspect.
Fourth aspect, the embodiment of the present application provide a kind of computer readable storage medium, wherein above-mentioned computer-readable
Storage medium storage is used for the computer program of electronic data interchange, wherein above-mentioned computer program executes computer such as
Step some or all of described in the embodiment of the present application first aspect.
5th aspect, the embodiment of the present application provide a kind of computer program product, wherein above-mentioned computer program product
Non-transient computer readable storage medium including storing computer program, above-mentioned computer program are operable to make to calculate
Machine executes the step some or all of as described in the embodiment of the present application first aspect.The computer program product can be one
A software installation packet.
As can be seen that technical solution provided by the present application obtains film video when determining film video to be played
Then video requency frame data and audio frame number evidence carry out video requency frame data analyzing determining indoor scene section and outdoor scene
Section, it is the time that it is corresponding, which then to extract the indoor scene section, uses different 3D audio plans for the time of different scenes
Slightly, it can allow user that can experience indoor and outdoor difference from audio and video in this way, to increase audio
Effect improves user experience.
Detailed description of the invention
In order to illustrate the technical solutions in the embodiments of the present application or in the prior art more clearly, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of application for those of ordinary skill in the art without creative efforts, can be with
It obtains other drawings based on these drawings.
Fig. 1 is the structural schematic diagram of a kind of electronic equipment provided by the embodiments of the present application；
Fig. 2 is a kind of flow diagram of film sound effect treatment method disclosed in the embodiment of the present application；
Fig. 3 is the flow diagram of another kind film sound effect treatment method disclosed in the embodiment of the present application；
Fig. 4 is a kind of structural schematic diagram of film sound-effect processing equipment disclosed in the embodiment of the present application；
Fig. 5 is the structural schematic diagram of another kind electronic equipment disclosed in the embodiment of the present application.
Specific embodiment
In order to make those skilled in the art more fully understand application scheme, below in conjunction in the embodiment of the present application
Attached drawing, the technical scheme in the embodiment of the application is clearly and completely described, it is clear that described embodiment is only
Some embodiments of the present application, instead of all the embodiments.Based on the embodiment in the application, those of ordinary skill in the art
Every other embodiment obtained without creative efforts, shall fall in the protection scope of this application.
The description and claims of this application and term " first " in above-mentioned attached drawing, " second " etc. are for distinguishing
Different objects, are not use to describe a particular order.In addition, term " includes " and " having " and their any deformations, it is intended that
It is to cover and non-exclusive includes.Such as the process, method, system, product or equipment for containing a series of steps or units do not have
It is defined in listed step or unit, but optionally further comprising the step of not listing or unit, or optionally also wrap
Include other step or units intrinsic for these process, methods, product or equipment.
Referenced herein " embodiment " is it is meant that a particular feature, structure, or characteristic described can wrap in conjunction with the embodiments
It is contained at least one embodiment of the application.Each position in the description occur the phrase might not each mean it is identical
Embodiment, nor the independent or alternative embodiment with other embodiments mutual exclusion.Those skilled in the art explicitly and
Implicitly understand, embodiment described herein can be combined with other embodiments.
Electronic equipment involved by the embodiment of the present application may include the various handheld devices with wireless communication function
(such as smart phone), mobile unit, virtual reality (virtual reality, VR)/augmented reality (augmented
Reality, AR) equipment, wearable device calculates equipment or is connected to other processing equipments of radio modem, and
Various forms of user equipmenies (user equipment, UE), mobile station (mobile station, MS), terminal device
(terminal device), research and development/test platform, server etc..For convenience of description, apparatus mentioned above is referred to as electricity
Sub- equipment.
In the specific implementation, electronic equipment can use audio data (sound that sound source issues) in the embodiment of the present application
HRTF (Head Related Transfer Function, head related transfer function) filter is filtered, and obtains virtual ring
Around sound, also referred to as surround sound or panorama sound, a kind of 3 D stereo sound effect is realized.Title of the HRTF corresponding to time-domain
It is HRIR (Head Related Impulse Response).Or by audio data and binaural room impulse response
(Binaural Room Impulse Response, BRIR) does convolution, and binaural room impulse response is made of three parts: straight
Up to sound, reflection and reverberation.
Referring to Fig. 1, Fig. 1 is the structural schematic diagram of a kind of electronic equipment provided by the embodiments of the present application, electronic equipment packet
Control circuit and input-output circuit are included, imput output circuit connects to the control circuit.
Wherein, control circuit may include storage and processing circuit.Storage circuit in the storage and processing circuit can be with
It is memory, such as hard drive memory, nonvolatile memory (such as flash memory or it is used to form the other of solid state drive
Electrically programmable read only memory etc.), volatile memory (such as either statically or dynamically random access memory etc.) etc., the application
Embodiment is with no restriction.Processing circuit in storage and processing circuit can be used for the operating of controlling electronic devices.Processing electricity
Road can microprocessor based on one or more, microcontroller, digital signal processor, baseband processor, power management unit,
Audio codec chip, specific integrated circuit, display-driver Ics etc. are realized.
Storage and processing circuit can be used for running the software in electronic equipment, such as play incoming call prompting jingle bell application journey
Sequence, play short message prompt jingle bell application program, play alarm clock prompting jingle bell application program, play media file application program,
Voice over internet protocol (voice over internet protocol, VOIP) call application program, operating system function
Energy is equal.These softwares can be used for executing some control operations, for example, playing incoming call prompting jingle bell, playing short message prompt sound
Other functions etc. in bell, broadcasting alarm clock prompting jingle bell, broadcasting media file, progress voice telephone calls and electronic equipment,
The embodiment of the present application is with no restriction.
Wherein, input-output circuit can be used for that electronic equipment is made to realize outputting and inputting for data, i.e. permission electronic equipment
From outer equipment receiving data and electronic equipment is allowed to export data to external equipment from electronic equipment.
Input-output circuit may further include sensor.Sensor may include ambient light sensor, based on light and
The infrared proximity transducer of capacitor, ultrasonic sensor, touch sensor is (for example, be based on light touch sensor and/or condenser type
Touch sensor, wherein touch sensor can be a part of touching display screen, can also be used as a touch sensor knot
Structure independently uses), acceleration transducer, gravity sensor and other sensors etc..Input-output circuit can also be further
Including audio component, audio component can be used for providing audio input and output function for electronic equipment.Audio component can be with
Including tone generator and other components for being used to generate and detect sound.
Input-output circuit can also include one or more display screens.Display screen may include liquid crystal display, organic
Light emitting diode (LED) display screen, electric ink display screen, plasma panel, using a kind of in the display screen of other display technologies or
Several combination of person.Display screen may include touch sensor array (that is, display screen can be touching display screen).Touch sensing
Device can be the capacitance touch sensing formed by transparent touch sensor electrode (such as tin indium oxide (ITO) electrode) array
Device, or can be the touch sensor formed using other touching techniques, such as sound wave touch-control, pressure sensible touch, resistive touch,
Optical touch etc., the embodiment of the present application is with no restriction.
Input-output circuit, which can further include telecommunication circuit, can be used for providing for electronic equipment and external equipment
The ability of communication.Telecommunication circuit may include analog- and digital- input-output interface circuit, and be based on radiofrequency signal and/or light
The radio communication circuit of signal.Radio communication circuit in telecommunication circuit may include radio-frequency transceiver circuitry, power amplifier
Circuit, low-noise amplifier, switch, filter and antenna.For example, the radio communication circuit in telecommunication circuit may include
For supported by emitting and receiving near-field coupling electromagnetic signal near-field communication (near field communication,
NFC circuit).For example, telecommunication circuit may include near-field communication aerial and near-field communication transceiver.Telecommunication circuit can also wrap
Include cellular telephone transceiver and antenna, wireless lan transceiver circuit and antenna etc..
Input-output circuit can further include other input-output units.Input-output unit may include
Button, control stick, click wheel, scroll wheel, touch tablet, keypad, keyboard, camera, light emitting diode and other state instructions
Device etc..
Wherein, electronic equipment can further include battery (not shown), and battery provides electric energy for electron equipment.
Film is to combine a kind of continuous image frame to grow up by activity photography and diaprojection art, is one
Door vision and the sense of hearing modern art and one can accommodate drama, photography, drawing, music, dancing, text, sculpture, build
The modern science and technology of a variety of art and the synthesis of art such as build.
Film most start it is most of shown in special place, such as cinema, with electronic equipment development and
The development of the communication technology, electronic equipment such as smart phone also becomes the equipment that film often plays, relative in cinema
Configuration, electronic equipment can want far short of what is expected to the processing of audio.But for film, the experience of user includes video tastes
And audio experience promotes mainly through display screen technology, for audio experience, existing electronics video tastes
Equipment, which has no, executes special process flow to film, therefore affects user to the Experience Degree of movie audio.
Experience for film, higher target are to restore scene to viewer, that is, allow viewer to enjoy on the spot in person
Experience, such as existing 5D film etc., be the experience that viewer is improved by some technological means.So, for life
In scene living, for example, the audio data heard in scene indoors is different with the audio data heard in outdoor scene.
Specifically, often occur the scene of some explosions, fight in film scene, the audio data in the scene, if viewer
Indoors or outdoor, the effect heard in practice is entirely different, but is not set in electronics in the broadcasting of existing film
Standby middle experience is different, and then affects user experience.
It describes in detail below to the embodiment of the present application.
Referring to Fig. 2, Fig. 2 is a kind of flow diagram of film sound effect treatment method disclosed in the embodiment of the present application, answer
For electronic equipment described in above-mentioned Fig. 1, which includes the following steps:
Step S201, it determines film video to be played, extracts video requency frame data and audio frame number in film video
According to；
Determine that film video to be played can specifically include in above-mentioned steps S201:
Obtain electronic equipment operation video app play film video mark, according to the film video identify determine to
The film video of broadcasting, film video mark includes but is not limited to: film ID number, movie name etc..
Video requency frame data and the audio frame number evidence extracted in film video in above-mentioned steps S201 can specifically include:
By the video data and the isolated video requency frame data of audio data and audio frame number evidence in film video, video frame
Data include: video frame and video frame corresponding time, which includes: audio frame and audio frame corresponding time.
Step S202, the indoor scene section and outdoor scene area that determine in video requency frame data is analyzed video requency frame data
Between, scene interval corresponding indoor period and the outdoor period in outdoor scene section in extraction chamber；
Step S203, when film video is played to the indoor period, to the audio frame number of indoor period according to using room
Interior 3D audio strategy plays, when film video is played to the outdoor period, to the audio frame number of outdoor period according to using room
Outer 3D audio strategy plays.
Optionally, above-mentioned interior 3D audio strategy broadcasting includes but is not limited to: reducing volume, increases echo etc. mode.
Above-mentioned outdoor 3D audio strategy broadcasting can specifically include: filtering echo, reduction highest volume etc..
Technical solution provided by the present application obtains the video requency frame data of film video when determining film video to be played
And audio frame number evidence, then video requency frame data is carried out to analyze determining indoor scene section and outdoor scene section, then
It is the time that it is corresponding, which to extract the indoor scene section, uses different 3D audio strategies for the time of different scenes, so i.e.
It can allow user that can experience indoor and outdoor difference from audio and video, to increase the effect of audio, improve
User experience.
Optionally, in above-mentioned steps S202 to video requency frame data analyze determine video requency frame data in indoor scene section and
Outdoor scene section can specifically include:
Frame video data transmission every in video requency frame data is executed to sorting algorithm to handle to obtain into trained classifier
Multiple video frames of indoor scene and multiple video frames of outdoor scene are big by continuous time in multiple video frames of indoor scene
It is determined as indoor scene section in the video frame of preset time, continuous time in multiple video frames of outdoor scene is greater than default
The video frame of time is determined as outdoor scene section.
Above-mentioned preset time is specifically as follows 2s, naturally it is also possible to for other values, on the embodiment of the present application is not limited to
State the specific value of preset time.
Above-mentioned classifier includes but is not limited to: machine learning, neural network model, deep learning model etc. have classification
The algorithm model of function.
Indoor scene section is determined to determine how from the video frame that classifier obtains with an actual example below,
It for the picture of film, is found by data statistics, the switching of indoor scene and outdoor scene will not quickly, i.e., if it is room
Interior scene, then its generally can it is for 2 seconds more than, similarly, outdoor scene is equally applicable.So to the continuous of video frame
Time, which is counted, to reject the noise data that classifier generates.
Specifically, what such as classifier determined, video frame 1- video frame 1000 is indoor scene, extracts video 1- video
1000 duration x determines that video frame 1- video frame 1000 is indoor scene section if x is greater than 2 seconds.
It is, of course, also possible to determine indoor scene section and outdoor scene section by quantity, can specifically include:
Frame video data transmission every in video requency frame data is executed to sorting algorithm to handle to obtain into trained classifier
Multiple video frames of indoor scene and multiple video frames of outdoor scene, by continuous number of frames in multiple video frames of indoor scene
Video frame greater than amount threshold is determined as indoor scene section, and number of frames continuous in multiple video frames of outdoor scene is greater than
The video frame of amount threshold is determined as outdoor scene section.
Specifically, what such as classifier determined, video frame 1- video frame 1000 is indoor scene, extracts video 1- video
1000 lasting quantity is 1000, it is assumed that amount threshold 100, it is determined that video frame 1- video frame 1000 is indoor scene area
Between.
Certainly, above scheme can also be determined as follows indoor scene section and outdoor scene section, specifically may be used
To include:
Frame video data transmission every in video requency frame data is executed to sorting algorithm to handle to obtain into trained classifier
Multiple video frames of indoor scene and multiple video frames of outdoor scene, by continuous number of frames in multiple video frames of indoor scene
Video frame greater than amount threshold is determined as indoor scene section, and number of frames continuous in multiple video frames of outdoor scene is greater than
The video frame of amount threshold is determined as outdoor scene section, when such as the time interval in two neighboring indoor scene section is less than default
Between, which is merged into an indoor scene section, such as two neighboring outdoor scene section when
Between interval be less than preset time, which is merged into an outdoor scene section.
Specifically, what such as classifier determined, video frame 1- video frame 1000 is indoor scene, extracts video 1- video
1000 lasting quantity is 1000, it is assumed that amount threshold 100, it is determined that video frame 1- video frame 1000 is indoor scene section
1, video frame 1003- video frame 2000 is indoor scene, and the lasting quantity for extracting video frame 1003- video frame 2000 is 997,
Assuming that amount threshold is 100, it is determined that video frame 1003- video frame 2000 is indoor scene section 2, at this time indoor scene section
The interval of only 2 video frames between 2 and indoor scene section 1, which is less than given threshold, due to indoor and outdoor scene
Conversion will not be so fast, therefore 2 video frames can be determined as to noise signal, i.e. the video frame of classifier identification error,
Indoor scene section 2 and indoor scene section 1 are directly merged into an indoor scene section.
Optionally, the above method can also include:
Determine the physical environment in outdoor scene section, such as the physical environment is ground environment, determines the audio frame number
It is true according to first attenuation curve and the target range relationship according to the first attenuation curve of transmission objectives distance in air
The volume of audio data；
If the physical environment is underwater environment, determine that the audio frame number declines according to the second of transmission objectives distance in water
Subtract curve, the volume of audio data is determined according to second attenuation curve and the target range relationship.
In a kind of optional example, the method for above-mentioned determining target range is specifically as follows, and determines indoor scene section
First time the first audio frame number sound source in first position, face is carried out to corresponding video requency frame data at the first time
Identification, such as identifies face, determines the second position of face, by first position and the second position in the first video requency frame data
It is marked in map, calculating the distance between first position and the second position is that (distance can be straight line to transmission objectives distance
Distance, because transmission may be considered straightline propagation substantially for audio).
The map of above-mentioned first video requency frame data can be preset configuration map datum, such as shooting scene in Beijing
Dongzhimen, then configuration film scene in Dongzhimen map.
Referring to Fig. 3, Fig. 3 is a kind of flow diagram of film sound effect treatment method disclosed in the embodiment of the present application, answer
For electronic equipment described in above-mentioned Fig. 1, which includes the following steps:
Step S301, it determines film video to be played, extracts video requency frame data and audio frame number in film video
According to；
Step S302, frame video data transmission every in video requency frame data is executed into sorting algorithm into trained classifier
Processing obtains multiple video frames of indoor scene and multiple video frames of outdoor scene, will connect in multiple video frames of indoor scene
The video frame that continuous number of frames is greater than amount threshold is determined as indoor scene section, by successive frame in multiple video frames of outdoor scene
The video frame that quantity is greater than amount threshold is determined as outdoor scene section, and the time interval in such as two neighboring indoor scene section is small
In preset time, which is merged into an indoor scene section, such as two neighboring outdoor scene
The time interval in section is less than preset time, which is merged into an outdoor scene section, is mentioned
Take the outdoor period in indoor scene section corresponding indoor period and outdoor scene section.
Step S303, when film video is played to the indoor period, to the audio frame number of indoor period according to reducing sound
Amount filters echo when film video is played to the outdoor period.
Technical solution provided by the present application obtains the video requency frame data of film video when determining film video to be played
And audio frame number evidence, then video requency frame data is carried out to analyze determining indoor scene section and outdoor scene section, then
It is the time that it is corresponding, which to extract the indoor scene section, uses different 3D audio strategies for the time of different scenes, so i.e.
It can allow user that can experience indoor and outdoor difference from audio and video, to increase the effect of audio, improve
User experience.
A kind of film sound-effect processing equipment is provided refering to Fig. 4, Fig. 4, the film sound-effect processing equipment includes:
Acquiring unit 401 extracts video requency frame data and sound in film video for determining film video to be played
Frequency frame data；
Resolution unit 402, for analyzing the indoor scene section and outdoor that determine in video requency frame data to video requency frame data
Scene interval, scene interval corresponding indoor period and the outdoor period in outdoor scene section in extraction chamber；
Broadcast unit 403, for when film video is played to the indoor period, to the audio frame number evidence of indoor period
It is played using indoor 3D audio strategy, when film video is played to the outdoor period, to the audio frame number evidence of outdoor period
It is played using outdoor 3D audio strategy.
Optionally, described to analyze video requency frame data the indoor scene section and outdoor scene area determined in video requency frame data
Between specifically include:
Resolution unit 402 is specifically used for frame video data transmission every in video requency frame data into trained classifier
It executes sorting algorithm to handle to obtain multiple video frames of multiple video frames of indoor scene and outdoor scene, by the more of indoor scene
The video frame that continuous time is greater than preset time in a video frame is determined as indoor scene section, by multiple videos of outdoor scene
The video frame that continuous time is greater than preset time in frame is determined as outdoor scene section.
Optionally, described to analyze video requency frame data the indoor scene section and outdoor scene area determined in video requency frame data
Between specifically include:
Resolution unit 402 is specifically used for frame video data transmission every in video requency frame data into trained classifier
It executes sorting algorithm to handle to obtain multiple video frames of multiple video frames of indoor scene and outdoor scene, by the more of indoor scene
The video frame that continuous number of frames is greater than amount threshold in a video frame is determined as indoor scene section, by multiple views of outdoor scene
The video frame that continuous number of frames is greater than amount threshold in frequency frame is determined as outdoor scene section.
Optionally, described to analyze video requency frame data the indoor scene section and outdoor scene area determined in video requency frame data
Between specifically include:
Resolution unit 402 is specifically used for frame video data transmission every in video requency frame data into trained classifier
It executes sorting algorithm to handle to obtain multiple video frames of multiple video frames of indoor scene and outdoor scene, by the more of indoor scene
The video frame that continuous number of frames is greater than amount threshold in a video frame is determined as indoor scene section, by multiple views of outdoor scene
The video frame that continuous number of frames is greater than amount threshold in frequency frame is determined as outdoor scene section, such as two neighboring indoor scene section
Time interval be less than preset time, which is merged into an indoor scene section, such as it is adjacent
The time interval in two outdoor scene sections is less than preset time, which is merged into an outdoor
Scene interval.
Optionally, described device further include:
Processing unit 404, for determining the physical environment in outdoor scene section, such as physical environment is ground environment,
The audio frame number is determined according to the first attenuation curve of transmission objectives distance in air, according to first attenuation curve and institute
State the volume that target range relationship determines audio data.
Optionally, described device further include:
Processing unit 404 is underwater environment for such as the physical environment, determines that the audio frame number evidence is transmitted in water
Second attenuation curve of target range determines the sound of audio data according to second attenuation curve and the target range relationship
Amount.
Referring to Fig. 5, Fig. 5 is the structural schematic diagram of another kind electronic equipment disclosed in the embodiment of the present application, as shown,
The electronic equipment includes processor, memory, communication interface, and one or more programs, wherein said one or multiple journeys
Sequence is stored in above-mentioned memory, and is configured to be executed by above-mentioned processor, and above procedure includes for executing following step
Rapid instruction:
It determines film video to be played, extracts video requency frame data and audio frame number evidence in film video；
The indoor scene section and outdoor scene section determined in video requency frame data is analyzed video requency frame data, in extraction chamber
Scene interval corresponding indoor period and the outdoor period in outdoor scene section；
When film video is played to the indoor period, to the audio frame number of indoor period according to using interior 3D audio plan
It slightly plays, when film video is played to the outdoor period, to the audio frame number of outdoor period according to using outdoor 3D audio plan
Slightly play.
It is described to analyze video requency frame data the indoor scene section determined in video requency frame data in a kind of optional example
It is specifically included with outdoor scene section:
Frame video data transmission every in video requency frame data is executed to sorting algorithm to handle to obtain into trained classifier
Multiple video frames of indoor scene and multiple video frames of outdoor scene are big by continuous time in multiple video frames of indoor scene
It is determined as indoor scene section in the video frame of preset time, continuous time in multiple video frames of outdoor scene is greater than default
The video frame of time is determined as outdoor scene section.
It is described to analyze video requency frame data the indoor scene section determined in video requency frame data in a kind of optional example
It is specifically included with outdoor scene section:
Frame video data transmission every in video requency frame data is executed to sorting algorithm to handle to obtain into trained classifier
Multiple video frames of indoor scene and multiple video frames of outdoor scene, by continuous number of frames in multiple video frames of indoor scene
Video frame greater than amount threshold is determined as indoor scene section, and number of frames continuous in multiple video frames of outdoor scene is greater than
The video frame of amount threshold is determined as outdoor scene section.
It is described to analyze video requency frame data the indoor scene section determined in video requency frame data in a kind of optional example
It is specifically included with outdoor scene section:
Frame video data transmission every in video requency frame data is executed to sorting algorithm to handle to obtain into trained classifier
Multiple video frames of indoor scene and multiple video frames of outdoor scene, by continuous number of frames in multiple video frames of indoor scene
Video frame greater than amount threshold is determined as indoor scene section, and number of frames continuous in multiple video frames of outdoor scene is greater than
The video frame of amount threshold is determined as outdoor scene section, when such as the time interval in two neighboring indoor scene section is less than default
Between, which is merged into an indoor scene section, such as two neighboring outdoor scene section when
Between interval be less than preset time, which is merged into an outdoor scene section.
In a kind of optional example, the method also includes:
Determine the physical environment in outdoor scene section, such as the physical environment is ground environment, determines the audio frame number
It is true according to first attenuation curve and the target range relationship according to the first attenuation curve of transmission objectives distance in air
The volume of audio data.
In a kind of optional example, the method also includes:
If the physical environment is underwater environment, determine that the audio frame number declines according to the second of transmission objectives distance in water
Subtract curve, the volume of audio data is determined according to second attenuation curve and the target range relationship.
It is above-mentioned that mainly the scheme of the embodiment of the present application is described from the angle of method side implementation procedure.It is understood that
, in order to realize the above functions, it comprises execute the corresponding hardware configuration of each function and/or software mould for electronic equipment
Block.Those skilled in the art should be readily appreciated that, in conjunction with each exemplary unit of embodiment description presented herein
And algorithm steps, the application can be realized with the combining form of hardware or hardware and computer software.Some function actually with
Hardware or computer software drive the mode of hardware to execute, the specific application and design constraint item depending on technical solution
Part.Professional technician can specifically realize described function to each using distinct methods, but this reality
Now it is not considered that exceeding scope of the present application.
The embodiment of the present application can carry out the division of functional unit according to above method example to electronic equipment, for example, can
With each functional unit of each function division of correspondence, two or more functions can also be integrated in a processing unit
In.Above-mentioned integrated unit both can take the form of hardware realization, can also realize in the form of software functional units.It needs
It is noted that be schematical, only a kind of logical function partition to the division of unit in the embodiment of the present application, it is practical real
It is current that there may be another division manner.
It should be noted that electronic equipment described in the embodiment of the present application is presented in the form of functional unit.Here
Used term " unit " should be understood as meaning as widest as possible, for realizing pair of function described by each " unit "
As for example can be integrated circuit ASIC, single circuit, for executing the processor of one or more softwares or firmware program (altogether
Enjoying, dedicated or chipset) and memory, combinational logic circuit, and/or provide and realize other suitable groups of above-mentioned function
Part.
The embodiment of the present application also provides a kind of computer storage medium, wherein computer storage medium storage is for electricity
The computer program of subdata exchange, it is as any in recorded in above method embodiment which execute computer
A kind of some or all of film sound effect treatment method step.
The embodiment of the present application also provides a kind of computer program product, and the computer program product includes storing calculating
The non-transient computer readable storage medium of machine program, the computer program are operable to that computer is made to execute such as above-mentioned side
Some or all of any film sound effect treatment method recorded in method embodiment step.
It should be noted that for the various method embodiments described above, for simple description, therefore, it is stated as a series of
Combination of actions, but those skilled in the art should understand that, the application is not limited by the described action sequence because
According to the application, some steps may be performed in other sequences or simultaneously.Secondly, those skilled in the art should also know
It knows, the embodiments described in the specification are all preferred embodiments, related actions and modules not necessarily the application
It is necessary.
In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, there is no the portion being described in detail in some embodiment
Point, reference can be made to the related descriptions of other embodiments.
In several embodiments provided herein, it should be understood that disclosed device, it can be by another way
It realizes.For example, the apparatus embodiments described above are merely exemplary, such as the division of the unit, it is only a kind of
Logical function partition, there may be another division manner in actual implementation, such as multiple units or components can combine or can
To be integrated into another system, or some features can be ignored or not executed.Another point, shown or discussed is mutual
Coupling, direct-coupling or communication connection can be through some interfaces, the indirect coupling or communication connection of device or unit,
It can be electrical or other forms.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit
The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple
In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme
's.
It, can also be in addition, each functional unit in each embodiment of the application can integrate in one processing unit
It is that each unit physically exists alone, can also be integrated in one unit with two or more units.Above-mentioned integrated list
Member both can take the form of hardware realization, can also be realized in the form of software program module.
If the integrated unit is realized in the form of software program module and sells or use as independent product
When, it can store in a computer-readable access to memory.Based on this understanding, the technical solution of the application substantially or
Person says that all or part of the part that contributes to existing technology or the technical solution can body in the form of software products
Reveal and, which is stored in a memory, including some instructions are used so that a computer equipment
(can be personal computer, server or network equipment etc.) executes all or part of each embodiment the method for the application
Step.And memory above-mentioned includes: USB flash disk, read-only memory (read-only memory, ROM), random access memory
The various media that can store program code such as (random access memory, RAM), mobile hard disk, magnetic or disk.
Those of ordinary skill in the art will appreciate that all or part of the steps in the various methods of above-described embodiment is can
It is completed with instructing relevant hardware by program, which can store in a computer-readable memory, memory
It may include: flash disk, ROM, RAM, disk or CD etc..
The embodiment of the present application is described in detail above, specific case used herein to the principle of the application and
Embodiment is expounded, the description of the example is only used to help understand the method for the present application and its core ideas；
At the same time, for those skilled in the art can in specific embodiments and applications according to the thought of the application
There is change place, in conclusion the contents of this specification should not be construed as limiting the present application.
Claims (10)
1. a kind of film sound effect treatment method, which is characterized in that described method includes following steps:
It determines film video to be played, extracts video requency frame data and audio frame number evidence in film video；
The indoor scene section and outdoor scene section determined in video requency frame data is analyzed video requency frame data, indoor scene is extracted
Section corresponding indoor period and the outdoor period in outdoor scene section；
When film video is played to the indoor period, the audio frame number of indoor period is broadcast according to using interior 3D audio strategy
It puts, when film video is played to the outdoor period, the audio frame number of outdoor period is broadcast according to using outdoor 3D audio strategy
It puts.
2. the method according to claim 1, wherein
The video requency frame data includes: video frame and video frame corresponding time；
The audio frame includes: audio frame and audio frame corresponding time.
3. the method according to claim 1, wherein described analyze video requency frame data determines in video requency frame data
Indoor scene section and outdoor scene section specifically include:
Frame video data transmission every in video requency frame data is executed to sorting algorithm to handle to obtain interior into trained classifier
Continuous time in multiple video frames of indoor scene is greater than pre- by multiple video frames of scene and multiple video frames of outdoor scene
If the video frame of time is determined as indoor scene section, continuous time in multiple video frames of outdoor scene is greater than preset time
Video frame be determined as outdoor scene section.
4. the method according to claim 1, wherein described analyze video requency frame data determines in video requency frame data
Indoor scene section and outdoor scene section specifically include:
Frame video data transmission every in video requency frame data is executed to sorting algorithm to handle to obtain interior into trained classifier
Number of frames continuous in multiple video frames of indoor scene is greater than by multiple video frames of scene and multiple video frames of outdoor scene
The video frame of amount threshold is determined as indoor scene section, and number of frames continuous in multiple video frames of outdoor scene is greater than quantity
The video frame of threshold value is determined as outdoor scene section.
5. the method according to claim 1, wherein described analyze video requency frame data determines in video requency frame data
Indoor scene section and outdoor scene section specifically include:
Frame video data transmission every in video requency frame data is executed to sorting algorithm to handle to obtain interior into trained classifier
Number of frames continuous in multiple video frames of indoor scene is greater than by multiple video frames of scene and multiple video frames of outdoor scene
The video frame of amount threshold is determined as indoor scene section, and number of frames continuous in multiple video frames of outdoor scene is greater than quantity
The video frame of threshold value is determined as outdoor scene section, and such as the time interval in two neighboring indoor scene section is less than preset time,
The two neighboring indoor scene section is merged into an indoor scene section, between such as time in two neighboring outdoor scene section
Every being less than preset time, which is merged into an outdoor scene section.
6. the method according to claim 1, wherein the method also includes:
Determine the physical environment in outdoor scene section, such as physical environment is ground environment, determines that the audio frame number evidence exists
First attenuation curve of transmission objectives distance in air determines sound according to first attenuation curve and the target range relationship
The volume of frequency evidence.
7. the method according to claim 1, wherein the method also includes:
If the physical environment is underwater environment, determine that the audio frame number is bent according to the second decaying of transmission objectives distance in water
Line determines the volume of audio data according to second attenuation curve and the target range relationship.
8. a kind of film sound-effect processing equipment, which is characterized in that the film sound-effect processing equipment includes:
Acquiring unit extracts video requency frame data and audio frame number in film video for determining film video to be played
According to；
Resolution unit, for analyzing the indoor scene section and outdoor scene area that determine in video requency frame data to video requency frame data
Between, scene interval corresponding indoor period and the outdoor period in outdoor scene section in extraction chamber；
Broadcast unit, for when film video is played to the indoor period, to the audio frame number of indoor period according to using room
Interior 3D audio strategy plays, when film video is played to the outdoor period, to the audio frame number of outdoor period according to using room
Outer 3D audio strategy plays.
9. a kind of electronic equipment, which is characterized in that including processor, memory, communication interface, and one or more programs,
One or more of programs are stored in the memory, and are configured to be executed by the processor, described program packet
Include the instruction for executing the step in the method according to claim 1 to 7.
10. a kind of computer readable storage medium, which is characterized in that storage is used for the computer program of electronic data interchange,
In, the computer program makes computer execute the method according to claim 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811209949.7A CN109286841B (en) | 2018-10-17 | 2018-10-17 | Movie sound effect processing method and related product |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811209949.7A CN109286841B (en) | 2018-10-17 | 2018-10-17 | Movie sound effect processing method and related product |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109286841A true CN109286841A (en) | 2019-01-29 |
| CN109286841B CN109286841B (en) | 2021-10-08 |
Family
ID=65177942
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811209949.7A Active CN109286841B (en) | 2018-10-17 | 2018-10-17 | Movie sound effect processing method and related product |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109286841B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115022710A (en) * | 2022-05-30 | 2022-09-06 | 咪咕文化科技有限公司 | Video processing method and device and readable storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104036789A (en) * | 2014-01-03 | 2014-09-10 | 北京智谷睿拓技术服务有限公司 | Multimedia processing method and multimedia device |
| WO2015011624A2 (en) * | 2013-07-21 | 2015-01-29 | Wizedsp Ltd | Systems and methods using acoustic communication |
| CN107179908A (en) * | 2017-05-16 | 2017-09-19 | 网易（杭州）网络有限公司 | Audio method of adjustment, device, electronic equipment and computer-readable recording medium |
| CN107888843A (en) * | 2017-10-13 | 2018-04-06 | 深圳市迅雷网络技术有限公司 | Sound mixing method, device, storage medium and the terminal device of user's original content |
| CN108337556A (en) * | 2018-01-30 | 2018-07-27 | 三星电子（中国）研发中心 | Method and apparatus for playing audio/video file |
-
2018
- 2018-10-17 CN CN201811209949.7A patent/CN109286841B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2015011624A2 (en) * | 2013-07-21 | 2015-01-29 | Wizedsp Ltd | Systems and methods using acoustic communication |
| CN104036789A (en) * | 2014-01-03 | 2014-09-10 | 北京智谷睿拓技术服务有限公司 | Multimedia processing method and multimedia device |
| CN107179908A (en) * | 2017-05-16 | 2017-09-19 | 网易（杭州）网络有限公司 | Audio method of adjustment, device, electronic equipment and computer-readable recording medium |
| CN107888843A (en) * | 2017-10-13 | 2018-04-06 | 深圳市迅雷网络技术有限公司 | Sound mixing method, device, storage medium and the terminal device of user's original content |
| CN108337556A (en) * | 2018-01-30 | 2018-07-27 | 三星电子（中国）研发中心 | Method and apparatus for playing audio/video file |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115022710A (en) * | 2022-05-30 | 2022-09-06 | 咪咕文化科技有限公司 | Video processing method and device and readable storage medium |
| CN115022710B (en) * | 2022-05-30 | 2023-09-19 | 咪咕文化科技有限公司 | Video processing method, device and readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109286841B (en) | 2021-10-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109413563A (en) | The sound effect treatment method and Related product of video | |
| CN107580184B (en) | A kind of image pickup method and mobile terminal | |
| CN106375772B (en) | Video broadcasting method and device | |
| CN103901901B (en) | A kind of screen rotation method and device of video terminal | |
| CN107707828B (en) | A kind of method for processing video frequency and mobile terminal | |
| CN109597481A (en) | AR virtual portrait method for drafting, device, mobile terminal and storage medium | |
| CN108958696A (en) | Principal and subordinate's earphone method for handover control and Related product | |
| CN107656718A (en) | A kind of audio signal direction propagation method, apparatus, terminal and storage medium | |
| CN109308179A (en) | 3D sound effect treatment method and Related product | |
| CN108924910A (en) | The update method and Related product of AI model | |
| CN109327795B (en) | Sound effect processing method and related product | |
| CN109660911A (en) | Recording sound effect treatment method, device, mobile terminal and storage medium | |
| CN106033676B (en) | Audio play control method and device, electronic equipment | |
| CN109254752A (en) | 3D sound effect treatment method and Related product | |
| CN109412704A (en) | Electromagnetic interference control method and Related product | |
| CN104375811A (en) | Method and device for processing sound effects | |
| CN110312032A (en) | Audio frequency playing method and Related product | |
| CN109067965A (en) | Interpretation method, translating equipment, wearable device and storage medium | |
| CN106911956A (en) | A kind of audio data play method, device and mobile terminal | |
| CN109246580A (en) | 3D sound effect treatment method and Related product | |
| CN109743129A (en) | Electromagnetic interference control method and Related product | |
| CN109474743A (en) | Electromagnetic interference control method and Related product | |
| CN109121069A (en) | 3D sound effect treatment method and Related product | |
| CN108924705A (en) | 3D sound effect treatment method and Related product | |
| CN110198421B (en) | Video processing method and related product |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |