CN105959554A

CN105959554A - Video shooting apparatus and method

Info

Publication number: CN105959554A
Application number: CN201610387697.1A
Authority: CN
Inventors: 张登康
Original assignee: Nubia Technology Co Ltd
Current assignee: Nubia Technology Co Ltd
Priority date: 2016-06-01
Filing date: 2016-06-01
Publication date: 2016-09-21
Anticipated expiration: 2036-06-01
Also published as: CN105959554B

Abstract

The invention discloses a video shooting apparatus. For the video shooting apparatus, the front side and the back side of a terminal are each provided with a microphone. The video shooting apparatus includes an acquisition module and a control module, wherein the acquisition module is used for acquiring voice signals based on the microphones on the front side and the back side of the terminal; and the control module is used for controlling a corresponding camera to shoot videos when the acquired voice signals satisfy a preset condition. The invention also discloses a video shooting method. The video shooting apparatus and method can improve the intelligence for video shooting.

Description

Video capture device and method

Technical field

The present invention relates to camera technique field, particularly relate to a kind of video capture device and method.

Background technology

At present, the mobile terminal such as smart mobile phone is fitted with front camera and rear camera, and user can pass through smart mobile phone Before and after photographic head shoot whenever and wherever possible.But, during present photographic head carries out video capture, Each photographic head is independent to the shooting of video, such as, after front photographic head shoots, if being intended to Switch to post-positioned pick-up head, just can only first store front-facing camera shooting content, and switch to rearmounted After photographic head, re-start shooting, if there being multiple user lay respectively at front-facing camera and rearmounted take the photograph As head side, and user merely desires to record a video, it is necessary to constantly change photographic head towards, So that photographic head just to user to shoot, it is clear that this video capture mode, intelligent low.

Summary of the invention

Present invention is primarily targeted at a kind of video capture device and method of proposition, it is intended to traditional video Style of shooting, intelligent relatively low technical problem.

For achieving the above object, a kind of video capture device that the present invention provides, at front and the back of the body of terminal Face is respectively mounted mike, and described video capture device includes:

Acquisition module, for gathering voice signal based on the mike being arranged on terminal front side and the terminal back side；

Control module, during for meeting pre-conditioned at the described voice signal gathered, controls to take the photograph accordingly As head carries out video capture.

Alternatively, described control module includes:

Determine unit, for determining that user that the described voice signal of collection is corresponding is relative to terminal camera Orientation；

Judging unit, appoints with terminal for the orientation at the user place corresponding at the described voice signal gathered When the orientation of one photographic head is consistent, it is judged that the described voice that the mike of described photographic head side gathers Whether signal mates with default voice signal；

Control unit, for when described voice signal mates with default voice signal, controls described shooting Head carries out video capture.

Alternatively, if there being other photographic head carrying out video capture before described terminal, described control module, It is additionally operable to control described photographic head in the video that other photographic head shoots, continues buffered video；

Described control module, is additionally operable to control described photographic head and re-shoots video, and by described photographic head The video file that the video file of shooting and other photographic head shoot synthesizes.

Alternatively, described video capture device also includes:

Determine module, for determining whether described photographic head photographs user corresponding to described voice signal Face-image；

Described control module, is additionally operable to when described photographic head photographs described face-image, controls described Photographic head continues buffered video in the video that other photographic head shoots.

Alternatively, when described photographic head photographs described face-image, described video capture device also wraps Include:

Extraction module, special for the lip-region of described face-image is identified extracting lip movement Levy；

Described control module, is additionally operable at Word message corresponding to described lip movement feature and described voice When the Word message that signal is corresponding mates, control the video relaying that described photographic head shoots at other photographic head Continuous buffered video.

Additionally, for achieving the above object, the present invention also proposes a kind of video capture method, in terminal just Face and the back side are respectively mounted mike, and described video capture method includes:

Voice signal is gathered based on the mike being arranged on terminal front side and the terminal back side；

When the described voice signal gathered meets pre-conditioned, control corresponding photographic head and carry out video bat Take the photograph.

Alternatively, described when the described voice signal gathered meets pre-conditioned, control corresponding shooting Head carries out the step of video capture and includes:

Determine user that the described voice signal of collection the is corresponding orientation relative to terminal camera；

Orientation at orientation and the arbitrary photographic head of terminal at user place corresponding to described voice signal gathered Time consistent, it is judged that whether the described voice signal that the mike of described photographic head side gathers is with default Voice signal mates；

When described voice signal mates with default voice signal, control described photographic head and carry out video capture.

Alternatively, if there being other photographic head carrying out video capture before described terminal, described gather When described voice signal meets pre-conditioned, after controlling the step that corresponding photographic head carries out video capture, Described video capture method also includes:

Control described photographic head in the video that other photographic head shoots, continue buffered video；

Or, control described photographic head and re-shoot video, and the video file shot by described photographic head The video file shot with other photographic head synthesizes.

Alternatively, the described photographic head of described control continues buffered video in the video that other photographic head shoots Step before, described video capture method also includes:

Determine whether described photographic head photographs the face-image of user corresponding to described voice signal；

When described photographic head photographs described face-image, perform to control described photographic head and image at other The video of head shooting continues the step of buffered video.

Alternatively, when described photographic head photographs described face-image, described video capture method is also wrapped Include:

It is identified extracting lip movement feature to the lip-region of described face-image；

At the Word message that the Word message that described lip movement feature is corresponding is corresponding with described voice signal Timing, performs to control described photographic head and continues the step of buffered video in the video that other photographic head shoots.

The video capture device and method that the present invention proposes, the front and back in terminal is respectively mounted Mike In the case of wind, acquisition module first gathers voice based on the mike being arranged on terminal front side and the terminal back side Signal, when the described voice signal gathered meets pre-conditioned, control module controls corresponding photographic head Carry out video capture, it is achieved that during taking pictures, can be according to voice signal automatic switchover photographic head to carry out Video capture, and need not manually change photographic head towards to shoot video, thus improve video capture Intelligent.

Accompanying drawing explanation

Fig. 1 is to realize the hardware architecture diagram of an optional mobile terminal in each embodiment of the present invention；

Fig. 2 is the electrical structure block diagram of camera in Fig. 1；

Fig. 3 is the optional mobile terminal schematic appearance of the present invention one；

Fig. 4 is the structural representation of voicefrequency circuit of the present invention；

Fig. 5 is the module diagram of video capture device first embodiment of the present invention；

Fig. 6 is the schematic flow sheet of video capture method first embodiment of the present invention；

Fig. 7 is the refinement module schematic diagram of control module in Fig. 5；

Fig. 8 is the present invention when the described voice signal gathered meets pre-conditioned, controls corresponding photographic head Carry out the schematic flow sheet of video capture preferred embodiment；

Fig. 9 is the schematic flow sheet of video capture method the 3rd embodiment of the present invention.

The realization of the object of the invention, functional characteristics and advantage will in conjunction with the embodiments, do referring to the drawings further Explanation.

Detailed description of the invention

Should be appreciated that specific embodiment described herein, only in order to explain the present invention, is not used to limit Determine the present invention.

The mobile terminal realizing each embodiment of the present invention is described referring now to accompanying drawing.In follow-up description In, use the suffix being used for representing such as " module ", " parts " or " unit " of element only for having It is beneficial to the explanation of the present invention, itself does not has specific meaning.Therefore, " module " and " parts " can Mixedly to use.

Mobile terminal can be implemented in a variety of manners.Such as, the terminal described in the present invention can include Such as mobile phone, smart phone, video camera, notebook computer, digit broadcasting receiver, PDA are (individual Personal digital assistant), PAD (panel computer), PMP (portable media player), guider etc. Mobile terminal and such as numeral TV, desk computer etc. fixed terminal.Hereinafter it is assumed that terminal It it is mobile terminal.However, it will be understood by those skilled in the art that, except being used in particular for mobile purpose Outside element, structure according to the embodiment of the present invention can also apply to the terminal of fixed type.

Fig. 1 is to realize the hardware architecture diagram of an optional mobile terminal in each embodiment of the present invention.

Mobile terminal 100 can include wireless communication unit 110, A/V (audio/video) input block 120, User input unit 130, sensing unit 140, output unit 150, memorizer 160, interface unit 170, Controller 180 and power subsystem 190 etc..Fig. 1 shows the mobile terminal with various assembly, but should It is understood by, it is not required that implement all assemblies illustrated.Can alternatively implement more or less of group Part.Will be discussed in more detail below the element of mobile terminal.

Wireless communication unit 110 generally includes one or more assembly, and it allows mobile terminal 100 with wireless Radio communication between communicator or network.

A/V input block 120 is used for receiving audio or video signal.A/V input block 120 can include phase Machine 121 and mike 122, camera 121 in Video Capture pattern or image capture mode by image capturing Static images or the view data of video that device obtains process.Picture frame after process can show On display unit 151.Picture frame after camera 121 processes can be stored in memorizer 160, and (or other deposits Storage media) in or be transmitted via wireless communication unit 110, can provide according to the structure of mobile terminal Two or more cameras 121.Mike 122 can be in telephone calling model, logging mode, speech recognition Pattern etc. operational mode receives sound (voice data) via mike, and can be by such sound It is processed as voice data.Audio frequency (voice) data after process can be changed in the case of telephone calling model For can be sent to the form output of mobile communication base station via mobile communication module 112.Mike 122 is permissible Implement various types of noise elimination (or suppression) algorithm and receiving and transmission audio signal to eliminate (or suppression) During produce noise or interference.

It is mobile to control that user input unit 130 can generate key input data according to the order of user's input The various operations of terminal.User input unit 130 allows user to input various types of information, and permissible Including keyboard, metal dome, touch pad (such as, detection due to touched and cause resistance, pressure, electricity The sensitive component of change held etc.), roller, rocking bar etc..Especially, when touch pad as a layer When being superimposed upon on display unit 151, touch screen can be formed.

Sensing unit 140 detects the current state of mobile terminal 100, (such as, mobile terminal 100 open or Closed mode), the position of mobile terminal 100, user is for the contact (that is, touch input) of mobile terminal 100 Presence or absence, the orientation of mobile terminal 100, the acceleration of mobile terminal 100 or speed is moved and direction etc., And generate the order or signal being used for controlling the operation of mobile terminal 100.Such as, when mobile terminal 100 When being embodied as sliding-type mobile phone, it is to engage on or off that sensing unit 140 can sense this sliding-type number Close.It addition, sensing unit 140 can detect whether power subsystem 190 provides electric power or interface unit 170 Whether couple with external device (ED).

Interface unit 170 is used as at least one external device (ED) and is connected connecing of can passing through with mobile terminal 100 Mouthful.Such as, external device (ED) can include wired or wireless head-band earphone port, external power source (or battery Charger) port, wired or wireless FPDP, memory card port, for connect there is identification module The port of device, audio frequency input/output (I/O) port, video i/o port, ear port etc..Identify mould Block can be that storage is for verifying that user uses the various information of mobile terminal 100 and can include user Identification module (UIM), client identification module (SIM), Universal Subscriber identification module (USIM) etc..It addition, The device (hereinafter referred to as " identification device ") with identification module can be to take the form of smart card, therefore, Identify that device can be connected with mobile terminal 100 via port or other attachment means.Interface unit 170 can For receiving from the input (such as, data message, electric power etc.) of external device (ED) and will receive Input the one or more elements being transferred in mobile terminal 100 or may be used at mobile terminal with outer Data are transmitted between part device.

It addition, when mobile terminal 100 is connected with external base, interface unit 170 can serve as allowing to lead to Cross it provide the path of mobile terminal 100 by electric power from base or can serve as allowing to input from base Various command signals be transferred to the path of mobile terminal by it.Various command signals from base input Or electric power may serve as identifying whether mobile terminal is accurately fitted within the signal on base.Output is single Unit 150 be configured to vision, audio frequency and/or tactile manner provide output signal (such as, audio signal, Video signal, alarm signal, vibration signal etc.).Output unit 150 can include display unit 151, Dio Output Modules 152 etc..

Display unit 151 may be displayed on the information processed in mobile terminal 100.Such as, mobile terminal is worked as 100 when being in telephone calling model, display unit 151 can show and call or other communicate (such as, civilian This information receiving and transmitting, multimedia file download etc.) relevant user interface (UI) or graphic user interface (GUI).When mobile terminal 100 is in video calling pattern or image capture mode, display unit 151 Can show capture image and/or the image of reception, illustrate video or image and the UI of correlation function or GUI etc..

Meanwhile, when display unit 151 and touch pad the most superposed on one another to form touch screen time, aobvious Show that unit 151 can serve as input equipment and output device.Display unit 151 can include liquid crystal display (LCD), thin film transistor (TFT) LCD (TFT-LCD), Organic Light Emitting Diode (OLED) display, flexibility show Show at least one in device, three-dimensional (3D) display etc..Some in these display may be constructed such that Transparence is to allow user to watch from outside, and this is properly termed as transparent display, typical transparent display Can for example, TOLED (transparent organic light emitting diode) display etc..According to the specific enforcement wanted Mode, mobile terminal 100 can include two or more display units (or other display device), such as, Mobile terminal can include outernal display unit (not shown) and inner display unit (not shown).Touch screen can For detecting touch input pressure and touch input position and touch input area.

Dio Output Modules 152 can be in call signal at mobile terminal and receive pattern, call mode, note Time under the isotypes such as record pattern, speech recognition mode, broadcast reception mode, wireless communication unit 110 is connect Receive or in memorizer 160 storage voice data transducing audio signal and be output as sound.And And, the audio frequency that dio Output Modules 152 can provide relevant to the specific function of mobile terminal 100 execution is defeated Go out (such as, call signal receives sound, message sink sound etc.).Dio Output Modules 152 can wrap Include pick up, buzzer etc..

Memorizer 160 can store the process performed by controller 180 and control the software program etc. of operation Deng, or can temporarily store oneself through output maybe will export data (such as, telephone directory, message, Still image, video etc.).And, memorizer 160 can store about when touch is applied to touch screen The vibration of the various modes of output and the data of audio signal.

Memorizer 160 can include the storage medium of at least one type, described storage medium include flash memory, Hard disk, multimedia card, card-type memorizer (such as, SD or DX memorizer etc.), random access storage device (RAM), static random-access memory (SRAM), read only memory (ROM), electrically erasable Read only memory (EEPROM), programmable read only memory (PROM), magnetic storage, disk, light Dish etc..And, mobile terminal 100 can be connected the storage function performing memorizer 160 with by network Network storage device cooperation.

Controller 180 generally controls the overall operation of mobile terminal.Such as, controller 180 performs and voice Control that call, data communication, video calling etc. are relevant and process.It addition, controller 180 can wrap Including the multi-media module 181 for reproducing (or playback) multi-medium data, multi-media module 181 can construct In controller 180, or it is so structured that separate with controller 180.Controller 180 can perform pattern to be known Other places are managed, so that the handwriting input performed on the touchscreen or picture drafting input are identified as character or figure Picture.

Power subsystem 190 receives external power or internal power under the control of controller 180 and provides behaviour Make the suitable electric power needed for each element and assembly.

Various embodiment described herein can be to use such as computer software, hardware or its any group The computer-readable medium closed is implemented.Implementing for hardware, embodiment described herein can pass through Use application-specific IC (ASIC), digital signal processor (DSP), digital signal processing device (DSPD), programmable logic device (PLD), field programmable gate array (FPGA), processor, control Device, microcontroller, microprocessor, it is designed to perform in the electronic unit of function described herein extremely Few one is implemented, and in some cases, such embodiment can be implemented in controller 180.Right Implementing in software, the embodiment of such as process or function can perform at least one function or behaviour with permission The single software module made is implemented.Software code can be by writing with any suitable programming language Software application (or program) is implemented, and software code can be stored in memorizer 160 and by controlling Device 180 performs.

So far, oneself is through describing mobile terminal according to its function.Below, for the sake of brevity, will describe Various types of mobile terminals of such as folded form, board-type, oscillating-type, slide type mobile terminal etc. In slide type mobile terminal as example.Therefore, the present invention can be applied to any kind of mobile whole End, and it is not limited to slide type mobile terminal.

With reference to the electrical structure block diagram that Fig. 2, Fig. 2 are camera in Fig. 1.

Photographic lens 1211 is made up of, for single-focus lens the multiple optical lens being used for being formed shot object image Or zoom lens.Photographic lens 1211 can move under the control of lens driver 1221 in the direction of the optical axis Dynamic, lens driver 1221, according to the control signal from lens driving control circuit 1222, controls photography The focal position of camera lens 1211, in the case of zoom lens, it is possible to control focal length.Lens driving Control circuit 1222 carries out driving of lens driver 1221 according to the control command from microcomputer 1217 Dynamic control.

Near the position of the shot object image formed on the optical axis of photographic lens 1211, by photographic lens 1211 It is configured with imaging apparatus 1212.Imaging apparatus 1212 is for imaging shot object image and obtaining photographed images number According to.On imaging apparatus 1212 two dimension and be arranged in a matrix the photodiode constituting each pixel.Respectively Photodiode produces the opto-electronic conversion electric current corresponding with light income, this opto-electronic conversion electric current by with each photoelectricity The capacitor that diode connects carries out charge accumulation.The front surface of each pixel is configured with the RGB of Bayer arrangement Color filter.

Imaging apparatus 1212 is connected with imaging circuit 1213, and this imaging circuit 1213 is in imaging apparatus 1212 Carry out charge accumulation to control and picture signal reading control, the picture signal (analog picture signal) to this reading Reduce to reset and carry out waveform shaping after noise, and then carry out gain raising etc. to become suitable signal level. Imaging circuit 1213 is connected with A/D converter 1214, and analog picture signal is carried out by this A/D converter 1214 Analog digital conversion, to bus 1227 output digital image signal (hereinafter referred to as view data).

Bus 1227 is the transmission path for being transmitted in the various data that the inside of camera reads or generates. It is connected to above-mentioned A/D converter 1214 in bus 1227, is additionally connected to image processor 1215, JPEG Processor 1216, microcomputer 1217, SDRAM (Synchronous Dynamic random access Memory, SDRAM (Synchronous dynamic random access memory)) 1218, memory interface (hereinafter referred to as memorizer I/F) 1219, LCD (Liquid Crystal Display, liquid crystal display) driver 1220.

Image processor 1215 carries out OB to the view data of output based on imaging apparatus 1212 and subtracts each other place Reason, blank level adjustment, color matrix computing, gamma conversion, colour difference signal process, noise removal process, The various image procossing such as change process simultaneously, edge treated.Jpeg processor 1216 is by Imagery Data Recording In time recording medium 1225, compress the view data read from SDRAM1218 according to JPEG compression mode. Additionally, jpeg processor 1216 carries out the decompression of jpeg image data to carry out image reproducing to show Contracting.When decompressing, read record file in record medium 1225, at jpeg processor 1216 In implement decompression after, the view data of decompression is temporarily stored in SDRAM1218 and Show on LCD1226.It addition, in the present embodiment, decompress mode as compression of images and adopt Be JPEG mode, but compressed and decompressed mode is not limited to this, it is of course possible to use MPEG, TIFF, H.264 other compressed and decompressed mode is waited.

Microcomputer 1217 plays the function in the control portion overall as this camera, is uniformly controlled camera Various process sequences.Microcomputer 1217 is connected to operating unit 1223 and flash memory 1224.

Operating unit 1223 includes but not limited to physical button or virtual key, this entity or virtual key Can be power knob, key of taking pictures, edit key, dynamic image button, reproduction button, menu button, The operations such as various load buttons and various input keys such as cross key, OK button, deletion button, large buttons Control, detects the mode of operation of these operational controls.

Testing result is exported to microcomputer 1217.Additionally, the LCD1226's as display Front surface is provided with touch panel, and the touch location of detection user, by this touch location to microcomputer 1217 Output.Microcomputer 1217, according to the testing result of the operating position from operating unit 1223, performs The various process sequences corresponding with the operation of user.

Flash memory 1224 storage is for performing the program of the various process sequences of microcomputer 1217.Microcomputer Calculation machine 1217 carries out, according to this program, the control that camera is overall.Additionally, flash memory 1224 stores the various of camera Adjusted value, microcomputer 1217 reads adjusted value, carries out the control of camera according to this adjusted value.

SDRAM1218 is can the electric volatibility rewritten to deposit for temporarily store view data etc. Reservoir.This SDRAM1218 temporarily store from A/D converter 1214 output view data and at image at Reason device 1215, jpeg processor 1216 etc. have carried out the view data after processing.

Memory interface 1219 is connected with record medium 1225, carries out view data and is attached to picture number File first-class data write record medium 1225 according to and the control of reading from record medium 1225.Note Recording medium 1225 for example, can on camera main-body the record such as the memory card of disassembled and assembled freely medium, but It is not limited to this, it is also possible to be the hard disk etc. being built in camera main-body.

Lcd driver 1210 is connected with LCD1226, the picture number after being processed by image processor 1215 According to being stored in SDRAM1218, need display time, read SDRAM1218 storage view data and The upper display of LCD1226, or, the compressed view data of jpeg processor 1216 is stored in SDRAM1218, when needs show, jpeg processor 1216 reads the compressed of SDRAM1218 View data, then decompress, the view data after decompressing is shown by LCD1226.

LCD1226 is arranged in the back side of camera main-body to carry out image and shows.This LCD1226LCD), but It is not limited to this, it would however also be possible to employ the various display floater such as organic EL (LCD1226), but is not limited to this, The various display floaters such as organic EL can also be used.

With reference to Fig. 3, the front and back of terminal is separately installed with photographic head and mike, it should be appreciated that The concrete position of described photographic head and mike does not limits, as long as being positioned at the same side, and Ke Yiru Shown in Fig. 3, the position of mike and photographic head is all located at the top half of plane.Certainly, in the present invention, When photographic head can also be all disposed within the top half of plane, one of them mike is arranged on plane Top half, another mike is arranged on the latter half of plane, this kind of mode can be in certain journey Two mikes can be kept on Du to have a certain distance poor, thus be more easily detected sound difference.

With reference to Fig. 4, first gather voice signal based on the mike being arranged on terminal front side and the terminal back side, i.e. Sound source of sound in Fig. 4, then voice signal is converted into voice signal waveform by sound collection circuit, then passes Transporting in pretreatment filter circuit, described voice signal waveform is filtered by described pretreatment filter circuit Process, and by the voice signal waveform transfer after Filtering Processing to sound treatment circuit, at described sound Voice signal waveform behind front and back side Filtering Processing is carried out registration process by reason circuit, in order to calculate also Obtaining the difference in time signal, final time difference counting circuit is according to the decision rule pre-established, to institute State the voice signal waveform after registration process and carry out the calculating judgement of time difference, to determine front and back The orientation of the voice signal that mike gathers.

Based on above-mentioned mobile terminal hardware configuration, the electrical structure schematic diagram of camera, the structure of voicefrequency circuit Schematic diagram, proposes each embodiment of video capture device of the present invention.

With reference to the module diagram that Fig. 5, Fig. 5 are video capture device first embodiment of the present invention.

It is emphasized that it will be apparent to those skilled in the art that module map shown in Fig. 5 is only one The exemplary plot of preferred embodiment, those skilled in the art is around the mould of the video capture device shown in Fig. 5 Block, can carry out supplementing of new module easily；The title of each module is self-defined title, is only used for auxiliary Understand each program function block of this video capture device, be not used in restriction technical scheme, this The core of inventive technique scheme is, the function that the module of each self-defined title is to be reached.

The present embodiment proposes a kind of video capture device, and the front and back in terminal is respectively mounted mike, Described video capture device includes:

Acquisition module 10, for gathering voice letter based on the mike being arranged on terminal front side and the terminal back side Number；

Control module 20, during for meeting pre-conditioned at the described voice signal gathered, controls corresponding Photographic head carries out video capture.

In the present embodiment, application scenarios includes two kinds: 1) before terminal does not opens shooting application, if Voice signal is gathered based on the mike being arranged on terminal front side and the terminal back side, and at the institute's predicate gathered When tone signal meets pre-conditioned, control corresponding photographic head and carry out video capture, as terminal is not opened in advance Open arbitrary photographic head to shoot, then collecting voice signal based on two mikes before and after installing Time, it is judged that the user that described voice signal is corresponding is consistent with the orientation of which mike, and controls and use The photographic head of the mike side that orientation, family is consistent is opened, to carry out video capture.2) lead in terminal Cross during the first photographic head of described terminal carries out video capture, if based on being arranged on described terminal front side Collect voice signal with the described mike at the back side, and meet at the described voice signal gathered pre-equally If during condition, orientation, user place as corresponding in current voice signal is consistent with second camera, then this Time control second camera carry out video capture, be the equal of to switch to second camera from the first photographic head, To proceed video capture.

In the present embodiment, acquisition module 10 is based on the Mike's elegance being arranged on terminal front side and the terminal back side During collection voice signal, if the pronunciation source of voice signal is positioned at front or the back side of described terminal, then two The voice signal that mike collects has time difference, and the intensity of the voice signal gathered is the most different, May determine that user that voice signal is corresponding, in the orientation of described terminal, specifically manages according to time difference or intensity By as follows:

Although the distance between two mikes is close, but due to the mobile phone iris action to sound itself, Sound arrives the sound level of two mikes it is possible to difference, i.e. if sound source is in mobile phone front, front wheat Gram sound level experienced big (i.e. intensity) some, and there is small time difference between the two, according to this two Point just can distinguish sound source from front or the back side, the most first collects the mike place of voice signal Side is exactly the sound bearing of voice signal, or the big mike side of intensity of sound gathered is The sound bearing of voice signal.For being best understood from the present embodiment, citing algorithm is as follows:

In space coordinates, it is assumed that front is respectively S1=(X1, Y1) with the coordinate of the mike at the back side, S2=(X2, Y2).If the time that two mikes receive voice signal is respectively t1, t2, then the time Difference is t1 t2, if t1>t2, then sound source is terminal front side, if t1<t2, then sound source is terminal The back side；If the intensity that two mikes receive voice signal is S1, S2, intensity difference is S1-S1, if S1>S2, then sound source is terminal front side, if S1<S2, then sound source is the terminal back side.

Further, in order to improve the accuracy that sound bearing corresponding to voice signal judges, by following Algorithm determines sound bearing:

E=exp (-sqrt (t1 t2)/a (S1-S2)), wherein a is for controlling time difference preset parameter；

If E > T, it is determined that voice signal, from the mike in front, otherwise carrys out the mike at the then back side.

In the present embodiment, the number of the described mike being arranged on terminal front side and the terminal back side does not limits Fixed, as long as ensureing that the front and back of described terminal is the most at least provided with a mike, the most all It is described in detail as a example by the most each mike.In the present embodiment, according to being arranged on described terminal front side With the described mike at the back side in real time or timing acquiring voice signal, further, in order to improve photographic head The accuracy of switching, preferably when the photographic head of described terminal runs, just controls just be arranged on described terminal Face or the described mike Real-time Collection voice signal at the back side, wherein, the operation of described photographic head includes described Photographic head is currently at takes pictures or video state.

In the present embodiment, voice signal is gathered based on the mike being arranged on terminal front side and the terminal back side Time, first judge whether the described voice signal gathered meets pre-conditioned, in the present embodiment, described default Condition includes: the orientation one of user's photographic head arbitrary with terminal that the described voice signal of collection is corresponding Cause, and/or judge whether the described voice signal of mike collection mates with default voice signal, wherein, Consistent in the orientation of user's photographic head arbitrary with terminal corresponding to described voice signal gathered, and/or Mike When whether the described voice signal of elegance collection mates with default voice signal, determine that described voice signal meets Pre-conditioned.And described when the described voice signal gathered meets pre-conditioned, control module 20 controls The mode that corresponding photographic head carries out video capture includes: first determine the source of sound of the described voice signal of collection The photographic head of direction side, the described photographic head that then control module 20 controls to determine is opened, to enter Row video capture.

The video capture device that the present embodiment proposes, the front and back in terminal is respectively mounted mike In the case of, acquisition module first gathers voice signal based on the mike being arranged on terminal front side and the terminal back side, When the described voice signal gathered meets pre-conditioned, control module controls corresponding photographic head and regards Frequency shooting, it is achieved that during taking pictures, can be according to voice signal automatic switchover photographic head to carry out video bat Take the photograph, and need not manually change photographic head towards to shoot video, thus improve the intelligence of video capture Property.

The present invention further provides a kind of video capture method.

With reference to the schematic flow sheet that Fig. 6, Fig. 6 are video capture method first embodiment of the present invention.

The present embodiment proposes a kind of video capture method, and the front and back in terminal is respectively mounted mike, Described video capture method includes:

Step S10, gathers voice signal based on the mike being arranged on terminal front side and the terminal back side；

Step S20, when the described voice signal gathered meets pre-conditioned, controls corresponding photographic head and enters Row video capture.

In the present embodiment, voice signal is gathered based on the mike being arranged on terminal front side and the terminal back side Time, if the pronunciation source of voice signal is positioned at front or the back side of described terminal, then two mike collections To voice signal have time difference, and the intensity of the voice signal gathered is the most different, according to time difference Or intensity may determine that user that voice signal is corresponding in the orientation of described terminal, concrete reason is as follows:

In the present embodiment, voice signal is gathered based on the mike being arranged on terminal front side and the terminal back side Time, first judge whether the described voice signal gathered meets pre-conditioned, in the present embodiment, described default Condition includes: the orientation one of user's photographic head arbitrary with terminal that the described voice signal of collection is corresponding Cause, and/or judge whether the described voice signal of mike collection mates with default voice signal, wherein, Consistent in the orientation of user's photographic head arbitrary with terminal corresponding to described voice signal gathered, and/or Mike When whether the described voice signal of elegance collection mates with default voice signal, determine that described voice signal meets Pre-conditioned.And described when the described voice signal gathered meets pre-conditioned, control corresponding shooting Head carries out the mode of video capture and includes: first determine the sound source direction place one of the described voice signal of collection The photographic head of side, the described photographic head then controlling to determine is opened, to carry out video capture.

The video capture method that the present embodiment proposes, the front and back in terminal is respectively mounted mike In the case of, first gather voice signal based on the mike being arranged on terminal front side and the terminal back side, gathering Described voice signal when meeting pre-conditioned, then control corresponding photographic head and carry out video capture, it is achieved During taking pictures, can be according to voice signal automatic switchover photographic head to carry out video capture, and without hands Dynamic change photographic head towards to shoot video, thus improve the intelligent of video capture.

Further, in order to improve the accuracy of photographic head switching, video capture device of the present invention is proposed Second embodiment.

Second embodiment of video capture device is with the difference of the first embodiment of video capture device, With reference to Fig. 7, described control module 20 includes:

Determine unit 21, for determining that the user that the described voice signal of collection is corresponding images relative to terminal The orientation of head；

Judging unit 22, for orientation and the terminal at the user place corresponding at the described voice signal gathered When the orientation of arbitrary photographic head is consistent, it is judged that institute's predicate that the mike of described photographic head side gathers Whether tone signal mates with default voice signal；

Control unit 23, for when described voice signal mates with default voice signal, takes the photograph described in control As head carries out video capture.

In the present embodiment, collecting based on the described mike being arranged on described terminal front side and the back side During voice signal, determine that user that unit 21 first determines that the described voice signal detected is corresponding is relative to end The orientation of end photographic head, specifically: determine that unit 21 may determine that voice signal according to time difference or intensity Corresponding source of sound is in the orientation of described terminal, because gathering voice signal by former and later two mikes, when User when terminal front side or the back side send voice signal, due to send the position of voice signal with two The distance of mike is different, and therefore, voice signal arrives the time intensity of two mikes and also differs, So, former and later two mikes just have a time difference and intensity difference in the time receiving voice signal, It is understood that the mike side first receiving voice signal is the side near user, In like manner, the mike that voice signal is stronger belongs to the photographic head of side together and is just proximate to the side of user, now, Determine user that unit 21 i.e. can determine that described voice signal the is corresponding side relative to the photographic head of described terminal Position.

Orientation at orientation and the arbitrary photographic head of terminal at user place corresponding to described voice signal gathered Time consistent, it is judged that unit 22 judges the described voice signal that the mike of described photographic head side gathers Whether mate with default voice signal, when described voice signal mates with default voice signal, control single Unit 23 controls described photographic head and carries out video capture.It is to say, at described voice signal and default voice During Signal Matching, control unit 23 just controls described photographic head and carries out video capture, if there being other before Photographic head is shooting, then other photographic head is just switched to described photographic head to enter by control unit 23 Row video capture, and the determination mode that described voice signal mates with default voice signal includes: a, work as institute State default voice signal when being the voice signal that audio intensity is more than preset strength, determine that mike detects Described voice signal mate with described default voice signal.If default voice signal is that audio intensity is The voice signal of 30DB, then, the audio intensity of the voice signal detected at mike reaches 30DB Time, determine that the described voice signal that mike detects mates with described default voice signal.B, when described When default voice signal is the voice signal that audio wave length is more than preset wavelength, determine what mike detected Described voice signal mates with described default voice signal.If default voice signal is that audio frequency wavelength length reaches Voice signal to 30mm, then, the audio wave length of the voice signal detected at mike reaches During 30mm, determine that the described voice signal that mike detects mates with described default voice signal.c、 When described default voice signal is consistent with pre-stored voice signal, determine the described voice that mike detects Signal mates with described default voice signal, such as, and pre-stored voice letter in described voice signal is terminal Number, such as " seeing me ", " turning over ", determine that the described voice signal that mike detects is preset with described Voice signal mates.

It is understood that by speech recognition to determine whether are described voice signal and default voice signal Coupling, is the equal of that the linguistic performance to video capture process carries out classification differentiation, cuts as being divided into necessity Changing voice and inessential switching voice two parts, wherein, necessary switching voice audio frequency as described above is strong Degree is more than the voice signal of preset strength, or audio wave length is more than the voice signal of preset wavelength, or Person is the audio signal etc. that prestores, then, when this necessity switching voice being detected, then can control shooting Head is opened or switching is to carry out video capture；And inessential switching voice may be defined as general voice signal, As reminded type voice Fructus Solani melongenae, the audio intensity voice signal less than preset strength, or audio frequency length is little Voice signal in preset length etc., under this type of voice, does not perform to open or switch photographic head Operation.

Further, in order to improve the motility of video capture, if there being other photographic head before described terminal When carrying out video capture, then switching to corresponding the taking the photograph in orientation, voice signal place from other photographic head During as head, the view-finder of described terminal shows the scene that current photographic head shoots, adjust for user Described current photographic head towards, or be easy to user and check the photographed scene of current photographic head.

In the present embodiment, when receiving voice signal, first judge that whether described voice signal is with default Voice signal mates, and when described voice signal mates with default voice signal, just controls described photographic head Carry out video capture, or be switched to current photographic head to carry out video capture from other photographic head, prevent Other voice noise interference to video capture, thus improve the accuracy of video capture.

Further, in order to improve the accuracy of photographic head switching, video capture method of the present invention is proposed Second embodiment.

Second embodiment of video capture method is with the difference of the first embodiment of video capture method, With reference to Fig. 8, described step S20 includes:

Step S21, determines user that the described voice signal of collection the is corresponding side relative to terminal camera Position；

Step S22, in orientation and the arbitrary shooting of terminal at user place corresponding to described voice signal gathered When the orientation of head is consistent, it is judged that the described voice signal of the mike collection of described photographic head side is No and default voice signal mates；

Step S23, when described voice signal mates with default voice signal, controls described photographic head and carries out Video capture.

In the present embodiment, collecting based on the described mike being arranged on described terminal front side and the back side During voice signal, first determine that user that the described voice signal detected is corresponding is relative to terminal camera Orientation, specifically: may determine that source of sound that voice signal is corresponding is in described terminal according to time difference or intensity Orientation because by former and later two mikes gather voice signal, when user is at terminal front side or the back of the body When face sends voice signal, different from the distance of two mikes owing to sending the position of voice signal, because of This, voice signal arrives the time intensity of two mikes and also differs, then, former and later two mikes A time difference and intensity difference is just had, it is to be understood that first receive in the time receiving voice signal Mike side to voice signal is the side near user, and in like manner, voice signal is stronger Mike belongs to the photographic head of side together and is just proximate to the side of user, now, i.e. can determine that described voice is believed Number corresponding user is relative to the orientation of the photographic head of described terminal.

Orientation at orientation and the arbitrary photographic head of terminal at user place corresponding to described voice signal gathered Time consistent, determine whether described voice signal that the mike of described photographic head side gathers whether Mate with default voice signal, when described voice signal mates with default voice signal, take the photograph described in control As head carries out video capture.It is to say, when described voice signal mates with default voice signal, Control described photographic head and carry out video capture, if there being other photographic head shooting before, then Other photographic head is switched to described photographic head to carry out video capture, and described voice signal and default language The determination mode of tone signal coupling includes: a, when described default voice signal be audio intensity be more than preset strong During the voice signal of degree, determine described voice signal and described default voice signal that mike detects Join.As default voice signal be audio intensity be the voice signal of 30DB, then, detect at mike The audio intensity of voice signal when reaching 30DB, determine described voice signal and institute that mike detects State default voice signal coupling.B, when described default voice signal be audio wave length more than the language of preset wavelength During tone signal, determine that the described voice signal that mike detects mates with described default voice signal.As Default voice signal is the voice signal that audio frequency wavelength length reaches 30mm, then, detect at mike To the audio wave length of voice signal reach 30mm time, determine the described voice signal that mike detects Mate with described default voice signal.C, when described default voice signal is consistent with pre-stored voice signal, Determine that the described voice signal that mike detects mates with described default voice signal, such as, described Voice signal is pre-stored voice signal in terminal, such as " seeing me ", " turning over ", determines that mike detects The described voice signal arrived mates with described default voice signal.

Further, in order to improve the motility of video capture, propose the of video capture device of the present invention Three embodiments.

3rd embodiment of video capture device and the difference of the first or second embodiments of video capture device It is, if there being other photographic head carrying out video capture before described terminal, described control module 20, also In the video that other photographic head shoots, buffered video is continued for controlling described photographic head；

Described control module 20, is additionally operable to control described photographic head and re-shoots video, and by described shooting The video file that the video file of head shooting and other photographic head shoot synthesizes.

In the present embodiment, if there being other photographic head carrying out video capture before described terminal, then institute State control module 20 first to switch to current photographic head from other photographic head and shoot, and, control current Photographic head continues buffered video in the video that other photographic head shoots, say, that does not suspend other and takes the photograph As the video of head shooting, after switching to current photographic head, described control module 20 directly controls currently Photographic head continues buffered video in the video that other photographic head shoots, and finally gives a complete video File, it should be appreciated that during two photographic head switch transitions, certain specially good effect can be strengthened, such as mould Paste seamlessly transits, and rotates transition etc., in order to increases the connecting in handoff procedure, prevents video lofty Synthesis, the video file of final output front camera and rear camera shooting.Certainly, described control module 20 is the most controlled Make current photographic head and re-shoot video, and the video file that current photographic head is shot and other photographic head The video file of shooting synthesizes, and finally gives a complete video file.

In the present embodiment, when switching photographic head and shooting, it is possible not only to control described photographic head and exists The video of other photographic head shooting continues buffered video, also can control described photographic head and re-shoot video, And the video file that the video file shot by described photographic head and other photographic head shoot synthesizes, carry The high motility of video capture.

Further, in order to improve the motility of video capture, propose the of video capture method of the present invention Three embodiments.

3rd embodiment of video capture method and the difference of the first or second embodiments of video capture method It is, with reference to Fig. 9, if there being other photographic head carrying out video capture before described terminal, described step After S20, described video capture method also includes:

Step S30, controls described photographic head and continues buffered video in the video that other photographic head shoots；

In the present embodiment, if there being other photographic head carrying out video capture before described terminal, then first Switch to current photographic head from other photographic head shoot, and, control current photographic head and take the photograph at other Buffered video is continued, say, that do not suspend the video of other photographic head shooting as in the video of head shooting, After switching to current photographic head, directly control current photographic head in the video that other photographic head shoots Continue buffered video, finally give a complete video file, it should be appreciated that two photographic head During switch transition, certain specially good effect can be strengthened, such as Fuzzy smooth transition, rotate transition etc., in order to Increase the connecting in handoff procedure, prevent the lofty synthesis of video, final output front camera and rear camera shooting Video file.Certainly, it is possible to control current photographic head and re-shoot video, and current photographic head is shot The video file that shoots of video file and other photographic head synthesize, finally give complete regarding Frequency file.

Further, in order to improve the accuracy of video capture, propose the of video capture device of the present invention Four embodiments.

4th embodiment of video capture device is with the difference of the 3rd embodiment of video capture device, Described video capture device also includes:

Determine module, determine whether described photographic head photographs the face of user corresponding to described voice signal Image；

Described control module 20, is additionally operable to when described photographic head photographs described face-image, controls institute State photographic head in the video that other photographic head shoots, continue buffered video.

In the present embodiment, before other photographic head of control switches to current photographic head, determine that module is first Determine whether described current photographic head photographs the face-image of user corresponding to described voice signal, only exist When described current photographic head photographs face-image, described control module 20 just controls described current photographic head In the video that other photographic head shoots, continuing buffered video, if being not picked up by face-image, can weigh Newly switch back into other photographic head described.

In the present embodiment, after necessary switching voice being detected, face inspection can be carried out by photographic head Survey, particularly when described photographic head is front-facing camera, can detect whether sound source is hand-held person, Face is can't detect, then it is believed that current necessary switching voice is from non-handheld camera as in front-facing camera Person, the most again switches back into described post-positioned pick-up head, thus improves the accuracy of video capture.

Further, in order to improve the accuracy of video capture, propose the of video capture method of the present invention Four embodiments.

4th embodiment of video capture method is with the difference of the 3rd embodiment of video capture method, Before the described photographic head of described control continues the step of buffered video in the video that other photographic head shoots, Described video capture method also includes:

In the present embodiment, before other photographic head of control switches to current photographic head, first determine described Whether current photographic head photographs the face-image of user corresponding to described voice signal, only described currently When photographic head photographs face-image, just control the video that described current photographic head shoots at other photographic head Middle continuation buffered video, if being not picked up by face-image, can switch back into other photographic head described again.

Further, in order to improve the accuracy of face-image identification, video capture device of the present invention is proposed The 5th embodiment.

5th embodiment of video capture device is with the difference of the 4th embodiment of video capture device, When described photographic head photographs described face-image, described video capture device also includes:

Described control module 20, is additionally operable at Word message corresponding to described lip movement feature and institute's predicate Tone signal corresponding Word message coupling time, control described photographic head in the video that other photographic head shoots Continue buffered video.

In the present embodiment, when described photographic head photographs face-image, described extraction module is first to institute The lip-region stating face-image is identified extracting lip movement feature, then analyzes described lip fortune The Word message that dynamic feature is corresponding, then the mike analyzing described photographic head side detect described The Word message that voice signal is corresponding, Word message corresponding to the most described lip movement feature is with described The Word message that voice signal is corresponding is compared, the word letter corresponding to determine described lip movement feature Cease whether the Word message corresponding with described voice signal mates, at the literary composition that described lip movement feature is corresponding Word information corresponding with described voice signal Word message coupling time, described control module 20 can control institute State current photographic head in the video that other first photographic head shoots, continue buffered video.

In the present embodiment, on the basis of current photographic head detects facial image, i.e. at Face detection On the basis of, lip-region positioned and extracts lip movement feature, it determines the hand-held person of present terminal Whether sounding, when particularly current photographic head is front-facing camera, it determines necessary switching voice before is No hand-held person in current front-facing camera, the most just controls current photographic head and images at other The video of head shooting continues buffered video, to get rid of extraneous voice interference, thus improves video capture Accuracy.

Further, in order to improve the accuracy of face-image identification, video capture method of the present invention is proposed The 5th embodiment.

5th embodiment of video capture method is with the difference of the 4th embodiment of video capture method, When described photographic head photographs described face-image, described video capture method also includes:

In the present embodiment, when described photographic head photographs face-image, first to described face-image Lip-region is identified extracting lip movement feature, then analyzes described lip movement feature corresponding Word message, the more described voice signal that the mike analyzing described photographic head side detects is corresponding Word message, Word message corresponding to the most described lip movement feature is corresponding with described voice signal Word message compare, to determine Word message corresponding to described lip movement feature and described voice Whether the Word message that signal is corresponding mates, at Word message corresponding to described lip movement feature with described When the Word message that voice signal is corresponding mates, described current photographic head can be controlled in other the first shooting The video of head shooting continues buffered video.

Further, in order to improve the intelligent of video capture, propose the of video capture device of the present invention Six embodiments.

The sixth embodiment of video capture device is with the difference of the 5th embodiment of video capture device, Described video capture device also includes:

Handover module, for terminating at described voice signal, switching back into other photographic head；

Described control module 20, is additionally operable to what other photographic head after controlling switching shot at current photographic head Video continues buffered video.

In the present embodiment, also the end point of necessity switching voice can be defined, in order to handover module Switch back into other photographic head, specifically, at the end of described voice signal, or described voice signal When being unsatisfactory for presetting voice signal, the audio intensity of the most described voice signal is less than preset strength, or When the audio frequency length of described voice signal is less than preset length, now, it is believed that current photographic head has shot Becoming, the most described handover module switches back into other photographic head, and described control module 20 controls other after switching Photographic head is proceeding buffered video.

Further, also face-image can not photographed or at described face-image at current photographic head Lip-region extract lip movement feature failure, described handover module switches to other photographic head, described Control module 20 controls other photographic head after switching and continues buffered video, thus improves the intelligence of video capture Can property.

Further, in order to improve the intelligent of video capture, propose the of video capture method of the present invention Six embodiments.

The sixth embodiment of video capture method is with the difference of the 5th embodiment of video capture method, Described video shooting method also includes:

Terminate at described voice signal, switch back into other photographic head；

Control other photographic head after switching in the video that current photographic head shoots, continue buffered video.

In the present embodiment, also the end point of necessity switching voice can be defined, in order to switch back into it Its photographic head, specifically, at the end of described voice signal, or described voice signal is unsatisfactory for pre- If during voice signal, the audio intensity of the most described voice signal is less than preset strength, or described voice When the audio frequency length of signal is less than preset length, now, it is believed that current photographic head has shot, then cut Gain other photographic head, and control other photographic head after switching and proceeding buffered video.

Further, also face-image can not photographed or at described face-image at current photographic head Lip-region extract the failure of lip movement feature, switch to other photographic head, and control its after switching Its photographic head continues buffered video, thus improves the intelligent of video capture.

It should be noted that in this article, term " include ", " comprising " or its other variant any Be intended to comprising of nonexcludability so that include the process of a series of key element, method, article or Person's system not only includes those key elements, but also includes other key element being not expressly set out, or also Including the key element intrinsic for this process, method, article or system.In the feelings not having more restriction Under condition, statement " including ... " key element limited, it is not excluded that include this key element process, Method, article or system there is also other identical element.

The invention described above embodiment sequence number, just to describing, does not represent the quality of embodiment.

Through the above description of the embodiments, those skilled in the art is it can be understood that arrive above-mentioned Embodiment method can add the mode of required general hardware platform by software and realize, naturally it is also possible to logical Cross hardware, but a lot of in the case of the former is more preferably embodiment.Based on such understanding, the present invention's The part that prior art is contributed by technical scheme the most in other words can be with the form body of software product Revealing to come, this computer software product is stored in a storage medium (such as ROM/RAM, magnetic disc, light Dish) in, including some instructions with so that a station terminal equipment (can be mobile phone, computer, service Device, air-conditioner, or the network equipment etc.) perform the method described in each embodiment of the present invention.

These are only the preferred embodiments of the present invention, not thereby limit the scope of the claims of the present invention, every Utilize equivalent structure or equivalence flow process conversion that description of the invention and accompanying drawing content made, or directly or Connect and be used in other relevant technical field, be the most in like manner included in the scope of patent protection of the present invention.

Claims

1. a video capture device, it is characterised in that the front and back in terminal is respectively mounted Mike Wind, described video capture device includes:

2. video capture device as claimed in claim 1, it is characterised in that described control module includes:

3. video capture device as claimed in claim 1 or 2, it is characterised in that if described terminal it Before have other photographic head carrying out video capture, described control module, be additionally operable to control described photographic head and exist The video of other photographic head shooting continues buffered video；

4. video capture device as claimed in claim 3, it is characterised in that described video capture device Also include:

5. video capture device as claimed in claim 4, it is characterised in that described at described photographic head When photographing described face-image, described video capture device also includes:

6. a video capture method, it is characterised in that the front and back in terminal is respectively mounted Mike Wind, described video capture method includes:

7. video capture method as claimed in claim 6, it is characterised in that described described in collection When voice signal meets pre-conditioned, control corresponding photographic head and carry out the step of video capture and include:

Video capture method the most as claimed in claims 6 or 7, it is characterised in that if described terminal it Before have other photographic head carrying out video capture, described gather described voice signal meet pre-conditioned Time, after controlling the step that corresponding photographic head carries out video capture, described video capture method also includes:

9. video capture method as claimed in claim 8, it is characterised in that the described shooting of described control Before head continues the step of buffered video in the video that other photographic head shoots, described video capture method Also include:

10. video capture method as claimed in claim 9, it is characterised in that clap at described photographic head When taking the photograph described face-image, described video capture method also includes: