CN106993134A - A kind of video generation device and method, terminal - Google Patents
A kind of video generation device and method, terminal Download PDFInfo
- Publication number
- CN106993134A CN106993134A CN201710206406.9A CN201710206406A CN106993134A CN 106993134 A CN106993134 A CN 106993134A CN 201710206406 A CN201710206406 A CN 201710206406A CN 106993134 A CN106993134 A CN 106993134A
- Authority
- CN
- China
- Prior art keywords
- area
- captured
- region
- background area
- main body
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/2621—Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Mobile Radio Communication Systems (AREA)
- Telephone Function (AREA)
Abstract
The invention discloses a kind of video generation device and method, terminal, wherein, the device includes：Abstraction module, for extracting foreground area and background area from region to be captured；Determining module, for determining main body thing from above-mentioned foreground area；Fuzzy Processing module, carries out dynamic tensile fuzzy operation for the aforementioned body thing to above-mentioned region to be captured and above-mentioned background area, obtains shooting obtained picture.Present application addresses existing acquisition dynamic picture excessively cumbersome technical problem, the technique effect of simple effective acquisition dynamic picture has been reached.
Description
Technical field
The present invention relates to image processing field, more particularly to a kind of video generation device and method, terminal.
Background technology
With continuing to develop for Internet technology, and the mobile terminal such as mobile phone is continued to develop.Increasing intelligence is eventually
End is all integrated with camera function, so that people can just realize the function such as take pictures by mobile phone terminal.
Further, the requirement with people to effect of taking pictures is also more and more, for example：U.S. face, skin makeup etc..And also one
It is a little that higher crowd, which also wants to that the picture with certain effects can be photographed, to be required to shooting effect.
For example, sometimes someone wishes to shoot with sporty photo, for example, the flight of aircraft, the traveling of automobile, people
Run.At present, in order to realize innervation picture demand, generally require complexity parameter calculated, to obtain innervation
Picture, implement complex.
For the problem, effective solution is not yet proposed at present.
The content of the invention
It is a primary object of the present invention to propose a kind of video generation device and method, terminal, it is intended to simple efficiently to shoot
Provide sporty picture.
To achieve the above object, a kind of video generation device that the present invention is provided, said apparatus includes：
Abstraction module, for extracting foreground area and background area from region to be captured；
Determining module, for determining main body thing from above-mentioned foreground area；
Fuzzy Processing module, enters Mobile state for the aforementioned body thing to above-mentioned region to be captured and above-mentioned background area and draws
Fuzzy operation is stretched, obtains shooting obtained picture.
Further, above-mentioned abstraction module from above-mentioned region to be captured by dual camera specifically for extracting foreground zone
Domain and background area.
Further, above-mentioned abstraction module from above-mentioned specifically for by the depth of view information in above-mentioned region to be captured, treating
Foreground area and background area are extracted in shooting area.
Further, above-mentioned Fuzzy Processing module includes：
First processing units, carry out dynamic tensile for the edge to aforementioned body thing and obscure；
Second processing unit, for being obscured to above-mentioned background area according to dynamic motion track.
Further, above-mentioned Fuzzy Processing module includes：
First combining unit, for main body thing of the dynamic tensile after fuzzy to be merged with above-mentioned foreground area, is obtained
Foreground area after Fuzzy Processing；
Second combining unit, for by background area of the dynamic tensile after fuzzy and the foreground area after above-mentioned Fuzzy Processing
Merge, obtain having sporty static images.
In addition, to achieve the above object, the present invention also proposes a kind of terminal, it is characterised in that given birth to including above-mentioned image
Into device.
In addition, to achieve the above object, the present invention also proposes a kind of image generating method, and the above method includes：
Foreground area and background area are extracted from region to be captured；
Main body thing is determined from above-mentioned foreground area；
Aforementioned body thing and above-mentioned background area to above-mentioned region to be captured carry out dynamic tensile fuzzy operation, are clapped
Take the photograph obtained picture.
Further, foreground area and background area are extracted from region to be captured, including：
Foreground area and background area are extracted from above-mentioned region to be captured by dual camera.
Further, foreground area and background area are extracted from above-mentioned region to be captured by dual camera, including：
By the depth of view information in above-mentioned region to be captured, foreground area and background area are extracted from above-mentioned region to be captured
Domain.
Further, to above-mentioned region to be captured aforementioned body thing and above-mentioned background area carries out the fuzzy behaviour of dynamic tensile
Make, including：
The edge progress dynamic tensile of aforementioned body thing is obscured；
Above-mentioned background area is obscured according to dynamic motion track.
Further, to above-mentioned region to be captured aforementioned body thing and above-mentioned background area carries out the fuzzy behaviour of dynamic tensile
Make, obtain shooting obtained picture, including：
Main body thing of the dynamic tensile after fuzzy is merged with above-mentioned foreground area, the foreground zone after Fuzzy Processing is obtained
Domain；
Background area of the dynamic tensile after fuzzy and the foreground area after above-mentioned Fuzzy Processing are merged, had
Dynamic static images.
A kind of video generation device proposed by the present invention and method, extract foreground area and background area from region to be captured
Domain, then determines main body thing from foreground area, and the main body thing and background area for finally treating shooting area enter Mobile state drawing
Fuzzy operation is stretched, obtains shooting obtained picture.The shooting of dynamic picture is realized through the above way, so as to solve existing
It is some to obtain dynamic picture excessively cumbersome technical problem, reach the technique effect of simple effective acquisition dynamic picture.
Brief description of the drawings
Fig. 1 is the hardware architecture diagram for realizing each optional mobile terminal of embodiment one of the invention；
Fig. 2 is the wireless communication system schematic diagram of mobile terminal as shown in Figure 1；
Fig. 3 is the structured flowchart of the video generation device according to the embodiment of the present invention；
Fig. 4 is the flow chart of the image generating method according to the embodiment of the present invention；
Fig. 5 is the schematic diagram in the region to be captured of the embodiment of the present invention；
Fig. 6 is the main body thing structure chart extracted of the embodiment of the present invention；
Fig. 7 is the Fuzzy Processing result schematic diagram of the background area of the embodiment of the present invention；
Fig. 8 is the sporty static picture of the formation of the embodiment of the present invention；
The realization, functional characteristics and advantage of the object of the invention will be described further referring to the drawings in conjunction with the embodiments.
Embodiment
It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not intended to limit the present invention.
Describe to realize the mobile terminal of each embodiment of the invention referring now to accompanying drawing.In follow-up description, use
For represent element such as " module ", " part " or " unit " suffix only for be conducive to the present invention explanation, itself
Not specific meaning.Therefore, " module " can be used mixedly with " part ".
Mobile terminal can be implemented in a variety of manners.For example, the terminal described in the present invention can include such as moving
Phone, smart phone, notebook computer, digit broadcasting receiver, PDA (personal digital assistant), PAD (tablet personal computer), PMP
The mobile terminal of (portable media player), guider etc. and such as numeral TV, desktop computer etc. are consolidated
Determine terminal.Hereinafter it is assumed that terminal is mobile terminal.However, it will be understood by those skilled in the art that, except being used in particular for movement
Outside the element of purpose, construction according to the embodiment of the present invention can also apply to the terminal of fixed type.
Fig. 1 illustrates for the hardware configuration of the mobile terminal of realization each embodiment of the invention.Certainly, the present invention is in embodiment
It is middle the hardware configuration of the mobile terminal comprehensively to be illustrated, in subsequent embodiment, if also relating to mobile terminal,
The hardware configuration in embodiment can be used to illustrate, repetition of explanation will be carried out no longer in subsequent embodiment, the description below answers pin
Each embodiment of the invention is applicable.
Mobile terminal 1 00 can include wireless communication unit 110, A/V (audio/video) input block 120, user's input
Unit 130, sensing unit 140, output unit 150, memory 160, interface unit 170, controller 180 and power subsystem 190
Etc..Fig. 1 shows the mobile terminal with various assemblies, it should be understood that being not required for implementing all groups shown
Part.More or less components can alternatively be implemented.The element of mobile terminal will be discussed in more detail below.
Wireless communication unit 110 generally includes one or more assemblies, and it allows mobile terminal 1 00 and wireless communication system
Or the radio communication between network.For example, wireless communication unit can include broadcasting reception module 111, mobile communication module
112nd, at least one in wireless Internet module 113, short range communication module 114 and location information module 115.
Broadcasting reception module 111 receives broadcast singal and/or broadcast via broadcast channel from external broadcast management server
Relevant information.Broadcast channel can include satellite channel and/or terrestrial channel.Broadcast management server can be generated and sent
The broadcast singal and/or broadcast related information generated before the server or reception of broadcast singal and/or broadcast related information
And send it to the server of terminal.Broadcast singal can include TV broadcast singals, radio signals, data broadcasting
Signal etc..Moreover, broadcast singal may further include the broadcast singal combined with TV or radio signals.Broadcast phase
Closing information can also provide via mobile communications network, and in this case, broadcast related information can be by mobile communication mould
Block 112 is received.Broadcast singal can exist in a variety of manners, for example, it can be with DMB (DMB) electronics
The form of program guide (EPG), the electronic service guidebooks (ESG) of digital video broadcast-handheld (DVB-H) etc. and exist.Broadcast
Receiving module 111 can receive signal broadcast by using various types of broadcast systems.Especially, broadcasting reception module 111
Can be wide by using such as multimedia broadcasting-ground (DMB-T), DMB-satellite (DMB-S), digital video
Broadcast-hand-held (DVB-H), forward link media (MediaFLO@) Radio Data System, received terrestrial digital broadcasting integrated service
Etc. (ISDB-T) digit broadcasting system receives digital broadcasting.Broadcasting reception module 111, which may be constructed such that, to be adapted to provide for extensively
Broadcast the various broadcast systems and above-mentioned digit broadcasting system of signal.Via broadcasting reception module 111 receive broadcast singal and/
Or broadcast related information can be stored in memory 160 (or other types of storage medium).
Mobile communication module 112 sends radio signals to base station (for example, access point, node B etc.), exterior terminal
And in server at least one and/or receive from it radio signal.Such radio signal can be logical including voice
Talk about signal, video calling signal or the various types of data for sending and/or receiving according to text and/or Multimedia Message.
Wireless Internet module 113 supports the Wi-Fi (Wireless Internet Access) of mobile terminal.The module can be internally or externally
It is couple to terminal.Wi-Fi (Wireless Internet Access) technology involved by the module can include WLAN (WLAN) (Wi-Fi), Wibro
(WiMAX), Wimax (worldwide interoperability for microwave accesses), HSDPA (high-speed downlink packet access) etc..
Short range communication module 114 is the module for supporting junction service.Some examples of short-range communication technology include indigo plant
ToothTM, radio frequency identification (RFID), Infrared Data Association (IrDA), ultra wide band (UWB), purple honeybeeTMEtc..
Location information module 115 is the module for checking or obtaining the positional information of mobile terminal.Location information module
Typical case be GPS (global positioning system).According to current technology, GPS module 115, which is calculated, comes from three or more satellites
Range information and correct time information and for the Information application triangulation of calculating so that according to longitude, latitude
Highly accurately calculate three-dimensional current location information.Currently, defended for calculating the method for position and temporal information using three
Star and the position calculated by using other satellite correction and the error of temporal information.In addition, GPS module 115
Can be by Continuous plus current location information in real time come calculating speed information.
A/V input blocks 120 are used to receive audio or video signal.A/V input blocks 120 can include the He of camera 121
Microphone 122, the static images that 121 pairs of camera is obtained in video acquisition mode or image capture mode by image capture apparatus
Or the view data of video is handled.Picture frame after processing may be displayed on display unit 151.Handled through camera 121
Picture frame afterwards can be stored in memory 160 (or other storage mediums) or be sent out via wireless communication unit 110
Send, two or more cameras 121 can be provided according to the construction of mobile terminal.Microphone 122 can be in telephone calling model, note
Sound (voice data) is received via microphone in record pattern, speech recognition mode etc. operational mode, and can be by so
Acoustic processing be voice data.Audio (voice) data after processing can be converted in the case of telephone calling model can
The form output of mobile communication base station is sent to via mobile communication module 112.Microphone 122 can implement various types of make an uproar
Sound eliminates (or suppression) algorithm to eliminate the noise or dry that (or suppression) produces during receiving and sending audio signal
Disturb.
The order that user input unit 130 can be inputted according to user generates key input data to control each of mobile terminal
Plant operation.User input unit 130 allows user to input various types of information, and can include keyboard, metal dome, touch
Plate (for example, detection due to being touched caused by resistance, pressure, electric capacity etc. change sensitive component), roller, rocking bar etc.
Deng.Especially, when touch pad is superimposed upon on display unit 151 in the form of layer, touch-screen can be formed.
Sensing unit 140 detects the current state of mobile terminal 1 00, (for example, mobile terminal 1 00 opens or closes shape
State), the position of mobile terminal 1 00, user is for the presence or absence of contact (that is, touch input) of mobile terminal 1 00, mobile terminal
The acceleration or deceleration movement of 100 orientation, mobile terminal 1 00 and direction etc., and generate for controlling mobile terminal 1 00
The order of operation or signal.For example, when mobile terminal 1 00 is embodied as sliding-type mobile phone, sensing unit 140 can be sensed
The sliding-type phone is opening or closing.In addition, sensing unit 140 can detect power subsystem 190 whether provide electric power or
Whether person's interface unit 170 couples with external device (ED).Sensing unit 140, which can include proximity transducer 1410, to be combined below
This is described touch-screen.
Interface unit 170 is connected the interface that can pass through as at least one external device (ED) with mobile terminal 1 00.For example,
External device (ED) can include wired or wireless head-band earphone port, external power source (or battery charger) port, wired or nothing
Line FPDP, memory card port, the port for connecting the device with identification module, audio input/output (I/O) end
Mouth, video i/o port, ear port etc..Identification module can be that storage is used to verify that user uses each of mobile terminal 1 00
Plant information and subscriber identification module (UIM), client identification module (SIM), Universal Subscriber identification module (USIM) can be included
Etc..In addition, the device (hereinafter referred to as " identifying device ") with identification module can take the form of smart card, therefore, know
Other device can be connected via port or other attachment means with mobile terminal 1 00.Interface unit 170 can be used for reception and come from
The input (for example, data message, electric power etc.) of external device (ED) and the input received is transferred in mobile terminal 1 00
One or more elements can be used for transmitting data between mobile terminal and external device (ED).
In addition, when mobile terminal 1 00 is connected with external base, interface unit 170 may be used as allowing by it by electricity
Power provides to the path of mobile terminal 1 00 from base or may be used as allowing passing through it from the various command signals that base is inputted
It is transferred to the path of mobile terminal.The various command signals or electric power inputted from base may be used as being used to recognize that mobile terminal is
The no signal being accurately fitted within base.Output unit 150 is configured to provide defeated with vision, audio and/or tactile manner
Go out signal (for example, audio signal, vision signal, alarm signal, vibration signal etc.).Output unit 150 can include display
Unit 151, dio Output Modules 152, alarm unit 153 etc..
Display unit 151 may be displayed on the information handled in mobile terminal 1 00.For example, when mobile terminal 1 00 is in electricity
When talking about call mode, display unit 151 can be shown with conversing or other communicating (for example, text messaging, multimedia file
Download etc.) related user interface (UI) or graphic user interface (GUI).When mobile terminal 1 00 is in video calling pattern
Or during image capture mode, display unit 151 can show the image of capture and/or the image of reception, show video or figure
UI or GUI of picture and correlation function etc..
Meanwhile, when display unit 151 and touch pad in the form of layer it is superposed on one another to form touch-screen when, display unit
151 may be used as input unit and output device.Display unit 151 can include liquid crystal display (LCD), thin film transistor (TFT)
In LCD (TFT-LCD), Organic Light Emitting Diode (OLED) display, flexible display, three-dimensional (3D) display etc. at least
It is a kind of.Some in these displays may be constructed such that transparence to allow user to be watched from outside, and this is properly termed as transparent
Display, typical transparent display can be, for example, TOLED (transparent organic light emitting diode) display etc..According to specific
Desired embodiment, mobile terminal 1 00 can include two or more display units (or other display devices), for example, moving
Dynamic terminal can include outernal display unit (not shown) and inner display unit (not shown).Touch-screen can be used for detection to touch
Input pressure and touch input position and touch input area.
Dio Output Modules 152 can mobile terminal be in call signal reception pattern, call mode, logging mode,
It is that wireless communication unit 110 is received or in memory 160 when under the isotypes such as speech recognition mode, broadcast reception mode
The voice data transducing audio signal of middle storage and it is output as sound.Moreover, dio Output Modules 152 can be provided and movement
The audio output (for example, call signal receives sound, message sink sound etc.) for the specific function correlation that terminal 100 is performed.
Dio Output Modules 152 can include loudspeaker, buzzer etc..
Alarm unit 153 can provide output to notify event to mobile terminal 1 00.Typical event can be with
Including calling reception, message sink, key signals input, touch input etc..In addition to audio or video is exported, alarm unit
153 can provide output in a different manner with the generation of notification event.For example, alarm unit 153 can be in the form of vibration
Output is provided, when receiving calling, message or some other entrance communications (incomingcommunication), alarm list
Member 153 can provide tactile output (that is, vibrating) to notify to user.Exported by providing such tactile, even in
When the mobile phone of user is in the pocket of user, user also can recognize that the generation of various events.Alarm unit 153
The output of the generation of notification event can be provided via display unit 151 or dio Output Modules 152.
Memory 160 can store software program of the processing performed by controller 180 and control operation etc., Huo Zheke
Temporarily to store oneself data (for example, telephone directory, message, still image, video etc.) through exporting or will export.And
And, memory 160 can store the vibration of various modes on being exported when touching and being applied to touch-screen and audio signal
Data.
Memory 160 can include the storage medium of at least one type, and the storage medium includes flash memory, hard disk, many
Media card, card-type memory (for example, SD or DX memories etc.), random access storage device (RAM), static random-access storage
Device (SRAM), read-only storage (ROM), Electrically Erasable Read Only Memory (EEPROM), programmable read only memory
(PROM), magnetic storage, disk, CD etc..Moreover, mobile terminal 1 00 can be with performing memory by network connection
The network storage device cooperation of 160 store function.
The overall operation of the generally control mobile terminal of controller 180.For example, controller 180 is performed and voice call, data
Communication, video calling etc. related control and processing.In addition, controller 180 can include being used to reproduce (or playback) many matchmakers
The multi-media module 181 of volume data, multi-media module 181 can be constructed in controller 180, or can be structured as and control
Device 180 is separated.Controller 180 can be with execution pattern identifying processing, by the handwriting input performed on the touchscreen or picture
Draw input and be identified as character or image.
Power subsystem 190 receives external power or internal power under the control of controller 180 and provides operation each member
Appropriate electric power needed for part and component.
Various embodiments described herein can be with use such as computer software, hardware or its any combination of calculating
Machine computer-readable recording medium is implemented.Implement for hardware, embodiment described herein can be by using application-specific IC
(ASIC), digital signal processor (DSP), digital signal processing device (DSPD), programmable logic device (PLD), scene can
Programming gate array (FPGA), processor, controller, microcontroller, microprocessor, it is designed to perform function described herein
At least one of electronic unit is implemented, and in some cases, such embodiment can be implemented in controller 180.
For software implementation, the embodiment of such as process or function can be with allowing to perform the single of at least one function or operation
Software module is implemented.Software code can by the software application (or program) write with any appropriate programming language Lai
Implement, software code can be stored in memory 160 and be performed by controller 180.
So far, oneself according to its function through describing mobile terminal.Below, for the sake of brevity, will description such as folded form,
Slide type mobile terminal in various types of mobile terminals of board-type, oscillating-type, slide type mobile terminal etc. is as showing
Example.Therefore, the present invention can be applied to any kind of mobile terminal, and be not limited to slide type mobile terminal.
Mobile terminal 1 00 as shown in Figure 1 may be constructed such that using via frame or packet transmission data it is all if any
Line and wireless communication system and satellite-based communication system are operated.
The communication system for describing wherein be operated according to the mobile terminal of the present invention referring now to Fig. 2.
Such communication system can use different air interfaces and/or physical layer.For example, used by communication system
Air interface includes such as frequency division multiple access (FDMA), time division multiple acess (TDMA), CDMA (CDMA) and universal mobile communications system
System (UMTS) (especially, Long Term Evolution (LTE)), global system for mobile communications (GSM) etc..As non-limiting example, under
The description in face is related to cdma communication system, but such teaching is equally applicable to other types of system.
With reference to Fig. 2, cdma wireless communication system can include multiple mobile terminal 1s 00, multiple base stations (BS) 270, base station
Controller (BSC) 275 and mobile switching centre (MSC) 280.MSC280 is configured to and Public Switched Telephony Network (PSTN)
290 form interface.MSC280 is also structured to the BSC275 formation interfaces with that can be couple to base station 270 via back haul link.
If any of interface that back haul link can be known according to Ganji is constructed, the interface includes such as E1/T1, ATM, IP,
PPP, frame relay, HDSL, ADSL or xDSL.It will be appreciated that system can include multiple BSC275 as shown in Figure 2.
Each BS270 can service one or more subregions (or region), by multidirectional antenna or the day of sensing specific direction
Each subregion of line covering is radially away from BS270.Or, each subregion can be by two or more for diversity reception
Antenna is covered.Each BS270 may be constructed such that the multiple frequency distribution of support, and each frequency distribution has specific frequency spectrum
(for example, 1.25MHz, 5MHz etc.).
What subregion and frequency were distributed, which intersects, can be referred to as CDMA Channel.BS270 can also be referred to as base station transceiver
System (BTS) or other equivalent terms.In this case, term " base station " can be used for broadly representing single
BSC275 and at least one BS270.Base station can also be referred to as " cellular station ".Or, specific BS270 each subregion can be claimed
For multiple cellular stations.
As shown in Figure 2, broadcast singal is sent to the mobile terminal operated in system by broadcsting transmitter (BT) 295
100.Broadcasting reception module 111 as shown in Figure 1 is arranged at mobile terminal 1 00 to receive the broadcast sent by BT295
Signal.In fig. 2 it is shown that several global positioning system (GPS) satellites 300.Satellite 300 helps to position multiple mobile terminals
At least one in 100.
In fig. 2, multiple satellites 300 are depicted, it is understood that be, it is possible to use any number of satellite obtains useful
Location information.GPS module 115 as shown in Figure 1 is generally configured to coordinate with satellite 300 to obtain desired positioning letter
Breath.GPS tracking techniques or outside GPS tracking techniques are substituted, the other of the position that can track mobile terminal can be used
Technology.In addition, at least one gps satellite 300 can optionally or additionally handle satellite dmb transmission.
As a typical operation of wireless communication system, BS270 receives the reverse link from various mobile terminal 1s 00
Signal.Mobile terminal 1 00 generally participates in call, information receiving and transmitting and other types of communication.It is each anti-that certain base station 270 is received
Handled to link signal in specific BS270.The data of acquisition are forwarded to the BSC275 of correlation.BSC provides call
Resource allocation and the mobile management function of coordination including the soft switching process between BS270.BSC275 is also by the number received
According to MSC280 is routed to, it is provided for the extra route service with PSTN290 formation interfaces.Similarly, PSTN290 with
MSC280 formation interfaces, MSC and BSC275 formation interface, and BSC275 correspondingly control BS270 with by forward link signals
It is sent to mobile terminal 1 00.
Based on above-mentioned mobile terminal hardware configuration and communication system, the mobile terminal in the embodiment of the present invention is proposed, such as
Shown in Fig. 3, a kind of video generation device can be provided with the mobile terminal, can be included：Abstraction module 301, determining module
302 and Fuzzy Processing module 303.These modules are described as follows below：
1) abstraction module 301, for extracting foreground area and background area from region to be captured；
Above-mentioned abstraction module 301 can be carried out in response to user in the triggering command of taking pictures of mobile terminal,
It can be performed when user selects synthesis or generation module image.
For example, can be that blurred picture systematic function is built-in with camera function, in user in an application scenarios
When selecting the pattern to be taken pictures, when " taking pictures " is clicked on, indicate that triggering carries out current work of taking pictures.This
When, abstraction module 301 can just be triggered extracts foreground area and background area from region to be captured.Wherein, it is so-called to treat
Shooting area can be region that is that the camera that present terminal is presented is faced or including, it is possible to be used as area to be captured
Domain.
In another application scenarios or after one pictures of selection, the picture is become dynamic by selection
Picture, then the region that will be shown on photo current can also be triggered as region to be captured, then identified in the picture
Foreground area and background area, and further carry out corresponding Fuzzy Processing etc..
Certainly, above-mentioned cited application scenarios are only a kind of schematic descriptions, when actually realizing, can also be had
Other many application scenarios, the application is not construed as limiting to this.
Can pre-establish a training pattern when foreground area and background area is extracted, by artificial right
Multiple samples pictures carry out artificial demarcation foreground area and background area, are then trained and obtain one and can automatically identify
Foreground area and the identification model of background area.
It is input in region to be captured as content to be identified in the identification model, it is possible to automatically identify the back of the body therein
Scene area and foreground area.
Foreground area and the background area in region to be captured can certainly be recognized using other modes, for example, can be with
Determine the position where the object that is moved in image, using object position in motion to the region between camera as
Foreground area, object position in motion is started away from the region between camera as background area etc., either
Foreground area and background area are recognized using other modes, specific identification method the application is not construed as limiting.
2) determining module 302, for determining main body thing from the foreground area；
After foreground area is determined, object can be determined from foreground area, main body thing is referred to as.Example
Such as, if photographic subjects be one run in people, aircraft in-flight, start in automobile etc., then these objects are all
The main body thing to be determined can be used as.That is, the main body thing determined is exactly to need to become the subject object thing of dynamic state.
Can be recognized by the way of by identification model, it would however also be possible to employ user when main body thing is identified
The mode of click, for example, user clicks on some region on user terminal, then just using the main body in the region as identifying
Main body thing, that is, be used as the object of dynamic image to be generated.For example, photographic subjects are a people run, then user
Can click on people on display screen region, then can just identify the people as main body thing, that is, need to become dynamic
The destination object of sense state.
3) Fuzzy Processing module 303, for the main body thing in the region to be captured and background area progress
Dynamic tensile fuzzy operation, obtains shooting obtained picture.
When realizing, it is contemplated that dynamic image is mainly the motion state formation of main body thing, for example, aircraft flies
When mistake, there is certain delay in the eyes of people, for the movement effects of the destination object of shooting this speed,
The dynamic image of these targets can be shot.Wherein, Fuzzy Processing module 303 can include：First processing units, for pair
The edge of the main body thing carries out dynamic tensile and obscured；Second processing unit, for the background area according to dynamic motion
Track is obscured.That is, can be that first the edge progress dynamic tensile of main body thing is obscured when Fuzzy Processing is carried out,
Then carry out stretching according still further to the direction of motion of main body thing to background area again to obscure, can thus form fuzzy dynamic state
Image.
Can carry out main body thing of the dynamic tensile after fuzzy with the foreground area when Fuzzy Processing is carried out
Merge, obtain the foreground area after Fuzzy Processing, then by the background area after dynamic tensile is obscured and the Fuzzy Processing
Foreground area afterwards is merged, and obtains having sporty static images.
That is, region to be captured is divided into three parts：Main body thing, foreground area, background area.Then, main body thing is carried out
Fuzzy Processing, Fuzzy Processing is carried out to background area, then three is merged, formed eventually with dynamic picture.
When above-mentioned determination foreground area and background area, it can be realized by dual camera, i.e. in terminal
Two cameras of middle setting, the first camera and second camera, foreground area and background area are realized by the two cameras
The extraction in domain.When foreground area and background area extraction is carried out, it can be determined by the depth of field.
Based on above-mentioned mobile terminal hardware configuration and communication system, each embodiment of the inventive method is proposed.
As shown in figure 4, the embodiment of the present invention proposes a kind of image generating method, including：
Step 401：Foreground area and background area are extracted from region to be captured；
In one embodiment, it can be carried out in response to user in the triggering command of taking pictures of mobile terminal,
It can be performed when user selects synthesis or generation module image.
For example, can be that blurred picture systematic function is built-in with camera function, in user in an application scenarios
When selecting the pattern to be taken pictures, when " taking pictures " is clicked on, indicate that triggering carries out current work of taking pictures.This
When, it can trigger and foreground area and background area are extracted from region to be captured.Wherein, so-called region to be captured can be
Region that is that the camera that present terminal is presented is faced or including, it is possible to be used as region to be captured.
In another application scenarios or after one pictures of selection, the picture is become dynamic by selection
Picture, then the region that will be shown on photo current can also be triggered as region to be captured, then identified in the picture
Foreground area and background area, and further carry out corresponding Fuzzy Processing etc..
Certainly, above-mentioned cited application scenarios are only a kind of schematic descriptions, when actually realizing, can also be had
Other many application scenarios, the application is not construed as limiting to this.
Can pre-establish a training pattern when foreground area and background area is extracted, by artificial right
Multiple samples pictures carry out artificial demarcation foreground area and background area, are then trained and obtain one and can automatically identify
Foreground area and the identification model of background area.
It is input in region to be captured as content to be identified in the identification model, it is possible to automatically identify the back of the body therein
Scene area and foreground area.
Foreground area and the background area in region to be captured can certainly be recognized using other modes, for example, can be with
Determine the position where the object that is moved in image, using object position in motion to the region between camera as
Foreground area, object position in motion is started away from the region between camera as background area etc., either
Foreground area and background area are recognized using other modes, specific identification method the application is not construed as limiting.
Step 402：Main body thing is determined from the foreground area；
After foreground area is determined, object can be determined from foreground area, main body thing is referred to as.Example
Such as, if photographic subjects be one run in people, aircraft in-flight, start in automobile etc., then these objects are all
The main body thing to be determined can be used as.That is, the main body thing determined is exactly to need to become the subject object thing of dynamic state.
Can be recognized by the way of by identification model, it would however also be possible to employ user when main body thing is identified
The mode of click, for example, user clicks on some region on user terminal, then just using the main body in the region as identifying
Main body thing, that is, be used as the object of dynamic image to be generated.For example, photographic subjects are a people run, then user
Can click on people on display screen region, then can just identify the people as main body thing, that is, need to become dynamic
The destination object of sense state.
Step 403：The fuzzy behaviour of dynamic tensile is carried out to the main body thing in the region to be captured and the background area
Make, obtain shooting obtained picture.
When realizing, it is contemplated that dynamic image is mainly the motion state formation of main body thing, for example, aircraft flies
When mistake, there is certain delay in the eyes of people, for the movement effects of the destination object of shooting this speed,
The dynamic image of these targets can be shot.In one embodiment, step 403 can include：To the main body thing
Edge carries out dynamic tensile and obscured；The background area is obscured according to dynamic motion track.That is, Fuzzy Processing is being carried out
When, can be that first the edge progress dynamic tensile of main body thing is obscured, then again to background area according still further to main body thing
The direction of motion carries out stretching and obscured, and can thus form the image of fuzzy dynamic state.
Can carry out main body thing of the dynamic tensile after fuzzy with the foreground area when Fuzzy Processing is carried out
Merge, obtain the foreground area after Fuzzy Processing, then by the background area after dynamic tensile is obscured and the Fuzzy Processing
Foreground area afterwards is merged, and obtains having sporty static images.
That is, region to be captured is divided into three parts：Main body thing, foreground area, background area.Then, main body thing is carried out
Fuzzy Processing, Fuzzy Processing is carried out to background area, then three is merged, formed eventually with dynamic picture.
When above-mentioned determination foreground area and background area, it can be realized by dual camera, i.e. in terminal
Two cameras of middle setting, the first camera and second camera, foreground area and background area are realized by the two cameras
The extraction in domain.When foreground area and background area extraction is carried out, it can be determined by the depth of field.
Above-mentioned image generating method and device are illustrated with reference to a specific embodiment, however it is noticeable
It is that the specific embodiment does not constitute the improper restriction to the application merely to the application is better described.
In this example, shot with the mobile terminal of dual camera.When shooting, the first camera can be passed through
Taken pictures with second camera joint.First camera shoots normal image, and second camera carries out fuzzy place to image
Reason, then, both merge, so as to obtain a dynamic rest image.That is, two cameras can perform different behaviour
Make, different pictures are obtained, so that can finally merge processing.
Specifically, it may include steps of：
S1：Camera is opened, using dual camera, foreground and background information is detached；Detaching foreground information and background letter
When breath, it is possible to the depth of view information of main body thing is determined by dual camera, determined with the identification for realizing background and prospect.
S2：Can be fuzzy with dynamic tensile to the edge of foreground subject thing, background can also be entered according to dynamic motion track
Row is fuzzy；
S3：Form a sporty static picture.
For example, it is an airplane as shown in figure 5, being region to be captured, it is sporty in order to shoot the aircraft band
Image, can identify main body thing therein and background area.Then, as shown in fig. 6, being the corresponding framework signal of main body thing
Figure, as shown in fig. 7, carrying out the signal after obscuring according to the movement locus of main body thing to background area for the framework based on main body thing
Figure.Then, the background area after main body thing, foreground area and the Fuzzy Processing after Fuzzy Processing is merged, obtained as
The sporty static picture of band shown in Fig. 8.The photo as to be obtained.
A kind of video generation device proposed by the present invention and method, extract foreground area and background area from region to be captured
Domain, then determines main body thing from foreground area, and the main body thing and background area for finally treating shooting area enter Mobile state drawing
Fuzzy operation is stretched, obtains shooting obtained picture.The shooting of dynamic picture is realized through the above way, so as to solve existing
Acquisition dynamic picture excessively cumbersome technical problem, reached the technique effect of simple effective acquisition dynamic picture.
It should be noted that herein, term " comprising ", "comprising" or its any other variant are intended to non-row
His property is included, so that process, method, article or device including a series of key elements not only include those key elements, and
And also including other key elements being not expressly set out, or also include for this process, method, article or device institute inherently
Key element.In the absence of more restrictions, the key element limited by sentence "including a ...", it is not excluded that including this
Also there is other identical element in process, method, article or the device of key element.
The embodiments of the present invention are for illustration only, and the quality of embodiment is not represented.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side
Method can add the mode of required general hardware platform to realize by software, naturally it is also possible to by hardware, but in many cases
The former is more preferably embodiment.Understood based on such, technical scheme is substantially done to prior art in other words
Going out the part of contribution can be embodied in the form of software product, and the computer software product is stored in a storage medium
In (such as ROM/RAM, magnetic disc, CD), including some instructions are to cause a station terminal equipment (can be mobile phone, computer, clothes
It is engaged in device, air conditioner, or network equipment etc.) perform method described in each embodiment of the invention.
The preferred embodiments of the present invention are these are only, are not intended to limit the scope of the invention, it is every to utilize this hair
Equivalent structure or equivalent flow conversion that bright specification and accompanying drawing content are made, or directly or indirectly it is used in other related skills
Art field, is included within the scope of the present invention.
Claims (10)
1. a kind of video generation device, it is characterised in that described device includes：
Abstraction module, for extracting foreground area and background area from region to be captured；
Determining module, for determining main body thing from the foreground area；
Fuzzy Processing module, for carrying out dynamic tensile mould to the main body thing in the region to be captured and the background area
Paste operation, obtains shooting obtained picture.
2. device according to claim 1, it is characterised in that the abstraction module is specifically for passing through the area to be captured
Depth of view information in domain, extracts foreground area and background area from the region to be captured.
3. device according to claim 1, it is characterised in that the Fuzzy Processing module includes：
First processing units, carry out dynamic tensile for the edge to the main body thing and obscure；
Second processing unit, for being obscured to the background area according to dynamic motion track.
4. device according to claim 1, it is characterised in that the Fuzzy Processing module includes：
First combining unit, for main body thing of the dynamic tensile after fuzzy to be merged with the foreground area, is obscured
Foreground area after processing；
Second combining unit, for background area of the dynamic tensile after fuzzy and the foreground area after the Fuzzy Processing to be carried out
Merge, obtain having sporty static images.
5. a kind of terminal, it is characterised in that including the video generation device any one of Claims 1-4.
6. a kind of image generating method, it is characterised in that methods described includes：
Foreground area and background area are extracted from region to be captured；
Main body thing is determined from the foreground area；
Dynamic tensile fuzzy operation is carried out to the main body thing in the region to be captured and the background area, shot
The picture arrived.
7. method according to claim 6, it is characterised in that foreground area and background area are extracted from region to be captured
Domain, including：
Foreground area and background area are extracted from the region to be captured by dual camera.
8. method according to claim 7, it is characterised in that before being extracted by dual camera from the region to be captured
Scene area and background area, including：
By the depth of view information in the region to be captured, foreground area and background area are extracted from the region to be captured.
9. method according to claim 7, it is characterised in that to the main body thing in the region to be captured and the back of the body
Scene area carries out dynamic tensile fuzzy operation, including：
The edge progress dynamic tensile of the main body thing is obscured；
The background area is obscured according to dynamic motion track.
10. method according to claim 6, it is characterised in that the main body thing to the region to be captured and described
Background area carries out dynamic tensile fuzzy operation, obtains shooting obtained picture, including：
Main body thing of the dynamic tensile after fuzzy is merged with the foreground area, the foreground area after Fuzzy Processing is obtained；
Background area of the dynamic tensile after fuzzy and the foreground area after the Fuzzy Processing are merged, obtain that there is innervation
Static images.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710206406.9A CN106993134B (en) | 2017-03-31 | 2017-03-31 | Image generation device and method and terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710206406.9A CN106993134B (en) | 2017-03-31 | 2017-03-31 | Image generation device and method and terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106993134A true CN106993134A (en) | 2017-07-28 |
| CN106993134B CN106993134B (en) | 2020-01-07 |
Family
ID=59414622
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710206406.9A Active CN106993134B (en) | 2017-03-31 | 2017-03-31 | Image generation device and method and terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106993134B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108111748A (en) * | 2017-11-30 | 2018-06-01 | 维沃移动通信有限公司 | A kind of method and apparatus for generating dynamic image |
| CN110084765A (en) * | 2019-05-05 | 2019-08-02 | Oppo广东移动通信有限公司 | A kind of image processing method, image processing apparatus and terminal device |
| CN110457102A (en) * | 2019-07-26 | 2019-11-15 | 武汉深之度科技有限公司 | Blur method, rendering method and the calculating equipment of visual object |
| CN113132612A (en) * | 2019-12-31 | 2021-07-16 | 华为技术有限公司 | Image stabilization processing method, terminal shooting method, medium and system |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1290907A (en) * | 1999-06-30 | 2001-04-11 | 国际商业机器公司 | Image process for realizing moving fuzzification |
| US20060061567A1 (en) * | 2004-09-22 | 2006-03-23 | Namco Ltd. | Program, information storage medium and image generation apparatus |
| KR20110043991A (en) * | 2009-10-22 | 2011-04-28 | 삼성테크윈 주식회사 | Apparatus and method for processing motion blur |
| JP4761537B2 (en) * | 2006-03-27 | 2011-08-31 | サミー株式会社 | Image generating apparatus, game machine, and image generating program |
| US20150113371A1 (en) * | 2013-10-18 | 2015-04-23 | Apple Inc. | Presentation system motion blur |
| US20160125633A1 (en) * | 2013-05-13 | 2016-05-05 | Nokia Technologies Oy | Method, apparatus and computer program product to represent motion in composite images |
| KR101671391B1 (en) * | 2015-07-07 | 2016-11-02 | 한국과학기술연구원 | Method for deblurring video using modeling blurred video with layers, recording medium and device for performing the method |
| CN106170976A (en) * | 2014-04-14 | 2016-11-30 | 阿尔卡特朗讯公司 | For the method and apparatus obtaining the image with motion blur |
| CN106454143A (en) * | 2016-08-31 | 2017-02-22 | 周民 | Motion image shooting method and terminal |
-
2017
- 2017-03-31 CN CN201710206406.9A patent/CN106993134B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1290907A (en) * | 1999-06-30 | 2001-04-11 | 国际商业机器公司 | Image process for realizing moving fuzzification |
| US20060061567A1 (en) * | 2004-09-22 | 2006-03-23 | Namco Ltd. | Program, information storage medium and image generation apparatus |
| JP4761537B2 (en) * | 2006-03-27 | 2011-08-31 | サミー株式会社 | Image generating apparatus, game machine, and image generating program |
| KR20110043991A (en) * | 2009-10-22 | 2011-04-28 | 삼성테크윈 주식회사 | Apparatus and method for processing motion blur |
| US20160125633A1 (en) * | 2013-05-13 | 2016-05-05 | Nokia Technologies Oy | Method, apparatus and computer program product to represent motion in composite images |
| US20150113371A1 (en) * | 2013-10-18 | 2015-04-23 | Apple Inc. | Presentation system motion blur |
| CN106170976A (en) * | 2014-04-14 | 2016-11-30 | 阿尔卡特朗讯公司 | For the method and apparatus obtaining the image with motion blur |
| KR101671391B1 (en) * | 2015-07-07 | 2016-11-02 | 한국과학기술연구원 | Method for deblurring video using modeling blurred video with layers, recording medium and device for performing the method |
| CN106454143A (en) * | 2016-08-31 | 2017-02-22 | 周民 | Motion image shooting method and terminal |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108111748A (en) * | 2017-11-30 | 2018-06-01 | 维沃移动通信有限公司 | A kind of method and apparatus for generating dynamic image |
| CN108111748B (en) * | 2017-11-30 | 2021-01-08 | 维沃移动通信有限公司 | Method and device for generating dynamic image |
| CN110084765A (en) * | 2019-05-05 | 2019-08-02 | Oppo广东移动通信有限公司 | A kind of image processing method, image processing apparatus and terminal device |
| CN110457102A (en) * | 2019-07-26 | 2019-11-15 | 武汉深之度科技有限公司 | Blur method, rendering method and the calculating equipment of visual object |
| CN110457102B (en) * | 2019-07-26 | 2022-07-08 | 武汉深之度科技有限公司 | Visual object blurring method, visual object rendering method and computing equipment |
| CN114924824A (en) * | 2019-07-26 | 2022-08-19 | 武汉深之度科技有限公司 | Visual object blurring method, visual object rendering method and computing equipment |
| CN114924824B (en) * | 2019-07-26 | 2023-11-14 | 武汉深之度科技有限公司 | Visual object blurring method, visual object rendering method and computing device |
| CN113132612A (en) * | 2019-12-31 | 2021-07-16 | 华为技术有限公司 | Image stabilization processing method, terminal shooting method, medium and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106993134B (en) | 2020-01-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104750420B (en) | Screenshotss method and device | |
| CN104735255B (en) | Multi-screen display method and system | |
| CN107018331A (en) | A kind of imaging method and mobile terminal based on dual camera | |
| CN106888349A (en) | A kind of image pickup method and device | |
| CN106550126A (en) | The control device and method of mobile terminal and its screen intensity | |
| CN105430258B (en) | A kind of method and apparatus of self-timer group photo | |
| CN104679890B (en) | Picture method for pushing and device | |
| CN106713716A (en) | Double cameras shooting control method and device | |
| CN106911850A (en) | Mobile terminal and its screenshotss method | |
| CN106851128A (en) | A kind of video data handling procedure and device based on dual camera | |
| CN106506778A (en) | A kind of dialing mechanism and method | |
| CN106851113A (en) | A kind of photographic method and mobile terminal based on dual camera | |
| CN106534552B (en) | Mobile terminal and its photographic method | |
| CN106873895A (en) | The implementation method and device of a kind of edge gesture operation | |
| CN107016639A (en) | A kind of image processing method and device | |
| CN106993134A (en) | A kind of video generation device and method, terminal | |
| CN107018334A (en) | A kind of applied program processing method and device based on dual camera | |
| CN106959816A (en) | Video intercepting method and mobile terminal | |
| CN106911881A (en) | A kind of an action shot filming apparatus based on dual camera, method and terminal | |
| CN107018326A (en) | A kind of image pickup method and device | |
| CN107071161A (en) | The aggregation display method and mobile terminal of icon in a kind of status bar | |
| CN106790994A (en) | The triggering method and mobile terminal of control | |
| CN106791016A (en) | A kind of photographic method and terminal | |
| CN106484534A (en) | Control method for the mobile terminal of displaying and control device | |
| CN106851114A (en) | A kind of photo shows, photo generating means and method, terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |