CN106973222A - The control method and mobile terminal of a kind of Digital Zoom - Google Patents

The control method and mobile terminal of a kind of Digital Zoom Download PDF

Info

Publication number
CN106973222A
CN106973222A CN201710114969.5A CN201710114969A CN106973222A CN 106973222 A CN106973222 A CN 106973222A CN 201710114969 A CN201710114969 A CN 201710114969A CN 106973222 A CN106973222 A CN 106973222A
Authority
CN
China
Prior art keywords
user
human eye
area
mobile terminal
zoom
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710114969.5A
Other languages
Chinese (zh)
Inventor
郝鹏飞
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vivo Mobile Communication Co Ltd
Original Assignee
Vivo Mobile Communication Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vivo Mobile Communication Co Ltd filed Critical Vivo Mobile Communication Co Ltd
Priority to CN201710114969.5A priority Critical patent/CN106973222A/en
Publication of CN106973222A publication Critical patent/CN106973222A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/61Control of cameras or camera modules based on recognised objects
    • H04N23/611Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/67Focus control based on electronic image sensor signals

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)

Abstract

The invention provides a kind of control method of Digital Zoom and mobile terminal.Mobile terminal has front camera and rear camera, and methods described includes:Obtain the user images of front camera collection;Determine user in the focus vision region taken pictures on preview area of the mobile terminal according to the user images;Detect the human eye operation of user;Determine that the human eye operates corresponding zoom type, wherein the zoom type includes enlarged drawing and downscaled images;According to the zoom type, Digital Zoom is carried out centered on the focus vision region on the preview area of taking pictures.By the embodiment of the present invention, mobile terminal not increase hardware only using the device of present terminal can be very good to complete automatic Digital Zoom, add the function of mobile terminal, improve Consumer's Experience.

Description

The control method and mobile terminal of a kind of Digital Zoom
Technical field
The present invention relates to the control method and mobile terminal of communication technical field, more particularly to a kind of Digital Zoom.
Background technology
With advances in technology with the development of society, mobile terminal has been incorporated in our life, meanwhile, camera function One of indispensable function of mobile terminal is turned into.It is all the digital change of manual regulation that current mobile terminal, which is taken pictures or recorded a video, Jiao, i.e., by detecting that finger 2 points of distance on screen is increase or reduction, so as to determine that the image in preview interface is Change still diminishes greatly.Manual zoom limits the both hands of user, is unfavorable for user and uses.
The content of the invention
The embodiment of the present invention provides a kind of control method of Digital Zoom, is limited and used with the mobile terminal manual zoom of solution The problem of family both hands.
On the one hand there is provided a kind of control method of Digital Zoom, applied to front camera and rear camera Mobile terminal, methods described includes:
Obtain the user images of front camera collection;
Determine user in the focus vision region taken pictures on preview area of the mobile terminal according to the user images;
Detect the human eye operation of user;
Determine that the human eye operates corresponding zoom type, wherein the zoom type includes enlarged drawing and reduced to scheme Picture;
According to the zoom type, number is carried out centered on the focus vision region on the preview area of taking pictures Zoom.
On the other hand there is provided a kind of mobile terminal, the mobile terminal has front camera and rear camera, The mobile terminal includes:
Image collection module, the user images for obtaining front camera collection;
Focus vision area determination module, for determining user's taking pictures in the mobile terminal according to the user images Focus vision region on preview area;
Human eye operates detection module, for detecting that the human eye of user is operated;
Zoom determination type module, for determining that the human eye operates corresponding zoom type, wherein the zoom type Including enlarged drawing and downscaled images;
Digital Zoom module, for according to the zoom type, with the focus vision on the preview area of taking pictures Digital Zoom is carried out centered on region.
According to the embodiment of the present invention, the mobile terminal with front camera and rear camera receives front camera and obtained The user images taken;Determine user in the focus vision region taken pictures on preview area of mobile terminal according to user images;Inspection Survey the human eye operation of user;Search human eye and operate corresponding zoom type;According to zoom type take pictures on preview area with regarding Digital Zoom is carried out centered on line focus region.By the embodiment of the present invention, mobile terminal does not increase hardware only using current whole The device at end just can be very good to complete automatic Digital Zoom, adds the function of mobile terminal, improves Consumer's Experience.
Described above is only the general introduction of technical solution of the present invention, in order to better understand the technological means of the present invention, And can be practiced according to the content of specification, and in order to allow above and other objects of the present invention, feature and advantage can Become apparent, below especially exemplified by the embodiment of the present invention.
Brief description of the drawings
In order to illustrate the technical solution of the embodiments of the present invention more clearly, below by institute in the description to the embodiment of the present invention The accompanying drawing needed to use is briefly described, it should be apparent that, drawings in the following description are only some implementations of the present invention Example, for those of ordinary skill in the art, without having to pay creative labor, can also be according to these accompanying drawings Obtain other accompanying drawings.
Fig. 1 is a kind of flow chart of the control method of Digital Zoom of the embodiment of the present invention one;
Fig. 2 is a kind of flow chart of the control method of Digital Zoom of the embodiment of the present invention two;
Fig. 3 is a kind of one of block diagram of mobile terminal of the embodiment of the present invention three;
Fig. 4 is the two of the block diagram of a kind of mobile terminal of the embodiment of the present invention three;
Fig. 5 is the block diagram of the mobile terminal of the embodiment of the present invention four;
Fig. 6 is the structural representation of the mobile terminal of the embodiment of the present invention five.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete Site preparation is described, it is clear that described embodiment is a part of embodiment of the invention, rather than whole embodiments.Based on this hair Embodiment in bright, the every other implementation that those of ordinary skill in the art are obtained under the premise of creative work is not made Example, belongs to the scope of protection of the invention.
Embodiment one
A kind of control method of Digital Zoom provided in an embodiment of the present invention is discussed in detail.
Reference picture 1, shows a kind of flow chart of the control method of Digital Zoom in the embodiment of the present invention, applied to tool There is the mobile terminal of front camera and rear camera, methods described includes:
Step 101, the user images of front camera collection are obtained.
In the present embodiment, during being shot, user can be autodyned by front camera, can also be led to Cross rear camera and shoot other personages or scenery.According to the shooting preview demand of user, by front camera or rearmounted shooting The image of head collection is shown as preview image of taking pictures on the display screen of mobile terminal.In this process, mobile terminal By opening front camera, the user images of front camera collection are obtained, to carry out follow-up identification.Mobile terminal can To be provided with multiple front cameras, multiple front cameras can be set to gather user images respectively, can also set wherein One front camera gathers user images.The embodiment of the present invention does not make detailed restriction to this, can be carried out according to actual conditions Set.Preferably, first judge whether front camera has turned on before user images are obtained, if front camera has turned on And user images have been gathered, when performing subsequent step, it need to only copy the preview of the user images gathered when front camera is opened Data.If front camera is not opened, open front camera and gather user images.
Step 102, the sight taken pictures preview area on of the user in the mobile terminal is determined according to the user images Focal zone.
In the present embodiment, get after user images, the eye image in detection user images is determined according to eye image User is in the focus vision region taken pictures on preview area of mobile terminal.For example, determining that user is look up, looks squarely or bowed Depending on eyeing left, eyeing right or as centre is seen.The scape of user's concern can be primarily determined that by determining the focus vision region of user Thing.
Step 103, the human eye operation of detection user.
In the present embodiment, behind the focus vision region for determining user, the human eye operation of detection user.Specifically, detection is used The eyes at family are opened wide or open small, or whether detection user blinks.For example, mobile terminal detects user A human eye operation Opened wide for eyes, or detect user A human eye operation to blink twice.The embodiment of the present invention is not made in detail to human eye operation Limit, can be configured according to actual conditions.
Step 104, determine that the human eye operates corresponding zoom type.
In the present embodiment, wherein the zoom type includes enlarged drawing and downscaled images, detect after human eye operation, really Determine human eye and operate corresponding zoom type.Specifically, it is enlarged drawing or downscaled images to search human eye operation corresponding.Example Such as, the human eye that mobile terminal sets eyes to open wide operates corresponding zoom type to be enlarged drawing, then detects user's A eyes and open After big, then preview image of taking pictures is amplified;If the human eye that mobile terminal sets eyes to open wide operates corresponding zoom class Type is downscaled images, then detects after user's A eyes open wide, then preview image of taking pictures is reduced.In the embodiment of the present invention, Operate corresponding zoom type not make detailed restriction for human eye, can be configured according to actual conditions.
Step 105, according to the zoom type, on the preview area of taking pictures centered on the focus vision region Carry out Digital Zoom.
In the present embodiment, determine after zoom type, taking pictures on preview area centered on focus vision region to taking pictures Preview image is zoomed in or out.Specifically, the preview image that will can take pictures tentatively is divided into three rows, three row, nine regions, it is determined that The sight of user is to overlook to eye left, then focus vision region is the lower left corner of preview image of taking pictures, to take pictures preview image with Digital Zoom is carried out centered on the lower left corner;Determine that the sight of user is look up eyeing right, then focus vision region is preview of taking pictures The upper right corner of image, to taking pictures, preview image carries out Digital Zoom centered on upper right comer region.Displaying image can also be drawn It is divided into multiple regions, according to the slight change in the focus vision region of user, adjusts the specific central area of Digital Zoom.This hair Bright embodiment does not make detailed restriction to this, can be configured according to actual conditions.
In summary, in the embodiment of the present invention, the acquisition for mobile terminal with front camera and rear camera is preposition The user images of camera collection;The focus vision region of user is determined according to user images;Detect the human eye operation of user;Really Determine human eye and operate corresponding zoom type;According to zoom type, taking pictures on preview area to enter centered on focus vision region Row Digital Zoom.By the embodiment of the present invention, mobile terminal not increase hardware only using present terminal device can be fine The automatic Digital Zoom of completion, add the function of mobile terminal, improve Consumer's Experience.
Embodiment two
Reference picture 2, shows a kind of flow chart of the control method of Digital Zoom in another embodiment of the present invention.
Step 201, the user images of front camera collection are obtained.
This step 201 is identical with the step 101 in embodiment one, will not be repeated here.
Step 202, human face region is detected in the user images got.
In the present embodiment, get after the image of user, human face region is detected from the user images got.Specifically Histogram feature, color characteristic, template characteristic, architectural feature and Haar (rectangle) can be included in ground, the image of human face region Feature etc., by detecting these characteristic informations so that it is determined that arriving human face region.In the embodiment of the present invention, it is preferable that according to user The rectangular characteristic of image, obtains the position coordinates of human face region, so that it is determined that the human face region in user images.For example, identification Rectangular area in user images, the position coordinates of human face region is determined according to the position coordinates of rectangular area.
Step 203, human eye area is detected in the human face region.
In the present embodiment, primarily determine that after human face region, human eye area is detected in human face region, detection human eye area Mode also has many kinds, can use AdaBoost (final classification device) algorithm, it would however also be possible to employ other algorithms.AdaBoost is A kind of iterative algorithm, different graders (Weak Classifier) is trained for same training set, then these Weak Classifier collection Altogether, a stronger final classification device (strong classifier) is constituted.Its algorithm is realized by change data distribution in itself , whether it correct according to the classification of each sample among each training set, and the general classification of last time accuracy rate, come true The weights of fixed each sample.Sub-classification device is given by the new data set for changing weights to be trained, and will finally be trained every time Obtained grader is finally merged, and is used as last Decision Classfication device.
Step 204, the visual angle of user is judged according to the image of the human eye area, and calculates user in the preview of taking pictures Focus vision region on region.
In the present embodiment, detect after human eye area, the visual angle of user is judged according to the image of human eye area, and calculate use Family is in the focus vision region on preview area of taking pictures.Preferably, focus vision region can be determined using following steps:
Step one, using upper eyelid circumference, inside and outside angle point and iris in human eye area described in Hough (Hough) transformation calculations Centre coordinate.
The circular formula of Hough transformation detection is (x-a) 2+ (y-b) 2=r 2, wherein (a, b) is the center of circle, r is radius. 0~4 five directions can be checked according to the edge gradient angle detecting center of circle, eight reference directions provided for edge gradient, So that it is determined that upper eyelid circumference and the center of circle, then it is determined that upper eyelid circumference on can be looked for using the matching search of ' locked ' zone To inside and outside angle point.Upper eyelid is one section of circular arc determined by inside and outside angle point, is that can obtain central angle by this section of circular arc.Looking for To after upper eyelid circumference and inside and outside angle point, the marginal information of iris can be primarily determined that, according to edge gradient direction and rainbow The edge pixel gradient of film deviates from the center of circle, calculates the relative centre coordinate (x, y) of iris.
Step 2, the visual angle of user is judged according to the upper eyelid circumference and the inside and outside angle point.
The eye sight line of people can be divided into vertical view, looks squarely and look up three visual angles.The corresponding eyelid center of circle in these three visual angles Angle is different, therefore can calculate eyelid central angle by upper eyelid circumference and inside and outside angle point, so that according to central angle Size determines the visual angle of user.
Step 3, according to the visual angle and the iris centre coordinate calculate user it is described take pictures on preview area regard Line focus region.
The eye sight line of people, which can be divided into, to eye left, eyes right, three directions are seen to centre.Overlook, look squarely and look up three Individual visual angle corresponds to and eyes left, eyes right, three directions are seen to centre respectively, has nine kinds of direction of visual lines.First by iris The calculating of centre coordinate, can primarily determine that the direction of visual lines of user, be then combined with the visual angle of user, can finally determine User is in the focus vision region on preview area of taking pictures.
Step 205, the bare area of at least one of detection iris, eyeball.
In the present embodiment, it can determine that the human eye that user is made is operated according to the change of the stretching degree of human eye;Can also The human eye operation that user is made is determined using other modes.The stretching degree of human eye is detected, can be detected in iris, eyeball at least The bare area of a kind of bare area, iris or eyeball becomes big, shows that the stretching degree of human eye becomes big;Iris or eyeball it is naked Product of showing up diminishes, and shows that the stretching degree of human eye diminishes.
Step 206, determine that human eye is operated according to the change of the bare area.
In the present embodiment, the bare area of mobile terminal detection iris or eyeball determines people according to the change of bare area Eye operation.For example, when the bare area of iris or eyeball only becomes big in setting time, judging that human eye is opened wide;When iris or The bare area of eyeball only becomes hour in setting time, judges that human eye opens small;When the bare area of iris or eyeball is in setting In time in rapid conversion between becoming big diminish, blink is judged.For example, the bare area of iris only diminishes in 1s, judge Human eye is opened small.The embodiment of the present invention does not make detailed restriction to setting time, can be configured according to actual conditions.
Step 207, determine that the human eye operates corresponding zoom type.
This step 207 is identical with the step 104 in embodiment one, will not be repeated here.
Step 208, if zoom type is enlarged drawing, with the focus vision region on the preview area of taking pictures Centered on enlarged drawing;If zoom type is downscaled images, with the focus vision region on the preview area of taking pictures Centered on downscaled images.
It is pre- taking pictures according to the focus vision region of user when it is determined that zoom type is enlarged drawing in the present embodiment Look on region the enlarged drawing centered on focus vision region.When it is determined that zoom type is downscaled images, according to regarding for user Line focus region, in the downscaled images centered on focus vision region of taking pictures on preview area.For example, preview area of taking pictures is divided into 9 regions, from No. 1 region to No. 9 regions respectively correspond to look up in terms of left, center, right, usually seen to left, center, right, overlook to the left, In, the right side see that, when zoom type is enlarged drawing, the direction of visual lines of user is seen to overlook to centre, with focus vision region pair The region answered is No. 8 region amplifications in No. 8 regions, the then preview area that will take pictures.
In summary, the embodiment of the present invention, the acquisition for mobile terminal with front camera and rear camera is preposition to be taken the photograph The user images gathered as head;Human face region is first detected according to user images, then detects human eye area, determines that the sight of user is gathered Burnt region;By detecting that the bare area of iris or eyeball determines that human eye is operated;Determine that human eye operates corresponding zoom type;Root Zooming in or out for image is carried out centered on focus vision region taking pictures on preview area according to zoom type.Pass through the present invention Embodiment, mobile terminal not increase hardware only using the device of present terminal can be very good to complete automatic Digital Zoom, increase Add the function of mobile terminal, improve Consumer's Experience.
It should be noted that for foregoing embodiment of the method, in order to be briefly described, therefore it is all expressed as a series of Combination of actions, but those skilled in the art should know, the present invention is not limited by described sequence of movement, because according to According to the present invention, some steps can be carried out sequentially or simultaneously using other.Secondly, those skilled in the art should also know, Embodiment described in this description belongs to preferred embodiment, and involved action is not necessarily essential to the invention.
Embodiment three
A kind of mobile terminal provided in an embodiment of the present invention is discussed in detail, number of the embodiment one into embodiment two can be realized The details of the control method of code zoom, and reach identical effect.
Reference picture 3, shows a kind of block diagram of mobile terminal in the embodiment of the present invention, and the mobile terminal has preposition Camera and rear camera, the mobile terminal include image collection module 301, focus vision area determination module 302, Human eye operation detection module 303, zoom determination type module 304, Digital Zoom module 305:
Image collection module 301, the user images for obtaining front camera collection;
Focus vision area determination module 302, for determining user in the mobile terminal according to the user images The focus vision region taken pictures on preview area;
Human eye operates detection module 303, for detecting that the human eye of user is operated;
Zoom determination type module 304, for determining that the human eye operates corresponding zoom type, wherein the zoom class Type includes enlarged drawing and downscaled images;
Digital Zoom module 305, it is poly- with the sight on the preview area of taking pictures for according to the zoom type Digital Zoom is carried out centered on burnt region.
On the basis of Fig. 3, alternatively, the focus vision area determination module 302 includes human face region and detects submodule Block 3021, human eye area detection sub-module 3022, focus vision region calculating sub module 3023, are shown in Fig. 4:
Human face region detection sub-module 3021, for detecting human face region in the user images collected;
Human eye area detection sub-module 3022, for detecting human eye area in the human face region;
Focus vision region calculating sub module 3023, the visual angle for judging user according to the image of the human eye area, And user is calculated in the focus vision region taken pictures on preview area.
On the basis of Fig. 4, alternatively, focus vision region calculating sub module 3023 includes:
Upper eyelid circumference, inside and outside angle point and iris centre coordinate computing unit, for calculating the people using Hough transformation Upper eyelid circumference, inside and outside angle point and iris centre coordinate in Vitrea eye domain;
Visual angle judging unit, the visual angle for judging user according to the upper eyelid circumference and the inside and outside angle point;
Focus vision area calculation unit, for calculating user described according to the visual angle and the iris centre coordinate The focus vision region taken pictures on preview area.
On the basis of Fig. 3, alternatively, the human eye operation detection module 303 includes bare area detection sub-module 3031st, human eye operation determination sub-module 3032, is shown in Fig. 4:
Bare area detection sub-module 3031, the bare area for detecting at least one of iris, eyeball;
Human eye operates determination sub-module 3032, for determining that human eye is operated according to the change of the bare area.
On the basis of Fig. 3, alternatively, the Digital Zoom module 305 includes image amplification submodule 3051, image contracting Small submodule 3052, is shown in Fig. 4:
Image amplify submodule 3051, if for zoom type be enlarged drawing, on the preview area of taking pictures with Enlarged drawing centered on the focus vision region;
Image down submodule 3052, if for zoom type be downscaled images, on the preview area of taking pictures with Downscaled images centered on the focus vision region.
In summary, in the embodiment of the present invention, the acquisition for mobile terminal with front camera and rear camera is preposition The user images of camera collection;Human face region is first detected according to user images, then detects human eye area, the sight of user is determined Focal zone;By detecting that the bare area of iris or eyeball determines that human eye is operated;Corresponding zoom type is operated according to human eye, Digital Zoom is carried out on preview area centered on focus vision region taking pictures.By the embodiment of the present invention, mobile terminal is not Increase hardware only just can be very good to complete automatic Digital Zoom using the device of present terminal, add the work(of mobile terminal Can, improve Consumer's Experience.
Example IV
Fig. 5 is the block diagram of the mobile terminal of another embodiment of the present invention.Mobile terminal 500 shown in Fig. 5 includes:At least One processor 501, memory 502, at least one network interface 504 and user interface 503.Each in mobile terminal 500 Component is coupled by bus system 505.It is understood that bus system 505 is used to realize that the connection between these components to be led to Letter.Bus system 505 is in addition to including data/address bus, in addition to power bus, controlling bus and status signal bus in addition.But be For the sake of clear explanation, in Figure 5 various buses are all designated as bus system 505.
Wherein, user interface 503 can include display, keyboard or pointing device (for example, mouse, trace ball (trackball), touch-sensitive plate or flexible screen etc..
It is appreciated that the memory 502 in the embodiment of the present invention can be volatile memory or nonvolatile memory, Or may include both volatibility and nonvolatile memory.Wherein, nonvolatile memory can be read-only storage (Read- Only Memory, ROM), programmable read only memory (Programmable ROM, PROM), the read-only storage of erasable programmable Device (Erasable PROM, EPROM), Electrically Erasable Read Only Memory (Electrically EPROM, EEPROM) or Flash memory.Volatile memory can be random access memory (Random Access Memory, RAM), and it is used as outside high Speed caching.By exemplary but be not restricted explanation, the RAM of many forms can use, such as static RAM (Static RAM, SRAM), dynamic random access memory (Dynamic RAM, DRAM), Synchronous Dynamic Random Access Memory (Synchronous DRAM, SDRAM), double data speed synchronous dynamic RAM (Double Data Rate SDRAM, DDRSDRAM), enhanced Synchronous Dynamic Random Access Memory (Enhanced SDRAM, ESDRAM), synchronized links Dynamic random access memory (Synchlink DRAM, SLDRAM) and direct rambus random access memory (Direct Rambus RAM, DRRAM).The embodiment of the present invention description system and method memory 502 be intended to including but not limited to these With the memory of any other suitable type.
In some embodiments, memory 502 stores following element, can perform module or data structure, or Their subset of person, or their superset:Operating system 5021 and application program 5022.
Wherein, operating system 5021, comprising various system programs, such as ccf layer, core library layer, driving layer, are used for Realize various basic businesses and handle hardware based task.Application program 5022, includes various application programs, such as media Player (Media Player), browser (Browser) etc., for realizing various applied business.Realize the embodiment of the present invention The program of method may be embodied in application program 5022.
In embodiments of the present invention, by calling program or the instruction of the storage of memory 502, specifically, can be application The program stored in program 5022 or instruction, processor 501 are used for the user images for obtaining front camera collection;According to described User images determine user in the focus vision region taken pictures on preview area of the mobile terminal;Detect the human eye behaviour of user Make;Determine that the human eye operates corresponding zoom type, wherein the zoom type includes enlarged drawing and downscaled images;According to The zoom type, Digital Zoom is carried out on the preview area of taking pictures centered on the focus vision region.
The method that the embodiments of the present invention are disclosed can apply in processor 501, or be realized by processor 501. Processor 501 is probably a kind of IC chip, the disposal ability with signal.In implementation process, the above method it is each Step can be completed by the integrated logic circuit of the hardware in processor 501 or the instruction of software form.Above-mentioned processing Device 501 can be general processor, digital signal processor (Digital Signal Processor, DSP), special integrated electricity Road (Application Specific Integrated Circuit, ASIC), ready-made programmable gate array (Field Programmable Gate Array, FPGA) or other PLDs, discrete gate or transistor logic, Discrete hardware components.It can realize or perform disclosed each method, step and the logic diagram in the embodiment of the present invention.It is general Processor can be microprocessor or the processor can also be any conventional processor etc..With reference to institute of the embodiment of the present invention The step of disclosed method, can be embodied directly in hardware decoding processor and perform completion, or with the hardware in decoding processor And software module combination performs completion.Software module can be located at random access memory, and flash memory, read-only storage may be programmed read-only In the ripe storage medium in this area such as memory or electrically erasable programmable memory, register.The storage medium is located at Memory 502, processor 501 reads the information in memory 502, the step of completing the above method with reference to its hardware.
It is understood that the embodiment of the present invention description these embodiments can with hardware, software, firmware, middleware, Microcode or its combination are realized.Realized for hardware, processing unit can be realized in one or more application specific integrated circuits (Application Specific Integrated Circuits, ASIC), digital signal processor (Digital Signal Processing, DSP), digital signal processing appts (DSP Device, DSPD), programmable logic device (Programmable Logic Device, PLD), field programmable gate array (Field-Programmable Gate Array, FPGA), general place Manage in device, controller, microcontroller, microprocessor, other electronic units for performing herein described function or its combination.
For software realize, can by perform the module (such as process, function) of function described in the embodiment of the present invention come Realize the technology described in the embodiment of the present invention.Software code is storable in memory and by computing device.Memory can To realize within a processor or outside processor.
Alternatively, the processor 501 is additionally operable to:Human face region is detected in the user images collected;Institute State detection human eye area in human face region;The visual angle of user is judged according to the image of the human eye area, and calculates user in institute State the focus vision region taken pictures on preview area.
Alternatively, the processor 501 is additionally operable to:Using Hough transformation calculate upper eyelid circumference in the human eye area, Inside and outside angle point and iris centre coordinate;The visual angle of user is judged according to the upper eyelid circumference and the inside and outside angle point;According to institute State visual angle and the iris centre coordinate calculates user in the focus vision region taken pictures on preview area.
Alternatively, the processor 501 is additionally operable to:Detect the bare area of at least one of iris, eyeball;According to described The change of bare area determines that human eye is operated.
Alternatively, the processor 501 is additionally operable to:If zoom type is enlarged drawing, in the preview area of taking pictures On centered on the focus vision region enlarged drawing;If zoom type is downscaled images, in the preview area of taking pictures On centered on the focus vision region downscaled images.
Mobile terminal 500 can realize each process that mobile terminal is realized in previous embodiment, to avoid repeating, here Repeat no more.In the embodiment of the present invention, the acquisition for mobile terminal front camera with front camera and rear camera is adopted The user images of collection;Human face region is first detected according to user images, then detects human eye area, the focus vision area of user is determined Domain;By detecting that the bare area of iris or eyeball determines that human eye is operated;Corresponding zoom type is operated according to human eye, taken pictures Digital Zoom is carried out on preview area centered on focus vision region.By the embodiment of the present invention, mobile terminal does not increase firmly Part only just can be very good to complete automatic Digital Zoom using the device of present terminal, add the function of mobile terminal, improve Consumer's Experience.
Embodiment five
Fig. 6 is the structural representation of the mobile terminal of another embodiment of the present invention.Specifically, the mobile terminal in Fig. 6 Can be mobile phone, tablet personal computer, personal digital assistant (PersonalDigital Assistant, PDA) or vehicle-mounted computer etc..
Mobile terminal in Fig. 6 includes radio frequency (RadioFrequency, RF) circuit 610, memory 620, input block 630th, display unit 640, processor 660, voicefrequency circuit 670, WiFi (WirelessFidelity) module 680 and power supply 690.
Wherein, input block 630 can be used for the numeral or character information for receiving user's input, and produce and mobile terminal User set and function control it is relevant signal input.Specifically, in the embodiment of the present invention, the input block 630 can be with Including contact panel 631.Contact panel 631, collecting touch operation of the user on or near it, (such as user uses hand The operation of any suitable object such as finger, stylus or annex on contact panel 631), and driven according to formula set in advance Corresponding attachment means.Optionally, contact panel 631 may include both touch detecting apparatus and touch controller.Wherein, Touch detecting apparatus detects the touch orientation of user, and detects the signal that touch operation is brought, and transmits a signal to touch control Device;Touch controller receives touch information from touch detecting apparatus, and is converted into contact coordinate, then gives the processor 660, and the order sent of reception processing device 660 and can be performed.Furthermore, it is possible to use resistance-type, condenser type, infrared ray with And the polytype such as surface acoustic wave realizes contact panel 631.Except contact panel 631, input block 630 can also include other Input equipment 632, other input equipments 632 can include but is not limited to physical keyboard, function key (such as volume control button, Switch key etc.), trace ball, mouse, the one or more in action bars etc..
Wherein, display unit 640 can be used for information and the movement for showing the information inputted by user or being supplied to user The various menu interfaces of terminal.Display unit 640 may include display panel 641, optionally, can use LCD or organic light emission The forms such as diode (Organic Light-Emitting Diode, OLED) configure display panel 641.
It should be noted that contact panel 631 can cover display panel 641, touch display screen is formed, when touch display screen inspection Measure after the touch operation on or near it, processor 660 is sent to determine the type of touch event, with preprocessor 660 provide corresponding visual output according to the type of touch event in touch display screen.
Touch display screen includes Application Program Interface viewing area and conventional control viewing area.The Application Program Interface viewing area And arrangement mode of the conventional control viewing area is not limited, can be arranged above and below, left-right situs etc. can distinguish two and show Show the arrangement mode in area.The Application Program Interface viewing area is displayed for the interface of application program.Each interface can be with The interface element such as the icon comprising at least one application program and/or widget desktop controls.The Application Program Interface viewing area It can also be the empty interface not comprising any content.The conventional control viewing area is used to show the higher control of utilization rate, for example, Application icons such as settings button, interface numbering, scroll bar, phone directory icon etc..
Wherein processor 660 is the control centre of mobile terminal, utilizes each of various interfaces and connection whole mobile phone Individual part, by operation or performs and is stored in software program and/or module in first memory 621, and calls and be stored in Data in second memory 622, perform the various functions and processing data of mobile terminal, so as to be carried out to mobile terminal overall Monitoring.Optionally, processor 660 may include one or more processing units.
In embodiments of the present invention, by call store the first memory 621 in software program and/or module and/ Or the data in the second memory 622, user images of the processor 660 for obtaining front camera collection;According to described User images determine user in the focus vision region taken pictures on preview area of the mobile terminal;Detect the human eye behaviour of user Make;Determine that the human eye operates corresponding zoom type, wherein the zoom type includes enlarged drawing and downscaled images;According to The zoom type, Digital Zoom is carried out on the preview area of taking pictures centered on the focus vision region.
Alternatively, the processor 660 is additionally operable to:Human face region is detected in the user images collected;Institute State detection human eye area in human face region;The visual angle of user is judged according to the image of the human eye area, and calculates user in institute State the focus vision region taken pictures on preview area.
Alternatively, the processor 660 is additionally operable to:Using Hough transformation calculate upper eyelid circumference in the human eye area, Inside and outside angle point and iris centre coordinate;The visual angle of user is judged according to the upper eyelid circumference and the inside and outside angle point;According to institute State visual angle and the iris centre coordinate calculates user in the focus vision region taken pictures on preview area.
Alternatively, the processor 660 is additionally operable to:Detect the bare area of at least one of iris, eyeball;According to described The change of bare area determines that human eye is operated.
Alternatively, the processor 660 is additionally operable to:If zoom type is enlarged drawing, in the preview area of taking pictures On centered on the focus vision region enlarged drawing;If zoom type is downscaled images, in the preview area of taking pictures On centered on the focus vision region downscaled images.
It can be seen that, in the embodiment of the present invention, the preposition shooting of the acquisition for mobile terminal with front camera and rear camera The user images of head collection;Human face region is first detected according to user images, then detects human eye area, the focus vision of user is determined Region;By detecting that the bare area of iris or eyeball determines that human eye is operated;Corresponding zoom type is operated according to human eye, clapped According to Digital Zoom is carried out on preview area centered on focus vision region.By the embodiment of the present invention, mobile terminal does not increase Hardware only just can be very good to complete automatic Digital Zoom using the device of present terminal, adds the function of mobile terminal, changes It has been apt to Consumer's Experience.
For the embodiment of above-mentioned mobile terminal, because it is substantially similar to embodiment of the method, so the ratio of description Relatively simple, the relevent part can refer to the partial explaination of embodiments of method.
Each embodiment in this specification is described by the way of progressive, what each embodiment was stressed be with Between the difference of other embodiment, each embodiment identical similar part mutually referring to.
It would have readily occurred to a person skilled in the art that be:Any combination application of each above-mentioned embodiment is all feasible, therefore Any combination between each above-mentioned embodiment is all embodiment of the present invention, but this specification exists as space is limited, This is not just detailed one by one.
The control program of Digital Zoom is not solid with any certain computer, virtual system or miscellaneous equipment provided herein There is correlation.Various general-purpose systems can also be used together with based on teaching in this.As described above, construction has this hair Structure required by the system of bright scheme is obvious.In addition, the present invention is not also directed to any certain programmed language.Should Understand, it is possible to use various programming languages realize the content of invention described herein, and language-specific is done above Description be in order to disclose the present invention preferred forms.
In the specification that this place is provided, numerous specific details are set forth.It is to be appreciated, however, that the implementation of the present invention Example can be put into practice in the case of these no details.In some instances, known method, structure is not been shown in detail And technology, so as not to obscure the understanding of this description.
Similarly, it will be appreciated that in order to simplify the disclosure and help to understand one or more of each inventive aspect, exist Above in the description of the exemplary embodiment of the present invention, each feature of the invention is grouped together into single implementation sometimes In example, figure or descriptions thereof.However, the method for the disclosure should be construed to reflect following intention:It is i.e. required to protect The application claims of shield features more more than the feature being expressly recited in each claim.More precisely, such as right As claim reflects, inventive aspect is all features less than single embodiment disclosed above.Therefore, it then follows tool Thus claims of body embodiment are expressly incorporated in the embodiment, wherein the conduct of each claim in itself The separate embodiments of the present invention.
Those of ordinary skill in the art it is to be appreciated that with reference to disclosed in the embodiment of the present invention embodiment description it is each The unit and algorithm steps of example, can be realized with the combination of electronic hardware or computer software and electronic hardware.These Function is performed with hardware or software mode actually, depending on the application-specific and design constraint of technical scheme.Specialty Technical staff can realize described function to each specific application using distinct methods, but this realization should not Think beyond the scope of this invention.
It is apparent to those skilled in the art that, for convenience and simplicity of description, the system of foregoing description, The specific work process of device and unit, may be referred to the corresponding process in preceding method embodiment, will not be repeated here.
In embodiment provided herein, it should be understood that disclosed apparatus and method, others can be passed through Mode is realized.For example, device embodiment described above is only schematical, for example, the division of the unit, is only A kind of division of logic function, can there is other dividing mode when actually realizing, such as multiple units or component can combine or Person is desirably integrated into another system, or some features can be ignored, or does not perform.Another, shown or discussed is mutual Between coupling or direct-coupling or communication connection can be the INDIRECT COUPLING or communication link of device or unit by some interfaces Connect, can be electrical, machinery or other forms.
The unit illustrated as separating component can be or may not be it is physically separate, it is aobvious as unit The part shown can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple On NE.Some or all of unit therein can be selected to realize the mesh of this embodiment scheme according to the actual needs 's.
In addition, each functional unit in each embodiment of the invention can be integrated in a processing unit, can also That unit is individually physically present, can also two or more units it is integrated in a unit.
If the function is realized using in the form of SFU software functional unit and is used as independent production marketing or in use, can be with It is stored in a computer read/write memory medium.Understood based on such, the control technology side of Digital Zoom of the invention The part or the part of the technical scheme that case substantially contributes to prior art in other words can be with the shapes of software product Formula is embodied, and the computer software product is stored in a storage medium, including some instructions are to cause a calculating Machine equipment (can be personal computer, server, or network equipment etc.) performs each embodiment methods described of the invention All or part of step.And foregoing storage medium includes:USB flash disk, mobile hard disk, ROM, RAM, magnetic disc or CD etc. are various can With the medium of store program codes.
The foregoing is only a specific embodiment of the invention, but protection scope of the present invention is not limited thereto, any Those familiar with the art the invention discloses technical scope in, change or replacement can be readily occurred in, should all be contained Cover within protection scope of the present invention.Therefore, protection scope of the present invention should be defined by scope of the claims.

Claims (10)

1. a kind of control method of Digital Zoom, applied to the mobile terminal with front camera and rear camera, it is special Levy and be, methods described includes:
Obtain the user images of front camera collection;
Determine user in the focus vision region taken pictures on preview area of the mobile terminal according to the user images;
Detect the human eye operation of user;
Determine that the human eye operates corresponding zoom type, wherein the zoom type includes enlarged drawing and downscaled images;
According to the zoom type, digital change is carried out centered on the focus vision region on the preview area of taking pictures It is burnt.
2. according to the method described in claim 1, it is characterised in that described to determine that user moves described according to the user images The focus vision region taken pictures on preview area of dynamic terminal includes:
Human face region is detected in the user images got;
Human eye area is detected in the human face region;
The visual angle of user is judged according to the image of the human eye area, and calculates user in the sight taken pictures on preview area Focal zone.
3. method according to claim 2, it is characterised in that the image according to the human eye area judges user's Visual angle, and calculate user and include in the focus vision region taken pictures on preview area:
Upper eyelid circumference, inside and outside angle point and iris centre coordinate in the human eye area are calculated using Hough transformation;
The visual angle of user is judged according to the upper eyelid circumference and the inside and outside angle point;
User is calculated in the focus vision region taken pictures on preview area according to the visual angle and the iris centre coordinate.
4. according to the method described in claim 1, it is characterised in that the human eye operation of the detection user includes:
Detect the bare area of at least one of iris, eyeball;
Determine that human eye is operated according to the change of the bare area.
5. according to the method described in claim 1, it is characterised in that described according to the zoom type, in the preview of taking pictures Carrying out Digital Zoom centered on the focus vision region on region includes:
If zoom type be enlarged drawing, on the preview area of taking pictures centered on the focus vision region enlarged drawing Picture;
If zoom type be downscaled images, on the preview area of taking pictures centered on the focus vision region diminution figure Picture.
6. a kind of mobile terminal, the mobile terminal has front camera and rear camera, it is characterised in that described to move Dynamic terminal includes:
Image collection module, the user images for obtaining front camera collection;
Focus vision area determination module, for determining take pictures preview of the user in the mobile terminal according to the user images Focus vision region on region;
Human eye operates detection module, for detecting that the human eye of user is operated;
Zoom determination type module, for determining that the human eye operates corresponding zoom type, wherein the zoom type includes Enlarged drawing and downscaled images;
Digital Zoom module, for according to the zoom type, with the focus vision region on the preview area of taking pictures Centered on carry out Digital Zoom.
7. mobile terminal according to claim 6, it is characterised in that the focus vision area determination module includes:
Human face region detection sub-module, for detecting human face region in the user images got;
Human eye area detection sub-module, for detecting human eye area in the human face region;
Focus vision region calculating sub module, for judging the visual angle of user according to the image of the human eye area, and calculates use Family is in the focus vision region taken pictures on preview area.
8. mobile terminal according to claim 7, it is characterised in that focus vision region calculating sub module includes:
Upper eyelid circumference, inside and outside angle point and iris centre coordinate computing unit, for calculating people's Vitrea eye using Hough transformation Upper eyelid circumference, inside and outside angle point and iris centre coordinate in domain;
Visual angle judging unit, the visual angle for judging user according to the upper eyelid circumference and the inside and outside angle point;
Focus vision area calculation unit, takes pictures for calculating user according to the visual angle and the iris centre coordinate described Focus vision region on preview area.
9. mobile terminal according to claim 6, it is characterised in that the human eye operation detection module includes:
Bare area detection sub-module, the bare area for detecting at least one of iris, eyeball;
Human eye operates determination sub-module, for determining that human eye is operated according to the change of the bare area.
10. mobile terminal according to claim 6, it is characterised in that the Digital Zoom module includes:
Image amplifies submodule, if being enlarged drawing for zoom type, with the sight on the preview area of taking pictures Enlarged drawing centered on focal zone;
Image down submodule, if being enlarged drawing for zoom type, with the sight on the preview area of taking pictures Downscaled images centered on focal zone.
CN201710114969.5A 2017-02-28 2017-02-28 The control method and mobile terminal of a kind of Digital Zoom Pending CN106973222A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710114969.5A CN106973222A (en) 2017-02-28 2017-02-28 The control method and mobile terminal of a kind of Digital Zoom

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710114969.5A CN106973222A (en) 2017-02-28 2017-02-28 The control method and mobile terminal of a kind of Digital Zoom

Publications (1)

Publication Number Publication Date
CN106973222A true CN106973222A (en) 2017-07-21

Family

ID=59328970

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710114969.5A Pending CN106973222A (en) 2017-02-28 2017-02-28 The control method and mobile terminal of a kind of Digital Zoom

Country Status (1)

Country Link
CN (1) CN106973222A (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107222737A (en) * 2017-07-26 2017-09-29 维沃移动通信有限公司 The processing method and mobile terminal of a kind of depth image data
CN108171155A (en) * 2017-12-26 2018-06-15 上海展扬通信技术有限公司 A kind of image-scaling method and terminal
CN108536364A (en) * 2017-12-28 2018-09-14 努比亚技术有限公司 A kind of image pickup method, terminal and computer readable storage medium
CN109242778A (en) * 2018-09-18 2019-01-18 北京旷视科技有限公司 A kind of picture mark control method, device and its storage medium
CN109634416A (en) * 2018-12-12 2019-04-16 广东小天才科技有限公司 Intelligent control method for dictation, newspaper and reading and terminal equipment
CN111182205A (en) * 2019-12-30 2020-05-19 维沃移动通信有限公司 Photographing method, electronic device, and medium
CN112118380A (en) * 2019-06-19 2020-12-22 北京小米移动软件有限公司 Camera control method, device, equipment and storage medium
CN112367468A (en) * 2020-10-30 2021-02-12 维沃移动通信有限公司 Image processing method and device and electronic equipment
CN114339037A (en) * 2021-12-23 2022-04-12 臻迪科技股份有限公司 Automatic focusing method, device, equipment and storage medium

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103914150A (en) * 2014-04-08 2014-07-09 小米科技有限责任公司 Camera control method and device
CN104348969A (en) * 2013-09-05 2015-02-11 陈英时 Method for operating mobile phone by stare of line of sight
CN105049717A (en) * 2015-07-02 2015-11-11 上海闻泰电子科技有限公司 Pupil control automatic focusing method for digital camera and system
CN105138119A (en) * 2015-08-04 2015-12-09 湖南七迪视觉科技有限公司 Stereo vision system with automatic focusing controlled based on human biometrics
CN105739680A (en) * 2014-12-29 2016-07-06 意美森公司 System and method for generating haptic effects based on eye tracking
CN106101562A (en) * 2016-08-16 2016-11-09 重庆交通大学 A kind of camera installation taken pictures according to eye motion
CN106210526A (en) * 2016-07-29 2016-12-07 维沃移动通信有限公司 A kind of image pickup method and mobile terminal
CN106331498A (en) * 2016-09-13 2017-01-11 青岛海信移动通信技术股份有限公司 Image processing method and image processing device used for mobile terminal

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104348969A (en) * 2013-09-05 2015-02-11 陈英时 Method for operating mobile phone by stare of line of sight
CN103914150A (en) * 2014-04-08 2014-07-09 小米科技有限责任公司 Camera control method and device
CN105739680A (en) * 2014-12-29 2016-07-06 意美森公司 System and method for generating haptic effects based on eye tracking
CN105049717A (en) * 2015-07-02 2015-11-11 上海闻泰电子科技有限公司 Pupil control automatic focusing method for digital camera and system
CN105138119A (en) * 2015-08-04 2015-12-09 湖南七迪视觉科技有限公司 Stereo vision system with automatic focusing controlled based on human biometrics
CN106210526A (en) * 2016-07-29 2016-12-07 维沃移动通信有限公司 A kind of image pickup method and mobile terminal
CN106101562A (en) * 2016-08-16 2016-11-09 重庆交通大学 A kind of camera installation taken pictures according to eye motion
CN106331498A (en) * 2016-09-13 2017-01-11 青岛海信移动通信技术股份有限公司 Image processing method and image processing device used for mobile terminal

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107222737A (en) * 2017-07-26 2017-09-29 维沃移动通信有限公司 The processing method and mobile terminal of a kind of depth image data
CN108171155A (en) * 2017-12-26 2018-06-15 上海展扬通信技术有限公司 A kind of image-scaling method and terminal
CN108536364A (en) * 2017-12-28 2018-09-14 努比亚技术有限公司 A kind of image pickup method, terminal and computer readable storage medium
CN109242778A (en) * 2018-09-18 2019-01-18 北京旷视科技有限公司 A kind of picture mark control method, device and its storage medium
CN109634416A (en) * 2018-12-12 2019-04-16 广东小天才科技有限公司 Intelligent control method for dictation, newspaper and reading and terminal equipment
CN112118380A (en) * 2019-06-19 2020-12-22 北京小米移动软件有限公司 Camera control method, device, equipment and storage medium
US11336818B2 (en) 2019-06-19 2022-05-17 Beijing Xiaomi Mobile Software Co., Ltd. Method and apparatus for controlling camera, device and storage medium
CN111182205A (en) * 2019-12-30 2020-05-19 维沃移动通信有限公司 Photographing method, electronic device, and medium
CN111182205B (en) * 2019-12-30 2021-07-27 维沃移动通信有限公司 Photographing method, electronic device, and medium
CN112367468A (en) * 2020-10-30 2021-02-12 维沃移动通信有限公司 Image processing method and device and electronic equipment
CN112367468B (en) * 2020-10-30 2022-02-01 维沃移动通信有限公司 Image processing method and device and electronic equipment
CN114339037A (en) * 2021-12-23 2022-04-12 臻迪科技股份有限公司 Automatic focusing method, device, equipment and storage medium

Similar Documents

Publication Publication Date Title
CN106973222A (en) The control method and mobile terminal of a kind of Digital Zoom
CN105933607B (en) A kind of take pictures effect method of adjustment and the mobile terminal of mobile terminal
CN106060419B (en) A kind of photographic method and mobile terminal
CN105847674B (en) A kind of preview image processing method and mobile terminal based on mobile terminal
CN107613203B (en) Image processing method and mobile terminal
CN107368150A (en) A kind of photographic method and mobile terminal
CN107317993B (en) A kind of video call method and mobile terminal
CN106454135B (en) One kind is taken pictures based reminding method and mobile terminal
CN106713764A (en) Photographic method and mobile terminal
CN107172296A (en) A kind of image capturing method and mobile terminal
CN107197170A (en) A kind of exposal control method and mobile terminal
CN103188434B (en) Method and device of image collection
CN106210526A (en) A kind of image pickup method and mobile terminal
CN106527693A (en) Application control method and mobile terminal
US20130176202A1 (en) Menu selection using tangible interaction with mobile devices
CN107659769A (en) A kind of image pickup method, first terminal and second terminal
CN105915782A (en) Picture obtaining method based on face identification, and mobile terminal
CN106937054B (en) A kind of take pictures weakening method and the mobile terminal of mobile terminal
CN107492067B (en) A kind of image beautification method and mobile terminal
CN106060386A (en) Preview image generation method and mobile terminal
CN107172346A (en) A kind of weakening method and mobile terminal
CN107592458B (en) Shooting method and mobile terminal
CN107155064A (en) A kind of image pickup method and mobile terminal
CN107084736A (en) A kind of air navigation aid and mobile terminal
RU2701092C1 (en) Moving objects support system and method

Legal Events

Date Code Title Description
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20170721

RJ01 Rejection of invention patent application after publication