CN101453564A - Method and apparatus for image capturing - Google Patents

Method and apparatus for image capturing Download PDF

Info

Publication number
CN101453564A
CN101453564A CNA2008100941404A CN200810094140A CN101453564A CN 101453564 A CN101453564 A CN 101453564A CN A2008100941404 A CNA2008100941404 A CN A2008100941404A CN 200810094140 A CN200810094140 A CN 200810094140A CN 101453564 A CN101453564 A CN 101453564A
Authority
CN
China
Prior art keywords
image
synthetic
paint
photo
image capture
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CNA2008100941404A
Other languages
Chinese (zh)
Other versions
CN101453564B (en
Inventor
詹政哲
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
MediaTek Inc
Original Assignee
MediaTek Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by MediaTek Inc filed Critical MediaTek Inc
Publication of CN101453564A publication Critical patent/CN101453564A/en
Application granted granted Critical
Publication of CN101453564B publication Critical patent/CN101453564B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • G06V40/166Detection; Localisation; Normalisation using acquisition arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/60Static or dynamic means for assisting the user to position a body part for biometric acquisition
    • G06V40/67Static or dynamic means for assisting the user to position a body part for biometric acquisition by interactive indications to the user
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/61Control of cameras or camera modules based on recognised objects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/61Control of cameras or camera modules based on recognised objects
    • H04N23/611Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Studio Devices (AREA)
  • Image Processing (AREA)

Abstract

The invention relates to an image capturing method for use in a camera, comprising: configuring a composition profile for a picture to be taken, wherein the composition profile defines a composition of the picture and the picture includes at least one object; enabling a sensor in the camera to sense and acquire an image; analyzing the image to determine whether the image satisfies the composition profile; generating an indication signal according to the determination result; and when the image satisfies the composition profile, storing the image to be the picture. The camera can acquire a picture of desired composition by performing the composition profile before photographing.

Description

Image capture method and device
Technical field
The present invention is particularly to the method based on the image capture (capture) of people's face detection relevant for digital camera.
Background technology
People's face is surveyed to applying to the major technique of digital camera focus control usually.Traditionally, digital camera can enable transducer (sensor) with the acquisition image, and adopts people's face probe algorithm with the people's face in the recognition image.After one or more people's face are identified, regulate camera and focus on face with the locking people, so just can obtain the photo of people's face clearly.People's face probe algorithm can be finished by different approach, for example the identification of color and profile.Owing to also have some ongoing researchs during people's face is surveyed, so be not described in detail at this.
As known to a person skilled in the art, usually camera can be by taking pictures behind the setting-up time automatically, so the user can configure between countdown, goes to the triggering of waiting for shutter (shutter) in the scope that camera lens can obtain then.Yet, in the countdown pattern, be difficult to synthetic (composition) of control photo, because phase teacher is not taken the photograph in the camera back.Owing to need the chronic of wait, may be positioned at bad position by the person of taking pictures.Therefore, need a kind of automated graphics of enhancing to capture method.
Summary of the invention
In order to solve above technical problem, the invention provides a kind of image capture method and device.
The invention provides a kind of image capture method, be used for camera, synthetic the cuing open that comprises the photo that configuration need take painted, and wherein synthetic cuing open painted the synthetic of definition photo, and photo comprises at least one object; The transducer of activation camera is in order to sensing and obtain image; Analysis image produces determination result to determine whether image satisfies synthetic cuing open and paint; Produce index signal according to determination result; And satisfying synthetic cuing open when painting when image, store images is a photo.
The present invention also provides a kind of image capture method, is used for camera, and synthetic the cuing open that comprises the photo that configuration need take painted, and wherein synthetic cuing open painted the number that definition is contained in a plurality of objects in the photo, and the position of each object; The transducer of activation camera is in order to sensing and obtain image; Analysis image produces determination result to determine whether image satisfies synthetic cuing open and paint; And satisfying synthetic cuing open when painting when image, store images is a photo.
The present invention also provides a kind of image capture device, comprises configuration interface, paints in order to synthetic the cuing open of photo input that needs are taken, and synthetic cuing open painted the synthetic of this photo of definition, and photo comprises at least one object; Capture module, in order to sensing and obtain image; Processor is coupled to configuration interface and captures module, in order to analysis image, produces determination result to determine whether image satisfies synthetic cuing open and paint; Storage arrangement is coupled to processor, image storage to memory device is changed to satisfies the synthetic photo that cuts open the needs shooting of painting; And indicating module, be coupled to processor, produce index signal, when image does not satisfy synthetic cuing open when painting, the object of the errors present in the processor analysis image, and produce index signal, satisfy synthetic cuing open with the object that instructs errors present and paint.
The present invention paints by synthesizing before taking pictures to cut open, and has the synthetic image capture of expectation to finish.
Description of drawings
Fig. 1 captures the flow chart of method for automated graphics of the present invention.
Fig. 2 is the calcspar that camera adopts the embodiment of image capture method according to the present invention.
Fig. 3 is for synthesizing the schematic diagram that cuts open the configuration interface of painting 300 according to the present invention in order to dispose.
Embodiment
Fig. 1 captures the flow chart of method for automated graphics of the present invention.In the present invention, the shooting of photo is painted (profile) based on synthetic cuing open.In step 101, provide interface to paint to dispose synthetic cuing open.Synthetic cut open the number of painting the object that can define in the photo to be comprised, and the position of each object and size.Object can be people's face or the combination of different colours and how much (geometric) figures.For example, if there are three people to be taken, then the operator can import the position and the size of three faces before able person's face is surveyed.
In step 103, camera enters automatic mode, when magazine transducer is activated with sensing and obtains image, image is analyzed.Transducer can be charge coupled device (charge-coupleddevice, C D) imageing sensor or CMOS (Complementary Metal Oxide Semiconductor) (hereinafter to be referred as CMOS) imageing sensor.Paint the object behaviour face that is disposed if be synthesized to cut open, graphical analysis will adopt people's face probe algorithm to determined object.Other color or geometric object can adopt different algorithms.
In step 105, utilize different algorithms, whether the decision image satisfies synthetic cuing open is painted.If satisfy, camera will be in step 109 store images.Otherwise, activate the position that instruction program is extremely expected with the movement of objects of misdirection position in step 107.With three people is example, is positioned at syntheticly when cuing open the precalculated position of painting definition when detecting three people's faces, then thinks to satisfy the synthetic situation of painting of cuing open, and this moment, fast goalkeeper was triggered to store photo.If image is considered to the ungratified situation in the step 105, camera then produces index signal and moves to the position of expectation to inform everyone.
Index signal can be a signal or the combination of a plurality of signals, the sound that sends from loud speaker (speaker) for example, light-emitting diode (LED) lamp indicator, or the demonstration on the camera screen.When people's face of errors present is considered to from the precalculated position too closely or is too far away (by judging size), index signal can be " X people please to move nearby/mobile at a distance ".By such feedback mechanism, shutter can be triggered after everyone meets the precalculated position at once.During practical operation, when image be considered to satisfy synthetic cut open be painted with one or three second after, camera then before shutter triggers output signal as " preparing, laugh at! ".Like this, camera can be by being made up to obtain the photo of expectation by camerist.
In general, different people is bold little also different, and that its position also can not be strict is static.In order to increase flexibility, camera can allow some errors when synthesizing coupling.Cut open when painting when synthesizing, the fault-tolerant scope of the size of each object and position also can be used as configuration parameter and defines.Step 107 is selectable, because satisfy synthetic cuing open when painting when definite image, the user wishes to take pictures immediately.
Fig. 2 is the calcspar that camera adopts the embodiment of image capture method according to the present invention.Camera 200 comprises configuration interface 202 and paints in order to set up synthetic cuing open.Configuration interface 202 can be touch-screen (touchpanel), writes (sketching) and sets up synthetic by directly drawing on touch-screen.Capture module 206 and can comprise camera lens, shutter and the ccd image sensor that can when enabling, obtain image.Storage device 208 is in order to store photo.The image capture method can be for being stored in the program in the firmware 212 and being carried out by processor 210.
Camera 200 further comprises indicating module 204, can be one or the combination of a plurality of indicating devices, for example, and display, loud speaker or a plurality of LED lamp.As previously mentioned, index signal can be the sound that is produced by indicating module 204, light, screen display or its combination.Except that sound, the arrow that the symbol indication is for example provided by the LED lamp moves to desired locations to indicate specific people.Some cameras have liquid crystal (the being called for short LCD) screen that can reverse, and it can be inverted to by the person of taking pictures.Like this, the screen indication can directly provide to by the person of taking pictures, and then can oneself be adjusted to suitable position by the person of taking pictures.
Fig. 3 is for synthesizing the schematic diagram that cuts open the configuration interface of painting 300 according to the present invention in order to dispose.In the configuration interface 300, six objects 301 to 306 need be configured, position and distance that each definition is different.Distance is by size decision, that is to say that bigger circle represents nearer object, and a little bit smaller circle is represented object more a little further.Object can be people's face or other concrete geometric figure, utilizes camera recognizer (for example people's face probe algorithm) to discern.Configuration interface 300 can be arranged on the camera touch-screen, or imports by legacy interface (as button or menu).Object 301,302 and 306 dash area are represented fault-tolerant scope, and the size that is positioned at this scope of people's face can allow.When set synthetic cut open paint after, whether camera enters automatic mode satisfies synthetic cuing open with continuous monitoring and paints.If detect the object of errors present, object 401 and 403 for example, camera produce index signal to instruct movement of objects to desired locations.Paint lasting predetermined time interval when all objects satisfy synthetic cuing open, for example one second, camera " was laughed at " in the preceding prompting of taking pictures automatically.The time interval also can be configuration parameter, and is not limited to one second.
The embodiment of the invention provides effective interaction mechanism, utilizes image analysis technology, surveys as people's face, has the synthetic automated graphics of expectation and captures to finish.

Claims (22)

1. an image capture method is used for camera, comprises:
Configuration needs synthetic the cuing open of the photo of shooting to paint, and wherein should synthetic cut open and paint the synthetic of this photo of definition, and this photo comprises at least one object;
Enable the transducer of this camera, in order to sensing and obtain image;
Analyze this image, produce determination result and paint to determine whether this image satisfies synthetic to cut open; Produce index signal according to this determination result; And
Should synthetic cut open when painting when this image satisfies, storing this image is this photo.
2. image capture method according to claim 1 is characterized in that this index signal comprises sound, light, screen display or sound, light, any combination of screen display.
3. image capture method according to claim 1 is characterized in that, the generation of this index signal comprises: should synthetic cut open when painting when this image does not satisfy, and instruct this object to satisfy should synthetic to cut open and paint.
4. image capture method according to claim 1 is characterized in that:
This object comprises people's face; And
Analyze this image and comprise employing people face probe algorithm to determine this image whether paint by satisfied should synthetic cuing open.
5. image capture method according to claim 1 is characterized in that, dispose this synthetic cut open to paint comprise the number that defines this object, the position of each this object, the perhaps size of each this object.
6. image capture method according to claim 5 is characterized in that, dispose this synthetic cut open to paint comprise the size that defines each this object and the fault-tolerant scope of position.
7. image capture method according to claim 1 is characterized in that, configuration should synthetic be cutd open and paint is to carry out by drawing to write on touch-screen.
8. image capture method according to claim 1 is characterized in that, stores this photo bag: contain:
Continue the scheduled time if this determination result is indicated this image to satisfy and should synthetic be cutd open to paint, storing this image is this photo.
9. an image capture method is used for camera, comprises:
Configuration needs synthetic the cuing open of the photo of shooting to paint, and wherein should synthetic cut open and paint the number that definition is contained in a plurality of objects in this photo, and the position of each this object;
Enable the transducer of this camera, in order to sensing and obtain image;
Analyze this image, produce determination result and paint to determine whether this image satisfies synthetic to cut open; And
Should synthetic cut open when painting when this image satisfies, storing this image is this photo.
10. image capture method according to claim 9 is characterized in that, this synthetic cuing open is painted the size that more defines each this object.
11. image capture method according to claim 9 is characterized in that, this is synthetic to cut open the size that more defines each this object and the fault-tolerant scope of position of painting.
12. image capture method according to claim 9 is characterized in that, this is synthetic to cut open that to paint be to carry out by drawing to write on touch-screen.
13. image capture method according to claim 9 is characterized in that:
These a plurality of objects comprise people's face; And
Analyze this image and comprise employing people face probe algorithm to determine this image whether paint by satisfied should synthetic cuing open.
14. image capture method according to claim 9 wherein stores this photo and comprises:
Continue the scheduled time if this determination result is indicated this image to satisfy and should synthetic be cutd open to paint, storing this image is this photo.
15. an image capture device comprises:
Configuration interface, in order to synthetic the cuing open of photo input that needs to take painted, this synthetic cuing open is painted the synthetic of this photo of definition, and this photo comprises at least one object;
Capture module, in order to sensing and obtain image;
Processor is coupled to this configuration interface and this captures module, in order to analyze this image, produces determination result and paints to determine whether this image satisfies synthetic to cut open;
Storage device is coupled to this processor, is to satisfy this synthetic photo that cuts open this needs shooting of painting with this image storage to this storage device; And
Indicating module is coupled to this processor, produces index signal, should synthetic cut open when painting when this image does not satisfy, and this processor is analyzed the object of the errors present in this image, and produces this index signal, satisfies synthetic to cut open with the object that instructs this errors present and paints.
16. image capture device according to claim 15 is characterized in that:
This indicating module comprises display, loud speaker or a plurality of lamp; And
This index signal comprises sound, light, screen display or sound, light, any combination of screen display.
17. image capture device according to claim 15 is characterized in that, more comprises a firmware and is coupled to this processor so that people's face probe algorithm to be provided, wherein:
This object comprises people's face; And
This people's face probe algorithm of this processor adopting is to determine this image whether paint by satisfied should synthetic cuing open.
18. image capture device according to claim 15 is characterized in that, this is synthetic to cut open to paint and comprises the number that defines this object, the position of each this object, the perhaps size of each this object.
19. image capture device according to claim 18 is characterized in that, this is synthetic to cut open to paint and more comprises the size that defines each this object and the fault-tolerant scope of position.
20. image capture device according to claim 15 is characterized in that, this configuration interface is a touch-screen.
21. image capture device according to claim 15 is characterized in that, this processor calculates this image to be kept satisfying this and syntheticly cuts open the duration of painting, and if should the duration longer than the scheduled time, it is this photo that this processor stores this image.
22. image capture device according to claim 15 is characterized in that, produces this index signal and paints to instruct satisfied should synthetic the cuing open of this object.
CN2008100941404A 2007-12-04 2008-05-05 Method and apparatus for image capturing Active CN101453564B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US11/949,792 2007-12-04
US11/949,792 US8111874B2 (en) 2007-12-04 2007-12-04 Method and apparatus for image capturing

Publications (2)

Publication Number Publication Date
CN101453564A true CN101453564A (en) 2009-06-10
CN101453564B CN101453564B (en) 2010-09-08

Family

ID=40675781

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2008100941404A Active CN101453564B (en) 2007-12-04 2008-05-05 Method and apparatus for image capturing

Country Status (3)

Country Link
US (1) US8111874B2 (en)
CN (1) CN101453564B (en)
TW (1) TWI358673B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103618851A (en) * 2013-11-08 2014-03-05 杨睿琦 Self-photographing method and terminal
CN106210184A (en) * 2014-09-15 2016-12-07 Lg电子株式会社 Mobile terminal and control method thereof

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4898475B2 (en) * 2007-02-05 2012-03-14 富士フイルム株式会社 Imaging control apparatus, imaging apparatus, and imaging control method
JP4927808B2 (en) * 2008-11-26 2012-05-09 京セラ株式会社 Equipment with camera
DE102009007935B4 (en) * 2009-02-06 2011-06-30 Lewandowski, Angela, 30159 Device and method for the artificial extension of nails
JP5359645B2 (en) * 2009-07-23 2013-12-04 ソニー株式会社 Composition determination apparatus, imaging system, composition determination method, and program
JP2011188210A (en) * 2010-03-08 2011-09-22 Olympus Imaging Corp Photographing apparatus and photographing system
WO2013020577A2 (en) * 2011-08-07 2013-02-14 Sensometrix Sa Body part guidance control method for non contact biometric authentication device, and biometric authentication device
US20150021228A1 (en) 2012-02-02 2015-01-22 Visunex Medical Systems Co., Ltd. Eye imaging apparatus and systems
US9655517B2 (en) 2012-02-02 2017-05-23 Visunex Medical Systems Co. Ltd. Portable eye imaging apparatus
US9351639B2 (en) 2012-03-17 2016-05-31 Visunex Medical Systems Co. Ltd. Eye imaging apparatus with a wide field of view and related methods
US10425586B2 (en) * 2013-03-14 2019-09-24 Nokia Technologies Oy Methods, apparatuses, and computer program products for improved picture taking
AU2014202744B2 (en) 2014-05-20 2016-10-20 Canon Kabushiki Kaisha System and method for re-configuring a lighting arrangement
US9986908B2 (en) 2014-06-23 2018-06-05 Visunex Medical Systems Co. Ltd. Mechanical features of an eye imaging apparatus
CN104202515B (en) * 2014-08-05 2019-04-19 惠州Tcl移动通信有限公司 Filming apparatus and its image pickup method
WO2016123138A1 (en) 2015-01-26 2016-08-04 Visunex Medical Systems Co. Ltd. A disposable cap for an eye imaging apparatus and related methods
CN117425057A (en) * 2022-07-07 2024-01-19 抖音视界(北京)有限公司 Method, apparatus, device and storage medium for image shooting

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6678393B1 (en) * 1997-12-23 2004-01-13 Intel Corporation Image selection based on image content
US6608910B1 (en) * 1999-09-02 2003-08-19 Hrl Laboratories, Llc Computer vision method and apparatus for imaging sensors for recognizing and tracking occupants in fixed environments under variable illumination
US6611622B1 (en) * 1999-11-23 2003-08-26 Microsoft Corporation Object recognition system and process for identifying people and objects in an image of a scene
JP3575679B2 (en) * 2000-03-31 2004-10-13 日本電気株式会社 Face matching method, recording medium storing the matching method, and face matching device
US7386170B2 (en) * 2000-06-30 2008-06-10 Texas Instruments Incorporated Image object ranking
JP3955170B2 (en) * 2000-07-03 2007-08-08 富士フイルム株式会社 Image search system
EP1665124A1 (en) * 2003-09-10 2006-06-07 Koninklijke Philips Electronics N.V. Apparatus and method for feature recognition
KR100608810B1 (en) * 2004-07-09 2006-08-08 엘지전자 주식회사 A method and a apparatus of improvement image quality at multimedia communication for mobile phone
CN100377164C (en) * 2004-10-21 2008-03-26 佳能株式会社 Method, device and storage medium for detecting face complexion area in image
JP2007010898A (en) 2005-06-29 2007-01-18 Casio Comput Co Ltd Imaging apparatus and program therefor
CN1933553A (en) 2005-09-16 2007-03-21 英华达(上海)电子有限公司 Method for position regulation prompting based on human face identification combined with TTS in digital camera
US8125526B2 (en) * 2006-02-03 2012-02-28 Olympus Imaging Corp. Camera for selecting an image from a plurality of images based on a face portion and contour of a subject in the image
TWM306340U (en) 2006-06-07 2007-02-11 Weistech Technology Co Ltd Digital photography apparatus with capability of information remark addition

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103618851A (en) * 2013-11-08 2014-03-05 杨睿琦 Self-photographing method and terminal
CN106210184A (en) * 2014-09-15 2016-12-07 Lg电子株式会社 Mobile terminal and control method thereof
CN106210184B (en) * 2014-09-15 2019-03-22 Lg电子株式会社 Mobile terminal and its control method

Also Published As

Publication number Publication date
TW200926010A (en) 2009-06-16
US8111874B2 (en) 2012-02-07
US20090141981A1 (en) 2009-06-04
CN101453564B (en) 2010-09-08
TWI358673B (en) 2012-02-21

Similar Documents

Publication Publication Date Title
CN101453564B (en) Method and apparatus for image capturing
TWI442328B (en) Shadow and reflection identification in image capturing devices
CN106254682B (en) A kind of photographic method and mobile terminal
JP5351128B2 (en) Camera shake display device, camera shake display method, image display device, image display method, and recording medium
US9826154B2 (en) Imaging device, control method of imaging device, and computer program
KR20110004085A (en) Photographing apparatus and photographing method
CN102498712B (en) Control device, image-capturing system, and control method
JP2004312733A (en) Device incorporating retina tracking and retina tracking system
US20120268615A1 (en) Photographing method and apparatus therefor using special effects
JP2013219525A (en) Imaging device, control method therefor, and program
CN106464784A (en) Image capturing device and image capturing method
US8872955B2 (en) Digital photographing apparatus and method of controlling the same
US7265790B2 (en) System and method for setting an image capture device to an operational mode
CN105592263A (en) Image capturing method, device and terminal
KR20160088081A (en) Haptic interface of image photographing device and method for controlling image photogrqphing device thereof
US11012629B2 (en) Image capturing apparatus, control method for image capturing apparatus, and control program for image capturing apparatus
JP2006217356A (en) Digital camera system
JP2007124365A (en) Imaging apparatus
CN105827985A (en) Imaging device and imaging method
JP2001183383A (en) Imaging apparatus and method for calculating velocity of object to be imaged
CN102316256A (en) Portable set and reproduction display packing
TWI542213B (en) Document camera with projecting ability and operating method for the same
JP2019149603A (en) Method for controlling imaging apparatus
JP5938269B2 (en) Imaging apparatus and control method thereof
JP5907856B2 (en) Imaging device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant