CN107181913A - A kind of photographic method and mobile terminal - Google Patents
A kind of photographic method and mobile terminal Download PDFInfo
- Publication number
- CN107181913A CN107181913A CN201710377881.2A CN201710377881A CN107181913A CN 107181913 A CN107181913 A CN 107181913A CN 201710377881 A CN201710377881 A CN 201710377881A CN 107181913 A CN107181913 A CN 107181913A
- Authority
- CN
- China
- Prior art keywords
- image
- facial image
- distance
- camera
- facial
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/61—Control of cameras or camera modules based on recognised objects
- H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/62—Control of parameters via user interfaces
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Studio Devices (AREA)
- Image Processing (AREA)
Abstract
The invention provides a kind of photographic method and mobile terminal, wherein, the photographic method includes：Recognize the facial image in view area；Determine each facial image to the distance of camera；According to the distance of each facial image to camera, to the corresponding character image of facial image in initial shooting image, the adjustment of displaying ratio is carried out, target shooting image is generated.The displaying ratio of character image in above-mentioned technical proposal, the image shot according to the distance of photograph subject to camera, adjustment so that the ratio of each facial image will not improve the experience of taking pictures of user because distance is different and produces larger difference.
Description
Technical field
The present invention relates to communication technical field, more particularly to a kind of photographic method and mobile terminal.
Background technology
With the development of electronic technology, increasing function is integrated with mobile terminal (such as mobile phone), as taken pictures,
Figure, pay, shopping etc., especially camera function facilitates people to the demand taken pictures.Because size of mobile terminals is smaller, side
Portable belt so that people can want to clap and just clap whenever and wherever possible, therefore the camera function on mobile terminal has obtained more and more people
Like.In the daily usage scenario taken pictures of people, many people (especially schoolgirl) influence the viewpoint of beauty and ugliness on face size
Take notice of very much, particularly when many people are in step with, be intended to stand later so that the face of oneself seems smaller when being in step with, but so
Passing station seems larger in the face of outrunner again, the use that influence user is in step with using the camera function on mobile terminal
Experience.
The content of the invention
The embodiments of the invention provide a kind of photographic method and mobile terminal, when with solution, many people are in step with the prior art,
Because the distance of photograph subject to camera is different, the problem of size for causing face to be imaged has larger gap.
First aspect is there is provided a kind of photographic method, applied to mobile terminal, it is characterised in that including：
Recognize the facial image in view area；
Determine each facial image to the distance of camera；
According to the distance of each facial image to camera, to the corresponding figure map of facial image in initial shooting image
Picture, carries out the adjustment of displaying ratio, generates target shooting image.
Second aspect there is provided a kind of mobile terminal, including：
Identification module, for recognizing the facial image in view area；
Determining module, for determining each facial image that the identification module identifies to the distance of camera；
Generation module, for the distance of each facial image for being determined according to the determining module to camera, to first
The corresponding character image of facial image in beginning shooting image, carries out the adjustment of displaying ratio, generates target shooting image.
The beneficial effects of the invention are as follows：
Character image in above-mentioned technical proposal, the image shot according to the distance of photograph subject to camera, adjustment
Displaying ratio so that the ratio of each facial image will not improve the bat of user because distance is different and produce larger difference
According to experience.
Brief description of the drawings
In order to illustrate the technical solution of the embodiments of the present invention more clearly, being used required in being described below to embodiment
Accompanying drawing be briefly described, it should be apparent that, drawings in the following description are only some embodiments of the present invention, for this
For the those of ordinary skill of field, without having to pay creative labor, other can also be obtained according to these accompanying drawings
Accompanying drawing.
Fig. 1 represents the flow chart of photographic method provided in an embodiment of the present invention；
Fig. 2 represents the sub-step flow chart of step 103 provided in an embodiment of the present invention；
Fig. 3 represents the sub-step flow chart of step 1031 provided in an embodiment of the present invention；
Fig. 4 represents the sub-step flow chart of step 1032 provided in an embodiment of the present invention；
Fig. 5 represents one of block diagram of mobile terminal provided in an embodiment of the present invention；
Fig. 6 represents the two of the block diagram of mobile terminal provided in an embodiment of the present invention；
Fig. 7 represents the three of the block diagram of mobile terminal provided in an embodiment of the present invention；
Fig. 8 represents the four of the block diagram of mobile terminal provided in an embodiment of the present invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation is described, it is clear that described embodiment is a part of embodiment of the invention, rather than whole embodiments.Based on this hair
Embodiment in bright, the every other implementation that those of ordinary skill in the art are obtained under the premise of creative work is not made
Example, belongs to the scope of protection of the invention.
One side according to the embodiment of the present invention is there is provided a kind of photographic method, applied to mobile terminal.Such as Fig. 1 institutes
Show, the photographic method includes：
Facial image in step 101, identification view area.
In this step, when taking pictures, the facial image in identification view area recognizes shown in camera preview interface
Facial image.
Specifically, the facial image in face recognition technology, identification view area can be used.
Step 102, determine each facial image to the distance of camera.
After the facial image during view area is identified by step 101, this step will determine every in view area
Distance of one face to camera.
Wherein, when carrying out recognition of face, it will usually identified people is outlined by rectangle frame in the preview interface of camera
Face image, and this step it is determined that face to camera apart from when, it may be determined that the midpoint point of rectangle frame to camera front end
Distance.Specifically, each people can be determined by dual camera distance-finding method, infrared distance measuring method or laser distance measurement method etc.
Distance of the face image to camera.Because dual camera distance-finding method, infrared distance measuring method and laser distance measurement method are existing
There is technology, therefore the embodiment of the present invention is just repeated no more to this.
Step 103, the distance according to each facial image to camera, to the facial image correspondence in initial shooting image
Character image, carry out displaying ratio adjustment, generate target shooting image.
Facial image is being determined by step 102 to after the distance of camera, this step is according to the distance, to initial bat
The corresponding character image of facial image taken the photograph in image, carries out the adjustment of displaying ratio, by the facial image remote apart from camera
The displaying ratio of corresponding character image is tuned up, by the displaying ratio of the facial image corresponding character image near apart from camera
Turn down, so as to balance the displaying ratio of the character image (including facial image) in photo, make the size of facial image in photo
Will not be different because of the distance to camera, and larger difference is produced, improve the experience of taking pictures when many people are in step with.
Wherein, when initial shooting image described here is the photographing instruction of triggering camera, in captured view area
Image.
Wherein, the photographing instruction described here includes but is not limited to：Physical button triggering command, touch gestures operation refer to
Make, speech trigger instruction, fingerprint triggering command and pressing at least one of triggering command.Specifically, above-mentioned instruction is touched
The mode of hair can be one or more physical button triggerings, the triggering of key press time interval mode, touch-screen single-point or multiple spot behaviour
Trigger, infrared sensor is triggered, acceleration transducer is triggered, gyro sensor is triggered, temperature sensor is triggered, fingerprint is known
Not Chu Fa, voice recognition triggering, gesture identification triggering or image recognition triggering etc..Certainly, above-mentioned triggering mode is only citing
Illustrate, other can arbitrarily realize that the mode of terminal camera triggering may apply in the embodiment of the present invention, herein not one by one
Explanation.
It should be noted that the description order of above-mentioned steps is merely to describe technical side provided in an embodiment of the present invention
Case, is not strict execution sequence, and concrete condition can be adjusted according to the actual requirements.
It should also be noted that, for the face figure for ensureing the facial image in shooting image with determining to camera distance
As consistent, determination of distance can be carried out when getting photographing instruction.
Above-mentioned technical proposal, according to the distance of photograph subject to camera, adjusts showing for the character image in shooting image
Show ratio, make the facial image ratio in each character image will not be because distance is different and produces larger difference, so as to lift use
The experience of taking pictures at family.
Further, as shown in Fig. 2 the distance according to each facial image to camera in step 103, to initial bat
The corresponding character image of facial image taken the photograph in image, carries out the adjustment of displaying ratio, generates target shooting image, specific bag
Include：
Step 1031, determination character image corresponding with facial image.
Before the displaying ratio adjustment of character image is carried out, also need to determine character image corresponding with each facial image,
So as to carry out the adjustment of the overall displaying ratio of character image, rather than the adjustment of facial image displaying ratio is only limitted to, to ensure figure
As display balance.
Preferably, the embodiment of the present invention can be using step 10311 as described below to the method described in step 10313, really
Determine the corresponding character image of facial image.Wherein, as shown in figure 3, determination personage corresponding with facial image in step 1031
Image, is specifically included：
Step 10311, determine pixel in predeterminable area outside each facial image to the first of camera respectively
Distance.
After the distance of the face in determining view area to camera, then determine default outside each facial image
The distance (i.e. the first distance) of pixel in region to camera.
Wherein, the pixel outside facial image described here refers to：Outside rectangle frame for identifying facial image
Pixel.The span of predeterminable area described here can be set according to the actual requirements, and the predeterminable area can be shape
The region or region in irregular shape of rule.
Wherein, in the Distance Judgment for carrying out the pixel outside facial image, it can follow apart from rectangle frame from the near to the remote
Rule carry out pixel selection judge.
Step 10312, the difference for judging the first distance and the distance of each facial image to camera.
The a certain pixel outside facial image is being determined by step 10311 to after the distance of camera, by this step
Suddenly the pixel is calculated to the distance and the difference of each facial image to the distance of camera of camera.
Wherein, difference described here is the numerical value more than or equal to 0, that is, the difference is the first distance and each people
Face image is into the distance of camera, and the larger distance value of numerical value subtracts the difference that the less distance of numerical value is worth to, or reason
Solve the absolute value for the first distance and the difference of the distance of each facial image to camera.
Step 10313, the pixel that difference is less than or equal to preset difference value is belonged to the corresponding people of corresponding facial image
In object image.
Preset when the distance of a certain pixel to camera is less than with the difference of a certain facial image to the distance of camera
During difference, the pixel is belonged in the corresponding character image of the facial image, so that other positions for belonging to this personage
As body, article of holding etc. the adjustment of displaying ratio is all carried out as an entirety.
Wherein, preset difference value can be selected according to the actual requirements.
Step 1032, the distance according to each facial image to camera, determine the corresponding figure map of each facial image
The scaling of picture.
In this step, according to the distance of each facial image to camera, determine that each character image carries out displaying ratio
The scaling of adjustment.
Preferably, the embodiment of the present invention can be using step 10321 as described below to the method described in step 10322, really
Determine the scaling of the corresponding character image of each facial image.Wherein, as shown in figure 4, in step 1032 according to each people
Face image determines the scaling of the corresponding character image of each facial image, specifically included to the distance of camera：
Step 10321, determination refer to facial image.
It is determined that before the scaling of character image, selecting one to refer to first from the face images in view area
Facial image.
Facial image is referred to for this, independently one can be selected according to demand by user and refer to facial image, for example,
When carrying out with reference to facial image selection, user's point touches one of facial image, then the facial image is defined as into reference man
Face image；A facial image can also be automatically selected by system to refer to facial image, for example, select distance placed in the middle
Facial image is to refer to facial image.It is implemented as：According to selection operation of the user to facial image, it is determined that with reference to face figure
Picture；Or according to the distance of each facial image to camera, from the face images in view area, determine reference man
Face image.
Step 10322, will with reference to facial image to camera second distance, the with other facial images to camera
The ratio of three distances, is defined as the scaling of the corresponding character image of other facial images.
In this step, by the distance with reference to other facial images outside facial image to camera, face figure is referred to this
Ratio as arriving camera distance, determines the scaling of the corresponding character image of other facial images, and its calculation formula is a=
d/d0, wherein a is scaling, and d is other facial images to the object distance of camera quilt, d0For with reference to facial image to taking the photograph
As the distance of head.
Wherein, other facial images are the face figure in the face images in view area in addition to reference to facial image
Picture；With reference to the corresponding character image of facial image scaling be 1.
Step 1033, according to scaling, character image corresponding to each facial image carries out the adjustment of displaying ratio,
Generate target shooting image.
The scaling determined according to step 1032, character image corresponding to each facial image carries out displaying ratio
Adjustment, generates target shooting image, and the displaying ratio of the corresponding character image of facial image that will be remote apart from camera is tuned up,
The displaying ratio of the facial image corresponding character image near apart from camera is turned down, thus by photograph subject move to it is same away from
(equivalent to Deep Canvas is removed) under, the displaying ratio of the character image (including facial image) in balance photo makes photo
The size of middle facial image will not be different because of the distance to camera, and produce larger difference, improve many people and are in step with
When experience of taking pictures.
In summary, photographic method provided in an embodiment of the present invention, by the distance according to photograph subject to camera, is adjusted
The displaying ratio of character image in whole shooting image so that the facial image ratio in each character image will not be because of distance not
Larger difference is produced together, so as to lift the experience of taking pictures of user.
There is provided a kind of mobile terminal for the other side of the foundation embodiment of the present invention.As shown in figure 5, the mobile terminal
500 include：
Identification module 501, for recognizing the facial image in view area.
When taking pictures, the facial image in the identification view area of identification module 501 recognizes and shows in camera preview interface
The facial image shown.
Specifically, the facial image in face recognition technology, identification view area can be used.
Determining module 502, for determining each facial image that identification module 501 identifies to the distance of camera.
After the facial image during view area is identified by identification module 501, area of finding a view is determined by determining module 502
The distance of each face in domain to camera.
Wherein, when carrying out recognition of face, it will usually identified people is outlined by rectangle frame in the preview interface of camera
Face image, and this step it is determined that face to camera apart from when, it may be determined that the midpoint point of rectangle frame to camera front end
Distance.Specifically, each people can be determined by dual camera distance-finding method, infrared distance measuring method or laser distance measurement method etc.
Distance of the face image to camera.Because dual camera distance-finding method, infrared distance measuring method and laser distance measurement method are existing
There is technology, therefore the embodiment of the present invention is just repeated no more to this.
Generation module 503, it is right for the distance of each facial image for being determined according to determining module 502 to camera
The corresponding character image of facial image in initial shooting image, carries out the adjustment of displaying ratio, generates target shooting image.
Facial image is being determined by determining module 502 to after the distance of camera, by generation module 503 according to this away from
From, to the corresponding character image of facial image in initial shooting image, the adjustment of displaying ratio is carried out, will be remote apart from camera
The displaying ratio of the corresponding character image of facial image tune up, by the facial image corresponding character image near apart from camera
Displaying ratio turn down, so as to balance the displaying ratio of the character image (including facial image) in photo, make face in photo
The size of image will not be different because of the distance to camera, and produce larger difference, improve bat when many people are in step with
According to experience.
Wherein, when initial shooting image described here is the photographing instruction of triggering camera, in captured view area
Image.
Wherein, the photographing instruction described here includes but is not limited to：Physical button triggering command, touch gestures operation refer to
Make, speech trigger instruction, fingerprint triggering command and pressing at least one of triggering command.Specifically, above-mentioned instruction is touched
The mode of hair can be one or more physical button triggerings, the triggering of key press time interval mode, touch-screen single-point or multiple spot behaviour
Trigger, infrared sensor is triggered, acceleration transducer is triggered, gyro sensor is triggered, temperature sensor is triggered, fingerprint is known
Not Chu Fa, voice recognition triggering, gesture identification triggering or image recognition triggering etc..Certainly, above-mentioned triggering mode is only citing
Illustrate, other can arbitrarily realize that the mode of terminal camera triggering may apply in the embodiment of the present invention, herein not one by one
Explanation.
It should be noted that the description order of above-mentioned steps is merely to describe technical side provided in an embodiment of the present invention
Case, is not strict execution sequence, and concrete condition can be adjusted according to the actual requirements.
It should also be noted that, for the face figure for ensureing the facial image in shooting image with determining to camera distance
As consistent, determination of distance can be carried out when getting photographing instruction.
Further, as shown in fig. 6, generation module 503 includes：
First determination sub-module 5031, for determining character image corresponding with facial image.
Before the displaying ratio adjustment of character image is carried out, also need to determine and each people by the first determination sub-module 5031
The corresponding character image of face image, so as to carry out the adjustment of the overall displaying ratio of character image, rather than is only limitted to facial image and shows
Show the adjustment of ratio, to ensure image display balance.
Second determination sub-module 5032, for the distance according to each facial image to camera, determines each face figure
As the scaling of corresponding character image.
Second determination sub-module 5032 determines that each character image is carried out according to the distance of each facial image to camera
The scaling of displaying ratio adjustment.
Submodule 5033 is generated, for according to scaling, character image corresponding to each facial image to be shown
The adjustment of ratio, generates target shooting image.
The scaling that generation submodule 5033 is determined according to the second determination sub-module 5032, to each facial image correspondence
Character image carry out displaying ratio adjustment, generate target shooting image, will be remote apart from camera facial image correspondence
The displaying ratio of character image tune up, the displaying ratio of the facial image corresponding character image near apart from camera is adjusted
It is small, thus photograph subject is moved under same distance in (equivalent to Deep Canvas is removed), balance photo character image (including
Facial image) displaying ratio, make the size of facial image in photo will not be different because of the distance to camera, and produce
Raw larger difference, improves the experience of taking pictures when many people are in step with.
Further, as shown in fig. 6, the first determination sub-module 5031 includes：
First determining unit 50311, for determining that the pixel in the predeterminable area outside each facial image is arrived respectively
First distance of camera.
Determined after the distance of the face in determining view area to camera, then by the first determining unit 50311
The distance (i.e. the first distance) of pixel outside each facial image to camera.
Wherein, the pixel outside facial image described here refers to：Outside rectangle frame for identifying facial image
Pixel.The span of predeterminable area described here can be set according to the actual requirements, and the predeterminable area can be shape
The region or region in irregular shape of rule.
Wherein, in the Distance Judgment for carrying out the pixel outside facial image, it can follow apart from rectangle frame from the near to the remote
Rule carry out pixel selection judge.
Judging unit 50312, the difference for judging the first distance and the distance of each facial image to camera.
The a certain pixel outside facial image is being determined by the first determining unit 50311 to after the distance of camera,
The pixel is calculated to the distance and the difference of each facial image to the distance of camera of camera by judging unit 50312
Value.
Wherein, difference described here is the numerical value more than or equal to 0, that is, the difference is the first distance and each people
Face image is into the distance of camera, and the larger distance value of numerical value subtracts the difference that the less distance of numerical value is worth to, or reason
Solve the absolute value for the first distance and the difference of the distance of each facial image to camera.
Processing unit 50313, the pixel for difference to be less than or equal to preset difference value belongs to corresponding facial image
In corresponding character image.
Preset when the distance of a certain pixel to camera is less than with the difference of a certain facial image to the distance of camera
During difference, processing unit 50313 belongs to the pixel in the corresponding character image of the facial image, so that handle belongs to this person
Other positions such as body of thing, hold the adjustment that article etc. all carries out displaying ratio as entirety.
Wherein, preset difference value can be selected according to the actual requirements.
Further, as shown in fig. 6, the second determination sub-module 5032 includes：
Second determining unit 50321, for determining to refer to facial image.
It is determined that before the scaling of character image, first by the second determining unit 50321 from the institute in view area
There is selection one in facial image to refer to facial image.
3rd determining unit 50322, for by the second distance with reference to facial image to camera, with other facial images
To the ratio of the 3rd distance of camera, it is defined as the scaling of the corresponding character image of other facial images.
Wherein, other facial images are the face figure in the face images in view area in addition to reference to facial image
Picture；With reference to the corresponding character image of facial image scaling be 1.
3rd determining unit 50322 is by the distance with reference to other facial images outside facial image to camera, with the ginseng
Facial image is examined to the ratio of camera distance, the scaling of the corresponding character image of other facial images is determined, it is calculated
Formula is a=d/d0, wherein a is scaling, and d is other facial images to the object distance of camera quilt, d0To refer to face
Distance of the image to camera.
Further, as shown in fig. 6, the second determining unit 50321 includes：
Determination subelement 503211, for according to selection operation of the user to facial image, it is determined that with reference to facial image；Or
Person is according to the distance of each facial image to camera, from the face images in view area, it is determined that with reference to face figure
Picture.
Facial image is referred to for this, independently one can be selected according to demand by user and refer to facial image, for example,
When carrying out with reference to facial image selection, user's point touches one of facial image, then the facial image is defined as into reference man
Face image；A facial image can also be automatically selected by system to refer to facial image, for example, select distance placed in the middle
Facial image is to refer to facial image.It is implemented as：According to selection operation of the user to facial image, it is determined that with reference to face figure
Picture；Or according to the distance of each facial image to camera, from the face images in view area, determine reference man
Face image.
In summary, mobile terminal provided in an embodiment of the present invention, the people in view area is recognized by identification module 501
Face image, then each facial image that identifies of identification module 501 is determined to the distance of camera by determining module 502, most
Afterwards, each facial image determined by generation module 503 according to determining module 502 is shot to the distance of camera to initial
The corresponding character image of facial image in image, carries out the adjustment of displaying ratio, generates target shooting image.According to taking pictures pair
As the distance to camera, the displaying ratio of the character image in shooting image is adjusted so that the face figure in each character image
As ratio will not be because distance be different and produces larger difference, so as to lift the experience of taking pictures of user.
There is provided a kind of mobile terminal 700 for the other side of the foundation embodiment of the present invention.As shown in fig. 7, the movement is whole
End 700 includes：At least one processor 701, memory 702, at least one network interface 704 and user interface 703.It is mobile whole
Each component in end 700 is coupled by bus system 705.It is understood that bus system 705 is used to realize these components
Between connection communication.Bus system 705 is in addition to including data/address bus, in addition to power bus, controlling bus and state letter
Number bus.But for the sake of clear explanation, various buses are all designated as bus system 705 in the figure 7.
Wherein, user interface 703 can include display, keyboard or pointing device (for example, mouse, trace ball
(trackball), touch-sensitive plate or touch-screen etc..
It is appreciated that the memory 702 in the embodiment of the present invention can be volatile memory or nonvolatile memory,
Or may include both volatibility and nonvolatile memory.Wherein, nonvolatile memory can be read-only storage (Read-
Only Memory, ROM), programmable read only memory (Programmable ROM, PROM), the read-only storage of erasable programmable
Device (Erasable PROM, EPROM), Electrically Erasable Read Only Memory (Electrically EPROM, EEPROM) or
Flash memory.Volatile memory can be random access memory (Random Access Memory, RAM), and it is used as outside high
Speed caching.By exemplary but be not restricted explanation, the RAM of many forms can use, such as static RAM
(Static RAM, SRAM), dynamic random access memory (Dynamic RAM, DRAM), Synchronous Dynamic Random Access Memory
(Synchronous DRAM, SDRAM), double data speed synchronous dynamic RAM (Double Data Rate
SDRAM, DDRSDRAM), enhanced Synchronous Dynamic Random Access Memory (Enhanced SDRAM, ESDRAM), synchronized links
Dynamic random access memory (Synchlink DRAM, SLDRAM) and direct rambus random access memory (Direct
Rambus RAM, DRRAM).The memory 702 of system and method described herein be intended to including but not limited to these and it is any its
It is adapted to the memory of type.
In some embodiments, memory 702 stores following element, can perform module or data structure, or
Their subset of person, or their superset：Operating system 7021 and application program 7022.
Wherein, operating system 7021, comprising various system programs, such as ccf layer, core library layer, driving layer, are used for
Realize various basic businesses and handle hardware based task.Application program 7022, includes various application programs, such as media
Player (Media Player), browser (Browser) etc., for realizing various applied business.Realize the embodiment of the present invention
The program of method may be embodied in application program 7022.
In embodiments of the present invention, by calling program or the instruction of the storage of memory 702, specifically, can be application
The program stored in program 7022 or instruction, processor 701 are used to recognize the facial image in view area；Determine each face
Distance of the image to camera；According to the distance of each facial image to camera, to the facial image in initial shooting image
Corresponding character image, carries out the adjustment of displaying ratio, generates target shooting image.
The method that the embodiments of the present invention are disclosed can apply in processor 701, or be realized by processor 701.
Processor 701 is probably a kind of IC chip, the disposal ability with signal.In implementation process, the above method it is each
Step can be completed by the integrated logic circuit of the hardware in processor 701 or the instruction of software form.Above-mentioned processing
Device 701 can be general processor, digital signal processor (Digital Signal Processor, DSP), special integrated electricity
Road (Application Specific Integrated Circuit, ASIC), ready-made programmable gate array (Field
Programmable Gate Array, FPGA) or other PLDs, discrete gate or transistor logic,
Discrete hardware components.It can realize or perform disclosed each method, step and the logic diagram in the embodiment of the present invention.It is general
Processor can be microprocessor or the processor can also be any conventional processor etc..With reference to institute of the embodiment of the present invention
The step of disclosed method, can be embodied directly in hardware decoding processor and perform completion, or with the hardware in decoding processor
And software module combination performs completion.Software module can be located at random access memory, and flash memory, read-only storage may be programmed read-only
In the ripe storage medium in this area such as memory or electrically erasable programmable memory, register.The storage medium is located at
Memory 702, processor 701 reads the information in memory 702, the step of completing the above method with reference to its hardware.
It is understood that embodiments described herein can with hardware, software, firmware, middleware, microcode or its
Combine to realize.Realized for hardware, processing unit can be realized in one or more application specific integrated circuit (Application
Specific Integrated Circuits, ASIC), digital signal processor (Digital Signal Processing,
DSP), digital signal processing appts (DSP Device, DSPD), programmable logic device (Programmable Logic
Device, PLD), field programmable gate array (Field-Programmable Gate Array, FPGA), general processor,
In controller, microcontroller, microprocessor, other electronic units for performing herein described function or its combination.
Realize, can be realized by performing the module (such as process, function) of function described herein herein for software
Described technology.Software code is storable in memory and by computing device.Memory can within a processor or
Realized outside processor.
Alternatively, processor 701 is additionally operable to：It is determined that character image corresponding with facial image；According to each facial image
To the distance of camera, the scaling of the corresponding character image of each facial image is determined；According to the scaling, to each
The corresponding character image of facial image carries out the adjustment of displaying ratio, generates target shooting image.
Alternatively, processor 701 is additionally operable to：Determine that the pixel in the predeterminable area outside each facial image is arrived respectively
First distance of camera；Judge the difference of first distance and the distance of each facial image to camera；Difference is less than
Or belonged to equal to the pixel of preset difference value in the corresponding character image of corresponding facial image.
Alternatively, processor 701 is additionally operable to：It is determined that with reference to facial image；By this with reference to the of facial image to camera
Two distances, the ratio with the 3rd distance of other facial images to camera is defined as the corresponding figure map of other facial images
The scaling of picture.Wherein, other facial images are except with reference in addition to facial image in the face images in view area
Facial image；With reference to the corresponding character image of facial image scaling be 1.
Alternatively, processor 701 is additionally operable to the selection operation to facial image according to user, it is determined that with reference to facial image；
Or according to the distance of each facial image to camera, from the face images in view area, it is determined that with reference to face
Image.
Mobile terminal 700 can realize each process that mobile terminal is realized in previous embodiment, to avoid repeating, here
Repeat no more.
Mobile terminal 700 provided in an embodiment of the present invention, by the distance according to photograph subject to camera, adjustment is shot
The displaying ratio of character image in image so that the facial image ratio in each character image will not be because distance is different and produces
Raw larger difference, so as to lift the experience of taking pictures of user.
There is provided a kind of mobile terminal 800 for the other side of the foundation embodiment of the present invention.Specifically, the mobile terminal
800 can be mobile phone, tablet personal computer, personal digital assistant (Personal Digital Assistant, PDA) or vehicle-mounted computer
Deng.
As shown in figure 8, the mobile terminal 800 include radio frequency (Radio Frequency, RF) circuit 801, memory 802,
Input block 803, display unit 804, processor 806, voicefrequency circuit 807, WiFi (Wireless Fidelity) module 808
With power supply 809.
Wherein, input block 803 can be used for the numeral or character information for receiving user's input, and produce and mobile terminal
The signal input that 800 user is set and function control is relevant.Specifically, in the embodiment of the present invention, the input block 803 can
With including contact panel 8031.Contact panel 8031, also referred to as touch-screen, collect touch operation of the user on or near it
(such as user uses the operations of any suitable object or annex on contact panel 8031 such as finger, stylus), and according to pre-
The formula first set drives corresponding attachment means.Optionally, contact panel 8031 may include touch detecting apparatus and touch to control
Two parts of device processed.Wherein, touch detecting apparatus detects the touch orientation of user, and detects the signal that touch operation is brought, will
Signal sends touch controller to；Touch controller receives touch information from touch detecting apparatus, and is converted into contact
Coordinate, then give the processor 806, and the order sent of reception processing device 806 and can be performed.Furthermore, it is possible to using electricity
The polytypes such as resistive, condenser type, infrared ray and surface acoustic wave realize contact panel 8031.It is defeated except contact panel 8031
Enter unit 803 can also include other input equipments 8032, other input equipments 8032 can include but is not limited to physical keyboard,
One or more in function key (such as volume control button, switch key etc.), trace ball, mouse, action bars etc..
Wherein, display unit 804 can be used for information and the movement for showing the information inputted by user or being supplied to user
The various menu interfaces of terminal 800.Display unit 804 may include display panel 8041, optionally, can use LCD or organic
The forms such as light emitting diode (Organic Light-Emitting Diode, OLED) configure display panel 8041.
It should be noted that contact panel 8031 can cover display panel 8041, touch display screen is formed, when the touch display screen
Detect after the touch operation on or near it, processor 806 is sent to determine the type of touch event, with preprocessor
806 provide corresponding visual output according to the type of touch event in touch display screen.
Touch display screen includes Application Program Interface viewing area and conventional control viewing area.The Application Program Interface viewing area
And arrangement mode of the conventional control viewing area is not limited, can be arranged above and below, left-right situs etc. can distinguish two and show
Show the arrangement mode in area.The Application Program Interface viewing area is displayed for the interface of application program.Each interface can be with
The interface element such as the icon comprising at least one application program and/or widget desktop controls.The Application Program Interface viewing area
It can also be the empty interface not comprising any content.The conventional control viewing area is used to show the higher control of utilization rate, for example,
Application icons such as settings button, interface numbering, scroll bar, phone directory icon etc..
Wherein, processor 806 is the control centre of mobile terminal 800, utilizes various interfaces and connection whole mobile phone
Various pieces, by operation or perform and be stored in software program and/or module in first memory 8021, and call and deposit
The data in second memory 8022 are stored up, the various functions and processing data of mobile terminal 800 are performed, so as to mobile terminal
800 carry out integral monitoring.Optionally, processor 806 may include one or more processing units.
In embodiments of the present invention, by call store the first memory 8021 in software program and/or module and/
Or the data in the second memory 8022, processor 806 is for recognizing the facial image in view area；Determine each face
Distance of the image to camera；According to the distance of each facial image to camera, to the facial image in initial shooting image
Corresponding character image, carries out the adjustment of displaying ratio, generates target shooting image.
Alternatively, processor 806 is additionally operable to：It is determined that character image corresponding with facial image；According to each facial image
To the distance of camera, the scaling of the corresponding character image of each facial image is determined；According to the scaling, to each
The corresponding character image of facial image carries out the adjustment of displaying ratio, generates target shooting image.
Alternatively, processor 806 is additionally operable to：Determine that the pixel in the predeterminable area outside each facial image is arrived respectively
First distance of camera；Judge the difference of first distance and the distance of each facial image to camera；Difference is less than
Or belonged to equal to the pixel of preset difference value in the corresponding character image of corresponding facial image.
Alternatively, processor 806 is additionally operable to：It is determined that with reference to facial image；By this with reference to the of facial image to camera
Two distances, the ratio with the 3rd distance of other facial images to camera is defined as the corresponding figure map of other facial images
The scaling of picture.Wherein, other facial images are except with reference in addition to facial image in the face images in view area
Facial image；With reference to the corresponding character image of facial image scaling be 1.
Alternatively, processor 806 is additionally operable to：According to selection operation of the user to facial image, it is determined that with reference to facial image；
Or according to the distance of each facial image to camera, from the face images in view area, it is determined that with reference to face
Image.
It can be seen that, mobile terminal 800 provided in an embodiment of the present invention, by the distance according to photograph subject to camera, is adjusted
The displaying ratio of character image in whole shooting image so that the facial image ratio in each character image will not be because of distance not
Larger difference is produced together, so as to lift the experience of taking pictures of user.
Those of ordinary skill in the art it is to be appreciated that with reference to disclosed in the embodiment of the present invention embodiment description it is each
The unit and algorithm steps of example, can be realized with the combination of electronic hardware or computer software and electronic hardware.These
Function is performed with hardware or software mode actually, depending on the application-specific and design constraint of technical scheme.Specialty
Technical staff can realize described function to each specific application using distinct methods, but this realization should not
Think beyond the scope of this invention.
It is apparent to those skilled in the art that, for convenience and simplicity of description, the system of foregoing description,
The specific work process of device and unit, may be referred to the corresponding process in preceding method embodiment, will not be repeated here.
In embodiment provided herein, it should be understood that disclosed apparatus and method, others can be passed through
Mode is realized.For example, device embodiment described above is only schematical, for example, the division of the unit, is only
A kind of division of logic function, can there is other dividing mode when actually realizing, such as multiple units or component can combine or
Person is desirably integrated into another system, or some features can be ignored, or does not perform.Another, shown or discussed is mutual
Between coupling or direct-coupling or communication connection can be the INDIRECT COUPLING or communication link of device or unit by some interfaces
Connect, can be electrical, machinery or other forms.
The unit illustrated as separating component can be or may not be it is physically separate, it is aobvious as unit
The part shown can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple
On NE.Some or all of unit therein can be selected to realize the mesh of this embodiment scheme according to the actual needs
's.
In addition, each functional unit in each embodiment of the invention can be integrated in a processing unit, can also
That unit is individually physically present, can also two or more units it is integrated in a unit.
If the function is realized using in the form of SFU software functional unit and is used as independent production marketing or in use, can be with
It is stored in a computer read/write memory medium.Understood based on such, technical scheme is substantially in other words
The part contributed to prior art or the part of the technical scheme can be embodied in the form of software product, the meter
Calculation machine software product is stored in a storage medium, including some instructions are to cause a computer equipment (can be individual
People's computer, server, or network equipment etc.) perform all or part of step of each of the invention embodiment methods described.
And foregoing storage medium includes：USB flash disk, mobile hard disk, ROM, RAM, magnetic disc or CD etc. are various can be with store program codes
Medium.
The foregoing is only a specific embodiment of the invention, but protection scope of the present invention is not limited thereto, any
Those familiar with the art the invention discloses technical scope in, change or replacement can be readily occurred in, should all be contained
Cover within protection scope of the present invention.Therefore, protection scope of the present invention should be defined by scope of the claims.
Claims (10)
1. a kind of photographic method, applied to mobile terminal, it is characterised in that including：
Recognize the facial image in view area；
Determine each facial image to the distance of camera；
According to the distance of each facial image to camera, to the corresponding character image of facial image in initial shooting image,
The adjustment of displaying ratio is carried out, target shooting image is generated.
2. photographic method according to claim 1, it is characterised in that it is described according to each facial image to camera away from
From to the corresponding character image of facial image in initial shooting image, the adjustment of progress displaying ratio generates target shooting figure
The step of picture, including：
It is determined that character image corresponding with facial image；
According to the distance of each facial image to camera, the scaling of the corresponding character image of each facial image is determined；
According to the scaling, character image corresponding to each facial image carries out the adjustment of displaying ratio, generates target
Shooting image.
3. photographic method according to claim 2, it is characterised in that determination character image corresponding with facial image
The step of, including：
Determine the pixel in the predeterminable area outside each facial image to the first distance of camera respectively；
Judge the difference of first distance and the distance of each facial image to camera；
The difference is less than or equal into the pixel of preset difference value to belong in the corresponding character image of corresponding facial image.
4. photographic method according to claim 2, it is characterised in that it is described according to each facial image to camera away from
From, the step of determining the scaling of the corresponding character image of each facial image, including：
It is determined that with reference to facial image；
By the second distance of the reference facial image to camera, the ratio with the 3rd distance of other facial images to camera
Value, is defined as the scaling of the corresponding character image of other described facial images；
Wherein, other described facial images are the people in the face images in view area in addition to the reference facial image
Face image；The scaling of the corresponding character image of the reference facial image is 1.
5. photographic method according to claim 4, it is characterised in that the step of determination refers to facial image, including：
According to selection operation of the user to facial image, it is determined that with reference to facial image；Or
According to the distance of each facial image to camera, from the face images in view area, it is determined that with reference to face
Image.
6. a kind of mobile terminal, it is characterised in that including：
Identification module, for recognizing the facial image in view area；
Determining module, for determining each facial image that the identification module identifies to the distance of camera；
Generation module, each facial image for being determined according to the determining module is clapped initial to the distance of camera
The corresponding character image of facial image taken the photograph in image, carries out the adjustment of displaying ratio, generates target shooting image.
7. mobile terminal according to claim 6, it is characterised in that the generation module includes：
First determination sub-module, for determining character image corresponding with facial image；
Second determination sub-module, for the distance according to each facial image to camera, determines that each facial image is corresponding
The scaling of character image；
Submodule is generated, for according to the scaling, character image corresponding to each facial image to carry out displaying ratio
Adjustment, generate target shooting image.
8. mobile terminal according to claim 7, it is characterised in that first determination sub-module includes：
First determining unit, for determining the pixel in the predeterminable area outside each facial image to the of camera respectively
One distance；
Judging unit, the difference for judging first distance and the distance of each facial image to camera；
Processing unit, it is corresponding for the difference to be belonged into corresponding facial image less than or equal to the pixel of preset difference value
In character image.
9. mobile terminal according to claim 7, it is characterised in that second determination sub-module includes：
Second determining unit, for determining to refer to facial image；
3rd determining unit, for by the second distance of the reference facial image to camera, with other facial images to taking the photograph
As the ratio of the 3rd distance of head, it is defined as the scaling of the corresponding character image of other described facial images；
Wherein, other described facial images are the people in the face images in view area in addition to the reference facial image
Face image；The scaling of the corresponding character image of the reference facial image is 1.
10. mobile terminal according to claim 9, it is characterised in that second determining unit includes：
Determination subelement, for according to selection operation of the user to facial image, it is determined that with reference to facial image；Or according to each
Facial image to camera distance, from the face images in view area, it is determined that with reference to facial image.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710377881.2A CN107181913B (en) | 2017-05-25 | 2017-05-25 | A kind of photographic method and mobile terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710377881.2A CN107181913B (en) | 2017-05-25 | 2017-05-25 | A kind of photographic method and mobile terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107181913A true CN107181913A (en) | 2017-09-19 |
| CN107181913B CN107181913B (en) | 2019-05-17 |
Family
ID=59831865
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710377881.2A Active CN107181913B (en) | 2017-05-25 | 2017-05-25 | A kind of photographic method and mobile terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107181913B (en) |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107784295A (en) * | 2017-11-20 | 2018-03-09 | 佘以道 | Camera camera system based on human body distance stretching |
| CN107820007A (en) * | 2017-11-09 | 2018-03-20 | 维沃移动通信有限公司 | The picture processing method and mobile terminal of a kind of camera |
| CN108038444A (en) * | 2017-12-11 | 2018-05-15 | 北京小米移动软件有限公司 | Image-recognizing method and device |
| CN108076492A (en) * | 2017-11-20 | 2018-05-25 | 佘以道 | A kind of method for promoting the image quality that camera shoots crowd |
| CN108134903A (en) * | 2017-12-25 | 2018-06-08 | 广东欧珀移动通信有限公司 | Image pickup method and Related product |
| CN108600647A (en) * | 2018-07-24 | 2018-09-28 | 努比亚技术有限公司 | Shooting preview method, mobile terminal and storage medium |
| CN108848317A (en) * | 2018-09-25 | 2018-11-20 | Oppo（重庆）智能科技有限公司 | Camera control method and Related product |
| CN110853563A (en) * | 2019-11-18 | 2020-02-28 | 深圳传音控股股份有限公司 | Mirror-based image processing method, mobile terminal and computer storage medium |
| CN111726531A (en) * | 2020-06-29 | 2020-09-29 | 北京小米移动软件有限公司 | Image shooting method, processing method, device, electronic equipment and storage medium |
| CN112839161A (en) * | 2019-11-22 | 2021-05-25 | 北京小米移动软件有限公司 | Shooting method and device |
| CN113301242A (en) * | 2020-02-21 | 2021-08-24 | 中兴通讯股份有限公司 | Photographing method, terminal, and computer-readable storage medium |
| WO2022001630A1 (en) * | 2020-06-29 | 2022-01-06 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Method and system for capturing at least one smart media |
| CN114679591A (en) * | 2021-12-30 | 2022-06-28 | 广州方硅信息技术有限公司 | Video proportion switching method, device and medium for live broadcast room and computer equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101478629A (en) * | 2008-01-04 | 2009-07-08 | 华晶科技股份有限公司 | Image processing process for regulating human face ratio |
| CN102833486A (en) * | 2012-07-05 | 2012-12-19 | 深圳泰山在线科技有限公司 | Method and device for real-time adjusting face display scale in video image |
| CN106488126A (en) * | 2016-10-26 | 2017-03-08 | 惠州Tcl移动通信有限公司 | A kind of can the photographic method of auto zoom picture size, system and its mobile terminal |
| CN106683100A (en) * | 2016-12-27 | 2017-05-17 | 宇龙计算机通信科技(深圳)有限公司 | Image segmentation and defogging method and terminal |
-
2017
- 2017-05-25 CN CN201710377881.2A patent/CN107181913B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101478629A (en) * | 2008-01-04 | 2009-07-08 | 华晶科技股份有限公司 | Image processing process for regulating human face ratio |
| CN102833486A (en) * | 2012-07-05 | 2012-12-19 | 深圳泰山在线科技有限公司 | Method and device for real-time adjusting face display scale in video image |
| CN106488126A (en) * | 2016-10-26 | 2017-03-08 | 惠州Tcl移动通信有限公司 | A kind of can the photographic method of auto zoom picture size, system and its mobile terminal |
| CN106683100A (en) * | 2016-12-27 | 2017-05-17 | 宇龙计算机通信科技(深圳)有限公司 | Image segmentation and defogging method and terminal |
Cited By (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107820007A (en) * | 2017-11-09 | 2018-03-20 | 维沃移动通信有限公司 | The picture processing method and mobile terminal of a kind of camera |
| CN107784295B (en) * | 2017-11-20 | 2018-12-21 | 惠州太初科技有限公司 | The camera camera system stretched based on human body distance |
| CN108076492A (en) * | 2017-11-20 | 2018-05-25 | 佘以道 | A kind of method for promoting the image quality that camera shoots crowd |
| CN107784295A (en) * | 2017-11-20 | 2018-03-09 | 佘以道 | Camera camera system based on human body distance stretching |
| CN108076492B (en) * | 2017-11-20 | 2018-10-30 | 张天勇 | A method of promoting the image quality that camera shoots crowd |
| CN108038444A (en) * | 2017-12-11 | 2018-05-15 | 北京小米移动软件有限公司 | Image-recognizing method and device |
| US11328168B2 (en) | 2017-12-11 | 2022-05-10 | Beijing Xiaomi Mobile Software Co., Ltd. | Image recognition method and apparatus |
| CN108134903A (en) * | 2017-12-25 | 2018-06-08 | 广东欧珀移动通信有限公司 | Image pickup method and Related product |
| CN108134903B (en) * | 2017-12-25 | 2020-01-14 | Oppo广东移动通信有限公司 | Shooting method and related product |
| US10798302B2 (en) | 2017-12-25 | 2020-10-06 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Method of capturing based on usage status of electronic device and related products |
| CN108600647A (en) * | 2018-07-24 | 2018-09-28 | 努比亚技术有限公司 | Shooting preview method, mobile terminal and storage medium |
| CN108848317A (en) * | 2018-09-25 | 2018-11-20 | Oppo（重庆）智能科技有限公司 | Camera control method and Related product |
| CN110853563A (en) * | 2019-11-18 | 2020-02-28 | 深圳传音控股股份有限公司 | Mirror-based image processing method, mobile terminal and computer storage medium |
| CN112839161A (en) * | 2019-11-22 | 2021-05-25 | 北京小米移动软件有限公司 | Shooting method and device |
| US11363190B2 (en) | 2019-11-22 | 2022-06-14 | Beijing Xiaomi Mobile Software Co., Ltd. | Image capturing method and device |
| CN113301242A (en) * | 2020-02-21 | 2021-08-24 | 中兴通讯股份有限公司 | Photographing method, terminal, and computer-readable storage medium |
| CN111726531A (en) * | 2020-06-29 | 2020-09-29 | 北京小米移动软件有限公司 | Image shooting method, processing method, device, electronic equipment and storage medium |
| WO2022001630A1 (en) * | 2020-06-29 | 2022-01-06 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Method and system for capturing at least one smart media |
| CN114679591A (en) * | 2021-12-30 | 2022-06-28 | 广州方硅信息技术有限公司 | Video proportion switching method, device and medium for live broadcast room and computer equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107181913B (en) | 2019-05-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107181913A (en) | A kind of photographic method and mobile terminal | |
| EP3525075B1 (en) | Method for lighting up screen of double-screen terminal, and terminal | |
| US20130159927A1 (en) | Electronic device with touch screen and screen unlocking method thereof | |
| CN107145348A (en) | A kind of application program split screen processing method and mobile terminal | |
| CN106020613A (en) | Operation method and mobile terminal for unread messages | |
| CN107272956A (en) | A kind of display methods, mobile terminal and computer-readable recording medium | |
| CN107172346A (en) | A kind of weakening method and mobile terminal | |
| CN107317993A (en) | A kind of video call method and mobile terminal | |
| CN108519851A (en) | A kind of interface switching method and mobile terminal | |
| CN107527040A (en) | A kind of method and apparatus of recognition of face | |
| CN107346332A (en) | A kind of image processing method and mobile terminal | |
| CN107734156A (en) | A kind of image pickup method and mobile terminal | |
| CN107333067A (en) | The control method and terminal of a kind of camera | |
| CN106940597A (en) | A kind of camera starts control method and mobile terminal | |
| CN107643912A (en) | A kind of information sharing method and mobile terminal | |
| CN107172347A (en) | A kind of photographic method and terminal | |
| CN106227488A (en) | The display packing of a kind of reminder message and mobile terminal | |
| CN106911897A (en) | A kind of determination method and mobile terminal for shooting focus | |
| CN107665434A (en) | A kind of method of payment and mobile terminal | |
| CN106791422A (en) | A kind of image processing method and mobile terminal | |
| CN107613193A (en) | A kind of camera control method and mobile terminal | |
| CN109683802A (en) | A kind of icon moving method and terminal | |
| CN107026982A (en) | The photographic method and mobile terminal of a kind of mobile terminal | |
| CN107302655A (en) | It is a kind of to shoot the adjusting method and mobile terminal found a view | |
| CN107360375A (en) | A kind of image pickup method and mobile terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |