CN106961558A - One kind is taken pictures treating method and apparatus - Google Patents

One kind is taken pictures treating method and apparatus Download PDF

Info

Publication number
CN106961558A
CN106961558A CN201610015094.9A CN201610015094A CN106961558A CN 106961558 A CN106961558 A CN 106961558A CN 201610015094 A CN201610015094 A CN 201610015094A CN 106961558 A CN106961558 A CN 106961558A
Authority
CN
China
Prior art keywords
processing
mirror image
described image
image data
image processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610015094.9A
Other languages
Chinese (zh)
Other versions
CN106961558B (en
Inventor
张本好
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZTE Corp
Original Assignee
ZTE Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZTE Corp filed Critical ZTE Corp
Priority to CN201610015094.9A priority Critical patent/CN106961558B/en
Priority to PCT/CN2016/077022 priority patent/WO2016197657A1/en
Publication of CN106961558A publication Critical patent/CN106961558A/en
Application granted granted Critical
Publication of CN106961558B publication Critical patent/CN106961558B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/725Cordless telephones
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2628Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformation in the plane of the image
    • G06T3/60Rotation of a whole image or part thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/61Control of cameras or camera modules based on recognised objects
    • H04N23/611Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80Camera processing pipelines; Components thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/90Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Studio Devices (AREA)
  • Image Processing (AREA)
  • Image Analysis (AREA)

Abstract

Taken pictures treating method and apparatus the invention discloses one kind.Processing method of taking pictures in the present invention includes:View data is obtained by the front camera of terminal device;The detection of characteristic information is carried out to view data, testing result is obtained;Mirror image processing is carried out to view data according to testing result or ignores mirror image processing.The present invention solves prior art and used in the processing mode that front camera is taken pictures, mirror image processing function is turned on and off by the setting of user, the processing mode currently taken pictures due to needing user's subjective judgement to be adapted to, and carried out setting operation manually by user, it is complicated so as to lead the operating procedure taken pictures, and the problem of easily there is picture distortion.

Description

One kind is taken pictures treating method and apparatus
Technical field
The present invention relates to technical field of image processing, espespecially one kind is taken pictures treating method and apparatus.
Background technology
With the development of computer technology, the application of intelligent terminal has obtained extensive raising, for example Music can be listened by intelligent terminal, game is played, chats on line and take pictures.Especially, intelligent terminal Front camera shooting style, i.e., the application of Self-timer is by the generally favor of user, preposition shooting Head and image processing software are to determine the good and bad key factor of auto heterodyne ability.
The pixel ability of front camera is the hardware factor for determining shooting image definition, can be by hard The upgrading of part improves the definition of shooting image.User is autodyned using the front camera of intelligent terminal During, the image shot in visual field, for example, user can be seen by the display screen of intelligent terminal I and friends and family, compare to meet user in auto heterodyne and tend to the requirement of What You See Is What You Get, lead to Can often mirror image processing be carried out to image of taking pictures, so, the photo generated after taking pictures and user are in display screen On the image seen be consistent.In a kind of application scenarios taken pictures, if the shooting of front camera is regarded Have in word, the photo generated using mirror image processing, word is heterochiral state, can be made The sense of reality into photo is poor.Regarding to the issue above, the processing mode generally used at present is:In intelligence Set One function to switch in the shooting application of terminal, by the setting of user open mirror image processing function or Mirror image processing function is closed, which needs user's subjective judgement to be adapted to the processing mode currently taken pictures, and Carried out setting operation manually by user.
In summary, prior art is used in the processing mode that front camera is taken pictures, and passes through user Setting be turned on and off mirror image processing function, because which needs user's subjective judgement to be adapted to current clap According to processing mode, and by user set manually and operate so that it is complicated to lead the operating procedure taken pictures, And the problem of easily there is picture distortion.
The content of the invention
In order to solve the above-mentioned technical problem, taken pictures treating method and apparatus the invention provides one kind, to solve In the processing mode that certainly prior art is taken pictures using front camera, by the setting unlatching of user or Mirror image processing function is closed, the processing mode currently taken pictures due to needing user's subjective judgement to be adapted to, and by User carries out setting operation manually, so as to lead the operating procedure complexity taken pictures, and photo mistake easily occurs Genuine problem.
The processing method in a first aspect, present invention offer one kind is taken pictures, including:
View data is obtained by the front camera of terminal device;
Described image data are carried out with the detection of characteristic information, testing result is obtained;
Mirror image processing is carried out to described image data according to the testing result or ignores mirror image processing.
It is described that feature is carried out to described image data in the first possible implementation of first aspect The detection of information, obtains testing result, refers to:
The characteristic information in described image data is detected, acquisition includes the testing result of the characteristic information, The characteristic information includes one or more in face information and text information.
According in the first possible implementation of first aspect, in second of possible implementation, The characteristic information includes face information;It is described that mirror is carried out to described image data according to the testing result As handling or ignoring mirror image processing, refer to:
Mirror image processing is carried out to described image data according to detected face information.
According in the first possible implementation of first aspect, in the third possible implementation, The characteristic information includes text information;It is described that mirror is carried out to described image data according to the testing result As handling or ignoring mirror image processing, refer to:
Mirror image processing is ignored to described image data according to detected text information.
According in the first possible implementation of first aspect, in the 4th kind of possible implementation, Reference zone is provided with described image data, the characteristic information includes face information and text information, Wherein, the face information includes position and the size of human face region, and the text information includes literal field The position in domain and size;It is described that mirror image processing is carried out to described image data according to the testing result or neglected Mirror image processing is omited, including:
According to position and the size of the position of the human face region and size, and the character area, really The position relationship and proportionate relationship of the fixed human face region and the character area and the reference zone;
When the ratio for taking the reference zone in the human face region is more than first threshold, to described image Data carry out mirror image processing;
When the ratio for taking the reference zone in the character area is more than Second Threshold, to described image Data ignore mirror image processing.
In the 5th kind of possible implementation of first aspect, the characteristic information is the terminal device In preset detection desired value, the characteristic information is face information or text information;It is described to the figure As data carry out the detection of characteristic information, testing result is obtained, is referred to:
Described image data are detected, and are judged in described image data with the presence or absence of meeting the characteristic information Data content.
According in the 5th of first aspect the kind of possible implementation, in the 6th kind of possible implementation, The characteristic information is face information;It is described that mirror image is carried out to described image data according to the testing result Handle or ignore mirror image processing, including:
There is the data content for meeting the face information in the testing result is described image data When, mirror image processing is carried out to described image data;
The data content for meeting the face information is not present in the testing result is described image data When, mirror image processing is ignored to described image data.
According in the 5th of first aspect the kind of possible implementation, in the 7th kind of possible implementation, The characteristic information is text information;It is described that mirror image is carried out to described image data according to the testing result Handle or ignore mirror image processing, including:
There is the data content for meeting the text information in the testing result is described image data When, mirror image processing is ignored to described image data;
The data content for meeting the face information is not present in the testing result is described image data When, mirror image processing is carried out to described image data.
Second aspect, the present invention provides one kind and taken pictures processing unit, and the processing unit of taking pictures is arranged at end In end equipment, the processing unit of taking pictures includes:
Image collection module, for obtaining view data by the front camera of the terminal device;
Detection module, the view data for being obtained to described image acquisition module carries out the inspection of characteristic information Survey, obtain testing result;
Processing module, the testing result for being obtained according to the detection module is carried out to described image data Mirror image processing ignores mirror image processing.
In the first possible implementation of second aspect, the detection module is used for described image The view data that acquisition module is obtained carries out the detection of characteristic information, obtains testing result, refers to:Detection The characteristic information gone out in the view data of described image acquisition module acquisition, acquisition includes the characteristic information Testing result, the characteristic information include face information and text information in one or more.
According in the first possible implementation of second aspect, in second of possible implementation, The characteristic information includes face information;The processing module is used for the inspection obtained according to the detection module Survey result to carry out described image data mirror image processing or ignore mirror image processing, refer to:According to the detection The face information that module is detected carries out mirror image processing to described image data.
According in the first possible implementation of second aspect, in the third possible implementation, The characteristic information includes text information;The processing module is used for the inspection obtained according to the detection module Survey result to carry out described image data mirror image processing or ignore mirror image processing, refer to:According to the detection The text information that module is detected ignores mirror image processing to described image data.
According in the first possible implementation of second aspect, in the 4th kind of possible implementation, Reference zone is provided with described image data, the characteristic information includes face information and text information, Wherein, the face information includes position and the size of human face region, and the text information includes literal field The position in domain and size;The processing module includes:
Determining unit, for the position of human face region obtained according to the detection module and size, and The position of character area and size, determine the human face region and the character area and the reference zone Position relationship and proportionate relationship;
Processing unit, for determining that human face region takes the ratio of the reference zone in the determining unit When value is more than first threshold, mirror image processing is carried out to described image data;
The processing unit, is additionally operable to determine that character area takes the reference area in the determining unit When the ratio in domain is more than Second Threshold, mirror image processing is ignored to described image data.
In the 5th kind of possible implementation of second aspect, the characteristic information is the terminal device In preset detection desired value, the characteristic information is face information or text information;The detection module View data for being obtained to described image acquisition module carries out the detection of characteristic information, obtains detection knot Really, refer to:The view data that described image acquisition module is obtained is detected, and is judged in described image data With the presence or absence of the data content for meeting the characteristic information.
According in the 5th of second aspect the kind of possible implementation, in the 6th kind of possible implementation, The characteristic information is face information;The processing module is used for the detection obtained according to the detection module As a result mirror image processing is carried out to described image data or ignores mirror image processing, including:
The processing module, used in being described image data in the testing result that the detection module is obtained During in the presence of the data content for meeting the face information, mirror image processing is carried out to described image data;
The processing module, the testing result for being additionally operable to obtain in the detection module is described image data In be not present meet the face information data content when, mirror image processing is ignored to described image data.
According in the 5th of second aspect the kind of possible implementation, in the 7th kind of possible implementation, The characteristic information is text information;The processing module is used for the detection obtained according to the detection module As a result mirror image processing is carried out to described image data or ignores mirror image processing, including:
The processing module, used in being described image data in the testing result that the detection module is obtained During in the presence of the data content for meeting the text information, mirror image processing is ignored to described image data;
The processing module, the testing result for being additionally operable to obtain in the detection module is described image data In be not present meet the face information data content when, to described image data carry out mirror image processing.
Treating method and apparatus that what the present invention was provided take pictures, the front camera for passing through terminal device obtains figure As data, and to the detection of view data progress characteristic information, testing result is obtained, then pass through the inspection The view data that survey result is obtained to front camera carries out mirror image processing or ignores mirror image processing, the present invention Using the testing result of view data as the trigger condition for being turned on and off mirror image processing function, realize pair The self-adaptive switch of image feature in the image procossing that front camera is shot, while avoiding user's execution Complicated setting operation, solves prior art and uses in the processing mode that front camera is taken pictures, Mirror image processing function is opened by the setting of user or mirror image processing function is closed, due to needing user subjective Judge the processing mode for being adapted to currently take pictures, and setting is operated manually by user's progress, so as to lead what is taken pictures Operating procedure is complicated, and the problem of easily there is picture distortion.
Brief description of the drawings
Accompanying drawing is used for providing further understanding technical solution of the present invention, and constitutes one of specification Point, it is used to explain technical scheme together with embodiments herein, does not constitute to the present invention The limitation of technical scheme.
Fig. 1 is a kind of flow chart for processing method of taking pictures provided in an embodiment of the present invention;
Fig. 2 is the flow chart of another processing method of taking pictures provided in an embodiment of the present invention;
A kind of view data that Fig. 3 obtains for the processing method of taking pictures that is provided by embodiment illustrated in fig. 2 Schematic diagram;
Fig. 4 is the flow chart of another processing method of taking pictures provided in an embodiment of the present invention;
Fig. 5 is the flow chart of another processing method of taking pictures provided in an embodiment of the present invention;
Fig. 6 is a kind of structural representation for processing unit of taking pictures provided in an embodiment of the present invention;
Fig. 7 is the structural representation of another processing unit of taking pictures provided in an embodiment of the present invention.
Embodiment
For the object, technical solutions and advantages of the present invention are more clearly understood, below in conjunction with accompanying drawing Embodiments of the invention are described in detail.It should be noted that in the case where not conflicting, this Shen Please in embodiment and the feature in embodiment can mutually be combined.
The step of the flow of accompanying drawing is illustrated can such as one group computer executable instructions computer Performed in system.And, although logical order is shown in flow charts, but in some cases, Can be with the step shown or described by being performed different from order herein.
Technical scheme is described in detail below by specific embodiment, the present invention is following Terminal device in each embodiment is the intelligent terminal with camera, for example smart mobile phone, self-timer, (Personal Digital Assistant are referred to as panel computer or personal digital assistant:PDA) etc., this Invent to be generally also provided with the terminal device in each embodiment and can show captured in real-time image or display photo Display screen.The present invention provides following specific embodiment and can be combined with each other, for identical or phase As concept or process may be repeated no more in some embodiments.
Fig. 1 is a kind of flow chart for processing method of taking pictures provided in an embodiment of the present invention.The present embodiment is provided Processing method of taking pictures be applied in the case of being taken pictures by the front camera of terminal device, the party Method can be performed by processing unit of taking pictures, this take pictures processing unit by way of hardware and software is combined come Realize, the device can be integrated in the processor of terminal device, call and use for processor.Such as Fig. 1 Shown, the method that the present embodiment is provided can include:
S110, view data is obtained by the front camera of terminal device.
The terminal device used at present generally has camera function, and has simultaneously to after image progress of taking pictures The ability of processing, such as U.S. face processing, picture mirror image processing.What various embodiments of the present invention were provided takes pictures Processing method mainly application taken pictures by front camera after image processing process in, no matter which kind of Shooting style, it is necessary first to the view data taken pictures in field range is obtained by camera, obtained Perform and further handle on the basis of the view data.Specifically application scenarios for example can be:Pass through The front camera of smart mobile phone is autodyned.
It should be noted that various embodiments of the present invention can apply to the scene of taking pictures of equivalent front camera, Such as camera in smart mobile phone is rotary pick-up head, when camera is rotated to display screen homonymy, Used as front camera, then the display screen of such as one one camera slightly can rotate 180 degree, rotation Effect of taking pictures after display screen is equal to the effect of taking pictures of front camera.The following embodiment of the present invention will Front camera and it is equal to the take pictures camera of effect of front camera and is referred to as front camera, below Repeat no more.
S120, the detection of characteristic information is carried out to view data, obtains testing result.
In the present embodiment, the view data shot in visual field is obtained by front camera, before Put camera take pictures usually user auto heterodyne, i.e., may have face, landscape or other in the view data The view data of content.Testing result in the present embodiment is that the view data that front camera is obtained is entered The foundation of row processing, characteristic information is then the key parameter of perform detection.
The present embodiment is in a kind of application scenarios of perform detection, and characteristic information can be that view data is entered The object of row detection, in this case, characteristic information is specific testing result, for example, feature is believed Breath includes one or more in face information and text information;In another application scenarios of perform detection In, characteristic information can be detection desired value preset in terminal device, as the contrast ginseng of perform detection Number, the desired value of such as detection is face information, whether can have in detection image data in detection with The related content of face information, testing result is usually to exist or in the absence of the number related to characteristic information According to content.Above-mentioned different application scenarios, the principle of perform detection is different with mode, the detection knot of acquisition Fruit is also different;However, the purpose of perform detection is provided to the picture number for determining to obtain front camera According to the mode handled.
It should be noted that the invention is not restricted to the concrete mode of above-mentioned several perform detections, as long as can By the detection to view data, to get the critical data for determining image procossing mode, all may be used Using the detection behavior as the present invention;For example designated area in view data is detected.
S130, carries out mirror image processing to view data according to testing result or ignores mirror image processing.
In the present embodiment, the testing result of view data has been got, and the testing result can be with It is all to have in different forms and content, the testing result of which kind of form to determine how processing image The key factor of data.For example, it is usually to autodyne that the present embodiment, which performs the mode taken pictures, and shooting is regarded It is face in, in the case, testing result is, for example, face information or to have in view data Face information, now, in order to meet the i.e. requirement of gained seen in user's auto heterodyne, terminal device can be right View data carries out mirror image processing;Again for example, user is by front camera when being autodyned, Shoot visual field in have word content, or word content occupy shoot visual field proportion it is larger, for example, carry on the back The billboard of scape is the word on personage's clothes, now, if carrying out mirror image processing to view data, Word in the photo of generation is heterochiral state, just as the word in galley, photo it is true Sense is poor, in this case, it is possible to ignore mirror image processing to view data, that is, the photo shot can be with defeated Go out the correct effect of word, obtain meeting the word content of reading habit.The present embodiment is made with testing result To be turned on and off the trigger condition of mirror image processing function, it is possible to achieve mirror image in auto heterodyne image processing process The self-adaptive switch of function, it is to avoid the subjectivity of artificial judgement, while it also avoid the operation of complexity Journey.
The existing mode autodyned by front camera, for example above-mentioned background technology of common implementation Middle introduction, set One function to switch the camera of terminal device, mirror is opened by the setting of user As processing function or closing mirror image processing function, which needs user's subjective judgement to be adapted to what is currently taken pictures Processing mode, and setting operation manually is carried out by user, set the operation of functional switch complex manually, Need to find the position of functional switch, different auto heterodyne application programs also may be used to the set location of the functional switch Can be different;In addition, may be needed according to the setting for judging change functional switch during taking pictures, Bring to take pictures to user and cumbersome experience effect is set, the efficiency taken pictures and intelligent poor.
The processing method of taking pictures that the present embodiment is provided, picture number is obtained by the front camera of terminal device According to, and to the detection of view data progress characteristic information, testing result is obtained, then tie by the detection Fruit carries out mirror image processing to the view data that front camera is obtained or ignores mirror image processing, the present embodiment with The testing result of view data is realized to preceding as the trigger condition for being turned on and off mirror image processing function The self-adaptive switch of image feature in the image procossing of camera shooting is put, is performed again while avoiding user Miscellaneous setting operation, solves prior art and uses in the processing mode that front camera is taken pictures, lead to The setting for crossing user opens mirror image processing function or closes mirror image processing function, due to needing user's subjectivity to sentence The disconnected processing mode for being adapted to currently take pictures, and setting is operated manually by user's progress, so as to lead the behaviour taken pictures The problem of making step complicated, and easily picture distortion occur.
Further, prior art in the shooting process of front camera, it is necessary to which user voluntarily judges to fit The processing mode taken pictures before being fated, user judges there is certain subjectivity, and the judgement is easily to use Family causes to misread, especially to the uncomprehending user of image feature, if acquiescence opens mirror image in terminal device Function, occurs the problem of taking pictures distortion when shooting word, if acquiescence closes image feature, user may Effect to auto heterodyne is unsatisfied with, and causes user to complain.
Alternatively, the characteristic information in above-mentioned embodiment illustrated in fig. 1 is testing result, in above-mentioned Fig. 1 On the basis of illustrated embodiment, the S120 in the present embodiment could alternatively be:Detect in view data Characteristic information, acquisition includes the testing result of this feature information, this feature information include face information with One or more in text information.
In the present embodiment, the characteristic information detected, i.e. testing result can be different information or difference The combination of information, for example, the characteristic information detected is face information, then to the processing side of view data Formula is execution mirror image processing;For another example the characteristic information detected is text information, then to view data Processing mode to ignore mirror image processing.It is apparent that have followed unlatching mirror of being taken pictures to face in the present embodiment As processing function, word is taken pictures and closes the principle of mirror image processing function, i.e., in different application scene to the greatest extent The authenticity for shooting photo can be can guarantee that.
The present embodiment it is a kind of it is complex in the case of, the characteristic information detected include face information With the combination of text information, it can be analyzed and processed according to this feature information.As shown in Fig. 2 being this The flow chart for another processing method of taking pictures that inventive embodiments are provided, the present embodiment passes through front camera It is provided with reference zone in the view data of acquisition, above-mentioned face information includes the position of human face region and big Small, text information includes position and the size of character area.As shown in figure 3, for by real shown in Fig. 2 Apply in a kind of schematic diagram of view data of the processing method acquisition of taking pictures of example offer, figure and identify preposition take the photograph As the field of view and reference zone of head, reference zone is usually located at the center of field of view, and The size and location of the reference zone can be changed by the setting of user, the present embodiment in implementing, S130 can include:
S131, according to position and the size of the position of human face region and size, and character area, it is determined that The position relationship and proportionate relationship of human face region and character area and reference zone.
S132, when the ratio for taking reference zone in human face region is more than first threshold, enters to view data Row mirror image processing.
S133, when the ratio for taking reference zone in character area is more than Second Threshold, is neglected to view data Omit mirror image processing.
In the present embodiment, the position of human face region and size, the position of character area and size, and Reference zone can be the form of image information, and the position of above-mentioned different zones and size can also be data The coordinate of the form of information, for example, sharp point;Terminal device is based on human face region or character area The ratio of reference zone is occupied, determines which kind of information in image is even more important, determination processing mode is used as Foundation.For example when user autodynes, face generally takes up the very wide range of reference zone, can now hold Row mirror image processing;When the user for for example holding award certificate again autodynes, it is desirable to embody certificate content, this When reference zone occupied in a big way by the word in certificate, in order to the correctness for ensureing writing on the diploma can To ignore mirror image processing.
It should be noted that the first threshold and Second Threshold in the present embodiment could be arranged to identical number According to or different data, but generally can not be set to there may be the data of conflict in the application, for example, set It is 40% to put first threshold, and Second Threshold is 35%, it is possible to there is conflict, and setting first threshold is 50%, Second Threshold is 60%, would not there is conflict;In addition, S132 and S133 in the present embodiment To select an execution.
It should also be noted that, embodiment illustrated in fig. 2 is a kind of possible implementation of the present invention, this hair In the case that bright not limited features information includes face information and text information combination, judge to be turned on and off The concrete mode of mirror image processing function, for example, can determine human face region and literal field in whole field of view Domain proportionate relationship, then can for example regard focusing range as reference zone.
Alternatively, the characteristic information in above-mentioned embodiment illustrated in fig. 1 can also be preset in terminal device Desired value is detected, this feature information is, for example, face information or text information, then real shown in above-mentioned Fig. 1 Apply on the basis of example, the S120 in the present embodiment could alternatively be:Detection image data, and judge to be somebody's turn to do With the presence or absence of the data content for meeting characteristic information in view data.
In a kind of concrete implementation mode of the present embodiment, the characteristic information in S120 is specially face letter Breath, as shown in figure 4, being the flow chart of another processing method of taking pictures provided in an embodiment of the present invention.This S120 in embodiment can include:S121, detection image data;S122, judges in view data With the presence or absence of the data content for meeting face information;S130 in the present embodiment includes S131 and S132, And S131 and S132 are to select an execution, specifically, if the judged result in S122 is picture number According to the middle data content for existing and meeting face information, then S131 is performed, if the judged result in S122 is The data content for meeting face information is not present in view data;Then perform S132.
S131, mirror image processing is carried out to view data.
S132, ignores mirror image processing to view data.
In another concrete implementation mode of the present embodiment, the characteristic information in S120 is specially word Information, as shown in figure 5, being the flow chart of another processing method of taking pictures provided in an embodiment of the present invention. S120 in the present embodiment can include:S121, detection image data;S122, judges view data In with the presence or absence of meeting the data content of text information;S130 in the present embodiment equally include S131 and S132, and S131 and S132 are to select an execution, specifically, if the judged result in S122 is There is the data content for meeting word face information in view data, then S131 is performed, if sentencing in S122 Disconnected result meets the data content of text information to be not present in view data;Then perform S132.
S131, ignores mirror image processing to view data.
S132, mirror image processing is carried out to view data.
Above-mentioned Fig. 4 and embodiment illustrated in fig. 5, by the detection to specifying desired value, it is determined that being taken the photograph to preposition As head obtain view data processing mode, detection desired value can for user picture pay close attention to it is main because Element, by a kind of specific features be defined as detect desired value, other features are not made a decision, applied to In the taking pictures of special scenes, the content of detection can be simplified, the efficiency and system of detection image data is improved Performance.
Further, on the basis of the various embodiments described above, according to testing result to view data at After reason, also include:Image Coding storage is carried out to the view data after processing.Generally image storage is arrived In the machine of terminal device, the cloud that image is stored to terminal device user can also be taken by data flow It is engaged in device.
Fig. 6 is a kind of structural representation for processing unit of taking pictures provided in an embodiment of the present invention.The present embodiment The processing unit of taking pictures provided is applied in the case of being taken pictures by the front camera of terminal device, The processing unit of taking pictures realizes that the device can be integrated in terminal by way of hardware and software is combined In the processor of equipment, call and use for processor.As shown in fig. 6, the processing dress of taking pictures of the present embodiment Put and specifically include:Image collection module 11, detection module 12 and processing module 13.
Wherein, image collection module 11, for obtaining view data by the front camera of terminal device.
Terminal device in the present embodiment is mainly used at the image after being taken pictures by front camera During reason, it can be applied equally to be equal in the taking pictures of front camera.Preposition take the photograph can be equal to As the concrete application scene that head is taken pictures has been illustrated in the above-described embodiments, therefore it will not be repeated here.
Detection module 12, the view data for being obtained to image collection module 11 carries out characteristic information Detection, obtains testing result.
Testing result in the present embodiment be the view data that front camera is obtained is handled according to According to characteristic information is then the key parameter of perform detection.The present embodiment in the present embodiment perform detection one Plant in application scenarios, characteristic information can be the object detected to view data, in this case, Characteristic information is specific testing result;In another application scenarios of perform detection, characteristic information It can be the reduced parameter of preset detection desired value, as perform detection in terminal device.
It should be noted that the invention is not restricted to the concrete mode of above-mentioned several perform detections, as long as can By the detection to view data, to get the critical data for determining image procossing mode, all may be used Using the detection behavior as the present invention;For example designated area in view data is detected.
Processing module 13, mirror is carried out for the testing result that is obtained according to detection module 12 to view data As handling or ignoring mirror image processing.
In the present embodiment, the testing result got can be different forms and content, no matter which kind of All there is the key factor for determining how processing view data in the testing result of form.The present embodiment is to examine Survey result and be used as the trigger condition for being turned on and off mirror image processing function, it is possible to achieve auto heterodyne image procossing mistake The self-adaptive switch of image feature in journey, it is to avoid the subjectivity of artificial judgement, while it also avoid complexity Operating process.
Processing unit provided in an embodiment of the present invention of taking pictures is used to perform embodiment illustrated in fig. 1 offer of the present invention Processing method of taking pictures, possess corresponding functional module, its implementing principle and technical effect is similar, herein Repeat no more.
Alternatively, the characteristic information in above-mentioned embodiment illustrated in fig. 6 can be testing result, then this implementation Detection module 12 in example is used to carry out characteristic information to the view data that image collection module 11 is obtained Detection, obtains testing result, refers to:Detect the spy in the view data that image collection module 11 is obtained Reference ceases, and acquisition includes the testing result of characteristic information, and characteristic information includes face information and text information In one or more.
In the present embodiment, the characteristic information that detection module 12 is detected, i.e. testing result can be difference The combination of information or different information.If characteristic information includes face information, processing module 13 is used for basis The testing result that detection module 12 is obtained carries out mirror image processing to view data or ignores mirror image processing, is Refer to:The face information detected according to detection module 12 carries out mirror image processing to view data.If feature is believed Breath includes text information, then processing module 13 is used for the testing result obtained according to detection module 12 to figure As data carry out mirror image processing or ignore mirror image processing, refer to:The word detected according to detection module 12 Information ignores mirror image processing to view data.Processing module 13 in the present embodiment can have followed to face Take pictures and open mirror image processing function, word is taken pictures and closes the principle of mirror image processing function, i.e., should in difference With the authenticity for ensureing shooting photo in scene as far as possible.
The present embodiment it is a kind of it is complex in the case of, the characteristic information bag that detection module 12 is detected The combination of face information and text information is included, processing module 13 can be carried out at analysis according to this feature information Reason, wherein, reference zone is provided with the view data obtained in the present embodiment by front camera, Above-mentioned face information can include position and the size of human face region, and text information can include character area Position and size, be equally referred to the view data schematic diagram shown in Fig. 3.As shown in fig. 7, being The structural representation of another processing unit of taking pictures provided in an embodiment of the present invention, is being filled shown in above-mentioned Fig. 6 On the architecture basics put, the processing module 13 in the present embodiment includes:Determining unit 14, for basis Detection module 12 obtain human face region position and size, and character area position and size, really Determine the position relationship and proportionate relationship of human face region and character area and reference zone;Processing unit 15, is used In when determining unit 14 determines that human face region takes the ratio of reference zone more than first threshold, to figure As data carry out mirror image processing;The processing unit 15, is additionally operable to determine literal field in determining unit 14 When the ratio that domain takes reference zone is more than Second Threshold, mirror image processing is ignored to view data.
In the present embodiment, the position of human face region and size, the position of character area and size, and Reference zone can be the form of image information, can also be the form of data message, for example, image side The coordinate of boundary's point.Terminal device is turned on and off the mode of image feature based on above-mentioned each information determination, Illustrate, therefore will not be repeated here in above-described embodiment.
It should be noted that the first threshold and Second Threshold in the present embodiment could be arranged to identical number According to or different data, but generally can not be set to there may be the data of conflict in the application;In addition, The processing mode of the present embodiment is a kind of possible implementation of the present invention, not limited features information of the invention In the case of including face information and text information combination, judge to be turned on and off the tool of mirror image processing function Body mode.
Processing unit provided in an embodiment of the present invention of taking pictures is used to perform embodiment illustrated in fig. 2 offer of the present invention Processing method of taking pictures, possess corresponding functional module, its implementing principle and technical effect is similar, herein Repeat no more.
Alternatively, the characteristic information in above-mentioned embodiment illustrated in fig. 6 can also be preset in terminal device Desired value is detected, this feature information is, for example, face information or text information, then real shown in above-mentioned Fig. 6 Apply on the basis of example, the detection module 12 in the present embodiment is used for the figure obtained to image collection module 11 As data carry out the detection of characteristic information, testing result is obtained, is referred to:Detection image acquisition module 11 The view data of acquisition, and judge in view data with the presence or absence of the data content for meeting characteristic information.
In a kind of concrete implementation mode of the present embodiment, characteristic information is specially face information, accordingly Ground, processing module 13 is used for the testing result obtained according to the detection module 12 to described image data Carry out mirror image processing or ignore mirror image processing, including:Processing module 13, for being obtained in detection module 12 The testing result taken is entered to exist in view data during the data content for meeting face information to view data Row mirror image processing;In addition, processing module 13, be additionally operable to be in the testing result that detection module 12 is obtained When the data content for meeting face information being not present in view data, mirror image processing is ignored to view data.
In another concrete implementation mode of the present embodiment, characteristic information is specially text information, phase Ying Di, the testing result that processing module 13 is used to be obtained according to detection module 12 carries out mirror to view data As handling or ignoring mirror image processing, including:Processing module 13, for the inspection obtained in detection module 12 Result is surveyed to exist in view data during the data content for meeting text information, mirror image is ignored to view data Processing;In addition, the processing module 13, the testing result for being additionally operable to obtain in detection module 12 is image When the data content for meeting face information being not present in data, mirror image processing is carried out to view data.
Processing unit provided in an embodiment of the present invention of taking pictures is used to perform implementation shown in Fig. 4 of the present invention and Fig. 5 The processing method of taking pictures that example is provided, possesses corresponding functional module, its implementing principle and technical effect is similar, Here is omitted.
Above-described embodiment is by the detection to specifying desired value, it is determined that the picture number obtained to front camera According to processing mode, detection desired value can for user picture pay close attention to principal element, by a kind of specific spy Levy and be defined as detecting desired value, other features are not made a decision, in applied to the taking pictures of special scenes, The content of detection can be simplified, the efficiency and systematic function of detection image data is improved.
Further, on the architecture basics for processing unit of being taken pictures in the various embodiments described above, also including storage Module, for after processing module 13 is handled view data according to testing result, after processing View data carries out Image Coding storage., can be with generally by image storage into the machine of terminal device Image is stored into the Cloud Server of terminal device user by data flow.
Although disclosed herein embodiment as above, described content is only to readily appreciate the present invention And the embodiment used, it is not limited to the present invention.Technology people in any art of the present invention Member, do not depart from disclosed herein spirit and scope on the premise of, can be in the form of implementation and thin Any modification and change, but the scope of patent protection of the present invention are carried out on section, still must be with appended right The scope that claim is defined is defined.

Claims (16)

  1. The processing method 1. one kind is taken pictures, it is characterised in that including:
    View data is obtained by the front camera of terminal device;
    Described image data are carried out with the detection of characteristic information, testing result is obtained;
    Mirror image processing is carried out to described image data according to the testing result or ignores mirror image processing.
  2. 2. processing method according to claim 1 of taking pictures, it is characterised in that described to described image Data carry out the detection of characteristic information, obtain testing result, refer to:
    The characteristic information in described image data is detected, acquisition includes the testing result of the characteristic information, The characteristic information includes one or more in face information and text information.
  3. 3. processing method according to claim 2 of taking pictures, it is characterised in that the characteristic information bag Include face information;It is described that mirror image processing is carried out to described image data according to the testing result or ignores mirror As processing, refer to:
    Mirror image processing is carried out to described image data according to detected face information.
  4. 4. processing method according to claim 2 of taking pictures, it is characterised in that the characteristic information bag Include text information;It is described that mirror image processing is carried out to described image data according to the testing result or ignores mirror As processing, refer to:
    Mirror image processing is ignored to described image data according to detected text information.
  5. 5. processing method according to claim 2 of taking pictures, it is characterised in that in described image data Reference zone is provided with, the characteristic information includes face information and text information, wherein, the face Information includes position and the size of human face region, and the text information includes position and the size of character area; It is described that mirror image processing is carried out to described image data according to the testing result or ignores mirror image processing, including:
    According to position and the size of the position of the human face region and size, and the character area, really The position relationship and proportionate relationship of the fixed human face region and the character area and the reference zone;
    When the ratio for taking the reference zone in the human face region is more than first threshold, to described image Data carry out mirror image processing;
    When the ratio for taking the reference zone in the character area is more than Second Threshold, to described image Data ignore mirror image processing.
  6. 6. processing method according to claim 1 of taking pictures, it is characterised in that the characteristic information is Preset detection desired value in the terminal device, the characteristic information is face information or text information; The detection that described image data are carried out with characteristic information, obtains testing result, refers to:
    Described image data are detected, and are judged in described image data with the presence or absence of meeting the characteristic information Data content.
  7. 7. processing method according to claim 6 of taking pictures, it is characterised in that the characteristic information is Face information;It is described that mirror image processing is carried out to described image data according to the testing result or ignores mirror image Processing, including:
    There is the data content for meeting the face information in the testing result is described image data When, mirror image processing is carried out to described image data;
    The data content for meeting the face information is not present in the testing result is described image data When, mirror image processing is ignored to described image data.
  8. 8. processing method according to claim 6 of taking pictures, it is characterised in that the characteristic information is Text information;It is described that mirror image processing is carried out to described image data according to the testing result or ignores mirror image Processing, including:
    There is the data content for meeting the text information in the testing result is described image data When, mirror image processing is ignored to described image data;
    The data content for meeting the face information is not present in the testing result is described image data When, mirror image processing is carried out to described image data.
  9. The processing unit 9. one kind is taken pictures, it is characterised in that the processing unit of taking pictures is arranged at terminal and set In standby, the processing unit of taking pictures includes:
    Image collection module, for obtaining view data by the front camera of the terminal device;
    Detection module, the view data for being obtained to described image acquisition module carries out the inspection of characteristic information Survey, obtain testing result;
    Processing module, the testing result for being obtained according to the detection module is carried out to described image data Mirror image processing ignores mirror image processing.
  10. 10. processing unit according to claim 9 of taking pictures, it is characterised in that the detection module View data for being obtained to described image acquisition module carries out the detection of characteristic information, obtains detection knot Really, refer to:The characteristic information in the view data that described image acquisition module is obtained is detected, bag is obtained The testing result of the characteristic information is included, the characteristic information includes one in face information and text information Item is multinomial.
  11. 11. processing unit according to claim 10 of taking pictures, it is characterised in that the characteristic information Including face information;The processing module is used for the testing result obtained according to the detection module to described View data carries out mirror image processing or ignores mirror image processing, refers to:Detected according to the detection module Face information carries out mirror image processing to described image data.
  12. 12. processing unit according to claim 10 of taking pictures, it is characterised in that the characteristic information Including text information;The processing module is used for the testing result obtained according to the detection module to described View data carries out mirror image processing or ignores mirror image processing, refers to:Detected according to the detection module Text information ignores mirror image processing to described image data.
  13. 13. processing unit according to claim 10 of taking pictures, it is characterised in that described image data In be provided with reference zone, the characteristic information includes face information and text information, wherein, the people The position of face information including human face region and size, the text information include the position of character area and big It is small;The processing module includes:
    Determining unit, for the position of human face region obtained according to the detection module and size, and The position of character area and size, determine the human face region and the character area and the reference zone Position relationship and proportionate relationship;
    Processing unit, for determining that human face region takes the ratio of the reference zone in the determining unit When value is more than first threshold, mirror image processing is carried out to described image data;
    The processing unit, is additionally operable to determine that character area takes the reference area in the determining unit When the ratio in domain is more than Second Threshold, mirror image processing is ignored to described image data.
  14. 14. processing unit according to claim 9 of taking pictures, it is characterised in that the characteristic information For detection desired value preset in the terminal device, the characteristic information is face information or text information; The detection module is used for the inspection that characteristic information is carried out to the view data that described image acquisition module is obtained Survey, obtain testing result, refer to:The view data that described image acquisition module is obtained is detected, and is judged With the presence or absence of the data content for meeting the characteristic information in described image data.
  15. 15. processing unit according to claim 14 of taking pictures, it is characterised in that the characteristic information For face information;The processing module is used for the testing result obtained according to the detection module to the figure As data carry out mirror image processing or ignoring mirror image processing, including:
    The processing module, used in being described image data in the testing result that the detection module is obtained During in the presence of the data content for meeting the face information, mirror image processing is carried out to described image data;
    The processing module, the testing result for being additionally operable to obtain in the detection module is described image data In be not present meet the face information data content when, mirror image processing is ignored to described image data.
  16. 16. processing unit according to claim 14 of taking pictures, it is characterised in that the characteristic information For text information;The processing module is used for the testing result obtained according to the detection module to the figure As data carry out mirror image processing or ignoring mirror image processing, including:
    The processing module, used in being described image data in the testing result that the detection module is obtained During in the presence of the data content for meeting the text information, mirror image processing is ignored to described image data;
    The processing module, the testing result for being additionally operable to obtain in the detection module is described image data In be not present meet the face information data content when, to described image data carry out mirror image processing.
CN201610015094.9A 2016-01-08 2016-01-08 Photographing processing method and device Active CN106961558B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201610015094.9A CN106961558B (en) 2016-01-08 2016-01-08 Photographing processing method and device
PCT/CN2016/077022 WO2016197657A1 (en) 2016-01-08 2016-03-22 Photographing processing method and apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610015094.9A CN106961558B (en) 2016-01-08 2016-01-08 Photographing processing method and device

Publications (2)

Publication Number Publication Date
CN106961558A true CN106961558A (en) 2017-07-18
CN106961558B CN106961558B (en) 2020-06-16

Family

ID=57504504

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610015094.9A Active CN106961558B (en) 2016-01-08 2016-01-08 Photographing processing method and device

Country Status (2)

Country Link
CN (1) CN106961558B (en)
WO (1) WO2016197657A1 (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107563960A (en) * 2017-08-30 2018-01-09 惠州Tcl移动通信有限公司 A kind of processing method, storage medium and the mobile terminal of self-timer picture
CN108055463A (en) * 2017-12-26 2018-05-18 努比亚技术有限公司 Image processing method, terminal and storage medium
CN112422821A (en) * 2020-11-01 2021-02-26 王小燕 Intelligent terminal picture shooting and publishing method and system based on Internet
CN112929561A (en) * 2021-01-19 2021-06-08 北京达佳互联信息技术有限公司 Multimedia data processing method and device, electronic equipment and storage medium
CN113242385A (en) * 2021-05-12 2021-08-10 广州朗国电子科技有限公司 Method for intelligently adjusting camera image and related equipment

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107203964A (en) * 2017-05-24 2017-09-26 北京小米移动软件有限公司 Image processing method and device
CN108632413B (en) * 2018-05-15 2019-12-03 维沃移动通信有限公司 A kind of photographic method and mobile terminal
CN108650463B (en) * 2018-05-15 2019-11-26 维沃移动通信有限公司 A kind of photographic method and mobile terminal

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1620795A (en) * 2001-12-19 2005-05-25 三洋电机株式会社 Collapsible communication terminal apparatus
CN103152489A (en) * 2013-03-25 2013-06-12 锤子科技(北京)有限公司 Showing method and device for self-shooting image
CN104243831A (en) * 2014-09-30 2014-12-24 北京金山安全软件有限公司 Method and device for shooting through mobile terminal and mobile terminal
US20150154439A1 (en) * 2013-03-29 2015-06-04 Panasonic Intellectual Property Management Co., Ltd. Electronic mirror device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1620795A (en) * 2001-12-19 2005-05-25 三洋电机株式会社 Collapsible communication terminal apparatus
CN103152489A (en) * 2013-03-25 2013-06-12 锤子科技(北京)有限公司 Showing method and device for self-shooting image
US20150154439A1 (en) * 2013-03-29 2015-06-04 Panasonic Intellectual Property Management Co., Ltd. Electronic mirror device
CN104243831A (en) * 2014-09-30 2014-12-24 北京金山安全软件有限公司 Method and device for shooting through mobile terminal and mobile terminal

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107563960A (en) * 2017-08-30 2018-01-09 惠州Tcl移动通信有限公司 A kind of processing method, storage medium and the mobile terminal of self-timer picture
WO2019042369A1 (en) * 2017-08-30 2019-03-07 捷开通讯(深圳)有限公司 Processing method for self-photographed picture, storage medium and mobile terminal
CN108055463A (en) * 2017-12-26 2018-05-18 努比亚技术有限公司 Image processing method, terminal and storage medium
CN112422821A (en) * 2020-11-01 2021-02-26 王小燕 Intelligent terminal picture shooting and publishing method and system based on Internet
CN112422821B (en) * 2020-11-01 2022-01-04 艾普科创(北京)控股有限公司 Intelligent terminal picture shooting and publishing method and system based on Internet
CN112929561A (en) * 2021-01-19 2021-06-08 北京达佳互联信息技术有限公司 Multimedia data processing method and device, electronic equipment and storage medium
CN112929561B (en) * 2021-01-19 2023-04-28 北京达佳互联信息技术有限公司 Multimedia data processing method and device, electronic equipment and storage medium
CN113242385A (en) * 2021-05-12 2021-08-10 广州朗国电子科技有限公司 Method for intelligently adjusting camera image and related equipment

Also Published As

Publication number Publication date
WO2016197657A1 (en) 2016-12-15
CN106961558B (en) 2020-06-16

Similar Documents

Publication Publication Date Title
CN106961558A (en) One kind is taken pictures treating method and apparatus
Matern et al. Exploiting visual artifacts to expose deepfakes and face manipulations
Korshunov et al. Vulnerability assessment and detection of deepfake videos
US11080517B2 (en) Face anti-counterfeiting detection methods and systems, electronic devices, programs and media
US10438077B2 (en) Face liveness detection method, terminal, server and storage medium
Huh et al. Fighting fake news: Image splice detection via learned self-consistency
US20230116801A1 (en) Image authenticity detection method and device, computer device, and storage medium
CN107886032B (en) Terminal device, smart phone, authentication method and system based on face recognition
WO2020018359A1 (en) Three-dimensional living-body face detection method, face authentication recognition method, and apparatuses
CN109697416A (en) A kind of video data handling procedure and relevant apparatus
WO2020211624A1 (en) Object tracking method, tracking processing method, corresponding apparatus and electronic device
WO2020019760A1 (en) Living body detection method, apparatus and system, and electronic device and storage medium
CN106874826A (en) Face key point-tracking method and device
CN110163053B (en) Method and device for generating negative sample for face recognition and computer equipment
WO2020000912A1 (en) Behavior detection method and apparatus, and electronic device and storage medium
TW202011260A (en) Liveness detection method, apparatus and computer-readable storage medium
CN111240482B (en) Special effect display method and device
CN106464803A (en) Enhanced image capture
Saboia et al. Eye specular highlights telltales for digital forensics: A machine learning approach
CN106169075A (en) Auth method and device
CN108734106A (en) Quick sudden and violent probably video frequency identifying method based on comparison
WO2021169616A1 (en) Method and apparatus for detecting face of non-living body, and computer device and storage medium
AU2020309094B2 (en) Image processing method and apparatus, electronic device, and storage medium
CN109191635A (en) Objective method, apparatus and storage medium are sentenced based on face recognition technology
CN113160231A (en) Sample generation method, sample generation device and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant