CN105607835A - Mobile terminal with automatic picture direction adjusting function and display method thereof - Google Patents

Mobile terminal with automatic picture direction adjusting function and display method thereof Download PDF

Info

Publication number
CN105607835A
CN105607835A CN201510977314.1A CN201510977314A CN105607835A CN 105607835 A CN105607835 A CN 105607835A CN 201510977314 A CN201510977314 A CN 201510977314A CN 105607835 A CN105607835 A CN 105607835A
Authority
CN
China
Prior art keywords
picture
rotation information
scenery
rotation
face
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510977314.1A
Other languages
Chinese (zh)
Inventor
安钻杰
师小江
黄大勇
刘永杰
董红英
黄龙泉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huizhou TCL Mobile Communication Co Ltd
Original Assignee
Huizhou TCL Mobile Communication Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huizhou TCL Mobile Communication Co Ltd filed Critical Huizhou TCL Mobile Communication Co Ltd
Priority to CN201510977314.1A priority Critical patent/CN105607835A/en
Publication of CN105607835A publication Critical patent/CN105607835A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces

Abstract

The invention discloses a mobile terminal with an automatic picture direction adjusting function and a display method thereof. The method comprises the following steps: recognizing at least two scenes in a to-be-displayed picture by the mobile terminal; determining relative position coordinates between the at least two scenes and determining a first current direction of the picture according to the relative position coordinates; comparing the first current direction of the picture with a preset reference direction to determine first rotation information of the picture; and rotating the picture according to the first rotation information to display. Through the manner, the picture can be rapidly and automatically rotated to a normal display angle, so that the user experience of the product is enhanced.

Description

The self-adjusting mobile terminal of picture direction and display methods thereof
Technical field
The present invention relates to mobile terminal Display Technique field, particularly relate to a kind of picture direction automaticMobile terminal and the display methods thereof adjusted.
Background technology
Along with the develop rapidly of the communication technology and popularizing of smart electronics product, more and more intelligenceTerminal or mobile terminal become an indispensable part in people's life, as smart mobile phone, intelligenceTV, computer etc. And when intelligent terminal is universal, user possesses intelligent terminalKind and the performance requirement of function are also more and more higher, as audio frequency, video capability, camera function allThrough becoming the necessary functions of intelligent terminal.
Image Display is the basic function of various mobile terminals, but the picture that intelligent terminal shows alsoNon-is all the state corresponding with its screen at every turn, after many times needing to be rotated, could seeSee. Existing picture rotation is to carry out rotating image by artificial each operation. And generally can only 90The rotation of degree integral multiple, generally will arrive angle on target all needs could realize through multiple rotary, behaviourMake process loaded down with trivial details, and lose time, reduced user's experience.
Summary of the invention
The technical problem that the present invention mainly solves is to provide the self-adjusting movement of a kind of picture directionTerminal and display methods thereof can show picture rotation fast automaticly to normal angle, increaseAdding user experiences.
For solving the problems of the technologies described above, the technical scheme that the present invention adopts is: provide one to moveThe moving self-adjusting display methods of terminal picture direction, comprising:
Mobile terminal is identified at least two kinds of scenery in picture to be shown;
Relative position coordinates described in determining between at least two kinds of scenery, and according to described relative positionCoordinate is determined the first current direction of described picture;
The first current direction and the preset reference direction of described picture are compared, determine described figureThe first rotation information of sheet;
Described picture is rotated to rear demonstration according to described the first rotation information.
Wherein, the described step that described picture is rotated to rear demonstration according to described the first rotation informationBefore rapid, also comprise:
Described picture is carried out to recognition of face, determine the relative position coordinates of face face, and according toThe relative position coordinates of described face face is determined the second current direction of described picture;
The second current direction of described picture and described preset reference direction are compared, determine instituteState the second rotation information of picture;
The described step showing after described picture is rotated according to described the first rotation informationSuddenly comprise:
Judge that whether described the first rotation information is identical with described the second rotation information;
If described the first rotation information is identical with described the second rotation information, according to described firstRotation information shows after described picture is rotated; If described the first rotation information and instituteState the second rotation information not identical, according to set priority from described the first rotation information and described inIn the second rotation information, determine the rotation information of high priority, and according to the rotation of described high priorityInformation shows after described picture is rotated.
Wherein, describedly after being rotated according to described the first rotation information, described picture showsStep comprise:
Described picture is rotated according to described the first rotation information, and according to display screen sizeSize adjustment after show.
Wherein, the described step that described picture is carried out to recognition of face comprises:
No more than two faces in described picture are identified.
Wherein, the described step bag that at least two kinds of scenery in picture to be shown are identifiedDraw together:
Aerial scenery in picture to be shown and land scenery are identified;
Described determine described in the step of relative position coordinates between at least two kinds of scenery comprise:
Determine the relative position coordinates between described aerial scenery and described land scenery;
Wherein, described aerial scenery comprises at least one in sky, the sun, the moon, white clouds,Described land scenery comprises at least one in plant, stationary body, building.
For solving the problems of the technologies described above, another technical solution used in the present invention is: provide a kind ofThe self-adjusting mobile terminal of picture direction, described device comprises the first identification module, first directionDetermination module, the first rotation information determination module and display module,
Described the first identification module for to picture to be shown at least two kinds of scenery carry outIdentification;
Described first direction determination module is for the phase contraposition between at least two kinds of scenery described in determiningPut coordinate, and determine the first current direction of described picture according to described relative position coordinates;
Described the first rotation information determination module is used for the first current direction of described picture with pre-If reference direction is compared, determine the first rotation information of described picture;
Described display module is for after being rotated described picture according to described the first rotation informationShow.
Wherein, described device also comprises the second identification module, for described picture is carried out to face knowledgeNot;
Second direction determination module, for determining the relative position coordinates of face face, and according to instituteThe relative position coordinates of stating face face is determined the second current direction of described picture;
The second rotation information determination module, for by the second current direction of described picture and described pre-If reference direction is compared, determine the second rotation information of described picture;
Judge module, for judging whether phase of described the first rotation information and described the second rotation informationWith;
Described display module is specifically at described the first rotation information and described the second rotation informationWhen identical, after according to described the first rotation information, described picture being rotated, show; InstituteState the first rotation information when not identical with described the second rotation information, according to setting priority from describedIn the first rotation information and described the second rotation information, determine the rotation information of high priority, and according toThe rotation information of described high priority shows after described picture is rotated.
Wherein, described display module is specifically for entering described picture according to described the first rotation informationRow rotation, and according to showing after the size adjustment of display screen size.
Wherein, described the second identification module is specifically for no more than two faces in described pictureIdentify.
Wherein, described display module is specifically for aerial scenery and land in the picture to be shownScenery is identified;
Described first direction determination module is specifically for determining described aerial scenery and described land scapeRelative position coordinates between thing;
Wherein, described aerial scenery comprises at least one in sky, the sun, the moon, white clouds,Described land scenery comprises at least one in plant, stationary body, building.
The invention has the beneficial effects as follows: be different from the situation of prior art, mobile terminal of the present inventionFirst at least two kinds of scenery in picture to be shown are identified, determine these at least two kinds of scenery itBetween relative position coordinates, and determine according to relative position coordinates after the first current direction of picture,Contrast with preset reference direction, determine the first rotation information of picture, by picture according to firstAfter rotation information rotation, show. Not only can make user enjoy the picture of normal demonstration, whole mistakeWithout manual operation, more intelligent in journey, for user has brought convenience; And picture onlyJust be rotated according to preset reference direction, do not change the resolution ratio of original image, also ensureThe definition of original image, can not change any information of this picture in memory device yet.
Brief description of the drawings
Fig. 1 is self-adjusting display methods one embodiment of mobile terminal picture direction of the present inventionSchematic flow sheet;
Fig. 2 is another embodiment of the self-adjusting display methods of mobile terminal picture direction of the present inventionSchematic flow sheet;
Fig. 3 is the structural representation of self-adjusting mobile terminal one embodiment of picture direction of the present inventionFigure;
Fig. 4 is that the structure of self-adjusting another embodiment of mobile terminal of picture direction of the present invention is shownIntention;
Fig. 5 is the structural representation of mobile terminal one embodiment of the present invention.
Detailed description of the invention
Consult Fig. 1, Fig. 1 is the self-adjusting display methods one of mobile terminal picture direction of the present inventionThe schematic flow sheet of embodiment. As shown in Figure 1, the method bag of the Image Display of present embodimentDraw together following steps:
101: mobile terminal is identified at least two kinds of scenery in picture to be shown.
Mobile terminal, getting after picture to be shown, is first known the scenery in pictureNot. Particularly, the aerial scenery in picture and land scenery are differentiated, wherein, aerial scapeThing comprises at least one in sky, the sun, the moon and white clouds; Land scenery comprise plant,At least one in stationary body and building.
This mobile terminal comprises smart mobile phone, intelligent television, PC and smart camera etc.,This does not limit.
102: the relative position coordinates described in determining between at least two kinds of scenery, and according to described phasePosition coordinates is determined to the first current direction of described picture.
In the time getting the relative position coordinates of at least two kinds of scenery in picture, in order to determine this pictureWhether be that normal position shows, determine the relative position coordinates between two kinds of scenery identifying, concreteGround, according to the predefined origin of coordinates and coordinate system, determines the coordinate position of these two kinds of scenery,One preferred embodiment in, in the time that the scenery recognizing comprises characteristic information, as one largeTree, can first identify its branches and leaves and trunk, determines the relative position of tree. According to two kinds of scapesThing, as the relative position of the sun, large tree, is tentatively determined the first current direction of this picture, as detectedTo all lefts in trunk of branches and leaves of large tree, and the lower left of the sun in large tree, really preliminaryThe first current direction of determining photo current is the certain angle that has been tilted to the left.
103: the first current direction and the preset reference direction of described picture are compared, determineThe first rotation information of described picture.
Get after the first current direction of picture, further obtain the identification of mobile terminal storesThe reference direction that scenery is corresponding, as the preset reference direction of the normal sun and large tree, and by firstCurrent direction and this preset reference direction are compared, and determine the first rotation information of picture.
For example, in preset reference direction, the trunk of large tree be positioned at branches and leaves under, the sun is positioned atThe top of large tree, compares preset reference direction and the first current direction, judges the twoRelative position is inconsistent, further obtains the scenery of identification as the relative coordinate letter of the sun and large treeBreath, and compare with the relative coordinate information of the middle setting of preset reference information, determine this pictureCurrent direction and the angle that needs rotation, specifically determine first direction of rotation and the of this pictureOne anglec of rotation. For example, after comparison, determine that the first direction of rotation of this picture is for clockwiseDirection, first anglec of rotation is 80 degree.
104: described picture is rotated to rear demonstration according to described the first rotation information.
Determine after first direction of rotation and first anglec of rotation of this picture, by this picture according to thisOne anglec of rotation and the first direction of rotation are rotated, and postrotational picture is shown.
Because the size of the display screen of not all mobile terminal is all identical, in order to ensure oftenOn a mobile terminal, can show normal picture attractive in appearance, in another embodiment, mobileAfter terminal is rotated according to first anglec of rotation and the first direction of rotation picture, according to current aobviousThe size that shows screen size shows after picture is adjusted again.
As PC gets after the picture of high definition camera shooting, according to first anglec of rotation and firstAfter direction of rotation is rotated this picture, according to the size of the size of PC screen to thisPicture is adjusted rear demonstration.
Be different from prior art, the mobile terminal in present embodiment is first in picture to be shownAt least two kinds of scenery are identified, and determine the relative position coordinates between these at least two kinds of scenery, andDetermine according to relative position coordinates after the first current direction of picture, with preset reference direction carry out rightRatio, determines the first rotation information of picture, and picture is shown after according to the first rotation information rotation.Not only can make user enjoy the picture of normal demonstration, in whole process without manual operation, moreAdd intellectuality, for user has brought convenience; And picture is only just according to preset reference directionBe rotated, do not change the resolution ratio of original image, also ensured the definition of original image,Can not change any information of this picture in memory device yet.
Consult Fig. 2, Fig. 2 is that the self-adjusting display methods of mobile terminal picture direction of the present invention is anotherThe schematic flow sheet of one embodiment. The image display method of present embodiment comprises the steps:
201: mobile terminal is identified at least two kinds of scenery in picture to be shown.
Mobile terminal, getting after picture to be shown, is first known the scenery in pictureNot. Particularly, the aerial scenery in picture and land scenery are differentiated, wherein, aerial scapeThing comprises at least one in sky, the sun, the moon and white clouds; Land scenery comprise plant,At least one in stationary body and building.
If because picture comprises rivers,lakes and seas etc., may there is the inverted image of scenery, in order to keep awayExempt from the judgement that mobile terminal brings inverted image as identifying object inaccurate, therefore, this enforcement sideIn formula, at least two kinds of scenery in picture to be shown are identified, as the sun in picture andA highest building. Do not limit at this.
This mobile terminal comprises smart mobile phone, intelligent television, PC and smart camera etc.,This does not limit.
202: the relative position coordinates described in determining between at least two kinds of scenery, and according to described phasePosition coordinates is determined to the first current direction of described picture.
In the time getting the relative position coordinates of at least two kinds of scenery in picture, in order to determine this pictureWhether be that normal position shows, determine the relative position coordinates between two kinds of scenery identifying, concreteGround, according to the predefined origin of coordinates and coordinate system, determines the coordinate position of these two kinds of scenery,One preferred embodiment in, in the time that the scenery recognizing comprises characteristic information, as one largeTree, can first identify its branches and leaves and trunk, determines the relative position of tree. According to two kinds of scapesThing, as the relative position of the sun, large tree, is tentatively determined the first current direction of this picture, as detectedTo all lefts in trunk of branches and leaves of large tree, and the lower left of the sun in large tree, really preliminaryThe first current direction of determining photo current is the certain angle that has been tilted to the left.
203: the first current direction and the preset reference direction of described picture are compared, determineThe first rotation information of described picture.
Get after the first current direction of picture, further obtain the identification of mobile terminal storesThe reference direction that scenery is corresponding, as the preset reference direction of the normal sun and large tree, and by firstCurrent direction and this preset reference direction are compared, and determine the first rotation information of picture.
204: described picture is carried out to recognition of face, determine the relative position coordinates of face face,And determine the second current direction of described picture according to the relative position coordinates of described face face.
Under normal circumstances, the position of face face is relatively-stationary, in the time that picture comprises personage,Also can determine the current direction of picture according to the method for recognition of face. Because people are in the time taking a picture, canCan show different postures, the relative position of face entirety may rotate, the people of selectionToo much, may cause erroneous judgement, therefore, the preferred face to multipair two people in present embodimentIdentify.
Particularly, mobile terminal carries out recognition of face to picture to be shown, has judged whether face,In the time defining face, obtain the face of face as the coordinate of eyes, nose, face and hairInformation, and according to the second current direction of this picture of Relative position determination of these face and hair.
205: the second current direction of described picture and described preset reference direction are compared,Determine the second rotation information of described picture;
According to after the second current direction of the Relative position determination picture of face and hair, enter oneThe relative position information that obtains normal mode human face face in mobile terminal and hair of stepPreset reference direction, and this preset reference direction and the second current direction are compared, determining shouldThe second direction of rotation of picture.
It should be noted that, step 204~205 in present embodiment must be not in step201~203 carry out after being finished, only numbering just of step herein, and unrestricted, firstDetermining of rotation information and the second rotation information can be carried out simultaneously, also can be first to the second rotation letterBreath is determined the first rotation information again after determining, as long as can determine the first rotation information and the second rotationInformation, does not limit order.
It should be noted that, in other embodiments, if both do not recognized at least two kinds of scapesThing, also unidentified to face, as static scenery picture, mobile terminal directly shows pictureShow.
206: judge that whether described the first rotation information is identical with described the second rotation information.
Due in the time that the rotation information of picture is determined, adopt two kinds of methods, may go outExisting the two inconsistent situation. In order to determine concrete direction of rotation, first by the first rotation information andThe second rotation information is compared, and determines that whether the two is identical.
207: if described the first rotation information is identical with described the second rotation information, or wherein onlyHaving a rotation information is effectively, according to described arbitrary effective rotation information, described picture is enteredAfter row rotation, show; If described the first rotation information and not phase of described the second rotation informationWith, determine from described the first rotation information and described the second rotation information according to setting priorityThe rotation information of high priority, and according to the rotation information of described high priority, described picture is carried outAfter rotation, show.
If the first rotation information is identical with the second rotation information, the judgement of two kinds of determination methods is describedCome to the same thing, the effect after being rotated with the second rotation information according to the first rotation information is consistent, be therefore directly rotated according to the identical anglec of rotation and direction of rotation.
If the first rotation information and the second rotation information are inconsistent, according to predefined preferentialRank is determined the rotation information of high priority from the first rotation information and the second rotation information, and pressesAfter described picture being rotated according to the rotation information of described high priority, show. Such as, whenWhen the priority level of the first rotation information is high, according to first anglec of rotation and the first direction of rotation to figureSheet is rotated rear demonstration. If the priority level of the second rotation information is high, according to the second rotationAfter being rotated, angle and the second direction of rotation show.
Due to the face with respect to active, the relative position of scenery is more stable, therefore, and at onePreferred embodiment, when the first rotation information and the second rotation information are when inconsistent, according toTwo rotation informations show after picture is rotated.
Be different from prior art, the mobile terminal in present embodiment in picture to be shown extremelyFew two kinds of scenery are identified, and determine the relative position coordinates between these at least two kinds of scenery, and rootDetermine according to relative position coordinates after the first current direction of picture, with preset reference direction carry out rightRatio, determines the first rotation information of picture; Picture is carried out to recognition of face, according to face faceThe second current direction of Relative position determination picture, compares with preset reference direction, determines figureThe second rotation information of sheet, and the first rotation information and the second rotation information when identical according to secondRotation information is rotated, when the first rotation information and the second rotation information are not identical according to priorityNot high rotation information is rotated. Not only can make user enjoy the picture of normal demonstration, wholeWithout manual operation, more intelligent in individual process, for user has brought convenience; And, pictureOnly just be rotated according to preset reference direction, do not change the resolution ratio of original image, alsoEnsure the definition of original image. And, through repeatedly relatively judgement, further improve figureThe precision of sheet rotation information.
Consult Fig. 3, Fig. 3 is self-adjusting mobile terminal one embodiment of picture direction of the present inventionStructural representation, the device of present embodiment comprises that the first identification module 301, first direction are trueCover half piece 302, the first rotation information determination module 303 and the first rotation information determination module304,
The first identification module 301 for the picture to be shown at least two kinds of scenery knowNot.
The first identification module 301 gets after picture to be shown, first at the device Showing PictureScenery in picture is identified. Particularly, the aerial scenery in picture and land scenery are enteredRow is differentiated, and wherein, aerial scenery comprises at least one in sky, the sun, the moon and white clouds;Land scenery comprises at least one in plant, stationary body and building.
This device Showing Picture comprises smart mobile phone, intelligent television, PC and smart cameraDeng, do not limit at this.
First direction determination module 302 is for the relative position between at least two kinds of scenery described in determiningCoordinate, and determine the first current direction of described picture according to described relative position coordinates.
First direction determination module 302 in the first identification module 301 gets picture at least two kindsWhen the relative position coordinates of scenery, in order to determine that whether this picture is that normal position shows, determines and knowsRelative position coordinates between other two kinds of scenery, particularly, according to the predefined origin of coordinatesAnd coordinate system, determine the coordinate position of these two kinds of scenery, one preferred embodiment in,When the scenery recognizing comprises characteristic information, as a large tree, can first carry out its branches and leaves and trunkIdentification, determines the relative position of setting. At the relative position of setting as the sun, greatly according to two kinds of scenery,Tentatively determine the first current direction of this picture, as all left sides in trunk of branches and leaves of large tree detectedSide, and the lower left of the sun in large tree, tentatively determine that the first current direction of photo current isCertain angle has been tilted to the left.
The first rotation information determination module 303 for by the first current direction of described picture with defaultReference direction is compared, and determines the first rotation information of described picture.
The first rotation information determination module 303 gets picture at first direction determination module 302After the first current direction, further obtain the reference side corresponding to scenery of the identification of mobile terminal storesTo, as the preset reference direction of the normal sun and large tree, and by default to the first current direction and thisReference direction is compared, and determines the first rotation information of picture.
For example, in preset reference direction, the trunk of large tree be positioned at branches and leaves under, the sun is positioned atThe top of large tree, preset reference direction and first is worked as front by the first rotation information determination module 303To comparing, the relative position of judging the two is inconsistent, the scenery that further obtains identification asThe relative coordinate information of the sun and large tree, and with the relative coordinate letter of the middle setting of preset reference informationBreath is compared, and determines current direction and the angle that needs rotation of this picture, i.e. concrete definite being somebody's turn to doThe first direction of rotation of picture and first anglec of rotation. For example, after comparison, determine this pictureThe first direction of rotation be clockwise, first anglec of rotation is 80 degree.
Display module 304 is for being rotated rear aobvious by described picture according to described the first rotation informationShow.
Display module 304 is determined the first rotation of this picture at the first rotation information determination module 303After direction and first anglec of rotation, by this picture according to this first anglec of rotation and the first direction of rotationBe rotated, and postrotational picture is shown.
Because the size of the display screen of not all mobile terminal is all identical, in order to ensure oftenOn a mobile terminal, can show normal picture attractive in appearance, in another embodiment, showAfter module 304 is rotated according to first anglec of rotation and the first direction of rotation picture, according to working asThe size of front display screen size shows after picture is adjusted again.
As PC gets after the picture of high definition camera shooting, display module 304 revolves according to firstAfter gyration and the first direction of rotation are rotated this picture, according to the size of PC screenSize is adjusted rear demonstration to this picture.
Be different from prior art, the device of the Image Display of present embodiment comprises the first identification mouldPiece, first direction determination module, the first rotation information determination module and display module, firstIdentification module is identified at least two kinds of scenery in picture to be shown, and first direction is determinedModule is determined the relative position coordinates between at least two kinds of scenery, and determines according to relative position coordinatesThe first current direction of picture, the first rotation information determination module compares with preset reference informationRight, to determine after the first rotation information, display module is according to rear this figure that shows of the first rotation information rotationSheet. Not only can make user enjoy the picture of normal demonstration, in whole process without manual operation,More intelligent, for user has brought convenience; And picture is only just according to preset reference sideTo being rotated, do not change the resolution ratio of original image, also ensure the definition of original image.
Consult Fig. 4, Fig. 4 is another enforcement side of the self-adjusting mobile terminal of picture direction of the present inventionThe structural representation of formula. The difference of the device of the device of present embodiment and a upper embodiment existsIn, the device of present embodiment not only comprises the first identification module 401, first direction determination module402, the first rotation information determination module 403, display module 404, also comprises the second identification module405, second direction determination module 406, the second rotation information determination module 407 and judge module408,
Wherein, the first identification module 401 for the picture to be shown at least two kinds of sceneryIdentify.
First direction determination module 402 is for the relative position between at least two kinds of scenery described in determiningCoordinate, and determine the first current direction of described picture according to described relative position coordinates.
The first rotation information determination module 403 is by the first current direction and preset reference of described pictureDirection is compared, and determines the first rotation information of described picture.
Due to the first identification module 401, first direction determination module 402 and the first rotation informationDetermination module 403 is determined with the first identification module 301, first direction in a upper embodimentModule 302 and the first rotation information determination module 303 are identical, specifically refer to Fig. 3 and phaseClose text description, then this repeats no more.
The second identification module 405 is for carrying out recognition of face to described picture.
Under normal circumstances, the position of face face is relatively-stationary, in the time that picture comprises personage,Also can determine the current direction of picture according to the method for recognition of face. Because people are in the time taking a picture, canCan show different postures, the relative position of face entirety may rotate, the people of selectionToo much, may cause erroneous judgement, therefore, the second identification module 405 of present embodiment is preferredFace to multipair two people is identified.
Second direction determination module 406 is for determining the relative position coordinates of face face, and according toThe relative position coordinates of described face face is determined the second current direction of described picture.
Particularly, second direction determination module 406 at the second identification module 405 to figure to be shownWhen sheet carries out recognition of face and defines face, the face that obtain face as eyes, nose, face withAnd the coordinate information of hair, and according to of this picture of Relative position determination of these face and hairTwo current directions.
The second rotation information determination module 407 for by the second current direction of described picture with described inPreset reference direction is compared, and determines the second rotation information of described picture.
The second rotation information determination module 407 at second direction determination module 406 according to face andAfter the second current direction of the Relative position determination picture of hair, further obtain in mobile terminalThe relative position information of normal mode human face face and hair is preset reference direction, and shouldPreset reference direction and the second current direction are compared, and determine the second rotation information of this picture.
It should be noted that, the second identification module 405, second direction in present embodiment are determinedModule 406, the second rotation information determination module 407 must be not the first identification module 401,First direction determination module 402, the first rotation information determination module 403 start to move after finishing the workDo, numbering herein, just for mark, is not the restriction to job order, the first rotation informationCan carry out with determining of the second rotation information, after also can first determining the second rotation information simultaneouslyDetermine again the first rotation information, as long as can determine the first rotation information and the second rotation informationCan, order is not limited.
Whether judge module 408 is for judging described the first rotation information and described the second rotation informationIdentical.
Due in the time that the rotation information of picture is determined, adopt two kinds of methods, may go outExisting the two inconsistent situation. In order to determine concrete direction of rotation, judge module 408 revolves firstTransfering the letter breath and the second rotation information are compared, and determine that whether the two is identical.
Display module 404 is for identical with described the second rotation information at described the first rotation informationTime, after according to described the first rotation information, described picture being rotated, show; DescribedWhen one rotation information is not identical with described the second rotation information, according to setting priority from described firstIn rotation information and described the second rotation information, determine the rotation information of high priority, and according to describedThe rotation information of high priority shows after described picture is rotated.
If the first rotation information is identical with the second rotation information, the judgement of two kinds of determination methods is describedCome to the same thing, after display module 404 is rotated according to the first rotation information and the second rotation informationEffect be consistent, therefore directly revolve according to the identical anglec of rotation and direction of rotationTurn.
If the first rotation information and the second rotation information are inconsistent, display module 404 is according in advanceThe priority level of setting is determined revolving of high priority from the first rotation information and the second rotation informationTransfering the letter breath, and show after described picture being rotated according to the rotation information of described high priorityShow. Such as, in the time that the priority level of the first rotation information is high, display module 404 revolves according to firstGyration and the first direction of rotation are rotated rear demonstration to picture. If the second rotation information is excellentFirst rank is high, after display module 404 is rotated according to second anglec of rotation and the second direction of rotationShow.
Due to the face with respect to active, the relative position of scenery is more stable, therefore, and at onePreferred embodiment, when the first rotation information and the second rotation information are when inconsistent, show mouldPiece 404 shows after picture being rotated according to the second rotation information.
Be different from prior art, the first identification module pair of the image display apparatus in present embodimentAt least two kinds of scenery in picture to be shown are identified, and the first current orientation determination module is determinedRelative position coordinates between these at least two kinds of scenery, and determine picture according to relative position coordinatesAfter the first current direction, first anglec of rotation say the first current direction and preset reference direction carry out rightRatio, determines the first rotation information of picture; The second identification module carries out recognition of face to picture, theTwo current orientation determination modules are worked as front according to second of the Relative position determination picture of face faceTo, the second rotation information determination module is compared the second current direction and preset reference direction,Determine the second rotation information of picture, display module is in the first rotation information and the second rotation information phaseBe rotated according to the second rotation information, the first rotation information and the second rotation information are not identical simultaneouslyIn time, is rotated according to the high rotation information of priority level. Not only can make user enjoy normal aobviousThe picture showing, without manual operation, more intelligent in whole process, for user has brought convenience;And picture is only just rotated according to preset reference direction, do not change original imageResolution ratio, has also ensured the definition of original image. And, through repeatedly relatively judgement, enter oneStep has improved the precision of picture rotation information.
Consult Fig. 5, Fig. 5 is the structural representation of mobile terminal one embodiment of the present invention, this realityThe mobile terminal of executing mode comprises smart mobile phone, intelligent television, PC and smart camera etc.,Do not limit at this. Comprise processor 501 and memory 502, processor 501 and memory502 are coupled by bus 503, and this mobile terminal also comprises display 504. Wherein totalLine 503, except comprising data/address bus, can also comprise power bus, control bus and state letterNumber bus etc. But for the purpose of clearly demonstrating, in the drawings various buses are all designated as to bus 503.
Processor 501 for the picture to be shown at least two kinds of scenery identify.
Particularly, get after picture to be shown at processor 501, first to the scape in pictureThing is identified. Particularly, the aerial scenery in picture and land scenery are differentiated, wherein,Aerial scenery comprises at least one in sky, the sun, the moon and white clouds; Land scenery comprisesAt least one in plant, stationary body and building.
Processor 501 is also for the relative position coordinates between at least two kinds of scenery described in determining, andDetermine the first current direction of described picture according to described relative position coordinates.
Particularly, according to the predefined origin of coordinates and coordinate system, determine the seat of these two kinds of sceneryCursor position, in the first current direction of determining picture according to the coordinate position of these two kinds of scenery.
Processor 501 is also for carrying out the first current direction and the preset reference direction of described pictureCompare, determine the first rotation information of described picture.
Wherein, the first rotation information comprises the first direction of rotation and first anglec of rotation.
Particularly, processor 501, after the first current direction that gets picture, further obtainsThe reference direction corresponding to scenery of the identification of mobile terminal stores, as the normal sun and large set pre-If reference direction, and the first current direction and this preset reference direction are compared, determine pictureThe first rotation information.
Display 504 passes through to show after described picture is rotated according to described the first rotation informationScreen (not shown) shows.
Particularly, display 504, should after definite the first direction of rotation and first anglec of rotationPicture is rotated according to this first anglec of rotation and the first direction of rotation, and by postrotational pictureShow.
Because the size of the display screen of not all mobile terminal is all identical, in order to ensure oftenOn a mobile terminal, can show normal picture attractive in appearance, in another embodiment, showAfter device 504 is rotated according to first anglec of rotation and the first direction of rotation picture, according to currentThe size of display screen size shows after picture is adjusted again.
In another embodiment, in picture, may also comprise people, and under normal circumstances, faceThe position of face is relatively-stationary, in the time that picture comprises personage, also can be according to recognition of faceMethod is determined the current direction of picture. Processor 501 is also for carrying out recognition of face to described picture.Also for determining the relative position coordinates of face face, and according to the relative position of described face faceCoordinate is determined the second current direction of described picture.
Particularly, processor 501 in the time that the picture to be shown carries out recognition of face and defines face,Obtain the face of face as the coordinate information of eyes, nose, face and hair, and according to this fiveThe second current direction of this picture of Relative position determination of official and hair.
Processor 501 is also for by the second current direction of described picture and described preset reference directionCompare, determine the second rotation information of described picture.
Particularly, according to the second current direction of the Relative position determination picture of face and hairAfter, further obtain the relative position of normal mode human face face in mobile terminal and hairInformation is preset reference direction, and this preset reference direction and the second current direction are compared,Determine the second rotation information of this picture.
It should be noted that, the process that processor is identified in the process to recognition of face with to scenery alsoThere is not sequencing, can carry out simultaneously, can now identify face yet, also can be first to sceneryIdentify, then this does not limit.
Whether processor 501 is also for judging described the first rotation information and described the second rotation informationIdentical.
If the first rotation information is identical with the second rotation information, the judgement of two kinds of determination methods is describedCome to the same thing, after display 504 is rotated according to the first rotation information and the second rotation informationEffect is consistent, is therefore directly rotated according to the identical anglec of rotation and direction of rotation.
If the first rotation information and the second rotation information are inconsistent, display 504 is according to establishing in advanceFixed priority level is determined the rotation of high priority from the first rotation information and the second rotation informationInformation, and show after described picture being rotated according to the rotation information of described high priorityShow. Such as, in the time that the priority level of the first rotation information is high, display 504 is according to the first rotationAngle and the first direction of rotation are rotated rear demonstration to picture. If the second rotation information is preferentialRank is high, and processor shows after being rotated according to second anglec of rotation and the second direction of rotationShow.
Due to the face with respect to active, the relative position of scenery is more stable, therefore, and at onePreferred embodiment, when the first rotation information and the second rotation information are when inconsistent, display504 show after picture being rotated according to the second rotation information.
Program and the operation of described program that memory 502 moves for storing described processorThe data that produce in process. Can comprise read-only storage and random access memory, and to processingDevice 501 provides instruction and data. A part for memory 502 can also comprise non-volatile randomAccess memory (NVRAM).
Memory 502 has been stored following element, can performance element or data structure, or itSubset, or their superset:
Operational order: comprise various operational orders, for realizing various operations.
Operating system: comprise various system programs, for realizing various basic businesses and processing baseIn the task of hardware.
In embodiments of the present invention, processor 501 refers to by the operation of calling memory 502 and storingMake (this operational order can be stored in operating system), carry out aforesaid operations.
Processor 501 can also be called CPU, and (CentralProcessingUnit, central authorities process singleUnit). Memory 502 can comprise read-only storage and random access memory, and to processor701 provide instruction and data. A part for memory 502 can also comprise that non-volatile random depositsAccess to memory (NVRAM).
The method that the invention described above embodiment discloses can be applied in processor 501, or by locatingReason device 501 is realized. Processor 501 may be a kind of IC chip, has the processing of signalAbility. In implementation procedure, each step of said method can be by the hardware in processor 501Integrated logic circuit or the instruction of software form complete. Above-mentioned processor 501 can be logicalWith processor, digital signal processor (DSP), special IC (ASIC), ready-made volumeJourney gate array (FPGA) or other PLDs, discrete gate or transistor logicDevice, discrete hardware components. Can realize or carry out the disclosed each side in the embodiment of the present inventionMethod, step and logic diagram. General processor can be that microprocessor or this processor are also passableIt is processor of any routine etc. Step in conjunction with the disclosed method of the embodiment of the present invention can be straightConnect and be presented as that hardware decoding processor is complete, or with the hardware in decoding processor and softwareUnit combination is complete. Software unit can be positioned at random access memory, flash memory, read-only storage,This area maturations such as programmable read only memory or electrically erasable programmable memory, registerIn storage medium. This storage medium is positioned at memory 502, processor 501 read memories 502In information, complete the step of said method in conjunction with its hardware.
Be different from prior art, the mobile terminal in present embodiment in picture to be shown extremelyFew two kinds of scenery are identified, and determine the relative position coordinates between these at least two kinds of scenery, and rootDetermine according to relative position coordinates after the first current direction of picture, with preset reference direction carry out rightRatio, determines the first rotation information of picture; Picture is carried out to recognition of face, according to face faceThe second current direction of Relative position determination picture, compares with preset reference direction, determines figureThe second rotation information of sheet, and the first rotation information and the second rotation information when identical according to secondRotation information is rotated, when the first rotation information and the second rotation information are not identical according to priorityNot high rotation information is rotated. Not only can make user enjoy the picture of normal demonstration, wholeWithout manual operation, more intelligent in individual process, for user has brought convenience; And, pictureOnly just be rotated according to preset reference direction, do not change the resolution ratio of original image, alsoEnsure the definition of original image. And, through repeatedly relatively judgement, further improve figureThe precision of sheet rotation information.
The foregoing is only embodiments of the present invention, not thereby limit patent model of the present inventionEnclose every equivalent structure or change of equivalent flow process that utilizes description of the present invention and accompanying drawing content to doChange, or be directly or indirectly used in other relevant technical fields, be all in like manner included in of the present inventionIn scope of patent protection.

Claims (10)

1. the self-adjusting display methods of mobile terminal picture direction, is characterized in that, comprising:
Mobile terminal is identified at least two kinds of scenery in picture to be shown;
Relative position coordinates described in determining between at least two kinds of scenery, and according to described relative positionCoordinate is determined the first current direction of described picture;
The first current direction and the preset reference direction of described picture are compared, determine described figureThe first rotation information of sheet;
Described picture is rotated to rear demonstration according to described the first rotation information.
2. display methods according to claim 1, is characterized in that, described by described pictureThe step that is rotated rear demonstration according to described the first rotation information also comprises before:
Described picture is carried out to recognition of face, determine the relative position coordinates of face face, and according toThe relative position coordinates of described face face is determined the second current direction of described picture;
The second current direction of described picture and described preset reference direction are compared, determine instituteState the second rotation information of picture;
The described step showing after described picture is rotated according to described the first rotation informationSuddenly comprise:
Judge that whether described the first rotation information is identical with described the second rotation information;
If described the first rotation information is identical with described the second rotation information, according to described firstRotation information shows after described picture is rotated; If described the first rotation information and instituteState the second rotation information not identical, according to set priority from described the first rotation information and described inIn the second rotation information, determine the rotation information of high priority, and according to the rotation of described high priorityInformation shows after described picture is rotated.
3. display methods according to claim 1 and 2, is characterized in that,
The described step showing after described picture is rotated according to described the first rotation informationSuddenly comprise:
Described picture is rotated according to described the first rotation information, and according to display screen sizeSize adjustment after show.
4. display methods according to claim 2, is characterized in that, described to described pictureThe step of carrying out recognition of face comprises:
No more than two faces in described picture are identified.
5. display methods according to claim 1, is characterized in that, described to be shownThe step that at least two kinds of scenery in picture are identified comprises:
Aerial scenery in picture to be shown and land scenery are identified;
Described determine described in the step of relative position coordinates between at least two kinds of scenery comprise:
Determine the relative position coordinates between described aerial scenery and described land scenery;
Wherein, described aerial scenery comprises at least one in sky, the sun, the moon, white clouds,Described land scenery comprises at least one in plant, stationary body, building.
6. the self-adjusting mobile terminal of picture direction, is characterized in that, described device comprisesThe first identification module, first direction determination module, the first rotation information determination module and demonstrationModule,
Described the first identification module for to picture to be shown at least two kinds of scenery carry outIdentification;
Described first direction determination module is for the phase contraposition between at least two kinds of scenery described in determiningPut coordinate, and determine the first current direction of described picture according to described relative position coordinates;
Described the first rotation information determination module is used for the first current direction of described picture with pre-If reference direction is compared, determine the first rotation information of described picture;
Described display module is for after being rotated described picture according to described the first rotation informationShow.
7. mobile terminal according to claim 6, is characterized in that, described device also comprisesThe second identification module, for carrying out recognition of face to described picture;
Second direction determination module, for determining the relative position coordinates of face face, and according to instituteThe relative position coordinates of stating face face is determined the second current direction of described picture;
The second rotation information determination module, for by the second current direction of described picture and described pre-If reference direction is compared, determine the second rotation information of described picture;
Judge module, for judging whether phase of described the first rotation information and described the second rotation informationWith;
Described display module is specifically at described the first rotation information and described the second rotation informationWhen identical, after according to described the first rotation information, described picture being rotated, show; InstituteState the first rotation information when not identical with described the second rotation information, according to setting priority from describedIn the first rotation information and described the second rotation information, determine the rotation information of high priority, and according toThe rotation information of described high priority shows after described picture is rotated.
8. according to the mobile terminal described in claim 6 or 7, it is characterized in that described demonstration mouldPiece is specifically for described picture is rotated according to described the first rotation information, and according to display screenAfter the size adjustment of curtain size, show.
9. mobile terminal according to claim 7, is characterized in that, described the second identification mouldPiece is specifically for identifying no more than two faces in described picture.
10. mobile terminal according to claim 6, is characterized in that, described display module toolBody is identified for aerial scenery and land scenery to picture to be shown;
Described first direction determination module is specifically for determining described aerial scenery and described land scapeRelative position coordinates between thing;
Wherein, described aerial scenery comprises at least one in sky, the sun, the moon, white clouds,Described land scenery comprises at least one in plant, stationary body, building.
CN201510977314.1A 2015-12-21 2015-12-21 Mobile terminal with automatic picture direction adjusting function and display method thereof Pending CN105607835A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510977314.1A CN105607835A (en) 2015-12-21 2015-12-21 Mobile terminal with automatic picture direction adjusting function and display method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510977314.1A CN105607835A (en) 2015-12-21 2015-12-21 Mobile terminal with automatic picture direction adjusting function and display method thereof

Publications (1)

Publication Number Publication Date
CN105607835A true CN105607835A (en) 2016-05-25

Family

ID=55987807

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510977314.1A Pending CN105607835A (en) 2015-12-21 2015-12-21 Mobile terminal with automatic picture direction adjusting function and display method thereof

Country Status (1)

Country Link
CN (1) CN105607835A (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105975183A (en) * 2016-05-26 2016-09-28 北京小米移动软件有限公司 Screen locking picture processing method and device
CN106371730A (en) * 2016-09-08 2017-02-01 珠海市魅族科技有限公司 Mobile terminal and image rotation method
CN106648150A (en) * 2016-11-15 2017-05-10 努比亚技术有限公司 Picture adjusting device and method
CN107247936A (en) * 2017-05-31 2017-10-13 北京小米移动软件有限公司 Image-recognizing method and device
CN107509101A (en) * 2017-08-11 2017-12-22 环球智达科技(北京)有限公司 Image processing method
WO2018054375A1 (en) * 2016-09-26 2018-03-29 腾讯科技(深圳)有限公司 Live broadcast information processing method and device, and storage medium
CN108536513A (en) * 2018-03-13 2018-09-14 维沃移动通信有限公司 A kind of picture display direction method of adjustment and mobile terminal
WO2018201665A1 (en) * 2017-05-05 2018-11-08 平安科技(深圳)有限公司 Car damage image angle correction method, electronic device and readable storage medium
CN111563407A (en) * 2020-02-24 2020-08-21 北京乐学帮网络技术有限公司 Model training method, and image direction correcting method and device
CN112446829A (en) * 2020-12-11 2021-03-05 成都颜创启新信息技术有限公司 Picture direction adjusting method and device, electronic equipment and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102902947A (en) * 2011-07-27 2013-01-30 阿里巴巴集团控股有限公司 Image identification display method and device as well as user equipment
CN103176693A (en) * 2013-02-18 2013-06-26 联宝(合肥)电子科技有限公司 Method and device for changing terminal screen picture direction automatically
TWM463885U (en) * 2013-04-26 2013-10-21 Liu-Sheng Yi Photo automatic rotation device, system and storage device
US20140071308A1 (en) * 2012-09-11 2014-03-13 Apple Inc. Automatic Image Orientation and Straightening through Image Analysis
CN104137028A (en) * 2012-01-10 2014-11-05 三星电子株式会社 Device and method for controlling rotation of displayed image
CN104182114A (en) * 2013-05-22 2014-12-03 辉达公司 Method and system for adjusting image display direction of mobile equipment

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102902947A (en) * 2011-07-27 2013-01-30 阿里巴巴集团控股有限公司 Image identification display method and device as well as user equipment
CN104137028A (en) * 2012-01-10 2014-11-05 三星电子株式会社 Device and method for controlling rotation of displayed image
US20140071308A1 (en) * 2012-09-11 2014-03-13 Apple Inc. Automatic Image Orientation and Straightening through Image Analysis
CN103176693A (en) * 2013-02-18 2013-06-26 联宝(合肥)电子科技有限公司 Method and device for changing terminal screen picture direction automatically
TWM463885U (en) * 2013-04-26 2013-10-21 Liu-Sheng Yi Photo automatic rotation device, system and storage device
CN104182114A (en) * 2013-05-22 2014-12-03 辉达公司 Method and system for adjusting image display direction of mobile equipment

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105975183A (en) * 2016-05-26 2016-09-28 北京小米移动软件有限公司 Screen locking picture processing method and device
CN106371730A (en) * 2016-09-08 2017-02-01 珠海市魅族科技有限公司 Mobile terminal and image rotation method
WO2018054375A1 (en) * 2016-09-26 2018-03-29 腾讯科技(深圳)有限公司 Live broadcast information processing method and device, and storage medium
CN106648150A (en) * 2016-11-15 2017-05-10 努比亚技术有限公司 Picture adjusting device and method
WO2018201665A1 (en) * 2017-05-05 2018-11-08 平安科技(深圳)有限公司 Car damage image angle correction method, electronic device and readable storage medium
CN107247936A (en) * 2017-05-31 2017-10-13 北京小米移动软件有限公司 Image-recognizing method and device
CN107509101A (en) * 2017-08-11 2017-12-22 环球智达科技(北京)有限公司 Image processing method
CN108536513A (en) * 2018-03-13 2018-09-14 维沃移动通信有限公司 A kind of picture display direction method of adjustment and mobile terminal
CN108536513B (en) * 2018-03-13 2021-06-18 维沃移动通信有限公司 Picture display direction adjusting method and mobile terminal
CN111563407A (en) * 2020-02-24 2020-08-21 北京乐学帮网络技术有限公司 Model training method, and image direction correcting method and device
CN111563407B (en) * 2020-02-24 2024-02-02 北京乐学帮网络技术有限公司 Model training method, picture direction correcting method and device
CN112446829A (en) * 2020-12-11 2021-03-05 成都颜创启新信息技术有限公司 Picture direction adjusting method and device, electronic equipment and storage medium

Similar Documents

Publication Publication Date Title
CN105607835A (en) Mobile terminal with automatic picture direction adjusting function and display method thereof
CN108121986B (en) Object detection method and device, computer device and computer readable storage medium
US11869161B2 (en) Overlaying 3D augmented reality content on real-world objects using image segmentation
WO2021174939A1 (en) Facial image acquisition method and system
US10574881B2 (en) Smart guide to capture digital images that align with a target image model
US10171729B2 (en) Directional adjustment for a camera based on exposure quality information
CN108986016B (en) Image beautifying method and device and electronic equipment
US9947108B1 (en) Method and system for automatic detection and tracking of moving objects in panoramic video
CN110046546B (en) Adaptive sight tracking method, device and system and storage medium
CN106295533B (en) A kind of optimization method, device and the camera terminal of self-timer image
US9436999B2 (en) Automatic image orientation and straightening through image analysis
US11126882B2 (en) Method and device for license plate positioning
US10824910B2 (en) Image processing method, non-transitory computer readable storage medium and image processing system
CN109242961A (en) A kind of face modeling method, apparatus, electronic equipment and computer-readable medium
WO2017092679A1 (en) Eyeball tracking method and apparatus, and device
CN112419170B (en) Training method of shielding detection model and beautifying processing method of face image
CN109816769A (en) Scene based on depth camera ground drawing generating method, device and equipment
CN110072046B (en) Image synthesis method and device
CN110858295A (en) Traffic police gesture recognition method and device, vehicle control unit and storage medium
CN109120854B (en) Image processing method, image processing device, electronic equipment and storage medium
CN108921856B (en) Image cropping method and device, electronic equipment and computer readable storage medium
CN111433818A (en) Target scene three-dimensional reconstruction method and system and unmanned aerial vehicle
CN103795931A (en) Information processing method and electronic equipment
CN108093174A (en) Patterning process, device and the photographing device of photographing device
WO2022021029A1 (en) Detection model training method and device, detection model using method and storage medium

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20160525