CN104732218A - Image display method and device - Google Patents
Image display method and device Download PDFInfo
- Publication number
- CN104732218A CN104732218A CN201510150269.2A CN201510150269A CN104732218A CN 104732218 A CN104732218 A CN 104732218A CN 201510150269 A CN201510150269 A CN 201510150269A CN 104732218 A CN104732218 A CN 104732218A
- Authority
- CN
- China
- Prior art keywords
- image
- matched
- target photo
- facial image
- facial
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Abstract
The invention discloses an image display method. The image display method comprises the steps that a preset standard human face image is obtained; a target picture is obtained, and a display area of all human face images to be matched on the target picture is obtained; in the display area, matching degree analysis is conducted on the strand human face image and the human face images to be matched; If there is a target human face image with the matching degree with the standard human face image reaching a threshold value in the human face image, the position of the target human face image in the target picture is determined, and the position is displayed at an assigned position of the display screen according to the preset display scale. The invention further discloses an image display device. According to the image display method and device, firstly, the standard human face image and the target picture are obtained, and then the display area of all the human face images to be matched on the target picture is obtained; secondly, the standard human face image and the human face images to be matched are matched, and thus a user can accurately and quickly find the needed figure image from the picture containing many figure images.
Description
Technical field
The present invention relates to technical field of picture display, particularly relate to method and the device of image display.
Background technology
On an electronic device during browsing pictures, often can, due to the restriction of display screen physical size, user be made to be difficult to, in head portraits numerous from photo, find the target that oneself is wanted.Such as, from the group photo of the hundreds of people be presented at mobile phone screen, will find the position of a certain friend, that is a very troublesome engineering.
Summary of the invention
Fundamental purpose of the present invention is the method proposing the display of a kind of image, and being intended to solve needs to amplify the problem of searching image difficulty on a small screen.
For achieving the above object, the method for a kind of image display provided by the invention, the method for described image display comprises step:
Obtain the standard faces image preset;
Obtain Target Photo, and obtain the viewing area of all facial images to be matched on Target Photo;
In described viewing area, described standard faces image and described facial image to be matched are carried out matching degree analysis;
If have target facial image and standard faces images match degree to reach threshold value in described Target Photo, then determine the described position of target facial image in Target Photo, according to the displaying ratio preset, by described position display to the assigned address of display screen.
Preferably, on described acquisition Target Photo, the step of the viewing area of all facial images to be matched specifically comprises:
Receive the described Target Photo that user uploads;
Resolve described Target Photo, obtain the viewing area of all facial images to be matched on described Target Photo;
According to the described viewing area of all described facial images to be matched, generate the position table recording all described facial image positions to be matched; Described according to viewing area, the step of mating described standard faces image and described facial image to be matched specifically comprises:
Show according to described position, described standard faces image is mated with all described facial images to be matched one by one.
Preferably, determine the position of target facial image in Target Photo, according to the displaying ratio preset, described position is shown described Target Photo as screen center.
Preferably, the step of described acquisition standard faces image specifically comprises:
Receive the described standard faces image that user uploads; Or
Receive the shooting instruction of user, take corresponding face.
In addition, for achieving the above object, the present invention also proposes the device of a kind of image display, and the device of described image display comprises:
Acquisition module, for obtaining default standard faces image;
Locating module, for obtaining Target Photo, and obtains the viewing area of all facial images to be matched on Target Photo;
Matching module, in described viewing area, carries out matching degree analysis by described standard faces image and described facial image to be matched;
Display module, if reach threshold value for having target facial image and standard faces images match degree in described Target Photo, then determine the described position of target facial image in Target Photo, according to the displaying ratio preset, by described position display to the assigned address of display screen.
Preferably, described locating module comprises:
Receiving element, for receiving the described Target Photo that user uploads;
Resolution unit, for resolving described Target Photo, obtains the described viewing area of all facial images to be matched on described Target Photo;
Generation unit, for the described viewing area according to all described facial images to be matched, generates the position table recording all described facial image positions to be matched; Described standard faces image, specifically for showing according to described position, mates with all described facial images to be matched by described matching module one by one.
Preferably, determine the position of target facial image in Target Photo, according to the displaying ratio preset, described position is shown described Target Photo as screen center.
Preferably, described acquisition module comprises:
Receiving element, for receiving the described standard faces image that user uploads; Or
Shooting unit, for receiving the shooting instruction of user, takes corresponding face.
The present invention by first obtaining standard faces image and Target Photo, then obtains the viewing area of all facial images to be matched on Target Photo; Again according to viewing area, match-on criterion facial image and facial image to be matched; When the match is successful for standard faces image and facial image to be matched, displaying ratio according to presetting shows the facial image to be matched that the match is successful, be conducive to the character image that user searches needs accurately and fast from the picture comprising numerous character image, thus be conducive to the experience improving user.
Accompanying drawing explanation
Fig. 1 is the hardware configuration signal of the mobile terminal realizing each embodiment of the present invention;
Fig. 2 is the wireless communication system schematic diagram of mobile terminal as shown in Figure 1;
Fig. 3 is the schematic flow sheet of method first embodiment of image of the present invention display;
Fig. 4 is the schematic flow sheet of method second embodiment of image of the present invention display;
Fig. 5 is the high-level schematic functional block diagram of device first embodiment of image of the present invention display;
Fig. 6 is the high-level schematic functional block diagram of device second embodiment of image of the present invention display.
The realization of the object of the invention, functional characteristics and advantage will in conjunction with the embodiments, are described further with reference to accompanying drawing.
Embodiment
Should be appreciated that specific embodiment described herein only in order to explain the present invention, be not intended to limit the present invention.
The mobile terminal realizing each embodiment of the present invention is described referring now to accompanying drawing.In follow-up description, use the suffix of such as " module ", " parts " or " unit " for representing element only in order to be conducive to explanation of the present invention, itself is specific meaning not.Therefore, " module " and " parts " can mixedly use.
Mobile terminal can be implemented in a variety of manners.Such as, the terminal described in the present invention can comprise the such as mobile terminal of mobile phone, smart phone, notebook computer, digit broadcasting receiver, PDA (personal digital assistant), PAD (panel computer), PMP (portable media player), guider etc. and the fixed terminal of such as digital TV, desk-top computer etc.Below, suppose that terminal is mobile terminal.But it will be appreciated by those skilled in the art that except the element except being used in particular for mobile object, structure according to the embodiment of the present invention also can be applied to the terminal of fixed type.
Fig. 1 is the hardware configuration signal of the mobile terminal realizing each embodiment of the present invention.
Mobile terminal 100 can comprise wireless communication unit 110, A/V (audio/video) input block 120, user input unit 130, sensing cell 140, output unit 150, storer 160, interface unit 170, controller 180 and power supply unit 190 etc.Fig. 1 shows the mobile terminal with various assembly, it should be understood that, does not require to implement all assemblies illustrated.Can alternatively implement more or less assembly.Will be discussed in more detail below the element of mobile terminal.
Wireless communication unit 110 generally includes one or more assembly, and it allows the wireless communication between mobile terminal 100 and wireless communication system or network.Such as, wireless communication unit can comprise at least one in broadcast reception module 111, mobile communication module 112, wireless Internet module 113, short range communication module 114 and positional information module 115.
Broadcast reception module 111 via broadcast channel from external broadcasting management server receiving broadcast signal and/or broadcast related information.Broadcast channel can comprise satellite channel and/or terrestrial channel.Broadcast management server can be generate and send the server of broadcast singal and/or broadcast related information or the broadcast singal generated before receiving and/or broadcast related information and send it to the server of terminal.Broadcast singal can comprise TV broadcast singal, radio signals, data broadcasting signal etc.And broadcast singal may further include the broadcast singal combined with TV or radio signals.Broadcast related information also can provide via mobile communications network, and in this case, broadcast related information can be received by mobile communication module 112.Broadcast singal can exist in a variety of manners, such as, it can exist with the form of the electronic service guidebooks (ESG) of the electronic program guides of DMB (DMB) (EPG), digital video broadcast-handheld (DVB-H) etc.Broadcast reception module 111 can by using the broadcast of various types of broadcast system Received signal strength.Especially, broadcast reception module 111 can by using such as multimedia broadcasting-ground (DMB-T), DMB-satellite (DMB-S), digital video broadcasting-hand-held (DVB-H), forward link media (MediaFLO
@) Radio Data System, received terrestrial digital broadcasting integrated service (ISDB-T) etc. digit broadcasting system receive digital broadcasting.Broadcast reception module 111 can be constructed to be applicable to providing the various broadcast system of broadcast singal and above-mentioned digit broadcasting system.The broadcast singal received via broadcast reception module 111 and/or broadcast related information can be stored in storer 160 (or storage medium of other type).
Radio signal is sent at least one in base station (such as, access point, Node B etc.), exterior terminal and server and/or receives radio signals from it by mobile communication module 112.Various types of data that such radio signal can comprise voice call signal, video calling signal or send according to text and/or Multimedia Message and/or receive.
Wireless Internet module 113 supports the Wi-Fi (Wireless Internet Access) of mobile terminal.This module can be inner or be externally couple to terminal.Wi-Fi (Wireless Internet Access) technology involved by this module can comprise WLAN (WLAN) (Wi-Fi), Wibro (WiMAX), Wimax (worldwide interoperability for microwave access), HSDPA (high-speed downlink packet access) etc.
Short range communication module 114 is the modules for supporting junction service.Some examples of short-range communication technology comprise bluetooth
tM, radio-frequency (RF) identification (RFID), Infrared Data Association (I rDA), ultra broadband (UWB), purple honeybee
tMetc..
Positional information module 115 is the modules of positional information for checking or obtain mobile terminal.The typical case of positional information module is GPS (GPS).According to current technology, GPS module 115 calculates from the range information of three or more satellite and correct time information and for the Information application triangulation calculated, thus calculates three-dimensional current location information according to longitude, latitude and pin-point accuracy.Current, the method for calculating position and temporal information uses three satellites and by using the error of the position that goes out of an other satellite correction calculation and temporal information.In addition, GPS module 115 can carry out computing velocity information by Continuous plus current location information in real time.
A/V input block 120 is for audio reception or vision signal.A/V input block 120 can comprise camera 121 and microphone 1220, and the view data of camera 121 to the static images obtained by image capture apparatus in Video Capture pattern or image capture mode or video processes.Picture frame after process may be displayed on display unit 151.Picture frame after camera 121 processes can be stored in storer 160 (or other storage medium) or via wireless communication unit 110 and send, and can provide two or more cameras 1210 according to the structure of mobile terminal.Such acoustic processing can via microphones sound (voice data) in telephone calling model, logging mode, speech recognition mode etc. operational mode, and can be voice data by microphone 122.Audio frequency (voice) data after process can be converted to the formatted output that can be sent to mobile communication base station via mobile communication module 112 when telephone calling model.Microphone 122 can be implemented various types of noise and eliminate (or suppress) algorithm and receiving and sending to eliminate (or suppression) noise or interference that produce in the process of sound signal.
User input unit 130 can generate key input data to control the various operations of mobile terminal according to the order of user's input.User input unit 130 allows user to input various types of information, and keyboard, the young sheet of pot, touch pad (such as, detecting the touch-sensitive assembly of the change of the resistance, pressure, electric capacity etc. that cause owing to being touched), roller, rocking bar etc. can be comprised.Especially, when touch pad is superimposed upon on display unit 151 as a layer, touch-screen can be formed.
Sensing cell 140 detects the current state of mobile terminal 100, (such as, mobile terminal 100 open or close state), the position of mobile terminal 100, user for mobile terminal 100 contact (namely, touch input) presence or absence, the orientation of mobile terminal 100, the acceleration or deceleration of mobile terminal 100 move and direction etc., and generate order or the signal of the operation for controlling mobile terminal 100.Such as, when mobile terminal 100 is embodied as sliding-type mobile phone, sensing cell 140 can sense this sliding-type phone and open or close.In addition, whether whether sensing cell 140 can detect power supply unit 190 provides electric power or interface unit 170 to couple with external device (ED).Sensing cell 140 can comprise proximity transducer 1410 and will be described this in conjunction with touch-screen below.
Interface unit 170 is used as at least one external device (ED) and is connected the interface that can pass through with mobile terminal 100.Such as, external device (ED) can comprise wired or wireless head-band earphone port, external power source (or battery charger) port, wired or wireless FPDP, memory card port, for connecting the port, audio frequency I/O (I/O) port, video i/o port, ear port etc. of the device with identification module.Identification module can be that storage uses the various information of mobile terminal 100 for authentication of users and can comprise subscriber identification module (UIM), client identification module (SIM), Universal Subscriber identification module (USIM) etc.In addition, the device (hereinafter referred to " recognition device ") with identification module can take the form of smart card, and therefore, recognition device can be connected with mobile terminal 100 via port or other coupling arrangement.Interface unit 170 may be used for receive from external device (ED) input (such as, data message, electric power etc.) and the input received be transferred to the one or more element in mobile terminal 100 or may be used for transmitting data between mobile terminal and external device (ED).
In addition, when mobile terminal 100 is connected with external base, interface unit 170 can be used as to allow by it electric power to be provided to the path of mobile terminal 100 from base or can be used as the path that allows to be transferred to mobile terminal by it from the various command signals of base input.The various command signal inputted from base or electric power can be used as and identify whether mobile terminal is arranged on the signal base exactly.Output unit 150 is constructed to provide output signal (such as, sound signal, vision signal, alarm signal, vibration signal etc.) with vision, audio frequency and/or tactile manner.Output unit 150 can comprise display unit 151, dio Output Modules 152, alarm unit 153 etc.
Display unit 151 may be displayed on the information of process in mobile terminal 100.Such as, when mobile terminal 100 is in telephone calling model, display unit 151 can show with call or other communicate (such as, text messaging, multimedia file are downloaded etc.) be correlated with user interface (U I) or graphic user interface (GU I).When mobile terminal 100 is in video calling pattern or image capture mode, display unit 151 can the image of display capture and/or the image of reception, UI or GUI that video or image and correlation function are shown etc.
Meanwhile, when display unit 151 and touch pad as a layer superposed on one another to form touch-screen time, display unit 151 can be used as input media and output unit.Display unit 151 can comprise at least one in liquid crystal display (LCD), thin film transistor (TFT) LCD (TFT-LCD), Organic Light Emitting Diode (OLED) display, flexible display, three-dimensional (3D) display etc.Some in these displays can be constructed to transparence and watch from outside to allow user, and this can be called transparent display, and typical transparent display can be such as TOLED (transparent organic light emitting diode) display etc.According to the specific embodiment wanted, mobile terminal 100 can comprise two or more display units (or other display device), such as, mobile terminal can comprise outernal display unit (not shown) and inner display unit (not shown).Touch-screen can be used for detecting touch input pressure and touch input position and touch and inputs area.
When dio Output Modules 152 can be under the isotypes such as call signal receiving mode, call mode, logging mode, speech recognition mode, broadcast reception mode at mobile terminal, voice data convert audio signals that is that wireless communication unit 110 is received or that store in storer 160 and exporting as sound.And dio Output Modules 152 can provide the audio frequency relevant to the specific function that mobile terminal 100 performs to export (such as, call signal receives sound, message sink sound etc.).Dio Output Modules 152 can comprise loudspeaker, hummer etc.
Alarm unit 153 can provide and export that event informed to mobile terminal 100.Typical event can comprise calling reception, message sink, key signals input, touch input etc.Except audio or video exports, alarm unit 153 can provide in a different manner and export with the generation of notification event.Such as, alarm unit 153 can provide output with the form of vibration, when receive calling, message or some other enter communication (incoming communication) time, alarm unit 153 can provide sense of touch to export (that is, vibrating) to notify to user.By providing such sense of touch to export, even if when the mobile phone of user is in the pocket of user, user also can identify the generation of various event.Alarm unit 153 also can provide the output of the generation of notification event via display unit 151 or dio Output Modules 152.
Storer 160 software program that can store process and the control operation performed by controller 180 etc., or temporarily can store oneself through exporting the data (such as, telephone directory, message, still image, video etc.) that maybe will export.And, storer 160 can store about when touch be applied to touch-screen time the vibration of various modes that exports and the data of sound signal.
Storer 160 can comprise the storage medium of at least one type, described storage medium comprises flash memory, hard disk, multimedia card, card-type storer (such as, SD or DX storer etc.), random access storage device (RAM), static random-access memory (SRAM), ROM (read-only memory) (ROM), Electrically Erasable Read Only Memory (EEPROM), programmable read only memory (PROM), magnetic storage, disk, CD etc.And mobile terminal 100 can be connected the memory function of execute store 160 network storage device with by network cooperates.
Controller 180 controls the overall operation of mobile terminal usually.Such as, controller 180 performs the control relevant to voice call, data communication, video calling etc. and process.In addition, controller 180 can comprise the multi-media module 1810 for reproducing (or playback) multi-medium data, and multi-media module 1810 can be configured in controller 180, or can be configured to be separated with controller 180.Controller 180 can pattern recognition process, is identified as character or image so that input is drawn in the handwriting input performed on the touchscreen or picture.
Power supply unit 190 receives external power or internal power and provides each element of operation and the suitable electric power needed for assembly under the control of controller 180.
Various embodiment described herein can to use such as computer software, the computer-readable medium of hardware or its any combination implements.For hardware implementation, embodiment described herein can by using application-specific IC (ASIC), digital signal processor (DSP), digital signal processing device (DSPD), programmable logic device (PLD), field programmable gate array (FPGA), processor, controller, microcontroller, microprocessor, being designed at least one performed in the electronic unit of function described herein and implementing, in some cases, such embodiment can be implemented in controller 180.For implement software, the embodiment of such as process or function can be implemented with allowing the independent software module performing at least one function or operation.Software code can be implemented by the software application (or program) write with any suitable programming language, and software code can be stored in storer 160 and to be performed by controller 180.
So far, oneself is through the mobile terminal according to its functional description.Below, for the sake of brevity, by the slide type mobile terminal that describes in various types of mobile terminals of such as folded form, board-type, oscillating-type, slide type mobile terminal etc. exemplarily.Therefore, the present invention can be applied to the mobile terminal of any type, and is not limited to slide type mobile terminal.
Mobile terminal 100 as shown in Figure 1 can be constructed to utilize and send the such as wired and wireless communication system of data via frame or grouping and satellite-based communication system operates.
Describe wherein according to the communication system that mobile terminal of the present invention can operate referring now to Fig. 2.
Such communication system can use different air interfaces and/or Physical layer.Such as, the air interface used by communication system comprises such as frequency division multiple access (FDMA), time division multiple access (TDMA) (TDMA), CDMA (CDMA) and universal mobile telecommunications system (UMTS) (especially, Long Term Evolution (LTE)), global system for mobile communications (GSM) etc.As non-limiting example, description below relates to cdma communication system, but such instruction is equally applicable to the system of other type.
With reference to figure 2, cdma wireless communication system can comprise multiple mobile terminal 100, multiple base station (BS) 270, base station controller (BSC) 275 and mobile switching centre (MSC) 2800MSC 280 and be constructed to form interface with Public Switched Telephony Network (PSTN) 290.MSC 280 is also constructed to form interface with the BSC 275 that can be couple to base station 270 via back haul link.Back haul link can construct according to any one in some interfaces that oneself knows, described interface comprises such as E 1/T1, ATM, IP, PPP, frame relay, HDSL, ADSL or xDSL.Will be appreciated that system as shown in Figure 2 can comprise multiple BSC2750.
Each BS 270 can serve one or more subregion (or region), by multidirectional antenna or point to specific direction each subregion of antenna cover radially away from BS 270.Or each subregion can by two or more antenna covers for diversity reception.Each BS 270 can be constructed to support multiple parallel compensate, and each parallel compensate has specific frequency spectrum (such as, 1.25MHz, 5MHz etc.).
Subregion can be called as CDMA Channel with intersecting of parallel compensate.BS 270 also can be called as base station transceiver subsystem (BTS) or other equivalent terms.Under these circumstances, term " base station " may be used for broadly representing single BSC 275 and at least one BS 270.Base station also can be called as " cellular station ".Or each subregion of particular B S270 can be called as multiple cellular station.
As shown in Figure 2, broadcast singal is sent to the mobile terminal 100 at operate within systems by broadcsting transmitter (BT) 295.Broadcast reception module 111 as shown in Figure 1 is arranged on mobile terminal 100 and sentences the broadcast singal receiving and sent by BT 295.In fig. 2, several GPS (GPS) satellite 300 is shown.Satellite 300 helps at least one in the multiple mobile terminal 100 in location.
In fig. 2, depict multiple satellite 300, but understand, the satellite of any number can be utilized to obtain useful locating information.GPS module 115 as shown in Figure 1 is constructed to coordinate to obtain the locating information wanted with satellite 300 usually.Substitute GPS tracking technique or outside GPS tracking technique, can use can other technology of position of tracking mobile terminal.In addition, at least one gps satellite 300 optionally or extraly can process satellite dmb transmission.
As a typical operation of wireless communication system, BS 270 receives the reverse link signal from various mobile terminal 100.Mobile terminal 100 participates in call usually, information receiving and transmitting communicates with other type.Each reverse link signal that certain base station 270 receives is processed by particular B S 270.The data obtained are forwarded to relevant BSC 275.BSC provides call Resourse Distribute and comprises the mobile management function of coordination of the soft switching process between BS 270.The data received also are routed to MSC280 by BSC 275, and it is provided for the extra route service forming interface with PSTN 290.Similarly, PSTN290 and MSC 280 forms interface, and MSC and BSC 275 forms interface, and BSC 275 correspondingly control BS270 so that forward link signals is sent to mobile terminal 100.
Based on above-mentioned mobile terminal hardware configuration and communication system, each embodiment of method of image of the present invention display is proposed.
As shown in Figure 3, Fig. 3 is the schematic flow sheet of method first embodiment of image of the present invention display, and first embodiment of the invention proposes the method for a kind of image display, and the method for this image display comprises:
S10: obtain standard faces image;
User is browsing pictures on mobile terminals, and when browsing to one and comprising the group photo photo of hundreds of people, user wants to find the position of certain friend in photo, opens by gesture or voice the device browsing photo arranged on mobile terminals.
First mobile terminal needs to obtain the head portrait of people of user for searching, i.e. standard faces image.And the mode of acquisition for mobile terminal standard faces image has a lot, can by accepting the standard faces image that user uploads in real time; Also by the selection instruction according to user, by path query etc., standard faces image can be obtained from the local picture library of user; If the friend of user is on the scene, mobile terminal can also obtain standard faces image by the photo mode of shooting.Certainly, in the process of acquisition for mobile terminal standard faces image, the rise time of the standard faces image of acquisition for mobile terminal, should be as far as possible close with the rise time of the picture browsed.In the present embodiment, uploaded by user or the mode of shooting, standard faces image can be obtained accurately and fast, be conducive to user and search image with standard faces images match in Target Photo fast and accurately.
S20: obtain Target Photo, and obtain the viewing area of all facial images to be matched on Target Photo;
After acquisition standard faces image, mobile terminal also needs to determine the picture of user for searching, namely user prepares the position of searching friend place in which pictures, user determine that the picture searched is Target Photo, the Target Photo in the present embodiment is for the group photo of the hundreds of people mentioned above.After acquisition for mobile terminal to Target Photo, by image recognition technology, identify all people's face image in Target Photo, and determine the viewing area of often opening facial image, namely under current state, each facial image relative position on a display screen.Wherein, in order to distinguish the difference between facial image and facial image, the facial image in Target Photo is called facial image to be matched.In the present embodiment, by determining the position of often opening facial image to be matched in Target Photo, be matching process hereinafter, necessary condition is provided.
S30: according to viewing area, match-on criterion facial image and facial image to be matched, namely in viewing area, carry out matching degree analysis by standard faces image and facial image to be matched;
According to the viewing area of the facial image to be matched above obtained, standard faces image mates one by one with the facial image to be matched in Target Photo.The mode of coupling has a lot, in the present embodiment, realizes the two coupling by scanning standard facial image and facial image to be matched.In the present embodiment, by first determining the position of image to be matched, then match-on criterion facial image and facial image to be matched, make in the matching process of standard faces image and facial image to be matched, mobile terminal can find each region belonging to facial image to be matched accurately, avoid the whole screen of mobile terminal and go scanning, be conducive to the matching efficiency improving standard faces image and facial image to be matched.
S40: if the match is successful for standard faces image and facial image to be matched, then show according to the displaying ratio preset the facial image to be matched that the match is successful, target facial image and standard faces images match degree is even had to reach threshold value in Target Photo, then determine the position of target facial image in Target Photo, according to the displaying ratio preset, by position display to the assigned address of display screen;
When the match is successful for standard faces image and facial image to be matched, the facial image to be matched that the match is successful is amplified by the displaying ratio preset, and the facial image to be matched after amplifying is done process placed in the middle.Wherein, the approach showing the facial image to be matched that the match is successful according to the displaying ratio preset has multiple, can be all amplified by the Target Photo of whole, then facial image to be matched is presented at the central authorities of display screen; Also only can amplify the facial image to be matched that the match is successful, or amplify the Target Photo in the facial image to be matched that the match is successful and periphery preset range, then coupling facial image is presented at the central authorities of display screen.
In the present embodiment, by first obtaining standard faces image and Target Photo, then obtain the viewing area of all facial images to be matched on Target Photo; Again according to viewing area, match-on criterion facial image and facial image to be matched; When the match is successful for standard faces image and facial image to be matched, displaying ratio according to presetting shows the facial image to be matched that the match is successful, be conducive to the character image that user searches needs accurately and fast from the picture comprising numerous character image, thus be conducive to the experience improving user.
As shown in Figure 4, Fig. 4 is the schematic flow sheet of method second embodiment of image of the present invention display, and on the basis of above-described embodiment, step S20 specifically comprises:
S21: receive the Target Photo that user uploads;
First mobile terminal receives the Target Photo that user uploads, and the mode that user uploads Target Photo has multiple, can according to prompting from local picture library invocation target picture, also can from network high in the clouds invocation target picture.If when having number of ways to obtain Target Photo, with the sharpness of Target Photo to be obtained for paying the utmost attention to factor.
S22: resolve Target Photo, obtains the viewing area of all facial images to be matched on Target Photo;
After the Target Photo that acquisition user uploads, analyze the Target Photo obtained, facial images to be matched all on Target Photo is identified, and records current facial image to be matched viewing area on a display screen, and the relative position relation between each facial image to be matched.In the present embodiment, by obtaining the viewing area of facial image to be matched on Target Photo, making standard faces image when mating, facial image to be matched can be found accurately, thus be conducive to improving standard faces image and the direct matching efficiency of facial image to be matched.
S23: according to the viewing area of all facial images to be matched, generates the position table recording all facial image positions to be matched.
According to the relative position relation between the viewing area of facial image to be matched of record and facial image to be matched, generate the position table of the relative position relation recorded between all facial image positions to be matched and facial image to be matched.In the present embodiment, by generating position table, standard faces image can be realized according to position table in the process of coupling, be conducive to standard faces image and mate with each facial image to be matched successively fast.
On the basis of above-described embodiment, step S30 specifically comprises:
In the matching process, first show according to position, calculate the area of each screen shared by facial image to be matched, and generate the minimum rectangle frame surrounding facial image to be matched, namely for each Face image synthesis to be matched rectangle frame, the length of rectangle frame is equal with the maximum length of facial image to be matched, and the width of rectangle frame is equal with the breadth extreme of facial image to be matched, makes facial image to be matched just be positioned at rectangle frame; Show according to position again, standard faces image is made to mate facial image to be matched in each rectangle frame one by one, namely to fall into a trap the position relationship between the position of each facial image to be matched of record and facial image to be matched according to position table again, calculate the matching order that matching efficiency is the highest, again according to matching order, standard faces image is mated with the facial image to be matched in each rectangle frame.In the present embodiment, still mate in the mode of scanning, in the process of scanning, because the rectangle frame surrounding facial image to be matched minimizes, thus make in scanning process, need pixel quantity to be processed to minimize.
In the present embodiment, by generating the minimum rectangle frame surrounding facial image to be matched, reduce in matching process the area needing Target Photo to be processed, thus reduce the quantity thinking pixel to be processed, be conducive to the matching efficiency improving standard faces image and facial image to be matched.
On the basis of above-described embodiment, step S40 specifically comprises:
In the process that standard faces image and facial image to be matched mate one by one, when the match is successful for standard faces image and a certain facial image to be matched, according to the displaying ratio preset, show facial image to be matched to assigned address.Above-mentioned default displaying ratio is: the area surrounding the rectangle frame of the facial image to be matched that the match is successful, with the ratio of the area of whole display screen, such as displaying ratio is 1:3.The calculating of this ratio needs physical length size and the width dimensions of considering display screen, namely when receiving the displaying ratio of user preset, need the size according to display screen and displaying ratio, calculate length dimension and the width dimensions of the rectangle frame surrounding the facial image to be matched that the match is successful.After calculating the area size showing the facial image to be matched that the match is successful, then according to the instruction of user, viewing area is arranged on the predeterminated position of display screen.When the match is successful for standard faces image and a certain facial image to be matched, the rectangle frame surrounding facial image to be matched is amplified, and this rectangle frame mobile is to overlapping with viewing area.In the present embodiment, the facial image to be matched that the match is successful is shown between two parties.In the present embodiment, by by the facial image to be matched that the match is successful according to the displaying ratio preset, show to assigned address, be conducive to user and find timely and observe this facial image to be matched.When user find mate incorrect time, can continue coupling.
The present invention further provides the device of a kind of image display.
It is the high-level schematic functional block diagram of device first embodiment of image of the present invention display with reference to Fig. 5, Fig. 5;
The device of the image display of the present embodiment comprises:
Acquisition module 10, for obtaining standard faces image;
User is browsing pictures on mobile terminals, and when browsing to one and comprising the group photo photo of hundreds of people, user wants to find the position of certain friend in photo, opens by gesture or voice the device browsing photo arranged on mobile terminals.
Acquisition module comprises: receiving element, for receiving the standard faces image that user uploads; Or shooting unit, for the shooting instruction according to user, the face that shooting user specifies.
First mobile terminal needs to obtain the head portrait of people of user for searching, i.e. standard faces image.And the mode of acquisition for mobile terminal standard faces image has a lot, can by accepting the standard faces image that user uploads in real time; Also by the selection instruction according to user, by path query etc., standard faces image can be obtained from the local picture library of user; If the friend of user is on the scene, mobile terminal can also obtain standard faces image by the photo mode of shooting.Certainly, in the process of acquisition for mobile terminal standard faces image, the rise time of the standard faces image of acquisition for mobile terminal, should be as far as possible close with the rise time of the picture browsed.In the present embodiment, uploaded by user or the mode of shooting, standard faces image can be obtained accurately and fast, be conducive to user and search image with standard faces images match in Target Photo fast and accurately.
Locating module 20, for obtaining Target Photo, and obtains the viewing area of all facial images to be matched on Target Photo;
After acquisition standard faces image, mobile terminal also needs to determine the picture of user for searching, namely user prepares the position of searching friend place in which pictures, user determine that the picture searched is Target Photo, the Target Photo in the present embodiment is for the group photo of the hundreds of people mentioned above.After acquisition for mobile terminal to Target Photo, by image recognition technology, identify all people's face image in Target Photo, and determine the viewing area of often opening facial image, namely under current state, each facial image relative position on a display screen.Wherein, in order to distinguish the difference between facial image and facial image, the facial image in Target Photo is called facial image to be matched.In the present embodiment, by determining the position of often opening facial image to be matched in Target Photo, be matching process hereinafter, necessary condition is provided.
Matching module 30, for according to viewing area, match-on criterion facial image and facial image to be matched, namely in viewing area, carry out matching degree analysis by standard faces image and facial image to be matched;
According to the viewing area of the facial image to be matched above obtained, standard faces image mates one by one with the facial image to be matched in Target Photo.The mode of coupling has a lot, in the present embodiment, realizes the two coupling by scanning standard facial image and facial image to be matched.In the present embodiment, by first determining the position of image to be matched, then match-on criterion facial image and facial image to be matched, make in the matching process of standard faces image and facial image to be matched, mobile terminal can find each region belonging to facial image to be matched accurately, avoid the whole screen of mobile terminal and go scanning, be conducive to the matching efficiency improving standard faces image and facial image to be matched.
Display module 40, if for standard faces image and facial image to be matched, the match is successful, then show facial image to be matched according to the displaying ratio preset, target facial image and standard faces images match degree is even had to reach threshold value in Target Photo, then determine the position of target facial image in Target Photo, according to the displaying ratio preset, by position display to the assigned address of display screen.
When the match is successful for standard faces image and facial image to be matched, the facial image to be matched that the match is successful is amplified by the displaying ratio preset, and the facial image to be matched after amplifying is done process placed in the middle.Wherein, the approach showing the facial image to be matched that the match is successful according to the displaying ratio preset has multiple, can be all amplified by the Target Photo of whole, then facial image to be matched is presented at the central authorities of display screen; Also only can amplify the facial image to be matched that the match is successful, or amplify the Target Photo in the facial image to be matched that the match is successful and periphery preset range, then coupling facial image is presented at the central authorities of display screen.
In the present embodiment, by first obtaining standard faces image and Target Photo, then obtain the viewing area of all facial images to be matched on Target Photo; Again according to viewing area, match-on criterion facial image and facial image to be matched; When the match is successful for standard faces image and facial image to be matched, displaying ratio according to presetting shows the facial image to be matched that the match is successful, be conducive to the character image that user searches needs accurately and fast from the picture comprising numerous character image, thus be conducive to the experience improving user.
Be the high-level schematic functional block diagram of device second embodiment of image of the present invention display with reference to Fig. 6, Fig. 6, on the basis of above-described embodiment, locating module 20 comprises:
Receiving element 21, for receiving the Target Photo that user uploads;
First mobile terminal receives the Target Photo that user uploads, and the mode that user uploads Target Photo has multiple, can according to prompting from local picture library invocation target picture, also can from network high in the clouds invocation target picture.If when having number of ways to obtain Target Photo, with the sharpness of Target Photo to be obtained for paying the utmost attention to factor.
Resolution unit 22, for resolving Target Photo, obtains the viewing area of all facial images to be matched on Target Photo;
After the Target Photo that acquisition user uploads, analyze the Target Photo obtained, facial images to be matched all on Target Photo is identified, and records current facial image to be matched viewing area on a display screen, and the relative position relation between each facial image to be matched.In the present embodiment, by obtaining the viewing area of facial image to be matched on Target Photo, making standard faces image when mating, facial image to be matched can be found accurately, thus be conducive to improving standard faces image and the direct matching efficiency of facial image to be matched.
Generation unit 23, for the viewing area according to all facial images to be matched, generates the position table recording all facial image positions to be matched.
According to the relative position relation between the viewing area of facial image to be matched of record and facial image to be matched, generate the position table of the relative position relation recorded between all facial image positions to be matched and facial image to be matched.In the present embodiment, by generating position table, standard faces image can be realized according to position table in the process of coupling, be conducive to standard faces image and mate with each facial image to be matched successively fast.
On the basis of above-described embodiment, matching module 30 specifically for:
According to position table, standard faces image mates all facial images to be matched one by one.In the matching process, first show according to position, calculate the area of each screen shared by facial image to be matched, and generate the minimum rectangle frame surrounding facial image to be matched, namely for each Face image synthesis to be matched rectangle frame, the length of rectangle frame is equal with the maximum length of facial image to be matched, and the width of rectangle frame is equal with the breadth extreme of facial image to be matched, makes facial image to be matched just be positioned at rectangle frame; Show according to position again, standard faces image is made to mate facial image to be matched in each rectangle frame one by one, namely to fall into a trap the position relationship between the position of each facial image to be matched of record and facial image to be matched according to position table again, calculate the matching order that matching efficiency is the highest, again according to matching order, standard faces image is mated with the facial image to be matched in each rectangle frame.In the present embodiment, still mate in the mode of scanning, in the process of scanning, because the rectangle frame surrounding facial image to be matched minimizes, thus make in scanning process, need pixel quantity to be processed to minimize.
In the present embodiment, by generating the minimum rectangle frame surrounding facial image to be matched, reduce in matching process the area needing Target Photo to be processed, thus reduce the quantity thinking pixel to be processed, be conducive to the matching efficiency improving standard faces image and facial image to be matched.
On the basis of above-described embodiment, display module 40 specifically for:
According to the displaying ratio preset, show facial image to be matched to assigned address.In the process that standard faces image and facial image to be matched mate one by one, when the match is successful for standard faces image and a certain facial image to be matched, according to the displaying ratio preset, show facial image to be matched to assigned address.Above-mentioned default displaying ratio is: the area surrounding the rectangle frame of the facial image to be matched that the match is successful, with the ratio of the area of whole display screen, such as displaying ratio is 1:3.The calculating of this ratio needs physical length size and the width dimensions of considering display screen, namely when receiving the displaying ratio of user preset, need the size according to display screen and displaying ratio, calculate length dimension and the width dimensions of the rectangle frame surrounding the facial image to be matched that the match is successful.After calculating the area size showing the facial image to be matched that the match is successful, then according to the instruction of user, viewing area is arranged on the predeterminated position of display screen.When the match is successful for standard faces image and a certain facial image to be matched, the rectangle frame surrounding facial image to be matched is amplified, and this rectangle frame mobile is to overlapping with viewing area.In the present embodiment, the facial image to be matched that the match is successful is shown between two parties.In the present embodiment, by by the facial image to be matched that the match is successful according to the displaying ratio preset, show to assigned address, be conducive to user and find timely and observe this facial image to be matched.When user find mate incorrect time, can continue coupling.
It should be noted that, in this article, term " comprises ", " comprising " or its any other variant are intended to contain comprising of nonexcludability, thus make to comprise the process of a series of key element, method, article or device and not only comprise those key elements, but also comprise other key elements clearly do not listed, or also comprise by the intrinsic key element of this process, method, article or device.When not more restrictions, the key element limited by statement " comprising ... ", and be not precluded within process, method, article or the device comprising this key element and also there is other identical element.
The invention described above embodiment sequence number, just to describing, does not represent the quality of embodiment.
Through the above description of the embodiments, those skilled in the art can be well understood to the mode that above-described embodiment method can add required general hardware platform by software and realize, hardware can certainly be passed through, but in a lot of situation, the former is better embodiment.Based on such understanding, technical scheme of the present invention can embody with the form of software product the part that prior art contributes in essence in other words, this computer software product is stored in a storage medium (as ROM/RAM, magnetic disc, CD), comprising some instructions in order to make a station terminal equipment (can be mobile phone, computing machine, server, air conditioner, or the network equipment etc.) perform method described in each embodiment of the present invention.
These are only the preferred embodiments of the present invention; not thereby the scope of the claims of the present invention is limited; every utilize instructions of the present invention and accompanying drawing content to do equivalent structure or equivalent flow process conversion; or be directly or indirectly used in other relevant technical fields, be all in like manner included in scope of patent protection of the present invention.
Claims (8)
1. a method for image display, is characterized in that, the method for described image display comprises step:
Obtain the standard faces image preset;
Obtain Target Photo, and obtain the viewing area of all facial images to be matched on Target Photo;
In described viewing area, described standard faces image and described facial image to be matched are carried out matching degree analysis;
If have target facial image and standard faces images match degree to reach threshold value in described Target Photo, then determine the described position of target facial image in Target Photo, according to the displaying ratio preset, by described position display to the assigned address of display screen.
2. the method for image display as claimed in claim 1, it is characterized in that, on described acquisition Target Photo, the step of the viewing area of all facial images to be matched specifically comprises:
Receive the described Target Photo that user uploads;
Resolve described Target Photo, obtain the viewing area of all facial images to be matched on described Target Photo;
According to the described viewing area of all described facial images to be matched, generate the position table recording all described facial image positions to be matched; Described according to viewing area, the step of mating described standard faces image and described facial image to be matched specifically comprises:
Show according to described position, described standard faces image is mated with all described facial images to be matched one by one.
3. the method for image display as claimed in claim 1, is characterized in that, describedly determine the position of target facial image in Target Photo, according to the displaying ratio preset, the step of described position display to the assigned address of display screen is specifically comprised:
Determine the position of target facial image in Target Photo, according to the displaying ratio preset, described position is shown described Target Photo as screen center.
4. the method for image display as claimed in claim 1, it is characterized in that, the step of described acquisition standard faces image specifically comprises:
Receive the described standard faces image that user uploads; Or
Receive the shooting instruction of user, take corresponding face.
5. a device for image display, is characterized in that, the device of described image display comprises:
Acquisition module, for obtaining default standard faces image;
Locating module, for obtaining Target Photo, and obtains the viewing area of all facial images to be matched on Target Photo;
Matching module, in described viewing area, carries out matching degree analysis by described standard faces image and described facial image to be matched;
Display module, if reach threshold value for having target facial image and standard faces images match degree in described Target Photo, then determine the described position of target facial image in Target Photo, according to the displaying ratio preset, by described position display to the assigned address of display screen.
6. the device of image display as claimed in claim 5, it is characterized in that, described locating module comprises:
Receiving element, for receiving the described Target Photo that user uploads;
Resolution unit, for resolving described Target Photo, obtains the viewing area of all facial images to be matched on described Target Photo;
Generation unit, for the described viewing area according to all described facial images to be matched, generates the position table recording all described facial image positions to be matched;
Described standard faces image, specifically for showing according to described position, mates with all described facial images to be matched by described matching module one by one.
7. the device of image display as claimed in claim 5, is characterized in that, described position, specifically for determining the position of target facial image in Target Photo, according to the displaying ratio preset, is shown described Target Photo as screen center by described display module.
8. the device of image display as claimed in claim 5, it is characterized in that, described acquisition module comprises:
Receiving element, for receiving the described standard faces image that user uploads; Or
Shooting unit, for receiving the shooting instruction of user, takes corresponding face.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510150269.2A CN104732218B (en) | 2015-03-31 | 2015-03-31 | The method and device that image is shown |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510150269.2A CN104732218B (en) | 2015-03-31 | 2015-03-31 | The method and device that image is shown |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104732218A true CN104732218A (en) | 2015-06-24 |
| CN104732218B CN104732218B (en) | 2018-09-04 |
Family
ID=53456092
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510150269.2A Active CN104732218B (en) | 2015-03-31 | 2015-03-31 | The method and device that image is shown |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104732218B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105100642A (en) * | 2015-07-30 | 2015-11-25 | 努比亚技术有限公司 | Image processing method and apparatus |
| CN111052185A (en) * | 2017-08-29 | 2020-04-21 | 小猫星球 | Image registration method and device |
| CN114679591A (en) * | 2021-12-30 | 2022-06-28 | 广州方硅信息技术有限公司 | Video proportion switching method, device and medium for live broadcast room and computer equipment |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080253695A1 (en) * | 2007-04-10 | 2008-10-16 | Sony Corporation | Image storage processing apparatus, image search apparatus, image storage processing method, image search method and program |
| CN101794203A (en) * | 2009-01-07 | 2010-08-04 | Lg电子株式会社 | Mobile terminal and camera image control method thereof |
| CN102025827A (en) * | 2009-09-22 | 2011-04-20 | 鸿富锦精密工业（深圳）有限公司 | Communication device and photo display-based conversation method thereof |
| CN102118510A (en) * | 2011-03-17 | 2011-07-06 | 宇龙计算机通信科技(深圳)有限公司 | Contact correlation method, server and mobile terminal |
| CN202309884U (en) * | 2011-10-28 | 2012-07-04 | 深圳市迪威泰实业有限公司 | Intelligent image-picking and photographing integrated machine with portrait identifying and tracking functions |
| US20120229675A1 (en) * | 2011-03-07 | 2012-09-13 | Katsuya Yamamoto | Imaging apparatus, imaging method and imaging program |
| CN103049734A (en) * | 2011-10-12 | 2013-04-17 | 杜惠红 | Method and system for finding person in public place |
| CN103500220A (en) * | 2013-10-14 | 2014-01-08 | 大连民族学院 | Method for recognizing persons in pictures |
| CN103873755A (en) * | 2012-12-14 | 2014-06-18 | 鸿富锦精密工业（深圳）有限公司 | System and method for shooting leaping people |
-
2015
- 2015-03-31 CN CN201510150269.2A patent/CN104732218B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080253695A1 (en) * | 2007-04-10 | 2008-10-16 | Sony Corporation | Image storage processing apparatus, image search apparatus, image storage processing method, image search method and program |
| CN101794203A (en) * | 2009-01-07 | 2010-08-04 | Lg电子株式会社 | Mobile terminal and camera image control method thereof |
| CN102025827A (en) * | 2009-09-22 | 2011-04-20 | 鸿富锦精密工业（深圳）有限公司 | Communication device and photo display-based conversation method thereof |
| US20120229675A1 (en) * | 2011-03-07 | 2012-09-13 | Katsuya Yamamoto | Imaging apparatus, imaging method and imaging program |
| CN102118510A (en) * | 2011-03-17 | 2011-07-06 | 宇龙计算机通信科技(深圳)有限公司 | Contact correlation method, server and mobile terminal |
| CN103049734A (en) * | 2011-10-12 | 2013-04-17 | 杜惠红 | Method and system for finding person in public place |
| CN202309884U (en) * | 2011-10-28 | 2012-07-04 | 深圳市迪威泰实业有限公司 | Intelligent image-picking and photographing integrated machine with portrait identifying and tracking functions |
| CN103873755A (en) * | 2012-12-14 | 2014-06-18 | 鸿富锦精密工业（深圳）有限公司 | System and method for shooting leaping people |
| CN103500220A (en) * | 2013-10-14 | 2014-01-08 | 大连民族学院 | Method for recognizing persons in pictures |
Non-Patent Citations (1)
| Title |
|---|
| 《电脑编程技巧与维护》杂志社: "《电脑编程技巧与维护 2009年合订本 精华版》", 31 January 2010 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105100642A (en) * | 2015-07-30 | 2015-11-25 | 努比亚技术有限公司 | Image processing method and apparatus |
| CN105100642B (en) * | 2015-07-30 | 2018-11-20 | 努比亚技术有限公司 | Image processing method and device |
| CN111052185A (en) * | 2017-08-29 | 2020-04-21 | 小猫星球 | Image registration method and device |
| CN114679591A (en) * | 2021-12-30 | 2022-06-28 | 广州方硅信息技术有限公司 | Video proportion switching method, device and medium for live broadcast room and computer equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104732218B (en) | 2018-09-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104750420A (en) | Screen capturing method and device | |
| CN105183308A (en) | Picture display method and apparatus | |
| CN104660912A (en) | Photographing method and photographing device | |
| CN104731480A (en) | Image display method and device based on touch screen | |
| CN104967802A (en) | Mobile terminal, recording method of screen multiple areas and recording device of screen multiple areas | |
| CN104731512A (en) | Method, device and terminal for sharing pictures | |
| CN104731927A (en) | Sound recording file classifying method and system | |
| CN104951549A (en) | Mobile terminal and photo/video sort management method thereof | |
| CN104951236A (en) | Wallpaper configuration method for terminal device, and terminal device | |
| CN105160628A (en) | Method and device for acquiring RGB data | |
| CN104853088A (en) | Method for rapidly focusing a photographing mobile terminal and mobile terminal | |
| CN104794104A (en) | Multimedia document generating method and device | |
| CN104898940A (en) | Picture processing method and device | |
| CN104679890A (en) | Image pushing method and device | |
| CN104917965A (en) | Shooting method and device | |
| CN105100673A (en) | Voice over long term evolution (VoLTE) based desktop sharing method and device | |
| CN105227829A (en) | Preview picture device and its implementation | |
| CN104951229A (en) | Screen capturing method and device | |
| CN105430258A (en) | Method and device for taking self-timer group photos | |
| CN105138871A (en) | Unlocking method and apparatus for mobile terminal and mobile terminal | |
| CN104866352A (en) | Method for starting application and mobile terminal | |
| CN105261054A (en) | Device and method for compositing audio GIF image | |
| CN105302899A (en) | Mobile terminal and picture processing method | |
| CN104657484A (en) | Method, device and system for downloading application software | |
| CN105262953A (en) | Mobile terminal and method for control shooting of mobile terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |