CN104463092B - Mobile terminal and its control method - Google Patents

Mobile terminal and its control method Download PDF

Info

Publication number
CN104463092B
CN104463092B CN201410489932.7A CN201410489932A CN104463092B CN 104463092 B CN104463092 B CN 104463092B CN 201410489932 A CN201410489932 A CN 201410489932A CN 104463092 B CN104463092 B CN 104463092B
Authority
CN
China
Prior art keywords
image
search
region
controller
search result
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201410489932.7A
Other languages
Chinese (zh)
Other versions
CN104463092A (en
Inventor
金兴南
徐永定
李俊徽
赵映奎
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
LG Electronics Inc
Original Assignee
LG Electronics Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by LG Electronics Inc filed Critical LG Electronics Inc
Publication of CN104463092A publication Critical patent/CN104463092A/en
Application granted granted Critical
Publication of CN104463092B publication Critical patent/CN104463092B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416—Control or interface arrangements specially adapted for digitisers
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/53—Querying
    • G06F16/532—Query formulation, e.g. graphical querying
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/5854—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using shape and object relationship
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/5866—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04B—TRANSMISSION
    • H04B1/00—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
    • H04B1/38—Transceivers, i.e. devices in which transmitter and receiver form a structural unit and in which at least one part is used for functions of transmitting and receiving
    • H04B1/40—Circuits
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • G06V40/165—Detection; Localisation; Normalisation using facial parts and geometric relationships

Abstract

The present invention relates to a kind of mobile terminal and its control methods.The present invention relates to a kind of mobile terminals and its control method for making user's more advantageously using terminal.At least one of embodiment according to the present invention can provide the user with easy and accurate picture search environment via the face recognition for the people being included in image.

Description

Mobile terminal and its control method
Technical field
The present invention relates to a kind of mobile terminals and its control method for allowing users to more easily using terminal.
Background technique
Mobile terminal is a kind of equipment that may be configured to perform various functions.The example of such function includes data With voice communication, via camera captures images and video, record audio, via speaker system playing music and export Music and image and video are shown over the display.Some terminals include the additional function for supporting to play game, and other whole End is also arranged as multimedia player.Recently, mobile terminal, which has been configured to receive, allows to watch such as video and TV The broadcast of the content of program and multicast signals.
In general, according to ambulant presence or being not present, terminal can be classified into mobile terminal and fixed terminal.And And according to hand-held availability, mobile terminal can further be classified into handheld terminal and car-mounted terminal.
The function of supporting and increase mobile terminal is continually striving to.Such effort includes that software and hardware improves, And the changes and improvements in the construction package formed in mobile terminal.
These terminals are mass produced in the form of such as smart phone recently and are largely supplied and due to terminal High hardware performance causes to handle and/or storage mass data becomes available.Also, also enhancing is mounted in the terminal The performance of camera.Not only increase the quality of the image by receiving data storage but also increasing in this performance enhancement of hardware aspect Add the quality of the image by capture picture storage.
In general, mobile terminal provides a kind of picture library application journey corresponding with application program that is being used to read image data Sequence.But usually with date for receiving image data or by camera captured image data in picture library application program The sequence on date arranges image data.Intend to carry out it is therefore desirable to have and can search for user in a large amount of image data The control method of the mobile terminal of the image of search.
Summary of the invention
Therefore, the present invention is directed to device and method thereof, substantially avoids causing due to limitations and shortcomings of the prior art One or more problem.
It is proposed the present invention to meet aforementioned necessity.It allows users to search it is an object of the invention to provide one kind The mobile terminal and its control method of the image data of user first choice of the rope in many stored image datas.
Other advantage of the invention, object and feature will be partly presented in the description that follows, and partly For having checked that the one of ordinary skilled in the art of following content is apparent from, or can be obtained from practice of the invention Know other advantage of the invention, object and feature.It can be by the specification and its claim and attached drawing write In the structure specifically noted objectives and other advantages of the present invention are achieved and obtained.
In order to realize these purposes and other advantages and in accordance with the purpose of the invention, such as implements herein and widely describe , a kind of mobile terminal, comprising: touch screen；Memory, the memory are configured to store multiple images；And controller, it should Controller is configured to identify that the face for the people for including in each of multiple stored images, the controller are configured At facial area given plate is exported in touch screen, if received for the given side in the facial area given plate exported The input in portion region, then the controller is configured to search for the image to match with appointed facial area.
In order to realize these purposes and other advantages and in accordance with the purpose of the invention, such as implements herein and widely describe , a method of control mobile terminal includes the following steps: to store multiple images；Identification is in multiple stored images Each in include people face；Facial area given plate is exported in touch screen；And it if receives in quilt The input that facial area is specified in the facial area given plate of output, then search for the figure to match with appointed facial area Picture.
It is to be understood that foregoing general description of the present invention and it is subsequent detailed description be all it is exemplary and explanatory, And it is intended to provide and the claimed invention is explained further.
Detailed description of the invention
In conjunction with attached drawing, consider preferred embodiment it is described below after, the above and other aspect of the invention, feature, And advantage will become more apparent from.
Fig. 1 is the block diagram of mobile terminal according to an embodiment of the invention；
Fig. 2 is according to the present invention for mobile or portable terminal an exemplary front perspective view；
Fig. 3 is the rear perspective view of mobile terminal shown in figure 2；
Fig. 4 is the surface of the back casing of the rear cover exposure according to an embodiment of the invention by separate mobile terminal Rear perspective view；
Fig. 5 be it is according to an embodiment of the invention identify the face that is included in image and display together known The figure of other result (facial recognition information) and image；
Fig. 6 is the figure of the picture search mode of search image according to an embodiment of the invention；
Fig. 7 is the figure of the method according to an embodiment of the invention that image is searched for according to the first search pattern；
Fig. 8 is according to an embodiment of the invention using two or more tag search word execution search operation Method figure；
Fig. 9 is the figure of the method according to an embodiment of the invention that image is searched for according to the second search pattern；
Figure 10 is the exemplary figure of the method for the location finding image according to an embodiment of the invention based on face；
Figure 11 be it is according to an embodiment of the invention under the second search pattern via multiple facial area search graphs The figure of the method for picture；
Figure 12 is the figure of the method according to an embodiment of the invention that image is searched for according to the second search pattern；
Figure 13 is first showing for the method according to an embodiment of the invention that image is searched for according to third search pattern The figure of example；
Figure 14 is second showing for the method according to an embodiment of the invention that image is searched for according to third search pattern The figure of example；
Figure 15 is that the third of the method according to an embodiment of the invention that image is searched for according to third search pattern is shown The figure of example；
Figure 16 is the method for position of the change according to an embodiment of the invention between appointed facial area Exemplary figure；
Figure 17 to Figure 19 is the method according to an embodiment of the invention for searching for image according to third search pattern 4th exemplary figure；
Figure 20 is first showing for the method according to an embodiment of the invention that image is searched for according to the 4th search pattern The figure of example；
Figure 21 is second showing for the method according to an embodiment of the invention that image is searched for according to the 4th search pattern The figure of example；
Figure 22 and Figure 23 is the figure of the method for search group picture according to an embodiment of the invention；
Figure 24 is the method in specified region according to an embodiment of the invention and by referring in appointed region Determine the figure that number executes the method for picture search；
Figure 25 is the figure of the method according to an embodiment of the invention that image is searched for according to the 5th search pattern；
Figure 26 is the figure of the method according to an embodiment of the invention using search result；
Figure 27 is the figure of the method according to an embodiment of the invention using searching method；
Figure 28 is the figure of the method according to an embodiment of the invention via object identification search image；
Figure 29 is the figure of the method according to an embodiment of the invention that image is easily shared based on face recognition；
Figure 30 is the flow chart of the method according to an embodiment of the invention based on face recognition search image.
Specific embodiment
In the following detailed description, with reference to forming part of it and illustrative explanation through the invention is specific real Apply the attached drawing exemplified.Those skilled in the art, which should be appreciated that, can use other embodiments, and not take off In the case where from the scope of the present invention, structure, electrical and procedural variation can be carried out.Whenever possible, all attached Identical appended drawing reference will be used to refer to same or similar component in figure.
As used in this, it is merely for convenience of the disclosure, suffix " module ", " unit " and " part " is used for member Part.Therefore, important meaning or effect be not given suffix itself and understand " module " and " part " can together or Convertibly use.
The present invention can be applied to various types of terminals.The example of such terminal includes mobile terminal, is such as moved Phone, user equipment, smart phone, mobile computer, digital broadcast terminal, personal digital assistant, portable multimedia broadcasting are put Device (PMP) and omniselector.
Fig. 1 is the block diagram of the mobile terminal 100 of embodiment according to the present invention.Fig. 1 shows a reality according to the present invention The mobile terminal 100 of example is applied, mobile terminal 100 includes wireless communication unit 110, A/V (audio/video) input unit 120, uses Family input unit 130, sensing unit 140, output unit 150, memory 160, interface unit 170, controller 180, power supply list Member 190 etc..Fig. 1 shows the mobile terminal 100 with various assemblies, it is understood that, do not need the group for realizing all diagrams Part.More or less component can be realized as an alternative.
In the following description, the above element of mobile terminal 100 is successively explained.
Firstly, wireless communication unit 110 generally includes to allow in mobile terminal 100 and wireless communication system or move eventually One or more component carried out wireless communication between the network that end 100 is located at.For example, wireless communication unit 110 can wrap Include broadcasting reception module 111, mobile communication module 112, wireless Internet module 113, short range communication module 114, position-positioning Module 115 etc..
Broadcasting reception module 111 receives broadcast singal and/or broadcast from external broadcast management server via broadcast channel Relevant information.
Broadcast channel may include satellite channel and land channel.
Broadcast management server is commonly referred to as generating and sending the server of broadcast singal and/or broadcast related information Or it equipped with the broadcast singal and/or broadcast related information being previously generated and then sends provided signal or information to The server of terminal.Broadcast singal may be implemented as TV broadcast singal, radio signals and data broadcasting signal Deng.If desired, broadcast singal may further include the broadcast singal being combined with TV or radio signals.
At least two broadcasting reception modules 111 can be supplied to mobile terminal, to pursue at least two broadcast channels Reception or broadcast channel handover convenience simultaneously.
Broadcast related information includes information associated with broadcasting channel, broadcast program, broadcast service provider etc..And And broadcast related information is capable of providing via mobile communications network.In this case, pass through 112 energy of mobile communication module Enough receive broadcast related information.
Broadcast related information can be realized in a variety of manners.For example, broadcast related information may include that digital multimedia is wide Broadcast the electronic program guides (EPG) of (DMB) and the electronic service guidebooks (ESG) of hand-held digital video broadcast (DVB-H).
Broadcasting reception module 111 may be configured to receive the broadcast singal sent from various types of broadcast systems.It is logical Unrestricted example is crossed, such broadcast system includes terrestrial digital multimedia broadcast (DMB-T), digital multimedia broadcast (dmb) via satellite (DMB-S), hand-held digital video broadcast (DVB-H), DVB-CBMS, OMA-BCAST, be referred to as Radio Data System and land Integrated Services Digital Broadcasting (ISDB-T).Optionally, extensively Broadcast the digit broadcasting system that receiving module 111 can be configured to be suitable for other broadcast systems and be explained above.
The broadcast singal and/or broadcast related information received by broadcasting reception module 111 can be stored in such as In the suitable equipment of memory 160.
Mobile communication module 112 is (wide via such as GSM (global system for mobile communications), CDMA (CDMA), WCDMA One or more network entity is sent radio signals to (for example, base station, exterior terminal, server etc. with CDMA) etc. Deng)/from one or more network entity (for example, base station, exterior terminal, server etc.) receive wireless signal.It is such Wireless signal can indicate audio, video and according to text/Multimedia Message transmitting-receiving data etc..
Wireless Internet module 113 supports the internet access to mobile terminal 100.This module can by internally or Externally it is coupled to mobile terminal 100.In this case, wireless Internet technologies can include WLAN (Wireless LAN) (Wi-Fi), Wibro (WiMAX), Wimax (World Interoperability for Microwave Access, WiMax), (high-speed downlink packet connects HSDPA Enter), GSM, CDMA, WCDMA, LTE (long term evolution) etc..
It is realized via mobile communications network through the wireless mutual of Wibro, HSPDA, GSM, CDMA, WCDMA, LTE etc. Networking access.In in this respect, it is configured to execute the wireless Internet mould of wireless Internet access via mobile communications network Block 113 is understood as being a kind of mobile communication module 112.
Short range communication module 114 facilitates the communication of opposite short distance.Technology appropriate for realizing this module includes penetrating Frequency identifies the networking skill of (RFID), Infrared Data Association (IrDA), ultra wide band (UWB) and commonly known as bluetooth and purple honeybee Art etc..
The identification of position-locating module 115 or the position for obtaining mobile terminal 100 in other ways.If desired, passing through This module may be implemented in global positioning system (GPS) module.
According to current techniques, GPS module 115 can by according at least three satellites calculate range information and it is accurate when Between information and then by triangulation applications in information calculated, based on longitude, latitude and height and direction (or side At least one of position), to be precisely calculated current three-dimensional position information.Currently, using three satellite calculating positions and time Information, and the error in position place and temporal information calculated is then corrected using another satellite.In addition, GPS module 115 It can be by calculating real-time current location continuously come calculating speed information.
With reference to Fig. 1, audio/video (A/V) input unit 120 is configured to for audio or vision signal input being supplied to Mobile terminal 100.As shown, A/V input unit 120 includes camera 121 and microphone 122.Camera 121 is in video call The picture frame of the static picture or video that obtain by imaging sensor is received and handled under mode or screening-mode.Also, Processed picture frame can be displayed on display 151.
The picture frame handled by camera 121 can be stored in memory 160 or can be single via wireless communication Member 110 is externally sent.Optionally, at least two cameras 121 can be supplied to by mobile terminal 100 according to use environment.
When portable device is in such as phone call mode, logging mode and the AD HOC of speech recognition When, microphone 122 receives external audio signal.This audio signal is processed and is converted to electric audio signal.In call model In the case where, the audio data of processing is transformed to the format that can be transmitted via mobile communication module 112 to mobile communication base station. Microphone 122 generally includes various noise remove algorithms to remove the noise generated during receiving external audio signal.
User input unit 130 manipulates in response to the user of associated input equipment and generates input data.It is such to set Standby example includes keyboard, thin film switch, touch tablet (for example, static pressure/capacitor), shake wheel, rocker switch etc..
Sensing unit 140 provides sensing signal, for controlling movement using the state measurement of the various aspects of mobile terminal The operation of terminal 100.For example, sensing unit 140 can detecte the group of the open/close state of mobile terminal 100, mobile terminal 100 The position change of the component of the relative positioning of part (for example, display and keyboard), mobile terminal 100 or mobile terminal 100 exists Or there is no users to contact mobile terminal 100, the orientation of mobile terminal 100 or acceleration/deceleration and mobile terminal 100 Freely falling body.As an example, considering the mobile terminal 100 for being configured to slide type mobile terminal.In the configuration, sensing unit What 140 slippers that can sense mobile terminal were open or closed.Other examples include that the sensing of sensing unit 140 exists Or there is no the electric power provided by power supply unit 190, presence or absence of between interface unit 170 and external equipment coupling or Other connections.Also, sensing unit 140 can include proximity sensor 141.
Output unit 150 generates output relevant to vision, the sense of hearing, tactile etc..Also, output unit 150 includes display Device 151, audio output module 152, alarm unit 153, tactile module 154, projector module 155 etc..
Display 151 is typically implemented as visually to show (output) information associated with mobile terminal 100.Example Such as, if mobile terminal operates in the phone call mode, display will usually provide user interface (UI) or graphical user Interface (GUI), user interface (UI) or graphic user interface (GUI) include and dial, carry out and termination telephone calling is related The information of connection.As another example, if mobile terminal 100 is under video call mode or screening-mode, display 151 It can additionally or alternatively show image associated with these modes, UI or GUI.
Known display technology can be used to realize display module 151, for example including liquid crystal display (LCD), film Transistors-LCD display (TFT-LCD), organic light emitting diode display (OLED), flexible display and three dimensional display. Mobile terminal 100 may include display as one or more.
Some in the above display can be embodied as transparent or Nonopaque type, they are referred to alternatively as transparent display.Make For the representative example of transparent display, there is TOLED (transparent OLED) etc..Also the rear portion of display 151 can be configured and is realized For Nonopaque type.In the configuration, user can see terminal body rear portion via the region that the display 151 of terminal body occupies Object.
According to the configuration of mobile terminal 100 realized, at least two displays 151 can be provided to mobile terminal 100. For example, the list of mobile terminal 100 can be arranged in be spaced from each other or be built in the mode in a main body for multiple displays On a face.Alternatively, multiple displays can be arranged in the different sides of mobile terminal 100.
By display 151 and be used to detect touch action sensor (hereinafter referred to as " touch sensor ") configure In the case where at alternation of bed structure (hereinafter, referred to as " touch screen "), can by display 151 be used as input equipment and Output equipment.In this case, touch sensor can be configured to touch membrane, touch sheet, touch tablet etc..
Touch sensor can be configured to be applied to the pressure of the specific part of display 151 or from display The variation for the capacitor that 151 specific part generates is converted to electrical input signal.Furthermore it is possible to configure touch sensor to detect touching The pressure and touch location or size touched.
If providing touch input to touch sensor, signal corresponding with the touch is sent to touch control Device.Touch controller handles signal, and the signal of processing is then transmitted to controller 180.Therefore, controller 180 is able to know that Whether the specified portions of display 151 are touched.
With reference to Fig. 1, proximity sensor (141) can be provided to the inner area of mobile terminal 100 surrounded by touch screen Around domain or touch screen.Proximity sensor is to be detected in the case where no Mechanical Contact using electromagnetic field intensity or infrared ray It is present in the sensor around proximity sensor close to specified detection surface or object presence or absence of object.Therefore, it connects Nearly sensor has durability longer than contact type sensor, and has purposes more wider array of than contact type sensor.
Proximity sensor can include transmittance photoelectric sensor, direct reflective photoelectric sensor, mirror reflection photoelectricity Sensor, strength proximity sensor, electrostatic capacitance proximity sensor, magnetic proximity sensor, infrared proximity transducer etc. In one.In the case where touch screen includes electrostatic capacitance proximity sensor, it is configured to using electric field according to indicator Close variation detect the close of indicator.In this case, touch screen (touch sensor) can be classified as connecing Nearly sensor.
Proximity sensor detection is close to touch and close to touch manner (for example, close to when touching distance, continuing close to touch Between, close to touch location, close to touching displaced condition etc.).Further, it is possible to by close to touch action and being examined with detected What is measured is output to touch screen close to the corresponding information of touch manner.
Audio output module 152 include calling reception pattern, call placement mode, logging mode, speech recognition mode, It works in the various modes of broadcast reception mode etc., to export the audio data received from wireless communication unit 110 or deposit Store up the audio data in memory 160.During operation, the output of audio output module 152 is with specific function (for example, receiving To calling, receive message etc.) relevant audio.It is set usually using one or more speakers, buzzer, the generation of other audios It is standby and combinations thereof to realize audio output module 152.
153 output signal of alarm unit, for notifying the generation of particular event associated with mobile terminal 100.It is typical Event includes receiving call event, receive message event and receiving touch input event.Alarm unit 153 can lead to The mode of vibration and video or audio signal is crossed to export the signal occurred for notification event.It can be via display 151 Or audio output unit 152 exports video or audio signal.Therefore, display 151 or audio output module 152 can be regarded Make a part of alarm unit 153.
Tactile module 154 generates the various haptic effects that user can sense when.Vibration is generated by tactile module 154 The representative effects of haptic effect.The intensity and mode of the vibration generated by tactile module 154 are controllable.For example, can be with Different vibrations is exported in a manner of being synthesized together, or can be sequentially output different vibrations.
Tactile module 154 can generate various haptic effects and vibration.For example, tactile module 154, which generates, is attributed to phase Pass through injection/inlet hole injection/inhalation power for contacting the effect for the needle arrangement that skin surface vertically moves, being attributed to air Effect, be attributed to and skim over the effect of skin surface, the effect for being attributed to contact electrode, be attributed to the effect of electrostatic force, attribution In the effect etc. for indicating hot/cold feeling using heat sink or heat-releasing apparatus.
Tactile module 154 can be implemented such that user and sense tactile effect by the muscular sensation of finger, arm etc. Fruit, and haptic effect is transmitted by directly contacting.Optionally, according to the corresponding configuration type of mobile terminal 100, Neng Gouxiang Mobile terminal 100 provides at least two tactile modules 154.
Projector module 155 is the element for using mobile terminal 100 to carry out image projection instrument function.Also, root According to the control signal of controller 180, projector module 155 can show in external screen or wall and in display unit 151 The identical or at least partly different image of the image of upper display.
Specifically, projector module 155 can include light source (being not shown in the accompanying drawings), which generates for throwing outward Penetrate the light (for example, laser) of image；Video generation device (is not shown in the accompanying drawings), which is used for use from light The photogenerated image that source generates to export outward；And lens (being not shown in the accompanying drawings), the lens are for amplifying so as to pre- Fixed focal length exports image outward.Also, projector module 155 can further comprise for by mechanically mobile lens or The entire module of person adjusts the equipment (being not shown in the accompanying drawings) of image projecting direction.
Projector module 155 can device type according to display device and be classified as CRT (cathode-ray tube) module, LCD (liquid crystal display) module, DLP (digital light processing) module etc..Particularly, by enabling the light generated from light source to exist The mechanism that reflects on DMD (Digital Micromirror Device) chip operates DLP module, and can advantageously reduce projector module 151 size.
Preferably, projector can be provided in the length direction of the transverse direction of mobile terminal 100, front side or back side direction Module 155.And it is to be understood that projector module 155 can be provided to any of mobile terminal 100 according to its necessity Part.
Memory cell 160 is generally used for storing various types of data, to support processing, the control of mobile terminal 100 And memory requirement.The example of such data includes the program instruction of the application for operating on mobile terminal 100, contact person Data, telephone book data, message, audio, static picture (or photo), motion picture etc..Further, it is possible to by nearest use The accumulation frequency of use (for example, each telephone directory, each message or each multimedia frequency of use) of history or each data It is stored in memory cell 160.Furthermore it is possible to which the data of various mode of vibrations will be used for and/or in touch input to touch The sound exported in the case where screen is stored in memory cell 160.
It can be used including hard disk, random access memory (RAM), static random access memory (SRAM), electrically erasable Except programmable read only memory (EEPROM), Erasable Programmable Read Only Memory EPROM (EPROM), programmable read only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, disk or CD, multimedia card micro memory, cassette Memory (for example, SD memory, XD memory etc.) or other similar memories or data storage device it is suitable volatile Property and nonvolatile memory or store any type of equipment or memory 160 is realized in combination.Also, mobile terminal 100 It can be operated in association with the network memory of the store function for executing memory 160 on the internet.
Interface unit 170, which is generally implemented into, couples mobile terminal 100 with external equipment.Interface unit 170 is from outside Equipment receives data, or is powered and then the respective element transmitting into mobile terminal 100 or makes data or electric power The data obtained in mobile terminal 100 can be transmitted to external equipment.Interface unit 170 can be used wire/wireless wear-type and send Receiver port, external charger port, wire/wireless data port, memory card port, for be coupled to have identification mould Port, audio input/output port, video input/output port, ear port of the equipment of block etc. configure.
Identification module is the chip for storing the various information of the access right for authenticating mobile terminal 100, and It may include subscriber identification module (UIM), Subscriber Identity Module (SIM), general subscriber identification module (USIM) etc..With identification The equipment (hereinafter referred to as " identification equipment ") of module can be manufactured to smart card.Therefore, identification equipment is via corresponding port It may be connected to mobile terminal 100.
When mobile terminal 100 is connected to outside support, interface unit 170 becomes for from bracket to mobile terminal 100 provide the channel of electric power, or become for the various command signals inputted by user from bracket to be delivered to mobile terminal 100 channel.Electric power is operable to enable mobile terminal 100 from each of the various command signals that bracket inputs Identify that it has been correctly loaded in monitored mode signal in the bracket.
The all operationss of the usually control mobile terminal 100 of controller 180.For example, controller 180 execute with audio call, The associated control such as data communication, video call and processing.Controller 180 may include providing the multimedia of multimedia playback Module 181.Multi-media module 181 can be configured as a part of controller 180, or be embodied as independent assembly.
In addition, controller 180 is able to carry out mode (or image) identifying processing, for the writing executed on touch screen is defeated Enter and input of drawing is respectively identified as character or image.
Power supply unit 190 provides the electric power as needed for the various assemblies for mobile terminal 100.Electric power can be internal electricity Power, external power or combinations thereof.
Such as using computer software, hardware or its certain combination, institute here can be realized in computer-readable medium The various embodiments stated.It, can be at one or more specific integrated circuits (ASIC), digital signal for hardware embodiment Manage device (DSP), digital signal processing device (DSPD), programmable logic device (PLD), field programmable gate array (FPGA), Processor, controller, microcontroller, microprocessor, the other electronic units for being designed to carry out function described here or its selection Property combination in realize the embodiments described herein.Such embodiment can also be realized by controller 180.
For Software Implementation, can be realized by the individual software module of such as process and function described here Embodiment, each execution in software module one or more functions and operation described here.It is any suitable to utilize The programming language software application write realize software code, and software code can be stored in such as memory 160 Memory in, and executed by such as controller of controller 180 or processor.
Fig. 2 is the preceding perspective view of mobile terminal according to an embodiment of the invention.
The mobile terminal 100 being shown in the accompanying drawings has monoblock-type terminal main body.But it is also possible to match a variety of different Set middle realization mobile terminal 100.The example of such configuration includes: collapsible, sliding cover type, rotary, swing and its group It closes.For the sake of clarity, further disclosure will relate generally to monoblock-type mobile terminal 100.However, such introduction is same suitable In other types of mobile terminal.
With reference to Fig. 2, mobile terminal 100 includes constituting its external shell (shell, outer cover, lid etc.).In the present embodiment, Shell can be divided into procapsid 101 and back casing 102.Various electrical/electronic components are located at procapsid 101 and back casing In the space provided between 102.Optionally, in addition at least one middle casing can be further provided in 101 He of procapsid Between back casing 102.
For example, shell 101 and 102 is formed by the injection moulding of synthetic resin, or can be by such as stainless steel (STS), the metallics of titanium (Ti) etc. is formed.
Display 151, audio output unit 152, camera 121, user input unit 130/131 and 132, microphone 122, interface 180 etc. can be provided to terminal body, and more specifically, be provided to procapsid 101.
Display 151 occupies the major part of the interarea of procapsid 101.Audio output unit 151 and camera 121 are provided to With an adjacent region in the both ends of display 151, and user input unit 131 and microphone 122 are provided to and show Show the adjacent another region of the other end of device 151.User input unit 132 and interface 170 can be provided to 101 He of procapsid The transverse side of back casing 102.
Input unit 130 is manipulated to receive the order of the operation for controlling terminal 100.Also, 130 energy of input unit It enough include multiple manipulation units 131 and 132.Manipulation unit 131 and 132 can be referred to as actuating element and can be using use Family can execute any mechanism of the sense of touch mode of control action by experience sense of touch.
It can be set differently by the content that the first or second manipulation unit 131 or 132 inputs.For example, such as Such order of beginning, end, rolling etc. is input into the first manipulation unit 131.Also, it is used for from audio output unit Order, order of touch recognition mode for being switched to display 151 of volume adjustment of sound of 152 outputs etc. can be by It is input to the second manipulation unit 132.
Fig. 3 is the perspective view of the back side of mobile terminal shown in Figure 2.
With reference to Fig. 3, camera 121 ' can be additionally provided the back side of terminal body, and more specifically, provide Back casing 102.Camera 121 ' has the shooting direction generally opposite with the shooting direction of preceding camera 121 shown in Fig. 2, and And it can have the pixel different from the pixel of preceding camera 121.
Preferably, for example, preceding camera 121 has the facial picture for being enough to capture and send user for video call Low pixel, then camera 121 ' has for capturing plain objects in the case where not sending captured object with for clapping The high pixel taken the photograph.Also, each of camera 121 and 121 ' can be installed at terminal body to rotate or pop up.
It is adjacent with camera 121 ' that flash lamp 123 and mirror 124, which can be additionally provided,.Using the shooting pair of camera 121 ' As in the case where, flash lamp 123 is towards object projection light.It attempts to shoot user (self-timer) situation using camera 121 ' in user Under, mirror 124 allows users to check the user's face reflected by mirror 124.
Other audio output module 152 ' can be provided to the back side of terminal body.Other audio output module 152 ' can realize stereo function with previous audio output module 152 shown in Figure 2 together, and can be used for Hands-free mode is realized when talking by terminal.
Broadcast signal reception antenna 116 can be additionally provided the cross side of terminal body and the antenna for communication Deng.The antenna 116 for constituting a part of broadcasting reception module 111 shown in Fig. 1 can contractably provide terminal body.
Fig. 4 is the surface of the back casing of the rear cover exposure according to an embodiment of the invention by separate mobile terminal Rear perspective view.
With reference to Fig. 4, procapsid 101, back casing 102, rear cover (or battery cover) 103, camera 121 ', interface list are provided First 170, microphone 122, loudspeaker module 154, audio output unit 152 ', battery 191, battery loading unit 104, usim card Loading unit 166 and storage card loading unit 167.
For installing such as battery loading unit 104, usim card loading unit 105, storage card loading unit 106 etc. The space of external component can be provided to the surface of back casing 102.In general, being loaded in outer on the surface of back casing 102 Portion's component, which is provided, meets the diversified function of mobile terminal and various consumers to extend the function of mobile terminal 100 Demand.
When the performance of mobile terminal becomes diversification, battery 191 can be configured as replaceable type, such as in Fig. 4 Shown in, to supplement a considerable amount of power consumption.In the replaceable adopted situation of type, battery loading unit 104 It is formed on and allows the user to dismantle corresponding battery on the surface of back casing 102.In this case, contact terminal Battery loading unit 104 is provided to be electrically connected to and be installed in the intracorporal component of shell.
Usim card loading unit 166 or storage card loading unit 167 can be provided as shown in FIG. 4 by battery Loading unit 104.Alternatively, usim card loading unit 166 or storage card loading unit 167 can be provided to battery and add The bottom surface of carrier unit 104.Therefore, battery 191 can be by externally if unloading battery 191 from battery loading unit 104 Exposure.In this case, because the size of battery loading unit 104 be it is expansible, battery 191 can surpass ruler It is very little.
Although Fig. 4 shows usim card loading unit 166 or storage card loading unit 167 is installed in back casing 102 Configuration on back side, but it can be inserted into the mobile terminal 100 in a manner of the cross side to be inserted in back casing 102 Or it is separated from mobile terminal 100.
The surface of the covering back casing 102 of back casing 103.Therefore, back casing 103 is capable of fixing battery 191, usim card, deposits Reservoir card and glue not isolated with back casing 102 (lime) and also protect external component from external impact or Grain.Recently, water-proof function is added to mobile terminal 100.External component contacts water in order to prevent, and mobile terminal 100 can be into One step includes waterproof construction.Therefore, when back casing 102 and rear cover 103 are connected to each other, waterproof construction can be sealed in rear shell Gap between body 102 and rear cover 103.
Below, face recognition and facial recognition information in image are explained with reference to Fig. 5.
For the sake of clarity of the drawings, in the attached drawing for being used to interpret the one embodiment of the present of invention to be explained below In the shell to form the outside of mobile terminal 100 is omitted.But depict only the touch screen 151 for being shown in mobile terminal 100 In screen figure.
Fig. 5 be it is according to an embodiment of the invention identify the face that is included in image and display together known The figure of other result (facial recognition information) and image.
Fig. 5 (a) is the usual figure for reading picture and the image of display includes 3 people in Fig. 5 (a).According to the present invention One embodiment controller 180 can via can analyze belong to image face algorithm identification be included in image Everyone face.Algorithm analyzes eyes, nose or the mouth of the people in image and is able to use analyzed eye The face of eyeball, nose or mouth identification people.In the detailed explanation of following explanation one embodiment of the present of invention, pass through The result of algorithm identification will be regarded as facial recognition information.Facial recognition information may include in the entire area that image is output to The relative position information of identified face in domain.Also, if multiple people appear in picture, facial recognition information can To correspond to the personal information about at least one people in multiple people in.Therefore, if multiple people occur in the picture, The facial recognition information of image may include the face recognition result of at least one people for multiple people in.
Fig. 5 (b) is the figure for distinctively showing identified face.Controller 180 also can be in the picture exported In it is identified face on export face indicator 501-1 to 501-3.Particularly, controller 180 also can be based on being included The location information of face in analyzed facial recognition information display together facial indicator 501-1 together with the output of picture To 501-3.
In addition, algorithm can by people with analyze its according to each one and the spy of eyes, nose or mouth that changes The mode of sign identifies that the people of its face distinguishes.Particularly, controller 180 can be determined in a manner of being compared to each other face and schemed Whether identified face is identical as the face appeared in the picture being pre-stored in contact person in piece.By doing so When, if it is determined that identified face is identical as the face being pre-stored in contact person in picture, then controller 180 can be with Further display the additional information about the corresponding people being stored in contact person.
Particularly, the analysis of controller 180 face in the picture, identify the face and then can will face and spy Fixed contact information matching.Further, it is possible to which the contact information being matched additionally is shown in the picture.
As described in the example of Fig. 5 (c), as the example of additional information, controller 180 can will be used for its face The nametags 502-1 to 502-3 of identified people is considered as together with picture as additional information output.
The method of search image according to an embodiment of the invention is intended to provide based on face recognition knot above-mentioned Fruit can more easily search for the environment of image.Also, this method proposes to search further for based on face recognition result The additional information being pre-stored in contact person and the method that image can be searched for based on searched additional information.Particularly, If being identified as being stored in the people in contact person for the specific people being included in image, controller 180 can be into one The contact information of the particular person is stored as the label information about image by step.It in this case, can be in contact person Name, telephone number, home address in information including such as people etc. can be generally included in contact information Various information.
Meanwhile, it is capable to together with image by above-mentioned face recognition result be stored as label information or can with no matter When the mode of execution search image execution face recognition is able to carry out picture searching operation.Also, controller 180 can be by base Label information is stored as in the additional information that face recognition result searches.
Fig. 6 is the figure of the picture search mode of search image according to an embodiment of the invention.
In picture search mode according to an embodiment of the invention, drawing tool region 601, face can be exported Region given plate 602, tag search word list 603 and search-results region 604.
Facial area given plate 602 is the input according to an embodiment of the invention that be used to receive search condition Region.Particularly, facial area given plate can correspond to can input label search term or draw wherein occur face The drafting plate of position.
Particularly, facial area given plate 602 is according to an embodiment of the invention to be used to refer to facial area It is set to the region of search condition.When user usually remembers preferred image, user can remember first to be included in image People and the position of people that is included in image.Therefore, one embodiment of the present of invention is proposed using wherein in output picture Region relative position existing for septum reset search image method.Particularly, if it is specified in facial area by user Facial area is specified on plate 602, then controller 180, which can be searched for, exports it in the position for corresponding to appointed facial area The picture of face.
In addition, controller 180 according to an embodiment of the invention can show one in image, for the image Search is being executed in facial area given plate 602.
Drawing tool region 601 may include user for specifying the work of facial area in facial area given plate 602 Tool project.Tool project may include pencil tool, Eraser Tool, retrogressing tool and advance tool etc..
The region of pencil tool specified can be used in user.For example, if being received using pencil tool for shape The input of the curve circularized, then before the interior zone of the curve for the annular being formed can be considered as and corresponded to by controller 180 The facial area for the search condition stated.
The curve that Eraser Tool deletes the path and/or annular that are formed by using pencil tool can be used in user.
In the following description, it is omitted in the tool being included in drawing tool region 601 about for solution Release the item teleological interpretation that the embodiment of the present invention is not necessarily to.
The list of 603 indicating label search term of tag search word list is (for example, by depositing according to one embodiment of present invention Store up the list of the name of the people in contact person).Tag search word list 603 can correspond to from by most frequently being used At least one of the group selection of tag search word, tag search word searched recently and user configuration list composition.
According to one embodiment of present invention search-results region 604 correspond to output by controller 180 search to The region of a few image.If search result includes multiple images, controller 180 can be in search-results region 604 Show multiple images.If because the insufficient space of search-results region in search-results region can not show all Multiple images, then scroll operation can be used for showing all multiple images.
In the following description, the embodiment of the present invention is released based on the diagram of aforementioned image search pattern with reference to Fig. 6.
First search pattern-tag search mode
Fig. 7 is the figure of the method according to an embodiment of the invention that image is searched for according to the first search pattern.
In the first search pattern, propose to execute picture search based on tag search word.Particularly, the name of particular person, Telephone number etc. is used as search term and provides in the first search pattern that the spy including corresponding to search term can be searched for Determine the environment of the image (image of the face including particular person) of people.In this case, it is included in the people's in image Name and/or telephone number will be stored as label information about image.It according to one embodiment of present invention, can be with such as Mentioned in description above-mentioned execution face recognition and contact person's matched mode name and/or telephone number be stored as Label information about image.
As an example, user can when user wants search to include its name to be the image of people of " Eunhee Ahn " It inputs " Eunhee Ahn " and is used as tag search word.If " Eunhee Ahn " is entered as tag search word, basis The controller 180 of one embodiment of the present of invention can be searched in stored image The image of " Eunhee Ahn ".
Particularly, one embodiment of the present of invention proposes search label information to search for whether particular person is included in image In.It, can be through if executing face recognition operation for the particular person for belonging to image as mentioned in description above-mentioned By compared with the image for the contact person being pre-stored by about the additional information of the people (name, address etc.) be stored as about The label information of image.
In addition, in one embodiment of the invention, if received from tag search word list 603 as defined in selection The input 10a and 11a of tag search word, then controller 180 can execute picture search based on the tag search word selected.? Under such circumstances, the input for search term as defined in selecting can correspond to touch 10a works as in tag search word list 603 In preferred tag search word 701-1 and tag search word is dragged into 11a to facial area given plate when keeping touching 10a The input in 602 direction.Particularly, in input label search term, because the tag search word via key entry directly inputs It may be inconvenient, so one embodiment of the present of invention can be searched for word list 603 with output label and be searched from label Rope word list 603 selects the mode of a tag search word that the input of tag search word is made to become more convenient.
Fig. 7 (b) is shown in the tag search word 701- for selecting such as " Eunhee Ahn " from tag search word list 603 The screen of search result is exported in the case where 1.It is discribed such as in Fig. 7 (b), if the mark of selection such as " Eunhee Ahn " Sign search term 701-1, then controller 180 can abstract factory search term 701-1 exported in facial area given plate 602.
It includes such as " Eunhee Ahn " that controller 180 is searched in the multiple images being stored in memory 160 Label information image and in search-results region 604 export search result image.Such as the institute in the example of Fig. 7 (b) Describe, in search-results region 604 export 4 images and can the bottom of 4 images further export indicate into There is the indicator of the image searched in one step.In this case, user can be to roll the side of search-results region 604 Formula reads more search result images.
Meanwhile in an embodiment of the present invention, if receiving search command from user, controller 180 can be responded Search operation is executed in the search command received.But if change search condition (such as in facial area given plate 602 Fruit increases or Delete Search condition), then controller can update search result in response to the search condition being changed.
The method for executing search operation using a tag search word is explained in Fig. 7.But it is possible to using two or More tag search words execute search operation.About this, it will be described with reference to Fig. 8.
Fig. 8 is according to an embodiment of the invention using two or more tag search word execution search operation Method figure.
It is similar to Fig. 7 (b) with reference to Fig. 8 (a), it is exported such as in facial area given plate 602 by controller 180 The tag search word 701-1 of " Eunhee Ahn ".Particularly, it is assumed that inputted such as " Eunhee as search condition The tag search word 701-1 of Ahn ".
User wants the image that configuration includes such as people of the people of " Eunhee Ahn " and such as " Younh jung Seo " Search condition is to search for preferred image.If user will in mobile terminal according to an embodiment of the invention " Eunhee Ahn " and " Younh jung Seo " is inputted as tag search word, then mobile terminal to search includes all is entered Label image and can for user export image.
Particularly, if input 10b and 11b is for selecting such as " Young in the state shown in Fig. 8 (a) The tag search word 701-2 of jung Seo ", then controller 180 can be searched for including two all tag search being entered The image of word 701-1 and 701-2.In this case, the input for selecting tag search word can correspond to touch 10b Preferred tag search word 701-2 in tag search word list 603 and tag search word is dragged when keeping touching 10b Input of the dynamic 11b to the direction of facial area given plate 602.
Similarly, discribed such as in Fig. 8 (b), controller 180 can control the mark of such as " Young jung Seo " Label search term exports in facial area given plate 602.Further, it is possible to export the knot searched in search-results region 604 Fruit image.
The method for executing search operation using two tag search words is explained in the embodiment that reference Fig. 8 is explained.But If inputting additional tag search word, it is apparent that being able to use more tag search words executes search operation.
Second search pattern-facial positions search pattern
Meanwhile one embodiment of the present of invention proposes to search for image based on facial positions in the picture.Particularly, if User in facial area given plate 602 specify facial area, then user can search for its face be present in correspond to be instructed to Image in facial area position in image.
Fig. 9 is the method according to an embodiment of the invention for searching for image according to the second search pattern.
With reference to Fig. 9 (a), controller 180 can receive the input 10d and 11d for specifying facial area from user.If The input 10d and 11d for specifying facial area are received, then controller 180 is based on appointed facial area and searches for image And the result images searched can be exported in search-results region 604.
In this case, the input 10d and 11d for specifying facial area can correspond to specific to touch 10d Point and when keeping touching 10d, the mode that drags forms the input of loop curve.
In Fig. 9 (b), the display of controller 180 facial area specified by the input 10d and 11d of specified facial area 901.Appointed facial area 901 can indicate wherein in the whole region of facial area given plate 602 when septum reset exists Relative position.Therefore, if specified facial area, controller 180 can be searched for wherein to be searched corresponding to Image existing for the region septum reset of the image of appointed facial area 901 in multiple images.Particularly, in other words, it controls Device 180 processed can be searched for including facial image existing at position identical with appointed facial area 901.Therefore, The location finding image that can be arranged on according to its septum reset in image.It will describe in detail and be based on reference to Figure 10 below The method of facial positions search image.
Figure 10 is the exemplary figure of the method for the location finding image according to an embodiment of the invention based on face.
Figure 10 (a) shows facial area given plate 602.It is similar to Fig. 9, it is assumed that the phase in facial area given plate 602 Facial area 901 is specified in same position.In the embodiment in figure 10, facial area given plate 602 is drawn in a horizontal direction Divide 4 and is divided 4 in vertical direction.To be divided into 1 to 4 in a horizontal direction and be drawn in vertical direction The mode for being divided into A to D explains facial area given plate.By doing so, the facial area described in Figure 10 (a) can be referred to Fixed board 602 is divided into 16 regions in total and can position appointed facial area 901 at the region B2.
The search in the region B2 for corresponding to appointed facial area 901 of controller 180 includes the image of face.Figure 10 (b) it is exemplary figure for search result.Particularly, image can be divided into the same manner 16 regions by controller 180.Control Device processed searches for the image including face in the region B2 and is capable of providing search result.
Figure 10 (b) shows the example of the image search result of Figure 10 (a).Image search result includes 902-1 to 902-4's Search result.With reference to the example for the search result image described in Figure 10 (b), face is present in the region B2.
Particularly, when user wants the preferred image of search, user can be present in preferred image with remembering The position of face and the image that first choice is searched for using the mode of the position of face.
Meanwhile the example according to mentioned by the early stage in Figure 10, facial area given plate 602 is divided into 16 regions Mode search for image, the present invention can be without being limited thereto.It is apparent that can be facial area given plate to be divided into more The mode in region (or less region) executes picture search operation.
Meanwhile although Fig. 9 and Figure 10 show the example of single facial area, can be executed based on multiple facial areas Identical search operation.About this, will be described below with reference to Figure 11.
Figure 11 be it is according to an embodiment of the invention in the second search pattern via multiple facial area search graphs The figure of the method for picture.
It is similar to Fig. 9, in Figure 11 (a), it is assumed that controller 180 is received in the state of specified facial area 901 The input 10e and 11e of specified facial area.In explanation associated with Figure 11, the facial area 901 having been assigned with is claimed For first facial region and newest appointed facial area 1101 is referred to as the second facial area.
Figure 11 (b) is shown exports first facial region 901 and the second facial area in facial area given plate 602 1101.Controller 180 can search for image based on first facial region 901 and the second facial area 1101.Particularly, controller 180 can search for the image including face in corresponding respectively to 1101 region of first facial region 901 and the second facial area.
Figure 12 is the figure of the method according to an embodiment of the invention that image is searched for according to the second search pattern.It will be Image search method described in Figure 12 is different from specified facial area in early days in the method mentioned in Fig. 9.
With reference to Figure 12 (a), controller 180 exports facial area given plate 602 and divides facial area given plate 602 At 16 regions.For the sake of clarity, 16 regions of facial area given plate 602 are with by number 1 to 16 (" region 1 " to " area Domain 16 ") display mode mutually distinguished.
If receiving the input for selecting predetermined region from the facial area given plate 602 for be divided into multiple regions 10h, then the region selected can be designated as facial area (with reference to Figure 12 (b)) by controller 180.In this case, For selecting the input 10h of predetermined region to can correspond to be input into the pressing input for wanting the region selected.
Figure 12 (b) shows the case where " region 1 " is selected.According to one embodiment of present invention, if specifically Region is selected, then controller 180 can be displayed differently from the region that is selected with by the region selected with do not selected Region distinguish.For example, the indicator 1201 in the region that instruction is selected can be exported in the region selected.
Discribed such as in Figure 12 (a), if region is selected, controller 180 can be selected corresponding to Search includes the image of face in the region in region (appointed facial area).It is particularly, similar to facial area given plate, In the case where dividing an image into 16 regions, controller 180 can search include identified face in " region 1 " Image.
Method by specified facial range searching image is identical as the method referred to reference to Figure 10.
Figure 13 is first showing for the method according to an embodiment of the invention that image is searched for according to third search pattern The figure of example.Third search pattern corresponds to the search pattern that wherein the first search pattern and the second search pattern be combined with each other. Third search pattern enables the image in the specific position of image including particular person to be searched.
In Figure 13 (a), it is assumed that specify facial area 901 in facial area given plate 602.It is similar to Fig. 9 (b), control Device 180 processed can export multiple search result 902-1 extremely based on appointed facial area 901 in search-results region 604 902-4.In this case, if received for matching the defeated of specific tag search word 701-1 and facial area 901 Enter 10f and 11f, then controller 180 can be searched in multiple images to be searched is corresponding to appointed facial area It include the image of the face of the people corresponding to specific tag search word 701-1 in the region of the image in domain 901.
In this case, the input for specific tag search word 701-1 and facial area 901 to match 10f and 11f can correspond to touch the input of 10f tag search word 701-1 and is being dragged to face when keeping and touching 10f The input discharged after the position in portion region 901.
With reference to Figure 13 (b), controller 180 can be to export in matching facial area 901 in facial area given plate 602 The mode of the specific tag search word 701-1 in portion indicates that specific search term 701-1 matches with facial area 901.
Also, controller 180 can export result images in search-results region 604 according to the result of search.With reference to The discribed search result in Figure 13 (b) can check that only output corresponds to from the search result rejection image of Figure 13 (a) 901-1 the and 901-2 image of the result of a part.901-1 and 901-2 image corresponds in the figure for corresponding to facial area 901 It include the picture of such as particular person of " Eunhee Ahn " in the region of picture.
Figure 14 is second showing for the method according to an embodiment of the invention that image is searched for according to third search pattern The figure of example.Figure 14 shows the method that additional search criteria is input to the search condition described in Figure 13.
It is assumed that the tag search word 701-1 of such as " Eunhee Ahn " and the face in Figure 14 (a) similar with Figure 13 (b) Portion region 901 matches.In explanation associated with Figure 14, facial area 901 is referred to as first facial region and will quilt The facial area additionally inputted is referred to as the second facial area.
In the state of Figure 14 (a), if receiving the input 10k and 11k for additionally specifying facial area, control Device 180 processed can search for image based on first facial region 901, tag search word 701-1 and the second facial area 1401.It is first First, the method based on first facial region 901 and tag search word 701-1 search image can be with reference Figure 13 (a) and Figure 13 (b) method explained is identical.Controller 180 can search further for (filtering) right in the search result image of Figure 13 It should include the image of face in the region of the second facial area 1401.
When by doing so, the face of specific people in the first region is remembered in user and is not remembered clearly In the case where people in second area, user can search for the image of the face of any people including being present in second area.
Figure 15 is that the third of the method according to an embodiment of the invention that image is searched for according to third search pattern is shown The figure of example.
Similar to FIG. 10 in Figure 15, facial area given plate 602 has been divided 4 and has hung down in a horizontal direction Histogram is divided into 4 in.It is divided into 1 to 4 in a horizontal direction and is divided into A in vertical direction to D Mode explain facial area given plate.Similarly, it should be apparent that can be facial area given plate to be divided into Figure 15 The mode in more regions executes search.
In Figure 15 (a), facial area 901 is present in the region B2 and the label of such as " Young jung Seo " is searched Rope word 701-2 matches with first facial region 901.Controller 180 can be in the figure to be searched as the first search condition Whether the face of the configuration such as people of " Young jung Seo " is located at the region B2 as in.
In Figure 15 (a), it is assumed that select the tag search word 701-1 of such as " Eunhee Ahn " as search condition.Control Device 180 processed can export the tag search word selected of such as " Eunhee Ahn " in facial area given plate 602.So Afterwards, controller 180 can by such as people of " Eunhee Ahn " face whether be included in the image to be searched (with The position of image septum reset is unrelated) it is configured to the second search condition.
Controller 180 is based on the first search condition above-mentioned and the execution picture search operation of the second search condition and can Control search result to be output (with reference to Figure 15 (b)).
Particularly, according to the embodiment explained in Figure 15, it can search for while include being present in corresponding to facial area The face of the people of the face and such as " Eunhee Ahn " of such as particular person of " Young jung Seo " of the position of 901 image The image in portion.With reference to the example of image discribed in Figure 15 (b), the face of such as people of " Young jung Seo " is determined At the region B2 of position in the picture and it can check that the face of such as people of " Eunhee Ahn " is also included in image.And And the face of the people of such as " Eunhee Ahn " is unrelated with position.
Figure 16 is the method for position of the change according to an embodiment of the invention between appointed facial area Exemplary figure.
With reference to Figure 16 (a), such as the tag search word 701-1 of " Eunhee Ahn " matches with first facial region 901 And the tag search word 701-2 of such as " Young jung Seo " matches with the second facial area 1401.In such feelings Under condition, if received for changing the input 10g of the position between first facial region 901 and the second facial area 1401 And 11g, as described in Figure 16 (b), then controller 180 can replace first facial with the position of the second facial area 1401 The position in region 901.Then, controller can be executed based on the position of first facial region and the second facial area being changed Picture search operation.
Figure 17 to Figure 19 is the method according to an embodiment of the invention for searching for image according to third search pattern 4th exemplary figure.
Figure 17 (a) shows the case where selection " region 6 " and " region 7 ".Selection region and based on the region selected into Row search is identical as the second search pattern with reference to mentioned by Figure 12 early stage.Therefore, controller 180 is worked as in the image to be searched Middle search includes the image of face in corresponding to the region in region (region 6 and region 7) selected and then can be Search result is exported in discribed search-results region 604 such as in Figure 17 (a).The search result shown in Figure 17 (a) It is exported in region 604 using image 1601-1 to 1601-4 as search result.
It that case, if receive respectively will such as tag search word 701-1 of " Eunhee Ahn " and Input 10i, 11i that such as tag search word 701-2 of " Young jung Seo " and " region 6 " and " region 7 " match, 10j and 11j, then controller 180 can in " region 6 " display such as tag search word 701-1 of " Eunhee Ahn " and The tag search word 701-2 of such as " Young jung Seo " can be shown in " region 7 ".Also, controller 180 can be searched Rope includes the image of the face of such as people of " Eunhee Ahn " in " region 6 " and includes such as " Young in " region 7 " The image of the face of the people of jung Seo ".Also, as described in 17 (b), controller can be in search-results region 604 Middle display search result.As described in Figure 17 (b), tied in search-results region 604 using image 1601-1 as search Fruit output.
It is assumed that selecting the tag search word 701-1 in " region 6 " and such as " Eunhee Ahn " in Figure 18 (a) and being chosen " region 6 " selected matches.Further, it is assumed that selecting the tag search word 701-2 of such as " Young jung Seo " as search Condition.
In this case, because the tag search word 701-1 of such as " Eunhee Ahn " matches with " region 6 ", So the face that whether there is such as people of " Eunhee Ahn " in " region 6 " corresponds to the search condition in search image (the first search condition in the explanation about Figure 18).
Because whether the tag search word 701-2 of such as " Young jung Seo " is not matched that with any region Correspond to the search condition unrelated with region (position) on the image in the presence of the face of such as people of " Young jung Seo " (the second search condition in the explanation about Figure 18).
When by doing so, controller 180 can search for the figure for meeting both the first search condition and second search condition As (referring to Figure 18 (b)).
It is assumed that specified facial area 1901 and selecting such as tag search word 701-1 of " Eunhee Ahn " and such as The tag search word 701-2 of " Young jung Seo " is as the search unrelated with facial area appointed in Figure 19 (a) Condition.
In this case, the first search condition can correspond to face with the presence or absence of in " region 3 " and " region 7 " (being not necessarily specific people).Also, the second search condition can correspond to the presence or absence of such as " Eunhee unrelated with position The face of the people of the face and such as " Young jung Seo " of the people of Ahn ".Controller 180 can be searched based on first and second Rope conditional search image.
Figure 19 (b) shows the example of the image according to previous searches result.The image shown in this example includes such as The people of " Eunhee Ahn " face and such as " Young jung Seo " people face (unrelated with position) and be included in The face (referring to 501-5) identified in " region 3 " and " region 7 " on image-region.
Figure 20 is the first of the method for the search image according to an embodiment of the invention according to the 4th search pattern Exemplary figure.
4th search pattern corresponds to the method based on the number search image being included in image.More specifically, 4th search pattern corresponds to the method for the number search image based on the face identified in the picture.
Figure 20 (a) shows state according to an embodiment of the invention and exports number in drawing tool region 601 Input icon 601-1.If receiving the input 10r of selection number input icon 601-1, controller 180 can export use In the pop-up window 2001 of input number.If inputting 10s number via pop-up window 2001, controller 180 can be based on The number being entered executes picture search.Also, controller 180 can show the number 2002 being entered and can also export It instructs to instruct pop-up window 2003 based on the execution picture search of corresponding number.Then, controller 180 can be in search result The result images searched are exported in region 604.
Figure 21 is second showing for the method according to an embodiment of the invention that image is searched for according to the 4th search pattern The figure of example.
It is similar to the first example of Figure 20, picture search is executed based on number in the second example.But it is possible to based on packet The image included in the specific people being included in number executes picture search in the second example.
With reference to Figure 21, select the tag search word 701-1 of such as " Eunhee Ahn " as search condition.In such feelings Under condition, if receiving the input of the input icon 601-1 of selection number, controller 180 can be exported for inputting number Pop-up window 2001.If inputting 10s number via pop-up window 2001, controller 180 can be based on the people being entered Number and the tag search word selected execute picture search.
Particularly, controller 180 includes such as people of " Eunhee Ahn " and the energy in the image to be searched Enough search include and the image of the number that is entered people as many.
Also, controller 180 can show the number that 2002 are entered and can also export guidance based on corresponding to people Pop-up window 2003 is instructed in number execution picture search.Then, controller 180 can be exported in search-results region 604 and be searched Rope result images.
Meanwhile in the case where group picture, although cannot accurately be informed in includes how many people in group picture, exist The situation of the face of several people is captured in a manner of crowding around in specific position.Therefore, one embodiment of the present of invention is intended to propose The method for searching for the image of such as group picture mentioned above.About this, will be described below with reference to Figure 22.
Figure 22 and Figure 23 is the figure of the method for search group picture according to an embodiment of the invention.
Figure 22 (a) shows state according to an embodiment of the invention and exports collection in drawing tool region 601 Body shines region icon 601-2.
After selecting 10t group picture region icon 601-2, if receiving the input 10u in specified region, controller 180 can execute picture search based on appointed region 2101.
Figure 23 (a) shows appointed region 2101 and facial area given plate 602 and Figure 23 (b) shows Figure 23 (a) Search result image.In executing search, controller 180, which can be searched for, to be known in appointed region 2101 including multiple The image of other face.With reference to Figure 23 (b), including the facial 501-6 to 501-11 of multiple people in appointed region 2101. In addition, controller 180 can exclude to include the facial image identified in the outside in appointed region 2101 from search result. Particularly, controller 180, which can control, searches only for including the facial image identified in appointed region 2101.
Then, controller 180 can export search result in search-results region 604.
Meanwhile the embodiment explained according to reference Figure 22, no matter being included in the identified face in appointed region How the number in portion executes search operation.But different embodiment according to the present invention, it can be referred to specified be included in The mode of the number of identified face in fixed region executes search operation.About this embodiment, will refer to below Figure 24 is described.
Figure 24 is according to an embodiment of the invention by the specified region of prescribed number in appointed region The figure of method and the method for execution picture search.
Figure 24 (a) shows search condition according to an embodiment of the invention.It is similar to Figure 22, it is assumed that there are designated Region 2101.In this case, if receiving the input 10r of selection number input icon 601-1, controller 180 can export the pop-up window 2001 for inputting number.If inputting number 10v via pop-up window 2001, control Device 180 can execute picture search based on appointed region 2101 and the number being entered.Particularly, controller 180 can Search includes the image for the number being entered in appointed region 2101 in the image to be searched.
Also, controller 180 can export guidance and instruct pop-up window based on the execution picture search of appointed number 2101.Then, controller 180 can command deployment result images exported in search-results region 604.
Interpreted the embodiment of the present invention corresponds to know via face recognition to specific people so far The method of image is searched for otherwise.In addition, specific people can be passed through via face recognition to figure according to different embodiments As being sorted out.About this, will be described below with reference to Figure 25.
Figure 25 is the figure of the method according to an embodiment of the invention that image is searched for according to the 5th search pattern.
With reference to Figure 25 (a), controller 180 exports image in a manner of sorting out according to people to image.For example, only existing The output of the region 2501-1 includes the image of such as people of " Eunhee Ahn ".Particularly, controller 180 is searched for via face recognition Including such as picture of the people of " Eunhee Ahn " and can command deployment result exported in 2501-1.Method energy above-mentioned Enough it is equally applicable to remaining region 2501-2 to 2501-4.
The list of the people exported in Figure 25 (a) being capable of tag search word, most frequent in the picture to be used recently The sequence of the people that is included, the most frequent tag search word used etc. configures.Further, it is possible to be shown via scroll operation List including multiple people.
If receiving the input 10w of selection particular person, controller 180 can only be shown as described in Figure 25 (b) Show the image including particular person.
So far, it has been explained that execute the various methods of picture search.According to above-mentioned method, the knot of picture search Fruit can have single image, independent of the image of search condition or the output of multiple images.
In the following description, if exported multiple images as the result of picture search, in following embodiment It is middle that the method for utilizing search result is explained with reference to Figure 26.
Figure 26 is the figure of the method according to an embodiment of the invention using search result.
With reference to Figure 26 (a) to Figure 26 (c), main screen is exported via the touch screen 151 of mobile terminal 100.In further detail Explain main screen.
It is touched in screen 151 in general, main screen can be defined as to be displayed on first when cancelling the locking of touch screen Screen.At least one icon or widget of executing application or built-in function can be shown in main screen.? May exist two or more main screen in mobile terminal.In this case, when the placement regulation on touch screen 151 Touch gestures when can one by one be sequentially displayed two or more main screen.Each main screen can have mutually not Same icon (widget).
If searching for multiple images by preceding method, one embodiment of the present of invention is proposed on the home screen via figure Piece sliding widget 2601-1 to 2601-3 sequentially exports multiple images searched.
With reference to Figure 26 (a) to Figure 26 (c), controller 180 exports picture and slides widget 2601-1 to 2601-3.Picture is sliding Dynamic widget 2601-1 to 2601-3 shows image slides at a prescribed interval.Image is unreal according to one embodiment of present invention Lamp piece can correspond to search result image.
Meanwhile according to the present invention one can be efficiently used in the case where executing the operation for being combined with each other several pictures The searching method of a embodiment.
Figure 27 is the figure of the method according to an embodiment of the invention using searching method.
With reference to Figure 27 (a), controller 180 exports multiple images synthetic frame 2701-1 to 2701-6 via touch screen 151.
The instruction of image synthetic frame be used to synthesize multiple images the frame of one image.It selects an image and can incite somebody to action The image is inserted into each of the multiple regions (region A to D in Figure 27) being included in image synthetic frame.
If one input of the selection multiple images synthetic frame 2701-1 into 2701-6 is received, such as in Figure 27 (b) Middle to be described, then controller 180 being capable of output label search word list 603 and search-results region 604 and the figure selected As synthetic frame 2701-1.
If inputting specific tag search word in the specific region of image synthetic frame, controller 180 being capable of base Search operation is executed in the tag search word being entered to search for the image that be inserted into specific region.With reference in Figure 27 (b) example shown in is operated when executing picture search image to be inserted into the image synthetic frame 2701-1's selected When " region A ", if inputting the tag search word 701-1 of such as " Eunhee Ahn ", 180 energy of controller in " region A " Enough output includes the image search result of such as people of " Eunhee Ahn ".
In addition, one embodiment of the present of invention proposes the position further to consider the specific region in image synthetic frame The mode set executes picture search.With reference to the example of Figure 27 (b), because " region A " corresponds to the entirety based on image synthetic frame The region being tilted to the left, so the picture in the left region of picture including such as people of " Eunhee Ahn " may adapt to want It is inserted into the image of " region A ".Therefore, in the case where search will be inserted into the image of " region A ", controller 180 exists Search including such as picture of the people of " Eunhee Ahn " and can be controlled in the left region (2702 in Figure 27 (c)) of picture Search result processed exports in search-results region 604.
Meanwhile the embodiment of the present invention can not only be applied to the face recognition of people and can be applied to object Identification.The method via object identification search image is proposed in Figure 28.
Figure 28 is the figure of the method according to an embodiment of the invention via object identification search image.
Figure 28 (a) shows object area given plate 2802 according to an embodiment of the invention.Object area given plate 2802 correspond to the region of aforementioned facial area given plate 602.The instruction of object area given plate is corresponded to for receiving from user In the plate of the input in the region that specific object is positioned.
If receiving the input for specified region 2801 from user, controller 180, which can be searched for, to be provided It include the image of specific object in region 2801.With reference to the example of Figure 28, controller search includes in predetermined region 2801 The image of flower.
According to an embodiment of the invention, can via face recognition and certification by the face of particular person and contact information into Row matching.In addition, different embodiments of the invention propose will in the case where sharing image using matched contact information The method that image is directly sent to particular person.
Figure 29 is the figure of the method according to an embodiment of the invention that image is easily shared based on face recognition.
With reference to the image shown in Figure 29 (a), the face of such as people of " Eunhee Ahn " and such as " Young jung The face of the people of Seo " is identified.If receiving the input 10x of the selection such as people of " Eunhee Ahn ", controller 180 Shared selection pop-up window 2901 can be exported.Shared selection pop-up window 2901 instruction be used to share means from least one List in select a shared means pop-up window.It, will " text in shared selection pop-up window 2901 with reference to Figure 29 (b) This message ", " Kakao chat ", " Email " and " my contact person " are exported as shared means.If from shared choosing It selects and selects a kind of means in pop-up window 2901, then controller 180 is shared using the shared means execution selected and can Image is directly sent to such as " Eunhee using the information being stored in such as contact person of the people of " Eunhee Ahn " The people of Ahn ".
Figure 30 is the flow chart of the method according to an embodiment of the invention based on face recognition search image.
In step S3001, controller 180 can enter picture searching mode.The case where entering picture searching mode Under, such as depicted in figure 6, controller 180 can export (activation) facial area given plate 602 (drawing board) [S3002].
In step S3003, controller 180 can export the column of the tag search word including at least one tag search word Table.
In step S3004, controller 180 determines whether to receive in facial area given plate 602 for given side The input in portion region.If there is the specified of facial area, then controller is able to carry out step S3007.Otherwise, controller can Carry out step S3005.
In step S3005, controller 180 determines whether to receive selects at least one from tag search word list 603 The input of a tag search word.If being not received by the input of selection tag search word, controller 180 can terminate process Figure.If receiving the input of selection tag search word, controller 180 is able to carry out step S3006.
In step S3006, controller 180 can execute search operation based on the tag search word selected.In step In S3006, tag search mode above-mentioned can correspond to by the search pattern that controller 180 executes.Particularly, controller 180 can search for including corresponding to the face with the people (people corresponding to the tag search word selected) being included in image The image of the unrelated people in position.Also, controller 180 carries out step S3001, exports search result picture and then can tie Beam flow chart.
In step S3007, controller 180 determines whether to receive selects at least one from tag search word list 603 The input of a tag search word.If being not received by the input of selection tag search word, controller 180 is able to carry out S3009.If receiving the input of selection tag search word, controller 180 is able to carry out S3008.
In step S3008, controller 180 can be held based on appointed facial area and the tag search selected word Row search operation.Search operation in step S3008 can correspond to facial positions above-mentioned and tag search mode.Especially Ground, it includes specific people (corresponding to the tag search word selected that controller 180, which can be searched in appointed facial area, People) image.Also, controller 180 carries out step S3001, exports the result picture searched and then can terminate Flow chart.
In step S3009, controller 180 can execute search operation based on appointed facial area.In step Search operation in S3009 can correspond to facial positions search pattern above-mentioned.Particularly, controller 180 can be searched for The image of face in appointed facial area including random people.Also, controller 180 carries out step S3001, output search To result picture and then may terminate flow chart.
The advantages of mobile terminal according to the present invention and its control method is explained below and effect.
At least one of embodiment according to the present invention can be provided the user with and be allowed users to many stored The user interface of the image data of user's first choice is easily and conveniently searched in image data.
For those skilled in the art it is apparent that in no the case where being detached from spirit or scope of the invention Under the present invention can be appointed as to other forms.
The above method can be realized in the program recorded medium as computer-readable code.Computer-readable medium can To include the recording equipment for wherein storing all kinds by the data of computer system-readable.Computer-readable medium can be with It for example including ROM, RAM, CD-ROM, tape, floppy disk, optical data storage etc., and also include that carrier type realizes (example Such as, via the transmission of internet).Also, computer may include the control unit 180 of terminal.
It will be apparent to one skilled in the art that it is apparent that without departing from the spirit or scope of the present invention the case where Under, it can carry out various modifications and change in the present invention.Therefore, it is intended that the present invention covers modifications and variations of the invention, As long as they fall in the range of appended claims and its equivalent.

Claims (11)

1. a kind of mobile terminal, comprising:
Transmitter；
Touch screen；
Memory, the memory are configured to store multiple images and contact information；And
Controller, the controller are configured to:
The touch screen is set to show that the facial positions for being divided into the subregion of multiple equivalent sizes specify region；
The touch screen display is set to describe the grid of each subregion of multiple subregions；
The first selected subregion for being input to multiple subregions is received, the selected subregion is corresponding to the facial position Set the specific region in specified region；
Search for the multiple images at least one search result image stored, at least one described search result image packet Include the one or more face of present position corresponding with the specific region；
The touch screen is set to show that at least one described search result image, at least one described search result image are included in institute Rheme sets the one or more face of appearance；
The second input is received, it includes being searched in the position corresponding to the specific region that the second input instruction, which corresponds to, People counting number；And
Search for the multiple images at least one search result image stored, at least one described search result image packet The number of at least one face is included, the number of at least one face is included in position corresponding with the specific region, Wherein, the number of the face corresponds to the counting of searched for people, and the controller is further configured to control and searches only for Image including the face identified in appointed region；
If specific image includes the face identified in specified region, shared selection pop-up window is exported；
It controls the transmitter and specific image is sent directly to external equipment using contact information stored in memory At least one of.
2. mobile terminal according to claim 1, in which:
The memory is further configured to storage contact information associated with each of multiple contact persons；And
The controller is further configured to receive the second input, and second input links the specific of the multiple contact person Contact person is to selected subregion:
The multiple images stored are searched at least one search result image, at least one described search result image packet Include at least one particular contact being included in one or more faces；And
At least one described search result image includes the particular contact in the position corresponding to specific region.
3. mobile terminal according to claim 2, in which:
It is including one in the multiple contact person or more that the controller is further configured to make the touch screen to show A list；And
Second input includes selecting the specific contact person from shown list.
4. mobile terminal according to claim 3, wherein in response to including to the described specific of the selected subregion The touch and dragging of contact person, the specific contact person link with the selected subregion.
5. mobile terminal according to claim 3, wherein to arrange the shown list based on following sequences:
The frequency that each contact person is contacted,
The setting of user, or
The nearest connection time of each contact person.
6. mobile terminal according to claim 1, wherein the memory is further configured to storage and contacts with multiple The relevant contact information of each of people；
The controller is configured to receive the second input of the particular contact for selecting multiple contact persons；And
When the specific contact person is not linked to the selected subregion, the multiple images stored are searched to be used In at least one search result image, at least one described search result image includes in the position for corresponding to the specific region On any face, and the particular contact located at an arbitrary position.
7. a kind of method for controlling mobile terminal, which comprises
Show that facial positions specify region on the touch screen of the mobile terminal, wherein the facial positions specify region to be divided At the subregion of multiple equivalent sizes, and grid is shown as describing each subregion of multiple subregions；
The subregion for the selection that first is input to multiple subregions is received, the selected subregion corresponds to the facial positions The specific region in specified region；
Display instruction indicates that selected subregion is selected for searching for；
Search for the multiple images at least one search result image stored, at least one described search result image packet Include the one or more face of present position corresponding with the specific region；
Show at least one described search result image, at least one described search result image includes occurring in the position One or more faces；
The second input is received, it includes being searched in the position corresponding to the specific region that the second input instruction, which corresponds to, People counting number；And
Search for the multiple images at least one search result image stored, at least one described search result image packet At least facial number is included, at least facial number is included in position corresponding with the specific region, wherein described The number of face corresponds to the counting of searched for people；And
Control searches only for including the facial image identified in appointed region；
If specific image includes the face identified in specified region, shared selection pop-up window is exported；
Specific image is sent directly in external equipment by control transmitter using contact information stored in memory At least one.
8. according to the method described in claim 7, further comprising:
Store contact information associated with each of multiple contact persons；
In response to the second input, the particular contact of the multiple contact person is linked to selected subregion:
Wherein, the multiple images stored are searched at least one search result image, at least one described search result Image includes at least one particular contact being included in one or more faces；And
At least one described search result image includes the particular contact in the position corresponding to specific region.
9. according to the method described in claim 8, further comprising:
Display includes one or more the list in the multiple contact person, wherein second input includes from being shown The particular contact is selected in the list shown.
10. according to the method described in claim 9, further comprising:
In response to including the link input for touching and dragging to the specific contact person of the selected subregion, institute is linked State selection subregion and the specific contact person.
11. according to the method described in claim 9, further comprising to arrange the list based on following sequences:
The frequency that each contact person is contacted,
The setting of user, or
The nearest connection time of each contact person.
CN201410489932.7A 2013-09-23 2014-09-23 Mobile terminal and its control method Expired - Fee Related CN104463092B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020130112890A KR102065416B1 (en) 2013-09-23 2013-09-23 Mobile terminal and method for controlling the same
KR10-2013-0112890 2013-09-23

Publications (2)

Publication Number Publication Date
CN104463092A CN104463092A (en) 2015-03-25
CN104463092B true CN104463092B (en) 2019-07-16

Family

ID=51539161

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410489932.7A Expired - Fee Related CN104463092B (en) 2013-09-23 2014-09-23 Mobile terminal and its control method

Country Status (4)

Country Link
US (1) US20150084883A1 (en)
EP (1) EP2851778A1 (en)
KR (1) KR102065416B1 (en)
CN (1) CN104463092B (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101572331B1 (en) * 2013-12-26 2015-11-30 (주)멜파스 Touch sensing system and method for providing proximity sensing function using touch screen panel
JP2015207181A (en) * 2014-04-22 2015-11-19 ソニー株式会社 Information processing device, information processing method, and computer program
US10725614B2 (en) 2014-11-06 2020-07-28 Dropbox, Inc. Searching digital content
JP6295228B2 (en) * 2015-04-07 2018-03-14 東芝テック株式会社 Sales data processing device, server and program
US10540635B2 (en) * 2016-12-30 2020-01-21 Dropbox, Inc. System and method for generating desktop focus work areas
KR101922010B1 (en) * 2017-06-22 2018-11-26 엘지전자 주식회사 Mobile terminal and method for controlling the same
KR102599947B1 (en) 2017-10-27 2023-11-09 삼성전자주식회사 Electronic device and method for controlling the electronic device thereof
WO2023106463A1 (en) * 2021-12-10 2023-06-15 엘지전자 주식회사 Display device and control method therefor

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6195497B1 (en) * 1993-10-25 2001-02-27 Hitachi, Ltd. Associated image retrieving apparatus and method
JP2005063465A (en) * 2004-11-17 2005-03-10 Casio Comput Co Ltd Image retrieval device, electronic still camera and image retrieval method
US7716157B1 (en) * 2006-01-26 2010-05-11 Adobe Systems Incorporated Searching images with extracted objects
CN102467343A (en) * 2010-11-03 2012-05-23 Lg电子株式会社 Mobile terminal and method for controlling the same
CN103189864A (en) * 2010-08-31 2013-07-03 诺基亚公司 Methods and apparatuses for determining shared friends in images or videos

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006079220A (en) * 2004-09-08 2006-03-23 Fuji Photo Film Co Ltd Image retrieval device and method
JP5009577B2 (en) * 2005-09-30 2012-08-22 富士フイルム株式会社 Image search apparatus and method, and program
US20070143364A1 (en) * 2005-12-21 2007-06-21 Chen Lang S Techniques to manage contact information
JP5471124B2 (en) * 2009-07-29 2014-04-16 ソニー株式会社 Image search apparatus, image search method, and image search program
KR101598632B1 (en) * 2009-10-01 2016-02-29 마이크로소프트 테크놀로지 라이센싱, 엘엘씨 Mobile terminal and method for editing tag thereof
KR20120021061A (en) * 2010-08-31 2012-03-08 삼성전자주식회사 Method for providing search service to extract keywords in specific region and display apparatus applying the same
KR101860341B1 (en) * 2011-09-09 2018-05-24 엘지전자 주식회사 Mobile terminal and control method for the same

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6195497B1 (en) * 1993-10-25 2001-02-27 Hitachi, Ltd. Associated image retrieving apparatus and method
JP2005063465A (en) * 2004-11-17 2005-03-10 Casio Comput Co Ltd Image retrieval device, electronic still camera and image retrieval method
US7716157B1 (en) * 2006-01-26 2010-05-11 Adobe Systems Incorporated Searching images with extracted objects
CN103189864A (en) * 2010-08-31 2013-07-03 诺基亚公司 Methods and apparatuses for determining shared friends in images or videos
CN102467343A (en) * 2010-11-03 2012-05-23 Lg电子株式会社 Mobile terminal and method for controlling the same

Also Published As

Publication number Publication date
EP2851778A1 (en) 2015-03-25
US20150084883A1 (en) 2015-03-26
KR20150033202A (en) 2015-04-01
CN104463092A (en) 2015-03-25
KR102065416B1 (en) 2020-01-13

Similar Documents

Publication Publication Date Title
CN104463092B (en) Mobile terminal and its control method
CN108600605B (en) Mobile terminal and control method thereof
CN104813322B (en) Mobile terminal and its control method
US10048772B2 (en) Mobile terminal and method for controlling the same
US10685059B2 (en) Portable electronic device and method for generating a summary of video data
CN104346099B (en) Mobile terminal and its control method
CN106375637B (en) Mobile terminal and its control method
CN104717357B (en) Mobile terminal and its control method
CN104836889B (en) Mobile terminal and its control method
CN104281408B (en) Mobile terminal and its control method
CN102467343B (en) Mobile terminal and the method for controlling mobile terminal
CN103546629B (en) Mobile terminal and control method thereof
US9860411B2 (en) Mobile terminal and method of controlling the same
CN103813007B (en) Mobile terminal and control method thereof
CN105122780B (en) Electronic equipment and the method for controlling the electronic equipment
CN102291485B (en) Mobile terminal and group generating method therein
CN106488002B (en) Mobile terminal and the method for controlling mobile terminal
KR20180048142A (en) Mobile terminal and method for controlling the same
CN105721666A (en) Mobile Terminal And Controlling Method Thereof
KR20150008996A (en) Mobile terminal and control method thereof
CN104679402A (en) Mobile terminal and control method thereof
US20170214857A1 (en) Mobile terminal and method for controlling the same
CN102238761A (en) Mobile terminal and control method thereof
CN104536659B (en) Object information processing method and device
US20170003772A1 (en) Mobile terminal and method for controlling the same

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20190716

Termination date: 20200923