KR102108068B1 - Mobile terminal and method for controlling the same - Google Patents

Abstract

The present invention relates to a mobile terminal and a control method for allowing the use of the terminal to be implemented in consideration of user convenience. According to at least one of the embodiments of the present invention, it is advantageous in that various types of mobile terminals can be effectively controlled by using various sensors in a complex manner.

Description

Mobile terminal and its control method {MOBILE TERMINAL AND METHOD FOR CONTROLLING THE SAME}

The present invention relates to a mobile terminal and a control method for allowing the use of the terminal to be implemented in consideration of user convenience.

Terminal is mobile Depending on whether or not it can be divided into a mobile terminal (mobile / portable terminal) and a stationary terminal (stationary terminal). Again, the mobile terminal may be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry it.

As the function is diversified, such a terminal is a multimedia player type having multiple functions such as taking a picture or a video, playing a music or video file, receiving a game, or broadcasting. Is being implemented.

In order to support and increase the function of such a terminal, it may be considered to improve the structural part and / or software part of the terminal.

Recently, the trend of the mobile terminal market is aimed at the development of various types of mobile terminals in order to meet the increasingly diverse consumer preferences. The types of mobile terminals developed in this way are concentrated in a form that can emphasize the portability of the mobile terminals. Mobile terminal types for high portability are mainly in the form of watches, glasses or necklaces that can be worn on the user's body. In these types of mobile terminals, there are cases in which it is difficult to apply the input / output means used in the same way. For example, since these mobile terminals have a relatively small display size when compared to a conventional mobile terminal, there is a need to consider other methods of output means. In addition, in the case of a method of recognizing a user's voice command and using the recognition result as an input means, there is a fear that the recognition rate is significantly lower as the user's voice command is longer. Furthermore, there is a need to improve these voice commands because there is also a concern that their intentions are exposed to others. Accordingly, there is a need for a new method for a user input means capable of more accurately inputting a user's voice command without easily exposing the user's intention. In addition, it is necessary to study not only voice commands, but also new types of input / output methods to be applied to new types of mobile terminals.

The present invention is proposed to meet the above-mentioned needs, and an object thereof is to provide a mobile terminal and a control method thereof to further improve input / output convenience and portability of a user command.

Also, an object of the present invention is to provide a mobile terminal capable of improving the accuracy of user input and a control method thereof by effectively utilizing an intuitive input device.

The technical problems to be achieved in the present invention are not limited to the technical problems mentioned above, and other technical problems that are not mentioned will be clearly understood by those skilled in the art from the following description. Will be able to.

In order to achieve the above object, the present invention is a microphone, a necklace string for hanging on the neck of a user, a pendant unit fastened to the necklace string and slideable along the necklace string, and the position of the pendant unit according to the slide movement of the pendant unit Sensing unit for sensing, and recognizes a voice command received through the microphone, and in response to the first voice command recognized through the microphone, the first function when the position of the detected pantent unit falls within the first range And performs a second function when the detected position of the pendant unit falls within the second range.

In addition, in order to achieve the above object, the present invention is to control a mobile terminal in the form of a necklace, including a microphone, a necklace for hanging on the neck of the user, and a pendant unit that is fastened to the necklace and slides along the necklace. In the method, detecting the position of the pendant unit according to the slide movement of the pendant unit, recognizing a voice command received through the microphone, and corresponding to the first voice command recognized through the microphone, the sensing A step of performing a first function is performed when a position of the pendant unit is in a first range, and a second function is performed when the position of the detected pendant unit is in a second range.

The effects of the mobile terminal and its control method according to the present invention are as follows.

According to at least one of the embodiments of the present invention, there is an advantage that a mobile terminal with improved portability and a control method thereof can be provided.

In addition, according to at least one of the embodiments of the present invention, there is an advantage in that convenience can be improved in controlling a mobile terminal in the form of a necklace.

The effects obtainable in the present invention are not limited to the above-mentioned effects, and other effects not mentioned may be clearly understood by those skilled in the art from the following description. will be.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention (block diagram).
2 is a perspective view of an example of a mobile terminal or a mobile terminal related to the present invention as viewed from the front.
3 is a rear perspective view of the mobile terminal shown in FIG. 2.
Figure 4 is a rear perspective view showing the surface of the rear case by separating the rear cover of the mobile terminal according to an embodiment of the present invention.
5A is a diagram illustrating an example of a structure of a necklace-type mobile terminal according to an embodiment of the present invention.
5B is a diagram illustrating another example of a structure of a necklace-type mobile terminal according to an embodiment of the present invention.
6 is a view showing an example of the front and rear of the necklace-type mobile terminal according to an embodiment of the present invention.
FIG. 7 is a view showing a state in which the fastening part 502 is disengaged and a coupled state according to an embodiment of the present invention.
8 is a diagram illustrating a method of controlling a connection with another mobile terminal according to a state in which the fastening part 502 is disengaged and a coupled state according to an embodiment of the present invention.
9A to 9E are mechanical structures and pendants of the pendant portion 503 and the necklace string 501 in the necklace type mobile terminal 100 having the pendant portion 503 according to an embodiment of the present invention. It is a figure showing the relative position of the part 503.
10 is a necklace type mobile terminal 100 having a pendant unit 503 according to an embodiment of the present invention, different functions according to the position of the pendant unit 503 in response to the recognition of the same voice command It is a diagram showing an example of a method for performing.
11 is a diagram illustrating an example of a method of classifying types of applications executed according to an input voice command format according to an embodiment of the present invention.
12A and 12B are diagrams illustrating the structure of a length adjusting unit for classifying the operation mode according to the length adjustment of the necklace string 501 itself and adjusting the necklace string 501 according to an embodiment of the present invention. .
13 is a diagram illustrating an example of a method of performing a distinguishing function according to an embodiment of the present invention, as the length of the necklace string 501 is adjusted.
14A and 14B are diagrams illustrating a method of classifying the types of external devices to be connected in correspondence to a divided mode according to an embodiment of the present invention.
15 is a diagram illustrating a method of specifying any one of a plurality of mobile terminals connected to the mobile terminal 100-1, according to an embodiment of the present invention.
16 is a diagram illustrating an example of a control signal transmitted to another mobile terminal connected to a necklace-type mobile terminal according to an embodiment of the present invention.
17 is a diagram illustrating an example of feedback provided to a user when a necklace-type mobile terminal 100-1 and another mobile terminal are connected according to an embodiment of the present invention.
18 is a diagram illustrating an example of a method of displaying to a user according to success or failure of speech recognition according to an embodiment of the present invention.
19A and 19B are diagrams illustrating an example of a method of feedback using the vibration of a necklace string in a necklace type mobile terminal 100-1, according to an embodiment of the present invention.
20 is a diagram illustrating a method of adjusting a range of vibration of a necklace string in proportion to the amount of information to be guided to a user according to an embodiment of the present invention.
FIG. 21 shows the necklace cord 501 by vibrating when an alarm signal is received from the first external device 100-2 connected to the necklace type mobile terminal 100-1 according to an embodiment of the present invention. It is a figure showing a method.
22 is a diagram illustrating a method for transmitting information when the necklace-type mobile terminal 100-1 is released according to an embodiment of the present invention.
23 is a necklace type mobile terminal 100 having a pendant unit 503 according to an embodiment of the present invention, in response to the recognition of the same voice command, different functions according to the position of the pendant unit 503 It is a diagram showing a flowchart of the first method for performing the.
24 is a necklace type mobile terminal 100 having a pendant unit 503 according to an embodiment of the present invention, in response to the recognition of the same voice command, different functions according to the position of the pendant unit 503 It is a diagram showing a flowchart of a second method for performing.

Hereinafter, a mobile terminal related to the present invention will be described in more detail with reference to the drawings. The suffixes "modules" and "parts" for components used in the following description are given or mixed only considering the ease of writing the specification, and do not have meanings or roles distinguished from each other in themselves.

The mobile terminal described herein may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, personal digital assistants (PDA), portable multimedia player (PMP), navigation, and the like. However, those skilled in the art will readily appreciate that the configuration according to the embodiments described herein may also be applied to fixed terminals such as digital TVs and desktop computers, except when applicable only to mobile terminals.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention (block diagram).

The mobile terminal 100 includes a wireless communication unit 110, an audio / video (A / V) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, and an interface. It may include a unit 170, the control unit 180 and the power supply unit 190. The components shown in FIG. 1 are not essential, so a mobile terminal with more or fewer components may be implemented.

Hereinafter, the components will be described in turn.

The wireless communication unit 110 may include one or more modules that enable wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short-range communication module 114, and a location information module 115. .

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more broadcast receiving modules 1100 may be provided to the mobile terminal 100 for simultaneous broadcast reception or switching of broadcast channels for at least two broadcast channels.

The broadcast management server may refer to a server that generates and transmits broadcast signals and / or broadcast-related information or a server that receives previously generated broadcast signals and / or broadcast-related information and transmits them to a terminal. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, as well as a TV broadcast signal or a radio broadcast signal combined with a data broadcast signal.

The broadcast-related information refers to information related to a broadcast channel, broadcast program or broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, it may exist in the form of an Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or an Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast reception module 111 includes, for example, Digital Multimedia Broadcasting-Terrestrial (DMB-T), Digital Multimedia Broadcasting-Satellite (DMB-S), Media Forward Link Only (MediaFLO), and Digital Video Broadcast (DVB-H). -Handheld), DVB-CBMS (Convergence of Broadcasting and Mobile Service), OMA-BCAST (Open Mobile Alliance-BroadCAST), CMMB (China Multimedia Mobile Broadcasting), MBBMS (Mobile Broadcasting Business Management System), ISDB-T (Integrated Services) Digital broadcast signals can be received using digital broadcast systems such as Digital Broadcast-Terrestrial. Of course, the broadcast receiving module 111 may be configured to be suitable for other broadcasting systems as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast-related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 is at least one of a base station, an external terminal, and a server on a mobile communication network such as, but not limited to, Global System for Mobile communications (GSM), Code Division Multiple Access (CDMA), Wideband CDMA (WCDMA). Send and receive radio signals with one. The wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call signal, or a text / multimedia message.

The wireless Internet module 113 refers to a module for wireless Internet access, and may be built in or external to the mobile terminal 100. Wireless Internet technology includes Wireless LAN (WLAN) (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), GSM, CDMA, WCDMA, Long Term (LTE) Evolution) (but not limited to) and the like.

In view of the wireless Internet access by Wibro, HSDPA, GSM, CDMA, WCDMA, LTE, etc., through the mobile communication network, the wireless Internet module 113 performing wireless Internet access through the mobile communication network is the mobile communication module It may be understood as a kind of (112).

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, etc. may be used as short range communication technology.

The location information module 115 is a module for obtaining a location of a mobile terminal, and a representative example thereof is a Global Position System (GPS) module. According to the present technology, the location information module 115 calculates distance information and accurate time information from three or more satellites, and then applies trigonometry to the calculated information, resulting in three-dimensional according to latitude, longitude, and altitude. Current location information can be accurately calculated. Currently, a method of calculating position and time information using three satellites and correcting an error of the calculated position and time information using another one satellite is widely used. In addition, the GPS module 115 may calculate speed information by continuously calculating the current position in real time.

Referring to FIG. 1, the A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, which may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving pictures obtained by an image sensor in a video call mode or a shooting mode. The processed image frame may be displayed on the display unit 151.

The image frames processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. Two or more cameras 121 may be provided according to the use environment.

The microphone 122 receives an external sound signal by a microphone in a call mode, a recording mode, or a voice recognition mode, and processes it as electrical voice data. The processed voice data may be converted into a form transmittable to a mobile communication base station through the mobile communication module 112 and output. Various noise reduction algorithms for removing noise generated in the process of receiving an external sound signal may be implemented in the microphone 122.

The user input unit 130 generates input data for the user to control the operation of the terminal. The user input unit 130 may be configured with a button 136, a touch sensor (static pressure / blackout) 137 positioned on the front or rear or side of the mobile terminal 100, and although not shown, a key pad, It may be configured to further include a dome switch (dome switch), jog wheel, jog switch.

The sensing unit 140 detects the current state of the mobile terminal 100, such as the open / closed state of the mobile terminal 100, the location of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, and acceleration / deceleration of the mobile terminal. By generating a sensing signal for controlling the operation of the mobile terminal 100. Examples of the sensing unit 140 may include a gyroscope sensor, an acceleration sensor, a geomagnetic sensor, and the like.

For example, when the mobile terminal 100 is in the form of a slide phone, it can sense whether the slide phone is opened or closed. In addition, it is also possible to sense whether the power supply unit 190 supplies power, whether the interface unit 170 is coupled to an external device, or the like. Meanwhile, the sensing unit 140 may include a proximity sensor 141.

The output unit 150 is for generating output related to vision, hearing, or tactile sense, and includes a display unit 151, an audio output module 152, an alarm unit 153, and a haptic module 154. Can be.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal is in a call mode, a UI (User Interface) or a GUI (Graphic User Interface) related to the call is displayed. When the mobile terminal 100 is in a video call mode or a photographing mode, the photographed and / or received image or UI, GUI is displayed.

The display unit 151 includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), and a flexible display (flexible) display) and a 3D display.

Some of these displays may be of a transparent type or a light transmissive type so that the outside can be seen through them. This may be called a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED). The rear structure of the display unit 151 may also be configured as a light transmissive structure. With this structure, the user can see an object located behind the terminal body through an area occupied by the display unit 151 of the terminal body.

Two or more display units 151 may exist depending on the implementation form of the mobile terminal 100. For example, a plurality of display units may be spaced apart from one surface or integrally disposed in the mobile terminal 100, or may be respectively disposed on different surfaces.

When the display unit 151 and a sensor that senses a touch operation (hereinafter referred to as a “touch sensor”) form a mutual layer structure (hereinafter, referred to as a “touch screen”), the display unit 151 may be used in addition to an output device. It can also be used as an input device. The touch sensor may have a form of, for example, a touch film, a touch sheet, or a touch pad.

The touch sensor may be configured to convert changes in pressure applied to a specific portion of the display unit 151 or capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor may be configured to detect not only the touched position and area, but also the pressure at the time of touch.

When there is a touch input to the touch sensor, the signal (s) corresponding thereto is sent to a touch controller (not shown). The touch controller processes the signal (s) and then transmits corresponding data to the controller 180. Accordingly, the control unit 180 can know which area of the display unit 151 has been touched, and the like.

The proximity sensor 141 may be disposed inside the mobile terminal surrounded by the touch screen or near the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object present in the vicinity without mechanical contact using electromagnetic force or infrared rays. Proximity sensors have a longer lifespan and higher utilization than contact sensors.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive type proximity sensor, a magnetic type proximity sensor, and an infrared proximity sensor. When the touch screen is capacitive, it is configured to detect the proximity of the pointer due to a change in electric field according to the proximity of the pointer. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of description, the act of allowing the pointer to be recognized as being positioned on the touch screen without being touched by the pointer on the touch screen is referred to as a “proximity touch”, and the The act of actually touching the pointer on the touch screen may be referred to as "contact touch". The location where a proximity touch is performed by the pointer on the touch screen may mean a location where the pointer corresponds vertically to the touch screen when the pointer is touched in proximity.

The proximity sensor detects a proximity touch and a proximity touch pattern (eg, proximity touch distance, proximity touch direction, proximity touch speed, proximity touch time, proximity touch position, proximity touch movement state, etc.). Information corresponding to the sensed proximity touch operation and proximity touch pattern may be output on the touch screen.

The audio output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception, call mode or recording mode, voice recognition mode, broadcast reception mode, or the like. The sound output module 152 may also output sound signals related to functions (eg, call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. The sound output module 152 may include a receiver, a speaker, and a buzzer.

The alarm unit 153 outputs a signal for notifying the occurrence of an event in the mobile terminal 100. Examples of events generated in the mobile terminal include call signal reception, message reception, key signal input, and touch input. The alarm unit 153 may output a signal for notifying the occurrence of an event by vibrating in a form other than a video signal or an audio signal, for example, vibration. Since the video signal or the audio signal may also be output through the display unit 151 or the sound output module 152, in this case, the display unit 151 and the sound output module 152 are a type of the alarm unit 153. It may be classified.

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the tactile effect generated by the haptic module 154 is vibration. The intensity and pattern of vibration generated by the haptic module 154 is controllable. For example, different vibrations may be synthesized and output or sequentially output.

In addition to vibration, the haptic module 154 is used for stimulation such as pin arrangement that vertically moves with respect to the contact surface of the skin, spray or suction force of air through a spray or intake, grazing on the skin surface, contact with an electrode, and electrostatic force. Various tactile effects can be generated, such as an effect and an effect of reproducing a feeling of cold and warm using an element capable of absorbing heat or generating heat.

The haptic module 154 may not only deliver the tactile effect through direct contact, but may also be implemented so that the user can feel the tactile effect through muscle sensations such as fingers or arms. Two or more haptic modules 154 may be provided according to a configuration aspect of the mobile terminal 100.

The memory 160 may store a program for processing and control of the controller 180, and temporarily store input / output data (for example, a phone book, message, audio, still image, video, etc.). It can also perform the function. In the memory 160, the frequency of use for each of the data (eg, each phone number, each message, and the frequency of use for each multimedia) may be stored.

In addition, the memory 160 may store data related to various patterns of vibration and sound output when a touch is input on the touch screen.

The memory 160 is a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory, etc.), RAM (Random Access Memory, RAM), Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM), magnetic memory, magnetic It may include a storage medium of at least one type of disk, optical disk. The mobile terminal 100 may operate in connection with a web storage performing a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a passage with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device, receives power, transfers it to each component inside the mobile terminal 100, or allows data inside the mobile terminal 100 to be transmitted to the external device. For example, wired / wireless headset port, external charger port, wired / wireless data port, memory card port, port for connecting devices equipped with an identification module, audio input / output (I / O) port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip that stores various information for authenticating the usage rights of the mobile terminal 100, a user identification module (UIM), a subscriber identification module (SIM), and a universal user authentication module ( Universal Subscriber Identity Module (USIM). The device provided with the identification module (hereinafter referred to as 'identification device') may be manufactured in a smart card format. Therefore, the identification device may be connected to the mobile terminal 100 through a port.

When the mobile terminal 100 is connected to an external cradle, the interface unit becomes a passage through which power from the cradle is supplied to the mobile terminal 100, or various command signals input from the cradle by the user are moved. It may be a passage to the terminal 100. Various command signals or power input from the cradle may be operated as signals for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile terminal. For example, it performs related control and processing for voice calls, data communication, video calls, and the like. The controller 180 may also include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the controller 180, or may be implemented separately from the controller 180.

The controller 180 may perform a pattern recognition process capable of recognizing handwriting input or picture drawing input performed on the touch screen as text and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the controller 180 to supply power required for the operation of each component.

The battery may be a built-in battery made to be rechargeable, and may be detachably coupled to the terminal body for charging or the like. The connection port may be configured as an example of the interface unit 170 to which an external charger that supplies power for charging the battery is electrically connected.

The various embodiments described herein can be implemented in a computer- or similar device-readable recording medium using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing other functions. The described embodiments may be implemented by the controller 180 itself.

According to a software implementation, embodiments such as procedures and functions described herein may be implemented as separate software modules. Each of the software modules may perform one or more functions and operations described herein. Software code can be implemented in a software application written in an appropriate programming language. The software code may be stored in the memory 160 and executed by the controller 180.

Hereinafter, in describing an embodiment of the present invention, the display unit 151 will be described assuming that it is a touch screen 151. However, embodiments of the present invention are not limited to the touch screen 151.

In addition, in the embodiment of the present invention, the touch gesture means a gesture implemented by touching or touching the touch screen 151, and the touch input means an input received by the touch gesture.

Touch gestures include tapping, touch & drag, flicking, press, multi touch, pinch in, and pinch out depending on the action. And so on.

Tapping is an operation of lightly pressing and releasing the touch screen 151 once, and means a touch gesture such as a mouse click on a general personal computer.

Further, the touch drag is an operation of moving and moving to a specific position while maintaining a touch on the touch screen 151, and when dragging an object, the object may be continuously displayed according to the dragging direction.

In addition, flicking refers to an operation of touching the touch screen 151 and then moving in a specific direction (up, down, left, right, or diagonal) to release the contact point, and the mobile terminal 100 touch input by flicking When this is received, processing of a specific operation is performed based on the flicking direction, speed, and the like. For example, a page turning operation of an e-book may be performed based on the flicking direction.

In addition, the press means an operation of continuously maintaining a touch for a predetermined time or more after touching the touch screen 151.

In addition, multi-touch means an operation of simultaneously touching a plurality of points on the touch screen 151.

In addition, pinch-in refers to an operation of dragging the touch screen 151 in a direction in which a plurality of pointers being multi-touched approach each other. That is, it means a drag that starts from at least one of a plurality of points that are multi-touched on the touch screen 151, and occurs in a direction in which a plurality of points that are multi-touched close to each other.

In addition, pinch-out refers to an operation of dragging the touch screen 151 in a direction in which a plurality of pointers being multi-touched are moved away from each other. That is, it means a drag that starts from at least one of a plurality of points that are multi-touched on the touch screen 151 and occurs in a direction in which a plurality of points that are multi-touched are separated from each other.

2 is a perspective view of an example of a mobile terminal or a mobile terminal related to the present invention as viewed from the front.

The disclosed mobile terminal 100 has a bar-shaped terminal body. However, the present invention is not limited to this, and can be applied to various structures such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are movably coupled.

The body of the mobile terminal 100 includes cases (101, 102, 103) forming an exterior. In this embodiment, the case may be divided into a front case 101 and a rear case 102. Various electronic components are embedded in a space formed between the front case 101 and the rear case 102.

In some cases, electronic components may also be mounted on the surface of the rear case 102. Electronic components mounted on the surface of the rear case 102 include a battery, a USIM card, and a memory card that the user needs to detach. At this time, the rear case 102 may further include a rear cover 103 for covering its surface. The rear cover 103 is formed in a structure that can be easily attached and detached by a user, and when the rear cover 103 is removed, the surface of the rear case 102 is exposed.

When the rear cover 103 is combined as shown in FIG. 2, only a part of the side surface of the rear case 102 may be exposed, and when the size of the rear cover 103 is reduced, the rear surface of the rear case 102 Some may also be exposed. When the rear cover 103 covers the entire rear surface of the rear case 102, an opening 103 ′ for exposing the camera 121 ′ or the sound output unit 152 ′ to the outside may be included.

The cases 101, 102, and 103 may be formed by injecting synthetic resin or may be formed to have a metal material, for example, a metal material such as stainless steel (STS) or titanium (Ti).

A display unit 151, an audio output module 152, a camera 121, a user input unit 130 / 131,132, a microphone 122, an interface unit 170, etc. may be disposed in the terminal cases 101 and 102. .

The display unit 151 occupies most of the main surface of the front case 101. An acoustic output module 152 and a camera 121 are disposed in an area adjacent to one end of both ends of the display unit 151, and a user input unit 131 and a microphone 122 are arranged in an area adjacent to the other end. The user input unit 132 and the interface unit 170 may be disposed on side surfaces of the front case 101 and the rear case 102.

The user input unit 130 is operated to receive a command for controlling the operation of the mobile terminal 100, and may include a plurality of operation units 131 and 132. The operation units 131 and 132 may also be collectively referred to as a manipulating portion, and any method may be employed as long as the user operates with a tactile feeling.

Contents input by the first or second operation units 131 and 132 may be variously set. For example, the first operation unit 131 receives a command such as start, end, scroll, etc., and the second operation unit 132 inputs a command such as adjusting the volume of sound output from the sound output module 152. In response, the third manipulation unit 133 may receive a command such as switching of the display unit 151 to a touch recognition mode.

3 is a rear perspective view of the mobile terminal shown in FIG. 2.

Referring to FIG. 3, a camera 121 ′ may be additionally mounted on the rear of the terminal body, that is, the rear case 102. The camera 121 ′ has a shooting direction substantially opposite to the camera 121 (see FIG. 2), and may be a camera having different pixels from the camera 121.

For example, in the case of a video call, the camera 121 has a low pixel so that the user's face is taken and transmitted to the other party, and the camera 121 'may not shoot the general subject and send it immediately. It is desirable to have high pixels in many cases. The cameras 121 and 121 'may be installed on the terminal body to be rotatable or pop-up.

A flash 123 and a mirror 124 are additionally disposed adjacent to the camera 121 '. When the flash 123 photographs the subject with the camera 121 ', light is directed toward the subject. The mirror 124 allows the user to reflect on his or her face when the user wants to take a picture (self-portrait) using the camera 121 '.

A sound output unit 152 'may be additionally disposed on the rear side of the terminal body. The audio output unit 152 'may implement a stereo function together with the audio output unit 152 (see FIG. 2A), or may be used to implement a speakerphone mode during a call.

On the side of the terminal body, an antenna 116 for receiving a broadcast signal may be additionally disposed in addition to an antenna for a call. The antenna 116 forming part of the broadcast receiving module 111 (refer to FIG. 1) may be installed to be withdrawn from the terminal body.

Figure 4 is a rear perspective view showing the surface of the rear case by separating the rear cover of the mobile terminal according to an embodiment of the present invention. 4, the front case 101, the rear case 102, the rear cover (or battery cover) 103, the camera 121 ', the interface unit 170, microphone 122, speaker module sound output A portion 154152 ', a battery 191, a battery mounting portion 104, a USIM card mounting portion 166, and a memory card mounting portion 167 are shown.

On the surface of the rear case 102, a space for mounting external components such as a battery mounting unit 104, a USIM card mounting unit 105, and a memory card mounting unit 106 may be provided. In general, the external parts mounted on the surface of the rear case 102 are intended to expand the functions of the mobile terminal 100 in order to meet the diversified and diversified needs of the mobile terminal 100. to be.

As the performance of the mobile terminal 100 is diversified, the battery 191 may be configured as a replacement type as illustrated in FIG. 4 to compensate for the large power consumption. In the case of a replaceable type, a battery mounting part 104 is formed on the surface of the rear case 102 so that the user can attach and detach it. The battery mounting unit 104 is provided with a connection terminal to be electrically connected to a component mounted inside the case.

4, the USIM card mounting unit 166 or the memory card mounting unit 167 may be formed next to the battery mounting unit 104, or formed on the bottom surface of the battery mounting unit 104, so that the battery 191 When separated from the battery mounting portion 104, it may be formed to be exposed to the outside. In this case, the size of the battery mounting unit 104 may be larger, so that the battery 191 can be enlarged.

4, the USIM card mounting unit 166 or the memory card mounting unit 167 is illustrated to be mounted on the rear of the rear case 102, but can be inserted and removed from the mobile terminal 100 by inserting it from the side. Do.

The rear cover 103 covers the surface of the rear case, and secures the battery 191, a USIM card, a memory card, etc. mounted on the surface of the rear case 102 from being detached from external shocks or foreign substances. Protect the exterior parts. Recently, by adding a waterproof function, it may further include a waterproof structure (not shown) to be sealed when the rear case 102 and the rear cover 103 are coupled to prevent water from being injected into the exterior part.

Recently, the trend of the mobile terminal market is aimed at the development of various types of mobile terminals in order to meet the increasingly diverse consumer preferences. The types of mobile terminals developed in this way are concentrated in a form that can emphasize the portability of the mobile terminals. Mobile terminal types for high portability are mainly in the form of watches, glasses or necklaces that can be worn on the user's body. In these types of mobile terminals, there are cases in which it is difficult to apply the input / output means used in the same way. For example, since these mobile terminals have a relatively small display size when compared to a conventional mobile terminal, there is a need to consider other methods of output means. In particular, in the case of a necklace-type mobile terminal, because of its size limitation, a completely new type of input / output means is required, and embodiments of the present invention propose a control method of such a necklace-type mobile terminal.

5A is a diagram illustrating an example of a structure of a necklace-type mobile terminal according to an embodiment of the present invention. Referring to FIG. 5A, all or part of the configuration of the block diagram described above with reference to FIG. 1 may be configured to be included in the pendant portion 503 of the necklace. In addition, the mobile terminal 100 may include a necklace string 501 to be hung on the user's neck, and further includes a fastening unit 502 that can be fastened between both ends of the necklace string 501. can do. That is, in the state in which the fastening part 502 is disengaged, the mobile terminal of the necklace type shown in FIG. 5A is fastened to the neck of the user and fastened to both ends of the necklace string 501 using the fastening part 502. You can dial 100.

The necklace type mobile terminal 100 to be proposed in one embodiment of the present invention is proposed to control through a user's voice command in order to overcome the size limitation.

5B is a diagram illustrating another example of a structure of a necklace-type mobile terminal according to an embodiment of the present invention. Referring to FIG. 5B, in the structure of the necklace-type mobile terminal 100 described above with reference to FIG. 5A, it is a diagram illustrating a configuration further comprising earphones 602 and 602 '. The earphones 602 and 602 'may be electrically coupled through the mobile terminal 100 and the necklace string 501. Therefore, in receiving an audio signal through the mobile terminal 100, it will be possible to pass through the necklace string 501.

6 is a view showing an example of the front and rear of the necklace-type mobile terminal according to an embodiment of the present invention.

Pendant unit 503 according to an embodiment of the present invention may be divided into a front (Fig. 6 (a)) and a rear (Fig. 6 (b)). The front side may include a photo fixing frame to allow the user to carry the photo 603 like a pendant of a general necklace. Alternatively, the front of the pendant unit 503 is composed of a display unit 151, so that the necklace type mobile terminal 100 can operate such that an image set by the user is displayed on the front of the pendant unit 503.

The sensing unit 140 of the mobile terminal 100 according to an embodiment of the present invention may include a plurality of position sensing sensors for sensing the position of the pendant unit 503. That is, the necklace string 501 connected to the pendant unit 503 is a necklace of a plurality of position detection sensors 604a, 604b, ... for detecting the position of the pendant unit 503 by slide movement. It can be provided along the line 501. The plurality of position detection sensors 604a, 604b, ... may be arranged at predetermined intervals along the necklace string 501.

For example, when the pendant unit 503 is positioned on the 604b position sensor of the necklace string 501, the controller 180 is based on the signal detected from the 604b position sensor. You will be able to judge the location.

A microphone 122 may be located in one region 605 on the back of the pendant unit 503. According to the mobile terminal 100 according to at least one embodiment of the present invention, since the user recognizes a voice command and performs a predetermined function based on the recognized voice command, the microphone 122 is connected to the pendant unit 503 May be located. The position 605 of the plurality of position detection sensors 604a, 604b ... and the microphone 122 shown in FIG. 6 is only an example, and will not be limited to the position shown. In particular, the microphone 122 may be provided to be located at a point on the necklace string 501 in order to more clearly recognize a user's voice command.

FIG. 7 is a view showing a state in which the fastening part 502 is disengaged and a coupled state according to an embodiment of the present invention.

The control unit 180 of the mobile terminal 100 according to an embodiment of the present invention may detect the combined state and the released state through the fastening unit 502.

The necklace type mobile terminal 100 is limited in size due to the characteristic of having to wear around the neck, and the maximum energy that can be stored is limited according to the size limitation. Therefore, control of power consumption is inevitable. In one embodiment of the present invention, it is proposed to control the power consumption based on the coupling / disengagement detected through the fastening portion 502.

As shown in FIG. 7 (a), when it is sensed that the fastening part 502 is released, the controller 180 according to an embodiment of the present invention may control to deactivate at least one function (or module). In particular, in an embodiment of the present invention, in order to control the power consumption in the microphone 122, it is proposed to deactivate the microphone 122. Because, in order to identify not only the power consumption of the microphone 122 module itself, but also the received voice, the controller 180 is configured to calculate the power consumed in continuously analyzing the voice signal received through the microphone 122. This is because the waste is large. Therefore, in one embodiment of the present invention, it is proposed to minimize power waste through deactivation of the voice analysis operation as well as deactivation of the microphone 122 itself.

7 (b), upon detecting that the fastening portion 502 is coupled, the controller 180 according to an embodiment of the present invention may control to reactivate at least one function (or module) that has been deactivated. have. Since the function or module to be activated is the same as the function or module described through the deactivation, detailed description will be omitted.

Meanwhile, the activation / deactivation function may further include a connection with another mobile terminal. This embodiment will be described with reference to FIG. 8.

8 is a view showing a method of controlling a connection with another mobile terminal according to a state in which the fastening part 502 is disengaged and a coupled state according to an embodiment of the present invention.

8 (a) is a view showing a state in which the fastening portion 502 of the mobile terminal 100 according to an embodiment of the present invention is released. 8 (b) is a view showing a state in which the fastening portion 502 of the mobile terminal 100 according to an embodiment of the present invention is coupled. The controller 180 may attempt to connect with at least one other mobile terminal when it senses that it is coupled through the fastening unit 502. In this case, at least one other mobile terminal attempting to connect may include a mobile terminal having a history of previously connected. Alternatively, the at least one other mobile terminal attempting to connect may include a mobile terminal that is currently connectable.

That is, when the mobile terminal 100 is not coupled through the fastening unit 502, it is possible to minimize wasted power consumption by maintaining the connection with the other mobile terminal in the released state. Furthermore, when coupling is sensed through the fastening unit 502, there is an advantage that a function can be quickly provided to a user by automatically performing a connection with another mobile terminal.

In FIGS. 7 and 8, a method of controlling activation / deactivation of a predetermined function based on a result sensed through the fastening unit 502 has been described. In the embodiment to be described later through the drawings, a method of recognizing a voice command more accurately and subdivided will be described.

In the case of a method of recognizing a user's voice command and using the recognition result as an input means, there is a concern that the recognition rate is significantly lower as the user's voice command is longer. Furthermore, there is a need to improve these voice commands because there is also a concern that their intentions are exposed to others. Accordingly, in the embodiment to be described later in the present invention, a new method for a user input means capable of inputting a user's voice command more accurately is proposed without easily exposing the user's intention. In particular, in one embodiment of the present invention to be described with reference to FIGS. 9A to 9E, the necklace type mobile terminal 100 detects the position of the pendant portion 503 on the necklace string 501, and the pendant portion 503 It is suggested to perform different functions depending on the location of.

9A to 9E are mechanical structures and pendant parts of the pendant part 503 and the necklace string 501 in the necklace type mobile terminal 100 having the pendant part 503 according to an embodiment of the present invention. It is a figure showing the relative position of 503. The sensing unit 140 according to an embodiment of the present invention may further sense the position of the pendant unit 503.

The position of the pendant unit 503 sensed by the sensing unit 140 means a relative position on the necklace string 501. That is, the pendant portion 503 can slide on the necklace row 501 while being fastened to the necklace row 501. In addition, the sensing unit 140 may detect a relative position that changes depending on the slide of the necklace string 501 through the plurality of position detection sensors 604a, 604b ... described through FIG. 6. have. Hereinafter, in the detailed description, the position of the pendant portion 503 may mean indicating a relative position with the necklace string 501. The position of the pendant portion 503 according to an embodiment of the present invention can be expressed as a one-dimensional position because it moves on the necklace string 501 (that is, a 3mm point in the (+) direction from the basic position, or 1 cm in the (-) direction from the default position, etc.).

On the other hand, as described above, the position of the pendant unit 503 has been described as being sensed through a plurality of position sensing sensors arranged along the necklace string 501, but is not limited thereto. It will be apparent that the control method of the mobile terminal according to an embodiment of the present invention can detect the position of the pendant unit 503 by receiving a signal detected from a gyroscope sensor, an acceleration sensor, and / or a geomagnetic sensor. .

Referring to FIG. 9A, a diagram showing the position of the pendant unit 503 divided into three positions according to an embodiment of the present invention. When the user wears the necklace-type mobile terminal 100, as shown in FIG. 9A (a), the pendant portion 503 will naturally face downward by gravity. In describing one embodiment of the present invention, the position of the pendant portion 503 as in FIG. 9A (a) will be referred to as a basic position.

In one embodiment of the present invention, in the state of Figure 9a (a), when the user moves the position of the pendant unit 503 to the right, slides to the "A position" of Figure 9a (b), and to the left When moved, the slide can be moved to the “B position” in FIG. 9A (c). The terms “A position” and “B position” are used as a position, but when the position of the pendant part is within a predetermined range as well as a specific position, it may be determined as “A position”.

9B is a view showing an example of a fastening structure of the pendant portion 503 and the necklace string 501 according to an embodiment of the present invention. Referring to FIG. 9B, the pendant portion 503 is fastened to the ring portion 902, and the necklace string 501 penetrates the ring shape formed in the ring portion 902. By doing so, the pendant portion 503 may slide along the necklace string 501. Meanwhile, the structure of the ring portion 902 illustrated in FIG. 9B is exemplary, and the spirit of the present invention will not be limited to this structure.

9C is a diagram illustrating a display unit 151 in which a light emission type is changed according to a position of the pendant unit 503 according to an embodiment of the present invention.

In one embodiment of the present invention, it is proposed to perform a function that is distinguished according to the position of the pendant portion 503 (to be described later with reference to FIG. 10 below). The user should receive feedback classified accordingly, and will be able to enter the correct command. Therefore, in one embodiment of the present invention, it is proposed to display the light emission type of the display 151 differently according to the position of the pendant unit 503.

Referring to Figure 9c (a), the pendant portion 503 of the necklace type mobile terminal 100, the position of the pendant portion 503 that changes sequentially from the "basic position" to "A position" (A-> B-> It is a figure showing C). According to the position of the pendant portion 503 that changes sequentially as in FIG. 9C (a), the controller 180 controls to output the light emission pattern of the display 151 sequentially from 901-1 to 901-3. .

The same can be applied to "B position". Referring to Figure 9c (b), the pendant portion 503 of the necklace type mobile terminal 100, the position of the pendant portion 503 that changes sequentially from the "base position" to "B position" (A-> B-> It is a figure showing C). According to the position of the pendant unit 503 that changes sequentially as in FIG. 9C (b), the controller 180 controls to output the light emission pattern of the display 151 sequentially from 901-4 to 901-6. .

Meanwhile, in the above-described embodiment, the configuration in which the light emission pattern of the pendant unit 503 changes is described, but the present invention may be applied to any configuration that is not limited thereto and can provide feedback to the user. That is, the mobile terminal 100 according to an embodiment of the present invention, according to the sequentially changing position of the pendant unit 503, the intensity of the vibration of the pendant unit 503 gradually (or weakly) to be controlled Can be.

On the other hand, in the embodiment of the present invention related to Figure 9a, the position of the pendant portion 503 has been described to be limited to the slide movement along the necklace string 501. Meanwhile, in the embodiment related to FIG. 9D, an embodiment in which the position of the pendant portion 503 changes in a different direction will be described.

Referring to FIG. 9D (a), as shown in FIG. 9A (a), the basic position of the pendant portion 503 is shown. According to an embodiment of the present invention, the user proposes to use the pendant unit 503 by snapping it from the necklace string 501. The fastening structure of the pendant portion 503 and the necklace string 501 for this embodiment is shown in FIG. 9E.

9E is a view showing an example of a fastening structure of the pendant portion 503 and the necklace string 501 according to an embodiment of the present invention. As shown in the fastening structure described above with reference to Figure 9b may include a ring portion (902). Additionally, the pendant portion 503 according to the embodiment of the present invention illustrated in FIG. 9E may further include a length extension portion 903. Inside the length extension portion 903 coupled to the hook portion 902, an extension cable 904 is included, and one end of the extension cable 904 is coupled to the pendant portion 503, and the extension cable 904 is provided. The silver length extension portion 903 may be wound around the inside. When the user pulls the pendant portion 503, the extension cable 904 included in the length extension portion 903 may be pulled out and lengthened.

Fig. 9D (b) is a diagram showing the pendant portion 503 in a state where the above-described extension cable 904 is pulled out (hereinafter referred to as "pull position"). In one embodiment of the present invention, it is proposed to perform a function that distinguishes the "base position" and the "pull position" in FIG. 9D. That is, the controller 180 may perform a first function corresponding to a predetermined voice command in the "basic position", and perform a second function corresponding to a predetermined voice command in the "pull position". For example, in response to a voice command of "recording", in the case of "default location", the controller 180 may operate to record an audio signal input through the microphone 122 for 1 minute (first function). . Then, in response to the voice command of "recording", the control unit 180 in the "pull position", the audio signal input through the microphone 122 while the pendant unit 503 is extended cable 904 is extended To record (ie, when the extension cable 904 returns to its original state, recording is terminated) (second function). It will be apparent that the above-described first and second functions are only examples, and various functions including examples may be applied.

10 is a necklace-type mobile terminal 100 having a pendant unit 503 according to an embodiment of the present invention, in response to the recognition of the same voice command, different functions according to the position of the pendant unit 503 It is a figure showing an example of a method of performing. In the embodiment to be described in FIG. 10, an example of a function executed in correspondence with each of the positions identified in FIG. 9A will be described.

According to the embodiment described with reference to FIG. 10, a function performed by the controller 180 in response to the same voice command performs a function classified according to the position of the pendant unit 503 at a time when the voice command is received. In addition, in the example of FIG. 10, it is assumed that the name of a predetermined relative person “James” is input as the voice command.

Fig. 10 (a) shows an example of a function corresponding to the "basic position" shown in Fig. 9 (a). According to the illustration, in response to the voice command "James", the controller 180 can make a call with "James" as the first function corresponding to the "basic location".

Fig. 10 (b) shows an example of a function corresponding to "position A" shown in Fig. 9A (b). Similarly, when the voice command of "James" is received while the position of the pendant unit 503 is in the "A position", the controller 180 sends "James" a predetermined text message (preset text message) to the other party. Can be.

Fig. 10 (c) shows an example of a function corresponding to "B position" shown in Fig. 9A (c). When the voice command of "James" is received while the position of the pendant unit 503 is "B position", the controller 180 can perform a web search using "James" as a keyword.

Furthermore, in one embodiment of the present invention, it is proposed that different functions are mapped according to the presence or absence of other paired external devices. For example, it is assumed that other external devices are paired with the necklace-type mobile terminal 100-1 in a state in which functions such as the example of FIGS. 10A to 10C are mapped. Then, the fourth to sixth functions different from the above-described first to third functions may be mapped to respective positions. That is, when the command "James", which is the same voice command from the above-mentioned "basic location", is received, the corresponding fourth function may be a function of transmitting a call signal to the counterpart "James" through a paired external device. have. This is a function different from that of sending a call signal through the mobile terminal 100-1 itself, as in the first function described above. Similarly, the functions of FIGS. 5 and 6 may also operate to be distinguished from the functions described above.

Meanwhile, in the embodiment described with reference to FIG. 10, a predetermined function performed in response to the same predetermined voice command is an example of a method performed separately according to the position of the pendant unit 503. In one embodiment of the present invention, it is further proposed to classify the type of application performed according to the input voice command. This embodiment will be described below with reference to FIG. 11.

11 is a diagram illustrating an example of a method of classifying types of applications executed according to an input voice command format according to an embodiment of the present invention.

Referring to FIG. 11 (a), the user inputs a voice command (predetermined language format) “James” into the necklace type mobile terminal 100, and in FIG. 11 (b), the user enters the necklace type mobile terminal 100. A voice command (time format) of "4:30" is input to. The controller 180 may control to execute the phone application in response to the voice command "James", and may control to execute the alarm setting application in response to the voice command "4:30". Furthermore, the controller 180 may control to make a phone call using a person named “James” as a call counterpart after executing a phone application in response to a voice command “James”. Similarly, the controller 180 may control to set an alarm at 4:30 on the application after executing the alarm setting application in response to a voice command of "4:30".

The execution of the above-described application may be an application executed in the necklace type mobile terminal 100 itself, but may also mean an application executed in another external device connected to the necklace type mobile terminal 100. In such a case, the necklace type mobile terminal 100 may operate to transmit an execution command of a predetermined application to other connected external devices.

12A and 12B are diagrams illustrating the structure of a length adjusting unit for classifying the operation mode according to the length adjustment of the necklace string 501 itself and adjusting the necklace string 501 according to an embodiment of the present invention. .

12A shows three modes divided according to the length of the necklace string 501, and in the case of the length of the general necklace string 501, the basic mode (or the first mode) and the case where the necklace string 501 is shorter. In the sport mode (or the second mode), and finally longer than the normal necklace string 501, it will be referred to as the relaxation mode (or the third mode). In general, in the case of intense exercise, it may be convenient for a user to reduce the length of the necklace string 501 of the mobile terminal 100. In addition, when sleeping, it may be convenient to increase the length of the necklace string 501 generously. In one embodiment of the present invention, it is proposed to match functions more effectively in consideration of this situation.

12B is a diagram showing an example of a structure of a length adjusting unit 1201 for adjusting the length of the necklace string 501 according to an embodiment of the present invention. As described above, the pendant portion 503 is fastened by the necklace row 501 and the hook portion 902, and the mobile terminal 100 is provided with a length adjusting portion 1201 on one side of the necklace row 501. Doing. The length adjusting unit 1201 adjusts the length of the necklace string 501, and the sensing unit 140 may further sense the length of the necklace string 501 adjusted by the length adjusting unit 1201. In this way, the controller 180 can control the operation to be divided into a plurality of modes shown in FIG. 12A.

13 is a diagram illustrating an example of a method of performing a distinguishing function according to an embodiment of the present invention, as the length of the necklace string 501 is adjusted.

In the embodiment to be described in FIG. 13, an example of a function executed in correspondence to each of the positions identified in FIG. 12A will be described.

According to the embodiment described with reference to FIG. 13, a function performed by the controller 180 in response to the same voice command performs a function classified according to the position of the pendant unit 503 at the time the voice command is received. In addition, in the example of FIG. 13, it is assumed that a specific time of "6 o'clock" is input as the voice command.

13 (a) shows an example of a function corresponding to the “first mode” shown in FIG. 12a (a). As shown, in response to the voice command "6 o'clock", the controller 180 retrieves information about "6 o'clock" as a first function corresponding to "first mode" (for example, in a schedule application) You can search the saved schedule for 6 o'clock corresponding to today's date). Furthermore, the controller 180 may provide the searched result information to the user through voice output.

13 (b) shows an example of a function corresponding to “second mode” shown in FIG. 12a (b). As described above, the "second mode" in which the necklace string 501 is relatively short is a "sports mode", and in this mode, it may be assumed that the user is in a relatively active state. Accordingly, the controller 180 according to an embodiment of the present invention proposes to match a function used when there is a large amount of activity in response to a voice command input in the "second mode". Accordingly, when the voice command of "6 o'clock" is received while the position of the pendant unit 503 is "second mode", the controller 180 can control to feedback to the user that "6 o'clock" has been reached. have.

13 (c) shows an example of a function corresponding to the “third mode” shown in FIG. 9a (c). In the " third mode ", the length of the necklace string 501 is a " relaxation mode ", in a general case slightly longer than the length. In this mode, the user may assume that the user has a relatively small amount of activity. Accordingly, when the voice command of "6 o'clock" is received while the position of the pendant unit 503 is in the "third mode", the controller 180 uses the schedule management application to store the schedule at "6 o'clock". You will be able to control it.

The functions included in the above-described examples together with FIG. 13 are merely examples, and the spirit of the present invention will not be limited thereto. In FIG. 13, an example of classifying functions performed in correspondence with each mode has been described. In one embodiment of the present invention, it is further proposed to classify the types of external devices to be connected in correspondence with each mode. This embodiment will be described with reference to Figs. 14A and 14B.

14A and 14B are diagrams illustrating a method of classifying the types of external devices to be connected in correspondence to a divided mode according to an embodiment of the present invention. 14A and 14B show a plurality of external devices 100-2 to 100-5 connectable to the necklace-type mobile terminal 100-1 according to an embodiment of the present invention.

The state connected between the mobile terminal and the external device described in the embodiments of the present invention may mean a state in which data can be transmitted and received between the mobile terminal and the external device. In this case, it will be referred to as being connected or paired between the mobile terminal and the external device, and an external device connected to the necklace type mobile terminal according to an embodiment of the present invention will be referred to as a connected external device or a paired external device. .

14A shows the necklace type mobile terminal 100-1 in the "second mode" described above with reference to FIG. 12A, and FIG. 14B shows the necklace type in the "third mode" described above with reference to FIG. 12A. The mobile terminal 100-1 is shown. 14A and 14B, shadows are displayed on external devices having a connection priority in each situation.

In the above-described "second mode", when the user has a large amount of activity, that is, it can be assumed that he / she is exercising, the control unit 180 may perform the exercise and exercise among the other plurality of external devices 100-2 to 100-5. It can be controlled to preferentially connect related external devices. For example, the first external device 100-2 in the arm shape and the fourth external device 100-5 in the form of sneakers are mixed with other external devices, and the necklace type mobile terminal 100-1 is " When operating in the "second mode", the control unit 180 of the necklace type mobile terminal 100-1 is different from the first external device 100-2 in the form of arms and the fourth external device 100-5 in the form of sneakers. Priority connection to external devices is possible. This is because the user's usability can be improved by preferentially connecting an external device most likely to be used in a situation where there is a lot of user activity.

Priority in the example illustrated in FIG. 14A may be summarized as in Table 1 below.

Priority External device 1-1 100-2 1-2 100-5 2 100-3 3 100-4

Furthermore, the controller 180 is connected to any one of the external devices, such as the first external device 100-2 of the 1-1 rank and the fourth external device 100-5 of the 1-2 rank. When connected, it is possible to operate so as not to attempt to connect to the external device (second or third external device) with a lower priority. This is because, if it is assumed that the external external device is already connected, the possibility of using the external external device may be low, and a large amount of power consumption is expected to maintain the connection with many external devices simultaneously.

However, if any one of the external devices, such as the first external device 100-2 in the 1-1 rank and the fourth external device 100-5 in the 1-2 rank, is not connected, the controller 180 It may try to connect to other subordinated external devices (100-3 and 100-4).

Conversely, in the above-described "third mode", since it can be assumed that the user's exercise amount is low, the controller 180 controls to preferentially connect to the second and third external devices 100-3 and 100-4. Can be. As for the priority, the same may be applied as in the "second mode" described above.

As described above, the mobile terminal 100-1 according to an embodiment of the present invention may operate to establish a connection with a plurality of external devices and control a plurality of connected external devices. Accordingly, a method for selecting a specific external device when a specific external device is selected and controlled from a plurality of external devices is required. Accordingly, in one embodiment of the present invention, assuming that a connection is maintained with a plurality of external devices, it is proposed to select an external device to be controlled according to the position of the pendant unit 503. This embodiment will be described with reference to FIG. 15.

15 is a diagram illustrating a method of specifying any one of a plurality of external devices connected to a mobile terminal 100-1 according to an embodiment of the present invention.

15 (a) and (b), the two external devices 100-2 and 100-3 are connected to the necklace-type mobile terminal 100-1 according to an embodiment of the present invention. I assume. In one embodiment of the present invention, it is proposed to slide the pendant unit 503 in the direction of an external device to be controlled from among a plurality of connected external devices to select the external device.

In FIG. 15 (a), when the position of the pendant unit 503 slides to the "A position", the controller 180 controls the control signal to the first external device 100-2 located close to the "A position". Can send (1501). 15 (b), when the position of the pendant unit 503 slides to the "B position", the controller 180 controls the control signal to the second external device 100-3 located close to the "B position". (1502) can be transmitted.

In the above-described embodiment, in order to determine a nearby external device, in one embodiment of the present invention, the strength of a transmission / reception signal may be further considered. That is, when the position of the pendant portion 503 is moved to the "A position", the strength of the transmission / reception signal between the mobile terminal 100-1 and the first external device 100-2 is the mobile terminal 100-1. And it may be greater than the strength of the transmission and reception signal between the second external device (100-3). Then, the control unit 180 may transmit the control signal 1501 by identifying the first external device 100-2 that is in close proximity.

On the other hand, according to another embodiment of the present invention, regardless of the proximity of the distance, the controller 180 can be controlled to transmit a control signal for an external device matching each position of the pendant unit 503. That is, when the pendant unit 503 is moved to the "A position", the controller 180 transmits a control signal to an external device matching the "A position", and when it is moved to the "B position", to the "B position" It may operate to transmit the control signal of the matching external device.

In the above-described embodiment with reference to Fig. 15, contents including transmitting control signals 1501 and 1502 are included. An example of a control signal according to an embodiment of the present invention will be described in more detail with reference to FIG. 16.

16 is a diagram illustrating an example of a control signal transmitted to another external device connected to a necklace-type mobile terminal according to an embodiment of the present invention. In FIG. 16 (a), it is assumed that the necklace-type mobile terminal 100-1 and the first external device 100-2 are connected, and the display of the first external device 100-2 is locked.

Necklace-type mobile terminal 100-1 according to an embodiment of the present invention, when receiving a voice command "Camera", the first external device (100-2) connected to the necklace-type mobile terminal (100-1) ) Can transmit a control command 1601 to activate the camera 121. This is because the camera 121 is generally disabled when the display is locked and in a standby state.

FIG. 16 (b) is a diagram showing a state diagram of the first external device 100-2 that has received the control command 1601 and its state. In this drawing, the first external device 100-2 may control to output a preview screen for an image received through the activated camera 121 module together with output of a lock screen. In order to enter the photographing state through the general first external device 100-2, the display can be unlocked and then the camera application is executed. However, according to an embodiment of the present invention, there is an advantage that it is possible to easily enter the photographing state with a simple voice command. In particular, by outputting together with the lock screen of the first external device (100-2), it can be more useful because the first external device (100-2) can be locked while entering a picture taking state.

Furthermore, in order to take a picture in the state shown in FIG. 16 (b), in one embodiment of the present invention, it is proposed to shoot through an additional voice command. That is, when a voice command of "shooting" or "Camera" is received through the necklace type mobile terminal 100-1, it may be controlled to transmit a shooting control signal to the first external device 100-2. Alternatively, according to another embodiment of the present invention, the microphone of the first external device 100-2 may be activated and controlled to directly input a voice command through the activated microphone. Furthermore, it will be apparent that a picture can be taken by unlocking the display lock of the first external device 100-2 and selecting a displayed touch icon.

So far, the control method of the necklace type mobile terminal 100 has been described. In order to assist the above-described control method, information fed back to the user will be required. Accordingly, in one embodiment of the present invention described below, feedback provided to the user according to a predetermined state of the necklace-type mobile terminal 100 will be described.

17 is a diagram illustrating an example of feedback provided to a user when a necklace-type mobile terminal 100-1 and another mobile terminal are connected according to an embodiment of the present invention.

Referring to FIG. 17 (a), the necklace type mobile terminal 100-1 does not have any external devices connected thereto, and the pendant unit 503 is displayed in a first color. In FIG. 17 (b), it is assumed that the necklace type mobile terminal 100-1 is paired with other external devices 100-2 and 100-3. The controller 180 may control the color to be output by changing the color to the second color of the pendant unit 503 so as to inform the user that it is paired with other external devices 100-2 and 100-3. In the example illustrated in FIG. 17, although the color of the pendant unit 503 itself is illustrated as being changed, other display changes may also be possible.

18 is a diagram illustrating an example of a method of displaying to a user according to success or failure of speech recognition according to an embodiment of the present invention.

FIG. 18 (a) is a diagram showing the color patterns 1501 to 1503 of the pendant unit 503 that change according to the success of speech recognition. FIG. 18 (b) is a diagram showing the color patterns 1504 to 1506 of the pendant portion 503 that changes according to a voice recognition failure. In one embodiment of the present invention, it is proposed that the color of the pendant unit 503 changes together according to the speech recognition process, and that the color change according to the failure and success of speech recognition is identified. By doing so, the user can check the degree of the speech recognition process and the success / failure through the color change of the pendant unit 503.

Similarly, the color change of the pendant unit 503 is only an example according to an embodiment of the present invention, and embodiments of the present invention may be applied through visual classification according to another display method.

In addition to visual division, an embodiment of the present invention will further propose a method for providing feedback to a user using vibration. This embodiment will be described with reference to Figs. 19A to 21.

19A and 19B are diagrams illustrating an example of a method of feedback using the vibration of a necklace string in a necklace type mobile terminal 100-1, according to an embodiment of the present invention. In the embodiment related to FIGS. 19A and 19B, the necklace string 501 may vibrate and alarm the user, and further, the vibration is divided by separating the left 501-1 and right 501-2 of the necklace string. Suggest to do so.

In FIGS. 19A (A) and (B), it is assumed that the necklace-type mobile terminal 100-1 is connected to 100-2 and the second external device 100-3. In this state, when a predetermined alarm is received (for example, a phone call signal) through the first external device 100-2, and the necklace type mobile terminal 100-1 receives the alarm, the controller 180 As shown in FIG. 19A (a), the necklace string 501-1 corresponding to the direction of the first external device 100-2 is controlled to vibrate. Conversely, when a predetermined alarm is received through the second external device 100-3, and the alarm is received by the necklace-type mobile terminal 100-1, the control unit 180 performs a second operation as in FIG. 19A (B). The necklace string 501-2 corresponding to the direction of the external device 100-3 is controlled to vibrate.

Accordingly, the user will be able to determine through which external device the alarm corresponding to the vibration is received according to the position where the necklace string 501 vibrates. Hereinafter, an example of a method of responding to an alarm when the aforementioned alarm is received will be described in FIG. 19B.

19B (a) shows a state in which the necklace type mobile terminal 100-1 and the first external device 100-2 and the second external device 100-3 are connected, and the first external device ( It is assumed that a predetermined alarm (for example, a call signal) is received through 100-2). 19A, the necklace string 501-1 corresponding to the direction of the first external device 100-2 may vibrate. In this state, upon receiving an input for sliding the pendant unit 503 in the direction of the vibrating necklace string 501-1, the controller 180 receives the input to the predetermined alarm through the first external device 100-2. It is suggested to respond. That is, the controller 180 can transmit a control signal to the first external device 100-2 in response to the predetermined alarm. If the predetermined alarm is the reception of a call signal, the corresponding response may be a response to the call signal.

Meanwhile, in the case of feedback using the above-described vibration, it is proposed to guide the amount of information by adjusting the range of the vibration. This embodiment will be described with reference to FIG. 20.

20 is a diagram illustrating a method of adjusting a range of vibration of a necklace string in proportion to the amount of information to be guided to a user according to an embodiment of the present invention.

20 (a) to (c) is a diagram showing a state in which the intensity of vibration of the left necklace string 501-1 is increased from 1 to 3 steps, the controller 180 is information to be guided to the user As described above, the amount of vibration may be increased as described above. The vibration range of the left necklace string 501-1 in FIG. 20 (a), which is the range of the first-stage vibration, is shown as a partial region of the pendant unit 503, but the necklace string 501- The vibration area of 1) is gradually increasing.

According to the embodiment of FIG. 20, the user has the advantage of being able to estimate the amount of information to be alarmed.

Figure 21, according to an embodiment of the present invention, when receiving an alarm signal from the first external device (100-2) connected to the necklace-type mobile terminal (100-1), guides by vibrating the necklace string (501) It is a figure showing a method.

When the alarm time set in the first external device 100-2 arrives, the controller 180 of the necklace-type mobile terminal 100-1 may receive an alarm control signal from the first external device 100-2. have. In addition, the controller 180 receiving the alarm control signal may transmit the alarm signal to the user by controlling the necklace string 501 to vibrate.

In general, the first external device 100-2 may be carried by a user in a pocket or a bag, so that an alarm signal may be missed. However, when an alarm is received through the vibration of the necklace string 501, there is an advantage that a reliable alarm signal can be received.

On the other hand, in the case of the necklace type mobile terminal 100-1, since it is impossible to apply the above-described methods when the wear is released, it may be more effective to use the mobile terminal having a general form. Therefore, in one embodiment of the present invention, when the release of the wear of the necklace type mobile terminal 100-1 is detected, the information stored in the necklace type mobile terminal 100-1 in response to the detected release is transmitted to the general type mobile terminal. Suggest to deliver. This embodiment will be described with reference to FIG. 22.

22 is a diagram illustrating a method for transmitting information when the necklace type mobile terminal 100-1 is released according to an embodiment of the present invention. Referring to FIG. 22 (a), it is assumed that the necklace type mobile terminal 100-1 and the first external device 100-2 are paired. When the release of the wear of the necklace-type mobile terminal 100-1 is detected in the state of FIG. 22 (a), the controller 180 removes at least one setting information stored in the necklace-type mobile terminal 100-1. 1 can be controlled to transmit to the external device (100-2) (see Fig. 22 (b)). The at least one setting information may include at least one of a set alarm list, a stored voice memo, and a stored contact list.

23 is a necklace type mobile terminal 100 having a pendant unit 503 according to an embodiment of the present invention, in response to the recognition of the same voice command, different functions according to the position of the pendant unit 503 It is a diagram showing a flowchart of the first method for performing.

In step S2301, the controller 180 detects the position of the pendant unit 503. In step S2302, the controller 180 receives a voice command from the user through the microphone 122. In step S2303, the controller 180 recognizes the user's voice command received in step S2302. In step S2304, the controller 180 determines whether the received voice command matches a predetermined voice command, and if the result of the determination does not match, the controller 180 may return to step S2302. If it is determined in step S2304 that a match is made, the process may proceed to step S2305.

In step S2305, the controller 180 proceeds to step S2306 when the position is included in the first range, and proceeds to step S2307 if the position is included in the second range according to the detected position of the pendant unit. In step S2306, the controller 180 performs the first function of the mobile terminal 100 and ends. In step S2307, the controller 180 performs the second function of the mobile terminal 100 and ends.

24 is a necklace type mobile terminal 100 having a pendant unit 503 according to an embodiment of the present invention, in response to the recognition of the same voice command, different functions according to the position of the pendant unit 503 It is a diagram showing a flowchart of a second method for performing.

In step S2401, the controller 180 detects the position of the pendant unit 503. In step S2402, the controller 180 proceeds to step S2403 when the location is included in the first range, and proceeds to step S2404 if the location is included in the second range according to the detected position of the pendant unit.

In step S2403, the controller 180 receives a voice command from the user through the microphone 122. In step S2404, the controller 180 recognizes the user's voice command received in step S2403. In step S2405, the controller 180 determines whether the received voice command matches a predetermined voice command, and if the result of the determination does not match, the controller 180 may return to step S2403. If it is determined in step S2304 that a match is made, the process may proceed to step S2406.

In step S2406, the controller 180 ends after performing the first function of the mobile terminal 100.

In step S2407, the controller 180 receives a voice command from the user through the microphone 122. In step S2408, the controller 180 recognizes the user's voice command received in step S2407. In step S2409, the controller 180 determines whether the received voice command matches a predetermined voice command, and if the result of the determination does not match, the controller 180 may return to step S2407. If it is determined in step S2309 that a match is made, the process may proceed to step S2410.

In step S2410, the controller 180 performs the second function of the mobile terminal 100 and ends.

It will be apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit and essential features of the present invention.

The present invention described above can be embodied as computer readable codes on a medium on which a program is recorded. The computer-readable medium includes any kind of recording device in which data readable by a computer system is stored. Examples of computer-readable media include ROM, RAM, CD-ROM, magnetic tapes, floppy disks, optical data storage devices, etc., which are also implemented in the form of carrier waves (eg, transmission over the Internet). It also includes. In addition, the computer may include a control unit 180 of the terminal.

Accordingly, the above detailed description should not be construed as limiting in all respects, but should be considered illustrative. The scope of the invention should be determined by rational interpretation of the appended claims, and all changes within the equivalent scope of the invention are included in the scope of the invention.

100: mobile terminal 110: wireless communication unit
120: A / V input / output unit 130: User input unit
140: sensing unit 150: output unit
160: memory 170: interface
180: control unit 190: power supply unit

Claims (18)

In the mobile terminal in the form of a necklace,
MIC;
A necklace for hanging on the user's neck;
A pendant part that is fastened to the necklace and slides along the necklace;
A sensing unit configured to sense the position of the pendant unit according to the slide movement of the pendant unit; And
Recognize the voice command received through the microphone,
In response to the first voice command recognized through the microphone, the first function is performed when the detected position of the pendant unit falls within the first range, and the second function is performed when the detected position of the pendant unit falls within the second range. To perform the function,
Containing a control unit,
Mobile terminal. The method of claim 1, wherein the control unit,
In response to the second voice command recognized through the microphone, determine the type of the second voice command,
Based on the determined type, a predetermined application is executed,
The type includes at least one of a word type, a numeric type and a time type,
Mobile terminal. According to claim 2, The control unit,
When the determined type is a word type, a call transmission / reception application is executed, and a call signal is sent to a call counterpart corresponding to the recognized second voice command.
Mobile terminal. According to claim 2, The control unit,
When the determined type is a time type, an alarm setting application is executed, and an alarm is set for an alarm setting time corresponding to the recognized second voice command.
Mobile terminal. According to claim 1,
Further comprising a length adjusting portion for adjusting the length of the necklace,
The control unit, in response to the recognized third voice command, performs a third function when the length of the necklace string adjusted by the length adjusting unit is within a third range, and the necklace string adjusted by the length adjusting unit. To perform a fourth function when the length of is within a fourth range,
Mobile terminal. The method of claim 5,
Further comprising a wireless communication unit for establishing a connection with a plurality of external devices,
The control unit,
Establishing a connection with the plurality of external devices through the wireless communication unit,
When the length of the necklace string adjusted by the length adjusting unit is within the third range, the connection with the first external device is preferentially established, and when the length of the necklace string adjusted by the length adjusting unit is within the fourth range, Prioritizing establishing a connection with a second external device,
Mobile terminal. According to claim 1,
Further comprising a wireless communication unit for establishing a connection with a plurality of external devices,
The control unit,
Establishing a connection with the plurality of external devices through the wireless communication unit,
When the position of the detected pantent unit is within the first range, a control signal is transmitted to a third external device, and when the position of the detected pantent unit is within a second range, a control signal is transmitted to a fourth external device. doing,
Mobile terminal. According to claim 1,
Further comprising a wireless communication unit for establishing a connection with at least one external device,
The control unit,
Establishing a connection with the at least one external device through the wireless communication unit,
In response to the recognized fourth voice command, transmitting a control signal to the connected at least one external device,
Mobile terminal. The method of claim 8,
The transmitting control signal includes a command for activating the camera of the connected mobile terminal and outputting a preview screen received through the activated camera.
Mobile terminal. A method for controlling a mobile terminal in the form of a necklace including a microphone, a necklace for hanging on the neck of a user, and a pendant unit that is fastened to the necklace and slides along the necklace,
Sensing the position of the pendant unit according to the slide movement of the pendant unit;
Recognizing a voice command received through the microphone; And
In response to the first voice command recognized through the microphone, the first function is performed when the detected position of the pendant unit falls within the first range, and the second function is performed when the detected position of the pendant unit falls within the second range. Comprising performing a function,
Method of controlling a mobile terminal. delete delete delete delete delete delete delete delete

Images