KR101952687B1 - Mobile terminal and method for controlling the same - Google Patents

Abstract

The present invention relates to a mobile terminal and a control method thereof, in which usage of a terminal can be realized by further considering convenience of a user. According to at least one of the embodiments of the present invention, it is advantageous to recognize the user's voice in a state for editing the home screen and control the scrolling of the screen as a result of the recognized voice, thereby facilitating the editing.

Description

[0001] MOBILE TERMINAL AND METHOD FOR CONTROLLING THE SAME [0002]

The present invention relates to a mobile terminal and a control method thereof, in which usage of a terminal can be realized by further considering convenience of a user.

The terminal can move And can be divided into a mobile / portable terminal and a stationary terminal depending on whether the mobile terminal is a mobile terminal or a mobile terminal. The mobile terminal can be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry the mobile terminal.

Such a terminal has various functions, for example, in the form of a multimedia device having multiple functions such as photographing and photographing of a moving picture, reproduction of a music or video file, reception of a game and broadcasting, etc. .

In order to support and enhance the functionality of such terminals, it may be considered to improve the structural and / or software parts of the terminal.

In recent years, various applications have been developed to assist mobile terminals. In order to effectively access such various applications, it is required that the home screen screen be edited to suit individual users. Therefore, a method of easily moving and registering icons and widgets on the home screen screen needs to be studied.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a mobile terminal and a control method thereof that can provide a home screen editing method which is considered to satisfy the above-mentioned necessity and which considers user's convenience.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are not restrictive of the invention, unless further departing from the spirit and scope of the invention as defined by the appended claims. It will be possible.

According to an aspect of the present invention, there is provided a touch screen display device including a touch screen, a microphone, and at least one object to be output to the touch screen, wherein a touch of the object is maintained through the touch screen, And a control unit for controlling the display unit to scroll the screen displayed on the touch screen when it is recognized.

According to another aspect of the present invention, there is provided a method of controlling a microphone, including the steps of recognizing voice through a microphone, outputting at least one object to a touch screen, And scrolling the screen displayed on the touch screen when the first voice is recognized through the control unit.

Effects of the mobile terminal and the control method according to the present invention will be described as follows.

According to at least one embodiment of the present invention, there is an advantage that it is possible to more easily control the editing process of changing the position of the object being output on the home screen of the mobile terminal or registering a new object on the home screen.

The effects obtained by the present invention are not limited to the above-mentioned effects, and other effects not mentioned can be clearly understood by those skilled in the art from the following description will be.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.
2A is a front perspective view of a mobile terminal according to an embodiment of the present invention.
2B is a rear perspective view of a mobile terminal according to an embodiment of the present invention.
3 is a flowchart of an embodiment of a method of controlling a mobile terminal according to the present invention.
4 to 8 are state diagrams of a display screen on which an embodiment of a method of controlling a mobile terminal according to the present invention is implemented.
9 is a diagram illustrating a state of a lock screen of a mobile terminal according to an exemplary embodiment of the present invention.
10 is a flowchart illustrating a method of unlocking a mobile terminal according to an embodiment of the present invention.

Hereinafter, a mobile terminal related to the present invention will be described in detail with reference to the drawings. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The mobile terminal described in this specification may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), navigation and the like. However, it will be understood by those skilled in the art that the configuration according to the embodiments described herein may be applied to a fixed terminal such as a digital TV, a desktop computer, and the like, unless the configuration is applicable only to a mobile terminal.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The mobile terminal 100 includes a wireless communication unit 110, an audio / video input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, A controller 170, a controller 180, a power supply 190, and the like. The components shown in FIG. 1 are not essential, and a mobile terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more broadcast receiving modules 1100 may be provided to the mobile terminal 100 for simultaneous broadcast reception or broadcast channel switching for at least two broadcast channels.

The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information means information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

For example, the broadcast receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S), a Media Forward Link Only (Mobile Broadcasting Business Management System), ISDB-T (Integrated Services Digital Broadcasting (ISDB-T)), Digital Multimedia Broadcasting (MBMS) Digital Broadcast-Terrestrial) or the like. Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 may be coupled to a base station, an external terminal, or a server on a mobile communication network, such as, but not limited to, Gobal System for Mobile communications (GSM), Code Division Multiple Access (CDMA), Wideband CDMA Transmits and receives wireless signals with one. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 100. Wireless Internet technologies include WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), GSM, CDMA, WCDMA, LTE Evolution (but not limited to) may be used.

The wireless Internet module 113, which performs wireless Internet access through the mobile communication network, is connected to the mobile communication module 110 through the mobile communication network, for example, from the viewpoint that the wireless Internet access by Wibro, HSDPA, GSM, CDMA, WCDMA, LTE, (112). ≪ / RTI >

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used as a short range communication technology.

The position information module 115 is a module for obtaining the position of the mobile terminal, and a representative example thereof is a Global Position System (GPS) module. According to the current technology, the position information module 115 calculates distance information and accurate time information from three or more satellites, and then applies a trigonometric method to the calculated information to obtain three-dimensional (3D) information according to latitude, longitude, The current position information can be accurately calculated. At present, a method of calculating position and time information using three satellites and correcting an error of the calculated position and time information using another satellite is widely used. In addition, the GPS module 115 can calculate speed information by continuously calculating the current position in real time.

Referring to FIG. 1, an A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ Two or more cameras 121 may be provided depending on the use environment.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. Various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a key pad, a dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the current state of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, And generates a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. It is also possible to sense whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor 141.

The output unit 150 is for generating output related to the visual, auditory or tactile sense and includes a display unit 151, an audio output module 152, an alarm unit 153, and a haptic module 154 .

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the mobile terminal 100 is in the video communication mode or the photographing mode, the photographed and / or received video or UI and GUI are displayed.

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display display, and a 3D display.

Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED) and the like. The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

There may be two or more display units 151 according to the embodiment of the mobile terminal 100. For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from one another or may be disposed integrally with each other, or may be disposed on different surfaces.

(Hereinafter, referred to as a 'touch screen') in which a display unit 151 and a sensor for sensing a touch operation (hereinafter, referred to as 'touch sensor') form a mutual layer structure, It can also be used as an input device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display unit 151 or a capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller (not shown). The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like.

The proximity sensor 141 may be disposed in an inner region of the mobile terminal or in the vicinity of the touch screen, which is enclosed by the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of recognizing that the pointer is positioned on the touch screen while the pointer is not in contact with the touch screen is referred to as "proximity touch" The act of actually contacting the pointer on the touch screen may be referred to as "contact touch. &Quot; The location where the pointer is proximately touched on the touch screen may refer to a position where the pointer corresponds vertically to the touch screen when the pointer is touched.

The proximity sensor detects a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

The audio output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 152 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The audio output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. In this case, the display unit 151 and the audio output module 152 may be a type of the alarm unit 153. The display unit 151 and the audio output module 152 may be connected to the display unit 151 or the audio output module 152, .

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 154 is vibration. The intensity and pattern of the vibration generated by the haptic module 154 are controllable. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 154 may include a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or a suction force of the air through the injection port or the suction port, a touch on the skin surface, contact with an electrode, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 154 can be implemented not only to transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sensation of the finger or arm. At least two haptic modules 154 may be provided according to the configuration of the mobile terminal 100.

The memory 160 may store a program for processing and controlling the control unit 180 and temporarily store the input / output data (e.g., telephone directory, message, audio, still image, For example. The memory 160 may store the frequency of use of each of the data (for example, each telephone number, each message, and frequency of use for each multimedia).

In addition, the memory 160 may store data on vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM A disk, and / or an optical disk. The mobile terminal 100 may operate in association with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or supplies power to each component in the mobile terminal 100 or transmits data to the external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip for storing various information for authenticating the use right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM), a general user authentication module A Universal Subscriber Identity Module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Therefore, the identification device can be connected to the mobile terminal 100 through the port.

When the mobile terminal 100 is connected to an external cradle, the interface unit may be a path through which power from the cradle is supplied to the mobile terminal 100, or various command signals input by the user to the cradle may be transmitted And may be a passage to be transmitted to the terminal 100. The various command signals or the power source inputted from the cradle may be operated as a signal for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile terminal. For example, voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

The controller 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of a processor, controllers, micro-controllers, microprocessors, and other electronic units for performing other functions. In some cases, The embodiments described may be implemented by the control unit 180 itself.

According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code can be implemented in a software application written in a suitable programming language. The software code is stored in the memory 160 and can be executed by the control unit 180. [

2A is a perspective view of an example of a mobile terminal or a mobile terminal according to the present invention.

The disclosed mobile terminal 100 includes a bar-shaped terminal body. However, the present invention is not limited thereto, and can be applied to various structures such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are relatively movably coupled.

The body includes a case (a casing, a housing, a cover, and the like) which forms an appearance. In this embodiment, the case may be divided into a front case 101 and a rear case 102. [ A variety of electronic components are embedded in the space formed between the front case 101 and the rear case 102. At least one intermediate case may be additionally disposed between the front case 101 and the rear case 102. [

The cases may be formed by injection molding a synthetic resin, or may be formed to have a metal material such as stainless steel (STS) or titanium (Ti) or the like.

A display unit 151, an audio output unit 152, a camera 121, user input units 130/131 and 132, a microphone 122, an interface unit 170, and the like are disposed in the front body 101 .

The display unit 151 occupies most of the main surface of the front case 101. A sound output unit 152 and a camera 121 are disposed in an area adjacent to one end of both ends of the display unit 151 and a user input unit 131 and a microphone 122 are disposed in an area adjacent to the other end. The user input unit 132 and the interface unit 170 may be disposed on the side surfaces of the front case 101 and the rear case 102. [

The user input unit 130 is operated to receive a command for controlling the operation of the mobile terminal 100 and may include a plurality of operation units 131 and 132. The operation units 131 and 132 may be collectively referred to as a manipulating portion.

The contents inputted by the first or second operation unit 131 or 132 may be variously set. For example, the first operation unit 131 receives commands such as start, end, scroll, and the like, and the second operation unit 132 controls the size of the sound output from the sound output unit 152 or the size of the sound output from the display unit 151 The touch recognition mode can be activated or deactivated.

2B is a rear perspective view of the mobile terminal shown in FIG. 2A.

Referring to FIG. 2B, a camera 121 'may be further mounted on the rear surface of the terminal body, that is, the rear case 102. The camera 121 'may have a photographing direction substantially opposite to that of the camera 121 (see FIG. 2A), and may be a camera having the same or different pixels as the camera 121.

For example, the camera 121 may have a low pixel so that the face of the user can be photographed and transmitted to the other party in case of a video call or the like, and the camera 121 ' It is preferable to have a large number of pixels. The cameras 121 and 121 'may be installed in the terminal body so as to be rotatable or pop-upable.

A flash 123 and a mirror 124 may be additionally disposed adjacent to the camera 121 '. The flash 123 illuminates the subject when the subject is photographed by the camera 121 '. The mirror 124 allows the user to illuminate the user's own face or the like when the user intends to shoot himself / herself (self-photographing) using the camera 121 '.

An acoustic output 152 'may be additionally disposed on the rear surface of the terminal body. The sound output unit 152 'may implement the stereo function together with the sound output unit 152 (see FIG. 2A), and may be used for the implementation of the speakerphone mode during a call.

In addition to the antenna for communication, a broadcast signal receiving antenna 116 may be additionally disposed on the side of the terminal body. The antenna 116, which forms part of the broadcast receiving module 111 (see FIG. 1), can be installed to be able to be drawn out from the terminal body.

A power supply unit 190 for supplying power to the mobile terminal 100 is mounted on the terminal body. The power supply unit 190 may be built in the terminal body or may be detachable from the outside of the terminal body.

The rear case 102 may further include a touch pad 135 for sensing a touch. The touch pad 135 may be of a light transmission type for the display unit 151. [ In this case, if the display unit 151 is configured to output time information on both sides (i.e., in the directions of both the front and back sides of the mobile terminal 100), the time information is also recognized through the touch pad 135 . The information output on both sides may be all controlled by the touch pad 135. [

Meanwhile, the display for exclusive use of the touch pad 135 may be separately installed, so that the touch screen may be disposed in the rear case 102 as well.

The touch pad 135 operates in correlation with the display portion 151 of the front case 101. The touch pad 135 may be disposed parallel to the rear of the display unit 151. The touch pad 135 may have a size equal to or smaller than that of the display unit 151.

Hereinafter, embodiments related to a control method that can be implemented in the mobile terminal configured as above will be described with reference to the accompanying drawings.

Hereinafter, it will be assumed that the display module 151 is a touch screen, since the following embodiments can be more easily implemented when the display module 151 is configured as a touch screen. Hereinafter, the display screen of the touch screen 151 will be referred to as a reference numeral 400.

3 is a flowchart of an embodiment of a method of controlling a mobile terminal according to the present invention. 4 to 8 are state diagrams of a display screen on which an embodiment of a method of controlling a mobile terminal according to the present invention is implemented.

One of the pages of two or more home screens prepared in the mobile terminal 100 is displayed on the first area 400A of the touch screen 400 as shown in (4-1) . In the second area 400B of the touch screen 400, an icon tray capable of collecting and arranging one or more icons frequently used by the user can be displayed. 4-1 in FIG. 4, the icon tray 2001 is provided with a "dialing" icon 2001, an "address book" icon 2003, a "message" icon 2005 and a " Are illustrated.

I will elaborate further on the home screen.

In general, the home screen may be defined as a screen displayed on the touch screen for the first time when the lock state of the touch screen is released, and one or more icons or widgets for executing an application or an internal function may be displayed [S301]. In this case, when a predetermined touch gesture is performed on the touch screen, the two or more home screen pages may be sequentially displayed one by one. Other icons (widgets) may be placed in each of the home screen pages [S301]. In this specification, the touch gesture refers to a concept including a simple touch, a double touch, a long touch, a multi-touch, a touch drag, and a touch flicking on the touch screen.

Hereinafter, for the sake of simplicity of explanation, it is assumed that three home screen pages, that is, first to third pages are preliminarily prepared, and the first one of them is displayed in (4-1) of FIG.

As shown in (4-1) to (4-3) of FIG. 4, each time the touch drag operation is performed on the touch screen 400 in the left direction, for example, (4-1)) => second page ((4-2) in Fig. 4) => third page (Fig.4-4) on the touch screen 400 = The first page (Fig. 4 (4-1)) can be sequentially displayed. Although not shown, every time the touch drag in the right direction is performed, in the opposite direction (i.e., the first page (Fig. 4 (4-1)) => the third page (4-3 in Fig. The second page (Fig. 4 (4-2)) => the first page (Fig. 4 (4-1)) ... the pages may be sequentially displayed.

Hereinafter, in the detailed description and claims included in the description of the present invention, the pages are sequentially displayed in the home screen, which will be referred to as a screen is scrolled. That is, when the screen is switched from the first page (Fig. 4 (4-1)) to the second page (Fig. 4 (2)), it can be said to scroll in the left direction. When the page screen of the home screen is switched in the opposite direction, it can be said that the screen is scrolled in the right direction.

At least one icon or widget may be displayed on each of the home screens as described above (S301). The icon may be an application icon for executing the application when touched. The widget may be an application widget for allowing only a limited function of the application to be always executed on the home screen. The icon and the widget may be collectively referred to as an " object ".

The position of the object is shifted according to the user's need on the home screen. In the embodiment of the present invention, in order to change the position of the object, it is necessary to enter the edit mode of the object. Furthermore, in the embodiment of the present invention, editing means not only changing the position of an object being output on the home screen, but also registering or deleting a new object to be output on the home screen. Registration means to control the icon of the application, which is not displayed on the home screen, to be displayed on the home screen.

5A shows an example for entering the editing mode.

Referring to FIG. 5A, when the controller 180 receives an input for holding a touch for an object for a predetermined time, the controller 180 can switch to the edit mode of FIG. 5A (b). Alternatively, the control unit 180 can switch to the edit mode of Fig. 5A (b) corresponding to another predetermined input.

Referring to FIG. 5A, in the edit mode, a grid 501 for aligning the positions of the icons on the home screen may be output. The controller 180 may arrange the position of the icon based on the grid 501.

Referring to FIG. 5A, in the edit mode, when the controller 180 detects an input for dragging while maintaining the touch on the object, the controller 180 controls the object to move to the dragged position. The control unit 180 may output an indicator 502 indicating the position of the object moved by the drag in the current grid 501.

When the touch for this object is released in this state, the control unit 180 can control to fix the position of the object to the position where the touch is released (Fig. 5 (c)).

In FIG. 5A, the control method in which the position of the "A object" moves within the first page has been described. Furthermore, a method of moving an object to another page as well as a control method of moving only within the first page will be described.

5B is a diagram illustrating a general method of moving an object to another page. Figure 5B (a) shows a method for scrolling to the right page (i.e., scrolling left). 5B, the controller 180 senses an input of dragging to the right edge of the home screen while keeping a touch on a predetermined object, and the touch input at the right edge is maintained for a predetermined time or more , Scroll the page of the home screen to the left direction (the scroll in the opposite direction is a dragging to the left corner of the home screen, and then touches the left corner for a predetermined time or longer). When the page of the home screen is scrolled to the left, the control unit 180 can display the next page (the second page in the above example) of the home screen as shown in FIG. 5B (b).

5B, in order to scroll the page of the home screen in the edit mode, the controller 180 scrolls to one corner of the page of the home screen and touches the corner of the page for a predetermined time or longer do.

Meanwhile, an embodiment of the present invention proposes a page scroll method of a home screen in which the user's convenience is improved in the edit mode. This method will be described below with reference to FIG. 6. Referring to FIG. 6 (a), a state diagram in the edit mode of FIG. 5 (b) is shown. 5A, when the touch input is received for a predetermined time or longer with respect to the object to be edited, the control unit 180 can switch to the edit mode corresponding to the touch input.

In the embodiment of the present invention, when the predetermined voice is recognized through the microphone 122 while keeping the touch on the object, the control unit 180 controls to scroll the screen.

For example, when the user touches the "A object" in FIG. 6A and recognizes the voice "left scroll" from the user through the microphone 122, In the state diagram of Fig. 6 (a) in which one page is output, the state diagram of Fig. 6 (b) outputting the second page can be switched.

In contrast to the above, when the user holds the touch for the "A object" and the voice "right scroll" is recognized by the user via the microphone 122, the control unit 180 outputs the first page The third page can be switched in the state diagram of Fig. 6 (a).

In the method described with reference to FIG. 4, a touch & drag gesture must be input to the touch screen in order to scroll the screen. However, since the touch and drag gesture input in this method can not be input when the touch is maintained, another alternative input is required. Therefore, in the embodiment of the present invention, it is proposed that the screen is scrolled when a predetermined voice is recognized as described above.

When the user touches the "A object ", the control unit 180 controls the microphone 122 to output an indicator 601 indicating that the user is recognizing the voice on the touch screen have. When the indicator 601 is held on the screen, the user can recognize the voice and scroll the screen.

As shown in FIG. 6 (b), the control method of disposing the specific position of the icon on the screen converted to the second page is the same as that described with reference to FIG. 5A, and will be omitted.

6 (c) is a diagram showing a final state diagram in which "A object" is placed on the second page. As described above, according to the embodiment of the present invention, it is possible to provide a control method considering user's convenience when switching the position of the object to another home screen.

According to an example of the control method according to the embodiment of the present invention, this control method can also be applied to registering a new object on the home screen. Hereinafter, an example of registering a new object on the home screen in Figs. 7 and 8 will be described.

7 (a) shows a screen in which a list of applications is output in the form of an icon. When the user touches an icon to be executed in the application list, the control unit 180 can execute the corresponding application in response to the input. Also, it is possible to register a specific icon in the icon list of this application on the home screen. In this case, the mobile terminal 100 must enter an edit mode in which the icon can be registered on the home screen.

As an example of the method of entering the edit mode, when the controller 180 holds the touch input for a predetermined time or more on the icon to be edited, the controller 180 can enter the edit mode.

FIG. 7A shows an example in which a music player icon 701 is held for a predetermined time or more.

7 (b) is a diagram showing a state diagram of a screen which enters the editing mode. In the edit mode of the seventh (b), the controller 180 outputs the first page, and the touch input to the icon of the user is still maintained. The control unit 180 places the music player icon 701 at a position where the touch input is continuously maintained by the user.

The control unit 180 may output the grid 501 in the edit mode as described above with reference to FIGS. 5A and 6, and may display an indicator 601 indicating that the voice is recognized through the microphone 122, To be output.

In the embodiment of the present invention, when the predetermined voice is recognized through the microphone 122 while keeping the touch on the object, the control unit 180 controls to scroll the screen.

For example, the control unit 180 may scroll the first page screen when the voice of "scroll to the left" is recognized through the microphone 122 while maintaining the touch on the predetermined icon as shown in FIG. 7B So as to output the second page screen. Similarly, since the touch of the music player icon 701 is kept by the user, the controller 180 places the music player icon 701 at the position where the touch is maintained in the second page screen state .

On the contrary, when the voice of "scroll to the right" is recognized through the microphone 122 while keeping the touch on the predetermined icon as shown in FIG. 7B, the control unit 180 scrolls the first page screen It is possible to control to output the third page screen.

7 (c), the controller 180 can register the icon at the position where the touch is released (Fig. 7 (d)) when the touch on the icon is released at the predetermined position of the second page Referring to FIG. 7 (d), a state diagram showing that the music player icon 701 is registered at the position where the touch is released is shown.

According to another embodiment of the present invention, when the preset voice is recognized through the microphone 122, the control unit 180 can enter the edit mode. For example, the control unit 180 can enter the edit mode when the voice "home setting" is recognized through the microphone 122. [

8 (a) is a diagram showing a state in which the editing mode is entered according to another embodiment of the present invention. Referring to FIG. 8A, in this editing mode, the display unit may output a first area 801-1 for displaying a home screen and a second area 801-2 for displaying a list of applications. The control unit 180 may control the microphone 122 to output an indicator 601 indicating that the user is recognizing the voice on the touch screen.

In the present invention, the user proposes a control method of searching an object to be registered on the home screen in the second area 801-2 and registering the retrieved object in the first area 801-1.

In the edit mode of Fig. 8 (a), the control unit 180 receives a search word for searching for an object through the microphone 122 by voice. The control unit 180 may output the object corresponding to the search term to the second area 801-2. In this case, the object corresponding to the search term may be an icon of the application or an object of the application.

In the example shown in Fig. 8, when the user inputs a voice called "gallery ", the control unit 180 can search for an object corresponding to" gallery ". In this case, the object to be searched may include an icon and widget of the application corresponding to "gallery ". The control unit 180 may output the "gallery" icon and the widget searched in the second area 801-2.

The user can drag the icon to the first area and release the touch while keeping the touch on the icon in the home screen that is output in the first area to register the "gallery" icon searched in the second area on the home screen .

On the other hand, if the home screen that is output to the first area is the first page, and the user wants to register the second page, the home screen must scroll left.

Alternatively, the home screen outputting to the first area is the first page, but when it is desired to register the third page, the home screen must scroll to the right.

When receiving a predetermined voice through the microphone 122, the control unit 180 can scroll the home screen output to the first area 801-1. The home screen that is output to the first area 801-1 of Fig. 8B is the first page. When the control unit 180 receives the voice "scroll to the left" through the microphone 122 by the user , And correspondingly, the first page can be switched to the second page (Fig. 8 (c)).

When the touch is released to the object after the object being output to the second area 801-2 is dragged to the first area while the touch is held, The object can be registered (Fig. 8 (d)).

Meanwhile, according to the control method of the mobile terminal according to another embodiment of the present invention, it is possible to provide a lock screen with enhanced security through voice recognition. This method will be described in detail with reference to FIGS. 9 and 10. FIG.

9 is a diagram illustrating a state of a lock screen of a mobile terminal according to an exemplary embodiment of the present invention. And FIG. 10 is a flowchart illustrating a method of unlocking a mobile terminal according to an embodiment of the present invention. 9 and 10 together.

FIG. 9A is a diagram illustrating a state diagram of a mobile terminal entering a lock screen according to an embodiment of the present invention (step S1001). Referring to FIG. 9A, the mobile terminal 100 outputs a plurality of unlocked objects 901 in a locked state according to an embodiment of the present invention (S1002).

Then, the controller 180 randomly associates numbers with the plurality of unlocked objects 901 thus outputted (step S1003). Referring to FIG. 9 (a), it can be seen that numbers from 1 to 9 are randomly associated with each of the nine unlocking objects 901.

Thereafter, the control unit 180 receives the voice recognition 902 for releasing the lock from the user (S1004). In this case, the received voice may include an array of numbers.

After receiving the voice input, the control unit 180 compares the unlocked object 901 corresponding to the list of numbers inputted by the user with the preset unlock pattern (S1005).

If the unlock object 901 corresponding to the number entered by the user is equal to the preset unlock pattern, the controller 180 releases the lock screen and outputs the home screen screen (step S1006) , Fig. 9 (c)).

If the unlocking object 901 corresponding to the number input from the user is not the same as the predetermined unlocking pattern, the control unit 180 returns to step S1004 and receives voice recognition from the user again.

It will be apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof.

The present invention described above can be embodied as computer-readable codes on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer-readable medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, and also implemented in the form of a carrier wave (for example, transmission over the Internet) . Also, the computer may include a control unit 180 of the terminal.

Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

100: mobile terminal 110: wireless communication unit
120: A / V input / output unit 130: user input unit
140: sensing unit 150: output unit
160: memory 170: interface section
180: control unit 190: power supply unit

Claims (18)

A touch screen displaying at least one object;
A microphone for speech recognition; And
And a controller for controlling the screen of the touch screen to scroll in a direction corresponding to the first voice when the first voice is recognized through the microphone while the touch for the object is maintained through the touch screen and,
Wherein,
When the second voice is recognized through the microphone, the user enters an editing mode for changing the position of the object. In the editing mode, the touch of the object is released after being dragged while the touch for the object is maintained The object is positioned at a position where the touch is released. delete delete delete The apparatus of claim 1,
In the editing mode, the screen of the touch screen is divided into a first area and a second area, and when the third voice is recognized through the microphone in the editing mode, an object corresponding to the third voice is searched for, The mobile terminal. 6. The apparatus of claim 5,
When the touch of the object displayed on the second area is dragged to the first area and the touch of the searched object is released, movement of adding the searched object to the position where the touch is released on the first area terminal. delete delete delete delete delete delete delete delete delete delete delete delete

Images