KR20120124314A - Mobile terminal and control method thereof - Google Patents

Abstract

PURPOSE: A mobile terminal and a controlling method thereof are provided to calculate a weighted average about sensing values detected by sensing units, thereby recognizing tough intensity of a touch spot based on the weighted average. CONSTITUTION: A displaying unit(151) is arranged in one side of a main body. Sensing units(140) are arranged in different end part of the main body and detects sensing values by sensing touch input about the displaying unit. A controlling unit(180) calculates a weighted average about the sensing values by using reciprocal numbers of distance values between the sensing units and a touch spot of the touch input. The controlling unit recognizes touch intensity of the touch spot based on the weighted average. [Reference numerals] (110) Wireless communication unit; (111) Broadcasting receiving module; (112) Mobile communication module; (113) Wireless internet module; (114) Local area network module; (115) Location information module; (120) A/V input unit; (121) Camera; (122) Microphone; (130) User input unit; (140) Sensing unit; (141) Proximity sensor; (150) Output unit; (151) Displaying unit; (152) Sound output module; (153) Alarming unit; (154) Haptic module; (160) Memory; (170) Interface unit; (180) Control unit; (181) Multimedia module; (190) Power supply unit

Description

[0001] MOBILE TERMINAL AND CONTROL METHOD THEREOF [0002]

The present invention relates to a mobile terminal, and more particularly, to a mobile terminal including a plurality of sensors and a control method thereof.

A terminal can be divided into a mobile or portable terminal and a stationary terminal depending on whether the terminal is movable or not. The mobile terminal may be further classified into a handheld terminal and a vehicle mount terminal according to whether a user can directly carry it.

As the functions of such terminals are diversified, they are implemented in the form of a multimedia player having complex functions such as photographing and photographing of movies, reproduction of music and video files, games, and broadcasting reception . Further, in order to support and enhance the function of the terminal, it may be considered to improve the structural and software parts of the terminal.

Meanwhile, the terminal may be equipped with various types of sensors capable of detecting light, sound, shock, temperature, pressure, gravity, and the like. In addition, the terminal may perform a control operation by using the information detected by these sensors. Therefore, in order to improve the performance of the terminal, not only the performance improvement of the sensor mounted on the terminal but also the performance improvement of the algorithm for processing the information detected therefrom may be considered as an important factor.

An object of the present invention is to provide a mobile terminal capable of recognizing touch intensity of a touch input and a control method thereof.

Another object of the present invention is to provide a mobile terminal capable of recognizing touch intensities of touch inputs to a plurality of touch points in a multi-touch input and a control method thereof.

A mobile terminal according to an embodiment of the present invention includes a terminal body, a display unit disposed on one surface of the body, a plurality of sensing units, and a controller. The plurality of sensing units are disposed at different ends of the main body, respectively, and detect a touch input to the display unit to detect a plurality of sensing values, respectively. The controller calculates a weighted average of the plurality of sensing values by using reciprocal numbers of distance values between the plurality of sensing units and the touch point of the touch input as a weight. The touch intensity of the touch point is recognized based on the weighted average.

In an embodiment, the touch input may be a multi-touch input including first and second touch inputs.

The control unit may calculate a first weighted average of the plurality of sensing values by using reciprocal values of distance values between the plurality of sensing units and the touch points of the first touch input as weights. A second weighted average of the plurality of sensing values may be calculated by using the inverses of the distance values between the plurality of sensing units and the touch points of the second touch input as weights.

The controller may recognize the touch intensities of the first and second touch points, respectively, based on the first and second weighted averages.

The controller may generate first audio data set to a volume corresponding to the first weighted average and second audio data set to a volume corresponding to the second weighted average.

The controller may select one of the first and second audio data and reproduce the selected audio data based on a comparison result of the first and second weighted averages.

The controller may be configured to mix the first and second audio data and to reproduce the mixed audio data.

In an embodiment, the mobile terminal may further include an audio output unit configured to output audio data set to a volume corresponding to the weighted average. The mobile terminal may further include a haptic module that outputs a vibration having an intensity corresponding to the weighted average.

In an embodiment, the plurality of sensing units may be configured as a sound sensor that senses a sound generated by the touch.

In an embodiment, the plurality of sensing units may be configured as a shock sensor for sensing a shock generated by the touch.

According to an embodiment of the present disclosure, a control method of a mobile terminal may include detecting a plurality of sensing values by detecting a touch input to a display unit, a plurality of sensing units detecting the plurality of sensing values, and the touch input. Calculating a weighted average of the plurality of sensed values using the inverses of the distance values between the touch points as a weight, and recognizing the touch intensity of the touch point based on the weighted average.

In an embodiment, in the detecting of the plurality of sensing values, the touch input may be a multi-touch input including first and second touch inputs.

The calculating of the distance values may include performing first weighting on the plurality of sensing values by using reciprocal values of the distance values between the plurality of sensing units and the touch point of the first touch input as weights. Calculating an average, and calculating a second weighted average of the plurality of sensing values using the inverses of the distance values between the plurality of sensing units and the touch point of the second touch input as weights. can do.

The control method may further include generating first audio data set to a volume corresponding to the first weighted average and second audio data set to a volume corresponding to the second weighted average, and The method may further include outputting at least one audio data of the first and second audio data.

The outputting of the at least one audio data may include selecting one of the first and second audio data based on a comparison result of the first and second weighted averages, and Outputting the selected audio data.

In an embodiment, the control method may further include mixing the first and second audio data, and outputting the mixed audio data.

The control method may further include outputting at least one of a first vibration having an intensity corresponding to the first weighted average and a second vibration having an intensity corresponding to the second weighted average. It may include.

The outputting of the at least one vibration may include selecting one of the first and second vibrations based on a comparison result of the first and second weighted averages, and the selected vibration. It may include the step of outputting.

In example embodiments, the control method may further include outputting a vibration having an intensity corresponding to the sum of the first and second weighted averages.

According to the present invention, the mobile terminal calculates a weighted average of the plurality of sensing values respectively detected by the plurality of sensing units based on the relative positional relationship between the plurality of sensing units disposed in the main body and the touch point with respect to the display unit. can do. The mobile terminal can recognize the touch intensity of the touch point based on this weighted average.

In addition, in the multi-touch input where the first and second touch inputs are received together, weighted averages corresponding to the first and second touch inputs may be calculated. Therefore, even if the multi-touch of the display unit is detected, the mobile terminal can recognize the touch intensity of each touch point based on the calculated weighted averages.

1 is a block diagram illustrating a mobile terminal according to the present invention.
2A and 2B are perspective views showing an appearance of a mobile terminal according to the present invention.
3 is a conceptual diagram illustrating a relative positional relationship between a plurality of sensing units and a single touch point in a mobile terminal according to an embodiment of the present invention.
4 is a conceptual diagram illustrating a relative positional relationship between a plurality of sensing units and a multi-touch point in a mobile terminal according to an embodiment of the present invention.
5 to 7 are flowcharts illustrating a control method of a mobile terminal according to an embodiment of the present invention.
8 and 9 are conceptual views illustrating an example in which the present invention is applied to a virtual instrument application.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described with reference to the accompanying drawings so that those skilled in the art may easily implement the technical idea of the present invention. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and like reference numerals designate like parts throughout the specification.

The mobile terminal described herein may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), a navigator, have. However, it should be understood that the configuration according to the embodiments described herein may be applied to a fixed terminal such as a digital TV, a desktop computer, and the like, unless it is applicable only to a mobile terminal. It will be easy to see.

1 is a block diagram illustrating a mobile terminal 100 according to the present invention. 1, a mobile terminal 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, A controller 160, an interface unit 170, a controller 180, and a power supply unit 190. The components shown in Fig. 1 are not essential, so that a mobile terminal having more or fewer components can be implemented.

Hereinafter, the components 110 to 190 of the mobile terminal 100 will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short distance communication module 114, and a location information module 115.

The broadcast receiving module 111 receives broadcast signals and broadcast related information from an external broadcast management server through a broadcast channel. Here, the broadcast related information means information related to a broadcast channel, a broadcast program or a broadcast service provider. The broadcast-related information can also be provided through a mobile communication network. In this case, the broadcast-related information may be received by the mobile communication module 112. The broadcast signal and the broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. Such wireless signals may include various types of data depending on a voice call signal, a video call signal, a text message, or a multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be embedded in the mobile terminal 100 or externally. Wireless Internet technologies may include Wireless LAN (Wi-Fi), Wireless Broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), and the like.

The short range communication module 114 refers to a module for short range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used.

The location information module 115 is a module for acquiring a location of the mobile terminal 100, and a representative example thereof is a GPS (Global Position System) module.

1, an A / V (Audio / Video) input unit 120 is for inputting an audio signal and a video signal, and may include a camera 121, a microphone 122, and the like. The camera 121 processes image frames such as still images and moving images obtained by the image sensor in the video communication mode or the photographing mode. The image frame processed by the camera 121 can be displayed on the display unit 151. [ The image frame may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ More than two cameras 121 may be provided depending on the use environment.

The microphone 122 processes the sound signal input from the outside in the communication mode, the recording mode, the voice selection mode, and the like as electrical voice data. The voice data processed by the microphone 122 in the communication mode can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 and output. The microphone 122 may be implemented with various noise reduction algorithms for eliminating noise generated when an external sound signal is input.

The user input unit 130 generates input data for controlling the operation of the mobile terminal 100 by a user. The user input unit 130 may be composed of a key pad, a dome switch, a touch pad (static and electrostatic), a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the current state of the mobile terminal 100 such as presence or absence of a user, the open / close state of the mobile terminal 100, position, orientation, acceleration, deceleration, And generates a sensing signal. For example, when the mobile terminal 100 is in the form of a slide phone, the sensing unit 140 may detect whether the slide phone is opened or closed. The sensing unit 140 may sense whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like.

The sensing unit 140 may include a proximity sensor 141. The sensing unit 140 may include a touch sensor (not shown) for sensing a touch operation with respect to the display unit 151.

The touch sensor may have the form of a touch film, a touch sheet, a touch pad, or the like. The touch sensor may be configured to convert a pressure applied to a specific portion of the display portion 151 or a change in capacitance generated at a specific portion of the display portion 151 into an electrical input signal. The touch sensor may be configured to detect a touch pressure as well as a touched position and area.

When the touch sensor and the display unit 151 have a mutual layer structure, the display unit 151 can be used as an input device in addition to the output device. The display unit 151 may be referred to as a 'touch screen'.

If there is a touch input via the touch screen, signals corresponding thereto are sent to a touch controller (not shown). The touch controller processes the signals transmitted from the touch sensor, and then transmits data corresponding to the processed signals to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched.

When the touch screen is capacitive, the touch screen may be configured to detect the proximity of the sensing object by the change of the electric field according to the proximity of the sensing object. Such a touch screen may be classified as proximity sensor 141. [

The proximity sensor 141 refers to a sensor that detects the presence or absence of an object to be sensed without mechanical contact using an electromagnetic force or infrared rays. The proximity sensor 141 has a longer life than the contact type sensor and its utilization is also high. Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor.

Hereinafter, for convenience of explanation, a proximity action is referred to as " proximity touch " while an object to be sensed does not touch the touch screen, and an action of touching the sensing object on the touch screen is called & touch ".

The proximity sensor 141 detects the presence or absence of a proximity touch and a proximity touch pattern (for example, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, The information corresponding to the presence / absence of proximity touch and the proximity touch pattern can be output to the touch screen.

The output unit 150 generates an output related to visual, auditory, tactile, and the like. The output unit 150 may include a display unit 151, an audio output module 153, an alarm unit 154, and a haptic module 155.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal 100 operates in the call mode, the display unit 151 displays a UI (User Interface) or a GUI (Graphic User Interface) related to the call. When the mobile terminal 100 operates in the video communication mode or the photographing mode, the display unit 151 displays the photographed image, the received image, the UI, the GUI, and the like.

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor liquid crystal display (TFT-LCD), an organic light emitting diode (OLED), a flexible display display, a 3D display, and an e-ink display.

At least one display (or display element) included in the display unit 151 may be configured to be transparent or light transmissive so that the display can see the outside through it. This may be referred to as a transparent display. A representative example of such a transparent display is TOLED (Transparant OLED). The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 in the terminal body.

There may be two or more display units 151 according to the embodiment of the mobile terminal 100. [ For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from each other or positioned integrally with one another, and may be located on different surfaces.

The sound output module 153 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice selection mode, a broadcast reception mode, The sound output module 153 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The sound output module 153 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 154 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events generated in the mobile terminal 100 include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 154 may output a signal for informing occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. The display unit 151 and the audio output module 153 may be classified as a part of the alarm unit 154 because the video signal or the audio signal can be output through the display unit 151 or the audio output module 153. [

The haptic module 155 generates various tactile effects that a user can feel. A typical example of the haptic effect generated by the haptic module 155 is vibration. The intensity, pattern, and the like of the vibration generated by the tactile module 155 are controllable. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 155 may be configured to perform various functions such as a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or a suction force of the air through the injection port or the suction port, a touch on the skin surface, contact with an electrode, Various effects can be generated such as the effect of heat generation and the effect of reproducing the cold sensation using the heat absorbing or heatable element.

The haptic module 155 can be configured to not only transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sense of the finger or arm. At least two haptic modules 155 may be provided according to the configuration of the mobile terminal 100.

The memory 160 may store a program for the operation of the controller 180 and temporarily store input and output data (e.g., a phone book, a message, a still image, a moving picture, etc.). The memory 160 may store data related to vibrations and sounds of various patterns that are output upon touch input on the touch screen.

The memory 160 may be a flash memory, a hard disk, a multimedia card micro type, a card type memory (e.g., SD or XD memory), a random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM) And may include at least one storage medium. The mobile terminal 100 may operate in association with a web storage that performs storage functions of the memory 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device, receives power, transfers the power to each component inside the mobile terminal 100, or transmits data inside the mobile terminal 100 to an external device. For example, the interface unit 170 may include a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, Input / output ports, video I / O ports, earphone ports, and the like.

The identification module is a chip for storing various information for authenticating the usage right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM), a general user authentication module Universal Subscriber Identity Module (USIM)). A device equipped with an identification module (hereinafter referred to as "identification device") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

The interface unit 170 may be a path through which the power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle or various command signals input from the cradle by the user, (Not shown). The various command signals or power supplied from the cradle may also act as a signal for recognizing that the mobile terminal 100 is correctly mounted in the cradle.

The controller 180 controls the overall operation of the mobile terminal 100. For example, control and processing related to voice calls, data communications, video calls, and the like are performed. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [ The control unit 180 may perform pattern selection processing for selecting handwriting input and drawing input on the touch screen as characters and images, respectively.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.

The various embodiments described herein may be implemented in a recording medium readable by a computer or similar device using software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be applied to various types of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays Microprocessors, microprocessors, and other electronic units for performing other functions, as will be appreciated by those skilled in the art. In some cases, the embodiments described herein may be implemented by the controller 180 itself.

According to the software implementation, embodiments such as the procedures and functions described herein may be implemented as separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code may be implemented in a software application written in a suitable programming language. Such software code may be stored in the memory 160 and executed by the controller 180.

Hereinafter, a method of processing user input to the mobile terminal 100 will be described.

The user input unit 130 is operated to receive a command for controlling the operation of the mobile terminal 100, and may include a plurality of operation units. The operating units may also be referred to as manipulating portions and may be employed in any manner as long as they are operated in a tactile manner by the user's tactile sense.

Various kinds of time information can be displayed on the display unit 151. [ Such visual information can be displayed in the form of letters, numbers, symbols, graphics, icons, and the like, and can be formed as a three-dimensional stereoscopic image. At least one of a character, a number, a symbol, a graphic, and an icon may be displayed in a predetermined arrangement for inputting time information, thereby being implemented as a keypad. Such a keypad may be referred to as a so-called " soft key ".

The display unit 151 may operate as an entire area or may be divided into a plurality of areas and operated. In the latter case, the plurality of areas can be configured to operate in association with one another. For example, an output window and an input window may be displayed on the upper and lower portions of the display unit 151, respectively. The output window and the input window are areas allocated for outputting or inputting information, respectively. In the input window, a soft key with a number for inputting a telephone number may be output. When the soft key is touched, the number corresponding to the touched soft key is displayed in the output window. When the operating unit is operated, a call connection to the telephone number displayed in the output window may be attempted, or the text displayed in the output window may be entered into the application.

The display unit 151 or the touch pad may be configured to detect touch scrolling. The user can move the cursor or the pointer positioned on the displayed object, for example, the icon, on the display unit 151 by scrolling the display unit 151 or the touch pad. Further, when the finger is moved on the display unit 151 or the touch pad, the path along which the finger moves may be visually displayed on the display unit 151. [ This will be useful for editing the image displayed on the display unit 151. [

One function of the mobile terminal 100 may be executed in response to a case where the display unit 151 and the touch pad are touched together within a predetermined time range. In the case of being touched together, there may be a case where the user clamps the main body of the mobile terminal 100 using the thumb and index finger. At this time, one function of the mobile terminal 100 to be executed may be activation or deactivation for the display unit 151 or the touch pad, for example.

2A and 2B are perspective views showing an appearance of a mobile terminal 100 according to the present invention. FIG. 2A shows a front side and one side of the mobile terminal 100, and FIG. 2B shows a rear side and the other side of the mobile terminal 100. FIG.

Referring to FIG. 2A, the mobile terminal 100 includes a bar-shaped terminal body. However, the mobile terminal 100 is not limited thereto, and may be realized in various forms such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are movably coupled to each other.

The terminal body includes a case (a casing, a housing, a cover, and the like) that forms an appearance. In the embodiment, the case may be divided into a front case 101 and a rear case 102. A variety of electronic components are embedded in the space formed between the front case 101 and the rear case 102. At least one intermediate case may be additionally disposed between the front case 101 and the rear case 102. [

The cases may be formed by injection molding of a synthetic resin or may be formed to have a metal material such as stainless steel (STS), titanium (Ti) or the like.

The display unit 151, the sound output unit 152, the camera 121, the user input unit 130 (see FIG. 1), the microphone 122, the interface 170, can do.

The display unit 151 occupies a main portion of the front case 101. [ The audio output unit 152 and the camera 121 are located in a region adjacent to one end of the display unit 151 and the first user input unit 131 and the microphone 122 are located in a region adjacent to the other end. The second user input unit 132 and the interface 170 may be located on the sides of the front case 101 and the rear case 102. [

The user input unit 130 is operated to receive a command for controlling the operation of the mobile terminal 100. [ The user input unit 130 may include a plurality of operation units 131 and 132.

The first or second operating units 131 and 132 can receive various commands. For example, the first operation unit 131 can receive commands such as start, end, scroll, and the like. The second operation unit 132 can receive commands such as adjusting the size of the sound output from the sound output unit 152, switching to the touch selection mode of the display unit 151, and the like.

Referring to FIG. 2B, a rear camera 121 'may be additionally mounted on the rear surface of the terminal body, that is, the rear case 102. The rear camera 121 'has a photographing direction opposite to that of the front camera 121 (see FIG. 2A), and may be configured to have pixels different from those of the front camera 121.

For example, the front camera 121 may be configured to have a low pixel, and the rear camera 121 'may be configured to have a high pixel. Accordingly, when the front camera 121 is used during a video call, the size of the transmission data may be reduced when the user's face is photographed and transmitted to the counterpart in real time. On the other hand, the rear camera 121 'can be used for the purpose of storing a high-quality image.

Meanwhile, the cameras 121 and 121 'may be installed in the terminal body so as to be rotated or popped up.

The flash 123 and the mirror 124 may be further positioned adjacent to the rear camera 121 '. The flash 123 emits light toward the subject when the user photographs the subject with the rear camera 121 '. The mirror 124 illuminates the user's face when the user photographs himself (self-photographing) using the rear camera 121 '.

A rear sound output unit 152 'may be additionally disposed on the rear surface of the terminal body. The rear sound output unit 152 ′ may perform a stereo function together with the front sound output unit 152 (see FIG. 2A), and may perform a speakerphone function during a call.

In addition to the antenna for communication, an antenna 116 for receiving broadcast signals may be additionally provided on the side surface of the terminal body. The antenna 116 constituting a part of the broadcast receiving module 111 (see FIG. 1) can be installed to be able to be drawn out from the terminal body.

A power supply unit 190 for supplying power to the mobile terminal 100 is mounted on the terminal body. The power supply unit 190 may be built in the main body of the terminal or may be detachable from the outside of the main body of the terminal.

The rear case 102 may further include a touch pad 135 for sensing a touch. The touch pad 135 may be of a light transmission type like the display unit 151 (see FIG. 2A). In addition, a rear display unit for outputting visual information may be additionally mounted on the touch pad 135. In this case, information output from both the front display unit 151 and the rear display unit may be controlled by the touch pad 135.

The touch pad 135 operates in correlation with the display unit 151. [ The touch pad 135 may be located parallel to the rear of the display unit 151. The touch pad 135 may have a size equal to or smaller than that of the display unit 151.

Hereinafter, a mechanism in which the mobile terminal recognizes the strength of the touch input during the single touch input will be described with reference to FIG. 3, and the mechanism in which the mobile terminal recognizes the strength of each touch input during the multi-touch input is illustrated in FIG. 4. It demonstrates with reference.

3 is a conceptual diagram illustrating a relative positional relationship between a plurality of sensing units and a single touch point in the mobile terminal 200 according to an embodiment of the present invention. Referring to FIG. 3, the mobile terminal 200 may include a plurality of sensing units 242 ˜ 248, a display unit 251, and a controller (not shown). Although four sensing units 242 to 248 respectively disposed at corners of the terminal body are illustrated in the drawing, the position and number of the sensing units are not limited thereto and may be variously changed.

The plurality of sensing units 242 to 248 may be disposed at different ends (outer end or inner end) of the terminal body, respectively. For example, the sensing units 242 to 248 may be disposed at corners or side portions of the terminal body, respectively.

According to an embodiment, the sensing units 242 ˜ 248 may be configured as a sound sensor, for example, a microphone, which senses a sound generated by a touch on the display unit 251. That is, the detectors 242 ˜ 248 may convert the detected sound into an electrical signal and detect detection values corresponding to the magnitude of the converted electrical signal.

In general, the size of the sensed sound decreases as the distance between the position where the sound is detected and the position where the sound is generated increases, and increases as the distance decreases. Therefore, the sensing units 242 ˜ 248 may sense different sound levels according to the relative position with respect to the touch point TP.

In another embodiment, the sensing units 242 ˜ 248 may be configured as shock sensors that sense shock generated by a touch on the display unit 251. That is, the sensing units 242 ˜ 248 may convert the detected shock into an electrical signal and detect sensing values corresponding to the magnitude of the converted electrical signal.

Like the magnitude of the sound detected, the magnitude of the detected shock decreases as the distance between the location of the shock detection and the location of the shock increases and increases as the distance decreases. Accordingly, the sensing units 242 ˜ 248 may sense different impact sizes according to a relative position with respect to the touch point TP.

For convenience of description, when one surface of the terminal body is applied to the rectangular coordinate plane, the coordinates of the touch point TP and the coordinates of the sensing units 242 to 248 are respectively (x, y), (0, 0), It can be represented as (W, 0), (0, H), (W, H). Here, W denotes the distance between the first and second detectors 242 and 244 or the distance between the third and fourth detectors 246 and 248, and H denotes the first and third detectors 242, Distance between the second and fourth sensing units 244 and 248. And x is greater than 0 and less than W, and y is greater than 0 and less than H.

The display unit 251 may be disposed on one surface of the terminal body, and detect the touch point TP when a touch input to the display area (touch detection area) of the display unit 251 is performed.

The controller may recognize the touch intensity of the touch point TP, that is, the strength of the touch input, by using the distance values D1 to D4 between the sensing units 242 to 248 and the touch point TP of the touch input. . In this case, the first to fourth distance values D1 to D4 are coordinates (x, y) of the touch point TP and coordinates (0, 0) and (W) of the first to fourth sensing units 242 to 248. , 0), (0, H), (W, H) can be calculated.

The controller uses the reciprocal numbers of the distance values D1 to D4 between the sensing units 242 to 248 and the touch point TP of the touch input as a weight, and the sensing units 242 to 248. It is possible to calculate a weighted average for the sensed values respectively detected by. A method of calculating the weighted average in the case of a single touch input will be described in more detail with reference to Equation 1 below.

Referring to Equation 1, the first to fourth sensing values SV1 to SV4 respectively detected by the first to fourth sensing units 242 to 248 respectively correspond to the first to fourth distance values D1 to D4. The inverses are each multiplied by the weight. The weighted average WA is calculated as a result of dividing the sum of the multiplied values by the sum of the inverses of the first to fourth distance values D1 to D4.

The controller may recognize the touch intensity of the touch point TP based on the weighted average calculated as described above. For example, the controller may convert the weighted average into the touch intensity using a preset conversion table. In this case, the touch intensity may increase as the weighted average increases, and the touch intensity may decrease as the weighted average decreases.

As described above, according to the present invention, the mobile terminal 200 may calculate a weighted average of the plurality of sensing values based on the relative positional relationship between the plurality of sensing units 242 ˜ 248 and the touch point TP. have. In addition, the mobile terminal 200 may recognize the touch intensity of the touch point TP based on the weighted average.

Hereinafter, the case where the mobile terminal recognizes the touch intensity of each touch input during the multi-touch input will be described in detail. However, the description overlapping with the case of recognizing the touch intensity in the single touch input will be omitted.

4 is a conceptual diagram illustrating a relative positional relationship between a plurality of sensing units and a multi-touch point in a mobile terminal 300 according to an embodiment of the present invention. Referring to FIG. 4, the mobile terminal 300 includes a plurality of sensing units 342 ˜ 348, a display unit 351, a controller (not shown), an audio output unit (not shown), and a haptic module (not shown). ) May be included.

Hereinafter, for convenience of description, it is assumed that the multi-touch input includes first and second touch inputs.

The display unit 351 is a touch point (TP1, hereinafter referred to as “first touch point”) of the first touch input and a touch point (TP2, hereinafter referred to as “second touch point) of the second touch input during the multi-touch input. ”). In this case, the coordinates of the first touch point TP1 may be represented by (x1, y1) and the coordinates of the second touch point TP2 may be represented by (x2, y2).

The controller may recognize the touch intensity of the first touch point TP1 using the distance values D1 to D4 between the sensing units 342 to 348 and the first touch point TP1. The controller may recognize the touch intensity of the second touch point TP2 using the distance values D5 to D8 between the sensing units 342 to 348 and the second touch point TP2.

In this case, the first to fourth distance values D1 to D4 are coordinates (x1, y1) of the first touch point TP1 and coordinates (0, 0) of the first to fourth sensing units 242 to 248, It can be calculated using (W, 0), (0, H), (W, H). The fifth to eighth distance values D5 to D8 may include coordinates (x2, y2) of the second touch point TP2 and coordinates (0, 0) of the first to fourth sensing units 242 to 248, It can be calculated using (W, 0), (0, H), (W, H).

The controller may calculate a first weighted average of the sensing values detected by the sensing units 242 to 248, respectively, using the inverses of the first to fourth distance values D1 to D4 as weights. The controller may calculate a second weighted average of the sensing values detected by the sensing units 242 to 248, respectively, using the inverses of the fifth to eighth distance values D5 to D8 as weights. Here, the first weighted average corresponds to the touch intensity of the first touch point TP1, and the second weighted average corresponds to the touch intensity of the second touch point TP2.

A method of calculating the weighted average in the case of a multi-touch input will be described in more detail with reference to Equation 2 below.

Referring to Equation 2, the first to fourth distance values D1 to D4 are applied to the first to fourth detection values SV1 to SV4 respectively detected by the first to fourth detection units 242 to 248. The inverses are each multiplied by the weight. The first weighted average WA1 is calculated as a result of dividing the sum of the multiplied values by the sum of the inverses of the first to fourth distance values D1 to D4.

Further, the inverses of the fifth to eighth distance values D5 to D8 are multiplied by the weights to the first to fourth sensed values SV1 to SV4, respectively. The second weighted average WA2 is calculated as a result of dividing the sum of the multiplied values by the sum of the inverses of the fifth to eighth distance values D5 to D8.

The controller may recognize the touch intensities of the first and second touch points TP1 and TP2 based on the first and second weighted averages, respectively.

As described above, according to the present invention, the mobile terminal 300 is based on the relative positional relationship between the plurality of sensing units 242 to 248 and the multi-touch points TP1 and TP2, respectively. Corresponding weighted averages can be calculated. Therefore, even if the multi-touch of the display unit 351 is detected, the mobile terminal 300 may recognize the touch intensities of the touch points TP1 and TP2 based on the calculated weighted averages.

Hereinafter, embodiments of a control operation performed by using weighted averages calculated at the multi-touch input will be described.

In one embodiment, weighted averages may be applied to play and output audio data. The controller may generate first audio data corresponding to the first weighted average and second audio data corresponding to the second weighted average. Here, the first audio data may be reproduced and output at a volume corresponding to the first weighted average, and the second audio data may be reproduced and output at a volume corresponding to the second weighted average. That is, a field value related to the volume of the audio data may be determined based on the weighted average.

The controller may select one of the first and second audio data based on a comparison result of the first and second weighted averages. The controller can reproduce the selected audio data. For example, when the first weighted average is larger than the second weighted average, the first audio data may be selected and reproduced.

The controller may generate mixed audio data by mixing the first and second audio data. The controller can reproduce the mixed audio data.

The audio output unit may output at least one of the first and second audio data under the control of the controller. In addition, the audio output unit may output the mixed audio data.

In another embodiment, the weighted averages may be applied to control the haptic response of the mobile terminal, for example, the vibration output by the haptic module. The controller may control the haptic module to output at least one of a first vibration having an intensity corresponding to the first weighted average and a second vibration having an intensity corresponding to the second weighted average.

More specifically, the controller may select one of the first and second vibrations based on a comparison result of the first and second weighted averages. The controller may control the haptic module to output the selected vibration. For example, when the first weighted average is larger than the second weighted average, the first vibration may be selected and output.

In addition, the controller may control the haptic module to output a vibration having an intensity corresponding to the sum of the first and second weighted averages.

5 to 7 are flowcharts illustrating a control method of a mobile terminal according to an embodiment of the present invention. FIG. 5 illustrates an embodiment of a control operation performed at the single touch input, FIG. 6 is an embodiment of a control operation performed at the multi-touch input, and FIG. 7 is a control operation performed at the multi-touch input. Another embodiment of the is shown.

Referring to FIG. 5, the control method includes detecting a plurality of sensing values by detecting a touch input to the display unit (S110). Here, a plurality of sensing units may be disposed at different ends of the terminal body to detect these sensing values. The plurality of sensing units may be configured as at least one of a sound sensor and a shock sensor.

Next, a step (S120) of calculating a weighted average of the detected sensing values is performed. In this case, the inverses of the distance values between the sensing units and the touch points of the touch input may be used as weights.

When the weighted average is calculated, step S130 of recognizing the touch intensity of the touch point is performed based on the weighted average. In this case, a preset conversion table may be used to convert the weighted average into the touch intensity of the touch point. Such a conversion table may be stored in a memory unit.

Referring to FIG. 6, the control method may include detecting a plurality of sensing values by detecting a multi-touch input to the display unit (S210). Here, the number of sensing values is the same as the number of sensing units that detect the single touch input or the multi-touch input. That is, regardless of the number of touch points, each of the sensing units detects one corresponding sensing value.

Next, using the inverse of the distance values between the sensing unit and the first touch point as a weight, calculating a first weighted average of the sensing values (S220) and the distance value between the sensing unit and the second touch point In operation S230, a second weighted average of the sensed values is calculated using the inverses as weights. Computing the first and second weighted averages (S220 and S230) may be performed regardless of the order.

After the first and second weighted averages are calculated, generating first audio data set to a volume corresponding to the first weighted average (S240) and second audio data set to a volume corresponding to the second weighted average. Producing a step (S250) is performed.

Subsequently, an operation (S260) of outputting at least one audio data among the first and second audio data is performed. In this step S260, either one of the first and second audio data may be selected based on a comparison result of the first and second weighted averages, and the selected audio data may be output by the audio output unit. In addition, the first and second audio data may be mixed, and the mixed audio data may be output by the audio output unit.

Referring to FIG. 7, the control method may include detecting a plurality of sensed values (S310), calculating a first weighted average (S320), and calculating a second weighted average, as illustrated in FIG. 6. It may include (S330).

Next, an operation (S340) of outputting at least one of a first vibration having an intensity corresponding to the first weighted average and a second vibration having an intensity corresponding to the second weighted average is performed. In this step S340, one of the first and second vibrations may be selected based on a comparison result of the first and second weighted averages, and the selected vibrations may be output by the haptic module. In addition, a vibration having an intensity corresponding to the sum of the first and second weighted averages may be output by the haptic module.

8 and 9 are conceptual views illustrating an example in which the present invention is applied to a virtual instrument application.

Referring to FIG. 8, when an application capable of playing drums is executed in the mobile terminal 400, the display unit 451 may display a virtual drum set. Virtual drum sets include crash cymbal, ride cymbal, hi-hat cymbal, middle tom, small tom, floor tom, It may be composed of a snare, a bass drum, and the like.

As illustrated, when multi-touch is detected for the crash symbol region and the base drum region, the four sensing units 442 to 448 disposed at the corners of the mobile terminal 400 may detect the four sensing values, respectively. Can be.

The controller (not shown) uses the coordinates of the first and second touch points TP1 and TP2 corresponding to the crash symbol region and the base drum region, respectively, and the coordinates of the detectors 442 to 448. Distance values between ˜448 and the first touch point TP1 and distance values between the detectors 442 to 448 and the second touch point TP2 may be calculated.

As described with reference to Equation 2, the controller calculates a first weighted average of the detected values detected as the touch intensity of the first touch point TP1 using the calculated distance values, and the second touch. A second weighted average of the sensed values detected as the touch intensity at point TP2 can be calculated.

The audio output unit (not shown) may output the sound of the crash symbol at a volume corresponding to the first weighted average under the control of the controller, and may output the sound of the bass drum at a volume corresponding to the second weighted average. have.

Referring to FIG. 9, when an application capable of playing a guitar is executed in the mobile terminal 500, the display unit 551 may display a virtual guitar. The virtual guitar may include six strings STR1 to STR6.

As illustrated, when the multi-touch of the second and fourth strings STR2 and STR4 is detected, the four sensing units 542 to 548 disposed at the corners of the mobile terminal 500 have four sensing values. Can be detected respectively.

The controller (not shown) uses coordinates of the first and second touch points TP1 and TP2 corresponding to the second and fourth strings STR2 and STR4, and coordinates of the sensing units 542 to 548, respectively. Distance values between the detectors 542 ˜ 548 and the first touch point TP1 and distance values between the detectors 542 ˜ 548 and the second touch point TP2 may be calculated. As described above, the first and second weighted averages of the detected sensing values may be calculated.

The audio output unit (not shown) outputs the sound of the second string STR2 at a volume corresponding to the first weighted average under the control of the controller, and simultaneously outputs the sound of the fourth string STR4 to the second weighted average. Can be output at a volume corresponding to.

According to the embodiment disclosed herein, the above-described method can be implemented by a code that can be read by a processor on a medium on which the program is recorded. Examples of the medium that can be read by the processor include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, etc., and may be implemented in the form of a carrier wave (e.g., transmission over the Internet) .

In the mobile terminal disclosed in this specification, the configuration and method of the above-described embodiments are not limitedly applied, but all or some of the embodiments may be selectively combined so that various modifications can be made.

Claims (20)

Terminal body;
A display unit disposed on one surface of the main body;
A plurality of sensing units disposed at different ends of the main body, respectively, and detecting a plurality of sensing values by sensing a touch input to the display unit; And
A weighted average of the plurality of sensing values is calculated by using reciprocal numbers of distance values between the plurality of sensing units and the touch point of the touch input as a weight. And a controller configured to recognize the touch intensity of the touch point based on a weighted average. The method of claim 1,
And the touch input is a multi touch input including first and second touch inputs. The method of claim 2,
The control unit,
Calculating a first weighted average of the plurality of sensing values by using reciprocal values of the distance values between the plurality of sensing units and the touch points of the first touch input as weights,
And calculating a second weighted average of the plurality of sensing values by using reciprocal values of distance values between the plurality of sensing units and the touch points of the second touch input as weights. The method of claim 3, wherein
The control unit,
And a touch intensity of the first and second touch points, respectively, based on the first and second weighted averages. The method of claim 3, wherein
The control unit,
And a first audio data set to a volume corresponding to the first weighted average and a second audio data set to a volume corresponding to the second weighted average. The method of claim 5, wherein
The control unit,
And selecting one of the first and second audio data based on a comparison result of the first and second weighted averages, and reproducing the selected audio data. The method of claim 5, wherein
The control unit,
And mixing the first and second audio data and reproducing the mixed audio data. The method of claim 1,
And an audio output unit configured to output audio data set to a volume corresponding to the weighted average. The method of claim 1,
The mobile terminal further comprises a haptic module for outputting a vibration having an intensity corresponding to the weighted average. The method of claim 1,
The plurality of detection unit is a mobile terminal, characterized in that consisting of a sound sensor for detecting the sound generated by the touch. The method of claim 1,
The plurality of detection unit is a mobile terminal, characterized in that consisting of a shock sensor for detecting a shock generated by the touch. Detecting a plurality of sensing values by sensing a touch input to the display unit;
Calculating a weighted average of the plurality of sensing values by using reciprocal values of distance values between the plurality of sensing units respectively detecting the plurality of sensing values and the touch points of the touch input; And
And recognizing a touch intensity of the touch point based on the weighted average. 13. The method of claim 12,
In the detecting of the plurality of sensing values,
And the touch input is a multi-touch input including first and second touch inputs. The method of claim 13,
Computing the distance values,
Calculating a first weighted average of the plurality of sensing values by using reciprocal values of distance values between the plurality of sensing units and the touch points of the first touch input as weights; And
And calculating a second weighted average of the plurality of sensing values by using reciprocal values of distance values between the plurality of sensing units and the touch points of the second touch input as weights. 15. The method of claim 14,
Generating first audio data set to a volume corresponding to the first weighted average and second audio data set to a volume corresponding to the second weighted average; And
And outputting audio data of at least one of the first and second audio data. The method of claim 15,
The outputting of the at least one audio data may include:
Selecting one of the first and second audio data based on a comparison result of the first and second weighted averages; And
Outputting the selected audio data. The method of claim 15,
Mixing the first and second audio data; And
And outputting the mixed audio data. 15. The method of claim 14,
And outputting at least one of a first vibration having an intensity corresponding to the first weighted average and a second vibration having an intensity corresponding to the second weighted average. The method of claim 18,
The outputting of the at least one vibration,
Selecting one of the first and second vibrations based on a comparison result of the first and second weighted averages; And
And outputting the selected vibration. 15. The method of claim 14,
And outputting a vibration having an intensity corresponding to the sum of the first and second weighted averages.

Images