KR20110032209A - Mobile terminal and method for displaying object using distance sensing - Google Patents

Abstract

PURPOSE: A mobile terminal and a method for displaying an object are provided to simply magnify or reduce the side of the object on a screen using a forward and backward moving gesture. CONSTITUTION: A display unit(30) displays an object in a screen. A distance sensing unit(40) outputs the sensing signal through a user sensing of a mobile terminal. A control unit(50) receives the sensing signal from the distance sensing unit. The control unit calculates displacements between the user and the mobile terminal using the received sensing signal. According to the calculated displacement, the control unit controls the size of the object. The control unit displays the object in adjusted size.

Description

Mobile terminal and method for displaying object using distance sensing {Mobile terminal and method for displaying object using distance sensing}

The present invention relates to a mobile terminal and a method for displaying an object thereof, and more particularly, to a mobile terminal for adjusting the size of an object displayed on the screen by recognizing the distance between the mobile terminal and the user and an object display method using the distance recognition thereof. will be.

Information and communication technology using wired and wireless communication networks is growing very fast in a short period of time due to new technologies and functions that stimulate consumer purchasing. In particular, due to the development of the technology of the mobile terminal, beyond the step of performing a simple application, various applications are installed to meet the needs of users. As a result, the user may use voice information, text information, video information, moving picture expert group (MPEG) layer 3 (MPEG), a game, and the like through the mobile terminal.

On the other hand, the mobile terminal displays small objects, such as images and text, displayed on the screen due to the limitation of the screen size. Therefore, the user enlarges the corresponding area by manipulating an input unit such as a keypad or a touch pad to check an object or an object part displayed on a specific area on the screen. That is, the user selects an object processing mode capable of processing an object displayed on the screen by manipulating the input unit, and selects a specific area to be enlarged in the selected object processing mode. The user must call a function key for processing the selected specific area, and select a function key for enlarging the selected specific area among the called function keys.

As described above, there is a inconvenience in that the user has to manipulate the input unit several times in order to enlarge a specific area on the screen of the mobile terminal. In order to operate the input unit many times, it is necessary to operate the input unit of the mobile terminal with the other hand while holding the mobile terminal with one hand, so that in an environment where both hands cannot be used freely (for example, in a crowded subway or bus) It may be inconvenient to use the function to enlarge a certain area.

In addition, an input error may occur when the input unit is manipulated several times. The reason is that as the number of key inputs increases, the probability of occurrence of an input error increases. In particular, an input error due to key input is more frequently generated in a touch screen type mobile terminal than a keypad type. In other words, the touch screen type mobile terminal displays a virtual keypad on the screen and receives a key input through a user's touch. In the process of touching a key, an input error occurs frequently by touching another key adjacent to a target key. Because.

Accordingly, an object display method using a mobile terminal and a distance recognition method of controlling and displaying the size of an object displayed on the screen of the mobile terminal according to whether the distance between the user and the mobile terminal is recognized even without operating a separate input unit several times. It is to provide.

Another object of the present invention is to provide a portable terminal and an object display method using distance recognition thereof, which provides an operation convenience capable of stably operating the portable terminal even with one hand.

In order to achieve the above object, the present invention provides a portable terminal comprising a display unit, a distance sensing unit and a control unit. The display unit displays an object on the screen. The distance detector detects a user of the portable terminal and outputs a detection signal. The control unit receives the detection signal from the distance detection unit, calculates a displacement between the mobile terminal and the user based on the received detection signal, and adjusts the size of the object according to the calculated displacement to the display unit. Display.

The mobile terminal according to the present invention further includes a storage unit for storing an adjustment value for adjusting the size of the object according to the displacement. In this case, the controller may extract the adjustment value according to the calculated displacement from the storage unit, and adjust the size of the object by the extracted adjustment value.

The present invention also provides a portable terminal including a display unit, a distance sensing unit and a control unit. The display unit displays an object on the screen. The distance detector detects a user of the portable terminal and outputs a detection signal. The controller receives the detection signal from the distance detection unit, calculates a distance between the mobile terminal and the user based on the received detection signal, and adjusts the size of the object according to the calculated distance to the display unit. Display.

The mobile terminal according to the present invention further includes a storage unit for storing an adjustment value for adjusting the size of the object according to the distance. In this case, the controller may extract the adjustment value according to the calculated distance from the storage unit, and adjust the size of the object by the extracted adjustment value.

In the mobile terminal according to the present invention, the distance detecting unit includes at least one of a camera, a proximity sensor, an infrared sensor, an RF (Radio Frequency) sensor, a gyro sensor, an acceleration sensor, and an ultrasonic sensor.

The present invention also includes a display step of displaying an object on a screen by a mobile terminal, a reception step of receiving, by the mobile terminal, a detection signal detected by a user through a distance detection unit, and the mobile terminal based on the received detection signal. Comprising a step of calculating the displacement between the mobile terminal and the user, and provides a method of displaying the object of the mobile terminal using a distance recognition comprising the display step of adjusting the size of the object displayed by the portable terminal according to the calculated displacement. .

In the object display method of a portable terminal according to the present invention, the calculating step includes the step of calculating a first distance between the portable terminal and the user from the first detection signal received by the portable terminal through the distance sensing unit. Calculating, by the terminal, a second distance between the portable terminal and the user from the second detection signal received according to a change in position between the portable terminal and the user through the distance sensing unit, wherein the portable terminal has the second distance and the first distance; Computing the displacement by the difference of.

In the object display method of a mobile terminal according to the present invention, the displacement between the mobile terminal and the user in the calculating step using at least one of the camera vision method, infrared method, gyro-acceleration method and ultrasonic method. Can be calculated.

In the method for displaying an object of a mobile terminal according to the present invention, the adjusting display step includes: when the calculated displacement is a positive value, the mobile terminal enlarges the object, and when the calculated displacement is a negative value, The mobile terminal may include reducing the object.

In the method for displaying an object of a mobile terminal according to the present invention, the control display step includes the step of the mobile terminal shrinking the object if the calculated displacement is a positive value, and if the calculated displacement is a negative value, The mobile terminal may include enlarging the object.

In the object display method of the portable terminal according to the present invention, in the adjustment display step, the portable terminal can enlarge or reduce the size of the object in proportion to the absolute value of the calculated displacement.

In the object display method of the mobile terminal according to the present invention, the control display step, if the absolute value of the calculated displacement is greater than or equal to a threshold value, the mobile terminal adjusts and displays the size of the object, the calculated displacement If the absolute value of is less than or equal to the threshold value, the mobile terminal may include maintaining the display state of the object.

In the object display method of a mobile terminal according to the present invention, if the absolute value of the calculated displacement is greater than or equal to a threshold value in the adjustment display step, the mobile terminal may enlarge or reduce the size of the object in proportion to the absolute value. Can be.

In the object display method of the portable terminal according to the present invention, if the absolute value of the calculated displacement is greater than or equal to a threshold value in the adjustment display step, the portable terminal may enlarge or reduce the size of the object to a predetermined size.

In the object display method of the mobile terminal according to the present invention, the object may include at least one of an image, a video, a menu, a list, an icon, and text.

The present invention also includes a display step of displaying an object on a screen by a mobile terminal, a reception step of receiving, by the mobile terminal, a detection signal detected by a user through a distance detection unit, and the mobile terminal based on the received detection signal. Comprising a step of calculating the distance between the mobile terminal and the user, and provides a method for displaying the object of the mobile terminal using a distance recognition comprising the display step of adjusting the size of the object according to the calculated distance by the mobile terminal. .

In the object display method of the portable terminal according to the present invention, the distance between the portable terminal and the user in the calculating step may be calculated using at least one of a camera vision method, an infrared method and an ultrasonic method.

In the method for displaying an object of a mobile terminal according to the present invention, the adjusting display step includes: when the calculated distance exceeds a threshold, the mobile terminal enlarges the size of the object than a reference size at the threshold; If the calculated distance is a threshold, the mobile terminal displays the object with a reference size at the threshold; if the calculated distance is less than or equal to a threshold, the mobile terminal is smaller than the reference size at the threshold; It may include reducing the size of the object.

In the method for displaying an object of a mobile terminal according to the present invention, the adjusting display step comprises the steps of: the mobile terminal reducing the size of the object than the reference size at the threshold when the calculated distance exceeds a threshold value; If the calculated distance is a threshold, the mobile terminal displays the object with a reference size at the threshold; if the calculated distance is less than or equal to a threshold, the mobile terminal is smaller than the reference size at the threshold; It may include increasing the size of the object.

In the object display method of the mobile terminal according to the present invention, in the control display step, the mobile terminal may adjust the size of the object in proportion to the calculated distance.

In the object display method of a mobile terminal according to the present invention, the control display step, if the calculated distance is greater than or equal to a threshold, the mobile terminal maintains the size of the object at the threshold, the calculated distance Is less than or equal to a threshold value, the mobile terminal may include adjusting and displaying the size of the object.

In the object display method of the mobile terminal according to the present invention, if the calculated distance is greater than or equal to a threshold, the mobile terminal adjusts and displays the size of the object, and the calculated distance is critical. If the value is less than the value, the mobile terminal may include maintaining the size of the object at the threshold value.

According to the present invention, since the mobile terminal adjusts the size of the object and displays it on the screen according to the distance or displacement between the user and the mobile terminal, the user may perform a simple gesture of moving the mobile terminal back and forth with respect to itself even without separately operating the input unit. This makes it easy to enlarge or reduce the objects displayed on the screen.

In addition, the user can enlarge or reduce the objects displayed on the screen by a simple gesture of moving the mobile terminal back and forth with respect to the user while holding the mobile terminal with one hand, so that the user can stably hold the mobile terminal with one hand. Operation convenience that can be operated can be provided.

Hereinafter, with reference to the accompanying drawings will be described in detail an embodiment of the present invention.

As shown in FIG. 1, the mobile terminal 100 according to an embodiment of the present invention adjusts the size of the object 60 displayed on the screen by using the distance recognition between the user 200 and the mobile terminal 100. Display. That is, when the user 200 moves the mobile terminal 100 back and forth with respect to the user 200 itself, the mobile terminal 100 calculates the distance or displacement d between the user 200 and the mobile terminal 100. According to the calculated distance or displacement (d), the size of the object 60 displayed on the screen is adjusted and displayed.

At this time, the mobile terminal 100 according to an embodiment of the present invention is a mobile communication terminal, a notebook (notebook), PDA (Personal Digital Assistant), PMP (Portable Multimedia Player), DMB (Digital Multimedia Broadcasting) or DVB (Digital Video Broadcasting) It includes, but is not limited to, digital broadcast receivers.

The mobile terminal 100 according to the embodiment of the present invention will be described in detail with reference to FIGS. 1 and 2 as follows. 2 is a block diagram showing the configuration of the mobile terminal 100 of FIG.

The mobile terminal 100 according to the embodiment of the present invention includes an input unit 10, a storage unit 20, a display unit 30, a distance sensing unit 40, and a controller 50.

The input unit 10 provides a plurality of keys for the operation of the mobile terminal 100, generates a selection signal according to the key selection of the user 200, and transmits the selected signals to the controller 50. The user 200 requests display of the object 60 on the screen of the display unit 30 through the input unit 10, and enlarges the displayed object 60 by recognizing the distance between the mobile terminal 100 and the user 200. You can request to run the reduced object display mode. The input unit 10 may be a keypad, a pointing device such as a touch pad, or an input device such as a touch screen, but is not limited thereto.

The storage unit 20 stores a program necessary for controlling the operation of the mobile terminal 100 and data generated during execution of the program, and includes one or more volatile memory devices and nonvolatile memory devices. The storage unit 20 stores an execution program for enlarging or reducing the object 60 using distance recognition. The storage unit 20 stores an adjustment value for adjusting the size of the object 60 according to the distance or displacement d between the mobile terminal 100 and the user 200. In this case, the adjustment value may be set according to the distance between the mobile terminal 100 and the user 200 or may be set according to the displacement between the mobile terminal 100 and the user 200. The object 60 is information that can be displayed on the screen, and includes, but is not limited to, an image, a video, a menu, a list, an icon, and a text.

The display unit 30 displays information stored in the storage unit 20 as at least one object 60, including various function menus executed in the mobile terminal 100. The display unit 30 adjusts and displays the size of the object 60 according to whether the distance between the mobile terminal 100 and the user 200 is controlled under the control of the controller 50. In this case, the display unit 30 may be a liquid crystal display (LCD), organic light emitting diodes (OLED), a touch screen, or the like, but is not limited thereto. The touch screen simultaneously serves as a display device and an input device.

The distance detector 40 detects the user 200 and outputs a detection signal to the controller 50. The detection signal includes distance information necessary for calculating the distance between the mobile terminal 100 and the user 200. The distance information includes at least one of a source used to detect the user 200, for example, an irradiation speed of an infrared ray, an ultrasonic wave, a time when the user 200 is detected, and a captured image. In this case, the distance detecting unit 40 may include at least one of a camera, a proximity sensor, an infrared sensor, a radio frequency (RF) sensor, a gyro sensor, an acceleration sensor, and an ultrasonic sensor, but is not limited thereto.

The controller 50 is a microprocessor that performs the overall control operation of the mobile terminal 100. The controller 50 controls the size adjustment of the displayed object 60 by recognizing the distance between the mobile terminal 100 and the user 200. In this case, the controller 50 calculates the displacement between the mobile terminal 100 and the user 200 to display the image by adjusting the size of the object 60 or calculates the distance between the mobile terminal 100 and the user 200 to determine the object ( 60) can be displayed by adjusting the size.

First, the controller 50 calculates the displacement between the mobile terminal 100 and the user 200 to adjust and display the size of the object 60 as follows. That is, the controller 50 receives the detection signal from the distance detector 40. The controller 50 calculates a displacement between the mobile terminal 100 and the user 200 based on the received detection signal. The controller 50 adjusts the size of the object 60 according to the calculated displacement and displays it on the display unit 30. In this case, the controller 50 may extract an adjustment value according to the displacement calculated by the storage unit 20, and adjust and display the size of the object 60 using the extracted adjustment value.

The displacement between the mobile terminal 100 and the user 200 can be calculated as follows. That is, the controller 50 calculates a first distance between the mobile terminal 100 and the user 200 from the first detection signal received through the distance detection unit 40. Next, the controller 50 receives a second detection signal according to a change in position between the mobile terminal 100 and the user 200 through the distance detection unit 40, and based on the received second detection signal, the mobile terminal 100. ) And a second distance between the user 200. The controller 50 calculates the displacement by the difference between the calculated second distance and the first distance, as disclosed in Equation 1 below.

Displacement = second distance-first distance

The distance between the mobile terminal 100 and the user 200 may be calculated using at least one of a camera vision method, an infrared method, a gyro-acceleration method, and an ultrasound method, but is not limited thereto. For example, the camera vision method is a method of calculating a distance from a size of a user image photographed by a camera. That is, since the size of the user image photographed by the camera is inversely proportional to the distance between the mobile terminal 100 and the user 200, the controller 50 determines the size of the user image and the distance between the mobile terminal 100 and the user 200. The distance between the mobile terminal 100 and the user 200 may be calculated from the relational expression. That is, the controller 50 extracts a specific portion of the user 200, for example, a face, a mouth, a nose, and an eye, from the captured user image, and calculates the size of the extracted specific portion. The controller 50 may calculate the distance between the mobile terminal 100 and the user 200 according to the calculated size.

The gyro-accelerated method detects the movement of the mobile terminal 100 with a gyro sensor and an acceleration sensor and calculates a moving distance or displacement of the mobile terminal 100. That is, when the mobile terminal 100 moves in a specific direction from the starting point, the controller 50 receives the detection signals from the gyro sensor and the acceleration sensor, respectively. In this case, the controller calculates a moving direction of the mobile terminal 100 from the detection signal received from the gyro sensor. The controller 50 calculates the acceleration value according to the movement of the mobile terminal 100 from the detection signal received from the acceleration sensor, and calculates the distance by integrating the calculated acceleration value twice. The controller 50 calculates the displacement of the mobile terminal 100 from the distance and the direction of the starting point.

In addition, the infrared (or ultrasonic) method is a method of calculating a distance between the mobile terminal 100 and the user 200 by receiving a reflected wave of infrared rays radiated from the mobile terminal 100 to the user 200. That is, after irradiating infrared rays from the infrared irradiation unit of the distance detecting unit 40 to the user 200 and receiving the reflected reflected wave from the infrared receiving unit, the distance detecting unit 40 transmits a detection signal to the control unit 50. At this time, the detection signal includes the reception time of the reflected wave as the distance information. The controller 50 may calculate the distance between the mobile terminal 100 and the user 200 from the reception time of the reflected wave included in the detection signal and the irradiation speed of the infrared ray. For example, assuming that the irradiation speed of the infrared ray and the reflected wave speed are the same, the distance between the mobile terminal 100 and the user 200 may be calculated by multiplying the reception time by the irradiation speed and dividing by two.

On the other hand, the displacement may have one of positive, zero and negative values. The displacement has a positive value when the second distance is longer than the first distance, that is, when the distance between the mobile terminal 100 and the user 200 is far. When the displacement has a value of zero, the second distance and the first distance are the same, that is, the distance between the mobile terminal 100 and the user 200 is maintained. When the displacement has a negative value, the second distance is shorter than the first distance, that is, when the distance between the mobile terminal 100 and the user 200 approaches.

The controller 50 may display the object 60 in various ways as described below when the object 60 is adjusted and displayed according to the calculated displacement, but is not limited thereto. That is, if the calculated displacement is a positive value, the controller 50 enlarges and displays the object 60. If the calculated displacement is a negative value, the controller 50 may reduce and display the object 60. On the contrary, if the calculated displacement is a positive value, the controller 50 reduces and displays the object 60. If the calculated displacement is a negative value, the controller 50 may enlarge and display the object 60. When the calculated displacement is zero, the controller 50 may maintain the display state of the object 60. In this case, the controller 50 may enlarge or reduce the size of the object 60 in proportion to the calculated absolute value of the displacement. For example, the controller 50 may enlarge or reduce the size of the object 60 continuously or stepwise in proportion to the calculated absolute value of the displacement. Alternatively, the controller 50 may enlarge or reduce the size of the object 60 to a predetermined size according to the calculated absolute value of the displacement.

Alternatively, if the absolute value of the calculated displacement is greater than or equal to the threshold value, the controller 50 adjusts and displays the size of the object 60. If the absolute value of the calculated displacement is equal to or less than the threshold value, the controller 50 may maintain the display state of the object 60. If the absolute value of the calculated displacement is greater than or equal to the threshold value, the controller 50 may enlarge or reduce the size of the object 60 in proportion to the absolute value. Alternatively, if the absolute value of the calculated displacement is greater than or equal to the threshold value, the controller 50 may enlarge or reduce the size of the object to a predetermined size. Here, the threshold may be set to a specific value or may be set to a certain range.

Next, the controller 50 calculates the distance between the mobile terminal 100 and the user 200 to adjust and display the size of the object 60 as follows. That is, the controller 50 receives the detection signal from the distance detector 40. The controller 50 calculates a distance between the mobile terminal 100 and the user 200 based on the received detection signal. The controller 50 adjusts the size of the object 60 according to the calculated distance and displays it on the display unit 30. In this case, the controller 50 may extract an adjustment value according to the distance calculated by the storage unit 20, and adjust and display the size of the object 60 using the extracted adjustment value.

The controller 50 may display the object 60 in various ways as described below when the object 60 is adjusted according to the calculated distance, but is not limited thereto. For example, if the calculated distance exceeds the threshold, the controller 50 enlarges and displays the size of the object 60 rather than the reference size at the threshold. If the calculated distance is a threshold value, the controller 50 displays the object 60 at a reference size. If the calculated distance is less than or equal to the threshold value, the controller 50 reduces the size of the object 60 rather than the reference size and displays it. That is, when the mobile terminal 100 moves out of the distance corresponding to the threshold with respect to the user 200, the controller 50 enlarges and displays the object 60 displayed on the screen. In the opposite case, the controller 50 reduces and displays the object 60 displayed on the screen.

On the contrary, if the calculated distance exceeds the threshold, the controller 50 reduces the size of the object 60 and displays the size smaller than the reference size at the threshold. If the calculated distance is a threshold value, the controller 50 displays the object 60 at a reference size. If the calculated distance is less than or equal to the threshold value, the controller 50 enlarges and displays the size of the object 60 rather than the reference size. That is, when the mobile terminal 100 moves out of the distance corresponding to the threshold with respect to the user 200, the controller 50 reduces and displays the object 60 displayed on the screen. In the opposite case, the controller 50 enlarges and displays the object 60 displayed on the screen.

Alternatively, if the calculated distance is greater than or equal to the threshold value, the controller 50 maintains the size of the object 60 at the threshold value. If the calculated distance is less than or equal to the threshold value, the controller 50 adjusts and displays the size of the object 60. That is, when the mobile terminal 100 moves out of the threshold distance corresponding to the threshold value, the controller 50 displays the object 60 at a predetermined size. When the mobile terminal 100 moves inside the critical distance, the controller 50 adjusts and displays the size of the object 60.

Alternatively, if the calculated distance is greater than or equal to the threshold value, the controller 50 adjusts and displays the size of the object 60. If the calculated distance is less than or equal to the threshold, the controller 50 maintains the size of the object 60 at the threshold. That is, when the mobile terminal 100 moves inside the threshold distance corresponding to the threshold value, the controller 50 displays the object 60 at a predetermined size. When the mobile terminal 100 moves out of the critical distance, the controller 50 adjusts and displays the size of the object 60.

In this case, the controller 50 may adjust and display the size of the object 60 in proportion to the calculated distance.

As described above, since the mobile terminal 100 adjusts the size of the object 60 by displaying the distance between the user 200 and the mobile terminal 100 and displays it on the screen, the user 200 Even if the input unit 10 is not operated separately, the object 60 displayed on the screen can be easily enlarged or reduced by a simple gesture of moving the mobile terminal 100 back and forth with respect to itself. In addition, the user 200 may enlarge or reduce the object 60 displayed on the screen through a simple gesture of moving the mobile terminal 100 back and forth with respect to the user 200 while holding the mobile terminal 100 with one hand. In addition, the mobile terminal 100 according to an embodiment of the present invention can provide a user convenience to the user 200 to stably operate the mobile terminal 100 with one hand.

An example of an object display method of the mobile terminal 100 using distance recognition according to an embodiment of the present invention will be described with reference to FIGS. 1 to 5. 3 is a flowchart illustrating an example of an object display method of the mobile terminal 100 using distance recognition according to an embodiment of the present invention. 4 is a detailed flowchart according to the step of calculating the displacement between the mobile terminal 100 and the user 200 of FIG. 5 is a detailed flowchart according to the step of adjusting and displaying the size of the object 60 according to the calculated displacement of FIG. 3.

First, in step S71, the mobile terminal 100 displays the object 60 on the screen of the display unit 30. For example, when a selection signal of the user 200 is input through the input unit 10, the mobile terminal 100 may display the object 60 on the screen.

Next, the mobile terminal 100 detects the user 200 through the distance detecting unit 40 in step S73. That is, when the object 60 is displayed on the screen, the controller 50 activates the distance detector 40. When the distance detector 40 detects the user 200, the distance detector 40 outputs the detection signal to the controller 50. In this case, the controller 50 may automatically activate the distance detector 40 when the object 60 is displayed on the screen or in response to a request signal from the user 200. The request signal of the user 200 may be input through a key input, a voice input, a gesture input, and the like, but is not limited thereto. In addition, the distance detecting unit 40 may output the detection signal to the controller 50 periodically or continuously.

Meanwhile, the mobile terminal 100 may display the object 60 at a predetermined size regardless of the distance between the user 200 and the mobile terminal 100 according to the selection signal of the user 200. For example, when the distance sensing unit 40 is switched to an inactive state according to a selection signal of the user 200, the mobile terminal 100 has a predetermined size regardless of the distance between the user 200 and the mobile terminal 100. Is displayed. In addition, when the execution of the object display mode is stopped according to the selection signal of the user 200, the mobile terminal 100 displays the object 60 at a predetermined size even when the sensing signal is received from the distance detecting unit 40.

Next, in operation S75, the mobile terminal 100 calculates a displacement between the user 200 and the mobile terminal 100 based on the received detection signal. In this case, the mobile terminal 100 may calculate the displacement between the user 200 and the mobile terminal 100 using at least one of a camera vision method, an infrared method, a gyro-acceleration method, and an ultrasound method.

Referring to the step of calculating the displacement according to step S75 in detail. First, in operation S751, the mobile terminal 100 calculates a first distance between the mobile terminal 100 and the user 200 from the first detection signal received through the distance detection unit 40. Next, in operation S753, the mobile terminal 100 receives a second detection signal according to a change in position between the mobile terminal 100 and the user 200 through the distance detection unit 40, and based on the received second detection signal. The second distance between the mobile terminal 100 and the user 200 is calculated. In operation S755, the mobile terminal 100 may calculate the displacement based on the difference between the calculated second distance and the first distance.

In operation S77, the mobile terminal 100 adjusts the size of the object 60 according to the calculated displacement and displays the size on the display unit 30. The step S77 will be described in detail with reference to FIG. 5 as follows. First, in step S771, the controller 50 determines whether the calculated absolute value of the displacement is greater than or equal to the threshold value.

If the determination result of step S771 is equal to or greater than the threshold value, in step S773, the mobile terminal 100 determines whether the displacement calculated again has a positive value or a negative value.

When the determination result in step S773 has a negative value, in step S775, the mobile terminal 100 enlarges and displays the object 60. That is, when the mobile terminal 100 moves toward the user 200, the mobile terminal 100 enlarges and displays the object 60. The mobile terminal 100 may enlarge the size of the object 60 in proportion to the calculated absolute value of the displacement.

If the determination result in step S773 has a positive value, in step S777, the mobile terminal 100 displays the object 60 in a reduced size. That is, when the mobile terminal 100 moves away from the user 200, the mobile terminal 100 reduces the object 60 and displays it. The mobile terminal 100 may reduce the size of the object 60 in proportion to the calculated absolute value of the displacement.

On the other hand, if the determination result of step S771 is less than the threshold value, in step S779 the mobile terminal 100 maintains the size of the object (60). That is, when there is little variation in the distance between the mobile terminal 100 and the user 200, the mobile terminal 100 maintains the display state of the object 60 displayed on the screen.

Meanwhile, in the example of the object display method of the mobile terminal 100 according to the embodiment of the present invention, an example of expanding the size of the object 60 in operation S775 and reducing the size of the object 60 in operation S777 is disclosed. It is not limited to this. For example, the size of the object 60 may be reduced in step S775, and the size of the object 60 may be enlarged in step S777.

Another example of an object display method of the mobile terminal 100 using distance recognition according to an embodiment of the present invention will be described with reference to FIGS. 1, 2, 6, and 7 as follows. 6 is a flowchart illustrating another example of an object display method of the mobile terminal 100 using distance recognition according to an embodiment of the present invention. FIG. 7 is a detailed flowchart according to the step of adjusting and displaying the size of the object 60 according to the calculated distance of FIG. 6.

First, in step S71, the mobile terminal 100 displays the object 60 on the screen of the display unit 30. Subsequently, in step S73, the mobile terminal 100 receives a detection signal that detects the user 200 through the distance detection unit 30.

Next, in step S76, the mobile terminal 100 calculates a distance between the user 200 and the mobile terminal 100 based on the received detection signal. In this case, the mobile terminal 100 may calculate the distance between the user 200 and the mobile terminal 100 using at least one of a camera vision method, an infrared method, and an ultrasonic method.

In operation S78, the mobile terminal 100 adjusts the size of the object 60 according to the calculated distance and displays it on the display unit 30. The step S78 will be described in detail with reference to FIG. 7 as follows. First, in step S781, the mobile terminal 100 compares the calculated distance and the threshold value.

When the distance calculated as a result of the comparison in step S781 is less than or equal to the threshold value, in step S785, the mobile terminal 100 enlarges the size of the object 60. That is, when the mobile terminal 100 moves toward the user 200, the mobile terminal 100 enlarges and displays the size of the object 60. In this case, the mobile terminal 100 may enlarge the size of the object 60 in proportion to the calculated distance. Alternatively, the mobile terminal 100 may enlarge the size of the object 60 rather than the reference size at the threshold.

When the distance calculated as a result of the comparison in step S781 exceeds the threshold, in step S787, the mobile terminal 100 may reduce the size of the object 60. That is, when the mobile terminal 100 moves away from the user 200, the mobile terminal 100 reduces the size of the object 60 and displays it. In this case, the mobile terminal 100 may reduce the size of the object 60 in proportion to the calculated distance. Alternatively, the mobile terminal 100 may reduce the size of the object 60 rather than the reference size at the threshold.

When the distance calculated as a result of the comparison in step S781 is equal to the threshold value, the mobile terminal 100 maintains the size of the object 60 in step S789. That is, when there is little variation in the distance between the mobile terminal 100 and the user 200, the mobile terminal 100 maintains the size of the object 60 displayed on the screen. In this case, the mobile terminal 100 may display the object 60 as a reference size at the threshold.

Meanwhile, in another example of the method for displaying an object of the mobile terminal 100 according to an embodiment of the present invention, an example of expanding the size of the object 60 in step S785 and reducing the size of the object 60 in step S787 is disclosed. It is not limited to this. For example, the size of the object 60 may be reduced in step S785, and the size of the object 60 may be enlarged in step S787.

The object display method of the mobile terminal 100 using distance recognition according to an embodiment of the present invention will be described with reference to the screen example of FIG. 8 as follows. 8 is a diagram illustrating a screen according to the object display method of the mobile terminal 100 using distance recognition according to an embodiment of the present invention.

Referring to FIG. 8, when the user 200 moves the mobile terminal 100 in the direction of the arrow 91, that is, toward the user 200, the mobile terminal 100 displays the object 60 displayed on the display unit 30. ) Enlarged to display.

On the other hand, when the user 200 moves the mobile terminal 100 in the direction of reference numeral 93, that is, away from the user 200, the mobile terminal 100 reduces the object 60 displayed on the display unit 30. Display.

8 illustrates an example in which the mobile terminal 100 enlarges the object 60 when the mobile terminal 100 moves toward the user 200, and reduces the object 60 when the mobile terminal 100 moves away from the user 200, but the present invention is not limited thereto. In other words, when the mobile terminal 100 moves toward the user 200, the object 60 may be reduced, and when the mobile terminal 100 moves away from the user 200, the object 60 may be enlarged.

On the other hand, the embodiments of the present invention disclosed in the specification and drawings are merely presented specific examples to aid understanding, and are not intended to limit the scope of the present invention. In addition to the embodiments disclosed herein, it is apparent to those skilled in the art that other modifications based on the technical idea of the present invention may be implemented.

The present invention relates to a mobile terminal and an object display method using the distance recognition. Since the mobile terminal adjusts the size of the object and displays it on the screen according to the distance or displacement between the user and the mobile terminal, the user does not separately operate the input unit. Even if you do not, you can easily zoom in or out on an object displayed on the screen through a simple gesture that moves the mobile terminal back and forth with respect to itself.This allows the user to stably operate the mobile terminal with one hand to enlarge or reduce the object. Operation convenience can be provided.

1 is a view showing a state of use of a mobile terminal for displaying an object using distance recognition according to an embodiment of the present invention.

2 is a block diagram illustrating a configuration of the mobile terminal of FIG. 1.

3 is a flowchart illustrating an example of an object display method of a portable terminal using distance recognition according to an embodiment of the present invention.

FIG. 4 is a detailed flowchart according to calculating a displacement between the mobile terminal and the user of FIG. 3.

FIG. 5 is a detailed flowchart according to a step of displaying and adjusting the size of an object according to the calculated displacement of FIG. 3.

6 is a flowchart illustrating another example of an object display method of a mobile terminal using distance recognition according to an embodiment of the present invention.

FIG. 7 is a detailed flowchart according to a step of displaying and adjusting the size of an object according to the calculated distance of FIG. 6.

8 is an exemplary view of a screen according to an object display method of a mobile terminal using distance recognition according to an embodiment of the present invention.

Description of the Related Art [0002]

10: input unit 20: storage unit

30: display unit 40: distance detection unit

50: control unit 100: mobile terminal

200: user

Claims (22)

In the mobile terminal, A display unit displaying an object on a screen; A distance detector for detecting a user of the portable terminal and outputting a detection signal; A control unit configured to receive the detection signal from the distance detection unit, calculate a displacement between the mobile terminal and the user based on the received detection signal, and adjust the size of the object according to the calculated displacement to display on the display unit; A mobile terminal comprising a. The method of claim 1, A storage unit for storing an adjustment value for adjusting the size of the object according to the displacement; More, The controller extracts the adjustment value according to the calculated displacement from the storage unit, and adjusts the size of the object by the extracted adjustment value. In the mobile terminal, A display unit displaying an object on a screen; A distance detector for detecting a user of the portable terminal and outputting a detection signal; A control unit configured to receive the detection signal from the distance detection unit, calculate a distance between the mobile terminal and the user based on the received detection signal, and adjust the size of the object according to the calculated distance to display on the display unit; A mobile terminal comprising a. The method of claim 3, A storage unit for storing an adjustment value for adjusting the size of the object according to the calculated distance; More, The controller extracts the adjustment value according to the calculated distance from the storage unit, and adjusts the size of the object by the extracted adjustment value. According to claim 1 or 3, wherein the distance detecting unit, A mobile terminal comprising at least one of a camera, a proximity sensor, an infrared sensor, a radio frequency (RF) sensor, a gyro sensor, an acceleration sensor, and an ultrasonic sensor. A display step of displaying, by the mobile terminal, an object on a screen; A reception step of receiving, by the portable terminal, a detection signal detected by a user through a distance detection unit; Calculating, by the portable terminal, a displacement between the portable terminal and the user based on the received detection signal; An adjustment display step of displaying, by the mobile terminal, the size of the object according to the calculated displacement; Object display method of the mobile terminal using the distance recognition, characterized in that it comprises a. The method of claim 6, wherein the calculating step, Calculating, by the portable terminal, a first distance between the portable terminal and the user from the first detection signal received through the distance sensing unit; Calculating, by the portable terminal, a second distance between the portable terminal and the user from the second sensing signal received according to a change in position between the portable terminal and the user through the distance detecting unit; Calculating, by the portable terminal, a displacement by a difference between the second distance and the first distance; Object display method of the mobile terminal using the distance recognition, characterized in that it comprises a. The method of claim 6, wherein in the calculating step, Displacement between the mobile terminal and the user is calculated using at least one of a camera vision method, an infrared method, a gyro-acceleration method, and an ultrasonic method. . The method of claim 6, wherein the adjustment display step, If the calculated displacement is a positive value, expanding the object by the mobile terminal; If the calculated displacement is negative, the mobile terminal shrinks the object; Object display method of the mobile terminal using the distance recognition, characterized in that it comprises a. The method of claim 6, wherein the adjustment display step, If the calculated displacement is a positive value, the mobile terminal shrinks the object; If the calculated displacement is a negative value, expanding the object by the mobile terminal; Object display method of the mobile terminal using the distance recognition, characterized in that it comprises a. The method according to claim 9 or 10, wherein in the adjustment display step, And displaying the size of the object in proportion to the calculated absolute value of the displacement. The method of claim 6, wherein the adjustment display step, If the absolute value of the calculated displacement is greater than or equal to a threshold, displaying, by the mobile terminal, adjusting the size of the object; If the absolute value of the calculated displacement is less than or equal to a threshold, the mobile terminal maintaining a display state of the object; Object display method of the mobile terminal using the distance recognition, characterized in that it comprises a. The method of claim 12, wherein in the adjustment display step, And if the absolute value of the calculated displacement is greater than or equal to a threshold value, the portable terminal enlarges or reduces the size of the object in proportion to the absolute value. The method of claim 12, wherein in the adjustment display step, If the absolute value of the calculated displacement is greater than or equal to a threshold, the object display method of the mobile terminal using the distance recognition, characterized in that the mobile device enlarges or reduces the size of the object to a predetermined size. The method of claim 6, And the object comprises at least one of an image, a video, a menu, a list, an icon, and text. A display step of displaying, by the mobile terminal, an object on a screen; A reception step of receiving, by the portable terminal, a detection signal detected by a user through a distance detection unit; Calculating, by the portable terminal, a distance between the portable terminal and the user based on the received detection signal; An adjustment display step of displaying, by the mobile terminal, the size of the object according to the calculated distance; Object display method of the mobile terminal using the distance recognition, characterized in that it comprises a. The method of claim 16, wherein in the calculating step, The distance between the portable terminal and the user is calculated by using at least one of the camera vision method, infrared method and ultrasonic method. The method of claim 16, wherein the adjustment display step, If the calculated distance exceeds a threshold, the mobile terminal expanding the size of the object rather than the reference size at the threshold; If the calculated distance is a threshold, displaying, by the mobile terminal, the object at a reference size at the threshold; If the calculated distance is less than or equal to a threshold, the mobile terminal reducing the size of the object from a reference size at the threshold; Object display method of the mobile terminal using the distance recognition, characterized in that it comprises a. The method of claim 16, wherein the adjustment display step, If the calculated distance exceeds a threshold, the mobile terminal reducing the size of the object rather than the reference size at the threshold; If the calculated distance is a threshold, displaying, by the mobile terminal, the object at a reference size at the threshold; If the calculated distance is less than or equal to a threshold, the mobile terminal expanding the size of the object rather than the reference size at the threshold; Object display method of the mobile terminal using the distance recognition, characterized in that it comprises a. The method of claim 16, wherein in the adjustment display step, And displaying the size of the object in proportion to the calculated distance. The method of claim 16, wherein the adjustment display step, If the calculated distance is greater than or equal to a threshold, the mobile terminal maintaining the size of the object at the threshold; If the calculated distance is equal to or less than a threshold, displaying, by the mobile terminal, adjusting the size of the object; Object display method of the mobile terminal using the distance recognition, characterized in that it comprises a. The method of claim 16, wherein the adjustment display step, If the calculated distance is greater than or equal to a threshold, displaying, by the mobile terminal, adjusting the size of the object; If the calculated distance is less than or equal to a threshold, the mobile terminal maintaining the size of the object at the threshold; Object display method of the mobile terminal using the distance recognition, characterized in that it comprises a.

Images