KR20100130875A - Electronic device capable of controlling operation using a touchless sensor and control method thereof - Google Patents

Abstract

PURPOSE: An electronic device capable of controlling an operation using a non-contact sensor and a control method thereof are provided to display an operation control menu and a pointer on a screen without touching a screen, thereby executing a desired operation. CONSTITUTION: A controller displays an image on a display unit(S200). If an adjacent object is sensed by a sensing signal of a sensor, the controller displays an operation control menu and a pointer on one area of the display unit(S205,S210). The sensor senses the adjacent object by an ultrasonic reflected wave. If movement of the adjacent object is sensed by a change of the sensing signal, the controller moves a display location of the pointer corresponding to movement of the adjacent object(S215,S220).

Description

Electronic device capable of controlling operation using a touchless sensor and control method

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an electronic device and a control method thereof, and more particularly, to an electronic device capable of controlling an operation in a touchless manner and a control method thereof.

Digital photo frame, a kind of electronic device, is similar to general glass picture frame, but it is a device that can display images or videos in digital file by using LCD as a display. E-frame can be connected to a computer, just plug in a memory card, recognize digital files, display images, and have its own memory to store some digital files. The electronic picture frame allows you to listen to music through the built-in speaker as well as photos, and has the function to provide real-time information such as video playback, weather and stocks.

By the way, in the case of a general electronic frame, the operation control method through the button is difficult for the user to intuitively use, it takes time to master the operation method, it may be a negative factor in terms of design due to the button keys. In addition, the operation control method using the touch screen is convenient for the user to use through an intuitive touch, but when the screen of the electronic frame is touched with a finger or the like, fingerprints remain on the screen and thus a clear screen cannot be maintained.

Therefore, in order to efficiently use various functions provided by the electronic picture frame, it is necessary to control the operation of the electronic picture frame through a method capable of intuitive operation control without directly touching the screen of the electronic picture frame.

Accordingly, an object of the present invention is to provide an electronic device and a control method thereof capable of controlling the operation in a non-contact manner by using a non-contact detection sensor.

According to an aspect of the present invention, there is provided a method of controlling an electronic device, the method comprising: displaying an image on a display unit, providing a detection sensor for detecting a proximity object by an ultrasonic wave, and outputting the detection signal output from the detection sensor Accordingly, when the proximity object is detected, displaying an operation control menu and a pointer on one area of the display unit, and when the movement of the proximity object is detected according to the change of the detection signal, the movement of the proximity object is performed. Moving the display position of the pointer.

In addition, the control method of the electronic device according to the present invention for achieving the above object, the step of displaying an image on the display unit, providing a sensing sensor for detecting a proximity object by the ultrasonic reflected wave, which is output from the sensing sensor Displaying the operation control menu and a pointer on a region of the display unit when the proximity object approaching the first distance or less is detected according to the detection signal, and the first distance and the first distance according to the change of the detection signal. And when the movement of the proximity object is detected between the second distances closer to the display portion than one distance, moving the display position of the pointer in response to the movement of the proximity object.

On the other hand, the electronic device according to the present invention, the display unit for displaying an image, a sensing unit for detecting a proximity object using an ultrasonic sensor, and when the proximity object is detected according to the detection signal output from the sensing unit, the display And a control unit for displaying an operation control menu and a pointer on a negative area, and moving the display position of the pointer in response to the movement of the proximity object when the movement of the proximity object is detected according to the change of the detection signal.

In addition, the electronic device according to the present invention includes a display unit for displaying an image, a sensing unit sensing a proximity object by an ultrasonic reflected wave, and a first distance closer to the display unit according to a sensing signal output from the sensing unit. When the proximity object is detected, an operation control menu and a pointer are displayed on an area of the display unit, and the proximity object is located between the first distance and a second distance closer to the first distance according to the change of the detection signal. And a control unit for moving the display position of the pointer in response to the movement of the adjacent object.

According to the present invention, by using a detection sensor that detects a proximity object in a non-contact manner, such as an ultrasonic sensor, by displaying and moving the operation control menu and the pointer on the screen without touching the screen, the user can execute the desired operation. . Accordingly, in the case of an electronic picture frame or the like, various operations can be conveniently controlled in a non-contact manner without touching the screen or operating a button.

Hereinafter, with reference to the drawings will be described the present invention in more detail.

Electronic devices described in the present specification include a digital photo frame, a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a personal digital assistant (PDA), and a portable multimedia player (PMP). , Navigation, and the like. In addition, suffixes "module" and " part "for the components used in the following description are given merely for convenience of description, and do not give special significance or role in themselves. Therefore, the "module" and "unit" may be used interchangeably.

1 is a block diagram of an electronic device according to an embodiment of the present invention. Referring to Figure 1 will be described in terms of the components according to the electronic device function according to an embodiment of the present invention.

Referring to FIG. 1, the electronic device 100 may include a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, and an output unit 150. , A memory 160, an interface unit 170, a controller 180, and a power supply unit 190. Such components may be configured by combining two or more components into one component, or by dividing one or more components into two or more components as necessary when implemented in an actual application.

The wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 113, a wireless Internet module 115, a short distance communication module 117, and a GPS module 119.

The broadcast receiving module 111 receives at least one of a broadcast signal and broadcast related information from an external broadcast management server through a broadcast channel. In this case, the broadcast channel may include a satellite channel, a terrestrial channel, and the like. The broadcast management server may refer to a server for generating and transmitting at least one of a broadcast signal and broadcast related information and a server for receiving at least one of the generated broadcast signal and broadcast related information and transmitting the broadcast signal to the terminal.

The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal having a data broadcast signal combined with a TV broadcast signal or a radio broadcast signal. The broadcast related information may also be provided through a mobile communication network, and in this case, may be received by the mobile communication module 113. Broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 receives a broadcast signal using various broadcast systems, and in particular, digital multimedia broadcasting-terrestrial (DMB-T), digital multimedia broadcasting-satellite (DMB-S), and media forward link (MediaFLO). Digital broadcast signals can be received using digital broadcasting systems such as only), digital video broadcast-handheld (DVB-H), integrated services digital broadcast-terrestrial (ISDB-T), and the like. In addition, the broadcast receiving module 111 may be configured to be suitable for all broadcast systems providing broadcast signals as well as such digital broadcast systems. The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 113 transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data according to voice call signal, video call signal, or text / multimedia message transmission and reception.

The wireless internet module 115 refers to a module for wireless internet access, and the wireless internet module 115 may be embedded or external to the electronic device 100. Wireless Internet technologies may include Wireless LAN (Wi-Fi), Wireless Broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), and the like.

The short-range communication module 117 refers to a module for short-range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, etc. may be used.

A GPS (Global Position System) module 119 receives position information from a plurality of GPS satellites.

The A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 123. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video call mode or the photographing mode. The processed image frame may be displayed on the display unit 151.

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. The camera 121 may be equipped with two or more cameras according to the configuration of the terminal.

The microphone 123 receives an external sound signal by a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 113 and output when the voice data is in the call mode. The microphone 123 may be a variety of noise reduction algorithms for eliminating noise generated in receiving an external sound signal.

The user input unit 130 generates key input data input by the user for controlling the operation of the terminal. The user input unit 130 may include a key pad, a dome switch, a touch pad (static pressure / capacitance), a jog wheel, a jog switch, a finger mouse, and the like. Particularly, when the touch pad has a mutual layer structure with the display unit 151 described later, it can be called a touch screen.

The sensing unit 140 detects a current state of the electronic device 100 such as an open / closed state of the terminal 100, a location of the electronic device 100, presence or absence of user contact, and the like to sense an operation of the electronic device 100. Generate a signal. For example, when the terminal 100 is in the form of a slide phone, it may sense whether the slide phone is opened or closed. In addition, it may be responsible for sensing functions related to whether the power supply unit 190 is supplied with power, whether the interface unit 170 is coupled to an external device, and the like.

The sensing unit 140 may include a detection sensor 141, a pressure sensor 143, a motion sensor 145, and the like. The sensor 141 may detect the presence or absence of an object approaching or an object present in the vicinity without mechanical contact. The detection sensor 141 may detect a proximity object by using an ultrasonic reflected wave, using a change in an alternating magnetic field or a change in a static magnetic field, or using a rate of change in capacitance. The sensor 141 may be provided with two or more according to the configuration aspect.

The pressure sensor 143 may detect whether pressure is applied to the terminal 100 and the magnitude of the pressure. The pressure sensor 143 may be installed at a portion of the electronic device 100 that requires the detection of pressure according to the use environment. If the pressure sensor 143 is installed in the display unit 151, a touch input through the display unit 151 and a greater pressure than the touch input are applied according to a signal output from the pressure sensor 143. The pressure touch input can be identified. In addition, according to the signal output from the pressure sensor 143, it can also know the magnitude of the pressure applied to the display unit 151 when the pressure touch input.

The motion sensor 145 detects the position or movement of the electronic device 100 using an acceleration sensor, a gyro sensor, or the like. An acceleration sensor that can be used for the motion sensor 145 is a device that converts an acceleration change in one direction into an electric signal and is widely used along with the development of MEMS (micro-electromechanical systems) technology. The acceleration sensor measures the acceleration of a small value built in the airbag system of an automobile and recognizes the minute motion of the human hand and measures the acceleration of a large value used as an input means such as a game There are various types. Acceleration sensors are usually constructed by mounting two or three axes in one package. Depending on the usage environment, only one axis of Z axis is required. Therefore, when the acceleration sensor in the X-axis direction or the Y-axis direction is used instead of the Z-axis direction for some reason, the acceleration sensor may be mounted on the main substrate by using a separate piece substrate.

The gyro sensor is a sensor for measuring the angular velocity, and it can sense the direction of rotation with respect to the reference direction.

The output unit 150 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 150 may include a display unit 151, an audio output module 153, an alarm unit 155, and a haptic module 157.

The display unit 151 displays and outputs information processed by the electronic device 100. For example, when the terminal 100 is in a call mode, the terminal 100 displays a user interface (UI) or a graphic user interface (GUI) related to the call. When the terminal 100 is in the video call mode or the shooting mode, the terminal 100 may display the captured or received images, respectively, or simultaneously, and display the UI and the GUI.

Meanwhile, as described above, when the display unit 151 and the touch pad have a mutual layer structure and constitute a touch screen, the display unit 151 may be used as an input device in addition to the output device. If the display unit 151 is configured as a touch screen, it may include a touch screen panel, a touch screen panel controller, and the like. In this case, the touch screen panel is a transparent panel attached to the outside and may be connected to the internal bus of the terminal 100. The touch screen panel keeps a watch on the contact result, and if there is a touch input, sends the corresponding signals to the touch screen panel controller. The touch screen panel controller processes the signals, and then transmits corresponding data to the controller 180 so that the controller 180 can determine whether the touch input has been made and which area of the touch screen has been touched.

In addition, the display unit 151 may be configured of an electronic paper (e-Paper). Electronic paper (e-Paper) is a kind of reflective display, and has excellent visual characteristics such as high resolution, wide viewing angle and bright white background as conventional paper and ink. E-paper can be implemented on any substrate such as plastic, metal, paper, etc., and the image is maintained even after the power is cut off, and there is no back light power, so the battery life of the electronic device 100 is long. Can be maintained. As the electronic paper, a hemispherical twist ball filled with a telephone can be used, or an electrophoresis method and a microcapsule can be used.

In addition, the display unit 151 may include a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, and a three-dimensional display. It may include at least one of (3D display). In addition, two or more display units 151 may exist according to the implementation form of the electronic device 100. For example, an external display unit (not shown) and an internal display unit (not shown) may be simultaneously provided in the electronic device 100.

The audio output module 153 outputs audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, In addition, the sound output module 153 outputs a sound signal related to a function performed in the electronic device 100, for example, a call signal reception sound and a message reception sound. The sound output module 153 may include a speaker, a buzzer, and the like.

The alarm unit 155 outputs a signal for notifying occurrence of an event of the terminal 100. Examples of events occurring in the terminal 100 include call signal reception, message reception, and key signal input. The alarm unit 155 outputs a signal for notifying occurrence of an event in a form other than an audio signal or a video signal. For example, the signal may be output in the form of vibration. The alarm unit 155 can output a signal to notify when a call signal is received or a message is received. Also. When the key signal is input, the alarm unit 155 may output the signal as a feedback to the key signal input. The user may recognize the occurrence of an event through the signal output from the alarm unit 155. The signal for notifying the event occurrence in the terminal 100 may also be output through the display unit 151 or the sound output module 153.

The haptic module 157 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 157 is a vibration effect. When the haptic module 157 generates vibration with a haptic effect, the intensity and pattern of the vibration generated by the haptic module 157 can be converted, and the different vibrations can be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 157 may be provided with a function of stimulating by a pin arrangement vertically moving with respect to the contact skin surface, an effect of stimulating air through the injection or suction force of the air through the injection port or the suction port, The effect of stimulation through contact of an electrode (eletrode), the effect of stimulation by electrostatic force, and the effect of reproducing a cold sensation using a device capable of endothermic or exothermic can be generated. The haptic module 157 can be implemented not only to transmit the tactile effect through direct contact but also to feel the tactile effect through the muscular sense of the user's finger or arm. Two or more haptic modules 157 may be provided according to a configuration aspect of the electronic device 100.

The memory 160 may store a program for processing and controlling the controller 180 and may provide a function for temporarily storing input or output data (for example, a phone book, a message, a still image, a video, etc.). It can also be done.

The memory 160 may include a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (eg, SD or XD memory, etc.), It may include a storage medium of at least one type of RAM and ROM. In addition, the electronic device 100 may operate a web storage that performs a storage function of the memory 150 on the Internet.

The interface unit 170 serves as an interface with all external devices connected to the electronic device 100. Examples of external devices connected to the electronic device 100 include a wired / wireless headset, an external charger, a wired / wireless data port, a memory card, a memory card, a SIM / UIM card, and the like. / Output) terminal, video I / O (Input / Output) terminal, earphone, and the like. The interface unit 170 may receive data from such an external device or receive power and transmit the data to each component inside the electronic device 100, and may transmit data within the electronic device 100 to an external device. .

When the electronic device 100 is connected to an external cradle, the interface unit 170 may be a passage through which power from the connected cradle is supplied to the electronic device 100, or various command signals input from the cradle by the user may be electronically transmitted. It may be a passage that is delivered to the device 100.

The controller 180 typically controls the operation of each unit to control the overall operation of the electronic device 100. For example, perform related control and processing for voice calls, data communications, video calls, and the like. In addition, the controller 180 may include a multimedia playback module 181 for multimedia playback. The multimedia playback module 181 may be configured in hardware in the controller 180 or may be configured in software separately from the controller 180.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.

The electronic device 100 having such a configuration may be configured to be operable in a communication system capable of transmitting data through a frame or packet, including a wired / wireless communication system and a satellite based communication system. have.

The electronic device according to the present invention has been described in terms of components according to functions. Hereinafter, with reference to FIG. 2, the electronic device, in particular, the electronic picture frame related to the present invention will be further described in terms of the components according to the appearance.

 Figure 2 is a perspective view of the electronic device from the front according to an embodiment of the present invention. Referring to FIG. 2, the electronic device 100 includes a case formed by the front case 100A-1 and the rear keris 100A-2, and a support 100B supporting the case.

Various electronic components are embedded in the space formed by the front case 100A-1 and the rear case 100A-2. At least one intermediate case may be further disposed between the front case 100A-1 and the rear case 100A-2. Such cases may be formed by injecting synthetic resin, or may be formed to have a wood material, or a metal material such as stainless steel (STS) or titanium (Ti).

In the main body, specifically, the front case 100A-1, the display unit 151, the first sound output module 153a, the first camera 121a, and the first to fourth detection sensors 141a, 141b, 141c, and 141d. ) May be arranged.

The display unit 151 includes a liquid crystal display (LCD), organic light emitting diodes (OLED), and the like, which visually express information. The display unit 151 may be constructed such that the touch pad is overlapped with the layer structure so that the display unit 151 operates as a touch screen so that information can be input by a user's touch. The first acoustic output module 153a may be implemented in the form of a receiver or a speaker. The first camera 121a may be implemented to be suitable for capturing an image or a video of a user or the like. The first to fourth detection sensors 141a, 141b, 141c, and 141d may detect the presence or absence of an object approaching the display unit 151 or an object present in the vicinity thereof without mechanical contact.

A user input unit (not shown) may be disposed on the side of the rear case 100A-2, and a microphone (not shown) and an interface unit (not shown) may be disposed on the front case 100A-1 or the rear case 100A-2. ) May be arranged.

The user input unit may be adopted in any manner as long as the user is operating in a tactile manner. For example, the user input unit may be implemented as a dome switch or a touch pad that may receive a command or information by a user's push or touch operation, or may be a wheel or a jog or a joystick that rotates keys. Can be implemented. In terms of functionality, the user input may be used to input commands such as start, end, scroll, etc., input of numbers or letters, symbols, etc., and hot-keys for activating special functions in the electronic device 100. Can operate as). The microphone may be implemented in a form suitable for receiving a user's voice or other sound.

 A second camera (not shown) may be additionally mounted to the rear case 100A-2. The second camera has a photographing direction substantially opposite to that of the first camera 121a. It may have different pixels. For example, in the case of a video call, the first camera 121a has a low pixel so that the user's face is photographed and transmitted to the other party, and the second camera does not immediately transmit a general subject. It is preferable to have a high pixel because there are many.

A flash (not shown) and a mirror (not shown) may be further disposed adjacent to the second camera. The flash shines toward the subject when the subject is photographed by the second camera. The mirror allows the user to see his / her own face or the like when the user wishes to photograph himself (self-photographed) using the second camera.

In addition, a second sound output module (not shown) may be further disposed on the rear case 100A-2. The second sound output module may implement the stereo function together with the first sound output module 153a, and may be used for talking in the speakerphone mode.

In addition, an antenna (not shown) for receiving a broadcast signal may be disposed on one side of the rear case 100A-2 in addition to an antenna for a call. The antenna may be installed to be pulled out of the rear case 100A-2.

In the above, the second camera or the like has been described as being disposed in the rear case 100A-2, but is not necessarily limited thereto. For example, at least one or more of the components described as being disposed in the second rear case, such as the second camera, may be mounted to the front case 100A-1. In addition, even if the second camera is not provided separately, the first camera 121a may be rotatably formed to be able to photograph up to the photographing direction of the second camera. In addition, a power supply unit (not shown) for supplying power to the electronic device 100 may be mounted on the rear case 100A-2. The power supply unit may be, for example, a rechargeable battery and detachably coupled to the rear case 100A-2 for charging.

3 is a flowchart provided to explain a method for controlling an electronic device according to an embodiment of the present invention. Referring to FIG. 3, in response to power being applied or a user command, the controller 180 displays an image on the display unit 151 (S200). In this case, the displayed image may be a video image in addition to the general photo image.

In the state where the image is displayed, when the user's finger or the like is detected by the electronic frame 100 in proximity (S205), the controller 180 controls an operation control menu and a pointer on one region of the display unit 151. To display (S210).

In this case, a proximity object such as a user's finger or the like may be detected using an ultrasonic sensor as the detection sensor 141. The ultrasonic sensor generally uses a piezoelectric vibrator, and may be configured as a transmitter for applying an electric signal of a constant frequency to the vibrator to perform sound transmission, and a receiver for generating a voltage by the received acoustic vibration. The ultrasonic sensor can grasp the distance, the position, etc. to a near object by the time until an ultrasonic wave is emitted and a change in the period, amplitude, etc. of received ultrasonic wave. In addition, the pointer displayed on the display unit 151 may be converted to a desired shape and displayed.

 If the movement of the proximity object is detected according to the change of the detection signal output from the detection sensor 141 (S215), the controller 180 controls the pointer to be displayed in response to the movement of the proximity object (S215). S220).

In addition, when the movement of the proximity object having a larger amount of reflected ultrasonic waves is detected than the normal case using the fingertip (S225), the controller 180 controls to perform a drag input operation corresponding to the movement of the proximity object (S230). . An example of the case where the reflected volume is larger than the general case may be a case using a finger node or a palm or the like. When the drag input is operated, the shape of the pointer may be displayed differently.

If the proximity object does not move for a predetermined time and the position is fixed (S235), the controller 180 controls an operation corresponding to the item indicated by the pointer or a drag input in the operation control menu to be executed ( S240). According to an operation mode, an operation corresponding to the selected item may be performed when the proximity object approaches or falls below a preset reference value. In addition, an item selected by the pointer or on which the pointer is located may be displayed in a different color or shape from another item.

This process is repeatedly performed until the end of the operation is selected (S245), it is possible to control the operation of the electronic device such as an electronic frame by a non-contact method without touching the screen.

4 is a flowchart provided to explain a method for controlling an electronic device according to another embodiment of the present invention. In the present embodiment, a case in which the operation of the electronic device is controlled by the three-dimensional method using the proximity degree indicating the proximity of the proximity object to the display unit 151 will be described.

Referring to FIG. 4, the controller 180 displays an image on the display unit 151 according to power or user command (S300). In the state where the image is displayed, when the electronic device 100 detects a proximity object in which the user's finger or the like approaches the D1 distance or less from the display unit 151 (S305), the controller 180 controls one of the display units 151. An operation control menu and a pointer are displayed in the area (S310).

Next, when the movement of the proximity object is detected in the first proximity range according to the change of the detection signal output from the detection sensor 141 (S315), the controller 180 moves the pointer in response to the movement of the proximity object. Control to be displayed (S320).

At this time, the case where the proximity distance is set away from the display unit 151 to D3 < D2 < D1 is set, and the case where the proximity distance is located below the D3 distance from the display unit 151 is on the third proximity range and the display unit 151. The case where the D3 distance is less than the D2 distance is positioned in the second proximate range, and the case where the D3 distance is located more than the D2 distance or less than the D1 distance is set to the first proximity range.

When the movement of the proximity object is detected in the second proximity range according to the change of the detection signal output from the detection sensor 141 (S325), the controller 180 controls to perform a drag input operation corresponding to the movement of the proximity object. (S330).

When the proximity object is detected in the third proximity range according to the change of the detection signal output from the detection sensor 141 (S335), the controller 180 corresponds to an object indicated by the pointer or an object selected by a drag input operation. Control to perform a predetermined operation (S340)

This process is repeatedly performed until the end of the operation is selected (S345), it is possible to control the operation of the electronic device by a non-contact three-dimensional method.

5 is a view referred to for explaining the proximity range. As shown in FIG. 5, when a user's finger or pen approaches the display unit 151, the first to fourth detection sensors 141a, 141b, 141c, and 141d installed around the display unit 151. Detects this and outputs the detection signal.

At this time, the case where the electronic device 100 is located less than the D3 distance is located less than the third proximity range, D3 distance or less than the D2 distance, if the location is located less than the second proximity range, D2 distance or less than the D1 distance. In the case of being positioned, the first proximity range is set.

When the user's finger is close to the D1 distance or less, the operation control menu and the pointer may be displayed on the display unit 151. If the user moves between D1 and D2 of the user's finger, it may be processed as a drag input operation. When the user's finger approaches the D3 distance or less, the user may perform an operation corresponding to the item indicated by the pointer.

6 to 11 are views for explaining a method of controlling an electronic device according to the present invention together with a screen displayed on a display unit. Hereinafter, for convenience of description, a case of using an ultrasonic sensor (Ultrasonic sensor) in the electronic frame will be described. However, the sensor used in the present invention is not limited to the ultrasonic sensor, and various sensors may be used in addition thereto.

6 and 7 are views referred to for explaining the case of moving the display position of the pointer. First, FIG. 6 is a diagram referred to for describing a process of moving a display position of a pointer in a two-dimensional method.

As illustrated in FIG. 6, when the user's finger is positioned at the first position 403, the distance between 1A and 2A is sensed by the first and second detection sensors 141a and 141b to detect the distance from the display unit 151. The pointer is displayed at the first position 413. Afterwards, when the user's finger moves to the second position 405, the distance between 1B and 2B is sensed by the first and second detection sensors 141a and 141b, and the second position 415 of the display unit 151 is sensed. The pointer's display position moves. Therefore, the pointer displayed on the display unit 151 may be moved in response to the user's finger movement.

FIG. 7 is a diagram referred to for describing a process of moving a display position of a pointer in a three-dimensional method. As illustrated in FIG. 7, when the user's finger is positioned at the first position 423, a distance of 1A to 4A is sensed by the first to fourth sensing sensors 141a, 141b, 141c, and 141d to display the display unit ( The pointer is displayed at the first position 433 of 151. Thereafter, a distance of 1B to 4B is sensed by the first to fourth detection sensors 141a, 141b, 141c, and 141d to move the user's finger to the second position 425, and thus the second position 435 of the display unit 151. ) Is displayed.

8 and 9 are diagrams for explaining a case of executing an item indicated by a pointer. As shown in FIG. 8, the user's finger does not move for a predetermined time at the first position 501, and an operation corresponding to the item indicated by the position 511 of the current pointer is executed. That is, an operation corresponding to the click of the mouse may be performed according to the time elapsed. At this time, the time for whether to perform the operation corresponding to the mouse click when the time elapses without moving can be configured to be set by the user.

9 is a diagram illustrating a process corresponding to a mouse click operation. When the user's finger is close to the display unit 151, the operation corresponding to the mouse click is shown. That is, as shown in (a) of FIG. 9, if it is a reference value of 1A + 2A + 3A + 4A> click operation in the manner according to the approach of the screen and the finger, it is determined that it is not a click operation. As shown in (b), if the reference value of 1B + 2B + 3B + 4B <click operation, the operation corresponding to the mouse click can be performed. .

10 and 11 are diagrams for describing a case of performing a drag input operation. As shown in FIG. 10, when the finger is stretched and moved from the first position 603 to the second position 605, the amount of ultrasonic waves emitted from the ultrasonic sensor, worn and reflected on the palm, and received by the fingertip increases compared with the case where the fingertip is used. do. As such, when the amount of received ultrasonic waves is larger than the amount of reflection in the general case, the received ultrasonic waves may be configured to be recognized by the drag input 613.

As illustrated in FIG. 11, the reference value of the click operation <1A + 2A + 3A + 4A <the finger is moved from the first position 623 in the proximity range which becomes the reference value of the drag input according to the approach of the screen and the finger. When moved to the two positions 625, it can be configured to be a drag input (633). That is, if 1A + 2A + 3A + 4A <the reference value of the click operation, the operation corresponding to the click is performed, but if the finger is moved in the above-described second proximity range, the drag input operation may be performed.

The electronic device and the control method according to the present invention as described above is not limited to the configuration and method of the embodiments described as described above, the embodiments of the embodiments so that various modifications can be made All or part may be optionally combined.

Meanwhile, the present invention can be embodied as processor readable codes on a processor readable recording medium. The processor-readable recording medium includes all kinds of recording devices that store data that can be read by the processor. Examples of the processor-readable recording medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like, and also include a carrier wave such as transmission through the Internet. The processor-readable recording medium can also be distributed over network coupled computer systems so that the processor-readable code is stored and executed in a distributed fashion.

In addition, although the preferred embodiment of the present invention has been shown and described above, the present invention is not limited to the specific embodiments described above, but the technical field to which the invention belongs without departing from the spirit of the invention claimed in the claims. Of course, various modifications can be made by those skilled in the art, and these modifications should not be individually understood from the technical spirit or the prospect of the present invention.

1 is a block diagram of an electronic device according to an embodiment of the present invention;

Figure 2 is a perspective view of the electronic device from the front according to an embodiment of the present invention,

3 is a flow chart provided in the description of the control method of the electronic picture frame according to an embodiment of the present invention;

4 is a flow chart provided in the description of the control method of the electronic picture frame according to another embodiment of the present invention;

5 is a view referred to for explaining a proximity range in a control method of an electronic device according to an embodiment of the present invention; and

6 to 11 are views referred to for describing a method for controlling an electronic device according to an embodiment of the present invention.

Explanation of symbols on the main parts of the drawings

110: wireless communication unit 120: A / V input unit

130: user input unit 140: sensing unit

150: output unit 151: display unit

160: memory 170: interface unit

180: control unit

Claims (18)

Displaying an image on a display unit; Providing a detection sensor for detecting a proximity object by an ultrasonic reflected wave, and displaying the operation control menu and a pointer on one area of the display unit when the proximity object is detected according to a detection signal output from the detection sensor; And And moving the display position of the pointer in response to the movement of the proximity object when the movement of the proximity object is detected according to the change of the detection signal. The method of claim 1, And executing the operation corresponding to the item indicated by the pointer in the operation control menu when the detection signal has not changed for a predetermined time. The method of claim 2, And setting the predetermined time period based on a user command. The method of claim 1, And if it is detected that the proximity distance of the proximity object is less than a reference value according to the change of the detection signal, performing an operation corresponding to the item indicated by the pointer in the operation control menu. Control method of equipment. The method of claim 1, The image control method of the electronic device, characterized in that the video image. The method of claim 1, And performing a drag input operation in response to the movement of the proximity object when the amount of ultrasonic waves reflected from the proximity object is greater than or equal to a reference value. The method of claim 6, The control method of the electronic device, characterized in that for changing the shape of the pointer when the drag input operation. The method of claim 1, And setting the shape of the pointer based on a user command. A display unit displaying an image; Sensing unit for detecting the proximity object using the ultrasonic sensor; And When the proximity object is detected according to the sensing signal output from the sensing unit, an operation control menu and a pointer are displayed on an area of the display unit, and when the movement of the proximity object is detected according to the change of the detection signal, the proximity object is detected. And a controller for moving the display position of the pointer in response to movement of the pointer. 10. The method of claim 9, And the controller controls an operation corresponding to an item indicated by the pointer in the operation control menu when the detection signal has not changed for a predetermined time. 10. The method of claim 9, The controller may be configured to execute an operation corresponding to an item indicated by the pointer in the operation control menu when it is detected that the proximity distance of the proximity object is lower than a reference value according to the change of the detection signal. device. 10. The method of claim 9, The controller is characterized in that when the amount of ultrasonic waves reflected from the adjacent object is greater than the reference value, the drag input operation corresponding to the change of the detection signal is performed. Displaying an image on a display unit; A sensor for detecting a proximity object by an ultrasonic reflected wave is provided, and when the proximity object approaching the first distance or less is detected according to a detection signal output from the detection sensor, an operation control menu and a pointer are displayed on a region of the display unit. Displaying; And When the movement of the proximity object is detected between the first distance and the second distance closer to the display portion than the first distance according to the change of the detection signal, the display position of the pointer in response to the movement of the proximity object Control method of the electronic device comprising the step of moving. The method of claim 13, In response to a change in the detection signal, when the proximity object closer to the display unit than the second proximity distance is detected below the third proximity distance, the operation corresponding to the item indicated by the pointer is executed in the operation control menu. Control method of an electronic device further comprising the step of. The method of claim 14, If the movement of the proximity object is detected between the third proximity distance and the second proximity distance according to the change of the detection signal, further comprising performing a drag input operation corresponding to the movement of the proximity object. Control method of an electronic device, characterized in that. A display unit displaying an image; Sensing unit for detecting the proximity object by the ultrasonic reflected wave; And When the proximity object having a first distance less than or equal to the display unit is detected according to the sensing signal output from the sensing unit, an operation control menu and a pointer are displayed on an area of the display unit, and the display unit changes according to the change of the sensing signal. And a controller configured to move the display position of the pointer in response to the movement of the proximity object when the movement of the proximity object is detected between the first distance and the second distance closer to the first distance. The method of claim 16, The controller may be further configured to correspond to an item indicated by the pointer in the operation control menu when it is detected that the proximity distance of the proximity object is less than or equal to the third proximity distance closer to the second proximity distance according to the change of the detection signal. An electronic device, characterized in that for performing the operation. The method of claim 17, The controller may be configured to perform a drag input operation in response to the movement of the proximity object when the movement of the proximity object is detected between the second proximity distance and the third proximity distance according to the change of the detection signal. Characterized by electronic equipment.

Images