KR20120083159A - Mobile terminal and method for controlling electronic devices of the same - Google Patents

Mobile terminal and method for controlling electronic devices of the same Download PDF

Info

Publication number
KR20120083159A
KR20120083159A KR1020110004660A KR20110004660A KR20120083159A KR 20120083159 A KR20120083159 A KR 20120083159A KR 1020110004660 A KR1020110004660 A KR 1020110004660A KR 20110004660 A KR20110004660 A KR 20110004660A KR 20120083159 A KR20120083159 A KR 20120083159A
Authority
KR
South Korea
Prior art keywords
control program
device control
mobile terminal
information
display unit
Prior art date
Application number
KR1020110004660A
Other languages
Korean (ko)
Inventor
양인정
Original Assignee
엘지전자 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 엘지전자 주식회사 filed Critical 엘지전자 주식회사
Priority to KR1020110004660A priority Critical patent/KR20120083159A/en
Publication of KR20120083159A publication Critical patent/KR20120083159A/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03547—Touch pads, in which fingers can move on a surface
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/4401—Bootstrapping
    • G06F9/4411—Configuring for operating with peripheral devices; Loading of device drivers
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/445—Program loading or initiating
    • G06F9/44505—Configuring for program initiating, e.g. using registry, configuration files
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/033—Indexing scheme relating to G06F3/033
    • G06F2203/0339—Touch strips, e.g. orthogonal touch strips to control cursor movement or scrolling; single touch strip to adjust parameter or to implement a row of soft keys

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Security & Cryptography (AREA)
  • Telephone Function (AREA)

Abstract

Disclosed are a mobile terminal and a method of controlling an electronic device thereof. The present invention easily recognizes the device information in the camera view state such as the AR view, logo, model name, model number, etc. of the surrounding electronic devices, the device control program for controlling the electronic devices, the mobile terminal itself memory, website, The device control program is displayed on the screen by searching through various paths such as other mobile terminals.

Description

MOBILE TERMINAL AND METHOD FOR CONTROLLING ELECTRONIC DEVICES OF THE SAME}

The present invention relates to a mobile terminal for executing a device control program for automatically recognizing and controlling an external electronic device and a method for controlling the electronic device.

The terminal can move And may be divided into a mobile / portable terminal and a stationary terminal depending on whether the mobile terminal is a mobile terminal or a mobile terminal. In addition, the mobile terminal may be classified into a handheld terminal and a vehicle mount terminal according to whether a user can directly move.

Such a terminal has various functions, and accordingly, for example, a multimedia device having complex functions such as taking a picture or a video, playing a music or video file, playing a game, receiving a broadcast, etc. player).

The mobile terminal may be configured to perform various functions. Examples of such various functions include a data and voice communication function, a function of photographing a video or a moving image through a camera, a voice storage function, a music file playback function through a speaker system, and an image or video display function. Some mobile terminals include additional functionality to play games, while others are implemented as multimedia devices. Moreover, recent mobile terminals can receive broadcast or multicast signals to watch video or television programs.

Further, efforts for supporting and increasing the functions of the mobile terminal continue. The foregoing efforts include not only changes and improvements in the structural components forming the mobile terminal, but also improvements in software or hardware. Among them, the touch function of the mobile terminal allows a user who is unfamiliar with the button / key input to conveniently perform the operation of the terminal by using the touch screen. In recent years, not only simple input but also user interface (UI) Is becoming an important function of Accordingly, as the touch function is applied to a mobile terminal in various forms, development of a user interface (UI) corresponding thereto is further demanded.

Meanwhile, with the development of science and technology, the number of electronic devices is increasing greatly. Accordingly, development of a control program capable of controlling electronic devices is required, and the number of controllers capable of controlling electronic devices is becoming complicated by the increasing number of electronic devices.

An object of the present invention is to provide a mobile terminal and a method for controlling the electronic device, which executes a device control program for automatically recognizing and controlling external electronic devices.

The present invention searches for a device control program for controlling electronic devices by recognizing logos, etc. of surrounding electronic devices in a camera view state, and displaying them on a screen to easily control the electronic devices. Another object is to provide a method for controlling an electronic device.

A mobile terminal according to the present invention for achieving the above objects, using a camera for capturing external electronic devices to obtain image information, a display unit for displaying the image information on the screen, and the device information detected from the image information And a controller for recognizing the electronic device and searching for and executing the device control program for controlling the electronic device.

The mobile terminal according to the present invention further comprises a device in which the device information and the device control program are stored in advance. Herein, the control unit loads and executes a device control program corresponding to the recognized electronic device from the memory, and displays the display unit.

The mobile terminal according to the present invention further includes a wireless internet module for accessing a web server having a device control program corresponding to the recognized electronic device, wherein the controller downloads the device control program through the wireless internet module. To execute the display unit.

In the mobile terminal according to the present invention, the controller searches for websites that can download the device control program and displays the list of websites searched by the display unit.

The mobile terminal according to the present invention further comprises a short-range communication module for communicating with other mobile terminals in the vicinity. The control unit may request, receive and execute a device control program corresponding to the recognized electronic device through the short range communication module, and display the display unit.

In the mobile terminal according to the present invention, the controller searches for other mobile terminals in the vicinity having the device control program and displays the terminal list searched by the display unit.

In the mobile terminal according to the present invention, the device information is one or more of a manufacturer's logo, a product logo, a model name, a model number, or a combination thereof.

According to an aspect of the present invention, there is provided a method for controlling an electronic device of a mobile terminal, the method comprising: acquiring image information of an external electronic device using a camera; displaying the image information on a screen; Detecting device information from the device, recognizing the electronic device using the device information, searching for a device control program controlling the electronic device, and displaying the device control program on the screen. It is configured to include.

In the method for controlling an electronic device of a mobile terminal according to the present invention, the step of searching for the device control program may include: a memory in the mobile terminal in which the device control program is stored, websites for downloading the device control program, and Search for at least one of the other mobile terminals in the vicinity having the device control program.

The electronic device control method of the mobile terminal according to the present invention further comprises the step of displaying the search result list on the screen.

The mobile terminal and its electronic device control method according to the present invention automatically and easily recognizes external electronic devices, and provides a user's convenience by providing a device control program therefor.

According to the present invention, a logo, a model name, etc. of surrounding electronic devices are easily recognized in a camera view state, and a device control program for controlling the electronic devices is searched through various paths such as a mobile terminal's own memory, a website, and other mobile terminals. Can be displayed on the screen.

1 is a block diagram of a mobile terminal in accordance with the present invention;
2A and 2B are a front perspective view and a rear perspective view of an example of a mobile terminal related to the present invention;
3 to 5 are block diagrams schematically showing the configuration of a mobile terminal according to embodiments of the present invention;
6 to 7B are views for explaining an operation of recognizing device information according to an embodiment of the present invention;
8 is a view for explaining an operation of searching for a device control program according to an embodiment of the present invention;
9 is a view for explaining an operation of controlling an electronic device according to an embodiment of the present invention;
10 and 11 are flowcharts schematically illustrating a method for controlling an electronic device of a mobile terminal according to the present invention.

Hereinafter, a mobile terminal related to the present invention will be described in detail with reference to the accompanying drawings. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The mobile terminal described herein may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), navigation, and the like.

In the present specification, different embodiments are given the same or similar reference numerals for the same or similar configurations, and the description is replaced with the first description.

1 is a block diagram of a mobile terminal related to the present invention.

The mobile terminal 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, and an interface. The unit 170, the controller 180, and the power supply unit 190 may be included. The components shown in FIG. 1 are not essential, so that a mobile terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short range communication module 114, a location information module 115, and the like. .

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel. The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 100. Wireless Internet technologies may include Wireless LAN (Wi-Fi), Wireless Broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), and the like.

The short range communication module 114 refers to a module for short range communication. Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used as a short range communication technology.

The position information module 115 is a module for checking or obtaining the position of the mobile terminal (it is possible to check the position of the vehicle when the mobile terminal is mounted on the vehicle). One example is the Global Position System (GPS) module. The GPS module receives position information from a plurality of satellites. Here, the location information may include coordinate information represented by latitude and longitude. For example, the GPS module can measure the exact time and distance from three or more satellites and accurately calculate the current position by triangulating three different distances. A method of obtaining distance and time information from three satellites and correcting the error with one satellite may be used. In particular, the GPS module can obtain not only the location of latitude, longitude, and altitude but also accurate time together with three-dimensional speed information from the location information received from the satellite. As the location information module 115, a Wi-Fi Positioning System and / or a Hybrid Positioning System may be applied.

The location information module 115 may further include a geomagnetic sensor and / or a gravity sensor for detecting a direction. For example, the location information module 115 detects the direction of the mobile terminal (for example, east, west, north and south) to implement navigation using augmented reality through the geomagnetic sensor (electronic compass). The location information module 115 detects in which direction gravity is acting through the gravity sensor (G sensor), and shows a vertical screen when the user is holding the mobile terminal vertically, and is holding it horizontally. Automatically rotates the screen 90 degrees to show a wider screen. In addition, when the user watches the video, the location information module 115 rotates the screen according to the direction in which the user is holding the mobile terminal through the gravity sensor (G sensor) so that the user can easily watch the image.

The A / V input unit 120 is for inputting an audio signal or a video signal, and the A / V input unit 120 includes a camera 121 and a microphone 122. May be included.

The camera 121 processes an image frame such as a still image or a video obtained by an image sensor in a video call mode or a photographing mode. The processed image frame may be displayed on the display unit 151. The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. Two or more cameras 121 may be configured according to the configuration of the mobile terminal.

The microphone 122 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, etc., and processes the external sound signal into electrical voice data.

The user input unit 130 generates input data for the user to control the operation of the terminal. The user input unit 130 may include a key pad, a dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like. In particular, when the touch pad forms a mutual layer structure with the display unit 151, this may be referred to as a touch screen.

The sensing unit 140 may determine the current state of the mobile terminal 100 such as the open / closed state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of a user contact, the orientation of the mobile terminal, the acceleration / deceleration of the mobile terminal, and the like. The sensing unit generates a sensing signal for controlling the operation of the mobile terminal 100.

The output unit 150 is used to generate an output related to visual, auditory, or tactile senses, and includes a display unit 151, an audio output module 152, an alarm unit 153, and a haptic module 154. Can be.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal is in a call mode, a user interface (UI) or a graphic user interface (GUI) related to a call is displayed. When the mobile terminal 100 is in a video call mode or a photographing mode, the mobile terminal 100 displays photographed and / or received images, a UI, and a GUI.

The display unit 151 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, or a three-dimensional display. It may include at least one of (3D display). In addition, two or more display units 151 may exist according to the implementation form of the mobile terminal 100. For example, an external display unit (not shown) and an internal display unit (not shown) may be simultaneously provided in the mobile terminal 100.

When the display unit 151 and a sensor for detecting a touch operation (hereinafter referred to as a touch sensor) form a mutual layer structure (hereinafter referred to as a touch screen), the display unit 151 outputs the touch screen. In addition to the device can also be used as an input device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

In addition, the touch sensor may be configured to convert a change in pressure applied to a specific portion of the display unit 151 or capacitance generated at a specific portion of the display unit 151 into an electrical input signal. The touch sensor may be configured to detect not only the position and area of the touch but also the pressure at the touch. When there is a touch input to the touch sensor, the corresponding signal (s) is sent to a touch controller (not shown). The touch controller processes the signal (s) and then transmits the corresponding data to the controller 180. As a result, the controller 180 can determine which area of the display unit 151 is touched.

Proximity-touch in the present invention means that the pointer is approached a predetermined distance away from the screen without actually touching the screen.

The proximity sensor 141 may be disposed in the inner region of the mobile terminal 100 surrounded by the touch screen or near the touch screen. The proximity sensor 141 refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object present in the vicinity without using mechanical force by using an electromagnetic force or infrared rays. The proximity sensor 141 has a longer life and higher utilization than a contact sensor.

Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. When the touch screen is capacitive, the touch screen is configured to detect the proximity of the pointer by a change in an electric field according to the proximity of the pointer. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of allowing the pointer to be recognized without being in contact with the touch screen so that the pointer is located on the touch screen is referred to as "Proximity Touch", and the touch The act of actually touching the pointer on the screen is called "Contact Touch". The position of the proximity touch with the pointer on the touch screen means a position where the pointer is perpendicular to the touch screen when the pointer is in proximity touch.

In addition, the proximity sensor 141 detects a proximity touch and a proximity touch pattern (for example, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, and a proximity touch movement state). do. Information corresponding to the sensed proximity touch operation and proximity touch pattern may be output on the touch screen.

The sensing unit 140 may include an acceleration sensor 142. The acceleration sensor 142 converts an acceleration signal in one direction into an electrical signal, and is widely used with the development of micro-electromechanical systems (MEMS) technology. The acceleration sensor 142 measures the acceleration of a large value embedded in an airbag system of a vehicle and used to detect a collision, and recognizes the minute movement of a human hand and uses the acceleration of a minute value used as an input means such as a game. There are many different types of measurements. The acceleration sensor 142 is usually configured by mounting two or three axes in one package, and in some cases, only one Z axis is required depending on the use environment. Therefore, when the acceleration sensor in the X-axis direction or the Y-axis direction is used instead of the Z-axis direction for some reason, the acceleration sensor may be mounted on the main substrate by using a separate piece substrate.

The sound output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like.

The alarm unit 153 outputs a signal for notifying occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal include call signal reception, message reception, key signal input, touch input, and the like.

The haptic module 154 generates various tactile effects that a user can feel. A typical example of the haptic effect generated by the haptic module 154 is vibration.

The memory 160 may store a program for the operation of the controller 180 and may temporarily store input / output data (for example, a phone book, a message, a still image, a video, etc.).

The interface unit 170 serves as a path with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or supplies power to each component in the mobile terminal 100 or transmits data to the external device.

The controller 180 typically controls the overall operation of the mobile terminal. For example, perform related control and processing for voice calls, data communications, video calls, and the like.

The controller 180 may perform a pattern recognition process for recognizing a writing input or a drawing input performed on a touch screen as text and an image, respectively.

The controller 180 may include a multimedia module 181 and a voice recognition module 182. The multimedia module 181 performs multimedia playback, and the voice recognition module 182 recognizes a voice spoken by a user and performs a corresponding function according to the recognized voice signal.

The multimedia module 181 and the voice recognition module 182 may be implemented in the controller 180 or may be implemented separately from the controller 180.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.

Various embodiments described herein may be implemented in a recording medium readable by a computer or similar device using, for example, software, hardware or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and other electronic units for performing other functions. In some cases, May be implemented by the control unit 180.

According to a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that perform at least one function or operation. The software code may be implemented by a software application written in a suitable programming language. The software codes are stored in the memory 160 and can be executed by the control unit 180. [

2A is a front perspective view of an example of a mobile terminal according to the present invention;

The disclosed mobile terminal 100 includes a bar-shaped terminal body. However, the present invention is not limited thereto, and can be applied to various structures such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are relatively movably coupled.

The body includes a case (a casing, a housing, a cover, and the like) which forms an appearance. In this embodiment, the case may be divided into a front case 101 and a rear case 102. A variety of electronic components are embedded in the space formed between the front case 101 and the rear case 102. At least one intermediate case may be additionally disposed between the front case 101 and the rear case 102. [

The cases may be formed by injecting synthetic resin or may be formed of a metal material, for example, a metal material such as stainless steel (STS) or titanium (Ti).

The display unit 151, the audio output unit 152, the camera 121, the user input units 130/131 and 132, the microphone 122, and the interface 170 may be disposed in the terminal body, mainly the front case 101. have.

The display unit 151 occupies most of the main surface of the front case 101. A sound output unit 152 and a camera 121 are disposed in an area adjacent to one end of both ends of the display unit 151 and a user input unit 131 and a microphone 122 are disposed in an area adjacent to the other end. The user input unit 132 and the interface 170 may be disposed on the side surfaces of the front case 101 and the rear case 102. [

The user input unit 130 is manipulated to receive a command for controlling the operation of the mobile terminal 100, and may include a plurality of manipulation units 131, 132, and 137. The manipulation units 131, 132, and 137 may also be collectively referred to as manipulating portions, and may be employed in any manner as long as the user operates the tactile manner while feeling the tactile feeling.

Content input by the first or second manipulation units 131 and 132 may be variously set. For example, the first operation unit 131 receives commands such as start, end, scroll, and the like, and the second operation unit 132 controls the size of the sound output from the sound output unit 152 or the size of the sound output from the display unit 151 To the touch recognition mode of the touch screen. In addition, the 3rd operation unit 137 is demonstrated in FIG. 2B.

2B is a rear perspective view of the mobile terminal shown in FIG. 2A.

Referring to FIG. 2B, a camera 121 ′ may be additionally mounted on the rear of the terminal body, that is, the rear case 102. The camera 121 ′ has a photographing direction substantially opposite to that of the camera 121 (see FIG. 2A), and may be a camera having different pixels from the camera 121.

For example, the camera 121 may have a low pixel so that the face of the user can be photographed and transmitted to the other party in case of a video call or the like, and the camera 121 ' It is preferable to have a large number of pixels. The cameras 121 and 121 'may be installed in the terminal body so as to be rotatable or pop-upable.

A flash 123 and a mirror 124 are further disposed adjacent to the camera 121 '. The flash 123 illuminates the subject when the subject is photographed by the camera 121 '. The mirror 124 allows the user to see his / her own face or the like when photographing (self-photographing) the user using the camera 121 '.

An acoustic output 152 'may be additionally disposed on the rear surface of the terminal body. The sound output unit 152 ′ may implement a stereo function together with the sound output unit 152 (see FIG. 2A), and may be used to implement a speakerphone mode during a call.

In addition to the antenna for talking and the like, a broadcast signal reception antenna 116 may be additionally disposed on the side of the terminal body. The antenna 116, which forms part of the broadcast receiving module 111 (see FIG. 1), can be installed to be able to be drawn out from the terminal body.

A power supply unit 190 for supplying power to the mobile terminal 100 is mounted on the terminal body. The power supply unit 190 may be embedded in the terminal body or may be directly detachable from the outside of the terminal body.

The rear case 102 may further include a touch pad 135 for sensing a touch. The touch pad 135 may also be of a light transmission type like the display unit 151. [ In this case, if the display unit 151 is configured to output time information on both sides, the time information can be recognized through the touch pad 135 as well. The information output on both sides may be all controlled by the touch pad 135. [ Alternatively, a display may be additionally mounted on the touch pad 135, and a touch screen may be disposed on the rear case 102 as well.

The touch pad 135 operates in association with the display unit 151 of the front case 101. The touch pad 135 may be disposed parallel to the rear of the display unit 151. The touch pad 135 may have a size equal to or smaller than that of the display unit 151.

The third manipulation unit 137 may be used as a function key to which a specific function is assigned. For example, the point of interest information (ie, AR information) is superimposed on an icon in a real-time image to which augmented reality technology is applied as an embodiment of the present invention. When displayed, the remote AR information icon may be assigned to a function key displayed on the display unit 151 of FIG. 2A. The third operation unit 137 may be referred to as an AR information icon position switch key (for convenience, referred to as an “AR icon switch key”). In this case, the 'AR icon switch key 137' may be implemented as the soft key by forming an independent configuration on a part of the front or rear surface of the terminal, and displayed as a specific icon on the touch pad 135 or the display unit 151 of FIG. 2A. It can also be implemented.

Referring to FIG. 3, a mobile terminal according to an embodiment of the present invention includes a camera 210 for capturing external electronic devices to obtain image information, a display unit 220 for displaying the image information on a screen, And a controller 230 for recognizing the electronic device using the device information detected from the image information, and searching for and executing a device control program for controlling the electronic device.

The image information obtained by the camera 210 may be a still image or a moving image that is continuously input. The image information may be a camera view image or an augmented reality (AR) view.

For example, when a user or the like moves the mobile terminal while the camera 210 is executed, the display 220 displays image information input through the camera 210 on the screen. In this case, the display unit 220 may further display augmented reality information. As another example, the mobile terminal may be configured to recognize the external electronic device directly through the controller 230 without displaying the image information on the screen while the screen of the display unit 220 is turned off.

The device information is information of one or more of a manufacturer's logo, a product logo, a model name, a model number, or a combination thereof. In addition, the device information may be information in the form of a code such as a barcode, QR code.

As illustrated in FIG. 6, the controller 230 recognizes peripheral electronic devices using the device information (eg, LG Electronics' logo). In addition, the controller 230 searches for memory in the mobile terminal, websites, or other mobile terminals around the device control program, as described below. Then, the controller 230 loads, downloads, or receives the found device control program. The display unit 220 displays a corresponding device control program on the screen.

7A and 7B, the mobile terminal executes two operations in succession to execute a device control program for peripheral electronic devices. That is, the controller 230 first recognizes the logo of the external electronic device, and displays similar products corresponding to the logo on the screen of the display unit. Referring to FIG. 7A, the display unit 220 displays product lines produced by LG Electronics. Next, when the controller 230 recognizes the model name of the electronic device, the controller 220 searches for the device control program for the electronic device and displays the search result on the screen. Referring to FIG. 7B, the display unit 220 displays a model name recognized by the controller 230 on the screen. Then, as shown in Figure 6, the display unit 220 displays the device control program on the screen.

Referring to FIG. 4, a mobile terminal according to another embodiment of the present invention includes a camera 210 for acquiring image information about an external electronic device, a display unit 220 for displaying the image information on a screen, and A controller 230 which recognizes the electronic device using the device information detected from the image information, searches for and executes a device control program for controlling the electronic device, and a memory in which the device information and the device control program are stored in advance. And 240.

Herein, the controller 230 retrieves and executes a device control program corresponding to the recognized electronic device from the memory 240. In this case, the display 220 displays the device control program loaded by the controller 230 from the memory 240 on the screen.

In addition, the controller 230 causes the memory 240 to store the found device control program. That is, in the case of recognizing the same electronic device, the control unit 230 immediately retrieves from the memory 240 so that the display unit 220 displays it.

Referring to FIG. 5, a mobile terminal according to another embodiment of the present invention includes a camera 210 for acquiring image information about an external electronic device, a display unit 220 for displaying the image information on a screen, A controller 230 for recognizing the electronic device using the device information detected from the image information, searching for and executing a device control program for controlling the electronic device, and a device control program corresponding to the recognized electronic device. And a wireless Internet module 251 for accessing the web server. Here, the controller 230 downloads the device control program through the wireless internet module 251, and then executes it. In addition, the display unit 220 displays the device control program on the screen.

The wireless Internet module 251 is a module embedded in or provided with a mobile terminal to allow the mobile terminal to wirelessly access the Internet. As the wireless Internet technology, as described above, WLAN (Wi-Fi), Wibro, Wimax, HSDPA and the like may be used.

The mobile terminal accesses the Internet through the wireless Internet module 251, and the controller 230 searches for websites for downloading the device control program. In addition, as illustrated in FIG. 8, the display unit 220 displays a list of websites searched by the controller 230 on the screen. When the user selects one of the website lists displayed on the screen, the controller 230 causes the display unit 220 to display the corresponding website screen.

Referring back to FIG. 5, the mobile terminal according to the present invention further includes a short range communication module 252 for communicating with other mobile terminals in the vicinity. Here, the controller 230 requests, receives, and executes a device control program corresponding to the recognized electronic device to other nearby mobile terminals through the short range communication module 251. In addition, the display unit 220 displays the device control program received by the controller 230 through the short range communication module 251 on the screen.

As the short range communication module 252 technology, Bluetooth, RFID, infrared communication, UWB, ZigBee, or the like may be used.

The controller 230 searches for other mobile terminals in the vicinity having the device control program. In addition, the display unit 220 displays the searched terminal list on the screen. When the user selects one of the displayed terminal lists, the communication module 252 transmits a signal for requesting a device control program to the corresponding mobile terminal and receives the same. The mobile terminal may be configured to automatically request a device control program from another mobile terminal using a priority algorithm or an algorithm that sequentially requests transmission.

In the above embodiments, when a user or the like clicks or touches one of the icons constituting the device control program, the controller 230 recognizes this and transmits a control signal to the electronic device. For example, as shown in FIG. 9, when a user or the like clicks or touches a power button (or a power icon) while the display unit 220 displays a device control program for a computer, the controller ( 230 generates a corresponding power control signal and transmits it to the electronic device.

Referring to FIG. 10, in the method of controlling an electronic device of a mobile terminal according to the present invention, obtaining image information on an external electronic device using a camera (S100) and displaying the image information on a screen (S200). Detecting the device information from the image information (S300), recognizing the electronic device using the device information (S400), and searching for a device control program controlling the electronic device (S300). S500), and displaying the device control program on the screen (S600).

Referring to FIG. 11, the step of searching for the device control program (S500) may include: a memory in the mobile terminal in which the device control program is stored, websites for downloading the device control program, and the device control program; Search for at least one of the other mobile terminals in the vicinity.

The electronic device control method of the mobile terminal according to the present invention further comprises the step (not shown) of displaying the result list searched in the searching step on the screen.

For example, when the user acquires the image information by moving the mobile terminal while the user or the like has executed the camera (S100), the mobile terminal displays the image information on the screen (S200). The image information obtained by the camera 210 may be a still image or a moving image that is continuously input. That is, the image information may be a camera view image or an augmented reality (AR) view. The device information is information of one or more of a manufacturer's logo, a product logo, a model name, a model number, or a combination thereof. In addition, the device information may be information in the form of a code such as a barcode, QR code.

The mobile terminal detects device information from image information obtained through a camera or image information displayed through a display unit, and recognizes surrounding electronic devices using the device information. For example, as illustrated in FIG. 6, the mobile terminal recognizes peripheral electronic devices using the device information (eg, LG Electronics' logo). In addition, referring to FIG. 11, the mobile terminal searches a memory in the mobile terminal (S510), searches websites (S531) where the device control program can be downloaded, or a peripheral having the device control program. Search for other mobile terminals in step S521. Then, the mobile terminal loads, downloads, or receives the searched device control program and displays the corresponding device control program on the screen (S600). Then, the mobile terminal executes the corresponding device control program (S700).

As described above, the mobile terminal and its electronic device control method according to the present invention easily recognizes the device information in the camera view state, such as AR view, logo, model name, model number of the surrounding electronic devices, The device control program for controlling them is searched through various paths such as the mobile terminal's own memory, a website, and other mobile terminals, and the device control program is displayed on the screen.

210: camera 220: display unit
230: control unit 240: memory
250: wireless communication unit 251: wireless Internet module
252: near field communication module

Claims (10)

A camera for photographing external electronic devices to obtain image information;
A display unit displaying the image information on a screen; And
And a controller for recognizing the electronic device using the device information detected from the image information and searching for and executing a device control program for controlling the electronic device. The method according to claim 1,
And a memory in which the device information and the device control program are stored in advance.
And the controller is configured to load and execute a device control program corresponding to the recognized electronic device from the memory and to display the display unit. The method according to claim 1,
And a wireless internet module for accessing a web server having a device control program corresponding to the recognized electronic device.
The controller is configured to download and execute the device control program through the wireless Internet module, and to display the display unit. The method of claim 3, wherein the control unit,
And searching websites that can download the device control program, and displaying the list of websites searched by the display unit. The method according to claim 1,
Further comprising: a short-range communication module for performing communication with other mobile terminals in the vicinity,
The controller may request, receive, and execute a device control program corresponding to the recognized electronic device through the short range communication module, and display the display unit. The method of claim 5, wherein the control unit,
And searching for another mobile terminal in the vicinity having the device control program and displaying the list of terminals searched by the display unit. The device information of claim 1, wherein the device information comprises:
And at least one of a manufacturer's logo, a product logo, a model name, a model number, or a combination thereof. Obtaining image information on an external electronic device using a camera;
Displaying the image information on a screen;
Detecting device information from the image information;
Recognizing the electronic device using the device information;
Retrieving a device control program for controlling the electronic device; And
And displaying the device control program on the screen. The method of claim 8, wherein the searching for the device control program comprises:
And search for at least one of a memory in the mobile terminal in which the device control program is stored, websites for downloading the device control program, and other mobile terminals in the vicinity having the device control program. Method of controlling electronic devices. 10. The method of claim 9,
And displaying a list of search results on the screen in the searching step.
KR1020110004660A 2011-01-17 2011-01-17 Mobile terminal and method for controlling electronic devices of the same KR20120083159A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020110004660A KR20120083159A (en) 2011-01-17 2011-01-17 Mobile terminal and method for controlling electronic devices of the same

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020110004660A KR20120083159A (en) 2011-01-17 2011-01-17 Mobile terminal and method for controlling electronic devices of the same

Publications (1)

Publication Number Publication Date
KR20120083159A true KR20120083159A (en) 2012-07-25

Family

ID=46714660

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020110004660A KR20120083159A (en) 2011-01-17 2011-01-17 Mobile terminal and method for controlling electronic devices of the same

Country Status (1)

Country Link
KR (1) KR20120083159A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101402362B1 (en) * 2012-09-14 2014-06-02 주식회사 오비고 Method, terminal, server and computer-readable recording media for controlling web application
WO2014175536A1 (en) * 2013-04-22 2014-10-30 Samsung Electronics Co., Ltd. Display device, user terminal apparatus and control method thereof
US9247177B2 (en) 2013-04-22 2016-01-26 Samsung Electronics Co., Ltd. Display device, user terminal apparatus and calibration method thereof
KR20170018293A (en) * 2015-07-13 2017-02-17 시아오미 아이엔씨. Method and apparatus of downloading control program
US9652128B2 (en) 2013-02-05 2017-05-16 Electronics And Telecommunications Research Institute Method and apparatus for controlling electronic device

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101402362B1 (en) * 2012-09-14 2014-06-02 주식회사 오비고 Method, terminal, server and computer-readable recording media for controlling web application
US9652128B2 (en) 2013-02-05 2017-05-16 Electronics And Telecommunications Research Institute Method and apparatus for controlling electronic device
WO2014175536A1 (en) * 2013-04-22 2014-10-30 Samsung Electronics Co., Ltd. Display device, user terminal apparatus and control method thereof
US9247177B2 (en) 2013-04-22 2016-01-26 Samsung Electronics Co., Ltd. Display device, user terminal apparatus and calibration method thereof
US9491392B2 (en) 2013-04-22 2016-11-08 Samsung Electronics Co., Ltd. Display device, user terminal apparatus and control method thereof
US10003763B2 (en) 2013-04-22 2018-06-19 Samsung Electronics Co., Ltd. Display device, user terminal apparatus and control method thereof
KR20170018293A (en) * 2015-07-13 2017-02-17 시아오미 아이엔씨. Method and apparatus of downloading control program

Similar Documents

Publication Publication Date Title
KR101667715B1 (en) Method for providing route guide using augmented reality and mobile terminal using this method
CN106371782B (en) Mobile terminal and control method thereof
KR101688155B1 (en) Information processing apparatus and method thereof
US8619152B2 (en) Mobile terminal and operating method thereof
KR101641513B1 (en) Image photographing apparatus of mobile terminal and method thereof
KR101658087B1 (en) Mobile terminal and method for displaying data using augmented reality thereof
KR101705047B1 (en) Mobile terminal and method for sharing real-time road view
US20110319131A1 (en) Mobile terminal capable of providing multiplayer game and operating method thereof
US20110319130A1 (en) Mobile terminal and method of operation
US9268471B2 (en) Method and apparatus for generating directional sound
KR20100094754A (en) User interface method for inputting a character and mobile terminal using the same
CN104238900B (en) A kind of page positioning method and device
KR20100125938A (en) Mobile terminal and method of providing graphical user interface using same
KR20120005324A (en) Electronic device controlling apparatus for mobile terminal and method thereof
KR20120083159A (en) Mobile terminal and method for controlling electronic devices of the same
KR20110002922A (en) Electronic device and method of performing function using same
KR101677637B1 (en) Method for providing route guide using image projection and mobile terminal using this method
KR20120066511A (en) Video processing apparatus of mobile terminal and method thereof
KR20120075094A (en) Mobile terminal having smart search widget and searching method of the same
KR20110125725A (en) Electronic device and contents sharing method for electronic device
KR101771459B1 (en) Mobile terminal and method for searching goods of the same
KR102019119B1 (en) Terminal and method for controlling the same
KR20110126438A (en) Mobile terminal and operation method thereof
KR101779504B1 (en) Mobile terminal and control method for mobile terminal
KR102088866B1 (en) Mobile terminal

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
E601 Decision to refuse application