KR20170055279A - Mobile terminal capable of remotely controlling lighting devicee - Google Patents

Abstract

The present invention relates to a mobile terminal capable of remotely controlling a lighting device. The mobile terminal according to an embodiment of the present invention comprises: a display; a camera; a communication part; and a control part controlling to display a pre-stored first image including at least one lighting device, to display a second image including at least one lighting device which is photographed through the camera, and to transmit a remote control signal for adjusting brightness based on a difference between the first image and the second image to a lighting device being in operation through the communication part. Therefore, the lighting device can be remotely controlled.

Description

[0001] The present invention relates to a mobile terminal capable of remotely controlling a lighting device,

The present invention relates to a mobile terminal capable of remotely controlling a lighting device.

A mobile terminal is a portable device having one or more functions capable of carrying out voice and video communication, capable of inputting and outputting information, and storing data, while being portable. As the function of the mobile terminal has diversified, it has been equipped with complicated functions such as photographing, video shooting, playback of a music file or a video file, reception of a game, broadcasting, wireless Internet, multimedia player). Mobile terminals implemented in the form of multimedia devices are being applied variously in terms of hardware and software in order to implement complex functions.

An object of the present invention is to provide a mobile terminal capable of remotely controlling a lighting apparatus.

According to an aspect of the present invention, there is provided a mobile terminal including a display unit, a camera, a communication unit, and at least one lighting device, Controlling to display a second image including at least one illumination device and to transmit a remote control signal for brightness adjustment based on the difference between the first image and the second image to the illuminating device through the communication section And a control unit.

According to an embodiment of the present invention, a mobile terminal controls to display a pre-stored first image comprising a display, a camera, a communication section and at least one illumination device, And a control unit for controlling the display unit to display a second image including the illumination device and to control the remote control signal for brightness adjustment based on the difference between the first image and the second image to be transmitted to the illuminating device through the communication unit , It becomes possible to remotely control the lighting device.

In particular, the mobile terminal can remotely control the lighting device by transmitting a remote control signal for luminance adjustment based on a difference between the first image and the second image.

On the other hand, the mobile terminal can maintain the desired brightness and color temperature in spite of the faulty lighting device by transmitting the remote control signal for brightness adjustment to the illuminating device in operation around the failed lighting device, if there is a failed lighting device.

Meanwhile, the mobile terminal displays the first image and the second image together, and when the first image is dragged and dropped onto the second image, a remote control signal for luminance adjustment based on the difference between the first image and the second image , To the lighting device in operation. Accordingly, the desired brightness and color temperature can be easily maintained.

On the other hand, the mobile terminal transmits a remote control signal for brightness adjustment to an operating lighting device around the failed lighting device, and transmits a second brightness control remote control signal to the electronic device in operation around the failed lighting device, Despite the device, it is possible to maintain the desired luminance and color temperature.

1 is a diagram illustrating a device remote control system according to an embodiment of the present invention.
2 is a diagram illustrating a device-specific mobile terminal or a remote control screen.
FIGS. 3A to 3F are diagrams illustrating the types of devices controlled according to the direction of the mobile terminal of FIG. 1; FIG.
4A to 4C are views showing a mobile terminal case mounted on the mobile terminal of FIG.
5A and 5B are views showing a case where the front case of the mobile terminal is closed and a case where the front case is opened.
6 is an internal block diagram of the mobile terminal of FIG.
7 is a flowchart illustrating an example of a method of operating a mobile terminal according to an embodiment of the present invention.
8A to 13B are diagrams referred to in explaining the operation method of the mobile terminal of FIG.

Hereinafter, the present invention will be described in detail with reference to the drawings.

The suffix "module" and " part "for components used in the following description are given merely for convenience of description, and do not give special significance or role in themselves. Accordingly, the terms "module" and "part" may be used interchangeably.

1 is a diagram illustrating a device remote control system according to an embodiment of the present invention.

1, a device remote control system 10 according to an embodiment of the present invention includes a mobile terminal 600, a plurality of devices 100a, 100b, 100c, 100d, 100e, 100f, 100g, 100h ), And transmission devices 101a, 101b, 101c, 101d, 101e, 101f, 101g, 101h that are mounted in or disposed around each device.

On the other hand, the device remote control system 10 may further include a gateway 400, servers 700a, ..., 700n, and the like.

In the drawing, an example of a device includes an image display device 100a such as a TV, a set top box 100b, an air conditioner 100c, a lighting device 100d, a robot cleaner 100e, a refrigerator 100f, (100g), a temperature controller (100h), and the like, but various other examples are possible. On the other hand, the device shown in the drawing may be called a home device.

For example, it is possible to use a device such as a washing machine, an optical disk reproducing device, a game device, a security device such as a gas valve or a security camera, a door that is opened and closed electronically, a window that is electronically opened and closed, Electronic frames, energy storage devices (ESS), digital cameras, perfume emitting devices, vehicles, drones, and the like.

Hereinafter, the devices shown in the drawings are mainly described.

Each of the transmission apparatuses 101a, 101b, 101c, 101d, 101e, 101f, 101g, 101h can transmit a device identification (ID) signal for identification with another device.

The device identification signal may include at least one of device type information, manufacturer information, device model name information, device status information, and device control command related information for each device.

On the other hand, the device status information may include an ON / OFF state of the device, an operation value state at the time of device operation, and the like.

Alternatively, the device identification signal may be a specific signal set so that each device can be identified. For example, a time-based pattern signal, or a space-based pattern signal. More specifically, the device identification signal may be a time-based infrared pattern signal or a space-based infrared pattern signal.

The transmission devices 101a, 101b, 101c, 101d, 101e, 101f, 101g, and 101h reflect output signals output from the mobile terminal 600 and transmit a device identification (ID) (600) direction.

On the other hand, the device identification signal is a signal having good directivity, and may be an infrared signal, an RF (Radio Frequency) signal, a Wi-Fi signal, a ZigBee signal, a bluetooth signal, UWB (Ultra Wideband) signal.

The mobile terminal 600 can receive a plurality of identification signals from each of the transmission devices 101a, 101b, 101c, 101d, 101e, 101f, 101g, and 101h.

At this time, if the mobile terminal 600 is connected to any one of the plurality of devices 100a, 100b, 100c, 100d, 100e, 100f, 100g, and 100h or a plurality of transmission devices 101a, 101b, 101c, 101d, , 101f, 101g, and 101h, the mobile terminal 600 can detect one of the received at least one identification signal as a representative identification signal.

Then, the mobile terminal 600 performs signal processing on the detected identification signal or the representative identification signal, and transmits the device type information, manufacturer information, device model name information, device status information, device control command Based on at least one of the information associated with the identification signal.

Alternatively, the mobile terminal 600 may compare the detected identification signal or the representative identification signal with the data associated with the identification signal previously stored in the mobile terminal 600 to confirm or identify the device.

Then, the mobile terminal 600 can control to display the remote control object for the confirmed device remote control.

When any one of the remote control objects is selected by the user after the display of the remote control object for device control, the mobile terminal 600 outputs a signal corresponding to the selected item, that is, a remote control signal, can do.

For example, when the mobile terminal 600 is aimed at the air conditioner 100c, the mobile terminal 600 may display the first item of the remote control object as a remote control object And can output and transmit a remote control signal related to the wind strength adjustment to the air conditioner in the operation of the first item.

As a result, when the mobile terminal 600 is oriented in the first device direction, it detects the first identification signal received from the first device, and based on the detected first identification signal, performs remote control of the first device And to control the display of the first remote control object for remote control of the second device when the second device is oriented in the second device direction, , It can control to display the second remote control object.

Accordingly, a single mobile terminal 600 enables remote control of various devices.

The settop box 100b, the air conditioner 100c, the illuminator 100d, the robot cleaner 100e, the refrigerator 100f, and the air conditioner 100d according to the direction of the mobile terminal 600, The air cleaner 100g, and the temperature controller 100h can be remotely controlled.

The remote control signal output from the mobile terminal 600 may be an infrared signal, an RF signal, a Wi-Fi signal, a ZigBee signal, a bluetooth signal, Signal, or an Ultra Wideband (UWB) signal.

On the other hand, the mobile terminal 600 may receive control command information from the gateway 400 for at least some of the remote control objects for remote control of each device.

Alternatively, the mobile terminal 600 may transmit control command information, for at least a portion of the remote control objects, to the gateway 400, for remote control of each device.

In particular, the gateway 400 is configured to provide control over at least some of the remote control objects from the external servers 700a, ..., 700n, etc., via the network 550, Command information can be received.

At this time, the external servers 700a, ..., 700n may be a server operated by each device manufacturer or a server storing information about each device.

2 is a diagram illustrating a device-specific mobile terminal or a remote control screen.

2, a mobile terminal 201a for an image display apparatus, a mobile terminal 201b for an optical disk player, a mobile terminal 201c for an air conditioner, and a mobile terminal 201d for a robot cleaner are illustrated.

As shown in FIG. 2, when a mobile terminal or the like, to which different codes are allocated for remote control of each electronic device, is used, the number of mobile terminals increases, which is inconvenient for a user to use.

According to the present invention, a mobile terminal capable of remotely controlling a plurality of devices is presented more easily.

FIGS. 3A to 3F are diagrams illustrating the types of devices controlled according to the direction of the mobile terminal of FIG. 1; FIG.

3A illustrates a case where the mobile terminal 600 is oriented toward the air conditioner 100c among the various devices 100a, 100b, 100c, 100d, and 100e in the house.

The mobile terminal 600 receives at least one identification signal including an identification signal from the transmission device 101c corresponding to the air conditioner 100c. Then, the mobile terminal 600 can detect the identification signal in the received at least one identification signal, and confirm or identify that the remotely controllable device is the air conditioner 100c, based on the detected identification signal .

For example, when at least one of device type information, manufacturer information, and device model name information is included in the detected identification signal, the mobile terminal 600 performs signal processing on the identification signal, Information and device model name information, and can confirm or identify the device corresponding to the identification signal based on at least one of the extracted device type information, manufacturer information, and device model name information.

As another example, the mobile terminal 600 may be configured such that the received and detected identification signal is associated with an identification signal received and detected, and an identification signal stored in the memory 660, Compared to data, the device can be identified or identified.

More specifically, when the received and detected identification signal is a time-based pattern signal, the mobile terminal 600 compares the time-based pattern signal related data stored in the memory 660 with the received pattern signal, The device can be identified or identified.

Alternatively, when the received and detected identification signal is a space-based pattern signal, the mobile terminal 600 compares the space-based pattern signal-related data stored in the memory 660 with the received pattern signal, Verification or identification.

The mobile terminal 600 can control the display of the remote control object for the air conditioner 100c after identifying the oriented device as the air conditioner 100c.

On the other hand, when the device identification is completed or the remote control object display is completed, the mobile terminal 600 outputs the device controllable message 311a as a sound or transmits the device controllable message 311a to the mobile terminal 600 The LEDs may emit light for a predetermined time, or may output a vibration. Thereby, the user can recognize that air conditioning control is possible. On the other hand, FIG. 3a shows outputting an air conditioner controllable message 311a such as "Control the air conditioner" as a sound.

Alternatively, for convenience of use, a device whose identification or control is completed by the mobile terminal 600 may be configured to emit an LED included in the device or the transmission device for a predetermined period of time, It is also possible to make a specific sound in the sound device having the remote control function or to display a message remotely controllable by the mobile terminal 600 on the display included in the device or the transmission device.

In particular, when a predetermined item in the remote control object is selected after the display of the remote control object is completed, the mobile terminal 600 can transmit the remote control signal corresponding to the control command of the predetermined item to the air conditioner 100c.

On the other hand, the air conditioner 100c may emit the LED built in the air conditioner 100c for a predetermined time after receiving the remote control signal. Thereby, the user can recognize that the air conditioning control is being performed.

Next, FIG. 3B illustrates a case where the mobile terminal 600 is oriented toward the image display device 100a among the various devices 100a, 100b, 100c, 100d, and 100e in the house.

The mobile terminal 600 receives an identification signal from the transmission device 101a corresponding to the video display device 100a.

Then, the mobile terminal 600 detects an identification signal in at least one identification signal including the identification signal received from the video display device 100a, and based on the detected identification signal, It can be confirmed or identified that it is the display device 100a. The method of confirming the video display device 100a will be omitted with reference to the description of Fig. 3a.

After confirming that the device to be directed is the video display device 100a, the mobile terminal 600 can control to display the remote control object for the video display device 100a.

Next, FIG. 3C illustrates a case where the mobile terminal 600 is oriented toward the illuminator 100d among the various devices 100a, 100b, 100c, 100d, and 100e in the house.

The mobile terminal 600 receives an identification signal, for example, an infrared (IR) signal from the transmission device 101d corresponding to the illumination device 100d.

Then, the mobile terminal 600 can confirm that the device to be oriented based on the infrared (IR) signal is the illumination device 100d. The method of confirming the illumination device 100d is omitted by referring to the description of Fig. 3a.

Then, after confirming that the device to be directed is the lighting device 100d, the mobile terminal 600 can control the remote control object for the lighting device 100d to be displayed.

Next, FIG. 3D illustrates a case where the mobile terminal 600 is oriented toward the robot cleaner 100e among the various devices 100a, 100b, 100c, 100d, and 100e in the house.

The mobile terminal 600 receives the identification signal from the transmission device 101e corresponding to the robot cleaner 100e.

Then, the mobile terminal 600 detects an identification signal in at least one identification signal including the identification signal received from the robot cleaner 100e, and based on the detected identification signal, (100e). The method of confirming the robot cleaner 100e will be omitted with reference to the description of Fig. 3a.

After confirming that the device to be oriented is the robot cleaner 100e, the mobile terminal 600 can control to display the remote control object for the robot cleaner 100e.

3E shows a case where the remote control enable signal Skeystc is transmitted from the mobile terminal 600 to the air conditioner 100c to the air conditioner 100c when the setting for the remote control of the air conditioner 100c is completed .

The air conditioner 100c may display the air conditioner remotely controllable message 311 ac on the display 180c or output the air conditioner remotely controllable message 311ab as a sound after receiving the remote control enable signal Skeystc .

Instead of outputting the air conditioner controllable message 311a such as " Controlling the air conditioner at the mobile terminal 600, unlike FIG. 3A, the remote controllable signal Skeystc is sent to the air conditioner 100c, , And it is also possible that the air conditioner remote control enable messages 311ab and 311ac are output from the air conditioner 100c.

3F shows a case where the remote control enable signal Skeysta is input to the video display device 100a in the mobile terminal 600 when the setting for remote control of the video display device 100a is completed, (100a). ≪ / RTI >

After receiving the remote control enable signal Skeysta, the video display device 100a displays the video display device remote control enablement message 311bc on the display 180a or the video display device remote control enablement message 311bb Sound can also be output.

4A to 4C are views showing a mobile terminal case mounted on the mobile terminal of FIG.

4A is a side view of the mobile terminal case of FIG. 4A, FIG. 4C is a side view of the mobile terminal case 700, FIG. 4B is a side view of the mobile terminal case of FIG. Fig.

The mobile terminal case 700 includes a front case 701 covering at least a part of the display area of the mobile terminal 600 and a rear case 702 coupled to or attached to the rear surface of the mobile terminal 600. [ ).

In the upper region of the front case 701, an opening 720 may be formed for image confirmation displayed on the display 680.

The front case 701 is disposed on the upper side of the receiving unit 423 disposed on one side of the display 680 of the mobile terminal 600 and receives an identification signal such as an IR (Infra Red) signal And a mirror unit 710 for changing the path of the receiving unit 423 toward the receiving unit 423.

4C, the mirror unit 710 receives the identification signal, which is incident on the mobile terminal from the upper side of the mobile terminal 600, and transmits the identification signal to the receiving unit 423 Direction, the path-varied identification signal can be induced to be incident.

Accordingly, even when the front case 701 of the mobile terminal 600 is covered, the identification signal output in the direction in which the mobile terminal 600 is oriented can be stably incident on the receiving section 423.

Therefore, even in the standby mode, the mobile terminal 600 displays a remote control object for remotely controlling the device in the display area corresponding to the area where the opening 720 of the mobile terminal front case 701 is formed .

When the remote control object is displayed, the control unit 680 of the mobile terminal 600 temporarily releases the standby mode. If there is a touch input for a predetermined item in the remote control object, the control unit 680 of the mobile terminal 600 displays a remote control signal Can be controlled.

Accordingly, remote control of various devices can be easily performed while changing the direction of the mobile terminal 600, even in a state where the case 700 of the mobile terminal is covered.

5A and 5B are views showing a case where the front case of the mobile terminal is closed and a case where the front case is opened.

FIG. 5A is a front view of the case of the mobile terminal when the front case 701 is closed, and FIG. 5B is a front view of the case of the mobile terminal in which the front case 701 is opened.

Referring to FIG. 5A, a conductive material other than the peripheral region may be applied to a part of the front case 701.

In the figure, the first region 730a and the second region 730b under the opening of the front case 701 are coated with a conductive material different from the peripheral region.

For example, it is preferable that a conductive material having a higher conductivity than the peripheral region is applied.

Accordingly, even when the front case 701 is covered, the touch sensor of the mobile terminal 600 can sense the touch input to the first area 730a or the second area 730b.

The control unit 680 of the mobile terminal 600 sets the first item to be selected when the first case 730a is touched when the front case 701 is covered and the second item 730b ) Is touched, it can be set that the second item is selected.

Here, the first item may be a menu item and the second item may be a multi-device operation item, but the present invention is not limited thereto, and various modifications are possible.

That is, the control unit 680 of the mobile terminal 600 may assign a menu item to the first area 730a and a multi-device operation item to the second area 730b.

5A, when the mobile terminal 600 is directed to a specific device in a state in which the front case 701 is closed, the control unit 680 of the mobile terminal 600 performs a control , The remote control object can be controlled to be displayed.

For example, when the control unit 680 of the mobile terminal 600 is oriented toward the first device, the control unit 680 controls the first remote control object And to display a second remote control object for remote control for the second device based on the received second identification signal when being directed to the second device direction.

5B, when the front case 701 is opened, the control unit 680 of the mobile terminal 600 displays, in addition to the displayed remote control object, further remote control items of other items in its peripheral area Alternatively, the screen may be switched so that a remote control screen other than the displayed remote control object is displayed.

Accordingly, it is possible to identify and select more various items, thereby making it possible to increase the usability of the user.

6 is an example of an internal block diagram of the mobile terminal of FIG.

Referring to the drawings, the mobile terminal 600 may include a mobile terminal.

The mobile terminal 600 includes a wireless communication unit 610, an audio / video input unit 620, a user input unit 630, a sensing unit 640, an output unit 650, a memory 660, A controller 625, a controller 670, and a power supply 690.

The wireless communication unit 610 may include a broadcast receiving module 611, a mobile communication module 613, a wireless communication module 615, an acoustic communication unit 617, and a GPS module 619.

The broadcast receiving module 611 may receive at least one of a broadcast signal and broadcast related information from an external broadcast management server through a broadcast channel. At this time, the broadcast channel may include a satellite channel, a terrestrial channel, and the like.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 611 may be stored in the memory 660.

The mobile communication module 613 transmits and receives a radio signal to at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data according to a voice call signal, a video call signal, or a text / multimedia message transmission / reception.

The wireless communication module 615 refers to a module for wireless Internet access, and the wireless communication module 615 can be embedded in the mobile terminal 600 or externally. For example, the wireless communication module 615 may perform WFii-based wireless communication or WiFi Direct-based wireless communication.

Meanwhile, the wireless communication module 615 may include a receiving section 423 for receiving an identification signal and a transmitting section 423 for transmitting a remote control signal.

The receiving unit 423 receives a device identification signal of any one of an IR (Infra Red) signal, an RF (Radio Frequency) signal, a ZigBee signal, a bluetooth signal and a laser signal from the transmitting apparatus 101 .

Accordingly, the receiving unit 423 may include an IR receiving unit (not shown), an RF receiving unit (not shown), and the like.

Meanwhile, the transmitter 421 can output a remote control signal of any one of an IR (Infra Red) signal, an RF (Radio Frequency) signal, a ZigBee signal, a bluetooth signal and a laser signal .

Accordingly, the transmitting unit 421 may include an IR transmitting unit (not shown), an RF transmitting unit (not shown), and the like.

On the other hand, the transmitting unit 421 can output different remote control signals for each of a plurality of devices. For example, when outputting a remote control signal as an IR signal, it is possible to output IR signals of different patterns or different frequency bands.

On the other hand, the transmitting section 421 may output the output signal Sout in correspondence with the case of Fig. 4B. The output signal Sout at this time may be any one of an IR (Infra Red) signal, an RF (Radio Frequency) signal, a ZigBee signal, a bluetooth signal, and a laser signal.

When the device is the video display device 100a, the mobile terminal 600 transmits a signal including information on the pointing information of the mobile terminal 600, for example, motion, etc., to the RF transmitter (Not shown).

The acoustic communication unit 617 can perform acoustic communication. In the acoustic communication mode, the acoustic communication unit 617 can output sound by adding predetermined information data to the audio data to be output. Further, in the acoustic communication mode, the acoustic communication unit 617 can extract predetermined information data from the sound received from the outside.

In addition, Bluetooth, RFID (radio frequency identification), infrared data association (IrDA), ultra wideband (UWB), ZigBee, and the like can be used as the short distance communication technology.

The Global Positioning System (GPS) module 619 may receive position information from a plurality of GPS satellites.

The A / V (Audio / Video) input unit 620 is for inputting an audio signal or a video signal, and may include a camera 621 and a microphone 623.

The user input unit 630 generates key input data that the user inputs to control the operation of the terminal. The user input unit 630 may include a key pad, a dome switch, and a touch pad (static / static). Particularly, when the touch pad has a mutual layer structure with the display 680, it can be called a touch screen.

The sensing unit 640 senses the current state of the mobile terminal 600 such as the open / close state of the mobile terminal 600, the position of the mobile terminal 600, A sensing signal can be generated.

The sensing unit 640 may include a sensing sensor 641, a pressure sensor 643, a motion sensor 645, and the like. The motion sensor 645 can detect the movement or the position of the mobile terminal 600 using an acceleration sensor, a gyro sensor, a gravity sensor, or the like. In particular, the gyro sensor is a sensor for measuring the angular velocity, and it can sense the direction (angle) of rotation about the reference direction.

The output unit 650 may include a display 680, an audio output unit 653, an alarm unit 655, and a haptic module 657 and the like.

The display 680 displays and outputs information processed in the mobile terminal 600.

Meanwhile, when the display 680 and the touch pad have a mutual layer structure to constitute a touch screen, the display 680 may be used as an input device capable of inputting information by a user's touch in addition to the output device .

The audio output unit 653 outputs audio data received from the wireless communication unit 610 or stored in the memory 660. [ The audio output unit 653 may include a speaker, a buzzer, and the like.

The alarm unit 655 outputs a signal for notifying the occurrence of an event of the mobile terminal 600. For example, it is possible to output a signal in a vibration mode. .

The haptic module 657 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 657 is a vibration effect.

The memory 660 may store a program for processing and controlling the control unit 670 and application data and may store temporary data of inputted or outputted data (e.g., a phone book, a message, a still image, For example.

In particular, the memory 660 can store patterns of a plurality of IR signals received from a plurality of devices. Data can be stored for each device and for setting operation items. It is also possible to store an IR signal pattern for each device and operation item.

The interface unit 625 serves as an interface with all the external devices connected to the mobile terminal 600. The interface unit 625 may receive data from the external device or supply power to the respective components in the mobile terminal 600 and may transmit data in the mobile terminal 600 to the external device .

The controller 670 typically controls the operations of the respective units to control the overall operation of the mobile terminal 600. For example, perform related controls and processing for voice calls, data communications, video calls, and the like. In addition, the controller 670 may include a multimedia playback module 681 for multimedia playback. The multimedia playback module 681 may be configured in hardware in the controller 670 or in software separately from the controller 670.

When receiving the device identification signal from the transmitting apparatus corresponding to at least one device or device via the receiving unit 423, the control unit 670 controls the remote unit for remote control based on the received device identification signal And controls the transmitting unit 421 to transmit a remote control signal corresponding to the selected item when a predetermined item of the remote control object is selected.

On the other hand, when the mobile terminal is oriented toward the device, the control unit 670 can identify the device based on the identification signal received from the transmission device corresponding to the device or the device.

The control unit 670 controls to display a first remote control object for remote control for the first device based on the received first identification signal when the mobile terminal 600 is oriented in the first device direction And to display a second remote control object for remote control for the second device based on the received second identification signal when the mobile terminal 600 is oriented in the second device direction.

On the other hand, when any one of the first remote control object or the second remote control object is selected, the control unit 670 can control to transmit the remote control signal corresponding to the selected item.

When the mobile terminal 600 is oriented toward the video display device 100a, the controller 670 may receive a signal corresponding to the motion of the mobile terminal 600 sensed by the sensing unit 640, or a pointing signal To the video display device 100a through the wireless communication module 615, in particular, the transmission unit 421. [

The power supply unit 690 supplies external power and internal power under the control of the controller 670 to supply power necessary for operation of the respective components.

On the other hand, the camera 621 can capture an image. In particular, if the camera 621 is pointing in the direction of the user's face, an image including the user's face can be captured.

The control unit 670 can confirm the user based on the captured user face image and the pre-stored user image.

On the other hand, the camera 621 may capture an image including a user's fingerprint. In such a case, the control unit 670 may confirm the user based on the captured user finger fingerprint image and the user fingerprint image stored previously.

On the other hand, the control unit 670 performs user authentication on the basis of the image captured by the camera 621, and can control the remote control of the device when the user authentication is successful.

On the other hand, the control unit 670 controls the user information to be transmitted to the directed device, and controls the remote control of the device when receiving the user authentication confirmation information from the device.

On the other hand, the control unit 670 controls to display a pre-stored first image including at least one illumination device, and displays a second image including at least one illumination device photographed through the camera 621 And can control to transmit the remote control signal for luminance adjustment based on the difference between the first image and the second image, through the communication unit 610, to the illuminating apparatus being operated.

On the other hand, the control unit 670 can control to transmit the brightness control remote control signal to the illuminating device in the vicinity of the failed lighting device in the second image if there is a failed lighting device.

On the other hand, the control unit 670 controls the illumination device control screen to be displayed according to the illumination device control screen display input, and controls the first image to be displayed in the illumination device control screen.

On the other hand, the control unit 670 controls the second image and the luminance adjustment item for luminance adjustment to be displayed in the illumination device control screen in accordance with the current illumination device display input, and corresponds to the luminance adjustment object in the luminance adjustment item , It is possible to control the remote control signal for luminance adjustment corresponding to the set luminance to be transmitted to the illuminating device in operation.

On the other hand, when there is a failed illumination device in the second image, the control unit 670 controls to transmit the remote control signal for brightness adjustment to the illuminating device in the vicinity of the failed illumination device, It is possible to control the apparatus so as to transmit the second brightness control remote control signal.

On the other hand, the control unit 670 controls the first image and the second image to be displayed together, and when the first image is dragged and dropped onto the second image, The remote control signal can be controlled to be transmitted to the illuminating device in operation.

On the other hand, when it is determined that there is a faulty illumination device in the second image based on the difference between the first image and the second image, the control unit 670 controls the operation of the illuminating device around the failed illumination device, It is possible to control to transmit the control signal.

On the other hand, when it is determined that there is a faulty illumination device in the second image, based on the difference between the first image and the second image, the control unit 670 instructs the electronic equipment in operation around the failed illumination device to set the second luminance It is possible to control to further transmit the control remote control signal.

On the other hand, the control unit 670 controls to display the first image and the second image together with the luminance adjustment items for luminance adjustment, and controls the luminance corresponding to the set luminance, corresponding to the movement of the luminance adjustment object in the luminance adjustment item Control remote control signal to be transmitted to the illuminating device in operation.

Meanwhile, the block diagram of the mobile terminal 600 shown in FIG. 6 is a block diagram for an embodiment of the present invention. Each component of the block diagram may be integrated, added, or omitted according to the specifications of the mobile terminal 600 actually implemented. That is, two or more constituent elements may be combined into one constituent element, or one constituent element may be constituted by two or more constituent elements, if necessary. In addition, the functions performed in each block are intended to illustrate the embodiments of the present invention, and the specific operations and apparatuses do not limit the scope of the present invention.

FIG. 7 is a flowchart showing an example of a method of operating a mobile terminal according to an embodiment of the present invention, and FIGS. 8A to 13B are diagrams referencing a description of an operation method of the mobile terminal of FIG.

Referring to FIG. 7, the controller 670 of the mobile terminal 600 controls to display a first image including a lighting device (S710).

Next, the control unit 670 of the mobile terminal 600 controls to display the second image including the illumination device (S720).

Next, the control unit 670 of the mobile terminal 600 may transmit the brightness control remote control signal to the active lighting device based on the difference between the first image and the second image (S730).

According to an embodiment of the present invention, in order to simplify the control of the lighting apparatus, an image including the lighting apparatus is utilized.

The control unit 670 of the mobile terminal 600 controls to display a pre-stored first image including at least one illumination device and controls the display of the second image including at least one illumination device, And controls to transmit the remote control signal for luminance adjustment, based on the difference between the first image and the second image, through the communication unit 610 to the illuminating apparatus in operation. This makes it possible to easily control the lighting apparatus.

For example, to maintain brightness and color temperature by at least one lighting device in the first image, the control unit 670 of the mobile terminal 600 may be configured to control the luminance adjustment and the color temperature based on the difference between the first image and the second image, Control signals to be transmitted to the illuminating device in operation.

Specifically, when any one of the plurality of illuminators fails, the control unit 670 of the mobile terminal 600 controls the first and second illuminators so that the brightness and the color temperature are maintained by the at least one illuminator in the first image, Based on the difference between the image and the second image, a remote control signal for luminance adjustment can be transmitted to the illuminating device in operation around the failed lighting device. This makes it possible to keep the luminance and the color temperature in the first image at the same or nearest to each other.

In this manner, when any one of the plurality of lighting apparatuses fails, control can be easily performed on the operating lighting apparatus without setting control for each lighting apparatus.

As another example, when the first image maintains the luminance and the color temperature corresponding to the first mood, the control unit 670 of the mobile terminal 600 uses the previously stored first image, The temperature can be easily controlled to be the first mood.

That is, the control unit 670 of the mobile terminal 600 transmits the remote control signal for luminance adjustment, based on the difference between the first image and the second image, to the operating lighting apparatus, .

As another example, when any one of the plurality of lighting apparatuses fails, the control unit 670 of the mobile terminal 600 controls to transmit a remote control signal for luminance adjustment to the lighting apparatus in operation around the failed lighting apparatus And to transmit the second brightness control remote control signal to the electronic apparatus in operation around the failed lighting apparatus. This makes it possible to reinforce the luminance and color temperature corresponding to the first image, which is insufficient even by the operation of the illuminating device in operation. Thus, it is possible to maintain the luminance and the color temperature closest to the luminance and color temperature of the first image.

Hereinafter, an operation method of the mobile terminal of Fig. 7 will be described with reference to Figs. 8A to 13B.

The control unit 670 of the mobile terminal 600 uses the camera 621 to generate a first image including a plurality of illumination devices 100d1, 100d2, and 100d3 at the first time T1, (800) can be controlled to be captured.

The control unit 670 of the mobile terminal 600 may control to store the captured first image 800 in the memory 660.

Meanwhile, the controller 670 of the mobile terminal 600 may perform image analysis on the first image 800 to extract luminance information and color temperature information corresponding to the first image. When the first image 800 is stored, luminance information and color temperature information corresponding to the first image may be stored together.

Next, the control unit 670 of the mobile terminal 600, using the camera 621, controls the operation of the mobile terminal 600 by using the camera 621 as shown in Fig. 8B, 2 image 801 can be controlled to be captured.

The control unit 670 of the mobile terminal 600 may control to store the captured second image 801 in the memory 660. [

Meanwhile, the control unit 670 of the mobile terminal 600 may perform image analysis on the second image 801 to extract luminance information and color temperature information corresponding to the second image. When the second image 801 is stored, the brightness information and the color temperature information corresponding to the second image may be stored together.

On the other hand, the second image 801 illustrates that the second illumination device 100d2 of the plurality of illumination devices 100d1, 100d2, and 100d3 is broken. That is, it is illustrated that only the first illuminating device 100d1 and the third illuminating device 100d3 operate.

This causes the second image 801 to have a shaded area 806a around the second illumination device 100d2 as compared to the first image 800. [

On the other hand, the control unit 670 of the mobile terminal 600 may automatically or in a case of being directed to one of the plurality of illumination apparatuses 100d1, 100d2, and 100d3, The remote control screen 810 for control can be displayed.

The remote control screen 810 for illuminator control in FIG. 8C includes an image display area 812, a brightness control item 814 for brightness control of the illumination device in the displayed image, a color temperature control An item 816, and an apply item 818.

Meanwhile, the luminance adjustment item 814 for adjusting the luminance may include a movable luminance adjustment object 815 for adjusting the luminance, and the color temperature adjustment item 816 for adjusting the color temperature may include a color temperature adjustment A movable color temperature control object 816 may be provided.

8D, the control unit 670 of the mobile terminal 600 may display the image corresponding to the first image 800 in the image display area 812 as shown in FIG. 812t1) can be displayed.

At this time, the luminance adjustment object 815 in the luminance adjustment item 814 may represent the luminance of the first image 800. [ On the other hand, the color temperature adjustment object 816 in the color temperature adjustment item 816 may indicate the color temperature of the first image 800. [

8E, the control unit 670 of the mobile terminal 600 displays the image corresponding to the second image 801 in the image display area 812 when a second image is selected by user input or the like 812t2) can be controlled to be displayed.

On the other hand, in the image 812t2 corresponding to the displayed second image 801, a shaded area 806a is generated around the second illuminator 100d2, as shown in Fig. 8B.

Meanwhile, the controller 670 of the mobile terminal 600 may move the brightness control object in the brightness control item or the color temperature control object in the color temperature control item by user input or the like, as shown in FIG. 8F.

8G, the control unit 670 of the mobile terminal 600 transmits the luminance control remote control signals Remd1 and Remd2 to the first illuminating apparatus 100d1 and the third illuminating apparatus 100d3 in operation Respectively.

At this time, the mobile terminal 600, the first illuminating device 100d1, and the third illuminating device 100d3 may be remotely controllable. For example, it may be in a paired state.

The control unit 670 of the mobile terminal 600 determines that the luminance of the first illuminating device 100d1 and that of the third illuminating device 100d3 are increased in order to increase the brightness, The remote control signals Remd1 and Remd2 for adjusting the brightness for the first time.

As a result, the shadow 806c near the second illuminating device 100d2, which is in failure, becomes smaller as shown in Fig. 8g, and becomes close to the luminance in the first image 800 almost.

Thus, the user can easily perform remote control for a plurality of lighting apparatuses. In particular, it becomes possible to perform remote control for a plurality of lighting apparatuses so as to be most similar to the luminance at the desired time point t1.

On the other hand, FIG. 8H illustrates that the movement amount of the brightness adjustment object 815 and the movement amount of the color temperature adjustment object 817 are smaller than those of FIGS. 8F and 8G.

8H, the control unit 670 of the mobile terminal 600 transmits the remote control signals Remd1 and Remd2 for brightness adjustment to the first illuminating apparatus 100d1 and the third illuminating apparatus 100d3, Respectively.

At this time, the shadow 806b in the vicinity of the second illumination device 100d2 which is in trouble becomes smaller as shown in Fig. 8H, but becomes larger than the shade 806c in Fig. 8G.

On the other hand, the control unit 670 of the mobile terminal 600 automatically or in a case of being directed to any one of the plurality of illumination apparatuses 100d1, 100d2, and 100d3, The remote control screen 810 for control can be displayed.

9A, the remote control screen 810 for controlling the illumination device includes a first image display area 813a, a second image display area 813b, a luminance adjustment item for adjusting the luminance of the illumination device in the displayed image A color temperature adjustment item 816 for adjusting the color temperature, and an apply item 818. [0064] FIG.

The first image display area 813a indicates a target image display area, and the second image display area 813b indicates a current image display area.

On the other hand, the control unit 670 of the mobile terminal 600 controls the first image display region 813a to display the image 813t1 corresponding to the first image by user input or the like, The image 813t2 corresponding to the second image can be displayed on the display unit 813b.

The image 813t1 corresponding to the first image 800 may include the target item object 813aa and the first through third illuminators 100d1 100d2 100d3 and corresponds to the second image 801 The image 813t2 may include the current item object 813bb and the first to third illuminating devices 100d1, 100d2, and 100d3.

9C, the control unit 670 of the mobile terminal 600 drops the image 813t1 corresponding to the first image 800 to the image 813t2 corresponding to the second image 801 Control to transmit the luminance control remote control signals Remd1 and Remd2 to the illuminating devices 100d1 and 100d3 in operation based on the difference between the first image 800 and the second image 801 as shown in Fig. can do.

As described above, the memory 660 can store luminance information and color temperature information corresponding to the first image 800, luminance information and color temperature information corresponding to the second image 801, and the like.

The control unit 670 of the mobile terminal 600 uses the difference between the brightness information and the color temperature information corresponding to the first image 800 and the brightness information and the color temperature information corresponding to the second image 801, It is possible to generate the luminance control remote control signals Remd1 and Remd2.

Thus, it is possible to maintain the luminance and the color temperature closest to the luminance and color temperature of the first image.

The control unit 670 of the mobile terminal 600 captures the current image subjected to the luminance adjustment after the transmission of the luminance control remote control signals Remd1 and Remd2 and outputs the captured image 813f Can be controlled to be displayed together.

At this time, as shown in FIG. 9E, an object 813m indicating that the current illumination is closest to the target may be displayed separately.

Next, Figs. 10A to 10C illustrate a method of maintaining the brightness close to the first image, even when the second illumination device 100d2 fails, by user input.

Figure 10A illustrates a remote control screen 810 for lighting device control, as shown in Figure 8C.

Fig. 10B illustrates that, similarly to Fig. 8D, an image 812t1 corresponding to the first image 800 is displayed in the image display area 812. Fig.

Fig. 10C illustrates that the luminance adjustment object 815 and the color temperature adjustment object 817 are moved to the right to increase the luminance. The control unit 670 of the mobile terminal 600 can transmit the brightness control remote control signals Remd1 and Remd2 for increasing the brightness to the first lighting apparatus 100d1 and the third lighting apparatus 100d3 have.

Thus, the shadow in the vicinity of the second illumination device 100d2, which is in a failure state, becomes smaller and comes close to the luminance in the first image 800 almost.

On the other hand, Figs. 8A to 10C illustrate the brightness adjusting function by comparing the first image and the second image only when some lighting apparatus is in failure, but the embodiment of the present invention is not limited thereto.

That is, as shown in Figs. 11A to 11C, even when a plurality of illuminating devices are not in trouble, even when the brightness is different, the brightness adjusting function can be applied by comparing the first image and the second image.

On the other hand, when the control unit 670 of the mobile terminal 600 is directed to any one of the plurality of illumination apparatuses 100d1, 100d2, and 100d3, The remote control screen 810 for control can be displayed.

The remote control screen 810 for illuminator control in Fig. 11A includes a first image display area 813t1, a second image display area 813t3, a brightness adjustment item for brightness adjustment of the illumination device in the displayed image A color temperature adjustment item 816 for adjusting the color temperature, and an apply item 818. [0064] FIG.

The controller 670 of the mobile terminal 600 controls the first image display area 813t1 to display the image 813aa corresponding to the first image by a user input or the like, The image 813t2 corresponding to the second image can be displayed on the display 813t3.

On the other hand, the control unit 670 of the mobile terminal 600 drops the image 813t1 corresponding to the first image 800 to the image 813t2 corresponding to the second image 801 as shown in FIG. 11B The remote control signals Remd1 and Remd2 for luminance adjustment based on the difference between the first image 800 and the second image 801 can be controlled to be transmitted to the illuminating devices 100d1 and 100d3 in operation.

The control unit 670 of the mobile terminal 600 captures the current image after the brightness control remote control signals Remd1 and Remd2 are transmitted and displays the captured image 812t2 in FIG. Can be controlled to be displayed together.

Next, Figs. 12A to 12C are diagrams for explaining a case where, when it is determined that there is a faulty illumination device in the second image, based on the difference between the first image and the second image, And controls to further transmit the remote control signal for luminance adjustment.

12A illustrates a remote control screen 810 for lighting device control that includes an image 1112. FIG.

On the other hand, the control unit 670 of the mobile terminal 600 controls the lighting devices 100d1 and 100d3 in operation around the failed lighting device based on the difference between the first image and the second image, , Remdb), and can control to transmit the second brightness control remote control signal (Remdc) to the TV 100a operating in the vicinity of the lighting apparatus.

Thus, the brightness or the like corresponding to the first image can be maintained.

The control unit 670 of the mobile terminal 600 captures the current image after the luminance control remote control signals Remda, Remdb and Remdc are transmitted and outputs the captured image 1113 12c. ≪ / RTI >

13A to 13B illustrate the difference in the operation of the lighting apparatus when the windows of the living room are opened and closed.

The control unit 670 of the mobile terminal 600 determines whether the brightness of the illumination devices 100d1, 100d2, and 100d3 is equal to or greater than the brightness of the first image 812t1 when the window 1309 in the first image 812t1 is opened, .

Next, when the window 1309 in the second image 1313 is closed as shown in FIG. 13B, the control unit 670 of the mobile terminal 600 controls the illumination devices 100d1, 100d2 , And 100d3 can be controlled to be the second luminance higher than the first luminance. At this time, it is possible to control the brightness of the TV 100a, which is a peripheral device, to increase.

The method of operation of the mobile terminal of the present invention can be implemented as a code that can be read by a processor on a recording medium readable by the processor included in the mobile terminal. The processor-readable recording medium includes all kinds of recording apparatuses in which data that can be read by the processor is stored. Examples of the recording medium that can be read by the processor include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, and may also be implemented in the form of a carrier wave such as transmission over the Internet . In addition, the processor-readable recording medium may be distributed over network-connected computer systems so that code readable by the processor in a distributed fashion can be stored and executed.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention.

Claims (9)

display;
camera;
A communication unit;
Controlling to display a pre-stored first image including at least one illumination device, controlling to display a second image including at least one illumination device, which is photographed through the camera, And a control unit for controlling the remote control signal for luminance adjustment based on the difference of two images to be transmitted through the communication unit to the illuminating apparatus being operated. The method according to claim 1,
Wherein,
And controls to transmit the brightness control remote control signal to an illuminating device in operation around the failed lighting device in the case where there is a failed lighting device in the second image. The method according to claim 1,
And a memory for storing the first image,
Wherein,
Controls the illumination device control screen to be displayed according to the illumination device control screen display input, and controls the first image to be displayed within the illumination device control screen. The method of claim 3,
Wherein,
Controls to display the second image and a luminance adjustment item for luminance adjustment in the illumination device control screen in accordance with the current illumination device display input,
And controls to transmit the luminance control remote control signal corresponding to the set luminance to the lighting apparatus in operation corresponding to the movement of the luminance adjustment object in the luminance adjustment item. The method according to claim 1,
Wherein,
If there is a faulty illumination device in the second image,
Controls to transmit the brightness control remote control signal to an illuminating device in operation around the failed lighting device,
And controls to transmit a second brightness control remote control signal to an electronic device in operation around the failed lighting device. The method according to claim 1,
Wherein,
Controls the first image and the second image to be displayed together,
And to transmit the remote control signal for luminance adjustment to the operating illuminating device based on a difference between the first image and the second image when the first image is dragged and dropped onto the second image . The method according to claim 6,
Wherein,
When it is determined that there is a faulty illumination device in the second image based on the difference between the first image and the second image, the remote control signal for luminance adjustment is transmitted to the illuminating device in the vicinity of the failed illumination device To the mobile terminal. 8. The method of claim 7,
Wherein,
When it is determined that there is a faulty illumination device in the second image based on a difference between the first image and the second image, a second brightness adjustment remote control signal To the mobile terminal. The method according to claim 1,
Wherein,
Controls to display together the first image and the second image together with a luminance adjustment item for luminance adjustment,
And controls to transmit the luminance control remote control signal corresponding to the set luminance to the lighting apparatus in operation corresponding to the movement of the luminance adjustment object in the luminance adjustment item.

Images