KR102336984B1 - Multimedia device - Google Patents

Abstract

Disclosed is a multimedia device capable of providing notification information for each user in a standby mode. The multimedia device according to an embodiment of the present invention includes a control unit that enters a standby mode when the multimedia device is turned off, and notification information from at least one of a broadcasting station, an external device, and an external server when the multimedia device enters the standby mode. a notification information collecting unit to collect; a sensing unit for obtaining user information and distance information from the user when the multimedia device enters a standby mode; and a display unit, wherein the control unit includes: When a user recognized based on the information corresponds to a preset user and the obtained distance information to the user corresponds to a preset distance value, a partial region of the display unit is activated, and the recognition among the collected notification information Notification information corresponding to the activated user is displayed in the activated partial area.

Description

Multimedia device {MULTIMEDIA DEVICE}

The present invention relates to a multimedia device.

TVs are gradually being implemented in the form of multimedia devices with complex functions by adding computer support functions and Internet functions beyond the broadcast reception function. In recent years, a home network environment capable of transmitting and receiving signals between electronic products and information and communication devices in the home is becoming more common, and accordingly, the need to provide customized information to users in the home is increasing.

SUMMARY OF THE INVENTION The present invention aims to solve the above and other problems. Another object of the present invention is to provide a multimedia device capable of providing customized information for each user when the multimedia device is in a standby mode.

Another object of the present invention is to provide a multimedia device capable of providing customized information for each user when the multimedia device is in an on state.

The technical problems to be achieved in the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by those of ordinary skill in the art to which the present invention belongs from the description below. will be able

According to one aspect of the present invention to achieve the above or other object, a multimedia device includes a control unit that enters a standby mode when the multimedia device is turned off, and a broadcasting station, an external device and A notification information collection unit for collecting notification information from at least one of external servers, a sensing unit for acquiring user information and distance information with the user when the multimedia device enters a standby mode, and a display unit, The controller activates a partial area of the display unit when a user recognized based on the acquired user information corresponds to a preset user and the acquired distance information with the user corresponds to a preset distance value, and , and display the notification information corresponding to the recognized user among the collected notification information on the activated partial area.

According to one aspect of the present invention to achieve the above or other object, a multimedia device includes a receiver for receiving a broadcast signal, a display for displaying video data of a broadcast program included in the received broadcast signal, and a sensing unit for sensing information; and a control unit, wherein the control unit senses information of a user who views the broadcasting program while video data of the broadcasting program is displayed, and transmits the sensed user information to the broadcasting program information of a user who views the broadcast program when video data of a broadcast program identical to the broadcast program is displayed again through the display unit after reception of a broadcast signal corresponding to the broadcast program is completed is sensed again, and when the re-sensed user information is different from the user information stored in the memory, a signal for providing a notification is controlled to be transmitted to a preset external device.

The effect of the multimedia device according to the present invention will be described as follows.

According to at least one of the embodiments of the present invention, it is possible to provide a multimedia device capable of providing customized information for each user when the multimedia device is in a standby mode.

Also, according to at least one of the embodiments of the present invention, it is possible to provide a multimedia device capable of providing customized information for each user when the multimedia device is in an on state.

Further scope of applicability of the present invention will become apparent from the following detailed description. However, it should be understood that the detailed description and specific embodiments such as preferred embodiments of the present invention are given by way of example only, since various changes and modifications within the spirit and scope of the present invention may be clearly understood by those skilled in the art.

1 is a block diagram illustrating a mobile terminal related to the present invention.
2 is a block diagram illustrating a multimedia device according to an embodiment of the present invention.
3 is a block diagram illustrating a detailed configuration of the control unit of FIG. 2 according to an embodiment of the present invention.
4 is a flowchart illustrating an example of a method of providing notification information for each user in a multimedia device according to an embodiment of the present invention.
5 is a diagram for explaining an example of a method of providing notification information for each user in a multimedia device according to an embodiment of the present invention.
6 is a diagram for explaining an example of a case in which a remote controller UI for controlling notification information displayed on a multimedia device is output to a mobile terminal according to an embodiment of the present invention.
7 is a diagram for explaining another example of a method of providing notification information for each user in a multimedia device according to an embodiment of the present invention.
8 is a diagram for explaining another example of a method of providing notification information for each user in a multimedia device according to an embodiment of the present invention.
9 is a diagram for explaining another example of a method of providing notification information for each user in a multimedia device according to an embodiment of the present invention.
10 is a diagram for explaining another example of a method of providing notification information for each user in a multimedia device according to an embodiment of the present invention.
11 illustrates an example of a method of continuously providing notification information through a user's mobile terminal according to the distance between the multimedia device and the user when notification information for each user is displayed on the multimedia device according to an embodiment of the present invention. is a drawing for
12 is a diagram for explaining another example of a method of providing notification information for each user in a multimedia device according to an embodiment of the present invention.
13 is a diagram for explaining an example of a method of outputting notification information with reference to information obtained from an image of a user in a multimedia device according to an embodiment of the present invention.
14 is a diagram for explaining another example of a method of providing notification information for each user in a multimedia device according to an embodiment of the present invention.
15 and 16 are diagrams for explaining an example of a method of providing customized information for each user based on history information for each user using a multimedia device according to an embodiment of the present invention.
17 is a diagram for explaining an example of a method for controlling a function of an in-house electronic device through a multimedia device according to an embodiment of the present invention.

Hereinafter, the embodiments disclosed in the present specification will be described in detail with reference to the accompanying drawings, but the same or similar components are assigned the same reference numbers regardless of reference numerals, and redundant description thereof will be omitted. The suffixes "module" and "part" for components used in the following description are given or mixed in consideration of only the ease of writing the specification, and do not have distinct meanings or roles by themselves. In addition, in describing the embodiments disclosed in the present specification, if it is determined that detailed descriptions of related known technologies may obscure the gist of the embodiments disclosed in this specification, the detailed description thereof will be omitted. In addition, the accompanying drawings are only for easy understanding of the embodiments disclosed in the present specification, and the technical idea disclosed herein is not limited by the accompanying drawings, and all changes included in the spirit and scope of the present invention , should be understood to include equivalents or substitutes.

Terms including an ordinal number such as 1st, 2nd, etc. may be used to describe various elements, but the elements are not limited by the terms. The above terms are used only for the purpose of distinguishing one component from another.

When an element is referred to as being “connected” or “connected” to another element, it is understood that it may be directly connected or connected to the other element, but other elements may exist in between. it should be On the other hand, when it is said that a certain element is "directly connected" or "directly connected" to another element, it should be understood that the other element does not exist in the middle.

The singular expression includes the plural expression unless the context clearly dictates otherwise.

In the present application, terms such as “comprises” or “have” are intended to designate that a feature, number, step, operation, component, part, or combination thereof described in the specification exists, but one or more other features It should be understood that this does not preclude the existence or addition of numbers, steps, operations, components, parts, or combinations thereof.

The mobile terminal described in this specification includes a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation system, and a slate PC. , tablet PCs, ultrabooks, wearable devices, for example, watch-type terminals (smartwatch), glass-type terminals (smart glass), HMD (head mounted display), etc. may be included. have.

However, it will be readily apparent to those skilled in the art that the configuration according to the embodiment described in this specification may be applied to a fixed terminal such as a digital TV, a desktop computer, a digital signage, etc., except when applicable only to a mobile terminal. will be.

1 is a block diagram illustrating a mobile terminal related to the present invention.

Referring to FIG. 1 , the mobile terminal 100 includes a wireless communication unit 110 , an input unit 120 , a sensing unit 140 , an output unit 150 , an interface unit 160 , a memory 170 , and a control unit 180 . ) and a power supply 190 and the like. The components shown in FIG. 1 are not essential for implementing the mobile terminal, so the mobile terminal described in this specification may have more or fewer components than those listed above.

More specifically, among the components, the wireless communication unit 110 is between the mobile terminal 100 and the wireless communication system, between the mobile terminal 100 and another mobile terminal 100, or between the mobile terminal 100 and an external server. It may include one or more modules that enable wireless communication between them. In addition, the wireless communication unit 110 may include one or more modules for connecting the mobile terminal 100 to one or more networks.

The wireless communication unit 110 may include at least one of a broadcast reception module 111 , a mobile communication module 112 , a wireless Internet module 113 , a short-range communication module 114 , and a location information module 115 . .

The input unit 120 includes a camera 121 or an image input unit for inputting an image signal, a microphone 122 or an audio input unit for inputting an audio signal, and a user input unit 123 for receiving information from a user, for example, , a touch key, a push key, etc.). The voice data or image data collected by the input unit 120 may be analyzed and processed as a user's control command.

The sensing unit 140 may include one or more sensors for sensing at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information. For example, the sensing unit 140 may include a proximity sensor 141, an illumination sensor 142, an illumination sensor, a touch sensor, an acceleration sensor, a magnetic sensor, and gravity. Sensor (G-sensor), gyroscope sensor, motion sensor, RGB sensor, infrared sensor (IR sensor: infrared sensor), fingerprint recognition sensor (finger scan sensor), ultrasonic sensor , optical sensors (eg, cameras (see 121)), microphones (see 122), battery gauges, environmental sensors (eg, barometers, hygrometers, thermometers, radiation detection sensors, It may include at least one of a thermal sensor, a gas sensor, etc.) and a chemical sensor (eg, an electronic nose, a healthcare sensor, a biometric sensor, etc.). Meanwhile, the mobile terminal disclosed in the present specification may combine and utilize information sensed by at least two or more of these sensors.

The output unit 150 is for generating an output related to visual, auditory or tactile sense, and includes at least one of a display unit 151 , a sound output unit 152 , a haptip module 153 , and an optical output unit 154 . can do. The display unit 151 may implement a touch screen by forming a layer structure with the touch sensor or being integrally formed. Such a touch screen may function as the user input unit 123 providing an input interface between the mobile terminal 100 and the user, and may provide an output interface between the mobile terminal 100 and the user.

The interface unit 160 serves as a passage with various types of external devices connected to the mobile terminal 100 . The interface unit 160 connects a device equipped with a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, and an identification module. It may include at least one of a port, an audio input/output (I/O) port, a video input/output (I/O) port, and an earphone port. In response to the connection of the external device to the interface unit 160 , the mobile terminal 100 may perform appropriate control related to the connected external device.

In addition, the memory 170 stores data supporting various functions of the mobile terminal 100 . The memory 170 may store a plurality of application programs (or applications) driven in the mobile terminal 100 , data for operation of the mobile terminal 100 , and commands. At least some of these application programs may be downloaded from an external server through wireless communication. In addition, at least some of these application programs may exist on the mobile terminal 100 from the time of shipment for basic functions (eg, incoming calls, outgoing functions, message reception, and outgoing functions) of the mobile terminal 100 . Meanwhile, the application program may be stored in the memory 170 , installed on the mobile terminal 100 , and driven to perform an operation (or function) of the mobile terminal by the controller 180 .

In addition to the operation related to the application program, the controller 180 generally controls the overall operation of the mobile terminal 100 . The controller 180 may provide or process appropriate information or functions to the user by processing signals, data, information, etc. input or output through the above-described components or by driving an application program stored in the memory 170 .

In addition, the controller 180 may control at least some of the components discussed with reference to FIG. 1A in order to drive an application program stored in the memory 170 . Furthermore, in order to drive the application, the controller 180 may be configured as security information for a transaction using at least a specific account among components included in the mobile terminal 100, which is previously registered by the user of the mobile terminal 100. It is possible to operate two or more in combination with each other.

The power supply unit 190 receives external power and internal power under the control of the control unit 180 to supply power to each component included in the mobile terminal 100 . The power supply unit 190 includes a battery, and the battery may be a built-in battery or a replaceable battery.

At least some of the respective components may operate in cooperation with each other in order to implement an operation, control, or control method of a mobile terminal according to various embodiments to be described below. Also, the operation, control, or control method of the mobile terminal may be implemented on the mobile terminal by driving at least one application program stored in the memory 170 .

Hereinafter, before looking at the various embodiments implemented through the mobile terminal 100 as described above, the above-listed components will be described in more detail with reference to FIG. 1A .

First, referring to the wireless communication unit 110 , the broadcast reception module 111 of the wireless communication unit 110 receives a broadcast signal and/or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more of the broadcast reception modules may be provided to the mobile terminal 100 for simultaneous broadcast reception or broadcast channel switching for at least two broadcast channels.

The broadcast management server may mean a server that generates and transmits a broadcast signal and/or broadcast-related information or a server that receives a previously generated broadcast signal and/or broadcast-related information and transmits the received broadcast signal and/or broadcast-related information to the terminal. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, as well as a TV broadcast signal or a broadcast signal in which a data broadcast signal is combined with a radio broadcast signal.

The broadcast signal may be encoded according to at least one of technical standards (or a broadcast method, for example, ISO, IEC, DVB, ATSC, etc.) for transmitting and receiving digital broadcast signals, and the broadcast reception module 111 is configured to The digital broadcast signal can be received using a method suitable for technical standards set by technical standards.

The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112 .

The broadcast-related information may exist in various forms, for example, an Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or an Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H). A broadcast signal and/or broadcast related information received through the broadcast reception module 111 may be stored in the memory 160 .

Mobile communication module 112, the technical standards or communication methods for mobile communication (eg, Global System for Mobile communication (GSM), Code Division Multi Access (CDMA), Code Division Multi Access 2000 (CDMA2000), EV -Enhanced Voice-Data Optimized or Enhanced Voice-Data Only (DO), Wideband CDMA (WCDMA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), LTE-A (Long Term Evolution-Advanced, etc.) transmits and receives a radio signal to and from at least one of a base station, an external terminal, and a server on a mobile communication network constructed according to.

The wireless signal may include various types of data according to transmission/reception of a voice call signal, a video call signal, or a text/multimedia message.

The wireless Internet module 113 refers to a module for wireless Internet access, and may be built-in or external to the mobile terminal 100 . The wireless Internet module 113 is configured to transmit and receive wireless signals in a communication network according to wireless Internet technologies.

As wireless Internet technology, for example, WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance), WiBro (Wireless Broadband), WiMAX (World Interoperability for Microwave Access), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A), etc., and the wireless Internet module ( 113) transmits and receives data according to at least one wireless Internet technology within a range including Internet technologies not listed above.

From the point of view that wireless Internet access by WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE, LTE-A, etc. is made through a mobile communication network, the wireless Internet module 113 performs wireless Internet access through the mobile communication network. ) may be understood as a type of the mobile communication module 112 .

Short-range communication module 114 is for short-range communication, Bluetooth™, RFID (Radio Frequency Identification), infrared communication (Infrared Data Association; IrDA), UWB (Ultra Wideband), ZigBee, NFC At least one of (Near Field Communication), Wireless-Fidelity (Wi-Fi), Wi-Fi Direct, and Wireless Universal Serial Bus (USB) technologies may be used to support short-range communication. The short-distance communication module 114 is, between the mobile terminal 100 and the wireless communication system, between the mobile terminal 100 and another mobile terminal 100, or the mobile terminal 100 through wireless area networks (Wireless Area Networks). ) and another mobile terminal (100, or an external server) can support wireless communication between the network located. The local area network may be local area networks (Wireless Personal Area Networks).

Here, the other mobile terminal 100 is a wearable device capable of exchanging (or interworking) data with the mobile terminal 100 according to the present invention, for example, a smart watch, smart glasses. (smart glass) or HMD (head mounted display)). The short-range communication module 114 may detect (or recognize) a wearable device capable of communicating with the mobile terminal 100 in the vicinity of the mobile terminal 100 . Furthermore, when the detected wearable device is a device authenticated to communicate with the mobile terminal 100 according to the present invention, the controller 180 transmits at least a portion of data processed by the mobile terminal 100 to the short-range communication module ( 114) to transmit to the wearable device. Accordingly, the user of the wearable device may use data processed by the mobile terminal 100 through the wearable device. For example, according to this, when a call is received in the mobile terminal 100, the user performs a phone call through the wearable device, or when a message is received in the mobile terminal 100, the user receives the received call through the wearable device. It is possible to check the message.

The location information module 115 is a module for obtaining a location (or current location) of a mobile terminal, and a representative example thereof includes a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module. For example, if the mobile terminal utilizes a GPS module, it can acquire the location of the mobile terminal by using a signal transmitted from a GPS satellite. As another example, if the mobile terminal utilizes the Wi-Fi module, the location of the mobile terminal may be obtained based on information of the Wi-Fi module and a wireless access point (AP) that transmits or receives a wireless signal. If necessary, the location information module 115 may perform any function of the other modules of the wireless communication unit 110 to obtain data on the location of the mobile terminal as a substitute or additionally. The location information module 115 is a module used to obtain the location (or current location) of the mobile terminal, and is not limited to a module that directly calculates or obtains the location of the mobile terminal.

Next, the input unit 120 is for input of image information (or signal), audio information (or signal), data, or information input from a user. For input of image information, the mobile terminal 100 has one Alternatively, a plurality of cameras 121 may be provided. The camera 121 processes an image frame such as a still image or a moving image obtained by an image sensor in a video call mode or a shooting mode. The processed image frame may be displayed on the display unit 151 or stored in the memory 170 . On the other hand, the plurality of cameras 121 provided in the mobile terminal 100 may be arranged to form a matrix structure, and through the cameras 121 forming the matrix structure as described above, various angles or focal points are applied to the mobile terminal 100 . A plurality of image information with can be input. In addition, the plurality of cameras 121 may be arranged in a stereo structure to acquire a left image and a right image for realizing a stereoscopic image.

The microphone 122 processes an external sound signal as electrical voice data. The processed voice data may be utilized in various ways according to a function (or an application program being executed) being performed by the mobile terminal 100 . Meanwhile, various noise removal algorithms for removing noise generated in the process of receiving an external sound signal may be implemented in the microphone 122 .

The user input unit 123 is for receiving information from the user, and when information is input through the user input unit 123 , the controller 180 may control the operation of the mobile terminal 100 to correspond to the input information. . Such a user input unit 123 is a mechanical input means (or a mechanical key, for example, a button located on the front, rear or side of the mobile terminal 100, a dome switch (dome switch), a jog wheel, jog switch, etc.) and a touch input means. As an example, the touch input means consists of a virtual key, a soft key, or a visual key displayed on the touch screen through software processing, or a part other than the touch screen. On the other hand, the virtual key or the visual key may be displayed on the touch screen while having various shapes, and for example, graphic, text ), an icon, a video, or a combination thereof.

On the other hand, the sensing unit 140 senses at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information, and generates a sensing signal corresponding thereto. The controller 180 may control the driving or operation of the mobile terminal 100 or perform data processing, function, or operation related to an application program installed in the mobile terminal 100 based on the sensing signal. Representative sensors among various sensors that may be included in the sensing unit 140 will be described in more detail.

First, the proximity sensor 141 refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object existing in the vicinity without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor 141 may be disposed in an inner region of the mobile terminal covered by the touch screen described above or near the touch screen.

Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive type proximity sensor, a magnetic type proximity sensor, and an infrared proximity sensor. When the touch screen is capacitive, the proximity sensor 141 may be configured to detect the proximity of an object having conductivity by a change in an electric field according to the proximity of the object. In this case, the touch screen (or touch sensor) itself may be classified as a proximity sensor.

On the other hand, for convenience of description, the act of approaching an object on the touch screen without contacting it so that the object is recognized that it is located on the touch screen is called “proximity touch”, and the touch The act of actually touching an object on the screen is called "contact touch". The position where the object is touched in proximity on the touch screen means a position where the object is perpendicular to the touch screen when the object is touched in proximity. The proximity sensor 141 may detect a proximity touch and a proximity touch pattern (eg, proximity touch distance, proximity touch direction, proximity touch speed, proximity touch time, proximity touch position, proximity touch movement state, etc.) have. Meanwhile, the controller 180 processes data (or information) corresponding to the proximity touch operation and the proximity touch pattern sensed through the proximity sensor 141 as described above, and further, provides visual information corresponding to the processed data. It can be printed on the touch screen. Furthermore, the controller 180 may control the mobile terminal 100 to process different operations or data (or information) according to whether a touch to the same point on the touch screen is a proximity touch or a contact touch. .

The touch sensor receives a touch (or touch input) applied to the touch screen (or the display unit 151) using at least one of various touch methods such as a resistive film method, a capacitive method, an infrared method, an ultrasonic method, and a magnetic field method. detect

As an example, the touch sensor may be configured to convert a change in pressure applied to a specific part of the touch screen or a change in capacitance occurring in a specific part of the touch screen into an electrical input signal. The touch sensor may be configured to detect a position, an area, a pressure at the time of touch, an electrostatic capacitance at the time of touch, etc. in which a touch object applying a touch on the touch screen is touched on the touch sensor. Here, the touch object is an object that applies a touch to the touch sensor, and may be, for example, a finger, a touch pen, a stylus pen, or a pointer.

As such, when there is a touch input to the touch sensor, a signal(s) corresponding thereto is sent to the touch controller. The touch controller processes the signal(s) and then transmits corresponding data to the controller 180 . Accordingly, the controller 180 can know which area of the display unit 151 has been touched, and the like. Here, the touch controller may be a component separate from the controller 180 , or may be the controller 180 itself.

Meanwhile, the controller 180 may perform different controls or may perform the same control according to the type of the touch object that touches the touch screen (or a touch key provided in addition to the touch screen). Whether to perform different control or the same control according to the type of the touch object may be determined according to the current operating state of the mobile terminal 100 or a running application program.

On the other hand, the above-described touch sensor and proximity sensor independently or in combination, a short (or tap) touch on the touch screen (short touch), long touch (long touch), multi touch (multi touch), drag touch (drag touch) ), flick touch, pinch-in touch, pinch-out touch, swype touch, hovering touch, etc. It can sense touch.

The ultrasonic sensor may recognize position information of a sensing target by using ultrasonic waves. Meanwhile, the controller 180 may calculate the position of the wave source through information sensed by the optical sensor and the plurality of ultrasonic sensors. The position of the wave source may be calculated using the property that light is much faster than ultrasonic waves, that is, the time at which light arrives at the optical sensor is much faster than the time at which ultrasonic waves reach the ultrasonic sensor. More specifically, the position of the wave source may be calculated using a time difference from the time that the ultrasonic wave arrives using light as a reference signal.

On the other hand, the camera 121 as seen in the configuration of the input unit 120 includes at least one of a camera sensor (eg, CCD, CMOS, etc.), a photo sensor (or image sensor), and a laser sensor.

The camera 121 and the laser sensor may be combined with each other to detect a touch of a sensing target for a 3D stereoscopic image. The photo sensor may be stacked on the display device, and the photo sensor is configured to scan the motion of the sensing target close to the touch screen. More specifically, the photo sensor mounts photo diodes and transistors (TRs) in rows/columns and scans the contents placed on the photo sensors using electrical signals that change according to the amount of light applied to the photo diodes. That is, the photo sensor calculates the coordinates of the sensing target according to the amount of change in light, and through this, location information of the sensing target can be obtained.

The display unit 151 displays (outputs) information processed by the mobile terminal 100 . For example, the display unit 151 may display execution screen information of an application program driven in the mobile terminal 100 or UI (User Interface) and GUI (Graphic User Interface) information according to the execution screen information. .

Also, the display unit 151 may be configured as a stereoscopic display unit for displaying a stereoscopic image.

A three-dimensional display method such as a stereoscopic method (glasses method), an auto stereoscopic method (glassesless method), or a projection method (holographic method) may be applied to the stereoscopic display unit.

In general, a 3D stereoscopic image consists of a left image (image for left eye) and a right image (image for right eye). Depending on the method in which the left and right images are merged into a 3D stereoscopic image, a top-down method in which the left and right images are placed up and down in one frame, and the left and right images in one frame L-to-R (left-to-right, side by side) method, which arranges the pieces of the left and right images in tiles Alternatively, it is divided into an interlaced method in which rows are alternately arranged, and a time sequential (frame by frame) method in which a left image and a right image are displayed alternately by time.

In addition, the 3D thumbnail image may be generated as a single image by generating a left image thumbnail and a right image thumbnail from the left image and the right image of the original image frame, respectively, and combining them. In general, a thumbnail means a reduced image or a reduced still image. The generated left image thumbnail and right image thumbnail may be displayed with a left and right distance difference on the screen by a depth corresponding to the parallax between the left image and the right image, thereby representing a three-dimensional sense of space.

The left image and the right image necessary for realizing the 3D stereoscopic image may be displayed on the stereoscopic display unit by the stereoscopic processing unit. The stereoscopic processing unit receives a 3D image (a reference view image and an extended view image) and sets a left image and a right image therefrom, or receives a 2D image and converts it into a left image and a right image.

The sound output unit 152 may output audio data received from the wireless communication unit 110 or stored in the memory 170 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. The sound output unit 152 also outputs a sound signal related to a function (eg, a call signal reception sound, a message reception sound, etc.) performed in the mobile terminal 100 . The sound output unit 152 may include a receiver, a speaker, a buzzer, and the like.

The haptic module 153 generates various tactile effects that the user can feel. A representative example of the tactile effect generated by the haptic module 153 may be vibration. The intensity and pattern of vibration generated by the haptic module 153 may be controlled by a user's selection or setting of the controller. For example, the haptic module 153 may synthesize and output different vibrations or output them sequentially.

In addition to vibration, the haptic module 153 is configured to respond to stimuli such as a pin arrangement that moves vertically with respect to the contact skin surface, a jet force or suction force of air through a nozzle or an inlet, rubbing against the skin surface, contact of an electrode, electrostatic force, etc. Various tactile effects can be generated, such as the effect of heat absorption and the effect of reproducing a feeling of coolness and warmth using an element capable of absorbing heat or generating heat.

The haptic module 153 may not only deliver a tactile effect through direct contact, but may also be implemented so that the user can feel the tactile effect through a muscle sense such as a finger or arm. Two or more haptic modules 153 may be provided according to the configuration of the mobile terminal 100 .

The light output unit 154 outputs a signal for notifying the occurrence of an event by using the light of the light source of the mobile terminal 100 . Examples of the event occurring in the mobile terminal 100 may be message reception, call signal reception, missed call, alarm, schedule notification, email reception, information reception through an application, and the like.

The signal output from the optical output unit 154 is implemented as the mobile terminal emits light of a single color or a plurality of colors toward the front or rear. The signal output may be terminated when the mobile terminal detects the user's event confirmation.

The interface unit 160 serves as a passage with all external devices connected to the mobile terminal 100 . The interface unit 160 receives data from an external device, receives power and transmits it to each component inside the mobile terminal 100 , or transmits data inside the mobile terminal 100 to an external device. For example, a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, a port for connecting a device equipped with an identification module (port), an audio I/O (Input/Output) port, a video I/O (Input/Output) port, an earphone port, etc. may be included in the interface unit 160 .

On the other hand, the identification module is a chip storing various types of information for authenticating the use authority of the mobile terminal 100, a user identification module (UIM), a subscriber identity module (subscriber identity module; SIM), universal user authentication It may include a universal subscriber identity module (USIM) and the like. A device equipped with an identification module (hereinafter, 'identification device') may be manufactured in the form of a smart card. Accordingly, the identification device may be connected to the terminal 100 through the interface unit 160 .

In addition, when the mobile terminal 100 is connected to an external cradle, the interface unit 160 becomes a passage through which power from the cradle is supplied to the mobile terminal 100, or is input from the cradle by a user. Various command signals may be a path through which the mobile terminal 100 is transmitted. Various command signals or the power input from the cradle may be operated as signals for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The memory 170 may store a program for the operation of the controller 180 , and may temporarily store input/output data (eg, a phone book, a message, a still image, a moving picture, etc.). The memory 170 may store data related to vibration and sound of various patterns output when a touch input on the touch screen is input.

Memory 170 is a flash memory type (flash memory type), hard disk type (hard disk type), SSD type (Solid State Disk type), SDD type (Silicon Disk Drive type), multimedia card micro type (multimedia card micro type) ), card-type memory (such as SD or XD memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read (EEPROM) -only memory), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and an optical disk may include at least one type of storage medium. The mobile terminal 100 may be operated in relation to a web storage that performs a storage function of the memory 170 on the Internet.

Meanwhile, as described above, the controller 180 controls the operation related to the application program and the general operation of the mobile terminal 100 in general. For example, if the state of the mobile terminal satisfies a set condition, the controller 180 may execute or release a lock state restricting input of a user's control command to applications.

In addition, the controller 180 performs control and processing related to voice calls, data communication, video calls, etc., or performs pattern recognition processing capable of recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively. can Furthermore, in order to implement various embodiments described below on the mobile terminal 100 according to the present invention, the controller 180 may control one or a combination of any one or a plurality of the components described above.

The power supply unit 190 receives external power and internal power under the control of the control unit 180 to supply power required for operation of each component. The power supply unit 190 includes a battery, and the battery may be a built-in battery configured to be rechargeable, and may be detachably coupled to the terminal body for charging or the like.

In addition, the power supply unit 190 may include a connection port, and the connection port may be configured as an example of the interface 160 to which an external charger that supplies power for charging the battery is electrically connected.

As another example, the power supply unit 190 may be configured to charge the battery in a wireless manner without using the connection port. In this case, the power supply unit 190 uses one or more of an inductive coupling method based on a magnetic induction phenomenon or a resonance coupling method based on an electromagnetic resonance phenomenon from an external wireless power transmitter. power can be transmitted.

Meanwhile, various embodiments below may be implemented in a computer-readable recording medium using, for example, software, hardware, or a combination thereof.

2 is a block diagram illustrating a multimedia device according to an embodiment of the present invention.

The multimedia device 200 according to an embodiment of the present invention is, for example, an intelligent network TV in which a computer support function is added to a broadcast reception function, and is a device to which an Internet function is added while being faithful to a broadcast reception function. For example, the multimedia device 200 may correspond to a network TV, a smart TV, a hybrid broadcast broadband television (HBBTV), an internet TV, a web TV, an Internet protocol television (IPTV), and the like. Also, the multimedia device 200 may include an HDMI port supporting the HDMI 2.0 version.

The multimedia device 200 includes a receiving unit 205 , an external device interface unit 235 , a memory 240 (storage unit), a display unit 280 , an audio output unit 286 , a power supply unit 290 , a control unit ( 270 ), a user interface unit 250 , a sensing unit 237 , and the like. According to an embodiment, the multimedia device 200 may further include a camera (not shown).

The receiver 205 may include at least one tuner 210 , a demodulator 220 , and a network interface unit 230 . However, in some cases, the receiver 205 includes the tuner 210 and the demodulator 220 , but may not include the network interface unit 230 , and vice versa. In addition, although not shown, the receiving unit 205 includes a multiplexer to multiplex the signal demodulated by the demodulator 220 through the tuner 210 and the signal received through the network interface unit 230 . You may. In addition, although not shown, the receiving unit 205 may include a demultiplexer to demultiplex the multiplexed signal or to demultiplex the demodulated signal or the signal that has passed through the network interface unit 230. .

The tuner 210 receives an RF broadcast signal by tuning a channel selected by a user or all channels previously stored among radio frequency (RF) broadcast signals received through an antenna. Also, the tuner 210 converts the received RF broadcast signal into an intermediate frequency (IF) signal or a baseband signal.

For example, if the received RF broadcast signal is a digital broadcast signal, it is converted into a digital IF signal (DIF), and if it is an analog broadcast signal, it is converted into an analog baseband image or audio signal (CVBS/SIF). That is, the tuner 210 may process both a digital broadcast signal and an analog broadcast signal. An analog baseband video or audio signal (CVBS/SIF) output from the tuner 210 may be directly input to the controller 270 .

Also, the tuner 210 may receive an RF broadcast signal of a single carrier or a multiple carrier. Meanwhile, the tuner 210 sequentially tunes and receives the RF broadcast signals of all broadcast channels stored through the channel storage function among the RF broadcast signals received through the antenna, and receives them as an intermediate frequency signal or a baseband signal (DIF: Digital Intermediate). frequency or baseband signal).

The demodulator 220 may receive and demodulate the digital IF signal DIF converted by the tuner 210 , and may perform channel decoding and the like. To this end, the demodulator 220 includes a trellis decoder, a de-interleaver, a Reed-Solomon decoder, or the like, or a convolution decoder, a deinterleaver and a read. - A Solomon decoder, etc. may be provided.

The demodulator 220 may output a stream signal TS after demodulation and channel decoding are performed. In this case, the stream signal may be a signal obtained by multiplexing an image signal, an audio signal, or a data signal. For example, the stream signal may be an MPEG-2 Transport Stream (TS) in which an MPEG-2 standard video signal, a Dolby AC-3 standard audio signal, etc. are multiplexed.

The stream signal output from the demodulator 220 may be input to the controller 270 . The controller 270 may control demultiplexing, image/audio signal processing, and the like, and may control output of an image through the display unit 280 and audio through the audio output unit 285 .

The external device interface unit 235 provides an interface environment between the multimedia device 200 and various external devices. To this end, the external device interface unit 235 may include an A/V input/output unit (not shown) or a wireless communication unit (not shown).

External device interface unit 235, DVD (Digital Versatile Disk), Blu-ray (Blu-ray), game device, camera, camcorder (Camcorder), computer (laptop), tablet PC, smart phone, Bluetooth device (Bluetooth) device) or an external device such as a cloud, and the like, may be connected via wired/wireless. The external device interface unit 235 transmits a signal including data such as an image, video, and voice input through a connected external device to the controller 270 of the multimedia device 200 . The controller 270 may control the processed image, video, audio, etc. to output a data signal to a connected external device. To this end, the external device interface unit 235 may further include an A/V input/output unit (not shown) or a wireless communication unit (not shown).

The A/V input/output unit includes a USB terminal, a CVBS (Composite Video Banking Sync) terminal, a component terminal, an S-video terminal (analog), It may include a Digital Visual Interface (DVI) terminal, a High Definition Multimedia Interface (HDMI) terminal, an RGB terminal, a D-SUB terminal, and the like.

The wireless communication unit may perform wireless communication with other digital devices. The multimedia device 200 is, for example, WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi (Wireless Fidelity) Direct, Bluetooth (Bluetooth), RFID (Radio Frequency Identification), infrared communication (IrDA) , Infrared Data Association), UWB (Ultra Wideband), ZigBee, and DLNA (Digital Living Network Alliance) can be networked with other digital devices according to communication protocols. According to an embodiment, the wireless communication unit may be a concept including the function of at least one configuration module among the network interface 230 , the external device interface unit 235 and the wireless communication unit.

In addition, the external device interface unit 235 may be connected to the set-top box (STB) and at least one of the above-described various terminals to perform input/output operations with the set-top-box (STB).

Meanwhile, the external device interface unit 235 may receive an application or an application list in an adjacent external device and transmit it to the controller 270 or the memory 240 .

The network interface unit 230 provides an interface for connecting the multimedia device 200 to a wired/wireless network including an Internet network. The network interface unit 230 may include, for example, an Ethernet terminal for connection with a wired network, and for connection with a wireless network, for example, a WLAN (Wireless LAN) (Wi- Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) communication standards, etc. can be used.

The network interface unit 230 may transmit or receive data with another user or another digital device through the connected network or another network linked to the connected network. In particular, some content data stored in the multimedia device 200 may be transmitted to a selected user or a selected digital device among other users or other digital devices registered in advance in the multimedia device 200 .

Meanwhile, the network interface unit 230 may access a predetermined web page through the connected network or another network linked to the connected network. That is, by accessing a predetermined web page through a network, it is possible to transmit or receive data with a corresponding server. In addition, content or data provided by a content provider or network operator may be received. That is, it is possible to receive content such as a movie, advertisement, game, VOD, and broadcast signal and information related thereto from a content provider or a network provider through a network. In addition, it is possible to receive firmware update information and an update file provided by a network operator. It may also transmit data to the Internet or to a content provider or network operator.

Also, the network interface unit 230 may select and receive a desired application from among applications open through a network.

The memory 240 may store a program for each signal processing and control in the controller 270 , or may store a signal-processed image, audio, or data signal.

Also, the memory 240 may perform a function for temporarily storing an image, audio, or data signal input from the external device interface unit 235 or the network interface unit 230 . The memory 240 may store information about a predetermined broadcast channel through a channel storage function.

The memory 240 may store an application or an application list input from the external device interface unit 235 or the network interface unit 230 .

In addition, the memory 240 may store various platforms to be described later.

The memory 240 is, for example, a flash memory type, a hard disk type, a multimedia card micro type, or a card type memory (eg, SD or XD memory). etc.), a RAM (RAM), and a ROM (EEPROM, etc.) may include at least one type of storage medium. The multimedia device 200 may reproduce content files (movie files, still image files, music files, document files, application files, etc.) stored in the memory 240 and provide them to the user. According to an embodiment, the memory 240 may be implemented by being included in the controller 270 .

The user interface unit 250 transmits a signal input by the user to the control unit 270 or transmits a signal of the control unit 270 to the user.

For example, the user interface unit 250 receives control signals such as power on/off, channel selection, and screen setting from the remote control device according to various communication methods such as an RF communication method and an infrared (IR) communication method. It may be processed or the control signal of the controller 270 may be transmitted to the remote control device.

According to an embodiment, the remote control device may be a remote controller or the mobile terminal 100 as described above with reference to FIG. 1 .

Also, the user interface unit 250 may transmit a control signal input from a local key (not shown) such as a power key, a channel key, a volume key, and a setting value to the control unit 270 .

The user interface unit 160 transmits a control signal input from a sensing unit (not shown) that senses a user's gesture to the control unit 270 or transmits a signal of the control unit 150 to the sensing unit ( not shown) can be transmitted. Here, the sensing unit (not shown) may include a touch sensor, a voice sensor, a position sensor, a motion sensor, and the like.

The controller 270 demultiplexes a stream input through the tuner 210 , the demodulator 220 , or the external device interface 235 or processes the demultiplexed signals to generate a signal for video or audio output. and output.

The image signal processed by the control unit 270 may be input to the display unit 280 and displayed as an image corresponding to the image signal. Also, the image signal processed by the control unit 270 may be input to an external output device through the external device interface unit 235 .

The controller 270 may include a demultiplexer, an image processor, and the like.

The controller 270 may control the overall operation of the multimedia device 200 . For example, the controller 270 may control the tuner 210 to tune an RF broadcast corresponding to a channel selected by the user or a pre-stored channel.

The controller 270 may control the multimedia device 200 according to a user command input through the user interface unit 250 or an internal program. In particular, by accessing a network, a user may download a desired application or an application list into the multimedia device 200 .

For example, the controller 270 controls the tuner 210 to input a signal of a selected channel according to a predetermined channel selection command received through the user interface unit 250 . And it processes the video, audio, or data signal of the selected channel. The control unit 270 enables the channel information selected by the user to be output through the display unit 280 or the audio output unit 285 together with the processed image or audio signal.

As another example, the control unit 270 may control an external device, for example, a camera or a camcorder, input through the external device interface unit 235 according to an external device image reproduction command received through the user interface unit 250 . , so that an image signal or an audio signal can be output through the display unit 280 or the audio output unit 285 .

Meanwhile, the controller 270 may control the display 280 to display an image. For example, a broadcast image input through the tuner 210 , an external input image input through the external device interface unit 235 , an image input through the network interface unit 230 , or the memory 140 . The stored image may be controlled to be displayed on the display unit 280 . In this case, the image displayed on the display unit 280 may be a still image or a moving image, and may be a 2D image or a 3D image.

Also, the controller 270 may control to reproduce the content. In this case, the content may be content stored in the multimedia device 200 , received broadcast content, or external input content input from the outside. The content may be at least one of a broadcast image, an external input image, an audio file, a still image, a connected web screen, and a document file.

Meanwhile, when entering the application view item, the controller 270 may control to display an application or an application list downloadable from an internal or external network of the multimedia device 200 .

The controller 270 may control to install and drive an application downloaded from an external network together with various user interfaces. In addition, by the user's selection, it is possible to control the display unit 280 to display an image related to the application being executed.

The display unit 280 converts the image signal, the data signal, the OSD signal processed by the controller 270, or the image signal and the data signal received from the external device interface unit 235 into R, G, and B signals, respectively. generate a drive signal.

The display unit 280 may be a PDP, LCD, OLED, flexible display, or 3D display.

Meanwhile, the display unit 280 may be configured as a touch screen and used as an input device in addition to an output device.

The audio output unit 285 receives a signal processed by the control unit 270 , for example, a stereo signal, a 3.1 channel signal, or a 5.1 channel signal, and outputs the audio signal. The audio output unit 285 may be implemented with various types of speakers.

Meanwhile, in order to detect a user's gesture, as described above, a sensing unit (not shown) including at least one of a touch sensor, a voice sensor, a position sensor, and a motion sensor may be further provided in the multimedia device 200 . . The signal sensed by the sensing unit (not shown) may be transmitted to the control unit 270 through the user interface unit 250 .

Meanwhile, a photographing unit (not shown) for photographing the user may be further provided. Image information captured by the photographing unit (not shown) may be input to the control unit 150 .

The controller 270 may detect a user's gesture by individually or in combination with an image captured by a photographing unit (not shown) or a signal sensed from a sensing unit (not shown).

The power supply unit 290 supplies the corresponding power throughout the multimedia device 200 .

In particular, to supply power to the control unit 270 that can be implemented in the form of a system on chip (SoC), the display unit 280 for displaying an image, and the audio output unit 285 for outputting audio. can

To this end, the power supply unit 290 may include a converter (not shown) that converts AC power into DC power. Meanwhile, for example, when the display unit 280 is implemented as a liquid crystal panel including a plurality of backlight lamps, an inverter capable of Pulse Width Modulation (PWM) operation for luminance variable or dimming driving (inverter) (not shown) may be further provided.

The remote control device transmits a user input to the user interface unit 250 . To this end, the remote control device may use Bluetooth, Radio Frequency (RF) communication, infrared (IR) communication, Ultra Wideband (UWB), ZigBee, or the like.

In addition, the remote control device may receive an image, audio, or data signal output from the user interface unit 250 , and display it on the remote control device or output voice or vibration.

The camera processes image frames such as still images or moving images obtained by the image sensor in the shooting mode. The processed image frame may be displayed on the display unit 280 or stored in the memory 240 .

The sensing unit 237 may sense at least one of information in the multimedia device 200 , information on a surrounding environment surrounding the multimedia device 200 , and user information. The sensing unit 237 may include at least one of a proximity sensor, an illuminance sensor, a camera, and an environmental sensor (eg, a barometer, a hygrometer, a thermometer, a radiation sensor, a heat sensor, a gas sensor, etc.). According to an embodiment, the sensing unit 237 may mean including a function of at least one of the network interface unit 4230 and the external device interface unit 235 .

The above-described multimedia device 200 may be a digital broadcast receiver capable of processing digital broadcast signals of a fixed or mobile ATSC method or a DVB method.

In addition, the display device according to the present invention may omit some of the illustrated components as needed, or may further include a non-illustrated component. Meanwhile, unlike the above, the display device does not include a tuner and a demodulator, and may receive and reproduce content through a network interface unit or an external device interface unit.

3 is a block diagram illustrating a detailed configuration of the control unit of FIG. 2 according to an embodiment of the present invention.

The controller 270 of the multimedia device 200 according to an embodiment of the present invention includes a demultiplexer 310 , an image processor 320 , an OSD generator 340 , a mixer 330 , and a frame rate. It may include a frame rate converter (FRC) 350 and a formatter 360 . In addition, although not shown, the control unit 270 may further include a voice processing unit and a data processing unit.

The demultiplexer 310 demultiplexes an input stream. For example, the demultiplexer 310 may demultiplex the input MPEG-2 TS video, audio, and data signals. Here, the stream signal input to the demultiplexer 310 may be a stream signal output from a tuner or demodulator or an external device interface unit.

The image processing unit 320 performs image processing of the demultiplexed image signal. To this end, the image processing unit 320 may include an image decoder 321 and a scaler 322 .

The image decoder 321 decodes the demultiplexed image signal, and the scaler 322 scales the resolution of the decoded image signal to be output on the display unit.

The video decoder 321 may support various standards. For example, the video decoder 321 performs the function of an MPEG-2 decoder when the video signal is encoded in the MPEG-2 standard, and when the video signal is encoded in the DMB (Digital Multimedia Broadcasting) method or the H.264 standard. In this case, the function of the H.264 decoder may be performed.

Meanwhile, the image signal decoded by the image processing unit 320 is input to the mixer 330 .

The OSD generator 340 generates OSD data according to a user input or by itself. For example, the OSD generator 340 generates data for displaying various data in the form of graphics or text on the screen of the display unit 280 based on the control signal of the user interface unit 250 . create The generated OSD data includes various data such as a user interface screen (eg, GUI) of the multimedia device 200, various menu screens, widgets, icons, and viewing rate information. do. The OSD generator 340 may generate data for displaying broadcast information based on a caption of a broadcast image or an EPG.

The mixer 330 mixes the OSD data generated by the OSD generator 340 and the image signal processed by the image processor and provides them to the formatter 360 . Because the decoded image signal and the OSD data are mixed, the OSD is overlaid and displayed on the broadcast image or the external input image.

The frame rate converter (FRC) 350 converts a frame rate of an input image. For example, the frame rate converter 350 may convert a frame rate of an input 60Hz image to have a frame rate of, for example, 120Hz or 240Hz according to an output frequency of the display unit. As described above, there may be various methods for converting the frame rate. For example, when the frame rate converter 350 converts the frame rate from 60 Hz to 120 Hz, the same first frame is inserted between the first frame and the second frame, or the first frame predicted from the first frame and the second frame It can be converted by inserting 3 frames. As another example, when converting the frame rate from 60 Hz to 240 Hz, the frame rate converter 350 may convert by inserting three more identical frames or predicted frames between existing frames. Meanwhile, when a separate frame conversion is not performed, the frame rate conversion unit 350 may be bypassed.

The formatter 360 changes the output of the input frame rate converter 350 to match the output format of the display unit. For example, the formatter 360 may output R, G, and B data signals, and these R, G, and B data signals are output as a low voltage differential signal (LVDS) or mini-LVDS. can be In addition, when the output of the input frame rate converter 350 is a 3D video signal, the formatter 360 configures and outputs a 3D form to match the output format of the display unit, thereby providing a 3D service through the display unit 280 . may support

Meanwhile, a voice processing unit (not shown) in the control unit 270 may perform voice processing of the demultiplexed voice signal. Such a voice processing unit (not shown) may support processing of various audio formats. For example, even when the audio signal is encoded in a format such as MPEG-2, MPEG-4, AAC, HE-AAC, AC-3, BSAC, it can be processed with a corresponding decoder.

In addition, a voice processing unit (not shown) in the controller 270 may process a base, a treble, and a volume control.

A data processing unit (not shown) in the control unit 270 may perform data processing of the demultiplexed data signal. For example, the data processing unit may decode the demultiplexed data signal even when it is encoded. Here, the encoded data signal may be EPG information including broadcast information such as start time and end time of a broadcast program aired on each channel.

Meanwhile, the above-described multimedia device 200 is an example according to the present invention, and each component may be integrated, added, or omitted according to the specifications of the actually implemented display device. That is, if necessary, two or more components may be combined into one component or one component may be subdivided into two or more components. In addition, the function performed in each block is for explaining the embodiment of the present invention, and the specific operation or device does not limit the scope of the present invention.

Hereinafter, with reference to FIGS. 4 to 17 , a method of providing notification information for each user in the multimedia device 200 according to embodiments of the present invention and a method of providing notification information for each user in the user's mobile terminal 100 through the multimedia device 200 according to embodiments of the present invention A method of providing notification information will be described.

4 is a flowchart illustrating an example of a method of providing notification information for each user in a multimedia device according to an embodiment of the present invention.

When the multimedia device 200 is turned off, the controller 270 of the multimedia device 200 may enter a standby mode and collect user information in the standby mode (S410). That the multimedia device 200 is turned off means that the multimedia device 200 is turned off according to a power off command from a user, and does not mean that no power is supplied to the multimedia device 200 . . The meaning that the multimedia device 200 has entered the standby mode means that standby power for maintaining a preset minimum function is being supplied to the multimedia device 200 when the power of the multimedia device 200 is turned off. can In this embodiment, the preset minimum function may mean a function of a configuration module required for the multimedia device 200 to provide preset notification information to a user.

When the multimedia device 200 enters the standby mode, the controller 270 of the multimedia device 200 may control the sensing unit 237 to acquire user information and distance information from the user. When the multimedia device 200 enters the standby mode, a portion of the sensing unit 237 necessary to acquire user information and distance information from the user may be maintained in an activated state.

For example, the sensing unit 237 may acquire information of the user by detecting a preset user's face from an image obtained by a camera included in the sensing unit 237, and the sensing unit 237 The user's information may be obtained by detecting an external device corresponding to a preset user using a wireless communication unit included in the .

Also, for example, the sensing unit 237 may acquire distance information with the user by detecting the size of a preset user included in an image obtained by a camera included in the sensing unit 237 and , by detecting the strength and delay time of a signal received from an external device corresponding to a preset user by using a wireless communication unit included in the sensing unit 237, the distance information with the user may be obtained, and the sensing unit Distance information with the user may be obtained by using the proximity sensor included in 237 .

According to an embodiment, the sensing unit 237 may acquire the user information and distance information from the user based on a signal received from an in-house gateway device (not shown). The gateway device is a device that connects in-house electronic devices with an external communication network, and may serve as a home environment controller for controlling in-house electronic devices. For example, in the signal received from the gateway device, user information/distance information obtained by the camera of the gateway device/distance information to the user, user information/distance information obtained by the wireless communication unit of the gateway device, etc. may include

In addition, the control unit 270 of the multimedia device 200 may recognize a user corresponding to the obtained user information based on the user information obtained through the sensing unit 237 in the standby mode. have.

The memory 240 of the multimedia device 200 may pre-store data necessary to identify a corresponding user based on the user information obtained by the sensing unit 237 .

Meanwhile, in the standby mode, the controller 270 of the multimedia device 200 may collect notification information from at least one of a broadcasting station, an external device, and an external server ( S420 ). For example, the control unit 270 of the multimedia device 200 through at least one of the tuner 210, the network interface unit 230, the external device interface unit 235, the sensing unit 237, the wireless communication unit, Notification information may be collected from at least one of a broadcasting station, an external device, and an external server. According to an embodiment, the collection of the notification information may be performed even before the multimedia device 200 enters the standby mode. According to an embodiment, the multimedia device 200 may receive notification information from the mobile terminal 100 when there is a mobile terminal 100 connected to the multimedia device 200 by wireless communication. For example, when the user of the mobile terminal 100 enters the house after going out, if there is historical information about the wireless communication connection between the mobile terminal 100 and the multimedia device 200, the mobile terminal 100 and the multimedia device 200 ) are automatically paired, and the multimedia device 200 may receive notification information from the mobile terminal 100 .

For example, the notification information includes program information included in a broadcast signal receivable through the tuner 210 or the network interface unit 230, a missed call received from the preset external mobile terminal 100, an unconfirmed text message, Information on schedules, etc., information on missed calls received from the home phone, information on home visitors acquired by the camera of the multimedia device 200 or the camera of the gateway device, and received from a preset external mobile terminal 100 It may include information on the received message, information on weather and traffic transmitted from an external server, and environmental information (eg: humidity, temperature, dust concentration, etc.) transmitted from an in-house electronic device. The controller 270 of the multimedia device 200 may classify the collected notification information for each pre-registered user and store it in the memory 240 .

The memory 240 of the multimedia device 200 includes data necessary for recognizing a user's face, viewing history information of a broadcast program viewed by the user through the multimedia device 200, and information on the mobile terminal 100 corresponding to the user. etc. may be stored.

The control unit 270 of the multimedia device 200, when a user recognized based on the acquired user information corresponds to a preset user and the acquired distance information with the user corresponds to a preset distance value, A partial area of the display unit 280 is activated (S430).

Then, the controller 270 of the multimedia device 200 displays the notification information corresponding to the recognized user among the collected notification information on a partial area of the activated display unit 280 (S440).

According to the present embodiment, when the user approaches the multimedia device 200 in a state in which the multimedia device 200 is turned off, by activating a partial area of the display unit 280 to output notification information corresponding to the user, multimedia There is an advantage in that it is possible to provide customized information for each user while efficiently using the power of the device 200 .

According to an embodiment, at least a part of the displayed notification information may vary according to the obtained value of the user's distance information. For example, when the value of the obtained user's distance information increases within a preset range, the volume of the displayed notification information decreases, and the obtained value of the user's distance information becomes small within a preset range. The amount of the displayed notification information may increase.

In addition, according to an embodiment, the displayed notification information may further include a menu option for checking detailed information, controlling an external device related to the notification information, or checking the notification information through a preset external device. may be The control unit 270 of the multimedia device 200, according to a command for selecting the menu option, activates a function of the multimedia device 200 for checking detailed information or is necessary for controlling an external device related to the notification information. A signal may be transmitted to a preset external device, or a signal necessary to check the notification information through the external device may be transmitted to a preset external device.

5 is a diagram for explaining an example of a method of providing notification information for each user in a multimedia device according to an embodiment of the present invention. A detailed description of the content overlapping with the above in relation to FIG. 4 will be omitted.

The controller 270 of the multimedia device 200 enters the standby mode when the multimedia device 200 is turned off. In addition, the control unit 270, the user recognized based on the user information obtained by the sensing unit 237 corresponds to a preset first user, and the distance information from the user acquired by the sensing unit 237 is preset When it corresponds to the distance value, the partial area 501 of the display unit 280 is activated, and among the collected notification information, the notification information 500 corresponding to the first user is displayed on the partial area 501 . can Here, the value of the preset distance may mean a value when the distance between the first user and the multimedia device 200 is within the preset distance.

For example, the notification information 500 displayed on the partial area 501 includes information on a missed call received from the mobile terminal 100 corresponding to the first user and information on a missed call received from a home phone. , information on a broadcast program preferred by the first user among broadcast programs currently being broadcast on the basis of information on the viewing history of the first user stored in the memory 240 .

According to an embodiment, the control unit 270 of the multimedia device 200 receives information from the mobile terminal 100 corresponding to the notification bar area on the top of the display unit 151 of the mobile terminal 100 and , information corresponding to the notification bar area may be displayed on the partial area 501 . For example, the configuration of information displayed on the partial area 501 may be similar to that of the notification bar area.

According to an embodiment, the notification information 500 may be implemented such that at least a part is selectable. Specifically, the notification information 500 displayed on the partial area 501 includes a menu option 511 for confirming detailed information of the notification information, and an external device related to the notification information (eg, movement of the first user). A menu option 512 for controlling the terminal 100), a menu option 513 for controlling a function of the multimedia device 200 corresponding to the notification information, and an external device (eg, the first At least one of menu options 514 for controlling the user's mobile terminal 100 may be included.

The first user may select the menu options 511 to 514 by using the remote controller or the mobile terminal 100 in which the remote function for controlling the multimedia device 200 is implemented.

For example, the control unit 270 of the multimedia device 200, based on the information on the missed call received from the mobile terminal 100 corresponding to the first user, according to the command to select the menu option 511, Detailed information on the caller number of the missed call, the caller of the missed call, and the reception time of the missed call may be displayed on the partial area 501 .

As another example, the control unit 270 of the multimedia device 200 transmits a first signal for transmitting a call signal to the calling number of a missed call according to a command for selecting the menu option 512 by the movement of the first user. It can be controlled to be transmitted to the terminal 100 . The first signal may be transmitted to the mobile terminal 100 through a wireless communication unit. The controller 180 of the mobile terminal 100 may control the mobile communication module 112 to transmit a call signal to the calling number of the missed call based on the first signal. According to an embodiment, when there are two or more missed calls, the first signal may correspond to a caller number corresponding to the last received missed call, a caller number corresponding to a missed call received more than a preset number of times, and the like.

As another example, the controller 270 of the multimedia device 200 may switch the power mode of the multimedia device 200 from the standby mode to the normal mode according to a command for selecting the menu option 513 . Here, the normal mode may mean a mode in which the multimedia device 200 is generally driven when the user turns on the power of the multimedia device 200 . In addition, the controller 270 of the multimedia device 200 controls the tuner 210 to tune the broadcast program included in the notification information 500 to a channel that is broadcasting, and broadcasts received through the tuner 210 . Video data corresponding to the broadcast program included in the signal may be output to the display unit 280 .

In another example, the controller 270 of the multimedia device 200 transmits a broadcast program included in the notification information 500 to the mobile terminal 100 of the first user according to a command for selecting the menu option 514 . ) may be controlled to transmit a second signal for viewing to the mobile terminal 100 of the first user. The controller 180 of the mobile terminal 100 activates a DMB application based on the second signal, receives video data corresponding to the broadcast program through the DMB application, and displays the received video data on the display unit. It can be displayed at (151).

According to an embodiment, the controller 270 of the multimedia device 200 receives distance information from the first user through the sensing unit 237 while the notification information 500 is displayed on the partial region 501 . When the re-obtained and re-obtained distance information with the first user deviates from the preset distance value, the output of the notification information 500 may be stopped and the partial region 501 may be inactivated.

Meanwhile, according to an embodiment of the present invention, when the multimedia device 200 is in the standby mode and the notification information 500 customized to the specific user is output on the display unit 280, the notification information 500 and The remote controller UI for controlling the function of the related multimedia device 200 may be automatically output to the preset mobile terminal 100 . This will be described with reference to FIG. 6 .

6 is a diagram for explaining an example of a case in which a remote controller UI for controlling notification information displayed on a multimedia device is output to a mobile terminal according to an embodiment of the present invention. A detailed description of the content overlapping with the above in relation to FIGS. 4 and 5 will be omitted.

When the notification information 500 is displayed on the activated partial area 501 of the display unit 280 , the controller 270 of the multimedia device 200 receives a first signal corresponding to the notification information 500 . The wireless communication unit may be controlled to transmit to the mobile terminal 100 of the first user. The first signal may include information on the multimedia device 500 and information on the remote controller UI related to a function for controlling the notification information 500 .

The controller 180 of the mobile terminal 100 executes a remote controller application based on the first signal, and displays a remote controller UI 600 related to a function for controlling the notification information 500 on the display unit ( 151) can be displayed. The remote controller UI 600 may be for controlling a function of the multimedia device 200 , or may be for controlling a function related to the notification information 500 among functions of the multimedia device 200 . The remote controller UI 600 may include a virtual menu button 610 corresponding to each function of the multimedia device 200 . A code value of a control signal corresponding to each function may be mapped to each menu button 610 .

The first user may select at least a part of the notification information 500 using the remote controller UI 600 output on the display unit 151 of the mobile terminal 100 . For example, the first user may select menu options 511 to 514 in the notification information 500 using the remote controller UI 600 output on the display unit 151 of the mobile terminal 100 . have.

The controller 180 of the mobile terminal 100 may transmit a code value of a control signal corresponding to a function selected using the remote controller UI 600 to the multimedia device 200 through the wireless communication unit 110 . In addition, the controller 270 of the multimedia device 200 may execute a corresponding function based on the received code value. Since the description of the function executed in the multimedia device is the same as that described above with reference to FIG. 5 , a detailed description thereof will be omitted.

7 is a diagram for explaining another example of a method of providing notification information for each user in a multimedia device according to an embodiment of the present invention. A detailed description of the content overlapping with the above in relation to FIGS. 4 to 6 will be omitted.

The controller 270 of the multimedia device 200 enters the standby mode when the multimedia device 200 is turned off. In addition, the control unit 270, the user recognized based on the user information obtained by the sensing unit 237 corresponds to a preset second user, and the distance information from the user acquired by the sensing unit 237 is preset When it corresponds to the distance value, the partial area 701 of the display unit 280 is activated, and the notification information 700 corresponding to the second user among the collected notification information is displayed on the partial area 501 . can

For example, the notification information 700 displayed on the partial area 501 may include information about a message received from the first mobile terminal 100A of the first user who is the guardian of the second user. The first user sends a preset message through the multimedia device 200 through the multimedia device 200 or the first mobile terminal 100A when the second user is recognized while the multimedia device 200 is in the standby mode. You can set it to print in advance.

According to an embodiment, the notification information 700 further includes a menu option 710 for connecting a call to the first mobile terminal 100A of the first user who has transmitted the message included in the notification information 700 . may include

The controller 270 of the multimedia device 200 transmits the information of the first mobile terminal 100A of the first user to the second mobile terminal 100B of the second user according to the command for selecting the menu option 710 . You can control the wireless communication unit to transmit to. The controller 180 of the second mobile terminal 100B controls the mobile communication module 112 to transmit a call signal to the first mobile terminal 100A based on the transmitted information of the first mobile terminal 100A. can be controlled

That is, according to an embodiment of the present invention, when the multimedia device 200 is in the standby mode, there is an advantage in that information customized for each recognized user can be provided.

On the other hand, according to an embodiment of the present invention, when the distance between the multimedia device 200 and the preset user is within the preset distance, if the preset user's gaze does not face the multimedia device, notification information may not be provided, If the distance between the multimedia device 200 and the preset user is out of the preset distance, but the preset user's gaze is directed toward the multimedia device, notification information may be provided. This will be described with reference to FIG. 8 .

8 is a diagram for explaining another example of a method of providing notification information for each user in a multimedia device according to an embodiment of the present invention. A detailed description of the content overlapping with the above in relation to FIGS. 4 to 7 will be omitted.

Referring to FIG. 8A , the controller 270 of the multimedia device 200 enters a standby mode when the multimedia device 200 is turned off. In addition, the control unit 270, the user recognized based on the user information obtained by the sensing unit 237 corresponds to a preset second user, and the distance information from the user acquired by the sensing unit 237 is preset When it corresponds to the distance value, a partial area 801 of the display unit 280 is activated, and first information 810 indicating that notification information corresponding to the second user exists is displayed in the first area 801 . ) can be displayed.

Then, the controller 270 of the multimedia device 200 activates the camera (in some embodiments, it is already activated), and based on the image acquired through the camera, the second user's gaze It is possible to detect whether it faces the 1 area 801 . When it is detected that the second user's gaze is facing the first area 801 , the controller 270 of the multimedia device 200 controls the second area 502 adjacent to the first area 801 . After activation, notification information 820 corresponding to the second user may be displayed in the activated first area 801 and the second area 802 .

According to an embodiment, a visual effect such that the notification information 820 extends from the first area 801 to the second area 802 and is displayed may be applied.

Since the description of the notification information 820 is similar to the notification information 700 described above with reference to FIG. 7 , a detailed description thereof will be omitted.

Meanwhile, when it is detected that the second user's gaze does not face the first area 801 , the control unit 270 of the multimedia device 200 deactivates the first area 801 after a preset time. can do.

According to an embodiment, the controller 270 of the multimedia device 200 outputs preset audio data to the audio output unit 285 when it is detected that the gaze of the second user does not face the first area 801 . ), it is also possible to draw the attention of the second user.

Meanwhile, according to an embodiment of the present invention, even when the multimedia device 200 operates in a normal mode, notification information for each user may be provided through the multimedia device 200 . This will be described with reference to FIG. 9 .

9 is a diagram for explaining another example of a method of providing notification information for each user in a multimedia device according to an embodiment of the present invention. A detailed description of the content overlapping with the above in relation to FIGS. 4 to 8 will be omitted.

In the present embodiment, it is assumed that the multimedia device 200 is in a normal mode rather than a standby mode, and video data 900 of a predetermined content is being output to the display unit 280 .

The control unit 270 of the multimedia device 200, while the video data 900 is being output to the display unit 280, the user recognized based on the user information obtained by the sensing unit 237 is a preset When the distance information corresponding to 1 user and obtained by the sensing unit 237 corresponds to a preset distance value, notification information corresponding to the first user is displayed on the partial area 901 of the display unit 280 . The first information 910 indicating the existence of may be displayed.

Then, the controller 270 of the multimedia device 200 activates the camera (in some embodiments, it is already activated), and based on an image obtained through the camera, the first user's gaze is changed to the part of the When it is detected that the user does not face the region 901, or when the first user's gaze is directed toward the partial region 901 based on an image obtained through the camera is less than a preset time, a preset time Afterwards, the first information 910 may disappear from the partial area 901 .

10 is a diagram for explaining another example of a method of providing notification information for each user in a multimedia device according to an embodiment of the present invention. A detailed description of the content overlapping with the above in relation to FIGS. 4 to 8 will be omitted.

The controller 270 of the multimedia device 200 enters the standby mode when the multimedia device 200 is turned off. In addition, the control unit 270, the user recognized based on the user information obtained by the sensing unit 237 corresponds to a preset first user, and the distance information from the user acquired by the sensing unit 237 is preset When it corresponds to the distance value, the partial area 1001 of the display unit 280 is activated, and the notification information 1000 corresponding to the first user among the collected notification information is displayed on the partial area 501 . can In this case, the controller 270 of the multimedia device 200 may extract notification information corresponding to the first user based on at least one of a current time, a current date, and a current day of the week from among the collected notification information.

As an example, if the current day of the week is a weekday and the current time corresponds to the attendance time preset by the first user, the control unit 270 of the multimedia device 200 is configured to allow the first user to use the collected notification information before going to work. It is possible to extract notification information suitable for , and display the extracted notification information 1000 on the partial area 501 . That is, the notification information 1000 may include weather information corresponding to the current time, the first user's today's schedule information, traffic information corresponding to the current time, and today's major news information.

As another example, when the current day of the week is Sunday and the current time corresponds to the morning time, the controller 270 of the multimedia device 200 selects notification information suitable for the first user to use on Sunday morning from among the collected notification information. extracted, and the extracted notification information may be displayed on the partial area 501 . Notification information suitable for the first user to use before going to work, notification information suitable for the first user to use on Sunday morning, etc. may be determined based on history information pre-stored in the memory 240 of the multimedia device 200 . Also, the determination may be made based on information (eg, schedule information) received from the mobile terminal 100 of the first user.

According to an embodiment, the notification information 1000 may be implemented such that at least a part of it is selectable. Specifically, the notification information 1000 displayed on the partial area 1001 may include checking detailed information of notification information, controlling a function of the multimedia device 200 corresponding to the notification information, or an external device related to notification information. It may include a menu option 1010 for controlling (eg, the mobile terminal 100 of the first user). Since the description related to the menu option 1010 is similar to that described above with reference to FIG. 5 , a detailed description thereof will be omitted.

On the other hand, according to an embodiment of the present invention, when the distance between the multimedia device 200 and the user is greater than a preset degree after the user-specific notification information is displayed on the multimedia device 200, the mobile terminal corresponding to the user ( 100), the notification information may be continuously provided. This will be described with reference to FIG. 11 .

11 illustrates an example of a method of continuously providing notification information through a user's mobile terminal according to the distance between the multimedia device and the user when notification information for each user is displayed on the multimedia device according to an embodiment of the present invention is a drawing for A detailed description of the content overlapping with the above in relation to FIGS. 4 to 11 will be omitted.

The controller 270 of the multimedia device 200 may output notification information corresponding to the recognized user to a partial area of the display 280 in the standby mode. Also, the controller 270 may periodically or aperiodically continuously sense the distance between the multimedia device 200 and the user through the sensing unit 237 .

When the distance between the multimedia device 200 and the user is out of a preset value, the control unit 270 of the multimedia device 200 is a first signal corresponding to the notification information output to a partial region of the display unit 280 . may be transmitted to the user's mobile terminal 100 through a wireless communication unit. The first signal may include the notification information, and may include access information necessary for the mobile terminal 100 to acquire the notification information, an acquisition method, an acquisition path, and the like.

The control unit 180 of the mobile terminal 100 displays a notification message 1110 for selecting whether or not to check the notification information through the mobile terminal 100 on the basis of the transmitted first signal. 151) can be displayed.

When the confirmation menu in the notification message 1110 is selected, the controller 180 of the mobile terminal 100 may display data corresponding to the notification information on the display unit 151 .

According to the present embodiment, when the user who has been provided with the notification information through the multimedia device 200 leaves home, the user convenience is emphasized by continuously providing the notification information through the mobile terminal 100 .

Meanwhile, according to an embodiment of the present invention, in outputting notification information for each user, the multimedia device 200 may output at least some different notification information according to the distance between the multimedia device 200 and the user. This will be described with reference to FIG. 12 .

12 is a diagram for explaining another example of a method of providing notification information for each user in a multimedia device according to an embodiment of the present invention. A detailed description of the content overlapping with the above in relation to FIGS. 4 to 11 will be omitted.

The controller 270 of the multimedia device 200 enters the standby mode when the multimedia device 200 is turned off. In addition, the control unit 270, the user recognized based on the user information obtained by the sensing unit 237 corresponds to a preset first user, and the distance information from the user acquired by the sensing unit 237 is preset When it corresponds to the distance value, the partial area 1201 of the display unit 280 may be activated and, among the collected notification information, notification information corresponding to the first user may be displayed on the partial area 1201 . At least a portion of the displayed notification information may vary according to the obtained value of the user's distance information. For example, when the value of the obtained user's distance information increases within a preset range, the volume of the displayed notification information decreases, and the obtained value of the user's distance information becomes small within a preset range. The amount of the displayed notification information may increase. In this embodiment, it is assumed that the displayed notification information is today's weather information.

As an example, referring to FIG. 12A , the controller 270 of the multimedia device 200 may include, when the value of the user's distance information is greater than a first reference within the preset range, the first notification information 1210 may be displayed on the partial area 1201 . The first notification information 1210 may correspond to information corresponding to today's overall average weather.

As another example, referring to (b) of FIG. 12 , the controller 270 of the multimedia device 200, when the value of the distance information of the user is less than the first criterion within the preset range, a second notification Information 1220 may be displayed on the partial area 1201 . The second notification information 1220 may correspond to detailed weather information for each time of the day.

According to the present embodiment, detailed information may be provided as the distance between the multimedia device 200 and the user increases, and brief information may be provided as the distance between the multimedia device 200 and the user increases.

Meanwhile, according to an embodiment of the present invention, when outputting notification information for each user, the multimedia device 200 may output the notification information with reference to information obtained from the user's image. This will be described with reference to FIG. 13 .

13 is a diagram for explaining an example of a method of outputting notification information with reference to information obtained from an image of a user in a multimedia device according to an embodiment of the present invention. A detailed description of the content overlapping with the above in relation to FIGS. 4 to 12 will be omitted.

The controller 270 of the multimedia device 200 enters the standby mode when the multimedia device 200 is turned off. In addition, the control unit 270, the user recognized based on the user information obtained by the sensing unit 237 corresponds to a preset first user, and the distance information from the user acquired by the sensing unit 237 is preset When it corresponds to the distance value, the partial area 1301 of the display unit 280 is activated, and the notification information 1310 corresponding to the first user among the collected notification information is displayed on the partial area 1301. can At this time, the controller 270 of the multimedia device 200 extracts the notification information 1310 based on information obtained from the image of the first user from among the information corresponding to the first user included in the collected notification information. can do. The image of the first user may be obtained by a camera built in the multimedia device 200 , obtained by a camera provided in the in-house gateway device, and the obtained image is transmitted to the multimedia device 200 . it may be

For example, when it is determined that the current weather corresponds to rainy weather and the first user does not hold an umbrella based on the image of the first user, the control unit 270 of the multimedia device 200 provides the umbrella to the first user. Notification information 1310 including information for reminding of and current weather information may be displayed on the partial area 1301 . The controller 270 of the multimedia device 200 may determine whether an umbrella is present in the image of the first user by using an object detection method and an edge detection method.

Meanwhile, according to an embodiment of the present invention, the user may set and control the environment of each space in the house through notification information provided through the multimedia device. This will be described with reference to FIG. 14 .

14 is a diagram for explaining another example of a method of providing notification information for each user in a multimedia device according to an embodiment of the present invention. A detailed description of the content overlapping with the above in relation to FIGS. 4 to 13 will be omitted.

The controller 270 of the multimedia device 200 enters the standby mode when the multimedia device 200 is turned off. In addition, the control unit 270, the user recognized based on the user information obtained by the sensing unit 237 corresponds to a preset first user, and the distance information from the user acquired by the sensing unit 237 is preset When it corresponds to the distance value, the partial area 1401 of the display unit 280 is activated, and among the collected notification information, the notification information 1400 corresponding to the first user is displayed on the partial area 1401. can

In the present embodiment, the notification information 1400 includes environmental information (Ex: humidity, temperature, dust concentration, CO ₂ concentration, etc.) or indoor electronics based on data sensed by the sensing unit 237 of the multimedia device 200 . It may include environment information transmitted from the device.

According to an embodiment, the notification information 1400 may include a menu option 1410 for changing the setting of the home environment to the recommended environment. The control unit 270 of the multimedia device 200, according to a command for selecting the menu option 1410, is a control signal necessary to change the indoor environment to a preset recommended environment (eg, corresponding to a preset environment setting value). signal) may be transmitted to an in-house electronic device. Alternatively, the controller 270 of the multimedia device 200 transmits a signal necessary for changing the in-house environment to a preset recommended environment to the in-house gateway device according to a command for selecting the menu option 1410, and the gateway device A control signal necessary for changing the in-house environment to a preset recommended environment may be transmitted to the in-house electronic device through . Here, the indoor electronic device may be a humidifier, a dehumidifier, a boiler, an air purifier, or the like.

In addition, according to an embodiment, the notification information 1400 is a menu for changing a setting of an environment of an indoor space (a first user's room) corresponding to the first user to a recommended environment or an environment preferred by the first user Option 1420 may be included. The controller 270 of the multimedia device 200 sets the indoor space corresponding to the first user as a preset recommended environment or a pre-stored preferred environment of the first user according to a command for selecting the menu option 1420 A control signal for changing may be controlled to be transmitted to an electronic device existing in an indoor space corresponding to the first user.

Also, according to an embodiment, the notification information 1400 may include a GUI 1430 for changing environment settings of various spaces in the house, respectively. For example, the GUI 1430 may include graphic images for several spaces in the house, and may include user information corresponding to each space. Also, the GUI 1430 may include menu options 1431 and 1432 for setting the environment of each space. The first user may control the environment for each space or change the environment setting value through the menu options 1431 and 1432 in the GUI 1430 .

Meanwhile, according to an embodiment of the present invention, customized information for each user may be provided based on the history information for each user using the multimedia device. This will be described with reference to FIGS. 15 and 16 .

15 and 16 are diagrams for explaining an example of a method of providing customized information for each user based on history information for each user using a multimedia device according to an embodiment of the present invention.

The controller 270 of the multimedia device 200 displays video data of a broadcast program included in the broadcast signal received by the receiver 205 on the display 280 . Meanwhile, the sensing unit 237 senses information of a user who views the broadcasting program while the video data of the broadcasting program is displayed on the display unit 280 . Here, the user's information definition and sensing method are similar to those described above with reference to FIG. 4 , and thus a detailed description thereof will be omitted.

In addition, the controller 270 of the multimedia device 200 stores the sensed user information in the memory 240 in response to the broadcast program. After reception of a broadcast signal corresponding to the broadcast program is completed, the control unit 270 of the multimedia device 200 is configured to receive video data of the same broadcast program as the broadcast program (ie, a broadcast program having the same name as the broadcast program). When 1510 is displayed again through the display unit 280, the user's information who watches the broadcast program is sensed again, and when the sensed user's information is different from the user's information stored in the memory 240, A signal for providing a notification may be controlled to be transmitted to a preset external device.

For example, in the embodiment of FIG. 15 , based on user information sensed by the sensing unit 237 , the broadcast program is transmitted to a first user (User 1), a second user (User 2), and a second user (User). It is assumed that 3) is the one you enjoy watching. Accordingly, the memory 240 may store viewing history information of the first to third users in response to the broadcast program.

Referring to (a) of FIG. 15 , the control unit 270 of the multimedia device 200 includes a third user (User 3) corresponding to the user information stored in the memory 240 in the re-sensed user information. When the information on the broadcast program is not included, it is possible to control so that a first signal for providing a notification about the broadcast program is transmitted to the mobile terminal 100 corresponding to the third user. Referring to FIG. 15B , the controller 180 of the mobile terminal 100 displays a notification message 1520 including notification information about the broadcast program on the display unit 151 based on the first signal. ) can be displayed. For example, the notification message 1520 includes a first menu option 1521 for viewing the broadcast program through the DMB application and a second menu option for recording the broadcast program through the multimedia device 200 ( 1522) may include at least one of. The controller 180 of the mobile terminal 100 executes a DMB application according to a command for selecting the first menu option 1510 and displays video data corresponding to the broadcast program received through the DMB application on the display unit. It can be displayed at (151). The controller 180 of the mobile terminal 100 may transmit a signal corresponding to the command for recording the broadcast program to the multimedia device 200 according to a command for selecting the second menu option 1522 . According to this embodiment, when the user who was watching a specific broadcast program through the multimedia device 200 is not watching the specific broadcast program, notification information about the specific program is provided to the user's mobile terminal 100 . can do it

As another example, in the embodiment of FIG. 16 , it is assumed that the first user (User 1) and the second user (User 2) enjoy watching the broadcast program based on the user information sensed by the sensing unit 237 . Assume Accordingly, the memory 240 may store viewing history information of the first user and the second user in response to the broadcast program.

Referring to (a) of FIG. 16 , the control unit 270 of the multimedia device 200 may include information of a third user that does not correspond to the user information stored in the memory 240 in the re-sensed user information. If included, detects viewing history information of a broadcast program corresponding to the third user from viewing history information of a broadcast program for each user stored in the memory 240 , and a broadcast program corresponding to the detected viewing history information It is possible to control so that the second signal including the information of the third user is transmitted to the mobile terminal 100 of the third user. Referring to FIG. 16 (b), the controller 180 of the mobile terminal 100, based on the second signal, a notification message including information on a broadcast program corresponding to the detected viewing history information ( 1530 may be displayed on the display unit 151 . The notification message 1530 may include information on other channels, other sources, etc. that output a broadcast program that the third user enjoys watching. For example, the notification message 1530 may include a first menu option 1531 for viewing a broadcast program that a third user likes to watch through a DMB application, and a first menu option 1531 for viewing a broadcast program that the third user likes to watch on a multimedia device ( 200) may include at least one of a second menu option 1532 for recording and a third menu option 1533 for viewing a broadcast program that a third user likes to watch through another multimedia device in the house.

Meanwhile, according to an embodiment of the present invention, a function of an in-house electronic device may be controlled through the multimedia device. This will be described with reference to FIG. 17 .

17 is a diagram for explaining an example of a method for controlling a function of an in-house electronic device through a multimedia device according to an embodiment of the present invention.

Referring to FIG. 17A , the display unit 280 of the multimedia device 200 displays video data 1700 corresponding to a predetermined content. The control unit 270 of the multimedia device 200, while the video data 1700 is being displayed, based on the image acquired through the camera included in the sensing unit 237, the user watching the predetermined content can detect the gaze of

Based on the image, the control unit 270 determines that the user's gaze, who was facing the video data 1700, is out of the video data 1700 and is facing the indoor electronic device (eg, the light 1710). can detect. For example, the controller 270 may detect that the user's gaze is directed toward the light 1710 based on the user's eyes and the light 1710 included in the image. In addition, the controller 270 may detect that the user's gaze moves from the lighting 1710 back to the video data 1700 .

Referring to (b) of FIG. 17 , the controller 270 moves the user's gaze from the video data 1700 toward the light 1710 and then moves from the light 1710 to the video data 1700 again. In this case, a GUI 1720 for controlling a function (eg, a brightness control function) of the light 1710 may be displayed on the display unit 280 . The GUI 1720 may include an indicator 1721 for adjusting the brightness of the lighting 1710 . The user may control the brightness of the lighting 1710 by moving the indicator 1721 of the GUI 1710 through the remote controller or the mobile terminal 100 capable of controlling the multimedia device 200 . For example, the user may increase/down the brightness of the light 1710 by using a volume up/down button or a channel up/down button included in the remote controller. The controller 270 may control a signal for controlling the brightness of the lighting 1710 to be transmitted to the lighting 1710 based on a signal received from the remote controller or the mobile terminal 100 .

According to an embodiment, when the value of the brightness of the light 1710 preferred by the user is pre-stored, the controller 180 of the multimedia device 200 selects the user based on the data sensed by the sensing unit 237 . It is also possible to identify and automatically control the brightness of the light 1710 according to the value of the brightness preferred by the identified user.

According to the above-described embodiments of the present invention, it is possible to provide a multimedia device capable of providing customized information for each user when the multimedia device is in the standby mode. In addition, a multimedia device capable of providing customized information for each user when the multimedia device is in an on state may be provided.

The present invention described above can be implemented as computer-readable codes on a medium in which a program is recorded. The computer-readable medium includes all types of recording devices in which data readable by a computer system is stored. Examples of computer-readable media include Hard Disk Drive (HDD), Solid State Disk (SSD), Silicon Disk Drive (SDD), ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc. There is also a carrier wave (eg, transmission over the Internet) that is implemented in the form of. In addition, the computer may include the above-described control unit. Accordingly, the above detailed description should not be construed as restrictive in all respects but as exemplary. The scope of the present invention should be determined by a reasonable interpretation of the appended claims, and all modifications within the equivalent scope of the present invention are included in the scope of the present invention.

100: mobile terminal
200: multimedia device

Claims (11)

A multimedia device comprising:
a notification information collecting unit for collecting notification information from at least one of a broadcasting station, an external device, and an external server when the multimedia device enters a standby mode;
a sensing unit configured to obtain user information of a user and distance information from the user when the multimedia device enters a standby mode;
a memory for storing user information of a preset user and a preset distance value;
display unit; and
A control unit for controlling the display based on the obtained user information, the obtained distance information, and the collected notification information,
The sensing unit,
A wireless communication unit for recognizing an external device to obtain the user information and the distance information,
The control unit is
When the multimedia device is turned off, it enters a standby mode,
When the acquired user information corresponds to the preset user information and the acquired distance information to the user corresponds to the preset distance value, a partial region of the display unit is activated, and the collected notification information Displaying notification information corresponding to the recognized user in the activated partial area, a multimedia device. The method of claim 1,
At least a part of the notification information displayed on the activated partial area varies according to the obtained value of the user's distance information. The method of claim 1,
The control unit, according to a command for selecting at least one of the notification information displayed on the activated partial region, controls the signal corresponding to the selected notification information to be transmitted to an external device corresponding to the recognized user, a multimedia device . The method of claim 1,
The control unit is
Controls the sensing unit to re-acquire distance information with the user while the notification information corresponding to the recognized user is displayed,
When the re-obtained distance information with the user is out of a value of the preset distance, the multimedia device stops displaying notification information corresponding to the recognized user and inactivates the activated partial area. The method of claim 1,
The sensing unit is made to include a camera for sensing the user's gaze,
The control unit is
When a user recognized based on the acquired user information corresponds to a preset user and the acquired distance information to the user corresponds to a preset distance value, a first area of the display unit is activated, and notification information Displaying first information for providing in the first area,
When it is sensed by the camera that the user's gaze is facing the first area, a second area in contact with the first area is activated, and notification information corresponding to the recognized user among the collected notification information is displayed. The multimedia device is displayed in the first area and the second area. The method of claim 1,
The sensing unit is made to include a camera for sensing the user's gaze,
The control unit is
When a user recognized based on the acquired user information corresponds to a preset user and the acquired distance information to the user corresponds to a preset distance value, the first area of the display unit is activated, and the user Displaying first information for indicating that there is notification information corresponding to the in the first area,
If it is sensed by the camera that the gaze of the user is not toward the first area within a preset time, inactivating the first area, the multimedia device. The method of claim 1,
The notification information displayed on the activated partial area varies according to at least one of a current time, a current date, a current season, and a current day of the week. The method of claim 1,
The notification information displayed on the activated partial area includes a menu option for setting an environment of a preset space,
The controller, in response to a command for selecting the menu option, controls the signal corresponding to the environment setting value of the preset space to be transmitted to a preset external device, the multimedia device. The method of claim 1,
The control unit is a multimedia device, characterized in that by detecting the strength, delay time, etc. of a signal received from an external device corresponding to the preset user through the wireless communication unit, to obtain information about the distance to the user. delete delete

Images