KR20170081454A - Display device and operating method thereof - Google Patents

Display device and operating method thereof Download PDF

Info

Publication number
KR20170081454A
KR20170081454A KR1020160000525A KR20160000525A KR20170081454A KR 20170081454 A KR20170081454 A KR 20170081454A KR 1020160000525 A KR1020160000525 A KR 1020160000525A KR 20160000525 A KR20160000525 A KR 20160000525A KR 20170081454 A KR20170081454 A KR 20170081454A
Authority
KR
South Korea
Prior art keywords
screen
mobile terminal
display device
display
unit
Prior art date
Application number
KR1020160000525A
Other languages
Korean (ko)
Inventor
미쉬라 아준프라사드
제인 가우라브
티와리 아쉬쉬
Original Assignee
엘지전자 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 엘지전자 주식회사 filed Critical 엘지전자 주식회사
Priority to KR1020160000525A priority Critical patent/KR20170081454A/en
Publication of KR20170081454A publication Critical patent/KR20170081454A/en

Links

Images

Classifications

    • H04N21/42219—
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • H04M1/7253—
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/42208—Display device provided on the remote control
    • H04N21/42209—Display device provided on the remote control for displaying non-command information, e.g. electronic program guide [EPG], e-mail, messages or a second television channel
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/42212—Specific keyboard arrangements
    • H04N21/42218—Specific keyboard arrangements for mapping a matrix of displayed objects on the screen to the numerical key-matrix of the remote control
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H04N21/43637—Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

The display device according to an embodiment of the present invention includes a mobile terminal connected to the display device, a local communication unit for performing a screen mirroring function, a display unit for displaying media content received from the mobile terminal through the screen mirroring function, And a control unit for controlling a screen of the display unit based on at least one of a screen viewing state of the mobile terminal and a screen state of the mobile terminal, .

Description

DISPLAY APPARATUS AND OPERATING METHOD THEREOF

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a display device, and more particularly, to an invention related to controlling a screen of a display device on the basis of a screen appearance state of a user or a screen state of a mobile terminal connected to the display device.

Digital TV services using wired or wireless communication networks are becoming popular. The digital TV service can provide various services that can not be provided by the existing analog broadcasting service.

For example, in the case of IPTV (Internet Protocol Television), a smart TV service, which is a kind of digital TV service, a bidirectionality is provided so that a user can actively select a type of viewing program and a viewing time. IPTV and smart TV services can provide various additional services such as Internet search, home shopping, online games and the like based on the bidirectionality.

Also, in recent years, a display device such as a TV can provide a screen mirroring function that displays the screen of a mobile terminal, such as a smart phone, as it is.

However, in order to stop the screen mirroring function, the user has to disconnect the display device through a separate stop button provided on the mobile terminal, and to reconnect the screen, the user has to go through the procedure again for screen mirroring.

Further, when a screen mirroring function is performed through a plurality of mobile terminals, it is difficult to operate the divided screens.

Also, during the screen mirroring, when the mobile terminal receives the alarm, the received alarm is displayed on the display device as it is, which prevents the user from watching the media content.

An object of the present invention is to provide a display device capable of automatically stopping or returning a screen mirroring function based on one of a screen viewing state of a screen of a display device of a user and a screen state of the mobile terminal.

Another object of the present invention is to provide a display device capable of controlling a screen of a display device by directing a screen of a mobile terminal when a screen mirroring function is performed through a plurality of mobile terminals.

It is another object of the present invention to provide a display device that prevents a display device from displaying an alarm of a mobile terminal during a screen mirroring function.

The display device according to an embodiment of the present invention includes a mobile terminal connected to the display device, a local communication unit for performing a screen mirroring function, a display unit for displaying media content received from the mobile terminal through the screen mirroring function, And a control unit for controlling a screen of the display unit based on at least one of a screen viewing state of the mobile terminal and a screen state of the mobile terminal, .

Wherein the control unit stops the screen mirroring function with the mobile terminal when the screen of the mobile terminal is in a screen oriented state toward the ground and displays the displayed media content through the display unit before performing the screen mirroring function .

If the user does not look at the screen of the display unit for a predetermined time, the controller stops the screen mirroring function with the mobile terminal and displays the displayed media content through the display unit before performing the screen mirroring function have.

The control unit may control the display unit to not display the media content by an area corresponding to a part of the hidden screen when a part of the entire screen of the mobile terminal is covered.

Wherein the control unit displays the alarm information received by the mobile terminal during the screen mirroring function and displays the alarm information displayed on the display unit through the display unit when the alarm information displayed on the screen of the mobile terminal is hidden. Can be controlled.

The control unit may control the display unit to display the media content and the media content received from the other mobile terminal on a divided screen by performing the screen mirroring function with the mobile terminal and another mobile terminal.

Wherein the control unit displays the media content received from the mobile terminal in a full screen mode without displaying the media content received from the other mobile terminal when the screen of the other mobile terminal is in a screen oriented state toward the ground, Can be controlled.

Wherein the control unit displays the media content received from the other mobile terminal in the form of an icon when the screen of the other mobile terminal is in a screen oriented state toward the ground and displays the received media content on a full screen The display unit can be controlled so as to display it.

The display device may further include a camera for detecting a state of the screen.

The control unit may receive information on a screen state of the mobile terminal from the mobile terminal through the local communication unit.

According to various embodiments of the present invention, the user can automatically stop or return the screen mirroring function without going through a complicated process for releasing the screen mirroring function.

In addition, according to the present invention, a user can easily control the screen of a display device only by directing the screen of the mobile terminal.

In addition, the user may not be disturbed by the viewing of the media content due to the alarm of the mobile terminal during the execution of the screen mirroring function.

1 is a block diagram illustrating a configuration of a display apparatus according to an embodiment of the present invention.
2 is a block diagram of a remote control device according to an embodiment of the present invention.
3 shows an example of an actual configuration of a remote control apparatus according to an embodiment of the present invention.
4 shows an example of utilizing a remote control device according to an embodiment of the present invention.
5 is a ladder diagram for a method of operating a system according to an embodiment of the present invention.
6A to 6C are views for explaining an example of controlling a screen of a display device based on at least one of a screen viewing state of a user and a screen state of a mobile terminal according to an embodiment of the present invention.
7A and 7B are views illustrating an example of controlling a screen of a display device based on a screen viewing state of a user and a screen state of a mobile terminal according to another embodiment of the present invention.
In FIGS. 7A and 7B, it is assumed that the user is in a screen-gazing state where the user is looking at the screen of the display device 100.
8A to 8E are views for explaining an example of controlling a screen of a display device based on a screen state of a mobile terminal according to another embodiment of the present invention.
9A and 9B are views illustrating an example of controlling a screen of a display device based on a screen state of a mobile terminal according to another embodiment of the present invention.
10A and 10B are views illustrating an example of controlling a screen of a display device based on a screen state of a mobile terminal according to another embodiment of the present invention.
11A to 11C are views for explaining an example of controlling a screen of a display device based on a screen state of a mobile terminal according to another embodiment of the present invention.

Hereinafter, embodiments related to the present invention will be described in detail with reference to the drawings. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The display device according to the embodiment of the present invention is an intelligent display device that adds a computer support function to a broadcast reception function, for example, and is equipped with a function of inputting a handwriting, a touch screen Or an interface that is more convenient to use than a space remote controller or the like. Also, it can be connected to the Internet and a computer by the support of a wired or wireless Internet function, and can perform functions such as e-mail, web browsing, banking or game. A standardized general-purpose OS can be used for these various functions.

Therefore, the display device described in the present invention can freely add or delete various applications, for example, on a general-purpose OS kernel, so that various user-friendly functions can be performed. More specifically, the display device may be, for example, a network TV, an HBBTV, a smart TV, an LED TV, an OLED TV, or the like, and may be applied to a smartphone as the case may be.

1 is a block diagram illustrating a configuration of a display apparatus according to an embodiment of the present invention.

1, the display apparatus 100 includes a broadcast receiving unit 130, an external device interface unit 135, a storage unit 140, a user input interface unit 150, a control unit 170, a local communication unit 173, A display unit 180, an audio output unit 185, and a power supply unit 190.

The broadcast receiving unit 130 may include a tuner 131, a demodulation unit 132, and a network interface unit 133.

The tuner 131 can tune to a specific broadcast channel according to the channel tuning command. The tuner 131 may receive a broadcast signal for the selected broadcast channel.

The demodulator 132 can separate the received broadcast signal into a video signal, an audio signal, and a data signal related to a broadcast program, and can restore the separated video signal, audio signal, and data signal into a form capable of outputting.

The external device interface unit 135 may receive an application or application list in an adjacent external device and may transmit the received application or application list to the control unit 170 or the storage unit 140.

The external device interface unit 135 may provide a connection path between the display device 100 and an external device. The external device interface unit 135 may receive at least one of video and audio output from an external device connected to the display device 100 wirelessly or by wire, and may transmit the received video and audio to the controller 170. The external device interface unit 135 may include a plurality of external input terminals. The plurality of external input terminals may include an RGB terminal, one or more HDMI (High Definition Multimedia Interface) terminals, and a component terminal.

The video signal of the external device input through the external device interface unit 135 may be output through the display unit 180. [ The audio signal of the external device input through the external device interface unit 135 may be output through the audio output unit 185. [

The external device that can be connected to the external device interface unit 135 may be any one of a set top box, a Blu-ray player, a DVD player, a game machine, a sound bar, a smart phone, a PC, a USB memory and a home theater, .

The network interface unit 133 may provide an interface for connecting the display device 100 to a wired / wireless network including the Internet network. The network interface unit 133 can transmit or receive data to another user or another electronic device via the network connected thereto or another network linked to the connected network.

In addition, some content data stored in the display device 100 can be transmitted to another user registered in the display device 100 or a selected one of the other electronic devices or selected electronic devices.

The network interface unit 133 can access a predetermined web page through the connected network or another network linked to the connected network. That is, it is possible to access a predetermined web page through a network and transmit or receive data with the server.

The network interface unit 133 may receive content or data provided by the content provider or the network operator. That is, the network interface unit 133 can receive contents such as a movie, an advertisement, a game, a VOD, a broadcast signal, and related information provided from a content provider or a network provider through a network.

In addition, the network interface unit 133 can receive update information and an update file of the firmware provided by the network operator, and can transmit data to the Internet or a content provider or a network operator.

The network interface unit 133 can select and receive a desired application among applications open to the public via the network.

The storage unit 140 stores programs for signal processing and control in the controller 170, and can store image-processed video, audio, or data signals.

The storage unit 140 may perform a function for temporarily storing video, audio, or data signals input from the external device interface unit 135 or the network interface unit 133, It may also store information about the image.

The storage unit 140 may store a list of applications or applications input from the external device interface unit 135 or the network interface unit 133. [

The display apparatus 100 may reproduce and provide a content file (a moving picture file, a still picture file, a music file, a document file, an application file, etc.) stored in the storage unit 140 to a user.

The user input interface unit 150 may transmit a signal input by the user to the control unit 170 or may transmit a signal from the control unit 170 to the user. For example, the user input interface unit 150 may be implemented by various communication methods such as Bluetooth, Ultra Wideband (WB), ZigBee, RF (Radio Frequency) communication, and infrared (IR) It is possible to receive and process control signals such as power on / off, channel selection, screen setting, and the like from the remote control device 200, or transmit control signals from the control unit 170 to the remote control device 200. [

The user input interface unit 150 may transmit a control signal input from a local key (not shown) such as a power key, a channel key, a volume key, and a set value to the controller 170.

The video signal processed by the controller 170 may be input to the display unit 180 and displayed as an image corresponding to the video signal. The video signal processed by the controller 170 may be input to the external output device through the external device interface 135. [

The audio signal processed by the control unit 170 may be output to the audio output unit 185 through audio. The voice signal processed by the control unit 170 may be input to the external output device through the external device interface unit 135.

In addition, the control unit 170 can control the overall operation in the display device 100. [

The control unit 170 may control the display device 100 according to a user command or an internal program input through the user input interface unit 150. The control unit 170 accesses the network and displays a list of applications or applications desired by the user, So that it can be downloaded into the portable terminal 100.

The control unit 170 can output the video or audio signal processed through the channel information selected by the user through the display unit 180 or the audio output unit 185.

The control unit 170 controls the operation of the external device through the external device interface unit 135 according to an external device video playback command received through the user input interface unit 150. For example, So that a video signal or a voice signal can be output through the display unit 180 or the audio output unit 185.

The control unit 170 may control the display unit 180 to display an image and may output the broadcast image input through the tuner 131 or the external input through the external device interface unit 135, The image input through the network interface unit or the image stored in the storage unit 140 may be displayed on the display unit 180. [ In this case, the image displayed on the display unit 180 may be a still image or a moving image, and may be a 2D image or a 3D image.

In addition, the controller 170 may control the content stored in the display device 100, the received broadcast content, or external input content input from the outside to be reproduced, and the content may be a broadcast image, an external input image, , A still image, a connected web screen, and a document file.

The local communication unit 173 can perform communication with an external device through wired or wireless communication. The short range communication unit 173 can perform short range communication with an external device. To this end, the short-range communication unit 173 is connected to the short-range communication unit 173 via Bluetooth, a Radio Frequency Identification (RFID), an Infrared Data Association (IrDA), an Ultra Wide Band (UWB), a ZigBee, (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technology. The local communication unit 173 may communicate with the display device 100 and the wireless communication system through the wireless area networks or between the display device 100 and the other display device 100 or between the display device 100 and the display device 100. [ And can support wireless communication between networks in which the display device 100 (or an external server) is located. The short-range wireless communication network may be a short-range wireless personal area network.

Here, the other display device 100 is a wearable device (e.g., a smartwatch, smart glass, etc.) capable of interchanging data with the display device 100 according to the present invention a smart glass, an HMD (head mounted display), or a smart phone. The local communication unit 173 can detect (or recognize) the wearable device capable of communicating with the periphery of the display device 100. [ Further, when the detected wearable device is a device authenticated to communicate with the display device 100 according to the present invention, the control unit 170 transmits at least a part of the data processed by the display device 100 to the local communication unit 173 To the wearable device. Therefore, the user of the wearable device can use the data processed in the display device 100 through the wearable device.

The local communication unit 173 may be included in the user input interface unit 150.

The display unit 180 converts the video signal, the data signal, the OSD signal, the video signal, the data signal, and the like received from the external device interface unit 135 into R, G, and B signals, respectively, Signal can be generated.

On the other hand, the display device 100 shown in FIG. 1 is only an embodiment of the present invention. Some of the components shown may be integrated, added, or omitted depending on the specifications of the display device 100 actually implemented.

That is, two or more constituent elements may be combined into one constituent element, or one constituent element may be constituted by two or more constituent elements, if necessary. In addition, the functions performed in each block are intended to illustrate the embodiments of the present invention, and the specific operations and apparatuses do not limit the scope of the present invention.

1, the display apparatus 100 may include a tuner 131 and a demodulator 132 and may include a network interface unit 133 or an external device interface unit (not shown) 135 to reproduce the image.

For example, the display apparatus 100 may be divided into an image processing apparatus such as a set-top box for receiving broadcast signals or contents according to various network services, and a content reproducing apparatus for reproducing contents inputted from the image processing apparatus Can be implemented.

In this case, the operation method of the display device according to the embodiment of the present invention to be described below may be applied not only to the display device 100 as described with reference to FIG. 1, but also to the image processing device such as the separated set- 180, and an audio output unit 185. The content playback apparatus may be implemented by any one of the above-described content playback apparatuses.

Next, a remote control apparatus according to an embodiment of the present invention will be described with reference to Figs. 2 to 3. Fig.

FIG. 2 is a block diagram of a remote control apparatus according to an embodiment of the present invention, and FIG. 3 shows an example of an actual configuration of a remote control apparatus 200 according to an embodiment of the present invention.

2, the remote control apparatus 200 includes a fingerprint recognition unit 210, a wireless communication unit 220, a user input unit 230, a sensor unit 240, an output unit 250, a power supply unit 260 A storage unit 270, a control unit 280, and a voice acquiring unit 290. [0034]

Referring to FIG. 2, the wireless communication unit 225 transmits / receives a signal to / from any one of the display devices according to the embodiments of the present invention described above.

The remote control device 200 includes an RF module 221 capable of transmitting and receiving signals to and from the display device 100 according to the RF communication standard and is capable of transmitting and receiving signals with the display device 100 according to the IR communication standard And an IR module 223. In addition, the remote control device 200 may include a Bluetooth module 225 capable of transmitting and receiving signals with the display device 100 according to the Bluetooth communication standard. The remote control apparatus 200 is provided with an NFC module 227 capable of transmitting and receiving signals to and from the display apparatus 100 in accordance with a NFC (Near Field Communication) communication standard. In accordance with a WLAN (Wireless LAN) communication standard, And a WLAN module 229 that can send and receive signals to and from the device 100.

The remote control device 200 transmits a signal containing information on the motion and the like of the remote control device 200 to the display device 100 through the wireless communication unit 220.

On the other hand, the remote control device 200 can receive a signal transmitted from the display device 100 through the RF module 221 and can transmit power to the display device 100 via the IR module 223, Off, channel change, volume change, and the like.

The user input unit 230 may include a keypad, a button, a touch pad, or a touch screen. The user can input a command related to the display device 100 to the remote control device 200 by operating the user input unit 230. [ When the user input unit 230 has a hard key button, the user can input a command related to the display device 100 to the remote control device 200 through the push operation of the hard key button. This will be described with reference to FIG.

Referring to FIG. 3, the remote control apparatus 200 may include a plurality of buttons. The plurality of buttons include a fingerprint recognition button 212, a power button 231, a home button 232, a live button 233, an external input button 234, a volume control button 235, a voice recognition button 236, A channel change button 237, an OK button 238, and a back button 239. [

The fingerprint recognition button 212 may be a button for recognizing the fingerprint of the user. In one embodiment, the fingerprint recognition button 212 is capable of a push operation and may receive a push operation and a fingerprint recognition operation. The power button 231 may be a button for turning on / off the power of the display device 100. The home button 232 may be a button for moving to the home screen of the display device 100. The live button 233 may be a button for displaying a real time broadcast program. The external input button 234 may be a button for receiving an external input connected to the display device 100. The volume control button 235 may be a button for controlling the volume of the volume output by the display device 100. The voice recognition button 236 may be a button for receiving the user's voice and recognizing the received voice. The channel change button 237 may be a button for receiving a broadcast signal of a specific broadcast channel. The confirmation button 238 may be a button for selecting a specific function, and the back button 239 may be a button for returning to a previous screen.

Fig. 2 will be described again.

When the user input unit 230 has a touch screen, the user can touch a soft key of the touch screen to input a command related to the display device 100 to the remote control device 200. [ In addition, the user input unit 230 may include various types of input means such as a scroll key, a jog key, and the like that can be operated by the user, and the present invention does not limit the scope of the present invention.

The sensor unit 240 may include a gyro sensor 241 or an acceleration sensor 243 and the gyro sensor 241 may sense information on the motion of the remote control device 200. [

For example, the gyro sensor 241 may sense information about the operation of the remote control device 200 on the basis of the x, y, and z axes, and the acceleration sensor 243 may sense the movement speed of the remote control device 200 And the like can be sensed. The remote control device 200 may further include a distance measuring sensor to sense the distance from the display unit 180 of the display device 100. [

The output unit 250 may output an image or voice signal corresponding to the operation of the user input unit 235 or corresponding to the signal transmitted from the display device 100. [ The user can recognize whether the user input unit 235 is operated or whether the display apparatus 100 is controlled through the output unit 250.

For example, the output unit 250 may include an LED module 251 that is turned on when the user input unit 235 is operated or a signal is transmitted to and received from the display device 100 through the wireless communication unit 225, a vibration module 253 for outputting sound, an acoustic output module 255 for outputting sound, or a display module 257 for outputting an image.

In addition, the power supply unit 260 supplies power to the remote control device 200, and if the remote control device 200 is not moved for a predetermined time, the power supply is interrupted to reduce power consumption. The power supply unit 260 may resume power supply when a predetermined key provided in the remote control device 200 is operated.

The storage unit 270 may store various types of programs, application data, and the like necessary for the control or operation of the remote control apparatus 200. [ If the remote control device 200 wirelessly transmits and receives signals through the display device 100 and the RF module 221, the remote control device 200 and the display device 100 transmit and receive signals through a predetermined frequency band .

The control unit 280 of the remote control device 200 stores information on a frequency band and the like capable of wirelessly transmitting and receiving a signal with the display device 100 paired with the remote control device 200 in the storage unit 270, can do.

The control unit 280 controls various matters related to the control of the remote control device 200. [ The control unit 280 transmits a signal corresponding to a predetermined key operation of the user input unit 235 or a signal corresponding to the motion of the remote control device 200 sensed by the sensor unit 240 through the wireless communication unit 225 100).

Also, the voice acquisition unit 290 of the remote control device 200 can acquire voice.

The voice acquisition unit 290 may include at least one microphone 291 and may acquire voice through the microphone 291.

Next, Fig. 4 will be described.

4 shows an example of utilizing a remote control device according to an embodiment of the present invention.

4A illustrates that the pointer 205 corresponding to the remote control device 200 is displayed on the display unit 180. In FIG.

The user can move or rotate the remote control device 200 up, down, left or right. The pointer 205 displayed on the display unit 180 of the display device 100 corresponds to the movement of the remote control device 200. [ In this remote control device 200, as shown in the figure, since the pointer 205 is moved according to the movement in the 3D space, it can be called a space remote controller.

4B illustrates that when the user moves the remote controller 200 to the left, the pointer 205 displayed on the display unit 180 of the display apparatus 100 moves to the left correspondingly.

Information on the motion of the remote control device 200 sensed through the sensor of the remote control device 200 is transmitted to the display device 100. The display device 100 can calculate the coordinates of the pointer 205 from the information about the motion of the remote control device 200. [ The display device 100 can display the pointer 205 so as to correspond to the calculated coordinates.

4C illustrates a case where the user moves the remote control device 200 away from the display unit 180 while the specific button in the remote control device 200 is depressed. Thereby, the selected area in the display unit 180 corresponding to the pointer 205 can be zoomed in and displayed.

Conversely, when the user moves the remote control apparatus 200 close to the display unit 180, the selection area within the display unit 180 corresponding to the pointer 205 may be zoomed out and displayed.

On the other hand, when the remote control device 200 moves away from the display unit 180, the selected area is zoomed out, and when the remote control device 200 approaches the display unit 180, the selected area may be zoomed in.

Further, the recognition of the upward, downward, and leftward / rightward movement can be excluded when a specific button in the remote control device 200 is pressed. That is, when the remote control device 200 moves away from or approaches the display unit 180, it is not recognized that the up, down, left, and right movements are recognized, and only the forward and backward movements are recognized. Only the pointer 205 is moved in accordance with the upward, downward, leftward, and rightward movement of the remote control device 200 in a state where the specific button in the remote control device 200 is not pressed.

On the other hand, the moving speed and moving direction of the pointer 205 may correspond to the moving speed and moving direction of the remote control device 200.

The pointer in the present specification means an object displayed on the display unit 180 in correspondence with the operation of the remote control device 200. [ Therefore, various shapes of objects other than the arrow shapes shown in the drawings are possible with the pointer 205. [ For example, it can be a concept that includes points, cursors, prompts, thick outlines, and so on. The pointer 205 may be displayed corresponding to a point on a horizontal axis or a vertical axis on the display unit 180 or may be displayed corresponding to a plurality of points such as a line or a surface Do.

Next, a method of operating the system according to an embodiment of the present invention will be described with reference to FIG.

5 is a ladder diagram for a method of operating a system according to an embodiment of the present invention.

In an embodiment of the present invention, a system may include, but is not limited to, a display device 100 and a mobile terminal 300, and may include a display device 100 and a plurality of mobile terminals.

Screen mirroring is a function of displaying a screen between terminals as it is, and may be a function of transmitting a screen being displayed by a first terminal to a second terminal and displaying the same screen by the first terminal and the second terminal. The user can view the same content on two or more terminals through screen mirroring.

Referring to FIG. 5, the display device 100 and the mobile terminal 300 are connected to each other (S501). In one embodiment, the display device 100 may be wirelessly connected to the mobile terminal 300 via the local communication unit 173. [ The display device 100 and the mobile terminal 300 may be connected to each other for screen mirroring.

The control unit 170 of the display device 100 receives information on the screen being displayed by the mobile terminal 300 from the mobile terminal 300 (S503). The information on the screen may include information necessary for displaying the screen displayed on the display unit of the mobile terminal 300 directly on the display unit 180 of the display device 100. [ For example, if the mobile terminal 300 is displaying content, the mobile terminal 300 may transmit data for the displayed content to the display device 100. [ Accordingly, the display apparatus 100 can display the content displayed on the mobile terminal 300 as it is. That is, the content being reproduced in the mobile terminal 300 can be reproduced in the display device 100 as it is.

The control unit 170 of the display device 100 displays the screen displayed by the mobile terminal 100 on the display unit 180 based on the received screen information (S505). Accordingly, the user can view the same content through the mobile terminal 300 and the display device 100. [

The control unit 170 of the display device 100 acquires at least one of a screen viewing state indicating a state of the user staring at the screen of the display unit 180 and a screen state of the mobile terminal 300 at step S507.

In one embodiment, the screen staring state may be one of a screen staring state and a screen staring state.

The screen-gazing holding state may be a state in which the user is looking at the screen of the display unit 180 during the screen mirroring. In one embodiment, the controller 170 can determine whether the user's gaze is looking at the screen of the display unit 180 through a camera (not shown) provided in the display apparatus 100.

The state of not looking at the screen may be a state where the user is not looking at the screen of the display unit 180 during the screen mirroring. For example, the user may look at the screen of the mobile terminal 300 rather than the screen of the display unit 180 during screen mirroring.

In one embodiment, the screen state of the mobile terminal 300 may include a screen orientation match state, a screen orientation state full screen blink state, and a partial screen blink state.

The screen direction coincidence state may be a state in which the screen direction of the display device 100 for displaying information and the screen direction of the mobile terminal 300 coincide with each other. For example, the screen direction matching state may be a state in which the screen direction of the display device 100 and the screen direction of the mobile terminal 300 are oriented toward the user.

The screen oriented state may be a state in which the screen of the mobile terminal 300 faces the ground. That is, the screen-oriented state may be a state in which the screen of the mobile terminal 300 is in contact with the ground so that the user can not see the screen of the mobile terminal 300.

The full screen blind state may be a state in which the entire screen of the mobile terminal 300 is hidden by the object. The full screen blind state can be handled the same as the screen oriented state. That is, they may be in the same state.

The partial screen blanking state may be a state in which a screen direction of the display device 100 is coincident with a screen direction of the mobile terminal 300 but a part of the screen of the mobile terminal 300 is hidden.

In one embodiment, the control unit 170 of the display device 100 may obtain the screen state of the mobile terminal 100 through a camera (not shown). That is, the control unit 170 can acquire the screen state of the mobile terminal 300 based on the image photographed through the camera (not shown).

The control unit 170 of the display device 100 may receive the screen status of the mobile terminal 300 from the mobile terminal 300. [ The mobile terminal 300 can detect the coincidence of the screen direction of the mobile terminal 300 through the image obtained through the camera (not shown). The mobile terminal 300 may sense a screen orientation state of the mobile terminal 300 through a sensor such as an illuminance sensor.

The control unit 170 of the display device 100 controls the screen of the display unit 180 based on at least one of the obtained screen state of the user and the screen state of the mobile terminal 300 (S509).

6A to 6C are views for explaining an example of controlling a screen of a display device based on at least one of a screen viewing state of a user and a screen state of a mobile terminal according to an embodiment of the present invention.

In FIGS. 6A and 6B, it is assumed that the mobile terminal 300 is in the screen orientation, and the mobile terminal 300 is in the screen orientation in FIG. 6C.

Referring to FIG. 6A, the display device 100 and the watch type mobile terminal 300-1 are connected to each other to perform a scroll mirroring function. That is, the watch-type mobile terminal 300-1 may be transmitting the media content being reproduced on the screen 310-1 to the display device 100, and the display device 100 may transmit the media content to the watch- 1 and may be playing through the display unit 180. In Fig. 6A, the user A may be staring at the screen of the display device 100. Fig. In other words, the screen-gazing state of the user A may be in the screen gaze holding state described above. At this time, the screen of the watch-type mobile terminal 300-1 may be in the same screen direction as the screen direction of the display device 100. [

Referring to FIG. 6B, the controller 170 can detect that the screen A of the user A is changed from the screen-holding state to the unscreened state. For example, the user A may gaze at the screen of the display device 100 and then take a look at the screen 310-1 of the watch-type mobile terminal 300-1. The non-screening state may be a state in which the user has not looked at the screen of the display unit 180 for a predetermined period of time.

If the control unit 170 detects that the screen is not in the screen-viewing state, the screen mirroring function can be stopped. That is, the controller 170 may transmit a request for stopping the screen mirroring function to the watch-type mobile terminal 300-1. After transmitting the request to stop the screen mirroring function, the control unit 170 may display the media content 630 that has been displayed before the screen mirroring function is performed through the display unit 180. The media content 630 may be a broadcast program, but this is merely an example.

6A, when the screen state of the mobile terminal 300 is changed from the screen direction matching state to the screen orientation state, the controller 170 may suspend the screen mirroring function. After the request to stop the screen mirroring function, the control unit 170 may display the media content 630 that was displayed before the screen mirroring function was performed through the display unit 180. [ That is, if the user directs the screen of the watch-type mobile terminal 300-1 to the ground, it may be intended to stop the screen mirroring. Accordingly, the display apparatus 100 can grasp the user's intention, stop the screen mirroring, and display the originally playing media content 630. [

7A and 7B are views illustrating an example of controlling a screen of a display device based on a screen viewing state of a user and a screen state of a mobile terminal according to another embodiment of the present invention.

In FIGS. 7A and 7B, it is assumed that the user is in a screen-gazing state where the user is looking at the screen of the display device 100.

Referring to FIG. 7A, the display device 100 may perform a screen mirroring function with the watch-type mobile terminal 300-1 and the smart tablet 300-2. The display unit 180 displays the first media content 710 being received from the watch-type mobile terminal 300 and the second media content 730 being received from the smart tablet 300-2 on the divided screen .

7A, when the screen of the smart tablet 300-2 is oriented (i.e., the screen is oriented), the controller 170 controls the size and layout of the content displayed on the screen of the display unit 180 ≪ / RTI > 7B, when the screen of the smart tablet 300-2 is directed (i.e., in a screen orientation state), the controller 170 controls the first medium The content 710 can be displayed in full screen and the second media content 730 can be displayed in the form of an icon 750 in a reduced form. When the smart tablet 300-2 is again changed to the semi-oriented state, the controller 170 may enlarge and display the second media content 730 as shown in FIG. 7A.

7A, when the screen of the smart tablet 300_2 is oriented (i.e., in a screen orientation state), the control unit 170 displays the first media content 710 as a full screen, The second media content 730 may not be displayed on the display unit 180. [ That is, the controller 170 may suspend the smart tablet 300-2 and the screen mirroring function. It may be intended that the user A performs screen mirroring through two terminals and then points to any one terminal to stop screen mirroring with the directed terminal. The display device 100 may grasp this intention of the user and may display small or no media content being received from the directed terminal.

8A to 8E are views for explaining an example of controlling a screen of a display device based on a screen state of a mobile terminal according to another embodiment of the present invention.

8A to 8E, it is assumed that the user is in a screen-gazing state where the user is looking at the screen of the display device 100. FIG.

8A, the display device 100 includes a first watch type mobile terminal 300-1, a second watch type mobile terminal 300-4, a smart tablet 300-2, and a smart phone 300-3 ) And screen mirroring function. The display unit 180 displays the first media content 810 being received from the first watch type mobile terminal 300-1 and the second media content 810 being received from the smart tablet 300-2 on the four- 820 and the third media content 830 being received from the smartphone 300-3 and the fourth media content 840 being received from the second watch type mobile terminal 300-4.

8B, when the screen of the smart tablet 300-2 is directed (i.e., in a screen oriented state), the controller 170 displays the first media content 810 as shown in FIG. 8B, To the display area of the second media content 820 and to display the second media content 820 in the form of an icon 821. [ The third media content 830 and the fourth media content 840 are being reproduced at their original positions. As another example, when the screen of the smart tablet 300-2 is directed (i.e., in a screen oriented state), the controller 170 enlarges and displays the first media content 810, The display unit 820 may not be displayed. That is, the control unit 170 may stop the smart tablet 300-2 and the screen mirroring function.

8A, when the entire screen of the smart tablet 300-2 is covered by the user's hand, the controller 170 controls the first media content 810 to be displayed in the display area of the second media content 820, And the second media content 820 may not be displayed. That is, the controller 170 can stop the screen mirroring with the smart tablet 300-2 with the full screen hidden. The fact that the user hides the entire screen of the smart tablet 300-2 can be viewed as an intent to stop screen mirroring with the device.

8A, when the screen of the smart tablet 300-2 is oriented (i.e., in a screen oriented state), the controller 170 displays the first media content (i.e., 810 to the display area of the third media content 830 and to reduce the second media content 820 to the icon 821 and display it. The controller 170 moves the third media content 830 to the display area of the existing fourth media content 830 and moves the fourth content 840 to the display area of the existing second media content 820 Can be moved. The controller 170 may display the first media content 810 vertically and display the remaining third media content 830 and the fourth media content 840 horizontally.

8B to 8C, when the screen state of the first watch type mobile terminal 300-1 is changed to the screen oriented state, the controller 170 controls the third media content 830 (See FIG. 8A) of the first media content 810 and enlarge the fourth media content 840 to the display area of the second media content 820 (see FIG. 8A) . That is, the controller 170 may stop screen mirroring with the first watch type mobile terminal 300-1. The user can perform screen mirroring through the smartphone 300-3 and the second watch type mobile terminal 300-4 instead of the screen oriented state.

9A and 9B are views illustrating an example of controlling a screen of a display device based on a screen state of a mobile terminal according to another embodiment of the present invention.

Referring to FIG. 9A, the display apparatus 100 may be performing screen mirroring with the smart tablet 300-2, and the smart tablet 300-2 may be playing the media content 910 being reproduced. The controller 170 determines that a portion of the first media content 910 displayed through the display unit 180 is a part of the first screen of the smart tablet 300-2 when the screen state of the smart tablet 300-2 is a partial screen blanking state It may not be displayed. Some unmarked areas can be treated as black areas. The control unit 170 can receive information indicating that the partial screen blanking state is obtained from the smart tablet 300-2.

10A and 10B are views illustrating an example of controlling a screen of a display device based on a screen state of a mobile terminal according to another embodiment of the present invention.

In FIGS. 10A and 10B, it is assumed that the user is in a screen-gazing state where the user is looking at the screen of the display device 100.

Fig. 10A is basically the same as Fig. 9A, but contents of notification information 1010 are different. That is, the controller 170 may receive the alarm information 1010 received from the outside during the screen mirroring. The alarm information 1010 may be superimposed on the upper side of the media content 910. However, due to the alarm information 1010, the user may not want to be disturbed by the viewing of the media content 910.

Referring to FIG. 10B, the controller 170 may obtain a partial screen blind state in which the alarm information 1010 is hidden on the screen of the smart tablet 300-2. The control unit 170 may not display the alarm information 1010 on the display unit 180 while displaying the entire media content 910 based on the obtained partial screen blind state. The user may not be disturbed by watching the media content 910 being screen mirrored through the operation of covering the alarm information 1010. [

11A to 11C are views for explaining an example of controlling a screen of a display device based on a screen state of a mobile terminal according to another embodiment of the present invention.

Since Fig. 11A is the same view as Fig. 9A, the related description is replaced.

11A, while the display device 100 and the smart tablet 300-2 perform the screen mirroring function, the smart tablet 300-2 may receive a call signal. When the smart tablet 300-2 receives a call signal, each of the display device 100 and the smart tablet 300-2 can display the call reception screen 1110 as shown in FIG. 11B . 11C, when the screen state of the smart tablet 300-2 is changed to the screen orientation state, the controller 170 switches the call reception screen 1110 to the media content 910 . That is, the controller 170 can reproduce the media content 910 that has been reproduced before receiving the call signal.

The user merely has to direct the smart tablet 300-2 in order to avoid interference with the viewing of the media content due to the reception of the call signal during the viewing of the media content through the screen mirroring.

According to an embodiment of the present invention, the above-described method can be implemented as a code that can be read by a processor on a medium on which the program is recorded. Examples of the medium that can be read by the processor include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, etc., and may be implemented in the form of a carrier wave (e.g., transmission over the Internet) .

The above-described display device is not limited to the configuration and method of the above-described embodiments, but the embodiments may be configured such that all or some of the embodiments are selectively combined so that various modifications can be made. It is possible.

Claims (10)

In the display device,
A local communication unit for performing a screen mirroring function with a mobile terminal connected to the display device;
A display unit for displaying media content received from the mobile terminal through the screen mirroring function; And
And a control unit for controlling the screen of the display unit based on at least one of a screen viewing state of the user and a screen state of the mobile terminal and a screen state of the mobile terminal,
Display device. The method according to claim 1,
The control unit
When the screen of the mobile terminal is in a screen oriented state toward the ground, stops the screen mirroring function with the mobile terminal, and displays the displayed media content through the display unit before performing the screen mirroring function
Display device. The method according to claim 1,
The control unit
When the user does not look at the screen of the display unit for a predetermined time, stops the screen mirroring function with the mobile terminal and displays the displayed media content through the display unit before performing the screen mirroring function
Display device. The method according to claim 1,
The control unit
When a part of the entire screen of the mobile terminal is hidden, the display unit is controlled so as not to display the media content by an area corresponding to a part of the hidden screen
Display device. The method according to claim 1,
The control unit
Displaying the alarm information received by the mobile terminal during the screen mirroring function,
When the alarm information displayed on the screen of the mobile terminal is hidden, the display unit is controlled so as not to display the alarm information displayed through the display unit
Display device. The method according to claim 1,
The control unit
And controls the display unit to display the media content and the media content received from the other mobile terminal on the divided screen by performing the screen mirroring function with the mobile terminal and another mobile terminal
Display device. The method according to claim 6,
The control unit
And controls the display unit to display the media content received from the mobile terminal on the full screen without displaying the media content received from the other mobile terminal when the screen of the other mobile terminal is in a screen oriented state toward the ground
Display device. The method according to claim 6,
The control unit
When the screen of the other mobile terminal is in a screen oriented state toward the ground, the media content received from the other mobile terminal is reduced and displayed in the form of an icon, and the media content received from the mobile terminal is displayed in full screen The control unit
Display device. The method according to claim 1,
Further comprising a camera for sensing a state of the screen
Display device. The method according to claim 1,
The control unit
And receives information on the screen status of the mobile terminal from the mobile terminal through the short-
Display device.
KR1020160000525A 2016-01-04 2016-01-04 Display device and operating method thereof KR20170081454A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020160000525A KR20170081454A (en) 2016-01-04 2016-01-04 Display device and operating method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020160000525A KR20170081454A (en) 2016-01-04 2016-01-04 Display device and operating method thereof

Publications (1)

Publication Number Publication Date
KR20170081454A true KR20170081454A (en) 2017-07-12

Family

ID=59353008

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020160000525A KR20170081454A (en) 2016-01-04 2016-01-04 Display device and operating method thereof

Country Status (1)

Country Link
KR (1) KR20170081454A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021101260A1 (en) * 2019-11-19 2021-05-27 Samsung Electronics Co., Ltd. Display device, mobile device, and screen mirroring method of display device

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021101260A1 (en) * 2019-11-19 2021-05-27 Samsung Electronics Co., Ltd. Display device, mobile device, and screen mirroring method of display device
US11435974B2 (en) 2019-11-19 2022-09-06 Samsung Electronics Co., Ltd. Display device, mobile device, screen mirroring method of display device, and screen mirroring method of mobile device

Similar Documents

Publication Publication Date Title
US9749575B1 (en) Display device and operating method thereof
US10725732B2 (en) Display device and operating method thereof
US10481753B2 (en) Display device and method of operating the same
KR102570379B1 (en) Display device for providing a screen mirroring function and operating method thereof
US10327030B2 (en) Display device and operating method thereof
KR20170035167A (en) Display device and operating method thereof
KR102479487B1 (en) display device
KR20180016805A (en) Display device and operating method thereof
KR20170123184A (en) Display device for providing a scrap function and operating method thereof
KR20160095377A (en) Display device and operating method thereof
KR20170081454A (en) Display device and operating method thereof
KR20170081425A (en) Display device
KR20160004739A (en) Display device and operating method thereof
US11974004B2 (en) Display device and operating method thereof
US11600216B1 (en) Display device and operating method thereof
KR20180054052A (en) Display device and operating method thereof
KR20180043139A (en) Display device and operating method thereof
US20230274684A1 (en) Display device and operating method thereof
KR20190028027A (en) Display device
KR20180006073A (en) Display device and operating method thereof
KR20160096884A (en) Display device and operating method thereof
KR20190069096A (en) Mobile terminal and display device
KR20230120798A (en) Display system
KR20230111526A (en) A display device
KR20210000520A (en) Display device