KR20240017471A - DISPLAY APPARATUS AND METHOD OF CONTROLLING OPERATION OF EXTERNAL APPARATUS USING Li-Fi SIGNAL GENERATED THEREFROM - Google Patents

Abstract

A method of controlling the operation of an external device using a display device and a light-fidelity (Li-Fi) signal generated from the display device is disclosed. Here, the display device according to an embodiment of the present disclosure includes a backlight including a light source; display panel; and a signal generator that generates a Li-Fi signal based on Li-Fi data generated using some light sources of the backlight, and transmits the generated Li-Fi signal to control the operation of the at least one external device. Includes a control module to control.

Description

A method of controlling the operation of an external device using a display device and a Li-Fi signal generated from the display device {DISPLAY APPARATUS AND METHOD OF CONTROLLING OPERATION OF EXTERNAL APPARATUS USING Li-Fi SIGNAL GENERATED THEREFROM}

The present disclosure relates to a display device, and more specifically, to an apparatus and method for controlling the operation of at least one external device based on a Li-Fi signal generated from the display device.

Li-Fi (Light-Fidelity) is a technology that combines LED (Light Emitting Diode), a high-efficiency lighting, and Wi-Fi (Wireless-Fidelity). In other words, communication is performed through visible light emitted from LED. It says what to do.

Compared to conventional wired/wireless communication, Li-Fi has the advantage of being able to communicate at a speed about 100 times faster than Wi-Fi and about 60 times faster than LTE-A, and it can communicate at a speed about 60 times faster than LTE-A. Since it uses visible light rather than using electromagnetic waves, it has the advantage of being completely free of risks due to electromagnetic waves. Additionally, due to the low power consumption of LED lighting, a communication system can be built with low power and low cost.

However, because visible light is used, if there is an obstacle such as an obstacle in the process of transmitting light, communication is frequently interrupted or communication sensitivity is low.

Li-Fi is superior to other communication systems in terms of transmission speed, but has the problem of poor stability, so much research and development is still needed.

The purpose of the present disclosure is to provide a display device that generates a signal containing data for Li-Fi communication with at least one external device.

Another object of the present disclosure is to provide a method of controlling the operation of at least one external device based on a Li-Fi signal generated from the display device.

A display device according to an embodiment of the present disclosure includes a backlight including a light source; display panel; and a signal generator that generates a Li-Fi signal based on Li-Fi (Light-Fidelity) data generated using some light sources of the backlight, and transmits the generated Li-Fi signal to Includes a control module that controls the operation of external devices.

A method of controlling the operation of at least one external device using a Li-Fi signal in a display device according to an embodiment of the present disclosure includes generating Li-Fi data using some light sources of a backlight; receiving an input signal; Separating and extracting the generated Li-Fi data from the received input signal; Generating a Li-Fi signal based on the separately extracted Li-Fi data; And transmitting the generated Li-Fi signal to the at least one external device.

According to at least one embodiment among various embodiments of the present disclosure, there is an effect in which the display device can control the operation of at least one external device using a Li-Fi signal.

According to at least one embodiment among various embodiments of the present disclosure, there is an effect of seamlessly providing various services such as a mirroring service to at least one external device using a Li-Fi signal from a display device. there is.

According to at least one embodiment among various embodiments of the present disclosure, a display device capable of receiving and emitting Li-Fi signals may also perform an AP (Access Point) function for other peripheral external devices, including IoT devices or sensors. You can.

FIG. 1 is a block diagram showing the configuration of a display device according to an embodiment of the present disclosure.
Figure 2 is a block diagram of a remote control device according to an embodiment of the present disclosure.
Figure 3 shows an example of the actual configuration of a remote control device according to an embodiment of the present disclosure.
Figure 4 shows an example of utilizing a remote control device according to an embodiment of the present disclosure.
Figure 5 is a diagram for explaining the landscape mode and portrait mode of a stand-type display device according to an embodiment of the present disclosure.
Figure 6 is a block diagram of processing a Li-Fi signal in a display device according to an embodiment of the present disclosure.
FIG. 7 is a diagram illustrating a signal frame structure defined according to an embodiment of the present disclosure.
FIG. 8 is a diagram illustrating an audio data processing method according to an embodiment of the present disclosure.
FIG. 9 is a diagram illustrating an optical sheet and a light output slit according to an embodiment of the present disclosure.
10 to 12 are diagrams to explain a method of controlling the operation of an external device through a Li-Fi signal in a display device according to an embodiment of the present disclosure.
FIG. 13 is a flowchart illustrating a method of controlling the operation of an external device through a Li-Fi signal in a display device according to an embodiment of the present disclosure.
FIG. 14 is a flowchart illustrating a method of controlling the operation of an external device through a Li-Fi signal in a display device according to another embodiment of the present disclosure.
FIG. 15 is a flowchart illustrating a method of controlling the operation of an external device through a Li-Fi signal in a display device according to another embodiment of the present disclosure.

Hereinafter, embodiments related to the present disclosure will be described in more detail with reference to the drawings. The suffixes “module” and “part” for components used in the following description are given or used interchangeably only for the ease of preparing the specification, and do not have distinct meanings or roles in themselves.

FIG. 1 is a block diagram showing the configuration of a display device 100 according to an embodiment of the present disclosure.

Referring to FIG. 1, the display device 100 includes a broadcast reception unit 130, an external device interface unit 135, a storage unit 140, a user input interface unit 150, a control unit 170, and a wireless communication unit 173. , may include a voice acquisition unit 175, a display unit 180, an audio output unit 185, and a power supply unit 190.

The broadcast receiver 130 may include a tuner 131, a demodulator 132, and a network interface unit 133.

The tuner 131 can select a specific broadcast channel according to a channel selection command. The tuner 131 may receive a broadcast signal for a specific selected broadcast channel.

The demodulator 132 can separate the received broadcast signal into a video signal, an audio signal, and a data signal related to the broadcast program, and can restore the separated video signal, audio signal, and data signal to a form that can be output.

The network interface unit 133 may provide an interface for connecting the display device 100 to a wired/wireless network including an Internet network. The network interface unit 133 may transmit or receive data with other users or other electronic devices through a connected network or another network linked to the connected network.

The network interface unit 133 can access a certain web page through a connected network or another network linked to the connected network. In other words, you can access a certain web page through a network and transmit or receive data with the corresponding server.

And, the network interface unit 133 can receive content or data provided by a content provider or network operator. That is, the network interface unit 133 can receive content and information related thereto, such as movies, advertisements, games, VOD (Video on Demand), and broadcast signals, provided from a content provider or network provider through a network.

Additionally, the network interface unit 133 can receive firmware update information and update files provided by a network operator, and can transmit data to the Internet, a content provider, or a network operator.

The network interface unit 133 can select and receive a desired application from among applications that are open to the public through a network.

The external device interface unit 135 may receive an application or application list in an adjacent external device and transmit it to the control unit 170 or the storage unit 140.

The external device interface unit 135 may provide a connection path between the display device 100 and an external device. The external device interface unit 135 may receive one or more of video and audio output from an external device connected wirelessly or wired to the display device 100 and transmit it to the control unit 170. The external device interface unit 135 may include a plurality of external input terminals. The plurality of external input terminals may include an RGB terminal, one or more High Definition Multimedia Interface (HDMI) terminals, and a component terminal.

An image signal from an external device input through the external device interface unit 135 may be output through the display unit 180. A voice signal from an external device input through the external device interface unit 135 may be output through the audio output unit 185.

An external device that can be connected to the external device interface unit 135 may be any one of a set-top box, Blu-ray player, DVD player, game console, sound bar, smartphone, PC, USB memory, or home theater, but this is only an example. .

Additionally, some of the content data stored in the display device 100 may be transmitted to a selected user or selected electronic device among other users or other electronic devices pre-registered in the display device 100.

The storage unit 140 stores programs for processing and controlling each signal in the control unit 170, and can store signal-processed video, audio, or data signals.

In addition, the storage unit 140 may perform a function for temporary storage of video, voice, or data signals input from the external device interface unit 135 or the network interface unit 133, and may perform a predetermined storage function through the channel memory function. You can also store information about the image.

The storage unit 140 may store an application or application list input from the external device interface unit 135 or the network interface unit 133.

The display device 100 can play content files (video files, still image files, music files, document files, application files, etc.) stored in the storage unit 140 and provide them to the user.

The user input interface unit 150 may transmit a signal input by the user to the control unit 170 or transmit a signal from the control unit 170 to the user. For example, the user input interface unit 150 may be configured according to various communication methods such as Bluetooth, Ultra Wideband (UWB), ZigBee, Radio Frequency (RF) communication, or Infrared (IR) communication. Control signals such as power on/off, channel selection, and screen settings can be received and processed from the remote control device 200, or control signals from the control unit 170 can be transmitted to the remote control device 200.

Additionally, the user input interface unit 150 may transmit control signals input from local keys (not shown) such as power key, channel key, volume key, and setting value to the control unit 170.

The image signal processed by the control unit 170 may be input to the display unit 180 and displayed as an image corresponding to the image signal. Additionally, the image signal processed by the control unit 170 may be input to an external output device through the external device interface unit 135.

The voice signal processed by the control unit 170 may be output as audio to the audio output unit 185. Additionally, the voice signal processed by the control unit 170 may be input to an external output device through the external device interface unit 135.

In addition, the control unit 170 may control overall operations within the display device 100.

In addition, the control unit 170 can control the display device 100 by a user command or internal program input through the user input interface unit 150, and connects to the network to display an application or application list desired by the user on the display device. You can download it within (100).

The control unit 170 allows channel information selected by the user to be output through the display unit 180 or the audio output unit 185 along with the processed video or audio signal.

In addition, the control unit 170 controls the external device input through the external device interface unit 135, for example, a camera or camcorder, according to an external device image playback command received through the user input interface unit 150. A video signal or audio signal can be output through the display unit 180 or the audio output unit 185.

Meanwhile, the control unit 170 can control the display unit 180 to display an image, for example, a broadcast image input through the tuner 131, or an external input input through the external device interface unit 135. An image, an image input through the network interface unit, or an image stored in the storage unit 140 can be controlled to be displayed on the display unit 180. In this case, the image displayed on the display unit 180 may be a still image or a moving image, and may be a 2D image or 3D image.

Additionally, the control unit 170 can control the playback of content stored in the display device 100, received broadcast content, or external input content from outside. The content may include broadcast video, external input video, audio files, and still content. It can be in various forms, such as videos, connected web screens, and document files.

The wireless communication unit 173 can communicate with external devices through wired or wireless communication. The wireless communication unit 173 can perform short range communication with an external device. To this end, the wireless communication unit 173 uses Bluetooth (Bluetooth??), BLE (Bluetooth Low Energy), RFID (Radio Frequency Identification), Infrared Data Association (IrDA), UWB (Ultra Wideband), ZigBee, and NFC ( Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technology can be used to support short-distance communication. This wireless communication unit 173 is connected between the display device 100 and a wireless communication system, between the display device 100 and another display device 100, or between the display device 100 and the display device 100 through wireless area networks. Wireless communication between networks where the display device 100 (or an external server) is located can be supported. Local area wireless networks may be wireless personal area networks.

Here, the other display device 100 is a wearable device capable of exchanging data with (or interoperable with) the display device 100 according to the present disclosure, for example, a smartwatch, smart glasses. It can be a mobile terminal such as smart glass, HMD (head mounted display), or smart phone. The wireless communication unit 173 can detect (or recognize) a wearable device capable of communication around the display device 100. Furthermore, if the detected wearable device is a device authenticated to communicate with the display device 100 according to the present disclosure, the control unit 170 sends at least a portion of the data processed by the display device 100 to the wireless communication unit. It can be transmitted to the wearable device through 173. Accordingly, the user of the wearable device can use the data processed by the display device 100 through the wearable device.

The voice acquisition unit 175 can acquire audio. The voice acquisition unit 175 may include at least one microphone (not shown) and may acquire audio around the display device 100 through the microphone (not shown).

The display unit 180 converts the video signals, data signals, and OSD signals processed by the control unit 170 or the video signals and data signals received from the external device interface unit 135 into R, G, and B signals, respectively, and drives them. A signal can be generated.

Meanwhile, the display device 100 shown in FIG. 1 is only an example of the present disclosure. Some of the illustrated components may be integrated, added, or omitted depending on the specifications of the display device 100 that is actually implemented.

That is, as needed, two or more components may be combined into one component, or one component may be subdivided into two or more components. Additionally, the functions performed in each block are for explaining embodiments of the present disclosure, and the specific operations or devices do not limit the scope of the present disclosure.

According to another embodiment of the present disclosure, unlike shown in FIG. 1, the display device 100 does not include a tuner 131 and a demodulation unit 132, but includes a network interface unit 133 or an external device interface unit ( You can also receive and play video through 135).

For example, the display device 100 is implemented as an image processing device such as a set-top box for receiving broadcast signals or contents according to various network services, and a content playback device for playing content input from the image processing device. It can be.

In this case, the method of operating a display device according to an embodiment of the present disclosure, which will be described below, includes not only the display device 100 as described with reference to FIG. 1, but also an image processing device such as a separate set-top box or a display unit 180. ) and a content playback device having an audio output unit 185.

The audio output unit 185 receives the audio-processed signal from the control unit 170 and outputs it as audio.

The power supply unit 190 supplies the corresponding power throughout the display device 100. In particular, power can be supplied to the control unit 170, which can be implemented in the form of a system on chip (SOC), the display unit 180 for displaying images, and the audio output unit 185 for audio output. there is.

Specifically, the power supply unit 190 may include a converter that converts alternating current power to direct current power and a dc/dc converter that converts the level of direct current power.

Next, with reference to FIGS. 2 and 3, a remote control device according to an embodiment of the present disclosure will be described.

Figure 2 is a block diagram of a remote control device according to an embodiment of the present disclosure, and Figure 3 shows an example of the actual configuration of the remote control device according to an embodiment of the present disclosure.

First, referring to FIG. 2, the remote control device 200 includes a fingerprint recognition unit 210, a wireless communication unit 220, a user input unit 230, a sensor unit 240, an output unit 250, and a power supply unit 260. ), a storage unit 270, a control unit 280, and a voice acquisition unit 290.

Referring to FIG. 2, the wireless communication unit 220 transmits and receives signals to and from any one of the display devices according to the embodiments of the present disclosure described above.

The remote control device 200 has an RF module 221 capable of transmitting and receiving signals to and from the display device 100 according to RF communication standards, and an RF module 221 capable of transmitting and receiving signals to and from the display device 100 according to IR communication standards. An IR module 223 may be provided. Additionally, the remote control device 200 may be equipped with a Bluetooth module 225 that can transmit and receive signals with the display device 100 according to the Bluetooth communication standard. In addition, the remote control device 200 is equipped with an NFC module 227 capable of transmitting and receiving signals to the display device 100 according to the NFC (Near Field Communication) communication standard, and displays the display device 100 according to the WLAN (Wireless LAN) communication standard. A WLAN module 229 capable of transmitting and receiving signals to and from the device 100 may be provided.

In addition, the remote control device 200 transmits a signal containing information about the movement of the remote control device 200 to the display device 100 through the wireless communication unit 220.

Meanwhile, the remote control device 200 can receive signals transmitted by the display device 100 through the RF module 221 and, if necessary, turn on/off the display device 100 through the IR module 223. Commands for turning off, changing channels, changing volume, etc. can be sent.

The user input unit 230 may be comprised of a keypad, button, touch pad, or touch screen. The user can input commands related to the display device 100 into the remote control device 200 by manipulating the user input unit 230. When the user input unit 230 is provided with a hard key button, the user can input a command related to the display device 100 to the remote control device 200 through a push operation of the hard key button. This will be explained with reference to FIG. 3 .

Referring to FIG. 3, the remote control device 200 may include a plurality of buttons. The plurality of buttons include a fingerprint recognition button (212), power button (231), home button (232), live button (233), external input button (234), volume control button (235), voice recognition button (236), It may include a channel change button 237, a confirmation button 238, and a back button 239.

The fingerprint recognition button 212 may be a button for recognizing the user's fingerprint. In one embodiment, the fingerprint recognition button 212 is capable of a push operation and may receive a push operation and a fingerprint recognition operation. The power button 231 may be a button for turning on/off the power of the display device 100. The home button 232 may be a button for moving to the home screen of the display device 100. The live button 233 may be a button for displaying a real-time broadcast program. The external input button 234 may be a button for receiving an external input connected to the display device 100. The volume control button 235 may be a button for adjusting the volume of the sound output by the display device 100. The voice recognition button 236 may be a button for receiving the user's voice and recognizing the received voice. The channel change button 237 may be a button for receiving a broadcast signal of a specific broadcast channel. The confirmation button 238 may be a button for selecting a specific function, and the back button 239 may be a button for returning to the previous screen.

Figure 2 will be described again.

If the user input unit 230 has a touch screen, the user can input commands related to the display device 100 through the remote control device 200 by touching a soft key on the touch screen. Additionally, the user input unit 230 may be provided with various types of input means that the user can operate, such as scroll keys and jog keys, and this embodiment does not limit the scope of the present disclosure.

The sensor unit 240 may include a gyro sensor 241 or an acceleration sensor 243, and the gyro sensor 241 may sense information about the movement of the remote control device 200.

For example, the gyro sensor 241 can sense information about the operation of the remote control device 200 based on the x, y, and z axes, and the acceleration sensor 243 measures the moving speed of the remote control device 200. Information about such things can be sensed. Meanwhile, the remote control device 200 may further include a distance measurement sensor and can sense the distance from the display unit 180 of the display device 100.

The output unit 250 may output a video or audio signal corresponding to an operation of the user input unit 230 or a signal transmitted from the display device 100. Through the output unit 250, the user can recognize whether the user input unit 230 is manipulated or the display device 100 is controlled.

For example, the output unit 250 includes an LED module 251 that turns on when the user input unit 230 is manipulated or a signal is transmitted and received with the display device 100 through the wireless communication unit 220, and a vibration module that generates vibration ( 253), a sound output module 255 that outputs sound, or a display module 257 that outputs an image.

Additionally, the power supply unit 260 supplies power to the remote control device 200, and stops power supply when the remote control device 200 does not move for a predetermined period of time, thereby reducing power waste. The power supply unit 260 can resume power supply when a predetermined key provided in the remote control device 200 is operated.

The storage unit 270 may store various types of programs, application data, etc. necessary for controlling or operating the remote control device 200. If the remote control device 200 transmits and receives signals wirelessly through the display device 100 and the RF module 221, the remote control device 200 and the display device 100 transmit and receive signals through a predetermined frequency band. .

The control unit 280 of the remote control device 200 stores and references information about the display device 100 paired with the remote control device 200 and the frequency band capable of wirelessly transmitting and receiving signals in the storage unit 270. can do.

The control unit 280 controls all matters related to the control of the remote control device 200. The control unit 280 sends a signal corresponding to a predetermined key operation of the user input unit 230 or a signal corresponding to the movement of the remote control device 200 sensed by the sensor unit 240 through the wireless communication unit 220. 100).

Additionally, the voice acquisition unit 290 of the remote control device 200 can acquire voice.

The voice acquisition unit 290 may include at least one microphone 291 and can acquire voice through the microphone 291.

Next, Figure 4 will be described.

Figure 4 shows an example of utilizing a remote control device according to an embodiment of the present disclosure.

Figure 4(a) illustrates that the pointer 205 corresponding to the remote control device 200 is displayed on the display unit 180.

The user can move or rotate the remote control device 200 up and down, left and right. The pointer 205 displayed on the display unit 180 of the display device 100 corresponds to the movement of the remote control device 200. This remote control device 200 can be called a spatial remote control because the corresponding pointer 205 is moved and displayed according to movement in 3D space, as shown in the drawing.

Figure 4(b) illustrates that when the user moves the remote control device 200 to the left, the pointer 205 displayed on the display unit 180 of the display device 100 also moves to the left correspondingly.

Information about the movement of the remote control device 200 detected through the sensor of the remote control device 200 is transmitted to the display device 100. The display device 100 can calculate the coordinates of the pointer 205 from information about the movement of the remote control device 200. The display device 100 may display the pointer 205 to correspond to the calculated coordinates.

Figure 4(c) illustrates a case where a user moves the remote control device 200 away from the display unit 180 while pressing a specific button in the remote control device 200. As a result, the selected area in the display unit 180 corresponding to the pointer 205 can be zoomed in and displayed enlarged.

Conversely, when the user moves the remote control device 200 closer to the display unit 180, the selected area in the display unit 180 corresponding to the pointer 205 may be zoomed out and displayed in a reduced size.

Meanwhile, when the remote control device 200 moves away from the display unit 180, the selected area may be zoomed out, and when the remote control device 200 approaches the display unit 180, the selected area may be zoomed in.

Additionally, when a specific button in the remote control device 200 is pressed, recognition of up-down, left-right movement may be excluded. That is, when the remote control device 200 moves away from or approaches the display unit 180, up, down, left, and right movements are not recognized, and only forward and backward movements can be recognized. When a specific button in the remote control device 200 is not pressed, only the pointer 205 moves as the remote control device 200 moves up, down, left, and right.

Meanwhile, the moving speed or direction of the pointer 205 may correspond to the moving speed or direction of the remote control device 200.

Meanwhile, a pointer in this specification refers to an object displayed on the display unit 180 in response to the operation of the remote control device 200. Accordingly, the pointer 205 can be an object of various shapes other than the arrow shape shown in the drawing. For example, concepts may include dots, cursors, prompts, thick outlines, etc. In addition, the pointer 205 can be displayed in correspondence to one of the horizontal and vertical axes on the display unit 180, as well as in response to multiple points, such as a line or surface. do.

5A and 5B are diagrams for explaining the landscape mode and portrait mode of a stand-type display device according to an embodiment of the present disclosure.

Referring to FIGS. 5A and 5B, a stand type display device 100 is shown.

A shaft 103 and a stand base 105 may be connected to the display device 100.

The shaft 103 may connect the display device 100 and the stand base 105. Shaft 103 may extend vertically.

The lower end of the shaft 103 may be connected to the edge of the stand base 105.

The lower end of the shaft 103 may be rotatably connected to the circumference of the stand base 105.

The display device 100 and the shaft 103 may rotate about a vertical axis with respect to the stand base 105.

The upper part of the shaft 103 may be connected to the rear of the display device 100.

The stand base 105 may serve to support the display device 100.

The display device 100 may be configured to include a shaft 103 and a stand base 105.

The display device 100 can rotate around a point where the top of the shaft 103 and the rear of the display 180 come into contact.

FIG. 5A shows that the display 180 operates in landscape mode with an attitude in which the horizontal length is greater than the vertical length, and FIG. 5b shows that the display 180 operates in landscape mode with an attitude in which the vertical length is greater than the horizontal length. It can be expressed.

Users can move around holding a stand-type display device. In other words, unlike fixed devices, stand-type display devices have improved mobility, so users are not restricted by placement location.

Next, a display device 100 that generates a signal containing data for Li-Fi (Light-Fidelity) visible light communication (for convenience, hereinafter referred to as a 'Li-Fi signal'), and the display device 100 Various embodiments of a method for controlling the operation of at least one external apparatus based on a Li-Fi signal are disclosed.

Figure 6 is a block diagram of processing a Li-Fi signal in a display device according to an embodiment of the present disclosure.

FIG. 7 is a diagram illustrating a signal frame structure defined according to an embodiment of the present disclosure.

FIG. 8 is a diagram illustrating an audio data processing method according to an embodiment of the present disclosure.

FIG. 9 is a diagram illustrating an optical sheet and a light output slit according to an embodiment of the present disclosure.

The display device 100 according to the present disclosure includes a hardware (HW) configuration that generates a Li-Fi signal, as will be described later. Depending on the embodiment, the hardware configuration may be detachable from/attachable to the display device 100.

The display device 100 and external devices described in this specification with reference to the attached drawings are assumed to include a hardware configuration for receiving and/or emitting Li-Fi signals, even if not specifically described below.

The hardware configuration for receiving the Li-Fi signal may be hardware dedicated to Li-Fi visible light communication, or it may be a hardware configuration in the form of a module that can also receive signals from other communication protocols (e.g., Wi-Fi). .

Meanwhile, the display device 100 and external devices may also include hardware (and software) components that process the received Li-Fi signal to extract and process data.

Depending on the embodiment, the component for processing the Li-Fi signal may be included in the component for receiving the Li-Fi signal described above or may be implemented as a separate component.

Depending on the embodiment, the component for receiving and processing the Li-Fi signal does not necessarily need to be built into the display device 100, and may be connected to the display device 100, and may receive and process the Li-Fi signal. After that, the data may be transmitted and received to the display device 100.

With reference to FIGS. 6 and 13, the operation of processing a Li-Fi signal in the display device 100 according to the present disclosure will be described.

The display device 100 may include a backlight, a color filter, a display panel, and a control module.

A method of controlling the operation of at least one external device using a Li-Fi signal in the display device 100 includes generating Li-Fi data using some light sources of the backlight, and generating Li-Fi data containing the Li-Fi data. When an input signal is received, the Li-Fi data is separately extracted from the received input signal, a Li-Fi signal is generated based on the separately extracted Li-Fi data, and the generated Li-Fi signal is generated from the at least one It can be transmitted to more than one external device.

Referring to Figure 6, the backlight includes an LED light source.

The control module may generate Li-Fi data using some light sources among all light sources of the backlight. At this time, the partial light source may refer to a light source disposed in a partial area of the backlight.

The control module may generate a Li-Fi signal based on the generated Li-Fi data.

The control module may transmit the generated Li-Fi signal to at least one external device through the display 180. The Li-Fi signal transmitted in this way may not only convey or provide simple information but also include control commands for controlling the operation of the external device.

Referring to FIG. 6, the display device 100 may include an MCU 610, a multi-driver IC unit 620, and a display 180.

At this time, the multi-driver IC unit 620 may correspond to or be included in the control module described above.

The MCU 610 can generate video local dimming data, video data, audio data, etc. At this time, for convenience of explanation, data excluding the video local dimming data may be referred to as Li-Fi data, but is not limited thereto.

Meanwhile, as described above, the Li-Fi data is data generated using at least some of the light sources of the backlight according to the present disclosure, and is not limited to audio data, image data (including video data), and text data. may also be included.

The multi-driver IC unit 620 includes an input controller 630, a data splitter 640, a first signal generator 650, and a second signal generator 660. It may be configured to include, but is not limited to this.

However, depending on the embodiment, more signal generators may be included than those shown in FIG. 6. For example, an audio-only signal generator, a video-only signal generator, etc. may be further included.

FIG. 13 is a flowchart illustrating a method of controlling the operation of an external device through a Li-Fi signal in the display device 100 according to an embodiment of the present disclosure.

Referring to FIGS. 6 and 13, the input control unit 630 may receive input data from the MCU 610 (S101).

The input control unit 630 can determine whether Li-Fi data is included in the received input data (S103).

The input control unit 630 can distinguish received input data. Here, the division may mean dividing into Li-Fi data and non-Li-Fi data, for example.

Meanwhile, in the above, non-Li-Fi may refer to the video local dimming data described above.

Since Li-Fi data is generated using an optical output light source in a specific wavelength range for Li-Fi visible light communication, the input control unit 630 generates Li-Fi data from the data received through the MCU 610. Must be able to distinguish. That is, the Li-Fi data is generated by a light source controlled at a separate frequency for optical data transmission and needs to be processed differently from, for example, video local dimming data.

Local dimming LED control data may be generated by a light source controlled at a frequency range of approximately 60 to 120 Hz, while Li-Fi data may be generated by a light source controlled at a frequency range of approximately 1 MHz.

If, as a result of the determination of the input control unit 630, Li-Fi data is not included in the received input data, the data splitter unit 630 may determine it to be local dimming data.

The data splitter unit 630 can separate non-Li-Fi data and Li-Fi data separated through the input control unit 630 and transmit them to the first signal generator 650 and the second signal generator 660, respectively. there is.

That is, if Li-Fi data is not included in the received input data as a result of the determination in step S103, the data splitter unit 630 transfers the data to the first signal generator 650 to generate and generate a local dimming signal. It can be transmitted (S105).

However, if Li-Fi data is included in the received input data as a result of the determination in step S103, the data splitter unit 630 separates the Li-Fi data and transfers it to the second signal generator 660, A Li-Fi signal based on Fi data can be generated (S107, S109).

The display device 100 can output the Li-Fi signal to an external device (S111).

The display device 100 can process non-Li-Fi signals and Li-Fi signals generated by the first signal generator 650 and the second signal generator 660, respectively. At this time, the processing may vary depending on the type of signal.

The display device 100 may perform local dimming control of the display panel based on the received non-Li-Fi signal.

On the other hand, when the display device 100 receives a Li-Fi signal, it can broadcast it to the outside. However, the present disclosure is not limited to the Li-Fi signal transmission method.

As an example, Li-Fi data according to the present disclosure is generated using a partial light source of the backlight, that is, an LED light source in an edge area, but is not limited thereto.

An optical sheet that allows only wavelengths in a specific visible light region to pass may be added to the edge area 910 of the backlight.

For convenience, in Figure 9 (a), an optical sheet that allows only wavelengths of a specific frequency band to pass is formed in the four edge areas of the backlight, but the present invention is not necessarily limited to this. For example, the optical sheet may be formed only in the edge area of a specific face, or the optical sheet may be formed outside the edge area.

Meanwhile, in the above, the specific frequency band may represent, for example, 400Tz to 790Tz, but is not limited thereto.

In relation to this, the display device 100 may include at least one of a first filter that filters only the output light of the color filter and a second filter that filters only the output light for the Li-Fi data. This may be to minimize or prevent signal interference that may occur depending on the two output lights. Depending on the embodiment, more filters may be added.

Referring to (b) of FIG. 9, the outside of the cabinet of the display device 100 may include an optical output slit for outputting the Li-Fi signal, for example, disposed on the top of the display panel. However, it is not limited to the above location. For example, the optical output slit may be formed on the upper part of the optical sheet described above. Meanwhile, the slit may also be used to allow only specific light to be output.

In addition, an optical sheet and an optical output slit are shown in (a) and (b) of FIGS. 9, respectively. The display device 100 may be equipped with both the optical sheet and the optical output slit or only one of them.

In distinguishing between Li-Fi data and non-Li-Fi data, the display device 100 may refer to the data structure or attribute information shown in FIG. 7.

Figure 7 shows a data frame structure, and this data frame may include a header, a body (body or main body), and a tailor part (not shown).

In the above, the body part is a part that contains actual data, the header part is a part that contains reference information for the data included in the body part, and the tailor part is a part that contains data related to error verification of the data frame. You can. However, the present disclosure is not necessarily limited to this data frame structure, and may be configured or defined differently.

For example, when the body part includes Li-Fi data, the MCU 610 may generate a data frame whose header part includes information indicating that Li-Fi data is included in the body part.

The data frame structure of FIG. 7 can be applied in the same or similar manner to, for example, Li-Fi data as well as non-Li-Fi data, that is, local dimming control data.

Referring to FIG. 7, the header part of the data frame may include information that can identify the type or attribute of the actual data included in the body part, for example, identifier (ID) information.

For convenience of explanation, in FIG. 7, '0x00' is a local dimming LED signal, '0x01' is a Li-Fi signal, and '0x10' and '0x11' are defined as preliminary field values for future use, but are not limited thereto. .

Referring to Figures 6 and 7, when data (or signal) is received, the input control unit 630 parses the header part of the data, extracts identifier information from the header, and receives data based on the extracted identifier information. You can identify whether the data is Li-Fi data.

Processing of Li-Fi data including audio data according to an embodiment of the present disclosure will be described.

Referring to FIG. 8, for example, Li-Fi data for transmitting audio data to an external device may be generated only in a section with audio data and not in the remaining sections.

When the audio data is dormant, for example, when there is silence or no audio output signal, other processing may be required. That is, if there is no audio data, the LED light source for Li-Fi data generation can be turned off, and if there is output, it can be turned on again. This may be perceived by the user as a flicker. Therefore, the corresponding section, that is, the section without audio data, can be designed for separate processing.

For example, as shown in FIG. 8, the display device 100 issues a data disable command from the first point 710 corresponding to the data enable command (LED blinking) at which audio data is output. Li-Fi data (LED blinking) can be generated and output up to the second point 720 corresponding to (data disable command) (LED blinking). And in the subsequent section, that is, the section 730 in which there is no audio data, FF data can be output (LED non-blinking) to prevent the above-mentioned flicker.

10 to 12 are diagrams to explain a method of controlling the operation of an external device through a Li-Fi signal in a display device according to an embodiment of the present disclosure.

Figures 14 and 15 are flowcharts for explaining a method of controlling the operation of an external device through a Li-Fi signal in a display device according to an embodiment of the present disclosure.

Referring to FIG. 14, the display device 100 (or control module) can receive an input signal (S203) even if the display panel is in an off state (S201).

The display device 100 may determine whether the received input is a Li-Fi LED communication request (S205).

As a result of the determination in step S205, if the received input signal is not a Li-Fi LED communication request, the display device 100 may perform a power-on operation of the display device 100 if it is a power-on signal, and the power -If the signal is not on, it can be ignored (S207).

If the received input signal is a Li-Fi LED communication request as a result of the determination in step S205, the display device 100 may generate a signal including Li-Fi data for Li-Fi LED communication (S209).

The display device 100 can output the generated Li-Fi LED communication signal to an external device (S211).

The display device 100 according to the present disclosure generates Li-Fi data using some light sources of the backlight. Usually, the display device 100 is in operation or in a power-on state, but the display device 100 is powered on. Even in this off or stand-by state (or Always on Display (AOD)), processing for Li-Fi signal-based communication support, operation control, etc. can be performed according to the present disclosure. In the above, the power-off of the display device 100 refers to a state in which at least the minimum driving power is being supplied to the display device 100 even though the display panel is turned off and a black screen appears.

Referring to (a) of FIG. 10, the display device 100 outputs video and audio through the display 180, and the audio is transmitted to external devices (Li-Fi speakers) 1010 and 1015 through Li-Fi signals. ) can be transmitted.

Referring to (b) of FIG. 10, the display device 100 outputs video and audio through the display 180, and simultaneously transmits the audio to a plurality of external devices 1030 to 1050 through a Li-Fi signal. Can be transmitted.

Depending on the embodiment, in Figure 10(b), one external device (e.g., smart speaker 1040) functions as an input means for requesting Li-Fi data based on Li-Fi visible light communication, and the remaining external device functions as an input means for requesting Li-Fi data. As described above, the devices 1030 and 1050 may receive a Li-Fi signal containing audio and function as an output means.

According to another embodiment, when a multi-view mode is being implemented on the display 180 of the display device 100, different audio data is included in each external device in (b) of FIG. 10. Li-Fi signals can be transmitted. For example, a first Li-Fi signal containing the first audio for the first video output from the display device 100 is transmitted to the first external device 1030, and the first Li-Fi signal is transmitted to the second external device 1040. A second Li-Fi signal including second audio for the second video may be transmitted. Meanwhile, a third Li-Fi signal containing audio data of an application running in the background of the display device 100 may be transmitted to the third external device 1050.

Referring to FIG. 15, the display device 100 can receive an input signal (S301).

The display device 100 may determine whether the received input signal is a Li-Fi LED communication request (S303).

As a result of the determination, if the received input signal is a Li-Fi LED communication request, the display device 100 may generate a Li-Fi LED control signal corresponding to the request (S305) and output the generated signal to an external device. (S307).

Meanwhile, if the received input signal is determined to be a Li-Fi LED communication request as a result of the above determination, the display device 100 may again determine whether it is a mirroring service request (S309).

As a result of the determination, if the received input signal is determined to be a mirroring service request, the display device 100 generates Li-Fi LED mirroring service data including information on the currently playing content (S311) and sends it to the external device that requested the mirroring service. A Li-Fi signal including the generated Li-Fi LED mirroring service data can be output (S313).

Accordingly, the external device can provide a mirroring screen for the content being output on the display device 100, as shown in FIG. 11.

Referring to FIG. 11 , the display device 100 outputs content 1110 through the display 180 .

At this time, the display device 100 transmits a Li-Fi signal for a mirroring service to surrounding external devices 1120 to 1140 through Li-Fi visible light communication according to the present disclosure, and displays the display on the screen of each external device. Operation can be controlled so that the same content as the device 100 can be enjoyed.

At this time, the mirroring service through Li-Fi visible light communication is provided through Li-Fi visible light communication at least one of the settings of the display device 100, the input of the user of the display device 100, or each surrounding external device. Mirroring service can be performed upon request.

Although in Figure 11, the mirroring service is provided on the entire screen of each nearby external device, it is not limited to this. For example, the mirroring service may be configured to output only split screens, pop-ups, audio, or video depending on the properties, types, or characteristics of each surrounding external device.

In FIG. 11, in each peripheral external device (1120 to 1140), guide information is provided in advance before the mirroring service screen through Li-Fi visible light communication according to the present disclosure is output to perform a permission or consent procedure for displaying the mirroring service screen. It can be done. At this time, if each peripheral external device (1120 to 1140) expresses its intention to accept/reject the mirroring service through Li-Fi visible light communication, it is fed back to the display device 100 and displayed on the screen of the display device 100. can be printed. In addition, the display device 100 may learn artificial intelligence by referring to the feedback data, and in the above-described case, may limit the mirroring service through Li-Fi visible light communication to the surrounding external device. However, cases where the surrounding external device requests mirroring service may be excluded.

Depending on the embodiment, even if a mirroring service through Li-Fi visible light communication is requested, the display device 100 individually generates mirroring data and signals through Li-Fi visible light communication for each surrounding external device to control individual operations. You can do it as well.

At this time, if there is a problem such as insufficient resources in the individual creation in the display device 100, after determining the priority or weight for the surrounding external device, the priority or weight is determined. It is also possible to control the operation of only some nearby external devices with high weight by providing a mirroring service through Li-Fi visible light communication.

According to another embodiment, when controlling the operation of the display device 100 by transmitting a mirroring signal through individual Li-Fi visible light communication to each surrounding external device, an error occurs in at least one surrounding external device. If this occurs or another input occurs, the provision of mirroring service through Li-Fi visible light communication for the relevant nearby external device or all surrounding external devices in mirroring service will be temporarily suspended, and the service will be resumed after processing the issue. It may be possible.

Meanwhile, as shown in FIG. 11, the home menu bar may be provided only on the display 180 of the display device 100 and may not be provided on the screens 1120 to 1140 of the external device. However, the present disclosure is not limited to this, and menus, etc. may be provided through Li-Fi signals according to requests, etc.

For example, in FIG. 12, according to at least one embodiment of the various embodiments of the present disclosure, the display device 100 capable of receiving and emitting Li-Fi signals is connected to other surrounding external devices including IoT devices or sensors. It can also perform the AP (Access Point) function.

In (a) of FIG. 12, for example, when a user wants to transmit a Li-Fi signal to control the washing machine 1220 through the smart speaker 1210, the network is different or direct communication is not smooth. Otherwise, when the Li-Fi signal is transmitted, the display device 100 receives the Li-Fi signal from the smart speaker 1210 even if the screen 180 is turned off, and the corresponding Li-Fi signal is transmitted. The signal can be broadcast (or unicast method is also possible) like an AP on the network.

At this time, the smart speaker 1210 may first request the display device 100 to perform the AP function as described above, and the display device 100 may request the Li-Fi signal even without a request from the smart speaker 1210. When light is received, the AP function may be automatically performed. Depending on the embodiment, in the latter case, for example, the display device 100 performs the automatic AP function only when the panel is off, and when the panel is on, there is a request from the smart speaker 1210 as in the former. The AP function may be performed only in certain cases.

Meanwhile, when a Li-Fi signal is received from the smart speaker 1210, the display device 100 may focus only on performing a simple AP function without processing it, but may parse the received Li-Fi signal to target (e.g., After identifying the washing machine 1220, the Li-Fi signal for the identified target may be regenerated and output.

In (a) of FIG. 12 described above, for example, the display device 100, the smart speaker 1210, and the washing machine 1220 may all belong to the same network, but the present invention is not limited thereto.

Meanwhile, in Figure 12 (b), when the display device 100 is turned on, the display device 100 operates the AP function between the smart speaker 1210 and the washing machine 1220 as shown in Figure 12 (a). While operating, the content currently being played on the display 180 may be provided to the laptop 1230 as a mirroring service using a Li-Fi signal for Li-Fi visible light communication.

Meanwhile, depending on the embodiment, the display device 100 according to the present disclosure may assign each edge of the four edges to a different device, thereby generating Li-Fi data related to the other assigned device. For example, in (b) of FIG. 12, the edge of the first side of the four sides is allocated and mapped for the smart speaker 1210, the edge of the second side is allocated and mapped for the washing machine 1220, and the edge of the third side is mapped. The edge of is allocated and mapped for the laptop 1230, and Li-Fi data can be generated and used using the light source of the edge. In the above, the edge of the remaining side may be used for general purposes or special purposes. The special purpose may be one of emergency or emergency use, a specific user, a specific event, or AP mode for controlling IoT devices.

The sequence included in the flowchart shown in FIGS. 13 to 15 is an example according to the present disclosure, and the present disclosure is not limited thereto. In other words, depending on the embodiment, one or more steps in the flowchart may be performed simultaneously or may be operated in a different order than shown. In addition, although it is shown as one step in FIGS. 13 to 15, depending on the embodiment, the step may be divided into a plurality of steps and operated, and vice versa.

In addition, although not shown, one or more operations related to the present disclosure may be further performed.

According to at least one embodiment of the various embodiments of the present disclosure described above, the display device 100 may control the operation of at least one external device using a Li-Fi signal, and the display device 100 may control the operation of at least one external device using the Li-Fi signal. A display device that not only can seamlessly provide various services such as mirroring services to at least one external device, but can also receive and emit Li-Fi signals upon request even if the panel is turned off. It can also function as an AP (Access Point) for other nearby external devices, including IoT devices and corresponding sensors.

The above description is merely an illustrative explanation of the technical idea of the present disclosure, and those skilled in the art will be able to make various modifications and variations without departing from the essential characteristics of the present disclosure.

Accordingly, the embodiments disclosed in the present disclosure are not intended to limit the technical idea of the present disclosure but are for illustrative purposes, and the scope of the technical idea of the present disclosure is not limited by these embodiments.

The scope of protection of this disclosure should be interpreted in accordance with the claims below, and all technical ideas within the equivalent scope should be interpreted as being included in the scope of rights of this disclosure.

100: display device 130: broadcast receiver
135: External device interface 140: Memory
150: User input interface 170: Controller
173: wireless communication interface 180: display
185: Speaker 190: Power supply circuit
200: remote control device 270: DB
280: Controller
610: MCU 620: Multi-driver IC unit
630: input control unit 640: data splitter unit
650, 660: signal generator

Claims (10)

In the display device,
A backlight containing a light source;
display panel; and
and a signal generator that generates a Li-Fi signal based on Li-Fi (Light-Fidelity) data generated using some light sources of the backlight, and transmits the generated Li-Fi signal to the at least one external device. Comprising a control module that controls the operation of the device,
Display device. According to paragraph 1,
The control module is,
Comprising a data splitter that separates the local dimming signal in the first frequency band and the Li-Fi data in the second frequency band from the input signal,
Display device. According to paragraph 2,
Contains more color filters,
Containing at least one of a first filter for filtering the output light of the color filter and a second filter for filtering the output light for the Li-Fi data,
Display device. According to paragraph 2,
The Li-Fi data is,
Generated using a light source in the edge area of the backlight,
Display device. According to clause 4,
The Li-Fi data is,
Contains header and body parts,
The header part includes an identifier that identifies the data as Li-Fi data,
Display device. According to paragraph 4,
In the edge area of the backlight,
An optical sheet that allows only wavelengths in a specific visible light range to pass has been added.
Display device. According to clause 6,
disposed on the upper part of the display panel, further comprising an optical output slit for outputting the Li-Fi signal,
Display device. According to paragraph 1,
The Li-Fi data is,
Containing at least one of audio, video and text data,
Display device. According to paragraph 2,
The control module is,
Driver IC,
Display device. In a method of controlling the operation of at least one external device in a display device using a Li-Fi signal,
Generating Li-Fi (Light-Fidelity) data using some light sources of the backlight;
receiving an input signal;
Separating and extracting the generated Li-Fi data from the received input signal;
Generating a Li-Fi signal based on the separately extracted Li-Fi data; and
Comprising transmitting the generated Li-Fi signal to the at least one external device,
A method of controlling external device operation of a display device.

Images