WO2021066210A1

WO2021066210A1 - Display device and display system

Info

Publication number: WO2021066210A1
Application number: PCT/KR2019/012742
Authority: WO
Inventors: 김창회
Original assignee: 엘지전자 주식회사
Priority date: 2019-09-30
Filing date: 2019-09-30
Publication date: 2021-04-08

Abstract

The present invention provides a display device and a display system for securing a frequency band for smooth signal transmission and reception between a display device and a remote control device. The display device may comprise: a user input interface unit which transmits and receives wireless signals to and from the remote control device; and a control unit for controlling the wireless signal transmission mode of the remote control device to be a first mode or a second mode according to the wireless environment.

Description

Display device and display system

The present invention relates to a display device and a display system including a display device and a remote control device.

When using the display device, the user can use the display device more conveniently by using the remote control device. For example, a user far away from the display device can conveniently control the display device through the remote control device.

In recent years, it is possible to control the display device while being connected to the remote control device via Bluetooth, and accordingly, a function of moving a pointer displayed on the display device according to the motion of the remote control device is supported. Control of the display device through the device has become easier.

To support the above functions, the remote control device may periodically transmit packets to the display device. Meanwhile, in addition to the remote control device, other Bluetooth devices may be connected to the display device. In this case, other devices may use a significant amount of the Bluetooth frequency band, and thus packet transmission from the remote control device to the display device may not be smooth.

In addition, when Wi-Fi communication is formed in an environment in which the display device is installed, a problem may occur in packet transmission from the remote control device to the display device due to interference between Bluetooth communication and Wi-Fi communication.

The present invention is to provide a display device and a display system for securing a frequency band for transmitting and receiving signals between a display device and a remote control device.

An object of the present invention is to provide a display device and a display system for controlling a remote control device so that Bluetooth devices including a remote control device can more smoothly transmit and receive signals when the majority of channels in a Bluetooth frequency band are used.

The present invention is to provide a display device and a display system capable of easily obtaining a signal transmission/reception status from a remote control device.

The present invention is to provide a display device and a display system for minimizing and compensating for loss of packets transmitted from a remote control device.

A display device according to an embodiment of the present invention includes a user input interface unit for transmitting and receiving a wireless signal to and from a remote control device, and a control unit for controlling a wireless signal transmission mode of the remote control device to a first mode or a second mode according to a wireless environment. Can include.

The controller may calculate a loss rate of a packet received from the remote control device and determine a wireless environment based on the loss rate of the packet.

If the packet loss rate is less than a preset threshold, the controller may determine the wireless environment as a normal state, and if the packet loss rate is greater than the threshold, the wireless environment may be determined as a busy state.

If the wireless environment is in the normal state, the control unit transmits a command to control the wireless signal transmission mode of the remote control device to the first mode, and if the wireless environment is busy, the wireless signal transmission mode of the remote control device is set to the second mode. Commands controlled by can be transmitted to the remote control device.

The second mode may be a wireless signal transmission mode in which the transmission period is longer than the transmission period in the first mode, and the data size is larger than the data size in the first mode.

A display system according to an embodiment of the present invention includes a remote control device and a display device that transmits and receives wireless signals to and from the remote control device, and the display device sets the wireless signal transmission mode of the remote control device to a first mode or It can be controlled in the second mode.

In the first mode, the remote control device transmits a packet having a data size of the first size to the display device every first period, and in the second mode, the data size is greater than the first size every second period that is longer than the first period. A packet of the second size may be transmitted to the display device.

The second period may be twice the first period, and the second period may be three times the first period.

In the second mode, the remote control device may change the transmission period to be longer than that of the first mode, and may perform encoding processing by increasing the amount of data per packet compared to the first mode.

When detecting the occurrence of packet loss in the second mode, the display device may calculate compensation data based on a packet received before the packet loss occurs and a packet received after the packet loss occurs.

When the remote control device transmits the packet to the display device, it can add a time stamp to the packet.

The display device may calculate a loss rate of a packet received from the remote control device and determine a wireless environment based on the loss rate of the packet.

The display device may determine the wireless environment as a normal state when the packet loss rate is less than a preset threshold value, and may determine the wireless environment as a busy state when the packet loss rate is greater than the threshold value.

If the wireless environment is in a normal state, the display device transmits a command to control the wireless signal transmission mode of the remote control device to the first mode, and if the wireless environment is busy, the wireless signal transmission mode of the remote control device is set to a second mode. Commands to be controlled in mode can be transmitted to the remote control device.

The display device may count the number of packets received from the remote control device and calculate a packet loss rate based on the number of packets received during a preset time.

According to an embodiment of the present invention, it is possible to smoothly transmit and receive signals between a display device and a remote control device regardless of a wireless environment, and accordingly, the display device can be operated more accurately according to a command input by a user to the remote control device. have.

In addition, the display device has an advantage of minimizing and supplementing packet loss according to a wireless environment, thereby minimizing errors such as performing an operation different from a command input to the remote control device.

In addition, since the display device can acquire the state of the wireless environment, there is an advantage of being able to adaptively respond to changes in the wireless environment.

In addition, the display device has an advantage of improving operation accuracy by supplementing the packet delay through a time stamp or the like.

1 is a block diagram illustrating a configuration of a display device according to an embodiment of the present invention.

2 is a block diagram of a remote control device according to an embodiment of the present invention.

3 shows an example of an actual configuration of a remote control device according to an embodiment of the present invention.

4 shows an example of using a remote control device according to an embodiment of the present invention.

5 is a flowchart illustrating a method of operating a display system according to an exemplary embodiment of the present invention.

6 is a flowchart illustrating a method of determining a wireless environment of a display device according to an embodiment of the present invention.

FIG. 7 is an exemplary diagram illustrating a state in which a display device according to an embodiment of the present invention receives and reads a packet when a wireless signal transmission mode of a remote control device is a first mode.

FIG. 8 is an exemplary diagram illustrating packet loss when a wireless signal transmission mode of a remote control device according to an embodiment of the present invention is a first mode.

9 is an exemplary diagram illustrating a state in which a display device according to an embodiment of the present invention receives and reads a packet when a wireless signal transmission mode of a remote control device is a second mode.

10 is an exemplary diagram illustrating a packet loss state and a method of compensating for a lost packet when a wireless signal transmission mode of a remote control apparatus according to an embodiment of the present invention is a second mode.

11 is an exemplary diagram illustrating a case in which a packet received by a display device according to an embodiment of the present invention is delayed.

Hereinafter, embodiments related to the present invention will be described in more detail with reference to the drawings. The suffixes "module" and "unit" for components used in the following description are given or used interchangeably in consideration of only the ease of preparation of the specification, and do not have meanings or roles that are distinguished from each other by themselves.

Referring to FIG. 1, the display device 100 includes a broadcast receiving unit 130, an external device interface unit 135, a storage unit 140, a user input interface unit 150, a control unit 170, and a wireless communication unit 173. , A voice acquisition unit 175, a display unit 180, an audio output unit 185, and a power supply unit 190 may be included.

The broadcast reception unit 130 may include a tuner 131, a demodulation unit 132, and a network interface unit 133.

The tuner 131 may tune into a specific broadcast channel according to a channel selection command. The tuner 131 may receive a broadcast signal for a selected specific broadcast channel.

The demodulator 132 may divide the received broadcast signal into a video signal, an audio signal, and a data signal related to a broadcast program, and restore the separated video signal, audio signal, and data signal into a form capable of outputting.

The network interface unit 133 may provide an interface for connecting the display device 100 to a wired/wireless network including an Internet network. The network interface unit 133 may transmit or receive data with other users or other electronic devices through a connected network or another network linked to the connected network.

The network interface unit 133 may access a predetermined web page through a connected network or another network linked to the connected network. That is, by accessing a predetermined web page through a network, the server and data can be transmitted or received.

In addition, the network interface unit 133 may receive content or data provided by a content provider or a network operator. That is, the network interface unit 133 may receive content such as movies, advertisements, games, VODs, broadcast signals, and related information provided from a content provider or a network provider through a network.

In addition, the network interface unit 133 may receive update information and an update file of firmware provided by a network operator, and may transmit data to an Internet or content provider or network operator.

The network interface unit 133 may select and receive a desired application from among applications open to the public through a network.

The external device interface unit 135 may receive an application or an application list in an adjacent external device and transmit it to the control unit 170 or the storage unit 140.

The external device interface unit 135 may provide a connection path between the display device 100 and an external device. The external device interface unit 135 may receive one or more of an image and audio output from an external device connected to the display device 100 by wire or wirelessly, and transmit it to the control unit 170. The external device interface unit 135 may include a plurality of external input terminals. The plurality of external input terminals may include an RGB terminal, one or more HDMI (High Definition Multimedia Interface) terminals, and a component terminal.

An image signal of an external device input through the external device interface unit 135 may be output through the display unit 180. The audio signal of an external device input through the external device interface unit 135 may be output through the audio output unit 185.

The external device connectable to the external device interface unit 135 may be any one of a set-top box, a Blu-ray player, a DVD player, a game console, a sound bar, a smartphone, a PC, a USB memory, and a home theater, but this is only an example. .

In addition, some content data stored in the display device 100 may be transmitted to another user registered in advance in the display device 100 or a selected user or a selected electronic device among other electronic devices.

The storage unit 140 may store a program for processing and controlling each signal in the controller 170, and may store a signal-processed image, audio, or data signal.

In addition, the storage unit 140 may perform a function for temporary storage of a video, audio, or data signal input from the external device interface unit 135 or the network interface unit 133. You can also store information about the image.

The storage unit 140 may store an application or an application list input from the external device interface unit 135 or the network interface unit 133.

The display device 100 may play content files (movie files, still image files, music files, document files, application files, etc.) stored in the storage unit 140 and provide them to a user.

The user input interface unit 150 may transmit a signal input by the user to the controller 170 or may transmit a signal from the controller 170 to the user. For example, the user input interface unit 150 according to various communication methods such as Bluetooth, WB (Ultra Wideband), ZigBee method, RF (Radio Frequency) communication method, or infrared (IR) communication method, Control signals such as power on/off, channel selection, and screen setting may be received and processed from the remote control device 200, or a control signal from the control unit 170 may be transmitted to the remote control device 200.

In addition, the user input interface unit 150 may transmit a control signal input from a local key (not shown) such as a power key, a channel key, a volume key, and a set value to the control unit 170.

The image signal processed by the controller 170 may be input to the display unit 180 and displayed as an image corresponding to the corresponding image signal. In addition, the image signal processed by the controller 170 may be input to an external output device through the external device interface unit 135.

The audio signal processed by the controller 170 may be audio output to the audio output unit 185. In addition, the voice signal processed by the control unit 170 may be input to an external output device through the external device interface unit 135.

In addition, the controller 170 may control the overall operation of the display apparatus 100.

In addition, the control unit 170 may control the display device 100 by a user command or an internal program input through the user input interface unit 150, and access the network to display an application or application list desired by the user. It can be downloaded within (100).

The control unit 170 enables channel information selected by the user to be output through the display unit 180 or the audio output unit 185 together with the processed image or audio signal.

In addition, the control unit 170, in accordance with the external device image playback command received through the user input interface unit 150, from an external device input through the external device interface unit 135, for example, from a camera or camcorder, An image signal or an audio signal may be output through the display unit 180 or the audio output unit 185.

Meanwhile, the control unit 170 may control the display unit 180 to display an image, for example, a broadcast image input through the tuner 131 or an external input input through the external device interface unit 135 An image, an image input through the network interface unit, or an image stored in the storage unit 140 may be controlled to be displayed on the display unit 180. In this case, the image displayed on the display unit 180 may be a still image or a moving image, and may be a 2D image or a 3D image.

In addition, the controller 170 may control content stored in the display device 100, received broadcast content, and external input content input from the outside to be played, and the content includes a broadcast image, an external input image, an audio file, and a stop. It may be in various forms such as an image, a connected web screen, and a document file.

The wireless communication unit 173 may communicate with an external device through wired or wireless communication. The wireless communication unit 173 may perform short range communication with an external device. To this end, the wireless communication unit 173 includes Bluetooth™, Bluetooth Low Energy (BLE), Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and NFC (Near NFC). Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless Universal Serial Bus (USB) technologies may be used to support short-range communication. The wireless communication unit 173 is provided between the display device 100 and a wireless communication system, between the display device 100 and another display device 100, or between the display device 100 and the display device 100 through wireless area networks. Wireless communication between networks in which the display device 100 or an external server is located may be supported. The local area wireless communication networks may be wireless personal area networks (Wireless Personal Area Networks).

Here, the other display device 100 is a wearable device capable of exchanging (or interlocking with) data with the display device 100 according to the present invention, for example, a smartwatch, smart glasses. (smart glass), HMD (head mounted display)), it can be a mobile terminal such as a smart phone. The wireless communication unit 173 may detect (or recognize) a wearable device capable of communicating around the display apparatus 100. Furthermore, when the sensed wearable device is an authenticated device to communicate with the display apparatus 100 according to the present invention, the control unit 170 transmits at least part of the data processed by the display apparatus 100 to the wireless communication unit ( 173) can be transmitted to the wearable device. Accordingly, a user of the wearable device may use data processed by the display apparatus 100 through the wearable device.

The voice acquisition unit 175 may acquire audio. The voice acquisition unit 175 may include at least one microphone (not shown), and may acquire audio around the display apparatus 100 through a microphone (not shown).

The display unit 180 converts an image signal, a data signal, an OSD signal processed by the control unit 170, or an image signal and a data signal received from the external device interface unit 135 into R, G, and B signals, respectively. Can generate signals.

Meanwhile, since the display device 100 shown in FIG. 1 is only an embodiment of the present invention. Some of the illustrated components may be integrated, added, or omitted according to the specifications of the display device 100 that is actually implemented.

That is, if necessary, two or more components may be combined into one component, or one component may be subdivided into two or more components to be configured. In addition, functions performed by each block are for explaining an embodiment of the present invention, and specific operations or devices thereof do not limit the scope of the present invention.

According to another embodiment of the present invention, unlike FIG. 1, the display apparatus 100 does not include a tuner 131 and a demodulation unit 132, but a network interface unit 133 or an external device interface unit ( 135) can also be received and played.

For example, the display device 100 is implemented by being divided into an image processing device such as a set-top box, such as for receiving broadcast signals or contents according to various network services, and a content reproducing device for reproducing content input from the image processing device. Can be.

In this case, the method of operating the display device according to an embodiment of the present invention to be described below is not only the display device 100 as described with reference to FIG. 1, but also an image processing device or display unit 180 such as a separate set-top box. ) And an audio output unit 185.

The audio output unit 185 receives a signal processed by the control unit 170 and outputs it as a voice.

The power supply unit 190 supplies corresponding power to the entire display apparatus 100. In particular, power is supplied to the control unit 170 that can be implemented in the form of a System On Chip (SOC), the display unit 180 for image display, and the audio output unit 185 for audio output. I can.

Specifically, the power supply unit 190 may include a converter that converts AC power to DC power and a dc/dc converter that converts the level of the DC power.

Next, a remote control device according to an embodiment of the present invention will be described with reference to FIGS. 2 to 3.

2 is a block diagram of a remote control device according to an embodiment of the present invention, and FIG. 3 is a block diagram showing an example of an actual configuration of a remote control device according to an embodiment of the present invention.

First, referring to FIG. 2, the remote control device 200 includes a fingerprint recognition unit 210, a wireless communication unit 220, a user input unit 230, a sensor unit 240, an output unit 250, and a power supply unit 260. ), a storage unit 270, a control unit 280, and a voice acquisition unit 290.

Referring to FIG. 2, the wireless communication unit 220 transmits and receives signals to and from any one of the display devices according to the exemplary embodiments described above.

The remote control device 200 includes an RF module 221 capable of transmitting and receiving signals with the display device 100 according to the RF communication standard, and capable of transmitting and receiving signals with the display device 100 according to the IR communication standard. An IR module 223 may be provided. In addition, the remote control device 200 may include a Bluetooth module 225 capable of transmitting and receiving signals to and from the display device 100 according to a Bluetooth communication standard. In addition, the remote control device 200 includes an NFC module 227 capable of transmitting and receiving signals with the display device 100 according to the NFC (Near Field Communication) communication standard, and the display according to the WLAN (Wireless LAN) communication standard. A WLAN module 229 capable of transmitting and receiving signals to and from the device 100 may be provided.

In addition, the remote control device 200 transmits a signal containing information about the movement of the remote control device 200 to the display device 100 through the wireless communication unit 220.

On the other hand, the remote control device 200 may receive a signal transmitted from the display device 100 through the RF module 221, and, if necessary, the power to the display device 100 through the IR module 223 / Commands related to off, channel change, volume change, etc. can be transmitted.

The user input unit 230 may include a keypad, a button, a touch pad, or a touch screen. A user may input a command related to the display device 100 to the remote control device 200 by manipulating the user input unit 230. When the user input unit 230 includes a hard key button, the user may input a command related to the display device 100 to the remote control device 200 through a push operation of the hard key button. This will be described with reference to FIG. 3.

Referring to FIG. 3, the remote control device 200 may include a plurality of buttons. The plurality of buttons include a fingerprint recognition button 212, a power button 231, a home button 232, a live button 233, an external input button 234, a volume control button 235, a voice recognition button 236, A channel change button 237, a confirmation button 238, and a back button 239 may be included.

The fingerprint recognition button 212 may be a button for recognizing a user's fingerprint. As an example, the fingerprint recognition button 212 is capable of a push operation and may receive a push operation and a fingerprint recognition operation. The power button 231 may be a button for turning on/off the power of the display apparatus 100. The home button 232 may be a button for moving to the home screen of the display device 100. The live button 233 may be a button for displaying a real-time broadcast program. The external input button 234 may be a button for receiving an external input connected to the display device 100. The volume control button 235 may be a button for adjusting the volume of the volume output by the display apparatus 100. The voice recognition button 236 may be a button for receiving a user's voice and recognizing the received voice. The channel change button 237 may be a button for receiving a broadcast signal of a specific broadcast channel. The confirmation button 238 may be a button for selecting a specific function, and the back button 239 may be a button for returning to a previous screen.

2 will be described again.

When the user input unit 230 includes a touch screen, the user may input a command related to the display device 100 to the remote control device 200 by touching a soft key on the touch screen. In addition, the user input unit 230 may include various types of input means that a user can manipulate, such as a scroll key or a jog key, and the present embodiment does not limit the scope of the present invention.

The sensor unit 240 may include a gyro sensor 241 or an acceleration sensor 243, and the gyro sensor 241 may sense information about movement of the remote control device 200.

For example, the gyro sensor 241 may sense information on the operation of the remote control device 200 based on the x, y, and z axes, and the acceleration sensor 243 is the moving speed of the remote control device 200 Information about the back can be sensed. On the other hand, the remote control device 200 may further include a distance measuring sensor, so that the distance to the display unit 180 of the display device 100 may be sensed.

The output unit 250 may output an image or audio signal corresponding to an operation of the user input unit 230 or a signal transmitted from the display apparatus 100. Through the output unit 250, the user may recognize whether the user input unit 230 is operated or whether the display apparatus 100 is controlled.

For example, the output unit 250 includes an LED module 251 that lights up when a user input unit 230 is manipulated or a signal is transmitted and received with the display device 100 through the wireless communication unit 220, and a vibration module that generates vibration ( 253), a sound output module 255 for outputting sound, or a display module 257 for outputting an image may be provided.

In addition, the power supply unit 260 supplies power to the remote control device 200, and when the remote control device 200 is not moved for a predetermined period of time, the power supply may be stopped, thereby reducing power waste. The power supply unit 260 may resume power supply when a predetermined key provided in the remote control device 200 is operated.

The storage unit 270 may store various types of programs and application data necessary for controlling or operating the remote control device 200. If the remote control device 200 wirelessly transmits and receives signals through the display device 100 and the RF module 221, the remote control device 200 and the display device 100 transmit and receive signals through a predetermined frequency band. .

The control unit 280 of the remote control device 200 stores information about a frequency band through which signals can be wirelessly transmitted and received with the display device 100 paired with the remote control device 200 in the storage unit 270 for reference. can do.

The controller 280 controls all items related to the control of the remote control device 200. The control unit 280 transmits a signal corresponding to the operation of a predetermined key by the user input unit 230 or a signal corresponding to the movement of the remote control device 200 sensed by the sensor unit 240 through the wireless communication unit 220. 100).

In addition, the voice acquisition unit 290 of the remote control device 200 may acquire a voice.

The voice acquisition unit 290 may include at least one microphone 291, and may acquire a voice through the microphone 291.

Next, FIG. 4 will be described.

4A illustrates that a pointer 205 corresponding to the remote control device 200 is displayed on the display unit 180.

The user can move or rotate the remote control device 200 up and down, left and right. The pointer 205 displayed on the display unit 180 of the display device 100 corresponds to the movement of the remote control device 200. As shown in the figure, since the corresponding pointer 205 is moved and displayed according to the movement in the 3D space, the remote control device 200 may be referred to as a space remote controller.

4B illustrates that when the user moves the remote control apparatus 200 to the left, the pointer 205 displayed on the display unit 180 of the display apparatus 100 also moves to the left in response thereto.

Information on the movement of the remote control device 200 detected through a sensor of the remote control device 200 is transmitted to the display device 100. The display device 100 may calculate the coordinates of the pointer 205 from information about the movement of the remote control device 200. The display apparatus 100 may display the pointer 205 to correspond to the calculated coordinates.

4C illustrates a case in which a user moves the remote control device 200 away from the display unit 180 while pressing a specific button in the remote control device 200. Accordingly, the selection area in the display unit 180 corresponding to the pointer 205 may be zoomed in and displayed in an enlarged manner.

Conversely, when the user moves the remote control device 200 to be close to the display unit 180, a selection area in the display unit 180 corresponding to the pointer 205 may be zoomed out and displayed in a reduced size.

Meanwhile, when the remote control device 200 moves away from the display unit 180, the selection area may be zoomed out, and when the remote control device 200 approaches the display unit 180, the selected area may be zoomed in.

In addition, when a specific button in the remote control apparatus 200 is pressed, recognition of vertical and horizontal movement may be excluded. That is, when the remote control device 200 moves away from or approaches the display unit 180, up, down, left, and right movements are not recognized, but only forward and backward movements may be recognized. When a specific button in the remote control device 200 is not pressed, only the pointer 205 moves according to the up, down, left, and right movement of the remote control device 200.

Meanwhile, the moving speed or moving direction of the pointer 205 may correspond to the moving speed or moving direction of the remote control device 200.

Meanwhile, in the present specification, a pointer refers to an object displayed on the display unit 180 in response to an operation of the remote control device 200. Accordingly, objects of various shapes other than the arrow shape shown in the drawing are possible with the pointer 205. For example, it may be a concept including a point, a cursor, a prompt, a thick outline, and the like. In addition, the pointer 205 may be displayed corresponding to any one of the horizontal axis and the vertical axis on the display unit 180, as well as corresponding to a plurality of points such as a line and a surface. Do.

The remote control device 200 may transmit and receive wireless signals to and from the display device 100 through Bluetooth communication.

When the motion of the remote control device 200 is detected, the remote control device 200 may transmit a wireless signal including data on motion of the remote control device 200 to the display device 100.

In addition, when obtaining a voice through the voice acquisition unit 290, the remote control apparatus 200 may transmit a wireless signal including data on voice to the display apparatus 100.

For example, when transmitting data on motion to the display device 100, the remote control device 200 transmits a packet of 22 bytes every 10 ms transmission period, and transmits data on voice to the display device 100. ), a packet of 126 bytes can be transmitted every 15 ms transmission period.

In this way, since the remote control device 200 continuously transmits motion or voice data to the display device 100 at every preset transmission period, the remote control device 200 may occupy a significant amount of the Bluetooth frequency bandwidth.

However, in addition to the remote control device 200, other Bluetooth devices such as a Bluetooth speaker, a Bluetooth keyboard, or a Bluetooth joystick may be connected to the display device 100, and in this case, Bluetooth communication of the remote control device 200 is performed by the other Bluetooth device. It may not be smooth.

In addition, when Wi-Fi is installed in the environment in which the display device 100 is provided, packets transmitted by the remote control device 200 may be lost or pushed due to interference between Bluetooth communication and Wi-Fi communication. have.

In particular, as the data transmission speed of Bluetooth communication increases, the data interference phenomenon of Bluetooth communication may become more severe.

Accordingly, the display system according to an embodiment of the present invention seeks to secure a bandwidth for smooth Bluetooth communication between the display device 100 and the remote control device 200.

The display system according to an exemplary embodiment of the present invention aims to minimize and supplement a packet loss and propagation problem between the display device 100 and the remote control device 200.

The display system may include a display device 100 and a remote control device 200.

The control unit 170 of the display apparatus 100 may determine a wireless environment (S11).

The wireless environment may refer to an environment in which wireless signals are transmitted and received between the display device 100 and the remote control device 200. For example, the wireless environment may refer to an environment for transmitting and receiving signals through Bluetooth communication between the display device 100 and the remote control device 200.

The wireless environment may be in a normal state or a busy state.

The normal state may mean a state in which packet transmission/reception between the display device 100 and the remote control device 200 through Bluetooth is smooth. The general state may be a state in which the number of empty channels in the Bluetooth frequency band exceeds a preset number.

The busy state may mean a state in which packet transmission/reception between the display device 100 and the remote control device 200 through Bluetooth is not smooth. The busy state may be a state in which the number of empty channels in the Bluetooth frequency band is less than a preset number.

Meanwhile, the terms'normal state' and'busy state' used in the present invention are merely examples for convenience of description, so it is reasonable that the terms are not limited thereto. In addition, although the wireless environment is divided into two states in the present invention, this is also merely an example for convenience of description, and the wireless environment may be divided into two or more states. Hereinafter, it is assumed that the wireless environment is classified into a normal state or a busy state.

The controller 170 of the display apparatus 100 may determine whether the wireless environment is in a normal state or a busy state.

There may be various methods for the control unit 170 to determine the wireless environment.

According to an embodiment, the controller 170 may determine a wireless environment by monitoring a packet received from the remote control device 200.

Next, a method of determining a wireless environment of the display device 100 according to an embodiment of the present invention will be described.

6 may be a flow chart embodied in step S11 of FIG. 5.

The control unit 170 may count the number of packets received from the remote control device 200 (S101).

The control unit 170 may calculate a packet loss rate based on the counted number of packets (S103).

The loss rate of packet may mean a ratio of the number of packets not received to the number of packets scheduled to be received during a preset time. For example, when the number of packets scheduled to be received during a preset time is 10 and the number of unreceived packets is 3, the packet loss rate may be 30%.

The number of packets scheduled to be received during a preset time may be previously stored in the storage unit 140.

Accordingly, the controller 170 may count the number of packets received from the remote control apparatus 200 and calculate a packet loss rate based on the number of packets received during a preset time.

The control unit 170 may compare the packet loss rate with a preset threshold (S105).

If the packet loss rate is less than a preset threshold, the controller 170 may determine the wireless environment as a normal state (S107), and if the packet loss rate is greater than a preset threshold, the wireless environment may be determined as a busy state ( S109).

The threshold value may be previously stored in the storage unit 140.

For example, if the threshold value is 35 (%), the control unit 170 determines the wireless environment as a normal state if the packet loss rate is less than 35 (%), and if the packet loss rate is greater than 35 (%), the You can judge the environment as busy.

In this way, the control unit 170 may determine the wireless environment based on the packet loss rate.

Similarly, the control unit 170 may determine a wireless environment based on a packet reception rate. For example, the packet reception rate may be calculated as a ratio of the number of packets received to the number of packets scheduled to be received during a preset time. In this case, the control unit 170 sets the wireless environment to a normal state when the reception rate of the packet is greater than a preset threshold And, if the packet reception rate is less than a preset threshold, the wireless environment may be determined as a busy state.

As described above, there may be various methods for the control unit 170 to determine the wireless environment.

Again, Fig. 5 will be described.

The control unit 170 may obtain whether the wireless environment is in a general state (S13).

Conversely, the controller 170 may obtain whether the wireless environment is in a busy state. That is, in step S13, the controller 170 may determine what state the wireless environment is in.

If the wireless environment is in a normal state, the controller 170 may control the wireless signal transmission mode of the remote control device 200 to the first mode (S15).

When the wireless environment is in a general state, the controller 170 may transmit a command for controlling the wireless signal transmission mode of the remote control device 200 to the first mode to the remote control device 200.

If the wireless environment is not in a general state, the controller 170 may control the wireless signal transmission mode of the remote control device 200 to the second mode (S17).

That is, when the wireless environment is busy, the controller 170 may transmit a command for controlling the wireless signal transmission mode of the remote control device 200 to the second mode to the remote control device 200.

That is, the controller 170 may control the wireless signal forwarding mode of the remote control device 200 to the first mode or the second mode according to the wireless environment.

The remote control device 200 may receive a command for controlling the wireless signal transmission mode to the first mode or the second mode from the display device 100.

The wireless signal transmission mode may refer to a method in which the remote control device 200 transmits a wireless signal to the display device 100.

The controller 280 of the remote control device 200 may switch the wireless signal transmission mode according to a control command received from the display device 100.

The control unit 280 of the remote control device 200 may determine a wireless signal transmission mode.

First, the control unit 280 of the remote control device 200 may determine whether the wireless signal transmission mode is the first mode (S19).

If the wireless signal transmission mode is the first mode, the control unit 280 may generate a packet having a data size of the first size every first period (S21).

When the wireless signal transmission mode is not the first mode, the controller 280 may determine whether the wireless signal transmission mode is the second mode (S23).

If the wireless signal transmission mode is the second mode, the control unit 280 may generate a packet having a data size of the second size every second period (S25).

In the second mode, the controller 280 may change the transmission period to be longer than that of the first mode, and may perform encoding processing by increasing the amount of data per packet compared to the first mode.

The controller 280 may transmit a packet generated in the first mode or the second mode to the display apparatus 100 (S27).

The first mode is a method of transmitting a wireless signal from the remote control device 200 to the display device 100 when the wireless environment is in a normal state, and the second mode uses more frequency channels than when the wireless environment is in a normal state. In the active state, the remote control device 200 may transmit a wireless signal to the display device 100. That is, the second mode may be a method of transmitting a wireless signal from the remote control device 200 to the display device 100 when the wireless environment is busy.

The period for transmitting the radio signal is longer in the second mode than in the first mode. That is, the transmission period in the second mode is longer than the transmission period in the first mode.

The size of data included in one packet is larger in the second mode than in the first mode. That is, the size of data included in one packet in the second mode is larger than the size of data included in one packet in the first mode. The data size may be the length of the data or the amount of data.

When a packet consists of a header part and a data part, the data size may mean the size of the data part excluding the header part.

In the first mode, the remote control device 200 transmits a packet having a data size of the first size to the display device 100 every first period, and in the second mode, the data size is transmitted every second period longer than the first period. A packet having a second size larger than the first size may be transmitted to the display apparatus 100.

In this case, the second period may be at least twice the first period, and the second size may be at least 3 times the first size.

In particular, the second period may be twice the first period, and the second period may be 3 times the first period. For example, the first period may be 10 ms, the second period may be 20 ms, the first size may be 20 bytes, and the second size may be 60 bytes. In this case, in the first mode, the remote control device 200 transmits a packet consisting of a header portion of 2 bytes and a data portion of 20 bytes every 10 ms to the display device 100, and in the second mode, a header portion of 2 bytes and a data portion of 20 ms A packet consisting of a 60-byte data unit may be transmitted to the display apparatus 100.

The display device 100 may receive a packet from the remote control device 200.

The control unit 170 of the display apparatus 100 may read a signal received from the remote control apparatus 200 every first cycle regardless of the wireless signal transmission mode of the remote control apparatus 200. That is, the period in which the display device 100 reads the signal received from the remote control device 200 may be constant regardless of the wireless signal transmission mode of the remote control device 200, and in this case, the advantage of securing usability is have.

The control unit 170 of the display apparatus 100 may detect the occurrence of packet loss (S29).

When detecting the occurrence of packet loss, the control unit 170 may calculate and process data compensating for the lost packet (S31).

After the control unit 170 calculates and processes data to compensate for the lost packet, it may determine the wireless environment again (S11).

Even when the occurrence of packet loss is not detected, the control unit 170 may determine the wireless environment again (S11).

That is, the control unit 170 may determine a wireless environment every predetermined period and control a wireless signal transmission mode of the remote control device 200 according to a change in the wireless environment.

When the wireless signal transmission mode of the remote control device 200 is the first mode, the remote control device 200 may transmit a packet to the display device 100 every first period (eg, 10 ms), and the packet is It may have a header part and a data part of the first size (for example, 20 bytes).

Referring to the example of FIG. 7, the display device 100 sequentially includes a first packet 71, a second packet 72, a third packet 73, a fourth packet 74, and a fifth packet in a first cycle. A packet 75, a sixth packet 76, a seventh packet 72, and an eighth packet 78 may be received.

The control unit 170 of the display apparatus 100 may read data from a data unit of each received packet. The diagram shown above of FIG. 7 shows a state of receiving a packet, and the diagram shown below of FIG. 7 shows a state of implementing a data scheduler by reading data from each received packet.

Meanwhile, when the remote control apparatus 200 transmits packets every first period in the first mode, packet loss may occur due to a change in the wireless environment.

When the wireless signal transmission mode of the remote control device 200 is the first mode, the display device 100 has a header portion and a first size (eg, 20 bytes) every first period (eg, 10 ms). A packet with a data portion can be received.

Referring to the example of FIG. 8, due to the influence of the wireless environment, the display apparatus 100 is configured with a first packet 81, a second packet 82, a third packet 83, and a fourth packet ( 84) After sequentially receiving each, the sixth packet 86 may be received after the first period or more, and then the eighth packet 88 may be received after the first period or more has elapsed. .

That is, some of the packets scheduled to be received by the display apparatus 100 from the remote control apparatus 200 may be lost due to an influence of a wireless environment or the like. On the other hand, as shown in FIG. 8, the case in which the fifth packet 85 and the seventh packet 87 are lost is only an example, and the fifth packet 85 and the sixth packet 86 are scheduled to be continuously received. Packets may be lost. When consecutive packets are lost as described above, there is an advantage that it is difficult to predict the data of the lost packet.

When the wireless signal transmission mode of the remote control device 200 is the second mode, the remote control device 200 may transmit a packet to the display device 100 every second period (eg, 20 ms), and the packet is It may have a header portion and a data portion of a second size (eg, 60 bytes).

Referring to the example of FIG. 9, the display device 100 may sequentially receive a first packet 91, a second packet 92, a third packet 93, and a fourth packet 94 every second period. I can.

The control unit 170 of the display apparatus 100 may read data from a data unit of each received packet. The diagram shown above of FIG. 9 shows a state of receiving a packet, and the diagram shown below of FIG. 9 shows a state of implementing a data scheduler by reading data from each received packet.

As described above, when the period in which the remote control device 200 transmits packets to the display device 100 is changed to a long time, there is an advantage of reducing the possibility of packet loss by reducing the number of packet transmissions for a predetermined time.

On the other hand, even when the transmission period of the packet is changed to a long time, packet loss may occur.

When the wireless signal transmission mode of the remote control device 200 is the second mode, the display device 100 has a header portion and a second size (eg, 60 bytes) every second period (eg, 20 ms). A packet with a data portion can be received.

Referring to the example of FIG. 10, the display apparatus 100 receives the first packet 101 and then receives the first packet 101 and then the second period or more elapses, and then the third packet 103 and the fourth packet (104) can be received.

That is, some of the packets scheduled to be received by the display apparatus 100 from the remote control apparatus 200 may be lost due to an influence of a wireless environment or the like. In the example of FIG. 10, the second packet 102 may be lost without being received by the display apparatus 100.

The control unit 170 may detect whether a packet loss occurs by detecting whether a packet is received every second period.

When the controller 170 detects the occurrence of packet loss, the controller 170 may calculate and process data for compensating for the lost packet.

Specifically, when detecting the occurrence of packet loss in the second mode, the control unit 170 may calculate compensation data based on a packet received before the packet loss occurs and a packet received after the packet loss occurs. .

Referring to the example of FIG. 10, when detecting the occurrence of loss of the second packet 102, the control unit 170 includes a first packet 101 and a packet received before the loss of the second packet 102 occurs. 2 A third packet 103, which is a packet received after the packet 102 is lost, may be obtained.

The control unit 170 is based on the data of the first packet 101, which is a packet received before the packet loss occurs, and the data of the third packet 103, which is a packet received after the packet loss occurs. 102) can be calculated. In particular, the control unit 170 may calculate the data of the lost packet based on the last data among the data included in the data part of the first packet 101 and the first data among the data included in the data part of the third packet 103. I can. For example, the control unit 170 recognizes the last data of the first packet 101 as the first data of the second packet 102 which is a loss packet, and recognizes the first data of the third packet 103 as the second data of the loss packet. It is recognized as the last data of the packet 102, and the average of the last data of the first packet 101 and the first data of the third packet 101 may be recognized as intermediate data of the second packet 102. In the example of FIG. 10, the control unit 170 recognizes the third data (1, 1, 1), which is the last data of the first packet 101, as the first data of the second packet 102, and the third packet 103 ), the first data (3, 3, 3) is recognized as the last data of the second packet 102, and the average of the 3 and 5 data (2, 2, 2) is the second packet. By recognizing it as the intermediate data of (102), the data of the second packet 102 can be calculated.

When the control unit 170 calculates the data of the second packet 102, the control unit 170 may process the data to operate according to the second packet 102.

As described above, when the size of data included in one packet is increased when the wireless environment is busy, the display device 100 is more easily and easily used by using the data of the packet received at a time adjacent to the lost packet when packet loss occurs. , It has the advantage of being able to accurately calculate the data of the packet.

The remote control apparatus 200 according to another embodiment of the present invention may add a time stamp to the packet when transmitting the packet in the second mode.

The display apparatus 100 may obtain the order of packets through a time stamp of the packet received from the remote control apparatus 200.

Next, FIG. 11 is an exemplary diagram illustrating a case in which a packet received by a display device according to an embodiment of the present invention is delayed.

For example, when some of the packets received by the display device 100 are delayed, two packets are simultaneously received, or the packet is received by the display device 100 in a reversed transmission order with the remote control device 200. Can be.

11 shows that after the display apparatus 100 receives the first packet 111, the second packet 112 and the third packet 113 are simultaneously received as the second packet 112 is delayed. It can indicate the case that has been done.

When the packet is delayed, the controller 170 of the display apparatus 100 calculates the expected data based on the packet received at a time adjacent to the delayed packet, and then compares the expected data with the delayed packet data. You can decide whether to process it or not.

For example, when the second packet 112 is delayed, the control unit 170 calculates and calculates expected data of the second packet 112 based on the first packet 111 and the third packet 113 The expected data may be compared with the data of the actually received second packet 112. The control unit 170 may determine whether to process the actual data of the second packet 112 based on the comparison result of the expected data and the actual data of the second packet 112.

When processing data of a delayed packet, the control unit 170 may minimize an operation error due to a delay of the packet by processing the data of the packets according to a time stamp.

According to another embodiment of the present invention, the remote control apparatus 200 may match a transmission period of a packet including motion data and a packet including voice data in the second mode. For example, in the first mode, when the remote control device 200 transmits a packet including motion data to the display device 100 every 10 ms, and transmits a packet including voice data to the display device 100 every 15 ms , In the second mode, both a packet including motion data and a packet including voice data may be transmitted to the display apparatus 100 every 20 ms.

In this way, when the same transmission period is used in the second mode, the case of continuously occupying the Bluetooth frequency band is reduced compared to when the transmission period of the packet including motion data and the transmission period of the packet including voice data are different. I can. That is, it is possible to minimize the case where the remote control device 200 continuously occupies the Bluetooth frequency band by unifying the period in which the remote control device 200 transmits packets.

The above description is merely illustrative of the technical idea of the present invention, and those of ordinary skill in the art to which the present invention pertains will be able to make various modifications and variations without departing from the essential characteristics of the present invention.

Accordingly, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention, but to explain the technical idea, and the scope of the technical idea of the present invention is not limited by these embodiments.

The scope of protection of the present invention should be interpreted by the following claims, and all technical ideas within the scope equivalent thereto should be construed as being included in the scope of the present invention.

Claims

A user input interface unit for transmitting and receiving wireless signals to and from the remote control device; And

Comprising a control unit for controlling the wireless signal transmission mode of the remote control device to a first mode or a second mode according to a wireless environment

Display device.
The method of claim 1,

The control unit

Calculating a loss rate of a packet received from the remote control device, and determining the wireless environment based on the loss rate of the packet

Display device.
The method of claim 2,

The control unit

If the packet loss rate is less than a preset threshold value, the wireless environment is determined as a normal state, and if the packet loss rate is greater than the threshold value, the wireless environment is determined as a busy state.

Display device.
The method of claim 3,

The control unit

When the wireless environment is in a normal state, a command for controlling the wireless signal transmission mode of the remote control device to the first mode is transmitted to the remote control device,

When the wireless environment is in a busy state, transmitting a command for controlling the wireless signal transmission mode of the remote control device to the second mode to the remote control device

Display device.
The method of claim 1,

The second mode is

In a wireless signal transmission mode, the transmission period is longer than the transmission period in the first mode, and the data size is larger than the data size in the first mode.

Display device.
Remote control device; And

Including a display device for transmitting and receiving a radio signal with the remote control device,

The display device

Controlling the wireless signal transmission mode of the remote control device to a first mode or a second mode according to a wireless environment

Display system.
The method of claim 6,

The remote control device

In the first mode, a packet having a data size of a first size is transmitted to the display device every first period,

In the second mode, a packet having a second size having a data size greater than the first size is transmitted to the display device every second period longer than the first period.

Display system.
The method of claim 7,

The second period is twice the first period,

The second size is three times the first size

Display system.
The method of claim 6,

The remote control device

In the second mode, the transmission period is changed to be longer than that of the first mode, and the amount of data per packet is increased compared to the first mode to perform encoding processing.

Display system.
The method of claim 6,

The display device

When the occurrence of packet loss is detected in the second mode, compensation data is calculated based on packets received before the packet loss occurs and packets received after the packet loss occurs.

Display system.
The method of claim 6,

The remote control device

When transmitting a packet to the display device, a time stamp is added to the packet.

Display system.
The method of claim 6,

The display device

Calculating a loss rate of a packet received from the remote control device, and determining the wireless environment based on the loss rate of the packet

Display system.
The method of claim 12,

The display device

If the packet loss rate is less than a preset threshold value, the wireless environment is determined as a normal state, and if the packet loss rate is greater than the threshold value, the wireless environment is determined as a busy state.

Display system.
The method of claim 13,

The display device

When the wireless environment is in a normal state, a command for controlling the wireless signal transmission mode of the remote control device to the first mode is transmitted to the remote control device,

When the wireless environment is in a busy state, transmitting a command for controlling the wireless signal transmission mode of the remote control device to the second mode to the remote control device

Display system.
The method of claim 12,

The display device

Counting the number of packets received from the remote control device, and calculating a loss rate of the packet based on the number of packets received during a preset time

Display system.