KR20230156473A - Display device - Google Patents

Abstract

A display device according to an embodiment of the present disclosure includes a communication unit that transmits and receives a positioning signal with a peripheral device; A processor that determines the relative position of the surrounding device based on the positioning signal transmitted and received from the communication unit and generates a pointer corresponding to the surrounding device located at a distance within a reference value; A display that outputs a pointer generated by a processor; may include.

Description

Display device {DISPLAY DEVICE}

This disclosure relates to a display device and a method of driving the same.

This disclosure relates to a pointer device and a method of driving the same.

This disclosure relates to a connection method between a display device and a pointer device.

This disclosure relates to a method of displaying a user's pointer on a display device.

Users edit documents or create a lot of content using small, easily portable display devices such as laptops or mobile terminals. Additionally, users utilize presentation systems using large display devices or projectors at conference locations.

When using a large display device (eg, TV, etc.) as a presentation tool to display documents or contents, there is a disadvantage that a pointer using a laser pointer device or the like is not displayed well on the large display device.

Meanwhile, the wireless pointer device can be connected to a small display device, and the user of the wireless pointer device can make a presentation while outputting the pointer to the small display device. However, it is inconvenient to make a presentation while sharing a pointer device among multiple conference attendees.

The present disclosure provides a display device capable of connecting a plurality of pointer devices and a method of driving the same.

The present disclosure provides a display device capable of displaying a plurality of user pointers and a method of driving the same.

The present disclosure relates to a display device and a method of driving the same that determine the position of the pointer device and process connection to the pointer device located at a distance and angle within a reference value.

The present disclosure relates to a pointer device that processes connection to a display device located at a distance and angle within a reference value and a method of driving the same.

A display device according to an embodiment of the present disclosure transmits and receives a positioning signal to a peripheral device, determines the location of the peripheral device based on the transmitted and received positioning signal, and provides a pointer corresponding to the peripheral device located at a distance within a reference value. It can be created and displayed.

A display device according to an embodiment of the present disclosure includes a communication unit that transmits and receives a positioning signal with a peripheral device; a processor that determines the relative position of the peripheral device based on the positioning signal transmitted and received from the communication unit and generates a pointer corresponding to the peripheral device located at a distance within a reference value; a display that outputs the pointer generated by the processor; may include.

According to the display device according to an embodiment of the present disclosure, the communication unit includes at least two antennas, the processor calculates the angle of arrival (AoA) and the distance of the surrounding device based on the transmitted and received positioning signal, and the The pointer corresponding to the peripheral device can be created.

According to the display device according to an embodiment of the present disclosure, the communication unit can transmit and receive the positioning signal using short-range wireless communication.

According to the display device according to an embodiment of the present disclosure, the short-range wireless communication may use at least one of ultra-wideband (UWB), Bluetooth, Bluetooth low energy (BLE), or Wi-Fi.

According to the display device according to an embodiment of the present disclosure, if there are a plurality of peripheral devices located within a distance within the reference value, each pointer corresponding to each peripheral device has a different color, a different size, or It can be created to display in different shapes.

According to the display device according to an embodiment of the present disclosure, the communication unit may receive user information from the peripheral device, and the processor may display the user information while generating the pointer corresponding to the peripheral device.

According to the display device according to an embodiment of the present disclosure, the processor may record participant information based on the user information.

According to the display device according to an embodiment of the present disclosure, the communication unit may receive motion information from the peripheral device, and the processor may control movement of the pointer corresponding to the peripheral device based on the motion information.

According to the display device according to an embodiment of the present disclosure, the peripheral device may include at least one of a pointer device, a spatial remote control, a wireless mouse, a wireless keyboard, a wearable device, and a mobile terminal.

The display device according to an embodiment of the present disclosure further includes a camera, and when the pointer corresponding to the peripheral device is activated, the processor controls the direction and zoom range of the camera according to the position and angle of the peripheral device. can do.

A pointer device according to an embodiment of the present disclosure transmits and receives a positioning signal with a nearby device, determines the relative position of the nearby device based on the transmitted and received positioning signal, and pairs with the peripheral device located at a distance within a reference value. You can try .

A pointer device according to an embodiment of the present disclosure includes a communication unit that transmits and receives a positioning signal with a peripheral device; A controller that determines the relative position of the peripheral device based on the positioning signal transmitted and received from the communication unit and attempts pairing with the peripheral device located at a distance within a reference value; may include.

The pointer device according to an embodiment of the present disclosure further includes an inertial measurement unit that acquires movement information of the pointer device, and the controller may provide the movement information to the peripheral device.

According to the pointer device according to an embodiment of the present disclosure, the communication unit can transmit and receive the positioning signal using short-distance wireless communication.

According to the pointer device according to an embodiment of the present disclosure, the short-range wireless communication may use at least one of ultra-wideband (UWB), Bluetooth, Bluetooth low energy (BLE), or Wi-Fi.

According to the pointer device according to an embodiment of the present disclosure, the communication unit includes at least two antennas, the controller calculates the angle of arrival (AoA) and distance of the surrounding device based on the transmitted and received positioning signal, and You can attempt pairing with the peripheral device that has an angle of arrival within this value.

According to the pointer device according to an embodiment of the present disclosure, the controller can provide user information of the pointer device to the peripheral device.

According to the display device and its driving method according to various embodiments of the present disclosure, a plurality of pointer devices can be connected.

According to the display device and its driving method according to various embodiments of the present disclosure, a plurality of user pointers can be displayed.

According to the display device and its driving method according to various embodiments of the present disclosure, it is possible to determine the position of the pointer device and process a connection to the pointer device located at a distance and angle within a reference value.

According to the pointer device and its driving method according to various embodiments of the present disclosure, connection can be processed for a display device located at a distance and angle within a reference value.

1 is a block diagram showing a first display device according to an embodiment of the present disclosure.
Figure 2 is a block diagram of a remote control device according to an embodiment of the present disclosure.
Figure 3 shows an example of the actual configuration of a remote control device according to an embodiment of the present disclosure.
Figure 4 shows an example of utilizing a remote control device according to an embodiment of the present disclosure.
Figure 5 is a diagram explaining a presentation system according to an embodiment of the present disclosure.
Figure 6 is a block diagram showing a second display device according to an embodiment of the present disclosure.
Figure 7 is a block diagram showing a pointer device according to an embodiment of the present disclosure.
Figure 8 is a flowchart explaining a method of driving a second display device according to an embodiment of the present disclosure.
FIG. 9 is a diagram illustrating a method of measuring the angle of arrival between a display device and a peripheral device in an embodiment of the present disclosure.
FIG. 10 is a diagram illustrating a method of measuring the distance between a display device and a peripheral device in an embodiment of the present disclosure.
Figure 11 is a diagram showing another example of a presentation system according to an embodiment of the present disclosure.
Figure 12 is a diagram showing another example of a presentation system according to an embodiment of the present disclosure.

Hereinafter, embodiments related to the present disclosure will be described in more detail with reference to the drawings. The suffixes “interface,” “module,” and “part” for components used in the following description are given or used interchangeably only for the ease of writing the specification, and do not have distinct meanings or roles in themselves. .

The display device according to an embodiment of the present disclosure is, for example, an intelligent display device that adds a computer support function to the broadcast reception function, and is faithful to the broadcast reception function while adding an Internet function, etc., and includes a handwriting input device and a touch screen. Alternatively, it can be equipped with a more convenient interface such as a spatial remote control. In addition, by supporting wired or wireless Internet functions, it is possible to connect to the Internet and a computer and perform functions such as email, web browsing, banking, or gaming. A standardized general-purpose OS can be used for these various functions.

Accordingly, in the display device described in the present disclosure, for example, various applications can be freely added or deleted on a general-purpose OS kernel, so various user-friendly functions can be performed. More specifically, the display device may be, for example, a network TV, HBBTV, smart TV, LED TV, OLED TV, etc., and in some cases, may also be applied to a smartphone.

FIG. 1 is a block diagram showing the configuration of a display device according to an embodiment of the present disclosure.

Referring to FIG. 1, the display device 100 includes a broadcast receiver 130, an external device interface 135, a memory 140, a user input interface 150, a controller 170, a wireless communication interface 173, and a display. It may include (180), a speaker (185), and a power supply circuit (190).

The broadcast receiver 130 may include a tuner 131, a demodulator 132, and a network interface 133.

The tuner 131 can select a specific broadcast channel according to a channel selection command. The tuner 131 may receive a broadcast signal for a specific selected broadcast channel.

The demodulator 132 can separate the received broadcast signal into a video signal, an audio signal, and a data signal related to the broadcast program, and can restore the separated video signal, audio signal, and data signal to a form that can be output.

The external device interface 135 may receive an application or application list within an adjacent external device and transfer it to the controller 170 or memory 140.

The external device interface 135 may provide a connection path between the display device 100 and an external device. The external device interface 135 may receive one or more of video and audio output from an external device connected wirelessly or wired to the display device 100 and transmit it to the controller 170. The external device interface 135 may include a plurality of external input terminals. The plurality of external input terminals may include an RGB terminal, one or more High Definition Multimedia Interface (HDMI) terminals, and a component terminal.

An image signal from an external device input through the external device interface 135 may be output through the display 180. A voice signal from an external device input through the external device interface 135 may be output through the speaker 185.

An external device that can be connected to the external device interface 135 may be any one of a set-top box, Blu-ray player, DVD player, game console, sound bar, smartphone, PC, USB memory, or home theater, but this is only an example.

The network interface 133 may provide an interface for connecting the display device 100 to a wired/wireless network including an Internet network. The network interface 133 may transmit or receive data with other users or other electronic devices through a connected network or another network linked to the connected network.

Additionally, some of the content data stored in the display device 100 may be transmitted to a selected user or selected electronic device among other users or other electronic devices pre-registered in the display device 100.

The network interface 133 can access a certain web page through a connected network or another network linked to the connected network. In other words, you can access a certain web page through a network and transmit or receive data with the corresponding server.

And, the network interface 133 can receive content or data provided by a content provider or network operator. That is, the network interface 133 can receive content and information related thereto, such as movies, advertisements, games, VODs, and broadcast signals, provided from a content provider or network provider through a network.

Additionally, the network interface 133 can receive firmware update information and update files provided by a network operator, and can transmit data to the Internet, a content provider, or a network operator.

The network interface 133 can select and receive a desired application from among applications open to the public through a network.

The memory 140 stores programs for processing and controlling each signal in the controller 170, and can store processed video, audio, or data signals.

In addition, the memory 140 may perform a function for temporary storage of video, voice, or data signals input from the external device interface 135 or the network interface 133, and may store information about a predetermined image through a channel memory function. You can also store information.

The memory 140 may store an application or application list input from the external device interface 135 or the network interface 133.

The display device 100 can play content files (video files, still image files, music files, document files, application files, etc.) stored in the memory 140 and provide them to the user.

The user input interface 150 may transmit a signal input by the user to the controller 170 or transmit a signal from the controller 170 to the user. For example, the user input interface 150 may be used remotely according to various communication methods such as Bluetooth, Ultra Wideband (UWB), ZigBee, Radio Frequency (RF) communication, or Infrared (IR) communication. Control signals such as power on/off, channel selection, and screen settings can be received and processed from the control device 200, or control signals from the controller 170 can be processed to be transmitted to the remote control device 200.

Additionally, the user input interface 150 can transmit control signals input from local keys (not shown) such as power key, channel key, volume key, and setting value to the controller 170.

The video signal processed by the controller 170 may be input to the display 180 and displayed as an image corresponding to the video signal. Additionally, the image signal processed by the controller 170 may be input to an external output device through the external device interface 135.

The voice signal processed by the controller 170 may be output as audio to the speaker 185. Additionally, the voice signal processed by the controller 170 may be input to an external output device through the external device interface 135.

In addition, the controller 170 may control overall operations within the display device 100.

In addition, the controller 170 can control the display device 100 by a user command or internal program input through the user input interface 150, and connects to the network to display the application or application list desired by the user on the display device ( 100) You can make it available for download.

The controller 170 allows channel information selected by the user to be output through the display 180 or speaker 185 along with the processed video or audio signal.

In addition, the controller 170 controls video signals from an external device, for example, a camera or camcorder, input through the external device interface 135, according to an external device video playback command received through the user input interface 150. Alternatively, the voice signal can be output through the display 180 or speaker 185.

Meanwhile, the controller 170 can control the display 180 to display an image, for example, a broadcast image input through the tuner 131, an external input image input through the external device interface 135, Alternatively, an image input through the network interface unit or an image stored in the memory 140 may be controlled to be displayed on the display 180. In this case, the image displayed on the display 180 may be a still image or a moving image, and may be a 2D image or a 3D image.

In addition, the controller 170 can control the playback of content stored in the display device 100, received broadcast content, or external input content, which includes broadcast video, external input video, and audio files. , can be in various forms such as still images, connected web screens, and document files.

The wireless communication interface 173 can communicate with external devices through wired or wireless communication. The wireless communication interface 173 can perform short range communication with an external device. For this purpose, the wireless communication interface 173 includes Bluetooth™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Near Field Communication (NFC), and Wi-Fi. Short-distance communication can be supported using at least one of Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technologies. This wireless communication interface 173 is between the display device 100 and a wireless communication system, between the display device 100 and another display device 100, or between the display device 100 through wireless area networks. It can support wireless communication between the network and the display device 100 (or external server). Local area wireless networks may be wireless personal area networks.

Here, the other display device 100 is a wearable device capable of exchanging data with (or interoperable with) the display device 100 according to the present disclosure, for example, a smartwatch, smart glasses. It can be a mobile terminal such as (smart glass), HMD (head mounted display), or smart phone. The wireless communication interface 173 may detect (or recognize) a wearable device capable of communication around the display device 100 .

Furthermore, if the detected wearable device is a device authenticated to communicate with the display device 100 according to the present disclosure, the controller 170 sends at least a portion of the data processed by the display device 100 to the wireless communication interface 173. It can be transmitted to a wearable device through . Accordingly, a user of a wearable device can use data processed by the display device 100 through the wearable device.

The display 180 converts the video signal, data signal, and OSD signal processed by the controller 170 or the video signal and data signal received from the external device interface 135 into R, G, and B signals, respectively, and provides a driving signal. can be created.

Meanwhile, the display device 100 shown in FIG. 1 is only an example of the present disclosure. Some of the illustrated components may be integrated, added, or omitted depending on the specifications of the display device 100 that is actually implemented.

That is, as needed, two or more components may be combined into one component, or one component may be subdivided into two or more components. In addition, the functions performed in each block are for explaining embodiments of the present disclosure, and the specific operations or devices do not limit the scope of the present disclosure.

According to another embodiment of the present disclosure, unlike shown in FIG. 1, the display device 100 does not have a tuner 131 and a demodulator 132 and has a network interface 133 or an external device interface 135. You can also receive and play video through the device.

For example, the display device 100 is divided into an image processing device such as a set-top box for receiving broadcast signals or contents according to various network services, and a content playback device for playing content input from the image processing device. It can be implemented.

In this case, the method of operating a display device according to an embodiment of the present disclosure, which will be described below, includes not only the display device 100 as described with reference to FIG. 1, but also an image processing device such as the separated set-top box or the display 180. ) and a content playback device having an audio output unit 185.

Next, with reference to FIGS. 2 and 3, a remote control device according to an embodiment of the present disclosure will be described.

FIG. 2 is a block diagram of a remote control device according to an embodiment of the present disclosure, and FIG. 3 shows an example of the actual configuration of the remote control device 200 according to an embodiment of the present disclosure.

First, referring to FIG. 2, the remote control device 200 includes a fingerprint reader 210, a wireless communication circuit 220, a user input interface 230, a sensor 240, an output interface 250, and a power supply circuit ( 260), memory 270, controller 280, and microphone 290.

Referring to FIG. 2, the wireless communication circuit 220 transmits and receives signals to and from any one of the display devices according to the embodiments of the present disclosure described above.

The remote control device 200 has an RF circuit 221 capable of transmitting and receiving signals to and from the display device 100 in accordance with RF communication standards, and is capable of transmitting and receiving signals to and from the display device 100 in accordance with IR communication standards. An IR circuit 223 may be provided. Additionally, the remote control device 200 may be provided with a Bluetooth circuit 225 capable of transmitting and receiving signals to and from the display device 100 according to the Bluetooth communication standard. In addition, the remote control device 200 is provided with an NFC circuit 227 capable of transmitting and receiving signals to the display device 100 according to the NFC (Near Field Communication) communication standard, and displays the display device 100 according to the WLAN (Wireless LAN) communication standard. A WLAN circuit 229 capable of transmitting and receiving signals to and from the device 100 may be provided.

In addition, the remote control device 200 transmits a signal containing information about the movement of the remote control device 200 to the display device 100 through the wireless communication circuit 220.

Meanwhile, the remote control device 200 can receive a signal transmitted by the display device 100 through the RF circuit 221 and, if necessary, turn on/off the display device 100 through the IR circuit 223. Commands for turning off, changing channels, changing volume, etc. can be sent.

The user input interface 230 may be comprised of a keypad, button, touch pad, or touch screen. The user can input commands related to the display device 100 into the remote control device 200 by manipulating the user input interface 230. If the user input interface 230 has a hard key button, the user can input a command related to the display device 100 to the remote control device 200 through a push operation of the hard key button. This will be explained with reference to FIG. 3 .

Referring to FIG. 3, the remote control device 200 may include a plurality of buttons. The plurality of buttons include a fingerprint recognition button (212), power button (231), home button (232), live button (233), external input button (234), volume control button (235), voice recognition button (236), It may include a channel change button 237, a confirmation button 238, and a back button 239.

The fingerprint recognition button 212 may be a button for recognizing the user's fingerprint. In one embodiment, the fingerprint recognition button 212 is capable of a push operation and may receive a push operation and a fingerprint recognition operation.

The power button 231 may be a button for turning on/off the power of the display device 100.

The home button 232 may be a button for moving to the home screen of the display device 100.

The live button 233 may be a button for displaying a real-time broadcast program.

The external input button 234 may be a button for receiving an external input connected to the display device 100.

The volume control button 235 may be a button for adjusting the volume of the sound output by the display device 100.

The voice recognition button 236 may be a button for receiving the user's voice and recognizing the received voice.

The channel change button 237 may be a button for receiving a broadcast signal of a specific broadcast channel.

The confirmation button 238 may be a button for selecting a specific function, and the back button 239 may be a button for returning to the previous screen.

Figure 2 will be described again.

If the user input interface 230 has a touch screen, the user can input commands related to the display device 100 through the remote control device 200 by touching a soft key on the touch screen. Additionally, the user input interface 230 may include various types of input means that the user can operate, such as scroll keys and jog keys, and this embodiment does not limit the scope of the present disclosure.

The sensor 240 may include a gyro sensor 241 or an acceleration sensor 243, and the gyro sensor 241 may sense information about the movement of the remote control device 200.

For example, the gyro sensor 241 can sense information about the operation of the remote control device 200 based on the x, y, and z axes, and the acceleration sensor 243 measures the moving speed of the remote control device 200. Information about such things can be sensed. Meanwhile, the remote control device 200 may further include a distance measurement sensor and can sense the distance from the display 180 of the display device 100.

The output interface 250 may output a video or audio signal corresponding to a manipulation of the user input interface 230 or a signal transmitted from the display device 100.

The user can recognize whether the output interface 250 is manipulating the user input interface 230 or controlling the display device 100.

For example, the output interface 250 includes an LED 251 that turns on when the user input interface 230 is manipulated or a signal is transmitted and received with the display device 100 through the wireless communication unit 225, and a vibrator 253 that generates vibration. ), a speaker 255 that outputs sound, or a display 257 that outputs an image.

In addition, the power supply circuit 260 supplies power to the remote control device 200, and stops power supply when the remote control device 200 does not move for a predetermined period of time, thereby reducing power waste.

The power supply circuit 260 can resume power supply when a predetermined key provided in the remote control device 200 is operated.

The memory 270 may store various types of programs, application data, etc. necessary for controlling or operating the remote control device 200.

When the remote control device 200 transmits and receives signals wirelessly through the display device 100 and the RF circuit 221, the remote control device 200 and the display device 100 transmit and receive signals through a predetermined frequency band. .

The controller 280 of the remote control device 200 stores and references information about the display device 100 paired with the remote control device 200 and the frequency band capable of wirelessly transmitting and receiving signals in the memory 270. You can.

The controller 280 controls all matters related to the control of the remote control device 200. The controller 280 sends a signal corresponding to a predetermined key operation of the user input interface 230 or a signal corresponding to the movement of the remote control device 200 sensed by the sensor 240 through the wireless communication unit 225. 100).

Additionally, the microphone 290 of the remote control device 200 can acquire voice.

A plurality of microphones 290 may be provided.

Next, Figure 4 will be described.

Figure 4 shows an example of utilizing a remote control device according to an embodiment of the present disclosure.

(a) of FIG. 4 illustrates that a pointer 205 corresponding to the remote control device 200 is displayed on the display 180.

The user can move or rotate the remote control device 200 up and down, left and right. The pointer 205 displayed on the display 180 of the display device 100 corresponds to the movement of the remote control device 200. This remote control device 200 can be called a spatial remote control because the corresponding pointer 205 is moved and displayed according to movement in 3D space, as shown in the drawing.

(b) of FIG. 4 illustrates that when the user moves the remote control device 200 to the left, the pointer 205 displayed on the display 180 of the display device 100 also moves to the left correspondingly.

Information about the movement of the remote control device 200 detected through the sensor of the remote control device 200 is transmitted to the display device 100. The display device 100 may calculate the coordinates of the pointer 205 from information about the movement of the remote control device 200. The display device 100 may display the pointer 205 to correspond to the calculated coordinates.

(c) of FIG. 4 illustrates a case where a user moves the remote control device 200 away from the display 180 while pressing a specific button in the remote control device 200. As a result, the selected area in the display 180 corresponding to the pointer 205 can be zoomed in and displayed enlarged.

Conversely, when the user moves the remote control device 200 closer to the display 180, the selected area in the display 180 corresponding to the pointer 205 may be zoomed out and displayed in a reduced size.

Meanwhile, when the remote control device 200 moves away from the display 180, the selected area may be zoomed out, and when the remote control device 200 approaches the display 180, the selected area may be zoomed in.

Additionally, when a specific button in the remote control device 200 is pressed, recognition of up-down, left-right movement may be excluded. That is, when the remote control device 200 moves away from or approaches the display 180, up, down, left, and right movements may not be recognized, and only forward and backward movements may be recognized. When a specific button in the remote control device 200 is not pressed, only the pointer 205 moves as the remote control device 200 moves up, down, left, and right.

Meanwhile, the moving speed or direction of the pointer 205 may correspond to the moving speed or direction of the remote control device 200.

Meanwhile, a pointer in this specification refers to an object displayed on the display 180 in response to the operation of the remote control device 200. Accordingly, the pointer 205 can be an object of various shapes other than the arrow shape shown in the drawing. For example, concepts may include dots, cursors, prompts, thick outlines, etc. In addition, the pointer 205 can be displayed not only in response to one of the horizontal and vertical axes on the display 180, but also in response to multiple points, such as a line or surface. .

The display device described above can be used by a user when performing a presentation. Hereinafter, a presentation system according to an embodiment of the present disclosure will be described with reference to FIG. 5.

A presentation system according to an embodiment of the present disclosure may include a first display device 100 and a second display device 300.

As an example, the first display device 100 may selectively include some or all of the configurations and functions described with reference to FIGS. 1 to 4 .

The second display device 300 may be connected to the first display device 100 wired or wirelessly. The second display device 300 may be connected wirelessly or wired to the first display device 100 through the external device interface 135 of the first display device 100. At least one of video or audio output from the second display device 300 may be output through the first display device 100.

The first display device 100 and the second display device 300 may be selected independently from the various display devices described above. Here, to facilitate understanding, the first display device 100 is a display device including a relatively large display such as a TV, and the second display device 300 is a display device including a relatively small display such as a PC. Explain based on standard.

A presentation system according to an embodiment may include a pointer device. For example, the user may point to a partial area of the image output to the second display device 300 using a pointer device.

A presentation system according to an embodiment may include one pointer device. Additionally, the presentation system may include a plurality of pointer devices. The plurality of pointer devices may include, for example, a first pointer device 410, a second pointer device 420, a third pointer device 430, and a fourth pointer device 440.

According to the second display device 300 and its driving method according to an embodiment of the present disclosure, a plurality of pointer devices 410, 420, 430, and 440 can be connected to the second display device 300.

According to the second display device 300 and its driving method according to an embodiment of the present disclosure, a plurality of user pointers respectively corresponding to a plurality of pointer devices 410, 420, 430, and 440 are displayed on the second display device 300. It can be displayed in .

Figure 6 is a block diagram showing a second display device according to an embodiment of the present disclosure.

The second display device 300 according to an embodiment may include a processor 310 and a communication unit 320. The communication unit 320 can transmit and receive positioning signals with surrounding devices.

The peripheral device may include at least one of a pointer device, a spatial remote control, a wireless mouse, a wireless keyboard, a wearable device, or a mobile terminal. Here, to facilitate understanding, the description will be based on the case where the second display device 300 transmits and receives positioning signals to and from a plurality of pointer devices 410, 420, 430, and 440.

The processor 310 may determine the relative position of the surrounding device based on the positioning signal received from the communication unit 320. The processor 310 may generate a pointer corresponding to a peripheral device (first to fourth pointer devices) located at a distance within a reference value from the second display device 300. The processor 310 may output the generated pointer to the display 330.

The communication unit 320 can transmit and receive positioning signals using short-range wireless communication. The communication unit 320 can transmit and receive positioning signals with surrounding devices using at least one of short-range wireless communication including ultra-wideband (UWB), Bluetooth or Bluetooth low energy (BLE), or Wi-Fi. there is.

The communication unit 320 performs primary communication with surrounding devices using Bluetooth or Bluetooth Low Energy (BLE), and when a nearby device to which a signal is connected is recognized, it uses ultra-wideband (UWB) to communicate with the surrounding devices. Positioning signals can also be transmitted and received. When transmitting and receiving positioning signals with nearby devices using ultra-wideband (UWB), the positions of nearby devices can be measured with an accuracy of within a few centimeters.

When the communication unit 320 includes at least two antennas, the processor 310 can calculate the angle of arrival (AoA) and distance of the surrounding device based on the transmitted and received positioning signal.

If the communication unit 320 includes at least three antennas, the processor 310 can calculate the angle of arrival (AoA) and distance of the surrounding device in three-dimensional space based on the transmitted and received positioning signal. .

The processor 310 calculates the angle of arrival and distance of the peripheral device based on the transmitted and received positioning signal, and calculates the angle of arrival and distance of the peripheral device and displays the corresponding pointer device (first to fourth pointer devices) located within a reference distance from the second display device 300. A pointer can be created and displayed on the display 330.

The processor 310 calculates the angle of arrival and distance of each of the plurality of pointer devices 410, 420, 430, and 440 based on the positioning signals transmitted and received with the plurality of pointer devices 410, 420, 430, and 440, and A pointer corresponding to each of the pointer devices 410, 420, 430, and 440 may be generated and displayed on the display 330.

As an example, FIG. 5 shows a first pointer device 410, a second pointer device 420, a third pointer device 430, a fourth pointer device 440, and a fifth pointer device 450.

The first to fourth pointer devices 410, 420, 430, and 440 are located within a reference distance from the second display device 300. Accordingly, the processor 310 may generate pointers corresponding to the first to fourth pointer devices 410, 420, 430, and 440 and display the corresponding pointers on the second display device 300.

The fifth pointer device 450 is located outside the reference distance from the second display device 300. Accordingly, the processor 310 may determine that the fifth pointer device 450 is outside the reference distance and may not generate a pointer corresponding to the fifth pointer device 450.

A method of calculating the angle of arrival and distance in the processor 310 based on positioning signals transmitted and received with peripheral devices, such as a plurality of pointer devices, will be discussed in more detail later.

The second display device 300 may include a memory 340 in which various types of programs and application data required for control or operation are stored.

The second display device 300 may include a camera 350. The processor 310 may display the image acquired through the camera 350 on the display 330 or store it in the memory 340.

Figure 7 is a block diagram showing a pointer device according to an embodiment of the present disclosure.

The first pointer device 410 according to an embodiment may include a controller 411 and a communication unit 413. The communication unit 413 can transmit and receive positioning signals with surrounding devices.

Peripheral devices may include various devices that can be connected to the first pointer device 410. Here, to facilitate understanding, the description will be based on the case where the first pointer device 410 transmits and receives a positioning signal with the second display device 300.

The controller 411 may determine the relative position of the surrounding device based on the transmitted and received positioning signal. The controller 411 may attempt pairing with a peripheral device located at a distance within the reference value.

The controller 411 of the first pointer device 410 transmits and receives a positioning signal with the second display device 300, and the second display device 300 is located at a distance within a reference value from the first pointer device 410. If determined to be successful, pairing for connection with the second display device 300 can be performed.

The communication unit 413 can transmit and receive positioning signals using short-distance wireless communication. The communication unit 413 may transmit and receive a positioning signal using at least one of ultra-wideband (UWB), Bluetooth, Bluetooth low energy (BLE), or short-range wireless communication including Wi-Fi.

When the communication unit 413 includes at least two antennas, the controller 411 can calculate the angle of arrival (AoA) and distance of the surrounding device based on the transmitted and received positioning signal.

If the communication unit 413 includes at least three antennas, the controller 411 can calculate the angle of arrival (AoA) and distance of the surrounding device in three-dimensional space based on the transmitted and received positioning signal. .

The first pointer device 410 may include an inertial measurement unit 415. The inertial measurement unit 415 may obtain movement information of the first pointer device 410. The inertial measurement unit 415 may include a gyro sensor or an acceleration sensor. The gyro sensor can sense information about the operation of the first pointer device 410 based on the x-axis, y-axis, and z-axis. The acceleration sensor can sense information about the moving speed of the first pointer device 410, etc. Additionally, the inertial measurement unit 415 may further include a geomagnetic sensor.

The first pointer device 410 may include a light emitting unit 417. The light emitting unit 417 may display the operating state of the first pointer device 410.

The first pointer device 410 may include a user interface 419. The user interface 419 may include at least one of a keypad, buttons, touch pad, or touch screen. The user can control the functions of the first pointer device 410 through the user interface 410.

The second to fifth pointer devices 420, 430, 440, and 450 shown in FIG. 5 may optionally include some or all of the configuration and functions of the first pointer device 410 described above.

The connection process between the second display device and the pointer device according to an embodiment of the present disclosure will be described with reference to FIGS. 5 to 8. Figure 8 is a flowchart explaining a method of driving a second display device according to an embodiment of the present disclosure.

The second display device 300 can transmit and receive positioning signals with surrounding devices (S801).

The processor 310 of the second display device 300 may transmit and receive a positioning signal with a peripheral device, for example, the communication unit 413 of the first pointer device 410, through the communication unit 320. The processor 310 of the second display device 300 may periodically transmit and receive a positioning signal with the first pointer device 410 while maintaining connection with the first pointer device 410 . Transmitting and receiving positioning signals between the second display device 300 and the first pointer device 410 may mean exchanging positioning signals.

The processor 310 of the second display device 300 transmits a request signal to the first pointer device 410 through the communication unit 320 to determine the position of the first pointer device 410. A response signal corresponding to the request signal transmitted from the communication unit 413 of 410 may be received. The request signal transmitted from the second display device 300 to the first pointer device 410 may be a poll message, and the response signal may be a response message.

After receiving the response signal from the first pointer device 410, the processor 310 of the second display device 300 may transmit a re-response signal to the first pointer device 410 through the communication unit 320. there is. The response signal transmitted from the second display device 300 to the first pointer device 410 may be a final message.

Positioning signals can be transmitted through various communication technologies such as ultra-wideband (UWB), Bluetooth or Bluetooth low energy (BLE), or Wi-Fi.

The processor 310 of the second display device 300 may determine the relative position of a nearby device based on the transmitted and received positioning signal and perform pairing (S803).

The processor 310 of the second display device 300 may determine the direction of a peripheral device, for example, the first pointer device 410, based on the angle of arrival (AoA) of the transmitted and received positioning signal. The processor 310 may determine the distance to a peripheral device, for example, the first pointer device 410, based on the time of flight (ToF) of the transmitted and received positioning signal.

The direction of the first pointer device 410 with respect to the second display device 300 and the distance of the first pointer device 410 with respect to the second display device 300 are both relative positions of the first pointer device 410. It can be.

The communication unit 320 of the second display device 300 may include a plurality of communication modules or a plurality of antennas, and the processor 310 may use a plurality of communication modules or a plurality of antennas to communicate with the first pointer device 410. The angle of arrival and distance of the first pointer device 410 can be calculated based on the phase difference or time difference of the positioning signal received from.

When the second display device 300 transmits and receives positioning signals using ultra-wideband (UWB), the position of the first pointer device 410 can be detected with an accuracy of within a few centimeters.

The processor 310 of the second display device 300 may determine whether to perform pairing with the first pointer device 410 based on the distance to the first pointer device 410.

The processor 310 of the second display device 300 may perform pairing with the first pointer device 410 when it is determined that the first pointer device 410 is located within the reference value.

According to an embodiment of the present disclosure, the reference value may be set in various ways. For example, the reference value can be flexibly set at 5m, 3m, or 1m. As an example, the reference value may be set considering the size of the space in which the user attending the presentation can be located and the location of the second display device 300.

If the distance to the first pointer device 410 is less than the reference value, the processor 310 of the second display device 300 determines that the first pointer device 410 is a peripheral device used by the user attending the presentation. After making the determination, pairing with the first pointer device 410 may be performed.

In contrast, when the distance to the first pointer device 410 exceeds the reference value, the processor 310 of the second display device 300 detects the user who is not attending the presentation. It is determined that it is a peripheral device being used, and pairing for the first pointer device 410 may not be performed.

In this case, positioning signal transmission and reception between the second display device 300 and the first pointer device 410 can be performed, but the distance to the first pointer device 410 does not meet the standard value, so the second display device 410 The processor 310 of 300 may not allow the first pointer device 310 to be connected.

For example, the fifth pointer device 450 shown in FIG. 5 may be located within a distance that can transmit and receive positioning signals to and from the second display device 300. However, the processor 310 of the second display device 300 allows connection without performing pairing with the fifth pointer device 450 because the distance to the fifth pointer device 450 exceeds the reference value. You may not.

Additionally, the processor 310 of the second display device 300 may determine whether to perform pairing for the first pointer device 410 by referring to the angle of arrival information of the first pointer device 410.

If the angle of arrival of the first pointer device 410 is within the reference value range, the processor 310 of the second display device 300 determines that the first pointer device 410 is a peripheral device used by the user attending the presentation. It can be judged that it is.

In contrast, when the angle of arrival of the first pointer device 410 is outside the reference value range, the processor 310 of the second display device 300 determines whether the first pointer device 410 is a user who is not attending the presentation. It can be determined that it is a peripheral device used by .

In addition, when the distance to the first pointer device 410 is less than or equal to the reference value and the angle of arrival of the first pointer device 410 is within the reference value range, the processor 310 of the second display device 300 1 It may be determined that the pointer device 410 is a peripheral device used by a user attending the presentation.

In other words, the processor 310 of the second display device 300 determines whether the distance to the first pointer device 410 exceeds the reference value or when the angle of arrival of the first pointer device 410 is within the reference value range. If it deviates, it may be determined that the first pointer device 410 is not a peripheral device used by the user attending the presentation.

As described above, the processor 310 of the second display device 300 transmits and receives a positioning signal from a nearby device, and determines whether to perform pairing with the surrounding device based on at least one information of the relative distance or angle of arrival. can be decided.

The second display device 300 may generate a pointer corresponding to a peripheral device (S805).

Referring to FIG. 5 , the second display device 300 includes a first pointer device 410, a second pointer device 420, a third pointer device 430, a fourth pointer device 440, and a fifth pointer device. A positioning signal can be transmitted and received with the pointer device 450, and whether or not to perform pairing for each pointer device can be determined based on at least one information of the relative distance or angle of arrival of each pointer device.

In the case of the presentation system shown in FIG. 5, the second display device 300 is determined to be a peripheral device used by the user participating in the presentation system for the first to fourth pointer devices 410, 420, 430, and 440. and pairing can be performed and connection can be permitted. The second display device 300 may determine that the fifth pointer device 450 is a peripheral device used by a user who does not participate in the presentation system, and may not allow the connection.

The processor 310 of the second display device 300 may generate a first pointer corresponding to the first pointer device 410 and display the first pointer on the display 330 of the second display device 300. . At this time, the image displayed on the display 330 of the second display device 300 may be output to the first display device 100.

The processor 310 of the second display device 300 may generate a second pointer corresponding to the second pointer device 420 and display the second pointer on the display 330 of the second display device 300. . At this time, the image displayed on the display 330 of the second display device 300 may be output to the first display device 100.

The processor 310 of the second display device 300 may generate a third pointer corresponding to the third pointer device 410 and display the third pointer on the display 330 of the second display device 300. . At this time, the image displayed on the display 330 of the second display device 300 may be output to the first display device 100.

The processor 310 of the second display device 300 may generate a fourth pointer corresponding to the fourth pointer device 440 and display the fourth pointer on the display 330 of the second display device 300. . At this time, the image displayed on the display 330 of the second display device 300 may be output to the first display device 100.

In this way, the processor 310 of the second display device 300, for example, if there are a plurality of peripheral devices (first to fourth pointer devices) located at a distance within a reference value, each peripheral device (first to fourth pointer devices) A plurality of pointers corresponding to the 4 pointer device) can be created and the plurality of pointers can be displayed on the display 330.

At this time, the processor 310 of the second display device 300 displays each pointer corresponding to each peripheral device (first to fourth pointer devices) in different colors, different sizes, or different shapes, so that each pointer corresponds to each peripheral device (first to fourth pointer devices). Each pointer can be created to be distinct.

A pointer according to the present disclosure refers to an object displayed on the display 330 in response to the operation of the pointer device. For example, a pointer can be an object of various shapes, such as an arrow, dot, circle, polygon, or icon. Additionally, the pointer may be displayed corresponding to one of the horizontal and vertical axes on the display 330, and may also be displayed corresponding to multiple points such as a line or surface.

The communication unit 320 of the second display device 300 may receive user information (A, B, C, D) from peripheral devices (first to fourth pointer devices). The processor 310 of the second display device 300 may display user information (A, B, C, D) while generating pointers corresponding to peripheral devices (first to fourth pointer devices).

Each controller of the first to fourth pointer devices 410, 420, 430, and 440 may obtain user information and provide the user information to a connected peripheral device (e.g., the second display device 300). .

For example, the controller of the first to fourth pointer devices 410, 420, 430, and 440 may obtain user information from the user's ID card or a mobile terminal such as a mobile phone. The first to fourth pointer devices 410, 420, 430, and 440 collect user information (name, nickname, or ID information) from the user's ID card or mobile terminal using RFID, NFC, or short-range wireless communication technology. can be obtained. Since user information can be displayed on each pointer of the second display device 300, users participating in the presentation can easily understand the presenter information using the corresponding pointer.

When the processor 310 of the second display device 300 displays each pointer corresponding to each peripheral device (first to fourth pointer devices) in different colors, the processor 310 displays the corresponding peripheral device (first to fourth pointer devices) in different colors. 1 to 4 pointer devices) can provide color information set.

For example, red may be set to match the pointer of the first pointer device 410, and blue may be set to match the pointer of the second pointer device 420.

According to an embodiment of the present disclosure, the processor 310 may transmit red color matching information to the first pointer device 410, and the controller 411 of the first pointer device 410 may emit red color from the light emitting unit 417. Colors can be made to emit light. The processor 310 may transmit blue matching information to the second pointer device 420, and the controller of the second pointer device 420 may cause the light emitting unit of the second pointer device 420 to emit blue color. there is.

Accordingly, the user can easily determine the color of the pointer matched to the pointer device used by the user through the light emitted from the light emitting unit of the pointer device. The light emitting unit of the pointer device may include a light emitting element such as LED or OLED.

The communication unit 320 of the second display device 300 may receive movement information from peripheral devices (first to fourth pointer devices). The processor 310 of the second display device 300 controls the movement of the pointer corresponding to each peripheral device (first to fourth pointer devices) based on the movement information of the peripheral device (first to fourth pointer devices). can do.

The first to fourth pointer devices 410, 420, 430, and 440 may obtain movement information of each pointer device through an inertial measurement unit and provide the movement information of the corresponding pointer device to the second display device 300. .

As an example, the first pointer device 410 may include an inertial measurement unit 415 that acquires movement information of the first pointer device 410. The controller 411 of the first pointer device 410 may provide movement information of the first pointer device 410 to a connected peripheral device (eg, the second display device 300).

According to an embodiment of the present disclosure, the inertial measurement unit 415 of the first pointer device 410 can determine movement information of the first pointer device 410. The inertial measurement unit 415 may include a gyro sensor or an acceleration sensor. The inertial measurement unit 415 can sense information about the operation of the first pointer device 410 based on the x-axis, y-axis, and z-axis, and can sense information about movement speed, etc.

Movement information of the first pointer device 410 obtained from the inertial measurement unit 415 may be transmitted to the second display device 300. The second display device 300 may control the movement of the first pointer corresponding to the first pointer device 410 on the display 330 based on the transmitted movement information of the first pointer device 410.

The first pointer device 410 may include a user interface 419. The first pointer device 410 may include a user interface 419. The user interface 419 may include at least one of a keypad, buttons, touch pad, or touch screen.

The user may request movement of the first pointer through movement of the first pointer device 410. The user can move the first pointer device 410 up and down or left and right, and the processor 310 of the second display device 300 moves the first pointer up and down or left and right in response to the movement of the first pointer device 410. It can be moved to . The moving speed or moving direction of the first pointer displayed on the second display device 300 may correspond to the moving speed or moving direction of the first pointer device 410.

The user may request movement of the first pointer through manipulation of the user interface 419 of the first pointer device 410. As an example, the first pointer device 410 may be operated in a manner similar to the spatial remote control described with reference to FIG. 4 . The user may request movement of the first pointer through the keypad, button, touchpad, or touch screen of the user interface 419.

In the presentation system described with reference to FIG. 5 , first to fourth pointers corresponding to first to fourth pointer devices may be displayed on the display 330 of the second display device 300. Additionally, user information corresponding to the first to fourth pointer devices may be displayed.

According to an embodiment, based on this user information, the second display device 300 may determine information about conference attendees who attended the presentation. The processor 310 of the second display device 300 may record information on attendees who attended the presentation based on the identified user information. The processor 310 of the second display device 300 may record meeting participant information and meeting progress in the memory 340. Based on participant information, the second display device 300 may, if necessary, create a menu granting control permissions, such as a mouse or keyboard, to attendees and display it on the display 330.

According to an embodiment of the present disclosure, the pointer device may calculate the angle of arrival or relative distance of a nearby device and determine whether to perform pairing or allow connection with the nearby device.

As described above, when the communication unit 413 of the first pointer device 410 includes at least two communication modules or at least two antennas, the controller 411 of the first pointer device 410 transmits and receives the positioning signal. Based on this, the angle of arrival and distance of a peripheral device (eg, the second display device 300) can be calculated.

The controller 411 of the first pointer device 410 may allow pairing and connection with the second display device 300 when the second display device 300 is located at a distance within a reference value.

Additionally, the controller 411 of the first pointer device 410 may allow pairing and connection with the second display device 300 when the second display device 300 has an angle of arrival within the reference value range. there is.

In addition, the controller 411 of the first pointer device 410 controls the second display device 300 when the second display device 300 is located at a distance within the reference value and has an angle of arrival within the reference value range. You can also allow pairing and connection.

For example, when the first pointer device 410 is pointed toward the second display device 300, that is, when they face each other, the angle of arrival of the second display device 300 may be 0 degrees. The controller 411 of the first pointer device 410 controls the second display device 300 when the angle of arrival of the second display device 300 is 0 degrees or the angle of arrival is in the range of -10 degrees to 10 degrees. You can also allow pairing and connection.

In this way, only when the first pointer device 410 is pointed at the second display device 300, the first pointer device 410 and the second display device 300 are connected to each other, and the second display device 300 ), a first pointer corresponding to the first pointer device 410 may be generated and displayed.

Accordingly, among the users attending the presentation, when a user who wants to make a presentation points at the second display device 300 using a pointer device, the user's pointer device is connected to the second display device 300 and the pointer is connected to the second display device 300. A pointer corresponding to the device may be displayed on the second display device 300.

According to an embodiment of the present disclosure, the second display device 300 may include a camera 350. The second display device 300 may output an image acquired through the camera 350 to the display 350.

When a pointer corresponding to a peripheral device (e.g., first to fourth pointer devices) is activated, the processor 310 of the second display device 300 determines the position and angle of the peripheral device (e.g., first to fourth pointer devices). The direction and zoom range of the camera 350 can be controlled accordingly. For example, the processor 310 may control the zoom range of the camera 350 and acquire an image according to the distance and direction at which the corresponding pointer device is located. Accordingly, the second display device 300 may acquire an image of the user using the pointer device through the camera 350 and output the obtained image on the display 330.

Here, the fact that the pointer is activated may mean that the user proceeds with the presentation using the pointer. Additionally, the fact that the pointer is activated may indicate that the pointer device is pointing toward the second display device 300. In addition, that the pointer is activated may indicate that the angle of arrival of the second display device 300 is 0 degrees, or the angle of arrival is in the range of -10 degrees to 10 degrees, based on the corresponding pointer device.

Next, an example of a method for measuring the angle of arrival (AoA) and distance based on the transmitted and received positioning signal will be described with reference to FIGS. 9 and 10.

FIG. 9 is a diagram illustrating a method of measuring the Angle of Arrival between a display device and a peripheral device in an embodiment of the present disclosure, and FIG. 10 is a diagram illustrating the distance between the display device and a peripheral device in an embodiment of the present disclosure. This is a diagram explaining how to measure.

For example, referring to FIG. 9 , the second display device 300 according to an embodiment of the present disclosure may include a first antenna 321 and a second antenna 322. The second display device 300 can transmit and receive a positioning signal 701 with the communication unit 413 of the first pointer device 410 through the first antenna 321 and the second antenna 322.

The angle of arrival θ (713) of the positioning signal 710 for the second display device 300 is the normal of the line connecting the first and second antennas 321 and 322 of the second display device 300 and the positioning signal 710. ) can be defined as the angle formed by , and when the positioning signal 710 is incident in a direction perpendicular to the second display device 300, the angle of arrival 713 may be 0 degrees.

The processor 310 of the second display device 300 determines the distance d between the first and second antennas 321 and 322 (711) and the positioning signal 710 incident on the first and second antennas 321 and 322. ), the angle of arrival θ (713) can be calculated using the distance difference p (712). Specifically, there is a phase difference α in the positioning signal 710 incident on the first antenna 321 and the second antenna 322, and the processor 310 uses the wavelength λ of the positioning signal 710 to determine the phase difference α. The corresponding distance difference p(712) can be calculated. That is, the processor 310 can calculate the angle of arrival θ (713) using [Equation 1] to [Equation 3] below.

FIG. 9 illustrates a method of calculating the angle of arrival in a two-dimensional plane using the first and second antennas 321 and 322 included in the communication unit 310 of the second display device 300. The present disclosure is not limited thereto.

In various embodiments of the present disclosure, the communication unit 320 of the second display device 300 may include three or more communication modules or three or more antennas. The processor 310 of the second display device 300 calculates the angle of arrival of the first pointer device 410 in three-dimensional space using three or more communication modules or three or more antennas, and calculates the angle of arrival of the first pointer device 410 in three-dimensional space. The direction of the first pointer device 410 can be determined.

FIG. 10 is a diagram illustrating a method of measuring the distance from the second display device 300 to the first pointer device 410 according to an embodiment of the present disclosure.

Referring to FIG. 10, the second display device 300 according to an embodiment of the present disclosure uses a two-way ranging technique to display the second display device 300 and the first pointer device ( 410) can measure the distance between

The second display device 300 transmits a poll message (801) to the first pointer device 410 at time point T _SP , and the first pointer device 410 sends a poll message (801) to time point T _RP . You can receive it. And, in response to the received poll message 801, the first pointer device 410 transmits a response message 802 to the second display device 300 at time point T _SR , and the second display device 300 may receive the response message 802 at time T _RR . And, in response to the received response message 802, the second display device 300 transmits a final message 803 to the first pointer device 410 at time T _SF , and the first pointer device 410 410 may receive the final message 803 at time T _RF .

Since the second display device 300 transmits the poll message 801 at time T _SP and receives the response message 802 in response to the poll message 801 at time T _RR , the second display device 300 From the perspective of , it takes T ₁ time to send a message and receive a response. Since the first pointer device 410 also received the poll message 801 at time T _RP and transmitted the response message 802 at time T _SR , the first pointer device 410 requires as much as T ₂ before responding. It takes time.

In addition, since the first pointer device 410 transmits the response message 802 at time T _SR and receives the final message 803, which is a response to the response message 802, at time T _RF , the first pointer device ( From the perspective of 410), it takes T ₃ time to transmit a message and receive a response. Since the second display device 300 also received the response message 802 at time T _RR and transmitted the final message 803 at time T _SF , the second display device 300 waits as much as T ₄ before responding. It takes time.

The processor 310 of the second display device 300 processes the positioning signals 801, 802, and 803 transmitted and received between the second display device 300 and the first pointer device 410 as shown in Equation 4 below. Time of Flight (TOF) can be calculated.

And, after calculating the time of flight (TOF) of the positioning signals 801, 802, and 803, the second display device 300 uses the propagation speed of the signal to display the second display device 300 and the first pointer device ( 410) can be calculated.

FIG. 10 illustrates a method of measuring the distance between the second display device 300 and the first pointer device 410 using Two Way Ranging (TWR). The present disclosure is not limited thereto. That is, in various embodiments of the present disclosure, the second display device 300 uses a one-way ranging technique, etc. to determine the distance between the second display device 300 and the first pointer device 410. Distance can be measured.

According to the display device and its driving method according to various embodiments of the present disclosure, a plurality of pointer devices can be connected.

According to the display device and its driving method according to various embodiments of the present disclosure, a plurality of user pointers can be displayed.

According to the display device and its driving method according to various embodiments of the present disclosure, it is possible to determine the position of the pointer device and process a connection to the pointer device located within a distance and reference angle range within a reference value.

Next, another example of a presentation system according to an embodiment of the present disclosure will be described with reference to FIG. 11.

According to an embodiment of the present disclosure, a presentation system as shown in FIG. 11 may be implemented.

The presentation system shown in FIG. 11 is different in the configuration and function of the first display device 100 compared to the presentation system described with reference to FIG. 5 . The first display device 100 may include a communication unit 120 and a camera 160.

The presentation system shown in FIG. 11 can process all of the functions described with reference to FIGS. 5 to 8. Additionally, the presentation system shown in Figure 11 can further handle the following functions.

The communication unit 120 of the first display device 100 may transmit and receive positioning signals to the first to fourth pointer devices 410, 420, 430, and 440. The first display device 100 may obtain at least one information among the angle of arrival or distance of the first to fourth pointer devices 410, 420, 430, and 440.

According to the presentation system shown in FIG. 11, the first display device 100 transmits and receives positioning signals to the first to fourth pointer devices 410, 420, 430, and 440, and the first to fourth pointer devices 410 , 420, 430, 440) can be determined. In addition, the second display device 300 transmits and receives positioning signals with the first to fourth pointer devices 410, 420, 430, and 440, and transmits and receives positioning signals from the first to fourth pointer devices 410, 420, 430, 440. You can decide the location.

The first display device 100 determines the relative positions of the first to fourth pointer devices 410, 420, 430, and 440, and provides movement information of the first to fourth pointer devices 410, 420, 430, and 440. Accordingly, the movement of the pointer can be controlled.

The first display device 100 may control the movement of the corresponding pointer according to the movement information and relative distance of the first to fourth pointer devices 410, 420, 430, and 440.

For example, as shown in FIG. 11, the second pointer device 420 may be separated from the first display device 100 by a first distance r1, and the fourth pointer device 440 may be separated from the first display device 100 ( It may be a second distance (r2) away from 100).

At this time, since the first distance r1 is shorter than the second distance r2, the moving distance or rotation angle of the second pointer device 420 and the moving distance or rotation angle of the fourth pointer device 440 are the same. Also, in the first display device 100, the moving distance of the second pointer corresponding to the second pointer device 420 and the moving distance of the fourth pointer corresponding to the fourth pointer device 440 may be implemented differently. .

For example, when the rotation angle of the second pointer device 420 and the rotation angle of the fourth pointer device 440 are the same, the movement distance of the second pointer in the first display device 100 is the movement distance of the fourth pointer. It can be implemented shorter than . This is because the first distance r1 between the first display device 100 and the second pointer device 420 is shorter than the second distance r2 between the first display device 100 and the fourth pointer device 440. Because.

According to an embodiment of the present disclosure, in consideration of the relative distance between the pointer device and the display device, the movement scale of the pointer may be adjusted according to the relative distance of the pointer device.

According to an embodiment, the communication unit 120 of the first display device 100 may transmit and receive positioning signals with the first to fourth pointer devices 410, 420, 430, and 440. The first display device 100 obtains the angle of arrival and distance information of the first to fourth pointer devices 410, 420, 430, and 440, and displays the The relative position can be determined.

The first display device 100 may determine the locations of conference participants attending the presentation based on the relative positions of the first to fourth pointer devices 410, 420, 430, and 440. The first display device 100 may record the location and participant information of conference attendees who attended the presentation.

According to an embodiment of the present disclosure, the first display device 100 may include a camera 160. The first display device 100 may output an image acquired through the camera 160.

When a pointer corresponding to a peripheral device (e.g., first to fourth pointer devices) is activated, the first display device 100 displays the camera 160 according to the position and angle of the peripheral device (e.g., first to fourth pointer devices). You can control the direction and zoom range. For example, the first display device 100 may control the zoom range of the camera 160 and acquire an image according to the distance and direction at which the corresponding pointer device is located. Accordingly, the first display device 100 may acquire an image of a user using the corresponding pointer device through the camera 160 and output the obtained image on the display 180.

Here, the fact that the pointer is activated may mean that the user proceeds with the presentation using the pointer. Additionally, the fact that the pointer is activated may indicate that the pointer device is pointing toward the first display device 100. In addition, that the pointer is activated may indicate that the angle of arrival of the first display device 100 is 0 degrees, or the angle of arrival is in the range of -10 degrees to 10 degrees, based on the corresponding pointer device.

In the presentation system described with reference to FIG. 11, the first display device 100 can obtain the position and movement information of the first to fourth pointer devices 410, 420, 430, and 440 and display the corresponding pointer. . Additionally, the second display device 300 may acquire the location and movement information of the first to fourth pointer devices 410, 420, 430, and 440 and display the corresponding pointers.

Next, another example of a presentation system according to an embodiment of the present disclosure will be described with reference to FIG. 12.

A presentation system according to an embodiment of the present disclosure may include a projector 1210, a screen 1220, and a first display device 1310.

According to an embodiment, content output on the first display device 1310 may be connected to the projector 1210 and projected on the screen 1220. The first display device 1310 may be connected to the projector 1210 wired or wirelessly.

For example, the first display device 1310 may be a small display device such as a laptop or mobile terminal. Content output on the first display device 1310 can be effectively shared with meeting participants by being projected on the screen 1220, which has a relatively large screen.

According to an embodiment, the projector 1210 uses short-range wireless communication technology similar to the method described with reference to FIGS. 5 to 11 to connect peripheral devices (e.g., the first display device 1310, the second display device (e.g., the first display device 1310), the second display device ( 1320), and can obtain at least one information among the angle of arrival or distance of a peripheral device (e.g., the first display device 1310 and the second display device 1320).

The projector 1210 can determine the location of a peripheral device (eg, the first display device 1310 and the second display device 1320) and determine whether to allow connection to the projector 1210.

As an example, the projector 1210 may allow connection to the first display device 1310 located at a distance within a reference value. Accordingly, the first display device 1310 is connected to the projector 1210, and content displayed on the first display device 1310 can be projected on the screen 1220.

At this time, when the second display device 1320 is located at a distance within the reference value from the projector 1210, the second display device 1320 sends a request signal requesting approval to use the screen 1220 to the projector 1210. can be transmitted (step 1). Then, the projector 1210 may transmit a request signal to the first display device 1310 to inquire whether to approve the user switch (step 2).

The first display device 1310 may transmit an approval signal or a rejection signal for user switching to the projector 1210 in response to a request signal inquiring whether the projector 1210 approves the user switching. When the first display device 1310 transmits an approval signal approving user switching to the projector 1210 (step 3), the projector 1210 authorizes the use of the screen 1220 to the second display device 1320. An approval signal can be transmitted (step 4). Accordingly, content may be projected on the screen 1220 of the second display device 1320.

According to an embodiment, a projector can transmit and receive positioning signals with nearby display devices using short-range wireless communication technology and easily and accurately determine the locations of the display devices. Based on the distance information of the display devices, the projector can decide whether to allow display devices located within the reference value to be connected to the projector (whether to use the screen), and can easily and efficiently switch projector use permissions between display devices. there is.

According to an embodiment of the present disclosure, the above-described method can be implemented as processor-readable code on a program-recorded medium. Examples of media that the processor can read include ROM, RAM, CD-ROM, magnetic tape, floppy disk, and optical data storage devices.

The display device described above is not limited to the configuration and method of the above-described embodiments, and the embodiments may be configured by selectively combining all or part of each embodiment so that various modifications can be made. It may be possible.

100 First display device
120 Department of Communications
160 camera
300 second display device
310 processor
320 Department of Communications
330 display
340 memory
350 camera
410 first pointer device
411 controller
413 Communications Department
415 inertial measurement unit
417 light emitting unit
419 user interface

Claims (16)

A communication unit that transmits and receives positioning signals with peripheral devices;
a processor that determines the relative position of the peripheral device based on the positioning signal transmitted and received from the communication unit and generates a pointer corresponding to the peripheral device located at a distance within a reference value;
a display that outputs the pointer generated by the processor;
A display device including a. According to paragraph 1,
The communication unit includes at least two antennas,
The processor calculates the angle of arrival (AoA) and distance of the peripheral device based on the transmitted and received positioning signal, and generates the pointer corresponding to the peripheral device. According to paragraph 1,
The communication unit is a display device that transmits and receives the positioning signal using short-range wireless communication. According to paragraph 3,
The short-range wireless communication is a display device that uses at least one of ultra-wideband (UWB), Bluetooth low energy (BLE), or Wi-Fi. According to paragraph 1,
The processor is configured to generate, if there are multiple peripheral devices located at a distance within the reference value, each pointer corresponding to each peripheral device to be displayed in a different color, different size, or different shape. According to paragraph 1,
The communication unit receives user information from the peripheral device,
A display device in which the processor displays the user information while generating the pointer corresponding to the peripheral device. According to clause 6,
A display device in which the processor records participant information based on the user information. According to paragraph 1,
The communication unit receives movement information from the peripheral device,
A display device wherein the processor controls movement of the pointer corresponding to the peripheral device based on the motion information. According to paragraph 1,
The peripheral device is a display device including at least one of a pointer device, a spatial remote control, a wireless mouse, a wireless keyboard, a wearable device, and a mobile terminal. According to paragraph 1,
Contains more cameras,
When the pointer corresponding to the peripheral device is activated, the processor controls the direction and zoom range of the camera according to the position and angle of the peripheral device. In a pointer device,
A communication unit that transmits and receives positioning signals with peripheral devices;
A controller that determines the relative position of the peripheral device based on the positioning signal transmitted and received from the communication unit and attempts pairing with the peripheral device located at a distance within a reference value;
A pointer device containing a. According to clause 11,
Further comprising an inertial measurement unit that acquires movement information of the pointer device,
The controller is a pointer device that provides the movement information to the peripheral device. According to clause 11,
The communication unit is a pointer device that transmits and receives the positioning signal using short-range wireless communication. According to clause 13,
The short-range wireless communication is a pointer device that uses at least one of ultra-wideband (UWB), Bluetooth low energy (BLE), or Wi-Fi. According to clause 11,
The communication unit includes at least two antennas,
The controller calculates the angle of arrival (AoA) and distance of the peripheral device based on the transmitted and received positioning signal, and attempts pairing with the peripheral device having an angle of arrival within a reference value. According to clause 11,
The controller is a pointer device that provides user information of the pointer device to the peripheral device.

Images