TWI762178B - Remote control method and control system - Google Patents

Abstract

A remote control method and a control system are provided. First, a peripheral apparatus connected to a display apparatus is identified through a multimedia interface. Afterward, an operation interface corresponding to the peripheral apparatus is displayed to the display apparatus. Moreover, coordinates of a light spot where a laser light falls on the display apparatus is identified when an option in the operation interface has been selected through the laser light emitted by an input apparatus, and a control code corresponding to the coordinates of the light spot is generated. Furthermore, the control code is transmitted to the peripheral apparatus so that the peripheral apparatus executes a corresponding related function.

Description

Remote control method and control system

The present invention relates to a remote control mechanism, and more particularly, to a remote control method and control system.

With the development of technology, TV can be connected with more and more kinds of peripheral devices. After being connected to a TV through a high-definition multimedia interface (High Definition Multimedia Interface, HDMI), the peripheral devices currently on the market are mostly controlled by their corresponding dedicated remote controllers. Therefore, when there are more peripheral devices connected, there are more remote controllers, and it is not very convenient to use them alternately. In addition, in the field of smart terminal applications, the input interface options become more complicated, so that consumers need to spend more time to operate. Although some solutions use a Bluetooth air mouse (Air mouse), the control of the air mouse is based on the principle of relative coordinates, resulting in poor user experience.

The present invention provides a remote control method and a control system. An input device emitting laser light is used in conjunction with an optical touch display device to establish a control and communication mechanism, so as to increase the convenience and intuition of operation.

The remote control method of the present invention is suitable for a display device, and the remote control method includes: confirming the peripheral device connected to the display device through a multimedia interface; displaying the operation interface corresponding to the peripheral device to the display device; When the emitted laser light selects an option in the operation interface, confirm that the laser light falls on the coordinates of the light spot on the display device, and generate a control code corresponding to the coordinates of the light spot; and transmit the control code to the peripheral device, so that the peripheral device executes the corresponding related functions.

In an embodiment of the present invention, when an option in the operation interface is selected through the laser light emitted by the input device, the function keys in the input device are enabled, so as to transmit the function key code to the display device through the input device through wireless communication technology .

In an embodiment of the present invention, the remote control method further includes: connecting with the input device through wireless communication technology, and receiving a wake-up signal from the input device.

In an embodiment of the present invention, the multimedia interface is a high-definition multimedia interface, which can transmit control through a Consumer Electronics Control (CEC) protocol of a High Definition Multimedia Interface (HDMI). code to peripheral devices.

In an embodiment of the present invention, the remote control method further comprises: establishing a connection with the peripheral device and the input device respectively through the Bluetooth communication technology, so as to transmit the light point coordinates and the function key code to the peripheral device through the Bluetooth communication technology.

The control system of the present invention includes: an input device and a display device. The input device is used for emitting laser light. The display device includes: a display panel, a multimedia interface and a processor. The processor is coupled to the display panel and the multimedia interface, and is configured to: confirm the peripheral device connected to the multimedia interface; display the operation interface corresponding to the peripheral device to the display panel; select the operation interface through the laser light sent by the input device When the option in , confirms the coordinates of the light spot where the laser light falls on the display panel, and generates a control code corresponding to the coordinates of the light spot; and transmits the control code to the peripheral device, so that the peripheral device can perform the corresponding function.

Based on the above, the present invention uses an input device that emits laser light and a display device to establish a control and communication mechanism, thereby providing a peripheral device connected to the display device with a remote control function, so as to increase the convenience and intuition of operation, At the same time, peripheral devices can be extended to more applications.

FIG. 1 is a block diagram of a control system according to an embodiment of the present invention. Referring to FIG. 1 , the control system includes an input device 110 and a display device 120 . The display device 120 is coupled to the peripheral devices 130-1 to 130-3. Here, the number of peripheral devices is only an example, and is not limited thereto. The following is an example to illustrate the detailed process of using the input device 110 and the display device 120 to remotely control the peripheral devices 130-1 to 130-3.

FIG. 2A is a flowchart of a remote control method according to an embodiment of the present invention. FIG. 3 is a schematic diagram of implementing remote control according to an embodiment of the present invention. In this embodiment, the signal source of the display device 120 is switched to the peripheral device 130-1.

Referring to FIG. 2A and FIG. 3 , in step S205 , the display device 120 confirms the peripheral device 130 - 1 connected to the display device 120 through the multimedia interface. Here, a wake-up signal can be sent to the display device 120 through the input device 110, so that the display device 120 can acquire the identification code of the peripheral device 130-1 according to the multimedia interface corresponding to the currently selected signal source. For example, the display device 120 can be connected with the input device 110 through a wireless communication technology, and receive a wake-up signal from the input device 110 through the connection. Here, the wireless communication technology is, for example, wireless fidelity (Wi-Fi), Bluetooth (Bluetooth, BLE), radio frequency (Radio frequency, RF), and the like.

Next, in step S210 , the operation interface 310 corresponding to the peripheral device 130 - 1 is displayed on the display device 120 . Here, it can be set that when the input device 110 sends the laser light L to the display device 120 and the display device 120 receives the laser light L, it will display the corresponding operation interface 310 according to the identification code obtained in step S205 . Here, the operation interface 310 is built in the display device 120 . As shown in FIG. 3, the operation interface 310 includes a plurality of options 311-316, which have different functions respectively.

After that, in step S215, when the option 313 in the operation interface 310 is selected through the laser light L sent by the input device 110, the display device 120 confirms that the laser light L falls on the light spot coordinates on the display device 120, and generates the coordinates corresponding to the laser light L on the display device 120. Control code for the coordinates of the light spot. For example, the user can manipulate the input device 110 to move the emitted laser light on the display device 120 , and after the laser light moves to the option to be selected (eg, the option 313 shown in FIG. 3 ), press the function key to make The input device 110 sends the function key code to the display device 120 . The display device 120 knows that the option has been selected after receiving the function key code, so it generates a control code corresponding to the option 313 according to the coordinates of the light spot of the display device 120 when the laser light falls on the display device 120 when the function key code is received.

Afterwards, in step S220, the display device 120 transmits the control code to the peripheral device 130-1, so that the peripheral device 130-1 executes the corresponding related function. In one embodiment, the peripheral device 130-1 is, for example, an old or traditional device (such as a DVD player), and the peripheral device 130-1 is transmitted through a cable such as a High Definition Multimedia Interface (HDMI). The peripheral device 130-1 has no built-in wireless communication module, and no user interface design of built-in remote controller. Accordingly, the microcontroller in the display device 120 automatically generates a user interface corresponding to the remote control of the peripheral device 130-1, and displays it on the display device 120 for consumers to watch and control.

Here, the display device 120 can transmit the control code to the peripheral device 130-1 through the HDMI Consumer Electronics Control (CEC) protocol. Referring to FIG. 3 , after the user selects the option 313 through the laser light of the input device 110 , the peripheral device 130 - 1 can execute the “play” function corresponding to the option 313 .

In another corresponding embodiment, the peripheral device 130-1 has a wireless communication module for connecting with the display device 120 through wireless communication technology, and the peripheral device 130-1 has a built-in user interface corresponding to the remote controller. . Therefore, the display device 120 does not need to generate a user interface corresponding to the remote control of the peripheral device 130-1 by itself, but can directly call the user interface built in the peripheral device 130-1 and display it. The peripheral device 130-1 may be a computer, a game console, or a set-top box (Over The Top (OTT) Box), which transmits coordinates and control codes through a pre-paired wireless communication module, so that the peripheral device 130-1 expands the remote Touch operation function.

FIG. 2B is a flowchart of a remote control method according to an embodiment of the present invention. In this embodiment, the signal source of the display device 120 is switched to the peripheral device 130-1. In this embodiment, it is further determined whether the peripheral device has the Bluetooth function.

Referring to FIG. 2B and FIG. 3 , in step S205 , the display device 120 confirms the peripheral device 130 - 1 connected to the display device 120 through the multimedia interface. Next, in step S207, the display device 120 determines whether the peripheral device 130-1 has the Bluetooth function and has been paired.

If the peripheral device 130 - 1 does not have the Bluetooth function and cannot be paired with the display device 120 , steps S210 to S220 shown in FIG. 2A are performed. If the built-in Bluetooth modules of the display device 120 and the peripheral device 130-1 have been paired, steps S230 to S240 are executed.

In step S230 , the operation interface 310 of the peripheral device 130 - 1 itself is displayed on the display device 120 .

Next, in step S235 (similar to step S215 ), when the option 313 in the operation interface 310 is selected through the laser light L sent by the input device 110 , the display device 120 confirms that the laser light L falls on the light spot on the display device 120 coordinates, and generate a control code corresponding to the coordinates of the light spot.

Afterwards, in step S240, the display device 120 transmits the coordinates of the light spot and the control code to the peripheral device 130-1, so that the peripheral device 130-1 executes the corresponding related function.

The following examples illustrate the detailed components inside the input device 110 and the display device 120 respectively. FIG. 4 is a block diagram of a display device according to an embodiment of the present invention. FIG. 5 is a block diagram of an input device according to an embodiment of the present invention.

Referring to FIG. 4 , the display device 120 includes a display panel 410 , a processor 420 , a communication device 430 and multimedia interfaces 441 , 442 and 443 . Here, the number of multimedia interfaces is only an example, and is not limited thereto. The multimedia interface is, for example, HDMI. HDMI can be used for peripheral devices such as set-top boxes, DVD players, personal computers, video games, integrated amplifiers, digital audio and TV sets. The processor 420 is coupled to the display panel 410 , the communication device 430 and the multimedia interfaces 441 , 442 and 443 . The display panel 410 can be based on a touch panel structure, and a photo sensor (photo sensor) layer can be added by utilizing the manufacturing process or technical capability, which can take into account the application of capacitive or optical touch.

The processor 420 is, for example, a central processing unit (Central Processing Unit, CPU), a physical processing unit (Physics Processing Unit, PPU), a programmable microprocessor (Microprocessor), an embedded control chip, a digital signal processor (Digital Signal Processor) Processor, DSP), Application Specific Integrated Circuits (ASIC), or other similar devices. The display device 120 also includes a storage device (not shown) storing a plurality of code fragments. After the above-mentioned code fragment is installed, it is executed by the processor 420 to control the output of the display panel 410 . The communication device 430 is, for example, a chip or circuit supporting the Bluetooth communication technology.

The processor 420 can determine which one is currently selected among the multimedia interfaces 441 , 442 and 443 , and obtain the identification code of the connected peripheral device through the selected multimedia interface.

5 , the input device 110 includes a Microcontroller Unit (MCU) 501 , a switch 503 , a laser diode 505 , a laser receiver 507 , a function key 509 , a communication device 511 and an activation key 513 . Here, only one function key 509 is shown, however, in other embodiments, a plurality of function keys may be set as appropriate. In addition, in other embodiments, the function key 509 and the activation key 513 may also be integrated into a physical or virtual key, which is not limited herein.

The microcontroller 501 is a single-chip microcomputer in which the main parts of the microcomputer are integrated on one wafer. Microcomputers are small electronic computers composed of large-scale integrated circuits. The microcontroller 501 is coupled to the switch 503 , the laser diode 505 , the laser receiver 507 and the function keys 509 . The communication device 511 is a communication structure capable of bidirectional transmission, such as a chip or circuit supporting Bluetooth communication technology.

When the activation key 513 is enabled, the microcontroller 501 switches the switch 503 to drive the laser diode 505 to transmit laser light. The microcontroller 501 determines whether a response signal is received through the communication device 511 within a specified time. When the response signal is received within the specified time, the microcontroller 501 continuously drives the laser diode 505 to send laser light. When no response signal is received within a specified time, the microcontroller 501 switches the switch 503 to drive the laser diode 505 to stop sending laser light. The laser receiver 507 can be implemented with a photodiode, which is used to receive and monitor the laser light emitted by the laser diode 505 .

Further, in the input device 110, when the user presses the activation key 513 on the input device 110, the microcontroller 501 detects that the activation key 513 is enabled. At this time, the switch 503 is switched to an open state to drive the laser diode 505 to emit laser light. Moreover, after the microcontroller 501 resets the count time of the timer to zero, it starts to count the time to determine whether a response signal is received within the specified time. Here, the specified time may be preset according to the damage to the eyes by the laser light. If no response signal is received within a specified time, the microcontroller 501 switches the switch 503 to an off state, so that the laser diode 505 stops emitting laser light. On the other hand, if the response signal is received within the specified time, the laser diode 505 is continuously driven to send laser light. During the period when the input device 110 continues to transmit the laser light, if it is detected that the function key 509 on the input device 110 is enabled, the microcontroller 501 can send the function key code to the display device 120 through the communication device 511 .

In the display device 120 , when the display panel 410 detects the laser light, the processor 420 transmits a response signal to the input device 110 through the communication device 430 , and displays the corresponding operation interface on the display panel 410 . When the function key code of the input device 110 is received through the communication device 430, the processor 420 confirms the coordinates of the light spot where the current laser light falls on the display panel 410, and generates a control code corresponding to the coordinates of the light spot. After that, the control code is transmitted to the peripheral device 130-1.

By using the input device 110 emitting laser light and the display device 120 to establish a control and communication mechanism, the display device 120 becomes a multimedia control center without setting too many physical buttons on the input device 110 . Accordingly, the remote control of the peripheral devices 130-1 to 130-3 is as convenient as the proximal control. In addition, the transmission path between the display device 120 and the peripheral devices 130 - 1 to 130 - 3 can be performed through the CEC function of HDMI. According to this, the CEC function of HDMI can be fully utilized, and the compatibility between many peripheral devices and the display device 120 can be solved. matching problem.

In addition, in other embodiments, the transmission path between the display device 120 and the peripheral devices 130-1 to 130-3 can also be performed through the Bluetooth communication technology.

6A and 6B are schematic diagrams of an application example of an input device according to an embodiment of the present invention. Referring to FIG. 6A and FIG. 6B , the input device 110 further includes a connection structure 610 to be electrically connected to the mobile device 600 . The mobile device 600 supplies power to the input device 110 through the electrical connection and performs signal transmission with the input device 110 through the electrical connection. After the connection structure 610 is electrically connected to the charging port of the mobile device 600 , the mobile device 600 will activate the corresponding application program to display the virtual keys 601 - 606 on the display of the mobile device 600 for control. Specifically, the input device 110 is a laser receiver 507 , and the laser diode 505 is combined with the mobile device 600 , wherein the laser receiver 507 and the laser diode 505 can be assembled arbitrarily through the connection structure 610 . Or disassembled from the mobile device 600 .

As shown in FIG. 6B , the laser light is sent through the input device 110 , and the movement of the light spot of the laser light on the display panel 120 can be similar to using a mouse to control the movement of a cursor, which is more intuitive. In addition, the mobile device 600 has functions such as bluetooth, touch display panel, microphone, 9-axis sensor, lens, identity recognition, etc., which can solve the problems of input, handwriting, voice, identity, etc., both of which can be combined with all remote control problems. solved.

By combining the input device 110 with the mobile device 600 , the virtual buttons 601 - 606 can be displayed through the display of the mobile device 600 , thereby becoming a laser remote control. In addition, by using functions such as identity recognition of the mobile device, a customized user interface or personal information recording can be generated under multi-person control during normal or game use. In addition, there are more different options when inputting, such as keyboard, handwriting or voice, etc., integrating all controls, consumers can choose according to their preferences or habits.

Since the mobile device 600 has the function of laser light, it can be applied more widely, such as a presentation pen or distance measurement, which makes life more convenient. In addition, direct coordinates can be generated on the display panel 410 through the laser light for intuitive control, so that the laser light simulation mouse function is more intuitive and more usable.

The mobile device 600 can also transmit the optical code through the laser light, and adjust the function according to the application requirements. In addition, by using the 9-axis sensor on the mobile device 600 and the coordinates generated by the laser light on the display panel 410, the display contents can be scaled, balanced, rotated and other functions, which can be used for viewing and games. Combining the application of the input device 110 with the mobile device 600 also helps to collect the big data of the user's manipulation behavior on the large-screen display more comprehensively, and the application is also wider.

In addition, in other embodiments, the input device 110 can also be built in the mobile device 600 .

In addition, the display panel 410 can also be used to detect the movement trajectory of the laser light, and the processor 420 performs corresponding specified operations based on the movement trajectory. For example, after the input device 110 excites the laser light, when the function key 509 is pressed and held down, the processor 420 reads and records the movement track of the laser light on the display panel 410, and identifies the movement track, so that the remote input can be performed , annotation or key mark, control symbol definition, shape function definition (opening the keyboard or remote control function, etc.), greatly increasing the convenience of remote input control.

7A and 7B are schematic diagrams of remote operation using a laser light trajectory according to an embodiment of the present invention. Referring to FIGS. 7A and 7B , continuously pressing the function key 509 of the input device 110 uses laser light to form a movement track 710 (shown in FIG. 7A ) on the right side of the display panel 410 . After that, the function key 509 is released, and the virtual remote controller 720 (shown in FIG. 7B ) is displayed on the display panel 410 .

8A and 8B are schematic diagrams of remote operation using a laser light trajectory according to an embodiment of the present invention. Referring to FIGS. 8A and 8B , continuously pressing the function key 509 of the input device 110 uses laser light to form a movement track 830 (as shown in FIG. 8A ) below the display panel 410 . After that, the function key 509 is released, and the virtual keyboard 840 (shown in FIG. 8B ) is displayed on the display panel 410 .

To sum up, the present invention employs an input device that emits laser light and a display device to establish a control and communication mechanism, thereby providing a peripheral device connected to the display device with a remote control function. In the above-mentioned embodiment, the display device becomes the multimedia control center, so there is no need to set too many physical buttons on the input device, so that the design is simpler. In addition, the movement of the cursor is simulated by the movement of the laser light, making it more convenient and intuitive for consumers to use.

110: Input device 120: Display device 130-1～130-3: Peripheral devices S205-S220: each step of the remote control method 310: Operation interface 311~316: Options 410: Display panel 420: Processor 430, 511: Communication equipment 441～443: Multimedia Interface 501: Microcontroller 503: switch 505: Laser Diode 507: Laser Receiver 509: function keys 513: trigger key 600: Mobile Devices 601～606: virtual keys 610: Connection Structure 710, 830: Movement track 720: Virtual Remote 840: Virtual keyboard L: laser light

FIG. 1 is a block diagram of a control system according to an embodiment of the present invention. FIG. 2A is a flowchart of a remote control method according to an embodiment of the present invention. FIG. 2B is a flowchart of a remote control method according to an embodiment of the present invention. FIG. 3 is a schematic diagram of implementing remote control according to an embodiment of the present invention. FIG. 4 is a block diagram of a display device according to an embodiment of the present invention. FIG. 5 is a block diagram of an input device according to an embodiment of the present invention. 6A and 6B are schematic diagrams of an application example of an input device according to an embodiment of the present invention. 7A and 7B are schematic diagrams of remote operation using a laser light trajectory according to an embodiment of the present invention. 8A and 8B are schematic diagrams of remote operation using a laser light trajectory according to an embodiment of the present invention.

S205~S220: each step of the remote control method

Claims (12)

A remote control method applicable to a display device, the remote control method comprising: confirming a peripheral device connected to the display device through a multimedia interface; displaying an operation interface corresponding to the peripheral device to the display device; When an option in the operation interface is selected through a laser beam sent by an input device, in response to a function key code received from the input device, it is confirmed that the laser beam falls on the function key code when the function key code is received A light spot coordinate on the display device is displayed, and a control code corresponding to the light spot coordinate is generated; the control code is transmitted to the peripheral device, so that the peripheral device performs a corresponding related function. The remote control method as claimed in claim 1, when selecting the option in the operation interface through the laser light emitted by the input device, further comprising: enabling a function key in the input device to transmit through the input device The input device transmits the function key code to the display device through a wireless communication technology. The remote control method of claim 1, further comprising: connecting with the input device through a wireless communication technology, and receiving a wake-up signal from the input device. The remote control method of claim 1, wherein the multimedia interface is a high-definition multimedia interface, and the step of transmitting the control code to the peripheral device comprises: a consumer electronic control protocol through the high-definition multimedia interface send the control code to the peripheral device. The remote control method of claim 1, further comprising: establishing a connection with the peripheral device and the input device respectively through a wireless communication technology, so as to transmit the control code to the peripheral device through the wireless communication technology. A control system includes: an input device sending a laser light; and a display device including: a display panel; a multimedia interface; and a processor coupled to the display panel and the multimedia interface and configured to : confirms a peripheral device connected to the multimedia interface; displays an operation interface corresponding to the peripheral device to the display panel; when an option in the operation interface is selected through the laser light sent by the input device, responds to an automatic A function key code received by the input device confirms a light spot coordinate of the laser light falling on the display panel when the function key code is received, and generates a control code corresponding to the light spot coordinate; and The control code is sent to the peripheral device, so that the peripheral device executes a corresponding related function. The control system of claim 6, wherein the processor is configured to: upon receiving the laser light from the input device, send a response signal to the input device so that the input device continues to send the laser light. The control system of claim 6, wherein the input device comprises: a function key; and a microcontroller coupled to the function key and configured to: after the function key is enabled, the input device The function key code is transmitted to the display device through a wireless communication technology. The control system of claim 6, wherein the input device further comprises: a connection structure configured to be electrically connected with a mobile device. The control system of claim 6, wherein the display device further comprises: a communication device configured to connect with the input device and receive a wake-up signal from the input device, wherein the communication device supports a wireless communication technology. The control system of claim 6, wherein the multimedia interface is a high-definition multimedia interface, and the processor is configured to: transmit the control code to the peripheral through a consumer electronic control protocol of the high-definition multimedia interface device. The control system of claim 6, wherein the display device further comprises: a communication device configured to establish a connection with the peripheral device and the input device, wherein the communication device supports a wireless communication technology, the processor is configured to transmit the control code to the peripheral device via the communication device.

Images