WO2021218830A1 - 一种指向遥控方法及系统 - Google Patents

一种指向遥控方法及系统 Download PDF

Info

Publication number
WO2021218830A1
WO2021218830A1 PCT/CN2021/089439 CN2021089439W WO2021218830A1 WO 2021218830 A1 WO2021218830 A1 WO 2021218830A1 CN 2021089439 W CN2021089439 W CN 2021089439W WO 2021218830 A1 WO2021218830 A1 WO 2021218830A1
Authority
WO
WIPO (PCT)
Prior art keywords
infrared
display device
remote control
infrared signal
projection
Prior art date
Application number
PCT/CN2021/089439
Other languages
English (en)
French (fr)
Inventor
胡玉冰
刘康仲
景涛
李亮
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to KR1020227041233A priority Critical patent/KR20230003044A/ko
Priority to US17/997,440 priority patent/US20230232060A1/en
Priority to JP2022566030A priority patent/JP7479508B2/ja
Priority to EP21796220.8A priority patent/EP4131978A4/en
Publication of WO2021218830A1 publication Critical patent/WO2021218830A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/42221—Transmission circuitry, e.g. infrared [IR] or radio frequency [RF]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G06F3/0308—Detection arrangements using opto-electronic means comprising a plurality of distinctive and separately oriented light emitters or reflectors associated to the pointing device, e.g. remote cursor controller with distinct and separately oriented LEDs at the tip whose radiations are captured by a photo-detector associated to the screen
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • G06F3/0386—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry for light pen
    • G—PHYSICS
    • G08—SIGNALLING
    • G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C23/00—Non-electrical signal transmission systems, e.g. optical systems
    • G08C23/04—Non-electrical signal transmission systems, e.g. optical systems using light waves, e.g. infrared
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/42225—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details characterized by types of remote control, e.g. universal remote control
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/426—Internal components of the client ; Characteristics thereof

Definitions

  • This application relates to the field of communication technology, and in particular to a pointing remote control method and system.
  • the simplified design of the remote control has become the consensus of the industry.
  • the remote control only has buttons for direction control, confirmation, return, volume +, volume -, homepage, etc., and all operations can be realized by cooperating with the user interface of the operating system on the display device.
  • a display device such as a television can display a user interface with a checkbox and display a checkbox, which can be used to indicate the checkbox selected on the user interface.
  • the user can use the remote control to move the option box on the option grid that the user wants to select through the direction control keys.
  • the user needs to use the arrow keys on the remote control for a long time and frequently to select the desired option.
  • the present application provides a method and system for pointing remote control, which realizes that the display device can recognize the pointing position of the remote control device on the display screen of the display device through the graphical infrared signal sent by the remote control device, which simplifies the operation steps.
  • this application provides a pointing remote control system, including: a remote control device and a display device; wherein the remote control device is used to send a graphical infrared signal to the display device.
  • the display device is used to receive the graphical infrared signal through a plurality of infrared receivers; the display device is also used to obtain the projection image of the graphical infrared signal on the display screen.
  • the display device is also used to determine the pointing position of the remote control device on the display screen according to the projection graph.
  • the display device is also used to display a prompt mark on the pointing position of the display screen, and the prompt mark is used to prompt the user of the pointing position of the remote control device on the display screen.
  • the display device includes the above-mentioned multiple infrared receivers and the above-mentioned display screen.
  • the remote control device is further configured to: receive a first input of the user acting on the first button; in response to the first input, send the control information corresponding to the first button to the display device.
  • the display device is further configured to: determine a first control operation according to the control information corresponding to the first button and the pointing position; and execute the first control operation.
  • the remote control device is specifically configured to: in response to the first input, send the control information corresponding to the first button to the display device through the graphical infrared signal.
  • the remote control device is specifically configured to: in response to the first input, send control information corresponding to the first button to the display device via Bluetooth.
  • the plurality of infrared receivers are arranged into an infrared receiver array, and the infrared receiver array is coupled in the display screen.
  • the multiple infrared receivers are arranged around the display screen to form an infrared receiver frame.
  • the graphical infrared signal includes a circular infrared signal;
  • the projection graphic includes a circular projection graphic or an elliptical projection graphic.
  • the display device is specifically configured to: determine the center position of the circular projection graphic or the elliptical projection graphic as the circular projection graphic or the elliptical projection graphic on the display screen according to the received graphical infrared signal Point to the location.
  • the patterned infrared signal includes a circular ring infrared signal; the projection pattern includes a circular ring projection pattern or an elliptical ring projection pattern, wherein the energy in different rings of the circular ring infrared signal is different.
  • the display device is specifically configured to: obtain the positions of the M receiving points covered by the circular ring projection graphic or the elliptical ring projection graphic on the infrared receiving array, where M is a positive integer; The location is the center of the circle, the outer ring radius and the inner ring radius corresponding to the signal strength of the ring-shaped infrared signal received by the receiving point, the ring corresponding to the receiving point is determined; according to the M receiving points For the respective corresponding rings, the overlapping area of M rings is determined, and the center position of the overlapping area is determined as the pointing position.
  • the graphical infrared signal includes a cross-shaped infrared signal; the projection figure includes a cross-shaped figure.
  • the display device is specifically used to: obtain the positions of the four receiving points on the infrared receiving frame that receive the cross-shaped infrared signal; determine that the graphical infrared signal is displayed on the display by the positions of the four receiving points The cross-shaped graphic on the screen; calculate the position of the intersection in the cross-shaped graphic, and determine the position of the intersection as the pointing position.
  • the first control operation includes any one of the following: a click operation, a long press operation, a frame selection operation, and a drag operation.
  • the display device includes any of the following device types: monitors, televisions, and tablet computers;
  • the remote control device includes any of the following device types: remote control, mouse, smart phone .
  • the embodiment of the present application provides a pointing remote control system.
  • the display device can receive the graphical infrared signal sent by the remote control device through the infrared receiver array or the infrared receiver frame.
  • the display device can determine the pointing position of the remote control device on the display device according to the projection of the graphical infrared signal on the infrared receiver array or the infrared receiver frame. In this way, the display device can recognize the pointing position of the remote control device on the display screen of the display device through the graphical infrared signal sent by the remote control device, which simplifies the operation steps.
  • the user can remotely perform touch-sensitive interactive operations (for example, click, frame selection, long press, drag, etc.) on the display device through the remote control device.
  • the present application provides a display device including: a processor, a display screen, and multiple infrared receivers.
  • the multiple infrared receivers are used to receive graphical infrared signals sent by a remote control device.
  • the processor is used to obtain the projection image of the graphical infrared signal on the display screen.
  • the processor is also used to determine the pointing position of the remote control device on the display screen according to the projection graph.
  • the display screen is also used to display a prompt mark on the pointing position of the display screen, and the prompt mark is used to prompt the user of the pointing position of the remote control device on the display screen.
  • the display device further includes: a wireless communication module.
  • the wireless communication module is used to receive the control information corresponding to the first button sent by the remote control device.
  • the processor is further configured to determine the first control operation according to the control information corresponding to the first button and the pointing position.
  • the processor is also used to execute the first control operation.
  • the wireless communication module is specifically configured to: receive the control information corresponding to the first button sent by the remote control device through the graphical infrared signal.
  • the wireless communication module is specifically configured to: receive the control information corresponding to the first button sent by the remote control device via Bluetooth.
  • the plurality of infrared receivers are arranged into an infrared receiver array, and the infrared receiver array is coupled in the display screen.
  • the multiple infrared receivers are arranged around the display screen to form an infrared receiver frame.
  • the graphical infrared signal includes a circular infrared signal;
  • the projection graphic includes a graphic projection or an elliptical projection graphic.
  • the processor is specifically configured to: determine the center position of the circular projection graphic or the elliptical projection graphic on the display screen based on the circular infrared signal received The pointing position.
  • the patterned infrared signal includes a circular ring infrared signal; the projection pattern includes a circular ring projection pattern or an elliptical ring projection pattern, wherein the energy in different rings of the circular ring infrared signal is different.
  • the processor is specifically configured to: obtain the positions of the M receiving points covered by the circular ring graphic or the elliptical ring projection graphic on the infrared receiving array, where M is a positive integer;
  • the position of the receiving point is a circle, the outer ring radius and the inner ring radius corresponding to the signal strength of the ring-shaped infrared signal received by the receiving point, the ring corresponding to the receiving point is determined; according to the M receiving points For the respective corresponding rings, the overlapping area of M rings is determined, and the center position of the overlapping area is determined as the pointing position.
  • the graphical infrared signal includes a cross-shaped infrared signal; the projection figure includes a cross-shaped figure.
  • the processor is specifically configured to: obtain the positions of the four receiving points on the infrared receiving frame that receive the cross-shaped infrared signal; determine that the graphical infrared signal is displayed on the display through the positions of the four receiving points The cross-shaped graphic on the screen; calculate the position of the intersection in the cross-shaped graphic, and determine the position of the intersection as the pointing position.
  • the first control operation includes any one of the following: a click operation, a long press operation, a frame selection operation, and a drag operation.
  • the display device includes any of the following device types: monitors, televisions, and tablet computers;
  • the remote control device includes any of the following device types: remote control, mouse, smart phone .
  • the embodiment of the present application provides a display device, which can receive a graphical infrared signal sent by a remote control device through an infrared receiver array or an infrared receiver frame.
  • the display device can determine the pointing position of the remote control device on the display device according to the projection of the graphical infrared signal on the infrared receiver array or the infrared receiver frame. In this way, the display device can recognize the pointing position of the remote control device on the display screen of the display device through the graphical infrared signal sent by the remote control device, which simplifies the operation steps.
  • the present application provides a pointing remote control method, including: first, a display device receives graphical infrared signals sent by the remote control device through multiple infrared receivers. Then, the display device obtains the projection figure of the graphical infrared signal on the display screen, and then, the display device determines the pointing position of the remote control device on the display screen according to the projection figure. Then, the display device displays a prompt mark on the pointing position of the display screen, and the prompt mark is used to prompt the user of the pointing position of the remote control device on the display screen.
  • the method further includes: the display device receives the control information corresponding to the first button sent by the remote control device.
  • the display device determines the first control operation according to the control information corresponding to the first button and the pointing position.
  • the display device performs the first control operation.
  • the display device receiving the control information corresponding to the first button sent by the remote control device specifically includes: the display device receiving the control information corresponding to the first button sent by the remote control device through the graphical infrared signal Control information.
  • the display device receiving the control information corresponding to the first button sent by the remote control device specifically includes: the display device receiving the control information corresponding to the first button sent by the remote control device via Bluetooth.
  • the plurality of infrared receivers are arranged into an infrared receiver array, and the infrared receiver array is coupled in the display screen.
  • the multiple infrared receivers are arranged around the display screen to form an infrared receiver frame.
  • the graphical infrared signal includes a circular infrared signal;
  • the projection graphic includes a graphic projection or an elliptical projection graphic.
  • the display device determines the pointing position of the remote control device on the display screen according to the projection pattern, which specifically includes: the display device projects the circular projection pattern or the ellipse on the display screen according to the circular infrared signal received Shape projection graphics, and determine the center position of the circular projection graphics or the elliptical projection graphics as the pointing position.
  • the patterned infrared signal includes a circular ring infrared signal;
  • the projection pattern includes a circular ring projection pattern or an elliptical ring projection pattern, wherein the energy in different rings of the circular ring infrared signal is different.
  • the display device determines the pointing position of the remote control device on the display screen according to the projection pattern, which specifically includes: the display device projects the pattern according to the circular or elliptical ring, and receiving the infrared signal in the projection pattern The intensity information determines the pointing position.
  • the graphical infrared signal includes a cross-shaped infrared signal; the projection figure includes a cross-shaped figure.
  • the display device obtains the projected graphics of the graphical infrared signal on the display screen, which specifically includes: the display device obtains the positions of the four receiving points on the infrared receiving frame that receive the cross-shaped infrared signal; the display device passes through the The positions of the four receiving points determine the cross-shaped figure of the graphical infrared signal on the display screen.
  • the display device determines the pointing position of the remote control device on the display screen according to the projected figure, which specifically includes: calculating the position of the intersection in the cross-shaped figure, and determining the position of the intersection as the pointing position.
  • the first control operation includes any one of the following: a click operation, a long press operation, a frame selection operation, and a drag operation.
  • the display device includes any of the following device types: monitors, televisions, and tablet computers;
  • the remote control device includes any of the following device types: remote control, mouse, smart phone .
  • the embodiment of the present application provides a method for pointing remote control.
  • the display device can receive the graphical infrared signal sent by the remote control device through the infrared receiver array or the infrared receiver frame.
  • the display device can determine the pointing position of the remote control device on the display device according to the projection of the graphical infrared signal on the infrared receiver array or the infrared receiver frame. In this way, the display device can recognize the pointing position of the remote control device on the display screen of the display device through the graphical infrared signal sent by the remote control device, which simplifies the operation steps.
  • the present application provides a chip system applied to a display device, characterized in that the chip system includes a processor; the display device includes a plurality of infrared receivers and a display screen.
  • the processor is used to: obtain a projection pattern on the display screen of the graphical infrared signal sent by the remote control device received by a plurality of infrared receivers; determine the pointing position of the remote control device on the display screen according to the projection pattern; Instruct the display screen to display a prompt mark at the pointing position, and the prompt mark is used to prompt the user of the pointing position of the remote control device on the display screen.
  • a wireless communication module is further included; the wireless communication module is configured to receive control information corresponding to the first button sent by the remote control device.
  • the processor is further configured to determine the first control operation according to the control information corresponding to the first button and the pointing position.
  • the processor is also used to execute the first control operation.
  • the wireless communication module is specifically configured to: receive the control information corresponding to the first button sent by the remote control device through the graphical infrared signal.
  • the wireless communication module is specifically configured to: receive the control information corresponding to the first button sent by the remote control device via Bluetooth.
  • the patterned infrared signal includes a circular infrared signal; the projection pattern includes a pattern projection or an elliptical projection pattern; the plurality of infrared receivers are arranged into an infrared receiver array, and the infrared receiver array Coupled in the display.
  • the processor is specifically configured to: determine the center position of the circular projection graphic or the elliptical projection graphic on the display screen based on the circular infrared signal received The pointing position.
  • the patterned infrared signal includes a circular ring infrared signal;
  • the projection pattern includes a circular ring projection pattern or an elliptical ring projection pattern, wherein the energy in different rings of the circular ring infrared signal is different.
  • the plurality of infrared receivers are arranged into an infrared receiver array, and the infrared receiver array is coupled in the display screen.
  • the processor is specifically configured to: obtain the positions of M receiving points covered by the circular ring projection graphic or the elliptical ring projection graphic on the infrared receiving array, where M is a positive integer; taking the position of the receiving point as the center of the circle, The radius of the outer ring and the radius of the inner ring corresponding to the signal strength of the ring-shaped infrared signal received by the receiving point are determined to determine the ring corresponding to the receiving point; and M rings corresponding to each of the M receiving points are determined The overlapping area of the circular ring, and the center position of the overlapping area is determined as the pointing position.
  • the graphical infrared signal includes a cross-shaped infrared signal; the projection graphic includes a cross-shaped graphic; the plurality of infrared receivers are arranged around the display screen to form an infrared receiver frame.
  • the processor is specifically configured to: obtain the positions of the four receiving points on the infrared receiving frame that receive the cross-shaped infrared signal; determine that the graphical infrared signal is displayed on the display through the positions of the four receiving points The cross-shaped graphic on the screen; calculate the position of the intersection in the cross-shaped graphic, and determine the position of the intersection as the pointing position.
  • the first control operation includes any one of the following: a click operation, a long press operation, a frame selection operation, and a drag operation.
  • an embodiment of the present application provides a display device, including: one or more functional units, the one or more functional units are used to execute the pointing remote control method in any one of the possible implementations of any of the above aspects .
  • an embodiment of the present application provides a computer storage medium, including computer instructions, which when the computer instructions run on a display device, cause the display device to execute the pointing remote control method in any one of the possible implementations of any of the above aspects .
  • the embodiments of the present application provide a computer program product, which when the computer program product runs on a computer, causes the computer to execute the pointing remote control method in any one of the possible implementations of any of the above aspects.
  • FIG. 1A is a schematic diagram of the hardware structure of a display device provided by an embodiment of the application.
  • FIG. 1B is a schematic structural diagram of an infrared receiver array provided by an embodiment of the application.
  • 1C is a schematic structural diagram of an infrared receiver frame provided by an embodiment of the application.
  • FIG. 1D is a schematic structural diagram of a direct-lit backlight liquid crystal display provided by an embodiment of the application.
  • 1E is a schematic structural diagram of an edge-lit backlit liquid crystal display provided by an embodiment of the application.
  • 1F is a schematic structural diagram of an organic light emitting diode display screen provided by an embodiment of the application.
  • 1G is a schematic diagram of the positions of a projection screen and an infrared receiver array during projection display according to an embodiment of the application;
  • FIG. 2 is a schematic diagram of the hardware structure of a remote control device provided by an embodiment of the application.
  • FIG. 3A is a schematic diagram of the generation principle of a circular infrared signal provided by an embodiment of the application.
  • 3B is a schematic diagram of the generation principle of a circular infrared signal provided by an embodiment of the application.
  • 3C is a schematic diagram of the generation principle of a cross-shaped infrared signal provided by an embodiment of the application.
  • FIG. 3D is a schematic diagram of the generation principle of another cross-shaped infrared signal provided by an embodiment of the application.
  • FIG. 4 is a schematic diagram of the architecture of a pointing remote control system provided by an embodiment of the application.
  • 5A is a schematic diagram of an application scenario of an infrared receiving array provided by an embodiment of the application.
  • 5B is a schematic diagram of an application scenario of an infrared receiver frame provided by an embodiment of the application.
  • FIG. 6 is a schematic diagram of a projection principle according to an embodiment of the application.
  • FIGS. 7A-7C are schematic diagrams of a set of principles for calculating pointing positions based on circular projection graphics provided by an embodiment of the application;
  • 8A-8C are a set of schematic diagrams of the principle of calculating the pointing position according to the elliptical projection figure according to the embodiment of the application;
  • 9A-9C are a set of schematic diagrams of the principle of calculating the pointing position according to the circular projection figure according to the embodiment of the application;
  • 10A-10D are a set of schematic diagrams of the principle of calculating the pointing position according to the elliptical ring projection figure according to the embodiment of the application;
  • 11A-11B are a set of schematic diagrams of the principle of calculating the pointing position according to the cross-shaped projection figure according to the embodiment of the application;
  • 12A-12B are schematic diagrams of another set of principles for calculating a pointing position based on a cross-shaped projection figure according to an embodiment of the application;
  • FIG. 13 is a schematic flowchart of a pointing remote control method provided by an embodiment of this application.
  • 14A-14F are schematic diagrams of a group of human-computer interaction operations provided by an embodiment of the application.
  • first and second are only used for descriptive purposes, and cannot be understood as implying or implying relative importance or implicitly specifying the number of indicated technical features. Therefore, the features defined with “first” and “second” may explicitly or implicitly include one or more of these features. In the description of the embodiments of the present application, unless otherwise specified, “multiple” The meaning is two or more.
  • the air mouse can control the cursor on the screen of the display device using the data output by sensors such as a gyroscope.
  • the basic principle is: the air mouse can map its own X-axis angular velocity and Z-axis angular velocity to the moving speed of the air mouse, and calculate the moving position of the cursor on the screen of the display device by changing the relative position.
  • the specific implementation is that the digital processing chip of the air mouse converts the motion signal obtained by the sensor into a digital signal, and uses radio frequency wireless communication to transmit the control signal to the display device. The display device then determines and displays the position of the cursor according to the control signal.
  • the air mouse Since the air mouse uses the motion data sensed by the sensor to locate the cursor, the air mouse needs to display the initial position of the cursor on the screen of the display device, and then after the user moves slowly in the pan operation, can it be based on the relative pan operation. Move the position to determine the last position of the cursor. Therefore, the accuracy of cursor positioning is not enough, and sometimes the user needs to move multiple times to move the cursor to the specified position.
  • the embodiments of the present application provide a pointing remote control method and system.
  • the display device can receive the graphical infrared signal sent by the remote control device through the infrared receiver array or the infrared receiver frame.
  • the display device can determine the pointing position of the remote control device on the display device according to the projection of the graphical infrared signal on the infrared receiver array or the infrared receiver frame. In this way, the display device can recognize the pointing position of the remote control device on the display screen of the display device through the graphical infrared signal sent by the remote control device, which simplifies the operation steps.
  • the user can remotely perform touch-sensitive interactive operations (for example, click, frame selection, long press, drag, etc.) on the display device through the remote control device.
  • the following describes a display device 100 provided by an embodiment of the present application.
  • FIG. 1A shows a schematic structural diagram of a display device 100.
  • the display device 100 may include a processor 111, a memory 112, a wireless communication processing module 113, a power switch 114, a display screen 115, an audio module 116, a speaker 117, and an infrared receiver 118.
  • the processor 111 may include one or more processing units.
  • the processor 111 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), and an image signal.
  • AP application processor
  • GPU graphics processing unit
  • ISP image signal processor
  • controller memory
  • video codec digital signal processor
  • DSP digital signal processor
  • baseband processor baseband processor
  • NPU neural-network processing unit
  • the controller may be the nerve center and command center of the display device 100.
  • the controller can generate operation control signals according to the instruction operation code and timing signals to complete the control of fetching instructions and executing instructions.
  • a memory may also be provided in the processor 111 to store instructions and data.
  • the memory in the processor 111 is a cache memory.
  • the memory can store instructions or data that the processor 111 has just used or used cyclically. If the processor 111 needs to use the instruction or data again, it can be directly called from the memory. Repeated accesses are avoided, the waiting time of the processor 111 is reduced, and the efficiency of the system is improved.
  • the memory 112 is coupled with the processor 111, and is used to store various software programs and/or multiple sets of instructions.
  • the memory 112 may be used to store computer executable program code, where the executable program code includes instructions.
  • the processor 111 executes various functional applications and data processing of the display device 100 by running instructions stored in the memory 112.
  • the memory 112 may include a program storage area and a data storage area.
  • the storage program area can store an operating system, an application program (such as a sound playback function, an image playback function, etc.) required by at least one function, and the like.
  • the data storage area can store data created during the use of the display device 100 (such as audio data, image data to be displayed, etc.) and the like.
  • the memory 112 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), and the like.
  • UFS universal flash storage
  • the wireless communication module 113 can provide applications on the display device 100 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), and global navigation satellites.
  • WLAN wireless local area networks
  • Wi-Fi wireless fidelity
  • BT bluetooth
  • global navigation satellites System (global navigation satellite system, GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (infrared, IR) and other wireless communication solutions.
  • the wireless communication processing module 113 may include a Bluetooth (BT) communication processing module 113A, a WLAN communication processing module 113B, and an infrared communication processing module 113C.
  • BT Bluetooth
  • One or more of the Bluetooth (BT) communication processing module 113A and WLAN communication processing module 113B can monitor signals emitted by other devices, such as detection requests, scanning signals, etc., and can send response signals, such as detection response, scanning In response, other devices can discover the display device 100, establish a wireless communication connection with other devices, and communicate with other devices through one or more wireless communication technologies in Bluetooth or WLAN.
  • the Bluetooth (BT) communication processing module 113A can provide one or more Bluetooth communication solutions including classic Bluetooth (BR/EDR) or Bluetooth low energy (Bluetooth low energy, BLE).
  • the WLAN communication processing module 113B may include one or more WLAN communication solutions among Wi-Fi direct, Wi-Fi LAN, or Wi-Fi soft AP.
  • the infrared communication processing module 113C can process the infrared receiver 118 receiving the infrared signal and receiving the infrared signal position.
  • the power switch 114 can be used to control the power supply to the display device 100 from the power source. In some embodiments, the power switch 114 can be used to control the external power supply to supply power to the display device 100.
  • the display device 100 may further include a battery, a charging management module, and a power management module.
  • the battery can be used to provide power to the display device 100.
  • the charging management module is used to receive charging input from the charger.
  • the charger can be a wireless charger or a wired charger.
  • the charging management module may receive the charging input of the wired charger through the USB interface.
  • the charging management module may receive the wireless charging input through the wireless charging coil of the display device 100. While the charging management module charges the battery, it can also supply power to the electronic device through the power management module.
  • the power management module is used to connect the battery, the charging management module and the processor 111.
  • the power management module receives input from the battery and/or charging management module, and supplies power to the processor 111, the memory 112, the display screen 115, and the wireless communication module 113.
  • the power management module can also be used to monitor battery capacity, battery cycle times, battery health status (leakage, impedance) and other parameters.
  • the power management module may also be provided in the processor 111.
  • the power management module and the charging management module may also be provided in the same device.
  • the display screen 115 can be used to display images, videos, etc.
  • the display screen 115 includes a display panel.
  • the display panel can use liquid crystal display (LCD), organic light-emitting diode (OLED), active matrix organic light-emitting diode or active-matrix organic light-emitting diode (active-matrix organic light-emitting diode).
  • LCD liquid crystal display
  • OLED organic light-emitting diode
  • active matrix organic light-emitting diode active-matrix organic light-emitting diode
  • active-matrix organic light-emitting diode active-matrix organic light-emitting diode
  • AMOLED flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diode (QLED), etc.
  • the infrared receiver 118 can be used to receive infrared signals.
  • the infrared receiver 118 may receive a graphical infrared signal sent by a remote control device, for example, a circular infrared signal, a circular infrared signal, a cross-shaped infrared signal, and so on.
  • graphics can refer to several spatial shapes that can be divided by contours in a two-dimensional space.
  • the display device 100 includes a plurality of infrared receivers 118. As shown in FIG. 1B, the plurality of infrared receivers 118 can be arranged in a matrix into an infrared receiver array.
  • the plurality of infrared receivers 118 may be arranged on the frame around the display screen 115.
  • the plurality of infrared receivers 118 arranged on the frame around the display screen 115 may be referred to as an infrared receiver frame.
  • the plurality of infrared receivers 118 are arranged around the projection screen and serve as the infrared receiver frame of the projection screen.
  • the infrared receiver array may be coupled to the display screen 115.
  • the display screen 115 may be a direct type backlit liquid crystal display screen.
  • the direct type liquid crystal display may include a back plate 121, a backlight plate 122, an optical film 124, and an LCD panel 125.
  • the infrared receiver array 122 may be located between the backlight plate 122 and the optical film 124.
  • the back plate 121 can be used to support the entire direct-type liquid crystal display.
  • the backlight panel 122 can be used to emit light and provide a light source for the LCD panel 125.
  • the optical film 124 can be used to excite the light of a single color emitted by the backlight panel 122 to generate light sources of different colors, and mix the lights of different colors with each other to form white light as the backlight source of the LCD panel.
  • the LCD panel 125 can change the display color and brightness of each pixel on the display screen 115 under the control of electrical signals.
  • the display screen 115 may be an edge-lit backlit liquid crystal display screen.
  • the side-type liquid crystal display may include a back plate 131, a light guide plate (LGP) 133, an optical film 134, and an LCD panel 135.
  • the infrared receiver array 132 may be located between the back plate 131 and the light guide plate 133.
  • the back plate 131 can be used to support the entire side-type liquid crystal display.
  • the light guide plate 133 can be used to adjust the light emitted by the LED light bars distributed on the side of the display screen 115 to enter the LCD panel 135 from a specified direction.
  • the optical film 134 can be used to excite the light of a single color emitted by the backlight panel 132 to generate light sources of different colors, and mix the lights of different colors with each other to form white light as the backlight source of the LCD panel.
  • the LCD panel 135 can change the display color and brightness of each pixel on the display screen 115 under the control of electrical signals.
  • the display screen 115 may be a self-luminous display screen, for example, an OLED display screen.
  • the OLED display screen includes a back panel 141 and an OLED panel 143.
  • the infrared receiver array 142 may be located between the back plate 141 and the OLED panel 143.
  • the back plate 141 can be used to support the entire OLED display screen.
  • the OLED panel 143 may include a number of self-luminous sub-pixels, and each sub-pixel can be individually lit. Due to the different organic material molecules in the sub-pixels, the sub-pixels can have three types of generating three primary colors of red, green, and blue (RGB), or four types of generating four colors of red, green, blue, and white (RGBW).
  • Each pixel on the OLED display screen can include sub-pixels of the three primary colors of red, green, and blue (RGB), so that each pixel can display a different color.
  • each pixel on the OLED display screen may include four color sub-pixels of red, green, blue, and white (RGBW), so that each pixel can display a different color.
  • the display device 100 may be a projection device such as a projector. As shown in FIG. 1G, the display screen 115 of the display device 100 may refer to a projection screen 152. The infrared receiver array 151 may be behind the projection screen 152.
  • the audio module 116 can be used to convert a digital audio signal into an analog audio signal for output, and can also be used to convert an analog audio input into a digital audio signal.
  • the audio module 116 can also be used to encode and decode audio signals.
  • the audio module 116 may be installed in the processor 111, or part of the functional modules of the audio module 116 may be installed in the processor 111.
  • the audio module 116 can transmit audio signals to the wireless communication module 113 through a bus interface (for example, a UART interface, etc.), so as to realize the function of playing audio signals through a Bluetooth speaker.
  • a bus interface for example, a UART interface, etc.
  • the speaker 117 can be used to convert the audio signal sent by the audio module 116 into a sound signal.
  • the display device 100 may also include a microphone, which is also a "microphone” or “microphone”, for converting sound signals into electrical signals.
  • a microphone which is also a "microphone” or “microphone”, for converting sound signals into electrical signals.
  • the user can speak through the human mouth and input the sound signal into the microphone.
  • the display device 100 may also include a wired local area network (local area network, LAN) communication processing module, a high definition multimedia interface (HDMI) communication processing module, and a communication serial bus (universal serial bus). , USB) communication processing module.
  • the wired LAN communication processing module can be used to communicate via a wired LAN and through other devices in a LAN, and can also be used to connect to a WAN via a wired LAN, and can communicate with devices in the WAN.
  • the HDMI communication processing module can be used to communicate with other devices through the HDMI interface.
  • the HDMI communication processing module can receive HDR video data sent by the set-top box through the HDMI interface, and so on.
  • the USB communication processing module can be used to communicate with other devices through a USB interface.
  • the display device 100 may be any of the following device types: a display, a television, a personal computer, a tablet computer, a projector, and so on. It should be noted that when the display device 100 is a projector, the display screen of the display device 100 may refer to a projection screen.
  • FIG. 2 shows a schematic diagram of the structure of the remote control device 200.
  • the remote control device 200 may include: a processor 201, a memory 202, a wireless communication processing module 203, an infrared transmitter 204, a power supply module 205, and so on. in:
  • the processor 201 can be used to read and execute computer-readable instructions.
  • the processor 201 may mainly include a controller, an arithmetic unit, and a register.
  • the controller is mainly responsible for instruction decoding. And send out the control signal for the operation corresponding to the instruction.
  • the arithmetic unit is mainly responsible for saving the register operands and intermediate operation results temporarily stored during the execution of the instruction.
  • the hardware architecture of the processor 201 may be an application specific integrated circuit (ASIC) architecture, MIPS architecture, ARM architecture, or NP architecture, and so on.
  • ASIC application specific integrated circuit
  • the processor 201 may be used to parse the signal received by the wireless communication processing module 203, such as the Bluetooth signal sent by the display device 100, and so on.
  • the processor 201 may also be used to generate signals sent out by the wireless communication processing module 203, such as Bluetooth broadcast signals, infrared signals with control information, and so on.
  • the memory 202 is coupled with the processor 201, and is used to store various software programs and/or multiple sets of instructions.
  • the memory 202 may include a high-speed random access memory, and may also include a non-volatile memory.
  • the memory 202 may store a communication program, and the communication program may be used to communicate with the display device 100.
  • the wireless communication processing module 203 may include an infrared communication processing module 203C. In some embodiments, the wireless communication processing module 203 may further include one or more of the Bluetooth communication processing module 203A and the WLAN communication processing module 203B.
  • one or more of the Bluetooth communication processing module 203A and the WLAN communication processing module 203B can monitor signals transmitted by other devices (such as the display device 100), such as detection requests, scan signals, etc., and can send response limit numbers. , Such as detection response, scan response, etc., so that other devices (such as the display device 100) can discover the remote control device 200 and establish a wireless communication connection.
  • the Bluetooth communication processing module 203 may provide a solution including one or more of Bluetooth communication in classic Bluetooth or Bluetooth low energy (bluetooth low energy, BLE).
  • the WLAN communication processing module 203B may include one or more WLAN communication solutions among Wi-Fi direct, Wi-Fi LAN, or Wi-Fi soft AP.
  • the infrared communication processing module 203C can modulate an infrared signal with control information, and send the infrared signal with control information through the infrared transmitter 204.
  • the infrared transmitter 204 may be an infrared light-emitting diode for radiating infrared signals outward.
  • the remote control device 200 may include a plurality of infrared transmitters 204.
  • the power management module 205 can be used to connect a battery (not shown), a charging management module (not shown) and the processor 201.
  • the power management module 205 receives input from a battery (not shown) and/or a charging management module (not shown), and supplies power to the processor 201, the memory 202, the wireless communication processing module 203, the infrared transmitter 204, and the like.
  • the power management module 205 can also be used to monitor parameters such as battery capacity, battery cycle times, and battery health status (leakage, impedance).
  • the remote control device 200 may also include one or more buttons (for example, confirm button, home button, volume+button, volume-button, channel+button, channel-button, etc.), where the one or more buttons may be physical button.
  • the remote control device 200 may further include a touch screen, and the one or more buttons may be virtual buttons displayed on the touch screen.
  • the remote control device 200 further includes one or more micro lens structures (not shown in the figure).
  • the one or more micro lens structures can be placed in the light emitting direction of the infrared emitter 204.
  • the infrared transmitter 204 can cooperate with the micro lens structure to output an infrared signal with a specified pattern of specific energy distribution.
  • the infrared transmitter 204 can be used as an infrared light source to emit an infrared signal.
  • the infrared signal can form a circular infrared signal after passing through the micro lens structure. Wherein, in the circular pattern, the energy distribution of the infrared signal is uniform.
  • the infrared transmitter 204 can be used as an infrared light source to emit an infrared signal. After the infrared signal passes through the microlens structure, it can form an infrared signal with a specified energy distribution in a circular pattern. For example, the innermost ring of the infrared signal of the ring pattern has the highest energy, and the more the ring goes out, the lower the energy.
  • the infrared transmitter 204 can be used as an infrared light source to emit an infrared signal.
  • the infrared signal can form a cross-shaped infrared signal after passing through the micro lens structure. In the cross-shaped pattern, the energy distribution of the infrared signal is uniform.
  • the remote control device 200 can output infrared signals with a specified pattern of specified energy distribution through multiple infrared emitters 204 and multiple microlens structures.
  • the remote control device 200 may include two infrared emitters 204 and two micro lens structures (micro lens structure 1 and micro lens structure 2).
  • the two infrared emitters 204 can respectively serve as two infrared light sources (infrared light source 1 and infrared light source 2) to emit infrared signals.
  • an infrared signal with a negative 45-degree strip pattern can be formed.
  • an infrared signal with a positive 45-degree strip pattern can be formed.
  • the infrared signal of the negative 45-degree bar graph and the infrared signal of the positive 45-degree bar graph can intersect to form the infrared signal of the cross-shaped graph.
  • the example shown in FIG. 3D is only used to explain the present application and should not constitute a limitation.
  • the intersection angle of the two bars of the cross-shaped figure may be other angles, which is not limited herein.
  • the remote control device 200 can output any of the following graphics:
  • the infrared signal micro lens structure and infrared transmitter circular pattern infrared signal, circular pattern infrared signal, cross pattern infrared signal, square ring pattern infrared signal, H-shaped pattern infrared signal, etc. .
  • the remote control device 200 may adopt a microlens structure and an infrared transmitter that output infrared signals with a cross shape or the like.
  • the remote control device 200 may be any of the following device types: remote control (such as a TV remote control), mouse, smart phone, tablet computer, and so on. It should be noted that when the remote control device 200 is a device with a touch screen such as a smart phone or a tablet computer, one or more buttons on the remote control device 200 may be virtual buttons displayed on the touch screen.
  • FIG. 4 shows a schematic framework diagram of a pointing remote control system 400 provided by an embodiment of the present application.
  • the pointing remote control system 400 may include a display device 100 and a remote control device 200.
  • the display device 100 may include a processor 411, an infrared receiver array (or an infrared receiver frame) 412, a display screen 413, and a wireless communication module 414.
  • the processor 411 may be a microcontroller unit (MCU).
  • the wireless communication module 414 may include a 2.4G radio frequency transmission module (for example, a Bluetooth transmission module, an infrared transmission module, etc.). In a possible implementation manner, the wireless communication module 414 may include a Wi-Fi transmission module.
  • a specific description of the display device 100 reference may be made to the embodiment described in FIG. 1A, which will not be repeated here.
  • the remote control device 200 may include a processor 421, an infrared transmitter 422, a button 423, and a wireless communication module 424.
  • the processor 421 may be a microcontroller unit (MCU).
  • the infrared transmitter 422 combined with the micro lens structure can send an infrared signal of a specified pattern.
  • the button 423 can be a physical button or a virtual button.
  • the wireless communication module 424 may include a 2.4G radio frequency transmission module (for example, a Bluetooth transmission module, an infrared transmission module, etc.).
  • the wireless communication module 424 may send control information corresponding to the button 423 to the display device 100 through a control signal.
  • the wireless communication module 414 may include a Wi-Fi transmission module.
  • the infrared transmitter 422 can send a graphical infrared signal with a specified energy distribution to the infrared receiver array (or infrared receiver frame) 412 through the micro lens structure 425. Due to the difference of the microlens structure 425, the patterned infrared signal can project patterns of different shapes on the opposite projection plane, for example, circular patterns, circular patterns, cross-shaped patterns, and so on.
  • the projection figure on the projection plane can be an ellipse figure, an ellipse ring figure, a cross figure, and so on.
  • the infrared receiver array (or infrared receiver frame) 412 After the infrared receiver array (or infrared receiver frame) 412 receives the graphical infrared signal, it can report the receiving information of the graphical infrared signal to the processor 411, where the received information may include the graphical infrared signal. location information. In some embodiments, the received information may include position information of the received graphical infrared signal and received signal strength information of the graphical infrared signal.
  • the processor 411 may determine the pointing position of the remote control device 200 according to the received information of the infrared signal, and give the pointing position to the display screen 413.
  • the display screen 413 may display a cursor at the pointing position.
  • the cursor can be used to prompt the user that the remote control device 200 points to the position of the cursor on the display screen 413.
  • the process of determining the pointing position of the remote control device 200 can refer to the subsequent embodiments, which will not be repeated here.
  • the processor 421 can detect a user's operation (for example, pressing, long press, single click, double tap, etc.) through the button 423, and in response to the operation, the processor 421 can match the corresponding control instruction of the button 423.
  • the processor 421 may instruct the wireless communication module 424 to send a control signal to the wireless communication module 414 according to the control instruction.
  • the wireless communication module 414 can analyze the control information from the control signal and send it to the processor 411.
  • the processor 411 may perform operations corresponding to the control information.
  • the infrared receiver array on the display device 100 may include a plurality of infrared receivers arranged in a rectangular array.
  • the infrared receiver array can be coupled in the display screen 413.
  • the infrared transmitter 422 can send a patterned infrared signal to the infrared receiver array through the micro lens structure 425.
  • the graphical infrared signal can present a designated pattern on the plane where the display screen is located.
  • the graphical infrared signal can present a circular ring shape on the plane where the display screen is located, and the circular ring shape is from the inner ring to the outer ring, and the signal strength decreases in sequence (or the signal strength increases in sequence).
  • the processor 411 may calculate the center position of the circular receiving area according to the receiving information of the infrared signal, and use the center position of the receiving area as the pointing position of the remote control device 200 on the display screen 413.
  • multiple infrared receivers on the display device 100 may be arranged around the display screen to form an infrared receiver frame.
  • the infrared transmitter 422 can send a graphical infrared signal to the frame of the infrared receiver through the micro lens structure.
  • the graphical infrared signal can present a designated pattern on the plane where the display screen is located.
  • the graphical infrared signal can present a cross-shaped pattern on the plane where the display screen is located.
  • the processor 411 can calculate the cross point of the cross-shaped graphic according to the received information of the infrared signal, and use the cross-shaped cross point of the cross-shaped graphic as the pointing position of the remote control device 200 on the display screen 413.
  • the wireless communication module 414 when the wireless communication module 414 includes an infrared transmission module, the wireless communication module 414 can modulate an infrared signal with control information, and transmit it to the infrared receiver array through a plurality of infrared transmitters 412 ( Or infrared receiver frame) 412.
  • the wireless communication module 414 can parse the control information from the infrared signal received by the infrared receiver array (or the infrared receiver frame) 412 and send the control information to the processor 411.
  • the processor 411 may perform operations corresponding to the control information.
  • the following describes in detail how the display device 100 determines the pointing position of the remote control device 200 on the display screen according to the received graphical infrared signal in the embodiment of the present application in combination with infrared signals of different graphics.
  • the display screen of the display device 100 is coupled with an infrared receiver array.
  • the infrared transmitter on the remote control device 200 can emit a circular infrared signal through the micro lens structure.
  • the display device 100 receives the infrared signal through the infrared receiver array, it can calculate the center position of the infrared signal according to the receiving area of the infrared signal, and use the center position of the infrared signal as the remote control device 200 in the display device 100 Pointing position on the display. In this way, the remote control device 200 can accurately point to the position on the display screen of the display device 100 that the user wants to operate.
  • the projection of the infrared signal on the display screen of the display device 100 is a circular projection.
  • the projection of the infrared signal on the display device 100 is an elliptical projection.
  • the display device 100 can determine the location of one or more infrared receivers that detect the infrared signal through the infrared receiving array. Then, the display device 100 can determine the receiving area of the infrared signal according to the location of the one or more infrared receivers that detected the infrared signal. The display device 100 may calculate the center point of the receiving area according to the receiving area of the infrared signal. Then, the display device 100 can use the center position of the receiving area as the center point of the infrared signal projected on the display screen, that is, the pointing position of the remote control device 200 on the display screen.
  • the display device 100 may receive the circular infrared signal forwardly emitted by the remote control device 200 to the display screen through an infrared receiving array.
  • the projection pattern of the infrared signal on the infrared receiver array can be circular.
  • the circular projection of the infrared signal may be covered with one or more infrared receivers on the infrared receiving array, for example, four infrared receivers on the infrared receiver array detect the infrared signal.
  • Figure 7B shows a part of the infrared receiver array.
  • the circular projection of infrared signals can be covered with four infrared receivers on the infrared receiving array, such as infrared receiver 1, infrared receiver 2, infrared receiver 3, and infrared receiver 4.
  • the positions of the four infrared receivers, the infrared receiver 1, the infrared receiver 2, the infrared receiver 3, and the infrared receiver 4 can form a receiving area (for example, a rectangular area).
  • the display device 100 can calculate the center position of the receiving area according to the positions of the four receivers, as the center point of the infrared signal projected on the display screen, that is, the pointing position of the remote control device 200 on the display screen.
  • the display device 100 may receive the infrared signal emitted from the side of the remote control device 200 to the display screen through an infrared receiving array.
  • the projection pattern of the infrared signal and the infrared signal on the infrared receiver array may be elliptical.
  • the circular projection of the infrared signal may be covered with one or more infrared receivers on the infrared receiving array, for example, four infrared receivers have detected the infrared signal.
  • Figure 8B shows a part of the infrared receiver array.
  • the elliptical projection of the infrared signal can be covered with four infrared receivers on the infrared receiving array, for example, four infrared receivers on the infrared receiver array detect the infrared signal.
  • the positions of the four infrared receivers, the infrared receiver 1, the infrared receiver 2, the infrared receiver 3, and the infrared receiver 4 can form a receiving area (for example, a rectangular area).
  • the display device 100 can calculate the center position of the receiving area according to the positions of the four receivers, as the center point of the elliptical projection of the infrared signal on the display screen, that is, the pointing position of the remote control device 200 on the display screen.
  • the display screen of the display device 100 is coupled with an infrared receiver array.
  • the remote control device 200 can emit a circular infrared signal through an infrared transmitter and a micro lens structure. Wherein, the infrared signal of the circular ring goes from the inner ring to the outer ring, and the signal strength decreases in sequence (or, the signal strength increases in sequence).
  • the display device 100 receives the circular infrared signal through the infrared receiver array, it can determine whether the remote control device 200 is in the display device 100 according to the receiving area where the circular infrared signal is received and the signal strength distribution in the receiving area. Pointing position on the display. In this way, the remote control device 200 can accurately point to the position on the display screen of the display device 100 that the user wants to operate.
  • the display device 100 can determine the locations of M receiving points in the infrared receiver array that have detected the infrared signal through the infrared receiving array, and the signal strength values of the M receiving points that receive the infrared signal. Then, the display device 100 can determine the pointing position of the remote control device 200 on the display screen according to the locations of the M receiving points that detected the infrared signal and the signal strength values of the infrared signals received by the M receiving points, where , M is a positive integer.
  • the display device 100 may receive the circular infrared signal that the remote control device 200 is transmitting to the display screen through an infrared receiving array.
  • the projection pattern of the circular infrared signal on the infrared receiver array may be a circular ring.
  • the circular projection of the infrared signal may cover M receiving points on the infrared receiving array. For example, four receiving points on the infrared receiver array detect the infrared signal.
  • Figure 9B shows a part of the infrared receiver array.
  • the circular projection of the circular infrared signal can be covered with four infrared receivers on the infrared receiving array, and the four infrared receivers are the receiving points of the circular projection.
  • infrared receiver 1 ie receiving point 1
  • infrared receiver 2 ie receiving point 2
  • infrared receiver 3 ie receiving point 3
  • infrared receiver 4 receiving point 4
  • the circular ring projection may have three rings, the inner ring has the highest signal strength, the middle ring has the medium signal strength, and the outer ring has the weakest signal strength.
  • the infrared receiver 1 is located in the outer ring of the circular projection, and the signal strength of the infrared signal received by the infrared receiver 1 may be -60 dBm.
  • the infrared receiver 2 is in the middle ring of the circular projection, and the signal strength of the infrared signal received by the infrared receiver 2 may be -40 dBm.
  • the infrared receiver 3 is in the middle ring of the circular projection, and the signal strength of the infrared signal received by the infrared receiver 3 may be -40 dBm.
  • the infrared receiver 4 is located in the inner ring of the circular projection, and the signal strength of the infrared signal received by the infrared receiver 3 may be -20 dBm.
  • the display device 100 can set the position of the infrared receiver receiving the circular infrared signal as the center of the circle, and the outer circle radius and the inner circle radius corresponding to the signal reception intensity of the infrared receiver received the infrared signal as a circle.
  • the display device 100 can use the position of the only infrared receiver that receives the infrared signal as the pointing position of the remote control device 200 on the display screen.
  • the display device 100 can determine the number of the multiple circular rings according to the respective circular rings corresponding to the multiple infrared receivers that receive the circular infrared signal. Coincident area.
  • the display device 100 may determine the overlapping area of the multiple circles as the pointing position of the remote control device 200 on the display screen. In a possible implementation manner, the display device 100 may determine the geometric center point of the overlapping area of the multiple rings as the pointing position of the remote control device 200 on the display screen.
  • the signal strength received by the infrared receiver 1 may be -60 dBm, and the radius of the outer circle of the infrared receiver 1 corresponding to the ring 1 may be 20 mm, and the radius of the inner circle may be 16 mm.
  • the signal strength received by the infrared receiver 2 can be -40dBm, and the outer radius of the infrared receiver 2 corresponding to the ring 2 can be 16mm and the inner radius is 12mm.
  • the signal strength received by the infrared receiver 3 may be -40 dBm, and the outer radius of the infrared receiver 3 corresponding to the ring 3 may be 16 mm and the inner radius of 12 mm.
  • the signal strength received by the infrared receiver 4 may be -20 dBm, and the outer radius of the infrared receiver 4 corresponding to the ring 4 may be 12 mm, and the inner radius may be 0. Wherein, when the inner radius of the ring 4 is 0, the ring 4 is circular.
  • the display device 100 can determine the overlapping area of the ring 1, the ring 2, the ring 3, and the ring 4 according to the ring 1, ring 2, ring 3, and ring 4.
  • the display device 100 may use the overlapping area as the pointing position of the remote control device 200 on the display screen.
  • the display device 100 may use the geometric center position of the overlapping area as the pointing position of the remote control device 200 on the display screen.
  • the display device 100 can determine that all the rings corresponding to the infrared receivers that have detected the ring-shaped infrared signal do not have overlapping areas.
  • the display device 100 can receive circular infrared signals from all infrared receivers (for example, infrared receiver 1, infrared receiver 2, infrared receiver 3, infrared receiver 4, infrared receiver 5, and infrared receiver 6)
  • a Class A infrared receiver for example, infrared receiver 2, infrared receiver 4 whose received signal strength is greater than the first signal strength (for example, -30 dBm) is determined.
  • the display device 100 can calculate the coincidence area of the circle corresponding to the type A infrared receiver (for example, infrared receiver 1, infrared receiver 2), and use the coincidence area of the circle corresponding to the type A infrared receiver as the remote control device 200 in the display Pointing position on the screen.
  • the display device 100 may use the geometric center position of the overlapping area as the pointing position of the remote control device 200 on the display screen.
  • the display device 100 may receive the circular infrared signal emitted from the side of the remote control device 200 to the display screen through an infrared receiving array.
  • the projection pattern of the circular infrared signal on the infrared receiver array may be an elliptical ring.
  • the elliptical ring projection of the circular infrared signal may cover M receiving points on the infrared receiving array. For example, six receiving points on the infrared receiver array detect the infrared signal.
  • Figure 10B shows a part of the infrared receiver array.
  • the circular projection of the infrared signal can cover six receiving points on the infrared receiving array, for example, infrared receiver 1 (ie receiving point 1), infrared receiver 2 (ie receiving point 2), Infrared receiver 3 (receiving point 3), infrared receiver 4 (receiving point 4), infrared receiver 5 (receiving point 5), and infrared receiver 6 (receiving point 6).
  • infrared receiver 1 ie receiving point 1
  • infrared receiver 2 ie receiving point 2
  • Infrared receiver 3 receiver 3
  • infrared receiver 4 receiver 4
  • infrared receiver 5 receiveriving point 5
  • infrared receiver 6 infrared receiver 6
  • the elliptical ring projection may have three rings, the inner ring has the highest signal strength, the middle ring has the medium signal strength, and the outer ring has the weakest signal strength.
  • the infrared receiver 1, the infrared receiver 3, the infrared receiver 5 and the infrared receiver 6 are in the outer ring of the circular projection.
  • the signal strength of the infrared signal received by the infrared receiver 1 can be -60dBm, and the infrared receiver 3 receives
  • the signal strength to the infrared signal may be -62dBm
  • the signal strength of the infrared signal received by the infrared receiver 5 may be -64dBm
  • the signal strength of the infrared receiver 6 may be -65dBm.
  • the infrared receiver 4 is in the middle ring of the circular projection, and the signal strength received by the infrared receiver 4 may be -40 dBm.
  • the infrared receiver 2 is located in the inner ring of the circular projection, and the signal strength received by the infrared receiver 2 may be -20 dBm.
  • the outer radius of the ring 1, the ring 3, the ring 5, and the ring 6 may be 20 mm, and the inner radius may be 16 mm.
  • the outer radius of the ring 4 may be 16mm, and the inner radius may be 12mm.
  • the outer radius of the ring 2 can be 12mm, and the inner radius can be 0. Wherein, when the inner radius of the ring 2 is 0, the ring 4 is circular.
  • the display device 100 can determine all the infrared receivers (for example, infrared receiver 1, infrared receiver 2, infrared receiver 3, infrared receiver 4, infrared receiver 5, and
  • the ring corresponding to the infrared receiver 6) (for example, ring 1, ring 2, ring 3, ring 4, ring 5, and ring 6) has no overlapping area.
  • the display device 100 can receive the ring infrared signal from all receiving points (for example, infrared receiver 1, infrared receiver 2, infrared receiver 3, infrared receiver 4, infrared receiver 5, and infrared receiver).
  • a class A receiving point for example, infrared receiver 2, infrared receiver 4
  • the display device 100 can calculate the coincidence area of the circle corresponding to the type A receiving point (for example, infrared receiver 2, infrared receiver 4), and use the coincidence area of the circle corresponding to the type A receiving point as the remote control device 200 on the display screen.
  • the pointing position In a possible implementation manner, the display device 100 may use the geometric center position of the overlapping area as the pointing position of the remote control device 200 on the display screen.
  • multiple infrared receivers on the display device 100 may be arranged on the frame in the display screen IV.
  • the remote control device 200 can emit an infrared signal in a cross-shaped pattern through an infrared transmitter and a micro lens structure.
  • the display device 100 receives the cross-shaped infrared signal through the infrared receiver frame, it can determine the cross point of the cross-shaped figure and use the cross point as the pointing position of the remote control device 200 on the display screen of the display device 100 .
  • the infrared signal emitted by the remote control device 200 may not pass through the display screen, so that the signal strength of the infrared signal received by the display device 100 is higher, and can accurately point to the position on the display device of the display device 100 that the user wants to operate.
  • the display device 100 may receive the cross-shaped infrared signal emitted by the remote control device 200 through the infrared receiving frame around the display screen.
  • the projection of the cross-shaped infrared signal on the infrared receiver array may be a cross-shaped.
  • the cross-shaped projection of the infrared signal can cover four receiving points on the infrared receiving frame.
  • the display device 100 can use the positions of the four complementary adjacent infrared receivers as the four receiving points of the infrared signal, respectively.
  • the display device 100 can connect these four receiving points in pairs (for example, receiving point 1 and receiving point 3, and receiving point 2 and receiving point 4) to determine the line located within the frame of the infrared receiver The intersection point, and the line intersection point is used as the pointing position of the remote control device 200 on the display screen of the display device 100.
  • the display device 100 may receive the cross-shaped infrared signal emitted by the remote control device 200 through the infrared receiving frame around the display screen.
  • each receiving area includes one or more infrared receivers that receive infrared signals.
  • the receiving area 1 includes an infrared receiver 1 and an infrared receiver 2
  • the receiving area 2 includes an infrared receiver 3 and an infrared receiver 4
  • the receiving area 3 includes an infrared receiver 5 and an infrared receiver.
  • the receiving area 4 includes an infrared receiver 7 and an infrared receiver 8.
  • the display device 100 may use the center point of each receiving area as the receiving point, and the four receiving points may be connected in pairs to determine the intersection of the lines located within the frame of the infrared receiver.
  • the display device 100 may use the line intersection point within the frame of the infrared receiver as the pointing position of the remote control device 200 on the display screen of the display device 100.
  • FIG. 13 shows a schematic flowchart of a pointing remote control method provided by an embodiment of the present application.
  • the pointing remote control method can be applied to a remote control system.
  • the remote control system may include a display device 100 and a remote control device 200.
  • the display device 100 may include an infrared receiver array coupled in the display screen or an infrared receiving frame arranged around the display screen.
  • the method may include:
  • the patterned infrared signal may be an infrared signal of a circular pattern, an infrared signal of a circular pattern, an infrared signal of a cross-shaped pattern, and so on.
  • the patterned infrared signal may also be an infrared signal of other patterns, for example, a square ring pattern, an H-shaped pattern, an X-shaped pattern (non-90° cross), and so on.
  • the energy distribution in each ring may be different in the infrared signal of a circular ring or a square ring, for example, the energy of the infrared signal of the circular ring or the square ring decreases from the inside to the outside, or the circular ring Or the energy of the infrared signal increases from the inside to the outside of the square ring, and so on.
  • the display device 100 determines the pointing position of the remote control device 200 on the display screen according to the projected graphics of the received graphical infrared signal on the display screen.
  • the display device 100 can determine the pointing position of the remote control device 200 on the display screen according to the position information of one or more infrared receivers that detect the projected image.
  • the display device 100 can determine the pointing position of the remote control device 200 on the display screen according to the position information of one or more infrared receivers that detect the projected image.
  • the display device 100 can determine the pointing position of the remote control device 200 on the display screen according to the position information of one or more infrared receivers that detect the projected image.
  • FIGS. 7A-7C or the embodiment shown in FIGS. 8A-8C, or the embodiment shown in FIGS. 9A-9C, or the embodiment shown in FIGS. 10A-10D, or The embodiment shown in FIGS. 11A-11B or the embodiment shown in FIGS. 12A-12B will not be repeated here.
  • the display device 100 displays a prompt mark at the pointing position of the remote control device 200 on the display screen.
  • the prompt mark can be used to prompt the user of the pointing position of the remote control device 200 on the display screen of the display device 100.
  • the prompt mark can be an arrow, an aperture, or other types of marks.
  • the display device 100 may display a main interface 1410.
  • the main interface 1410 includes multiple application icons (for example, a slideshow application icon, a video application icon, a music application icon, an application store application icon, a gallery application icon 1411, etc.).
  • the main interface 1410 may also include a task bar 1412.
  • the task bar 1412 may include one or more application shortcuts (for example, voice assistant application shortcuts, document application shortcuts, table application shortcuts, etc.), status bar (including volume adjustment icons, Wi-Fi Fi signal icon, time), etc.
  • the display device 100 may display an indication mark 1413 on the display screen.
  • the indication mark 1413 is used to indicate the pointing position of the remote control device 200 on the display screen.
  • the above steps S1301 to S1303 may be performed periodically.
  • the execution cycle of the above steps S1301 to S1303 may be 10 ms.
  • the execution cycles of the foregoing steps S1301, S1302, and S1303 may be different.
  • the execution period of step S1301 may be 26.3 us
  • the execution period of step S1302 and step S1303 may be 10 ms.
  • the remote control device 200 receives the user's input on the first button.
  • the remote control device 200 sends the control information corresponding to the first button to the display device.
  • the remote control device 200 may include one or more buttons, and the one or more buttons may be physical buttons.
  • the remote control device 200 may include a power button 1401, a confirmation button 1402, a return button 1403, a home button 1404, a menu button 1405, a volume up button 1406, and a volume down button 1407.
  • the aforementioned buttons are physical buttons.
  • the one or more keys may also be virtual keys.
  • the remote control device 200 may be a smart terminal with a touch screen such as a mobile phone.
  • the remote control device 200 may display one or more virtual keys through the touch screen.
  • the first button may be any one of the above-mentioned one or more buttons.
  • the remote control device 200 After the remote control device 200 receives the user's input (for example, a single click) on the first button, it can match the control information corresponding to the first button.
  • the remote control device 200 may send the control information corresponding to the first button to the display device 100 through wireless communication technologies such as graphical infrared signals, Bluetooth, and WLAN direct connection.
  • the control information corresponding to the first button may be an infrared remote control code.
  • the remote control device 200 may first determine the infrared remote control code corresponding to the first button from the infrared remote control code library. Then, the remote control device 200 can modulate an infrared signal according to the infrared remote control code corresponding to the first button, and transmit a graphical infrared signal to the display device 100 through an infrared transmitter combined with a micro lens structure.
  • the infrared remote control code library may be as shown in Table 2 below:
  • the infrared remote control code corresponding to the power button is "0x01".
  • the infrared remote control code corresponding to the confirm key is “0x02".
  • the infrared remote control code corresponding to the return key is "0x03".
  • the infrared remote control code corresponding to the home button is "0x04".
  • the infrared remote control code corresponding to the menu key is "0x05”.
  • the infrared remote control code corresponding to the volume plus key is “0x06”.
  • the infrared remote control code corresponding to the volume down button is "0x07".
  • the display device 100 determines the first control operation according to the control information corresponding to the first button and the pointing position of the remote control device 200.
  • the display device 100 executes a first control operation.
  • the above-mentioned first control operation may be a click operation.
  • the display device 100 may display an indication mark 1413 at the position of the gallery application icon 1411. Then, after the display device 100 receives the control information corresponding to the confirmation key 1402 sent by the remote control device 200, the display device 100 may determine that the first control operation is a click operation for the gallery application icon 1411.
  • the display device 100 may display the gallery application interface 1420.
  • the gallery application interface 1420 may include thumbnails of one or more pictures (for example, thumbnail 1421, thumbnail 1422, thumbnail 1423, thumbnail 1424, thumbnail 1425, thumbnail 1426), and one or more albums (For example, family album 1431, landscape album 1432, favorite album 1433). Among them, the number of pictures included in the album is displayed below each album. For example, the family album 1431 includes 2 pictures, the landscape album 1432 includes 4 pictures, and the favorite album includes 0 pictures.
  • the above-mentioned first control operation may be a frame selection operation.
  • the user can long press the confirm button 1402 to adjust the pointing position of the remote control device 200 on the display device 100 from the initial position 1441 to the lower right corner of the thumbnail 1424.
  • the display device 100 receives the control information corresponding to the confirmation key 1402 sent by the remote control device 200 for a long time (for example, more than 1s), and the position of the indication mark 1413 (for example, position 1441) does not select an object, the display device 100 can determine the first control The operation is a frame selection operation.
  • the display device 100 may use the position 1411 as the initial position, the position of the indication mark 1413 when the user releases the confirm key 1402 is detected as the end position, and the initial position and the end position as the diagonal fixed points of the rectangle to determine the rectangular frame 1442 .
  • the display device 100 may combine one or more selected objects (for example, a picture thumbnail 1423 and a picture thumbnail 1424) included in the rectangular frame 1442 into one combined object.
  • the above-mentioned first control operation may be a drag operation.
  • the display device 100 receives the control information corresponding to the confirmation key 1402 sent by the remote control device 200 for a long time (for example, more than 1 second), and indicates that the position of the indication mark 1413 (for example, position 1441) has a combined object frame 1443, it displays The device 100 may determine that the first control operation is a drag operation.
  • the display device 100 can control one or more selected objects (for example, thumbnail 1423 and thumbnail 1424) included in the combined object frame 1433. ), follow the indicator 1413 to move on the display screen.
  • the display device 100 when the display device 100 detects the end of the drag operation and the position of the indicator 1413 is located on the favorite album 1433, the display device 100 can add the picture corresponding to the thumbnail 1423 in the above-mentioned combined object frame 1443 The picture corresponding to the thumbnail 1424 is saved in the storage path corresponding to the favorite album 1433.
  • the display device 100 can display the picture 1423 and the picture 1424.
  • the first control operation is not limited to the foregoing click, box, and drag operations, and may also be other operations.
  • the display device 100 can receive the graphical infrared signal sent by the remote control device 200 through the infrared receiver array or the infrared receiver frame.
  • the display device 100 can determine the pointing position of the remote control device 200 on the display device 100 according to the projection of the graphical infrared signal on the infrared receiver array or the infrared receiver frame. In this way, the remote control device 200 can accurately point to the position on the display screen of the display device 100 that the user wants to operate.
  • touch-sensitive interactive operations for example, click, frame selection, long press, drag, etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)
  • Selective Calling Equipment (AREA)

Abstract

本申请公开了一种指向遥控系统，包括：遥控设备和显示设备；遥控设备向所述显示设备发送图形化红外信号。显示设备通过多个红外接收器接收图形化红外信号。显示设备获取所述图形化红外信号在显示屏上的投影图形。显示设备根据所述投影图形，确定出遥控设备在显示屏上的指向位置。显示设备在显示屏的该指向位置上显示提示标记，该提示标记用于提示用户遥控设备在显示屏上的指向位置。这样，显示设备可以通过遥控设备发送的图形化红外信号识别遥控设备在显示设备的显示屏上的指向位置，简化了操作步骤。

Description

一种指向遥控方法及系统
本申请要求于2020年04月30日提交中国专利局、申请号为202010365011.5、申请名称为“一种指向遥控方法及系统”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及通信技术领域，尤其涉及一种指向遥控方法及系统。
背景技术
随着电视机等显示设备进入智能时代，遥控器的简约化设计已经成为行业的共识。遥控器仅具备方向控制、确认、返回、音量+、音量-、主页等按键，配合显示设备上操作系统的用户界面，即可实现所有操作。
目前，电视机等显示设备可以显示带有选项格的用户界面，并显示选项框，该选项框可用于表示在用户界面上选中的选项格。用户可以借助遥控器通过方向控制键，将选项框移动在用户想要选中的选项格上。对于选项格较多的用户界面，例如全键盘输入的界面。用户需要在遥控器上长时间且频繁使用方向键，才能选中想要的选项。
因此，通过上述的遥控器操作电视机等显示设备时，操作步骤繁杂。
发明内容
本申请提供了一种指向遥控的方法及系统，实现了显示设备可以通过遥控设备发送的图形化红外信号识别遥控设备在显示设备的显示屏上的指向位置，简化了操作步骤。
第一方面，本申请提供了一种指向遥控系统，包括：遥控设备和显示设备；其中，该遥控设备，用于向该显示设备发送图形化红外信号。该显示设备，用于通过多个红外接收器接收该图形化红外信号；该显示设备，还用于获取该图形化红外信号在显示屏上的投影图形。该显示设备，还用于根据该投影图形，确定出该遥控设备在该显示屏上的指向位置。该显示设备，还用于在该显示屏的该指向位置显示提示标记，该提示标记用于提示用户该遥控设备在该显示屏上的指向位置。
其中，该显示设备包括上述多个红外接收器和上述显示屏。
在一种可能的实现方式中，该遥控设备，还用于：接收用户作用于第一按键的第一输入；响应于该第一输入，发送该第一按键对应的控制信息给该显示设备。该显示设备，还用于：根据该第一按键对应的控制信息和该指向位置，确定出第一控制操作；执行该第一控制操作。
在一种可能的实现方式中，该遥控设备，具体用于：响应于该第一输入，通过该图形化红外信号发送该第一按键对应的控制信息给该显示设备。
在一种可能的实现方式中，该遥控设备，具体用于：响应于该第一输入，通过蓝牙发送该第一按键对应的控制信息给该显示设备。
在一种可能的实现方式中，该多个红外接收器排列成红外接收器阵列，该红外接收器阵列耦合在该显示屏中。
在一种可能的实现方式中，该多个红外接收器排列在该显示屏的四周，形成红外接收器边框。
在一种可能的实现方式中，该图形化红外信号包括圆形红外信号；该投影图形包括圆形投影图形或椭圆形投影图形。该显示设备，具体用于：根据接收到该图形化红外信号在显示屏上的该圆形投影图形或该椭圆形投影图形，确定该圆形投影图形或该椭圆形投影图形的中心位置为该指向位置。
在一种可能的实现方式中，该图形化红外信号包括圆环形红外信号；该投影图形包括圆环形投影图形或椭圆环形投影图形，其中，该圆环红外信号中不同环内的能量不同。该显示设备，具体用于：获取所述圆环形投影图形或所述椭圆环投影图形在所述红外接收阵列上覆盖的M个接收点所在的位置，M为正整数；以所述接收点所在的位置为圆心，所述接收点接收到所述圆环形红外信号的信号强度对应的外环半径和内环半径，确定出所述接收点对应的圆环；根据所述M个接收点各自对应的圆环，确定出M个圆环的重合区域，并将所述重合区域的中心位置确定为所述指向位置。
在一种可能的实现方式中，该图形化红外信号包括十字形红外信号；该投影图形包括十字形图形。该显示设备，具体用于：获取该红外接收边框上接收到该十字形红外信号的四个接收点所在的位置；通过该四个接收点所在的位置，确定出该图形化红外信号在该显示屏上的该十字形图形；计算该十字形图形中交叉点的位置，并将该交叉点的位置确定为该指向位置。
在一种可能的实现方式中，该第一控制操作包括以下任一种：点选操作、长按操作、框选操作、拖拽操作。
在一种可能的实现方式中，该显示设备包括以下设备类型中的任一种：显示器、电视机和平板电脑；该遥控设备包括以下设备类型中的任一种：遥控器、鼠标、智能手机。
本申请的实施例提供了一种指向遥控系统，显示设备可以通过红外接收器阵列或红外接收器边框，接收到遥控设备发送的图形化红外信号。显示设备可以根据图形化红外信号在红外接收器阵列或红外接收器边框上的投影，确定出遥控设备在显示设备上的指向位置。这样，显示设备可以通过遥控设备发送的图形化红外信号识别遥控设备在显示设备的显示屏上的指向位置，简化了操作步骤。另外，用户可以通过遥控设备远距离对显示设备进行触控类的交互操作(例如，点选、框选、长按、拖拽等等)。
第二方面，本申请提供了一种显示设备，包括：处理器、显示屏和多个红外接收器。其中，该多个红外接收器，用于接收遥控设备发送的图形化红外信号。该处理器，用于获取该图形化红外信号在该显示屏上的投影图形。该处理器，还用于根据该投影图形，确定出该遥控设备在该显示屏上的指向位置。该显示屏，还用于在该显示屏的该指向位置显示提示标记，该提示标记用于提示用户该遥控设备在该显示屏上的指向位置。
在一种可能的实现方式中，该显示设备还包括：无线通信模块。该无线通信模块，用于接收该遥控设备发送的第一按键对应的控制信息。该处理器，还用于根据该第一按键对应的控制信息和该指向位置，确定出第一控制操作。该处理器，还用于执行该第一控制操作。
在一种可能的实现方式中，该无线通信模块，具体用于：接收该遥控设备通过该图形 化红外信号发送的该第一按键对应的控制信息。
在一种可能的实现方式中，该无线通信模块，具体用于：接收该遥控设备通过蓝牙发送的该第一按键对应的控制信息。
在一种可能的实现方式中，该多个红外接收器排列成红外接收器阵列，该红外接收器阵列耦合在该显示屏中。
在一种可能的实现方式中，该多个红外接收器排列在该显示屏的四周，形成红外接收器边框。
在一种可能的实现方式中，该图形化红外信号包括圆形红外信号；该投影图形包括图形投影或椭圆形投影图形。该处理器，具体用于：根据接收到该圆形红外信号在该显示屏上的该圆形投影图形或该椭圆形投影图形，确定该圆形投影图形或该椭圆形投影图形的中心位置为该指向位置。
在一种可能的实现方式中，该图形化红外信号包括圆环形红外信号；该投影图形包括圆环形投影图形或椭圆环形投影图形，其中，该圆环红外信号中不同环内的能量不同。该处理器，具体用于：获取所述圆环形图形或所述椭圆环投影图形在所述红外接收阵列上覆盖的M个接收点所在的位置，M为正整数；以所述接收点所在的位置为圆形，所述接收点接收到所述圆环形红外信号的信号强度对应的外环半径和内环半径，确定出所述接收点对应的圆环；根据所述M个接收点各自对应的圆环，确定出M个圆环的重合区域，并将所述重合区域的中心位置确定为所述指向位置。
在一种可能的实现方式中，该图形化红外信号包括十字形红外信号；该投影图形包括十字形图形。该处理器，具体用于：获取该红外接收边框上接收到该十字形红外信号的四个接收点所在的位置；通过该四个接收点所在的位置，确定出该图形化红外信号在该显示屏上的该十字形图形；计算该十字形图形中交叉点的位置，并将该交叉点的位置确定为该指向位置。
在一种可能的实现方式中，该第一控制操作包括以下任一种：点选操作、长按操作、框选操作、拖拽操作。
在一种可能的实现方式中，该显示设备包括以下设备类型中的任一种：显示器、电视机和平板电脑；该遥控设备包括以下设备类型中的任一种：遥控器、鼠标、智能手机。
本申请的实施例提供了一种显示设备，显示设备可以通过红外接收器阵列或红外接收器边框，接收到遥控设备发送的图形化红外信号。显示设备可以根据图形化红外信号在红外接收器阵列或红外接收器边框上的投影，确定出遥控设备在显示设备上的指向位置。这样，显示设备可以通过遥控设备发送的图形化红外信号识别遥控设备在显示设备的显示屏上的指向位置，简化了操作步骤。另外，也方便了用户可以通过遥控设备远距离对显示设备进行触控类的交互操作(例如，点选、框选、长按、拖拽等等)。
第三方面，本申请提供了一种指向遥控方法，包括：首先，显示设备通过多个红外接收器接收遥控设备发送的图形化红外信号。然后，该显示设备获取该图形化红外信号在显示屏上的投影图形，接着，该显示设备根据该投影图形，确定出该遥控设备在该显示屏上的指向位置。接着，该显示设备在该显示屏的该指向位置显示提示标记，该提示标记用于提示用户该遥控设备在该显示屏上的指向位置。
在一种可能的实现方式中，该方法还包括：该显示设备接收该遥控设备发送的第一按键对应的控制信息。该显示设备根据该第一按键对应的控制信息和该指向位置，确定出第一控制操作。该显示设备执行该第一控制操作。
在一种可能的实现方式中，该显示设备接收该遥控设备发送的第一按键对应的控制信息，具体包括：该显示设备接收该遥控设备通过该图形化红外信号发送的该第一按键对应的控制信息。
在一种可能的实现方式中，该显示设备接收该遥控设备发送的第一按键对应的控制信息，具体包括：该显示设备接收该遥控设备通过蓝牙发送的该第一按键对应的控制信息。
在一种可能的实现方式中，该多个红外接收器排列成红外接收器阵列，该红外接收器阵列耦合在该显示屏中。
在一种可能的实现方式中，该多个红外接收器排列在该显示屏的四周，形成红外接收器边框。
在一种可能的实现方式中，该图形化红外信号包括圆形红外信号；该投影图形包括图形投影或椭圆形投影图形。该显示设备根据该投影图形，确定出该遥控设备在该显示屏上的指向位置，具体包括：该显示设备根据接收到该圆形红外信号在该显示屏上的该圆形投影图形或该椭圆形投影图形，确定该圆形投影图形或该椭圆形投影图形的中心位置为该指向位置。
在一种可能的实现方式中，该图形化红外信号包括圆环形红外信号；该投影图形包括圆环形投影图形或椭圆环形投影图形，其中，该圆环红外信号中不同环内的能量不同。该显示设备根据该投影图形，确定出该遥控设备在该显示屏上的指向位置，具体包括：该显示设备根据该圆环形投影图形或椭圆环投影图形，和该投影图形内的红外信号接收强度信息，确定出该指向位置。
在一种可能的实现方式中，该图形化红外信号包括十字形红外信号；该投影图形包括十字形图形。该显示设备获取该图形化红外信号在显示屏上的投影图形，具体包括：该显示设备获取该红外接收边框上接收到该十字形红外信号的四个接收点所在的位置；该显示设备通过该四个接收点所在的位置，确定出该图形化红外信号在该显示屏上的该十字形图形。该显示设备根据该投影图形，确定出该遥控设备在该显示屏上的指向位置，具体包括：计算该十字形图形中交叉点的位置，并将该交叉点的位置确定为该指向位置。
在一种可能的实现方式中，该第一控制操作包括以下任一种：点选操作、长按操作、框选操作、拖拽操作。
在一种可能的实现方式中，该显示设备包括以下设备类型中的任一种：显示器、电视机和平板电脑；该遥控设备包括以下设备类型中的任一种：遥控器、鼠标、智能手机。
本申请的实施例提供了一种指向遥控方法，显示设备可以通过红外接收器阵列或红外接收器边框，接收到遥控设备发送的图形化红外信号。显示设备可以根据图形化红外信号在红外接收器阵列或红外接收器边框上的投影，确定出遥控设备在显示设备上的指向位置。这样，显示设备可以通过遥控设备发送的图形化红外信号识别遥控设备在显示设备的显示屏上的指向位置，简化了操作步骤。另外，也方便了用户可以通过遥控设备远距离对显示设备进行触控类的交互操作(例如，点选、框选、长按、拖拽等等)。
第四方面，本申请提供了一种芯片系统，应用于显示设备，其特征在于，该芯片系统包括：处理器；该显示设备包括多个红外接收器和显示屏。其中，该处理器用于：获取多个红外接收器接收到遥控设备发送的图形化红外信号在显示屏上的投影图形；根据该投影图形，确定出该遥控设备在该显示屏上的指向位置；指示该显示屏在该指向位置显示提示标记，该提示标记用于提示用户该遥控设备在该显示屏上的指向位置。
在一种可能的实现方式中，还包括无线通信模块；该无线通信模块，用于接收该遥控设备发送的第一按键对应的控制信息。该处理器，还用于根据该第一按键对应的控制信息和该指向位置，确定出第一控制操作。该处理器，还用于执行该第一控制操作。
在一种可能的实现方式中，该无线通信模块，具体用于：接收该遥控设备通过该图形化红外信号发送的该第一按键对应的控制信息。
在一种可能的实现方式中，该无线通信模块，具体用于：接收该遥控设备通过蓝牙发送的该第一按键对应的控制信息。
在一种可能的实现方式中，该图形化红外信号包括圆形红外信号；该投影图形包括图形投影或椭圆形投影图形；该多个红外接收器排列成红外接收器阵列，该红外接收器阵列耦合在该显示屏中。该处理器，具体用于：根据接收到该圆形红外信号在该显示屏上的该圆形投影图形或该椭圆形投影图形，确定该圆形投影图形或该椭圆形投影图形的中心位置为该指向位置。
在一种可能的实现方式中，该图形化红外信号包括圆环形红外信号；该投影图形包括圆环形投影图形或椭圆环形投影图形，其中，该圆环红外信号中不同环内的能量不同；该多个红外接收器排列成红外接收器阵列，该红外接收器阵列耦合在该显示屏中。该处理器，具体用于：获取圆环形投影图形或椭圆环投影图形在红外接收阵列上覆盖的M个接收点所在的位置，M为正整数；以所述接收点所在的位置为圆心，所述接收点接收到所述圆环形红外信号的信号强度对应的外环半径和内环半径，确定出接收点对应的圆环；根据M个接收点各自对应的圆环，确定出M个圆环的重合区域，并将所述重合区域的中心位置确定为所述指向位置。
在一种可能的实现方式中，该图形化红外信号包括十字形红外信号；该投影图形包括十字形图形；该多个红外接收器排列在该显示屏的四周，形成红外接收器边框。该处理器，具体用于：获取该红外接收边框上接收到该十字形红外信号的四个接收点所在的位置；通过该四个接收点所在的位置，确定出该图形化红外信号在该显示屏上的该十字形图形；计算该十字形图形中交叉点的位置，并将该交叉点的位置确定为该指向位置。
在一种可能的实现方式中，该第一控制操作包括以下任一种：点选操作、长按操作、框选操作、拖拽操作。
第五方面，本申请实施例提供了一种显示设备，包括：一个或多个功能单元，该一个或多个功能单元用于执行上述任一方面任一项可能的实现方式中的指向遥控方法。
第六方面，本申请实施例提供了一种计算机存储介质，包括计算机指令，当计算机指令在显示设备上运行时，使得显示设备执行上述任一方面任一项可能的实现方式中的指向遥控方法。
第七方面，本申请实施例提供了一种计算机程序产品，当计算机程序产品在计算机上 运行时，使得计算机执行上述任一方面任一项可能的实现方式中的指向遥控方法。
附图说明
图1A为本申请实施例提供的一种显示设备的硬件结构示意图；
图1B为本申请实施例提供的一种红外接收器阵列的结构示意图；
图1C为本申请实施例提供的一种红外接收器边框的结构示意图；
图1D为本申请实施例提供的一种直下式背光液晶显示屏的结构示意图；
图1E为本申请实施例提供的一种侧入式背光液晶显示屏的结构示意图；
图1F为本申请实施例提供的一种有机发光二极管显示屏的结构示意图；
图1G为本申请实施例提供的一种投影显示时投影幕布与红外接收器阵列的位置示意图；
图2为本申请实施例提供的一种遥控设备的硬件结构示意图；
图3A为本申请实施例提供的一种圆形红外信号的产生原理示意图；
图3B为本申请实施例提供的一种圆环形红外信号的产生原理示意图；
图3C为本申请实施例提供的一种十字形红外信号的产生原理示意图；
图3D为本申请实施例提供的另一种十字形红外信号的产生原理示意图；
图4为本申请实施例提供的一种指向遥控系统的架构示意图；
图5A为本申请实施例提供的一种红外接收阵列的应用场景示意图；
图5B为本申请实施例提供的一种红外接收器边框的应用场景示意图；
图6为本申请实施例提供的一种投影原理示意图；
图7A-图7C为本申请实施例提供的一组根据圆形投影图形计算指向位置的原理示意图；
图8A-图8C为本申请实施例提供的一组根据椭圆形投影图形计算指向位置的原理示意图；
图9A-图9C为本申请实施例提供的一组根据圆环形投影图形计算指向位置的原理示意图；
图10A-图10D为本申请实施例提供的一组根据椭圆环形投影图形计算指向位置的原理示意图；
图11A-图11B为本申请实施例提供的一组根据十字形投影图形计算指向位置的原理示意图；
图12A-图12B为本申请实施例提供的另一组根据十字形投影图形计算指向位置的原理示意图；
图13为本申请实施例提供的一种指向遥控方法的流程示意图；
图14A-图14F为本申请实施例提供的一组人机交互的操作示意图。
具体实施方式
下面将结合附图对本申请实施例中的技术方案进行清除、详尽地描述。其中，在本申请实施例的描述中，除非另有说明，“/”表示或的意思，例如，A/B可以表示A或B；文本中的“和/或”仅仅是一种描述关联对象的关联关系，表示可以存在三种关系，例如，A和/ 或B，可以表示：单独存在A，同时存在A和B，单独存在B这三种情况，另外，在本申请实施例的描述中，“多个”是指两个或多于两个。
以下，术语“第一”、“第二”仅用于描述目的，而不能理解为暗示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此，限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个该特征，在本申请实施例的描述中，除非另有说明，“多个”的含义是两个或两个以上。
目前，有一种空中鼠标，可以实现在空中移动。空中鼠标可以利用陀螺仪等传感器输出的数据，对显示设备的屏幕上的光标进行控制。其基本原理为：空中鼠标可以将自身X轴的角速度和Z轴的角速度映射到空中鼠标的移动速度，通过相对位置的变动，计算光标在显示设备的屏幕上的移动位置。具体实现是，空中鼠标的数字处理芯片将传感器获取到的运动信号转换成数字信号，使用射频无线通信传输控制信号给显示设备。显示设备然后根据控制信号，确定并显示出光标的位置。由于空中鼠标是通过传感器感测的运动数据进行光标的定位，空中鼠标需要显示设备的屏幕上先显示出光标的初始位置，然后在用户缓慢移动的平移类操作后，才能根据平移类操作的相对移动位置，确定出光标的最后位置。因此，光标定位的精度不够，有时需要用户多次移动才能将光标移动到指定位置。
本申请的实施例提供了一种指向遥控方法及系统，显示设备可以通过红外接收器阵列或红外接收器边框，接收到遥控设备发送的图形化红外信号。显示设备可以根据图形化红外信号在红外接收器阵列或红外接收器边框上的投影，确定出遥控设备在显示设备上的指向位置。这样，显示设备可以通过遥控设备发送的图形化红外信号识别遥控设备在显示设备的显示屏上的指向位置，简化了操作步骤。另外，用户可以通过遥控设备远距离对显示设备进行触控类的交互操作(例如，点选、框选、长按、拖拽等等)。
下面介绍本申请实施例提供的一种显示设备100。
图1A示出了显示设备100的结构示意图。
如图1A所示，显示设备100可以包括处理器111，存储器112，无线通信处理模块113，电源开关114，显示屏115，音频模块116，扬声器117，红外接收器118。
其中，处理器111可以包括一个或多个处理单元，例如：处理器111可以包括应用处理器(application processor，AP)，调制解调处理器，图形处理器(graphics processing unit，GPU)，图像信号处理器(image signal processor，ISP)，控制器，存储器，视频编解码器，数字信号处理器(digital signal processor，DSP)，基带处理器，和/或神经网络处理器(neural-network processing unit，NPU)等。其中，不同的处理单元可以是独立的器件，也可以集成在一个或多个处理器中。
其中，控制器可以是显示设备100的神经中枢和指挥中心。控制器可以根据指令操作码和时序信号，产生操作控制信号，完成取指令和执行指令的控制。
处理器111中还可以设置存储器，用于存储指令和数据。在一些实施例中，处理器111中的存储器为高速缓冲存储器。该存储器可以保存处理器111刚用过或循环使用的指令或 数据。如果处理器111需要再次使用该指令或数据，可从所述存储器中直接调用。避免了重复存取，减少了处理器111的等待时间，因而提高了系统的效率。
存储器112与处理器111耦合，用于存储各种软件程序和/或多组指令。存储器112可以用于存储计算机可执行程序代码，所述可执行程序代码包括指令。处理器111通过运行存储在存储器112的指令，从而执行显示设备100的各种功能应用以及数据处理。存储器112可以包括存储程序区和存储数据区。其中，存储程序区可存储操作系统，至少一个功能所需的应用程序(比如声音播放功能，图像播放功能等)等。存储数据区可存储显示设备100使用过程中所创建的数据(比如音频数据，待显示的图像数据等)等。此外，存储器112可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件，闪存器件，通用闪存存储器(universal flash storage，UFS)等。
无线通信模块113可以提供应用在显示设备100上的包括无线局域网(wireless local area networks，WLAN)(如无线保真(wireless fidelity，Wi-Fi)网络)，蓝牙(bluetooth，BT)，全球导航卫星系统(global navigation satellite system，GNSS)，调频(frequency modulation，FM)，近距离无线通信技术(near field communication，NFC)，红外技术(infrared，IR)等无线通信的解决方案。
在一些实施例中，无线通信处理模块113可以包括蓝牙(BT)通信处理模块113A、WLAN通信处理模块113B、红外线通信处理模块113C。蓝牙(BT)通信处理模块113A、WLAN通信处理模块113B中的一项或多项可以监听到其他设备发射的信号，如探测请求、扫描信号等等，并可以发送响应信号，如探测响应、扫描响应等，使得其他设备可以发现显示设备100，并与其他设备建立无线通信连接，通过蓝牙或WLAN中的一种或多种无线通信技术与其他设备进行通信。其中，蓝牙(BT)通信处理模块113A可以提供包括经典蓝牙(BR/EDR)或蓝牙低功耗(Bluetooth low energy，BLE)中一项或多项蓝牙通信的解决方案。WLAN通信处理模块113B可以包括Wi-Fi direct、Wi-Fi LAN或Wi-Fi softAP中一项或多项WLAN通信的解决方案。、红外线通信处理模块113C可以处理红外接收器118接收到红外信号以及接收红外信号的位置。
电源开关114，可用于控制电源向显示设备100的供电。在一些实施例中，电源开关114可用于控制外部电源对显示设备100的供电。
在一些实施例中，该显示设备100还可以包括电池、充电管理模块、电源管理模块。电池可以用于为显示设备100提供电源。充电管理模块用于从充电器接收充电输入。其中，充电器可以是无线充电器，也可以是有线充电器。在一些有线充电的实施例中，充电管理模块可以通过USB接口接收有线充电器的充电输入。在一些无线充电的实施例中，充电管理模块可以通过显示设备100的无线充电线圈接收无线充电输入。充电管理模块为电池充电的同时，还可以通过电源管理模块为电子设备供电。电源管理模块用于连接电池，充电管理模块与处理器111。电源管理模块接收电池和/或充电管理模块的输入，为处理器111，存储器112，显示屏115和无线通信模块113等供电。电源管理模块还可以用于监测电池容量，电池循环次数，电池健康状态(漏电，阻抗)等参数。在其他一些实施例中，电源管理模块也可以设置于处理器111中。在另一些实施例中，电源管理模块和充电管理模块也可以设置于同一个器件中。
显示屏115，可用于显示图像，视频等。显示屏115包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display，LCD)，有机发光二极管(organic light-emitting diode，OLED)，有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode的，AMOLED)，柔性发光二极管(flex light-emitting diode，FLED)，Miniled，MicroLed，Micro-oLed，量子点发光二极管(quantum dot light emitting diodes，QLED)等。
红外接收器118，可用于接收红外信号。示例性的，红外接收器118可以接收遥控设备发送的图形化的红外信号，例如，圆形红外信号、圆环形红外信号、十字形红外信号，等等。需要说明的是，图形可以指在一个二维空间中可以用轮廓划分出若干的空间形状。
本申请实施例中，显示设备100包括有多个红外接收器118。如图1B所示，该多个红外接收器118可以矩阵式的排列成红外接收器阵列。
在另一些实施例中，如图1C所示，该多个红外接收器118可以排列在显示屏115四周的边框上。在本申请的实施例中，排列在显示屏115四周的边框上的多个红外接收器118，可以被称为红外接收器边框。在一种可能的实现方式中，当显示设备100为投影仪时，该多个红外接收器118排列在投影幕布四周，作为投影幕布的红外接收器边框。
在本申请实施例中，当显示设备100包括有红外接收器阵列时，该红外接收器阵列可以耦合在显示屏115中。
示例性的，如图1D所示，显示屏115可以为直下式背光液晶显示屏。该直下式液晶显示屏可包括有背板121、背光灯板122、光学膜材124、LCD面板125。红外接收器阵列122可以处于背光灯板122与光学膜材124之间。其中，背板121可用于支撑整个直下式液晶显示屏。该背光灯板122可用于发光，给LCD面板125提供光源。该光学膜材124可用于将背光灯板122发出的单一颜色的光，激发产生多种不同色光的光源，并将不同色光彼此混光形成白光作为该LCD面板的背光源。该LCD面板125可以在电信号的控制下，改变显示屏115上各像素的显示颜色和亮度。
如图1E所示，显示屏115可以为侧入式背光液晶显示屏。该侧入式液晶显示屏可以包括有背板131、导光板(LGP)133、光学膜材134、LCD面板135。该红外接收器阵列132可以处于背板131与导光板133之间。其中，背板131可用于支撑整个侧入式液晶显示屏。该导光板133可用于将分布在显示屏115侧边的LED灯条发出的光，调整至从指定方向射入LCD面板135。该光学膜材134可用于将背光灯板132发出的单一颜色的光，激发产生多种不同色光的光源，并将不同色光彼此混光形成白光作为该LCD面板的背光源。该LCD面板135可以在电信号的控制下，改变显示屏115上个各像素的显示颜色和亮度。
如图1F所示，显示屏115可以为自发光式显示屏，例如，OLED显示屏。该OLED显示屏包括有背板141和OLED面板143。该红外接收器阵列142可以处于背板141和OLED面板143之间。该背板141可用于支撑整个OLED显示屏。该OLED面板143可以包括有若干个自发光的子像素，每个子像素都能够被单独点亮。由于子像素中的有机材料分子不同，子像素可以有产生生红、绿和蓝(RGB)三原色这三种类型，或者产生红、绿、蓝和白色(RGBW)四种颜色这四种类型。OLED显示屏上的每个像素都可以包括红色、绿色和蓝色(RGB)三原色的子像素，从而使得每个像素都可以显示出不同的颜色。或者，OLED 显示屏上的每个像素都可以包括红色、绿色、蓝色和白色(RGBW)四种颜色的子像素，从而使得每个像素都可以显示出不同的颜色。
在一些实施例中，显示设备100可以为投影仪等投影设备。如图1G所示，显示设备100的显示屏115可以指投影幕布152。该红外接收器阵列151可以在投影幕布152后。
音频模块116，可用于将数字音频信号转换成模拟音频信号输出，也可用于将模拟音频输入转换为数字音频信号。音频模块116还可以用于对音频信号编码和解码。在一些实施例中，音频模块116可以设置与处理器111中，或将音频模块116的部分功能模块设置与处理器111中。音频模块116可以通过总线接口(例如UART接口，等等)向无线通信模块113传递音频信号，实现通过蓝牙音箱播放音频信号的功能。
扬声器117，可用于将音频模块116的发送的音频信号转换为声音信号。
在一些实施例中，显示设备100还可以包括有麦克风，也成“话筒”，“传声器”，用于将声音信号转换为电信号。当发生语音控制指令时，用户可以通过人嘴发声，将声音信号输入到麦克风。
在一些实施例中，显示设备100还可以包括有线局域网(local area network，LAN)通信处理模块，高清晰度多媒体接口(high definition multimedia interface，HDMI)通信处理模块，通信串行总线(universal serial bus，USB)通信处理模块。该有线LAN通信处理模块可用于通过有线LAN和通过一个LAN中的其他设备进行通信，还可用于通过有线LAN连接到WAN，可与WAN中的设备通信。该HDMI通信处理模块可用于通过HDMI接口与其他设备进行通信。例如，HDMI通信处理模块可以通过HDMI接口接收机顶盒发送的HDR视频数据，等等。该USB通信处理模块可用于通过USB接口与其他设备进行通信。
在本申请实施例中，显示设备100可以为以下设备类型中的任一种：显示器、电视机、个人电脑、平板电脑、投影仪等等。需要说明的是，该显示设备100为投影仪时，该显示设备100的显示屏可以指投影幕布。
下面介绍本申请实施例提供的一种遥控设备。
图2示出了遥控设备200的结构示意图。
如图2所示，遥控设备200可以包括：处理器201、存储器202、无线通信处理模块203、红外发射器204、电源模块205，等等。其中：
处理器201可用于读取和执行计算机可读指令。具体实现中，处理器201可主要包括控制器、运算器和寄存器。其中，控制器主要负责指令译码。并为指令对应的操作发出控制信号。运算器主要负责保存指令执行过程中临时存放的寄存器操作数和中间操作结果等。具体实现中，处理器201的硬件架构可以是专用集成电路(ASIC)架构、MIPS架构、ARM架构或者NP架构等等。
在一些实施例中，处理器201可以用于解析无线通信处理模块203接收到的信号，如显示设备100发送的蓝牙信号，等等。
在一些实示例中，处理器201还可用于生成无线通信处理模块203向外发送的信号， 例如蓝牙广播信号、带有控制信息的红外信号，等等。
存储器202与处理器201耦合，用于存储各种软件程序和/或多组指令。具体实现中，存储器202可包括高速随机存取的存储器，并且也可包括非易失性存储器。存储器202可以存储通信程序，该通信程序可用于与显示设备100进行通信。
无线通信处理模块203可以包括红外线通信处理模块203C。在一些实施例中，无线通信处理模块203还可以包括蓝牙通信处理模块203A、WLAN通信处理模块203B中的一项或多项。
其中，蓝牙通信处理模块203A、WLAN通信处理模块203B中的一项或多项可以监听到其他设备(如显示设备100)发射的信号，如探测请求、扫描信号等等，并可以发送响应限号，如探测响应、扫描响应等，使得其他设备(如显示设备100)可以发现遥控设备200，并建立无线通信连接。其中，蓝牙通信处理模块203可以提供包括经典蓝牙或蓝牙低功耗(bluetooth low energy，BLE)中一项或多项蓝牙通信的解决方案。WLAN通信处理模块203B可以包括Wi-Fi direct、Wi-Fi LAN或Wi-Fi softAP中一项或多项WLAN通信的解决方案。红外通信处理模块203C可以调制出带有控制信息的红外信号，并通过红外发射器204发送该带有控制信息的红外信号。
其中，红外发射器204可以是红外发光二极管，用于向外辐射红外信号。在一些实施例中，遥控设备200可以包括有多个红外发射器204。
电源管理模块205可用于连接电池(未示出)，充电管理模块(未示出)与处理器201。电源管理模块205接收电池(未示出)和/或充电管理模块(未示出)的输入，为处理器201，存储器202，无线通信处理模块203，红外发射器204等供电。电源管理模块205还可以用于监测电池容量，电池循环次数，电池健康状态(漏电，阻抗)等参数。
遥控设备200还可以包括一个或多个按键(例如确认按键、主页按键、音量+按键、音量-按键、频道+按键、频道-按键，等等)，其中，该一个或多个按键可以是物理按键。在一些实施例中，遥控设备200还可以包括有触控屏，该一个或多个按键可以是触控屏上显示的虚拟按键。
在本申请实施例中，遥控设备200还包括有一个或多个微透镜结构(图中未示出)。该一个或多个微透镜结构可以放置在红外发射器204的发光方向上。当红外发射器204可以配合微透镜结构输出具有特定能量分布的指定图形的红外信号。
示例性的，如图3A所示，红外发射器204可以作为红外光源，发出红外信号。红外信号穿过微透镜结构后可以形成圆形红外信号。其中，该圆形图形中，红外信号的能量分布均匀。
如图3B所示，红外发射器204可以作为红外光源，发出红外信号。红外信号穿过微透镜结构后可以形成具有指定能量分布的圆环图形红外信号。例如，该圆环图形红外信号的最内环能量最高，圆环越往外，能量越低。
如图3C所示，红外发射器204可以作为红外光源，发出红外信号。红外信号穿过微透镜结构后可以形成十字形图形的红外信号。该十字形图形中，红外信号的能量分布均匀。
在一种可能的实现方式中，遥控设备200可以通过多个红外发射器204以及多个微透镜结构输出具有指定能量分布的指定图形的红外信号。
示例性的，如图3D所示，遥控设备200可以包括有两个红外发射器204，和两个微透镜结构(微透镜结构1和微透镜结构2)。其中，这两个红外发射器204可以分别作为两个红外光源(红外光源1和红外光源2)，发出红外信号。红外光源1发出的红外信号经过微透镜结构后，可以形成负45度条形图形的红外信号。红外光源2发出的红外信号经过微透镜结构后，可以形成正45度条形图形的红外信号。负45度条形图形的红外信号和正45度条形图形的红外信号可以相交，形成十字形图形的红外信号。上述图3D所示示例，仅仅用于解释本申请，不应构成限定，具体实现中，十字形图形的两个条形相交夹角可以是其他角度，在此不作限定。
在本申请的实施例中，当显示设备100上的多个红外接收器118成矩阵式排列成红外接收器阵列，耦合在显示屏115内时，遥控设备200可以采用输出下述任一种图形的红外信号的微透镜结构和红外发射器：圆形图形的红外信号、圆环形图形的红外信号、十字形图形的红外信号、方环形图形的红外信号，H形图形的红外信号，等等。当显示设备100上的多个红外接收器118在显示屏115的四周排列成红外接收边框时，遥控设备200可以采用输出十字形等图形的红外信号的微透镜结构和红外发射器。
在本申请实施例中，遥控设备200可以为以下设备类型中的任一种：遥控器(例如电视机遥控器)、鼠标、智能手机，平板电脑，等等。需要说明的是，该遥控设备200为智能手机或平板电脑等带有触控屏的装置时，该遥控设备200上的一个或多个按键可以是触控屏显示的虚拟按键。
下面介绍本申请实施例中提供的一种指向遥控系统。
图4示出了本申请实施例提供的一种指向遥控系统400的框架示意图。
如图4所示，该指向遥控系统400可以包括显示设备100和遥控设备200。该显示设备100可以包括处理器411、红外接收器阵列(或红外接收器边框)412、显示屏413、无线通信模块414。其中，该处理器411可以为微处理单元(microcontroller unit，MCU)。该无线通信模块414可以包括2.4G射频传输模块(例如，蓝牙传输模块、红外传输模块等)。在一种可能的实现方式中，该无线通信模块414可以包括Wi-Fi传输模块。其中，针对显示设备100的具体说明，可以参考前述图1A所述实施例，在此不再赘述。
该遥控设备200可以包括处理器421、红外发射器422、按键423、无线通信模块424。其中，处理器421可以为微处理单元(microcontroller unit，MCU)。红外发射器422结合微透镜结构可以发送出指定图形的红外信号。按键423可以有一个或多个。该按键423可以为物理按键或虚拟按键。该无线通信模块424可以包括2.4G射频传输模块(例如，蓝牙传输模块、红外传输模块等)。该无线通信模块424可以通过控制信号，发送按键423对应的控制信息给显示设备100。在一种可能的实现方式中，该无线通信模块414可以包括Wi-Fi传输模块。其中，针对遥控设备200的具体说明，可以参考前述图2所述实施例，在此不再赘述。
下面结合指向遥控系统400，具体说明显示设备100上硬件和遥控设备200上硬件的工作流程。
红外发射器422可以通过微透镜结构425发送具有指定能量分布的图形化红外信号给红外接收器阵列(或红外接收器边框)412。图形化红外信号因微透镜结构425的不同，可以在正对的投影平面上投影出不同形状的图形，例如，圆形图形、圆环形图形、十字形图形，等等。当图形化红外信号侧向投影到投影平面上时，投影平面上的投影图形可以为椭圆形图形、椭圆环形图形、十字形图形等等。
红外接收器阵列(或红外接收器边框)412在接收到图形化红外信号后，可以向处理器411上报该图形化红外信号的接收信息，其中，该接收信息可以包括有该图形化红外信号的位置信息。在一些实施例中，接收信息可以包括有该接收到的该图形化红外信号的位置信息和该图形化红外信号的接收信号强度信息。
处理器411可以根据红外信号的接收信息，确定出遥控设备200的指向位置，并将指向位置给到显示屏413。显示屏413可以在指向位置显示光标。该光标可用于提示用户，遥控设备200指向显示屏413上该光标所在的位置。其中，确定出遥控设备200的指向位置的过程，可以参考后续实施例，在此不再赘述。
处理器421可以通过按键423检测到用户的操作(例如按压，长按、单击、双击等等)，响应于该操作，处理器421可以匹配出该按键423的对应的控制指令。处理器421可以根据该控制指令指示无线通信模块424发送控制信号给无线通信模块414。无线通信模块414可以从控制信号中解析出控制信息发送给处理器411。处理器411可以执行该控制信息对应的操作。
示例性的，如图5A所示，显示设备100上的红外接收器阵列可以包括有多个成矩形阵列排列的红外接收器。该红外接收器阵列可以耦合在显示屏413内。红外发射器422可以通过微透镜结构425发送图形化红外信号给红外接收器阵列。当该图形化红外信号投射到红外接收器阵列上时，图形化红外信号在显示屏所在平面上可以呈现出指定图形。例如，图形化红外信号在显示屏所在平面上可以呈现出圆环形图形，并且，圆环形图形从内环至外环，信号强度依次减弱(或者，信号强度依次增大)。处理器411可以根据红外信号的接收信息，计算出圆环形接收区域的中心位置，并将该接收区域的中心位置，作为遥控设备200的在显示屏413上的指向位置。
如图5B所示，显示设备100上的多个红外接收器可以排列在显示屏的四周，形成红外接收器边框。红外发射器422可以通过微透镜结构发送图形化红外信号给红外接收器边框。当该图形化红外信号投射到显示屏413上时，红外信号在显示屏所在平面上可以呈现出指定图形。例如，图形化红外信号在显示屏所在平面上可以呈现出十字形图形。处理器411可以根据红外信号的接收信息，计算出十字形图形的十字交叉点，并将该十字形图形的十字交叉点，作为遥控设备200在显示屏413上的指向位置。
在一种可能的实现方式中，当无线通信模块414包括红外传输模块时，无线通信模块414可以调制出带有控制信息的红外信号，并通过多个红外发射器412发射到红外接收器阵列(或红外接收器边框)412。无线通信模块414可以从红外接收器阵列(或红外接收器边框)412接收到的红外信号中解析出控制信息，并将控制信息给到处理器411。处理器411可以执行该控制信息对应的操作。
下面结合不同的图形的红外信号，具体介绍本申请实施例中，显示设备100如何根据接收到的图形化红外信号，确定出遥控设备200在显示屏上的指向位置。
在一些应用场景中，显示设备100的显示屏内耦合有红外接收器阵列。遥控设备200上的红外发射器通过微透镜结构可以发出圆形红外信号。显示设备100通过红外接收器阵列接收到该红外信号时，可以根据接收到该红外信号的接收区域，计算红外信号的中心位置，并将该红外信号的中心位置作为遥控设备200在显示设备100的显示屏上的指向位置。这样，遥控设备200可以准确指向显示设备100的显示屏上用户想要操作的位置。
如图6所示，当遥控设备200作为发射点，正对显示设备100的显示屏发射圆形红外信号时，该红外信号在显示设备100的显示屏上的投影是圆形投影。当遥控设备200作为发射点，侧对显示设备100的显示屏发射圆形红外信号时，该红外信号在显示设备100的显示屏上的投影是椭圆形投影。
显示设备100可以通过红外接收阵列，确定检测到该红外信号的一个或多个红外接收器所在位置。然后，显示设备100可以根据该检测到该红外信号的一个或多个红外接收器所在位置，确定出该红外信号的接收区域。显示设备100可以根据该红外信号的接收区域，计算该接收区域的中心点。然后，显示设备100可以将该接收区域的中心位置，作为红外信号在显示屏上投影的中心点，也即是遥控设备200在显示屏上的指向位置。
示例性的，如图7A所示，显示设备100可以通过红外接收阵列接收遥控设备200正向显示屏发射的圆形红外信号。该红外信号在红外接收器阵列上的投影图形可以是圆形。其中，该红外信号的圆形投影可以在红外接收阵列上覆盖有一个或多个红外接收器，例如，红外接收器阵列上有四个红外接收器检测到了该红外信号。
图7B示出了红外接收器阵列的局部。如图7B所示，红外信号的圆形投影可以在红外接收阵列上覆盖有四个红外接收器，例如红外接收器1、红外接收器2、红外接收器3、红外接收器4。
如图7C所示，红外接收器1、红外接收器2、红外接收器3、红外接收器4这四个红外接收器的所在位置可以形成一个接收区域(例如矩形区域)。显示设备100可以根据这四个接收器的所在位置，计算出这接收区域的中心位置，作为红外信号在显示屏上投影的中心点，也即是遥控设备200在显示屏上的指向位置。
又示例性的，如图8A所示，显示设备100可以通过红外接收阵列接收遥控设备200侧向显示屏发射的红外信号。该红外信号该红外信号在红外接收器阵列上的投影图形可以是椭圆形。其中，该红外信号的圆形投影可以在红外接收阵列上覆盖有一个或多个红外接收器，例如，四个红外接收器检测到了该红外信号。
图8B示出了红外接收器阵列的局部。如图8B所示，红外信号的椭圆形投影可以在红外接收阵列上覆盖有四个红外接收器，例如，红外接收器阵列上有四个红外接收器检测到了该红外信号。
图8C所示，红外接收器1、红外接收器2、红外接收器3、红外接收器4这四个红外接收器的所在位置可以形成一个接收区域(例如矩形区域)。显示设备100可以根据这四个接收器的所在位置，计算出这接收区域的中心位置，作为红外信号在显示屏上椭圆投影的中心点，也即是遥控设备200在显示屏上的指向位置。
在一些应用场景中，显示设备100的显示屏内耦合有红外接收器阵列。遥控设备200可以通过红外发射器和微透镜结构可以发出圆环形红外信号。其中，该圆环红外信号从内环至外环，信号强度依次减弱(或者，信号强度依次增大)。显示设备100通过红外接收器阵列接收到该圆环形红外信号时，可以根据接收到该圆环形红外信号的接收区域以及接收区域内的信号强度分布，确定出遥控设备200在显示设备100的显示屏上的指向位置。这样，遥控设备200可以准确指向显示设备100的显示屏上用户想要操作的位置。
其中，显示设备100可以通过红外接收阵列，确定红外接收器阵列中检测到该红外信号的M个接收点所在位置，以及这M个接收点接收到红外信号的信号强度值。然后，显示设备100可以根据该检测到该红外信号的M个接收点所在位置，以及这M个接收点接收到红外信号的信号强度值，确定出遥控设备200在显示屏上的指向位置，其中，M为正整数。
示例性的，如图9A所示，显示设备100可以通过红外接收阵列接收遥控设备200正向显示屏发射的圆环形红外信号。该圆环形红外信号在红外接收器阵列上的投影图形可以是圆环形。其中，该红外信号的圆形投影可以在红外接收阵列上覆盖有M个接收点，例如，红外接收器阵列上有四个接收点检测到了该红外信号。
图9B示出了红外接收器阵列的局部。如图9B所示，圆环形红外信号的圆环形投影可以在红外接收阵列上覆盖有四个红外接收器，该四个红外接收器，即为该圆形投影的接收点。例如，红外接收器1(即接收点1)、红外接收器2(即接收点2)、红外接收器3(即接收点3)和红外接收器4(接收点4)。其中，由于圆环形红外信号的每个环的能量分布不同，因此，这四个红外接收器接收到红外信号的信号强度可以有不同。
例如，该圆环形投影可以有三个环，内环的信号强度最大、中环的信号强度中等，外环的信号强度最弱。红外接收器1处于该圆环形投影的外环，红外接收器1接收到红外信号的信号强度可以为-60dBm。红外接收器2处于该圆环形投影的中环，红外接收器2接收到红外信号的信号强度可以为-40dBm。红外接收器3处于该圆环形投影的中环，红外接收器3接收到红外信号的信号强度可以为-40dBm。红外接收器4处于该圆环形投影的内环，红外接收器3接收到红外信号的信号强度可以为-20dBm。
其中，信号强度与圆环的内外半径的对应可以如下表1所示：
表1
信号强度 圆环内半径 圆环外半径
[-20dBm，0) 0 12mm
[-40dBm，-20dBm) 12mm 16mm
(-∞，-40dBm) 16mm 20mm
由上述表1可知，当红外接收器接收到红外信号的信号强度大于等于-20dBm时，该红外接收器对应圆环的内半径为0，外半径为12mm。当红外接收器接收到红外信号的信号强度大于等于-40dBm且小于-20dBm时，该红外接收器对应圆环的内半径为12mm，外半径为16mm。当红外接收器接收到红外信号的信号强度小于-40dBm时，该红外接收器对应圆环的内半径为16mm，外半径为20mm。上述表1示例仅仅用于解释本申请，不应构成限定。
显示设备100可以将接收到圆环形红外信号的红外接收器所处位置为圆心，该红外接收器接收到红外信号的信号接收强度对应的外圆半径和内圆半径作圆环。当只有一个红外接收器接收到红外信号时，显示设备100可以将唯一接收到红外信号的红外接收器所处位置，作为遥控设备200在显示屏上的指向位置。当有多个红外接收器接收到该圆环形红外信号时，显示设备100可以根据接收到该圆环形红外信号的多个红外接收器各自对应的圆环，确定出这多个圆环的重合区域。显示设备100可以将这多个圆环的重合区域，确定为遥控设备200在显示屏上的指向位置。在一种可能的实现方式中，显示设备100可以将这多个圆环的重合区域的几何中心点，确定为遥控设备200在显示屏上的指向位置。
示例性的，例如，如图9C所示，红外接收器1接收到的信号强度可以为-60dBm，红外接收器1对应圆环1的外圆半径可以为20mm，内圆半径为16mm。红外接收器2接收到的信号强度可以为-40dBm，红外接收器2对应圆环2的外半径可以为16mm，内半径为12mm。红外接收器3接收到的信号强度可以为-40dBm，红外接收器3对应圆环3的外半径可以为16mm，内半径为12mm。红外接收器4接收到的信号强度可以为-20dBm，红外接收器4对应圆环4的外半径可以为12mm，内半径为0。其中，当圆环4的内半径为0时，该圆环4为圆形。
显示设备100可以根据圆环1、圆环2、圆环3、圆环4，确定出圆环1、圆环2、圆环3和圆环4的重合区域。显示设备100可以将该重合区域，作为遥控设备200在显示屏上的指向位置。在一种可能的实现方式中，显示设备100可以将该重合区域的几何中心位置，作为遥控设备200在显示屏上的指向位置。
在一些实施例中，显示设备100可以确定出所有检测到圆环形红外信号的红外接收器对应的圆环没有重合区域。显示设备100可以从所有接收到圆环形红外信号的红外接收器(例如，红外接收器1、红外接收器2、红外接收器3、红外接收器4、红外接收器5和红外接收器6)中，确定出接收信号强度大于第一信号强度(例如-30dBm)的A类红外接收器(例如，红外接收器2、红外接收器4)。显示设备100可以计算A类红外接收器(例如，红外接收器1、红外接收器2)对应圆环的重合区域，并将该A类红外接收器对应圆环的重合区域作为遥控设备200在显示屏上的指向位置。在一种可能的实现方式中，显示设备100可以将该重合区域的几何中心位置，作为遥控设备200在显示屏上的指向位置。
示例性的，如图10A所示，显示设备100可以通过红外接收阵列接收遥控设备200侧向显示屏发射的圆环形红外信号。该圆环形红外信号在红外接收器阵列上的投影图形可以是椭圆环形。其中，该圆环形红外信号的椭圆环形投影可以在红外接收阵列上覆盖有M个接收点，例如，红外接收器阵列上有六个接收点检测到了该红外信号。
图10B示出了红外接收器阵列的局部。如图10B所示，红外信号的圆环形投影可以在红外接收阵列上覆盖有六个接收点，例如，红外接收器1(即接收点1)、红外接收器2(即接收点2)、红外接收器3(即接收点3)、红外接收器4(接收点4)、红外接收器5(即接收点5)和红外接收器6(即接收点6)。其中，由于圆环形红外信号的每个环的能量分布不同，因此，这四个红外接收器接收到红外信号的信号强度可以有不同。
例如，该椭圆环形投影可以有三个环，内环的信号强度最大、中环的信号强度中等， 外环的信号强度最弱。红外接收器1、红外接收器3、红外接收器5和红外接收器6处于该圆环形投影的外环，红外接收器1接收到红外信号的信号强度可以为-60dBm、红外接收器3接收到红外信号的信号强度可以为-62dBm、红外接收器5接收到红外信号的信号强度可以为-64dBm、红外接收器6接收到的信号强度可以为-65dBm。红外接收器4处于该圆环形投影的中环，红外接收器4接收到的信号强度可以为-40dBm。红外接收器2处于该圆环形投影的内环，红外接收器2接收到的信号强度可以为-20dBm。结合上述表1，圆环1、圆环3、圆环5和圆环6的外半径可以为20mm，内半径可以为16mm。圆环4的外半径可以为16mm，内半径可以为12mm。圆环2的外半径可以为12mm，内半径可以为0。其中，当圆环2的内半径为0时，该圆环4为圆形。
如图10C所示，显示设备100可以确定出所有检测到圆环红外信号的红外接收器(例如红外接收器1、红外接收器2、红外接收器3、红外接收器4、红外接收器5和红外接收器6)对应的圆环(例如，圆环1、圆环2、圆环3、圆环4、圆环5和圆环6)没有重合区域。
如图10D所示，显示设备100可以从所有接收到圆环红外信号的接收点(例如，红外接收器1、红外接收器2、红外接收器3、红外接收器4、红外接收器5和红外接收器6)中，确定出接收信号强度大于第一信号强度(例如-30dBm)的A类接收点(例如，红外接收器2、红外接收器4)。显示设备100可以计算A类接收点(例如，红外接收器2、红外接收器4)对应圆环的重合区域，并将该A类接收点对应圆环的重合区域作为遥控设备200在显示屏上的指向位置。在一种可能的实现方式中，显示设备100可以将该重合区域的几何中心位置，作为遥控设备200在显示屏上的指向位置。
在一些应用场景中，显示设备100的上的多个红外接收器可以排列在显示屏四中的边框上。遥控设备200可以通过红外发射器和微透镜结构发出十字形图形的红外信号。显示设备100通过红外接收器边框接收到该十字形的红外信号时，可以通过确定出该十字形图形的交叉点，并将该交叉点作为遥控设备200在显示设备100的显示屏上的指向位置。这样，遥控设备200发射的红外信号可以不穿过显示屏，使得显示设备100接收到红外信号的信号强度更高，可以准确指向显示设备100的显示屏上用户想要操作的位置。
示例性的，如图11A所示，显示设备100可以通过显示屏四周的红外接收边框接收遥控设备200发射的十字形红外信号。该十字形红外信号在红外接收器阵列上的投影可以是十字形。其中，该红外信号的十字形投影可以在红外接收边框上覆盖有四个接收点。
如图11B所示，红外接收边框上有四个互不相邻的红外接收器接收到了红外信号，例如，红外接收器1、红外接收器2、红外接收器3、红外接收器4。显示设备100可以将这四个互补相邻的红外接收器所在的位置，分别作为红外信号的四个接收点。显示设备100可以这四个接收点两两连线(例如，接收点1和接收点3连线，接收点2和接收点4连线)，确定出位置在红外接收器边框之内的连线交点，并将该连线交点作为遥控设备200在显示设备100的显示屏上的指向位置。
在一些实施例中，如图12A所示，显示设备100可以通过显示屏四周的红外接收边框 接收遥控设备200发射的十字形红外信号。红外接收边框上有四个互不相邻的接收区域(例如，接收区域1、接收区域2、接收区域3和接收区域4)，接收到了红外信号。其中，每个接收区域中包括有一个或多个接收到红外信号的红外接收器。
如图12B所示，红外接收边框上有四个互不相邻的接收区域接收到了红外信号，例如，接收区域1、接收区域2、接收区域3和接收区域4。其中，该接收区域1中包括有红外接收器1和红外接收器2，该接收区域2中包括有红外接收器3和红外接收器4，该接收区域3中包括有红外接收器5和红外接收器6，该接收区域4中包括有红外接收器7和红外接收器8。显示设备100可以将每个接收区域的中心点作为接收点，可以这四个接收点两两连线，确定出位置在红外接收器边框之内的连线交点。显示设备100可以将该在红外接收器边框之内的连线交点作为遥控设备200在显示设备100的显示屏上的指向位置。
下面介绍本申请实施例中的提供的一种指向遥控方法。
图13示出了本申请实施例提供的一种指向遥控方法的流程示意图。其中，该指向遥控方法可应用于遥控系统。该遥控系统可以包括显示设备100和遥控设备200。该显示设备100可包括有耦合在显示屏内的红外接收器阵列或设置在显示屏四周的红外接收边框。如图13所示，该方法可包括：
S1301、遥控设备200发送的图形化红外信号。
示例性的，该图形化红外信号可以是圆形图形的红外信号、圆环形图形的红外信号、十字形图形的红外信号等等。具体可以，参考前述图3A至图3D所示实施例，在此不再赘述。本申请实施例中，图形化红外信号还可以是其他图形的红外信号，例如，方形环状图形、H形图形、X形图形(非90°交叉)等等。在一些实施例中，圆环形或方环形的红外信号中，每一环中的能量分布可以不同，例如，圆环形或方环形由内到外的红外信号能量递减，或者，圆环形或方环形由内到外的红外信号能量递增，等等。
S1302、显示设备100根据接收到图形化红外信号在显示屏上的投影图形，确定出在显示屏上遥控设备200的指向位置。
具体的，显示设备100可以根据检测到该投影图形的一个或多个红外接收器的位置信息，确定出显示屏上遥控设备200的指向位置。具体内容，可以参考上述图7A-图7C所示实施例，或图8A-图8C所示实施例，或图9A-图9C所示实施例，或图10A-图10D所示实施例，或图11A-图11B所示实施例，或图12A-图12B所示实施例，在此不再赘述。
S1303、显示设备100在显示屏上遥控设备200的指向位置显示提示标记。
其中，该提示标记可用于提示用户遥控设备200在显示设备100的显示屏上的指向位置。该提示标记可以是箭头、光圈等类型的标记。
示例性的，如图14A所示，显示设备100可以显示有主界面1410。该主界面1410包括有多个应用图标(例如，幻灯片应用图标、视频应用图标、音乐应用图标、应用商店应用图标、图库应用图标1411，等等)。该主界面1410还可以包括有任务栏1412。其中，该任务栏1412可以包括一个或多个应用的快捷方式(例如，语音助手应用的快捷方式、文档应用的快捷方式、表格应用的快捷方式等)、状态栏(包括音量调节图标、Wi-Fi信号图标、时间)等。在显示设备100确定出遥控设备200在显示屏上的指向位置后，显示设备100 可以在显示屏上显示出指示标记1413。该指示标记1413用于表示遥控设备200在显示屏上的指向位置。
在本申请的实施例中，上述步骤S1301至步骤S1303可以周期性执行。例如，上述步骤S1301至步骤S1303的执行周期可以为10ms。在一种可能的实现方式中，上述步骤S1301、S1302、S1303的执行周期可以不同。例如，上述步骤S1301的执行周期可以是26.3us，上述步骤S1302和步骤S1303的执行周期可以为10ms。
S1304、遥控设备200接收用户作用于第一按键的输入。
S1305、遥控设备200向显示设备发送第一按键对应的控制信息。
其中，遥控设备200可以包括有一个或多个按键，该一个或多个按键可以是物理按键。
如图14A所示，遥控设备200可以包括有电源键1401、确认键1402、返回键1403、主页键1404、菜单键1405、音量加键1406和音量减键1407。其中，上述按键为物理按键。
在一种可能的实现方式中，该一个或多个按键也可以是虚拟按键。例如，遥控设备200可以是手机等带有触控屏的智能终端。遥控设备200可以通过触控屏显示出一个或多个虚拟按键。
第一按键可以是上述一个或多个按键中的任意一个按键。遥控设备200在接收到用户作用于第一按键的输入(例如单击)后，可以从匹配出该第一按键对应的控制信息。遥控设备200可以通过图形化红外信号、蓝牙、WLAN直连等无线通信技术将第一按键对应的控制信息发送给显示设备100。
其中，当遥控设备200采用图形化红外信号发送第一按键对应的控制信息给显示设备100时，第一按键对应的控制信息可以为红外遥控码。遥控设备200可以先从红外遥控码库中确定出第一按键对应的红外遥控码。然后，遥控设备200可以根据第一按键对应的红外遥控码，调制出红外信号，并通红外发射器结合微透镜结构，发射图形化红外信号给显示设备100。
示例性的，红外遥控码库可以如下表2所示：
表2
按键 红外遥控码
电源键 0x01
确认键 0x02
返回键 0x03
主页键 0x04
菜单键 0x05
音量加键 0x06
音量减键 0x07
…… ……
由上述表2可以看出，电源键对应的红外遥控码为“0x01”。确认键对应的红外遥控码为“0x02”。返回键对应的红外遥控码为“0x03”。主页键对应的红外遥控码为“0x04”。菜 单键对应的红外遥控码为“0x05”。音量加键对应的红外遥控码为“0x06”。音量减键对应的红外遥控码为“0x07”。上述表2所示示例，仅仅用于解释本申请，不应构成限定。
S1306、显示设备100根据第一按键对应的控制信息和遥控设备200的指向位置，确定出第一控制操作。
S1307、显示设备100执行第一控制操作。
示例性的，上述第一控制操作可以是点选操作。如图14B所示，显示设备100在确定出遥控设备200指向图库应用图标1411上时，显示设备100可以在图库应用图标1411位置处显示指示标记1413。然后，在显示设备100接收到遥控设备200发送的确认键1402对应的控制信息后，显示设备100可以确定出第一控制操作为针对该图库应用图标1411的点选操作。
如图14C所示，响应于该针对该图库应用图标1411的点选操作，显示设备100可以显示出图库应用界面1420。该图库应用界面1420可以包括一张或多张图片的缩略图(例如，缩略图1421、缩略图1422、缩略图1423、缩略图1424、缩略图1425、缩略图1426)，和一个或多个相册(例如家人相册1431、风景相册1432、收藏相册1433)。其中，每个相册下方都显示有该相册包括的图片数量。例如，家人相册1431包括有2张图片，风景相册1432包括有4张图片，收藏相册包括有0张图片。
又示例性的，上述第一控制操作可以是框选操作。如图14D所示，用户可以长按确认键1402，调整遥控设备200的在显示设备100上的指向位置从初始位置1441，移动到缩略图1424的右下角位置。显示设备100长时间(例如大于1s)接收到遥控设备200发送的确认键1402对应的控制信息，并且指示标记1413所在位置(例如位置1441)没有选取对象时，显示设备100可以确定出第一控制操作为框选操作。显示设备100可以将该位置1411作为初始位置，将检测到用户松开确认键1402时指示标记1413所在位置作为终点位置，以该初始位置和终点位置作为矩形的对角定点，确定出矩形框1442。显示设备100可以将矩形框1442中包括的一个或多个选取对象(例如，图片缩略图1423和图片缩略图1424)组合成一个组合对象。
又示例性的，上述第一控制操作可以是拖拽操作。如图14E所示，显示设备100长时间(例如大于1s)接收到遥控设备200发送的确认键1402对应的控制信息，并且指示标记1413所在位置(例如位置1441)有组合对象框1443时，显示设备100可以确定第一控制操作为拖拽操作。在用户通过遥控设备200控制指示标记1413在显示设备100的显示屏上移动时，显示设备100可以控制该组合对象框1433中包括的一个或多个选取对象(例如，缩略图1423和缩略图1424)，跟随指示标记1413在显示屏上移动。
如图14F所示，显示设备100在检测到拖拽操作结束，该指示标记1413所处的位置位于收藏相册1433上时，显示设备100可以将上述组合对象框1443中的缩略图1423对应的图片和缩略图1424对应的图片，保存在该收藏相册1433对应的存储路径中。当用户操作遥控设备200，点选该收藏相册1433时，显示设备100可以显示出该图片1423和图片1424。
上述示例仅仅用于解释本申请，不应构成限定，具体实现中，第一控制操作不限于上述点选、框选、拖拽操作，还可以是其他等操作。
通过本申请实施例提供的一种指向遥控方法，显示设备100可以通过红外接收器阵列或红外接收器边框，接收到遥控设备200发送的图形化红外信号。显示设备100可以根据图形化红外信号在红外接收器阵列或红外接收器边框上的投影，确定出遥控设备200在显示设备100上的指向位置。这样，遥控设备200可以准确指向显示设备100的显示屏上用户想要操作的位置。另外，也方便了用户可以通过指向式遥控设备200远距离对显示设备100进行触控类的交互操作(例如，点选、框选、长按、拖拽等等)。
以上所述，以上实施例仅用以说明本申请的技术方案，而非对其限制；尽管参照前述实施例对本申请进行了详细的说明，本领域的普通技术人员应当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分技术特征进行等同替换；而这些修改或者替换，并不使相应技术方案的本质脱离本申请各实施例技术方案的范围。

Claims (42)

  1. 一种指向遥控系统，其特征在于，包括：遥控设备和显示设备；其中，
    所述遥控设备，用于向所述显示设备发送图形化红外信号；
    所述显示设备，用于通过多个红外接收器接收所述图形化红外信号；
    所述显示设备，还用于获取所述图形化红外信号在显示屏上的投影图形；
    所述显示设备，还用于根据所述投影图形，确定出所述遥控设备在所述显示屏上的指向位置；
    所述显示设备，还用于在所述显示屏的所述指向位置显示提示标记，所述提示标记用于提示用户所述遥控设备在所述显示屏上的指向位置。
  2. 根据权利要求1所述的系统，其特征在于，所述遥控设备，还用于：
    接收用户作用于第一按键的第一输入；
    响应于所述第一输入，发送所述第一按键对应的控制信息给所述显示设备；
    所述显示设备，还用于：
    根据所述第一按键对应的控制信息和所述指向位置，确定出第一控制操作；
    执行所述第一控制操作。
  3. 根据权利要求2所述的系统，其特征在于，所述遥控设备，具体用于：
    响应于所述第一输入，通过所述图形化红外信号发送所述第一按键对应的控制信息给所述显示设备。
  4. 根据权利要求2所述的系统，其特征在于，所述遥控设备，具体用于：
    响应于所述第一输入，通过蓝牙发送所述第一按键对应的控制信息给所述显示设备。
  5. 根据权利要求1所述的系统，其特征在于，所述多个红外接收器排列成红外接收器阵列，所述红外接收器阵列耦合在所述显示屏中。
  6. 根据权利要求1所述的系统，其特征在于，所述多个红外接收器排列在所述显示屏的四周，形成红外接收器边框。
  7. 根据权利要求5所述的系统，其特征在于，所述图形化红外信号包括圆形红外信号；所述投影图形包括圆形投影图形或椭圆形投影图形；
    所述显示设备，具体用于：
    根据接收到所述图形化红外信号在显示屏上的所述圆形投影图形或所述椭圆形投影图形，确定所述圆形投影图形或所述椭圆形投影图形的中心位置为所述指向位置。
  8. 根据权利要求5所述的系统，其特征在于，所述图形化红外信号包括圆环形红外信 号；所述投影图形包括圆环形投影图形或椭圆环形投影图形，其中，所述圆环红外信号中不同环内的能量不同；
    所述显示设备，具体用于：
    获取所述圆环形投影图形或所述椭圆环投影图形在所述红外接收阵列上覆盖的M个接收点所在的位置，M为正整数；
    以所述接收点所在的位置为圆心，所述接收点接收到所述圆环形红外信号的信号强度对应的外环半径和内环半径，确定出所述接收点对应的圆环；
    根据所述M个接收点各自对应的圆环，确定出M个圆环的重合区域，并将所述重合区域的中心位置确定为所述指向位置。
  9. 根据权利要求6所述的系统，其特征在于，所述图形化红外信号包括十字形红外信号；所述投影图形包括十字形图形；
    所述显示设备，具体用于：
    获取所述红外接收边框上接收到所述十字形红外信号的四个接收点所在的位置；
    通过所述四个接收点所在的位置，确定出所述图形化红外信号在所述显示屏上的所述十字形图形；
    计算所述十字形图形中交叉点的位置，并将所述交叉点的位置确定为所述指向位置。
  10. 根据权利要求2所述的系统，其特征在于，所述第一控制操作包括以下任一种：点选操作、长按操作、框选操作、拖拽操作。
  11. 根据权利要求1所述的系统，其特征在于，所述显示设备包括以下设备类型中的任一种：显示器、电视机和平板电脑；所述遥控设备包括以下设备类型中的任一种：遥控器、鼠标、智能手机。
  12. 一种显示设备，其特征在于，包括：处理器、显示屏和多个红外接收器；其中，
    所述多个红外接收器，用于接收遥控设备发送的图形化红外信号；
    所述处理器，用于获取所述图形化红外信号在所述显示屏上的投影图形；
    所述处理器，还用于根据所述投影图形，确定出所述遥控设备在所述显示屏上的指向位置；
    所述显示屏，还用于在所述显示屏的所述指向位置显示提示标记，所述提示标记用于提示用户所述遥控设备在所述显示屏上的指向位置。
  13. 根据权利要求12所述的显示设备，其特征在于，所述显示设备还包括：无线通信模块；
    所述无线通信模块，用于接收所述遥控设备发送的第一按键对应的控制信息；
    所述处理器，还用于根据所述第一按键对应的控制信息和所述指向位置，确定出第一控制操作；
    所述处理器，还用于执行所述第一控制操作。
  14. 根据权利要求13所述的显示设备，其特征在于，所述无线通信模块，具体用于：
    接收所述遥控设备通过所述图形化红外信号发送的所述第一按键对应的控制信息。
  15. 根据权利要求13所述的显示设备，其特征在于，所述无线通信模块，具体用于：
    接收所述遥控设备通过蓝牙发送的所述第一按键对应的控制信息。
  16. 根据权利要求12所述的显示设备，其特征在于，所述多个红外接收器排列成红外接收器阵列，所述红外接收器阵列耦合在所述显示屏中。
  17. 根据权利要求12所述的显示设备，其特征在于，所述多个红外接收器排列在所述显示屏的四周，形成红外接收器边框。
  18. 根据权利要求16所述的显示设备，其特征在于，所述图形化红外信号包括圆形红外信号；所述投影图形包括图形投影或椭圆形投影图形；
    所述处理器，具体用于：
    根据接收到所述圆形红外信号在所述显示屏上的所述圆形投影图形或所述椭圆形投影图形，确定所述圆形投影图形或所述椭圆形投影图形的中心位置为所述指向位置。
  19. 根据权利要求16所述的显示设备，其特征在于，所述图形化红外信号包括圆环形红外信号；所述投影图形包括圆环形投影图形或椭圆环形投影图形，其中，所述圆环红外信号中不同环内的能量不同；
    所述处理器，具体用于：
    获取所述圆环形图形或所述椭圆环投影图形在所述红外接收阵列上覆盖的M个接收点所在的位置，M为正整数；
    以所述接收点所在的位置为圆形，所述接收点接收到所述圆环形红外信号的信号强度对应的外环半径和内环半径，确定出所述接收点对应的圆环；
    根据所述M个接收点各自对应的圆环，确定出M个圆环的重合区域，并将所述重合区域的中心位置确定为所述指向位置。
  20. 根据权利要求17所述的显示设备，其特征在于，所述图形化红外信号包括十字形红外信号；所述投影图形包括十字形图形；
    所述处理器，具体用于：
    获取所述红外接收边框上接收到所述十字形红外信号的四个接收点所在的位置；
    通过所述四个接收点所在的位置，确定出所述图形化红外信号在所述显示屏上的所述十字形图形；
    计算所述十字形图形中交叉点的位置，并将所述交叉点的位置确定为所述指向位置。
  21. 根据权利要求13所述的显示设备，其特征在于，所述第一控制操作包括以下任一种：点选操作、长按操作、框选操作、拖拽操作。
  22. 根据权利要求12所述的显示设备，其特征在于，所述显示设备包括以下设备类型中的任一种：显示器、电视机和平板电脑；所述遥控设备包括以下设备类型中的任一种：遥控器、鼠标、智能手机。
  23. 一种指向遥控方法，其特征在于，包括：
    显示设备通过多个红外接收器接收遥控设备发送的图形化红外信号；
    所述显示设备获取所述图形化红外信号在显示屏上的投影图形；
    所述显示设备根据所述投影图形，确定出所述遥控设备在所述显示屏上的指向位置；
    所述显示设备在所述显示屏的所述指向位置显示提示标记，所述提示标记用于提示用户所述遥控设备在所述显示屏上的指向位置。
  24. 根据权利要求23所述的方法，其特征在于，所述方法还包括：
    所述显示设备接收所述遥控设备发送的第一按键对应的控制信息；
    所述显示设备根据所述第一按键对应的控制信息和所述指向位置，确定出第一控制操作；
    所述显示设备执行所述第一控制操作。
  25. 根据权利要求24所述的方法，其特征在于，所述显示设备接收所述遥控设备发送的第一按键对应的控制信息，具体包括：
    所述显示设备接收所述遥控设备通过所述图形化红外信号发送的所述第一按键对应的控制信息。
  26. 根据权利要求24所述的方法，其特征在于，所述显示设备接收所述遥控设备发送的第一按键对应的控制信息，具体包括：
    所述显示设备接收所述遥控设备通过蓝牙发送的所述第一按键对应的控制信息。
  27. 根据权利要求23所述的方法，其特征在于，所述多个红外接收器排列成红外接收器阵列，所述红外接收器阵列耦合在所述显示屏中。
  28. 根据权利要求23所述的方法，其特征在于，所述多个红外接收器排列在所述显示屏的四周，形成红外接收器边框。
  29. 根据权利要求27所述的方法，其特征在于，所述图形化红外信号包括圆形红外信号；所述投影图形包括图形投影或椭圆形投影图形；
    所述显示设备根据所述投影图形，确定出所述遥控设备在所述显示屏上的指向位置，具体包括：
    所述显示设备根据接收到所述圆形红外信号在所述显示屏上的所述圆形投影图形或所述椭圆形投影图形，确定所述圆形投影图形或所述椭圆形投影图形的中心位置为所述指向位置。
  30. 根据权利要求27所述的显示设备，其特征在于，所述图形化红外信号包括圆环形红外信号；所述投影图形包括圆环形投影图形或椭圆环形投影图形，其中，所述圆环红外信号中不同环内的能量不同；
    所述显示设备根据所述投影图形，确定出所述遥控设备在所述显示屏上的指向位置，具体包括：
    所述显示设备获取所述圆环形投影图形或所述椭圆环投影图形在所述红外接收阵列上覆盖的M个接收点所在的位置，M为正整数；
    所述显示设备以所述接收点所在的位置为圆心，所述接收点接收到所述圆环形红外信号的信号强度对应的外环半径和内环半径，确定出所述接收点对应的圆环；
    所述显示设备根据所述M个接收点各自对应的圆环，确定出M个圆环的重合区域，并将所述重合区域的中心位置确定为所述指向位置。
  31. 根据权利要求28所述的方法，其特征在于，所述图形化红外信号包括十字形红外信号；所述投影图形包括十字形图形；
    所述显示设备获取所述图形化红外信号在显示屏上的投影图形，具体包括：
    所述显示设备获取所述红外接收边框上接收到所述十字形红外信号的四个接收点所在的位置；
    所述显示设备通过所述四个接收点所在的位置，确定出所述图形化红外信号在所述显示屏上的所述十字形图形；
    所述显示设备根据所述投影图形，确定出所述遥控设备在所述显示屏上的指向位置，具体包括：
    计算所述十字形图形中交叉点的位置，并将所述交叉点的位置确定为所述指向位置。
  32. 根据权利要求24所述的方法，其特征在于，所述第一控制操作包括以下任一种：点选操作、长按操作、框选操作、拖拽操作。
  33. 根据权利要求23所述的方法，其特征在于，所述显示设备包括以下设备类型中的任一种：显示器、电视机和平板电脑；所述遥控设备包括以下设备类型中的任一种：遥控器、鼠标、智能手机。
  34. 一种芯片系统，应用于显示设备，其特征在于，所述芯片系统包括：处理器；所述显示设备包括多个红外接收器和显示屏；其中，所述处理器用于：
    获取所述多个红外接收器接收到遥控设备发送的图形化红外信号在所述显示屏上的投影图形；
    根据所述投影图形，确定出所述遥控设备在所述显示屏上的指向位置；
    指示所述显示屏在所述指向位置显示提示标记，所述提示标记用于提示用户所述遥控设备在所述显示屏上的指向位置。
  35. 根据权利要求34所述的芯片系统，其特征在于，所述芯片系统还包括无线通信模块；所述无线通信模块，用于接收所述遥控设备发送的第一按键对应的控制信息；
    所述处理器，还用于根据所述第一按键对应的控制信息和所述指向位置，确定出第一控制操作；
    所述处理器，还用于执行所述第一控制操作。
  36. 根据权利要求35所述的芯片系统，其特征在于，所述无线通信模块，具体用于：接收所述遥控设备通过所述图形化红外信号发送的所述第一按键对应的控制信息。
  37. 根据权利要求35所述的芯片系统，其特征在于，所述无线通信模块，具体用于：
    接收所述遥控设备通过蓝牙发送的所述第一按键对应的控制信息。
  38. 根据权利要求34所述的芯片系统，其特征在于，所述图形化红外信号包括圆形红外信号；所述投影图形包括图形投影或椭圆形投影图形；所述多个红外接收器排列成红外接收器阵列，所述红外接收器阵列耦合在所述显示屏中；
    所述处理器，具体用于：
    根据接收到所述圆形红外信号在所述显示屏上的所述圆形投影图形或所述椭圆形投影图形，确定所述圆形投影图形或所述椭圆形投影图形的中心位置为所述指向位置。
  39. 根据权利要求34所述的芯片系统，其特征在于，所述图形化红外信号包括圆环形红外信号；所述投影图形包括圆环形投影图形或椭圆环形投影图形，其中，所述圆环红外信号中不同环内的能量不同；所述多个红外接收器排列成红外接收器阵列，所述红外接收器阵列耦合在所述显示屏中；
    所述处理器，具体用于：
    获取所述圆环形投影图形或所述椭圆环投影图形在所述红外接收阵列上覆盖的M个接收点所在的位置，M为正整数；
    以所述接收点所在的位置为圆心，所述接收点接收到所述圆环形红外信号的信号强度对应的外环半径和内环半径，确定出所述接收点对应的圆环；
    根据所述M个接收点各自对应的圆环，确定出M个圆环的重合区域，并将所述重合区域的中心位置确定为所述指向位置。
  40. 根据权利要求34所述的芯片系统，其特征在于，所述图形化红外信号包括十字形 红外信号；所述投影图形包括十字形图形；所述多个红外接收器排列在所述显示屏的四周，形成红外接收器边框；
    所述处理器，具体用于：
    获取所述红外接收边框上接收到所述十字形红外信号的四个接收点所在的位置；
    通过所述四个接收点所在的位置，确定出所述图形化红外信号在所述显示屏上的所述十字形图形；
    计算所述十字形图形中交叉点的位置，并将所述交叉点的位置确定为所述指向位置。
  41. 根据权利要求34所述的芯片系统，其特征在于，所述第一控制操作包括以下任一种：点选操作、长按操作、框选操作、拖拽操作。
  42. 一种计算机可读存储介质，包括指令，其特征在于，当所述指令在显示设备上运行时，使得所述显示设备执行如权利要求23至24中任一项所述的方法。
PCT/CN2021/089439 2020-04-30 2021-04-23 一种指向遥控方法及系统 WO2021218830A1 (zh)

Priority Applications (4)

Application Number Priority Date Filing Date Title
KR1020227041233A KR20230003044A (ko) 2020-04-30 2021-04-23 포인팅 원격 제어 방법 및 시스템
US17/997,440 US20230232060A1 (en) 2020-04-30 2021-04-23 Pointing Remote Control Method and System
JP2022566030A JP7479508B2 (ja) 2020-04-30 2021-04-23 ポインティングリモート制御方法及びシステム
EP21796220.8A EP4131978A4 (en) 2020-04-30 2021-04-23 POINTING REMOTE CONTROL METHOD AND SYSTEM

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010365011.5 2020-04-30
CN202010365011.5A CN113596535B (zh) 2020-04-30 2020-04-30 一种指向遥控方法及系统

Publications (1)

Publication Number Publication Date
WO2021218830A1 true WO2021218830A1 (zh) 2021-11-04

Family

ID=78237398

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/089439 WO2021218830A1 (zh) 2020-04-30 2021-04-23 一种指向遥控方法及系统

Country Status (6)

Country Link
US (1) US20230232060A1 (zh)
EP (1) EP4131978A4 (zh)
JP (1) JP7479508B2 (zh)
KR (1) KR20230003044A (zh)
CN (1) CN113596535B (zh)
WO (1) WO2021218830A1 (zh)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010045730A (ja) * 2008-08-18 2010-02-25 Sony Corp 情報処理装置、情報処理方法、遠隔制御装置及び情報処理システム
CN101800866A (zh) * 2009-12-18 2010-08-11 康佳集团股份有限公司 一种在电视机显示屏上实现定位交互的方法及其系统
CN103702151A (zh) * 2013-11-25 2014-04-02 何文林 智能电视和触控屏人机交互遥控装置与方法
CN104010208A (zh) * 2014-04-23 2014-08-27 深圳创维－Rgb电子有限公司 一种具有红外定位功能的液晶电视及其红外定位方法
CN104768042A (zh) * 2014-01-07 2015-07-08 北京三星通信技术研究有限公司 显示屏以及遥控控制装置和方法

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030180692A1 (en) 2002-03-22 2003-09-25 Skala James A. Continuous aimpoint tracking system
GB0327251D0 (en) * 2003-11-22 2003-12-24 Jones Steven L Pointer position detection
WO2007063448A2 (en) * 2005-11-30 2007-06-07 Koninklijke Philips Electronics N. V. Position detection of an electromagnetic beam projection
JP2011523138A (ja) * 2008-06-04 2011-08-04 ヒューレット−パッカード デベロップメント カンパニー エル．ピー． コンピュータを遠隔制御するためのシステム及び方法
KR20150004156A (ko) * 2013-07-02 2015-01-12 삼성전자주식회사 디스플레이 장치 및 그 방법
KR20150066132A (ko) * 2013-12-06 2015-06-16 삼성전자주식회사 디스플레이 장치, 리모컨, 디스플레이 시스템, 및 디스플레이 방법
CN203661233U (zh) * 2014-01-07 2014-06-18 北京三星通信技术研究有限公司 遥控器和显示屏
JP6457989B2 (ja) 2016-10-12 2019-01-23 株式会社カプコン ゲームプログラム及びゲーム装置
CN109147304A (zh) * 2017-06-15 2019-01-04 中兴通讯股份有限公司 一种设备遥控方法以及遥控装置

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010045730A (ja) * 2008-08-18 2010-02-25 Sony Corp 情報処理装置、情報処理方法、遠隔制御装置及び情報処理システム
CN101800866A (zh) * 2009-12-18 2010-08-11 康佳集团股份有限公司 一种在电视机显示屏上实现定位交互的方法及其系统
CN103702151A (zh) * 2013-11-25 2014-04-02 何文林 智能电视和触控屏人机交互遥控装置与方法
CN104768042A (zh) * 2014-01-07 2015-07-08 北京三星通信技术研究有限公司 显示屏以及遥控控制装置和方法
CN104010208A (zh) * 2014-04-23 2014-08-27 深圳创维－Rgb电子有限公司 一种具有红外定位功能的液晶电视及其红外定位方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4131978A4

Also Published As

Publication number Publication date
CN113596535B (zh) 2022-10-18
US20230232060A1 (en) 2023-07-20
CN113596535A (zh) 2021-11-02
EP4131978A4 (en) 2023-08-30
JP7479508B2 (ja) 2024-05-08
KR20230003044A (ko) 2023-01-05
JP2023523774A (ja) 2023-06-07
EP4131978A1 (en) 2023-02-08

Similar Documents

Publication Publication Date Title
WO2022052772A1 (zh) 多窗口投屏场景下的应用界面显示方法及电子设备
US20220269387A1 (en) Interface generation method and device
US10372397B2 (en) Multimedia output and display device selection
US20180375987A1 (en) Method, apparatus and mobile terminal for device control based on a mobile terminal
US9035971B2 (en) Image display apparatus, image display method, and of image display program
US9210376B2 (en) Multimedia output and display device selection
US10798351B2 (en) Apparatus, method and system for location based touch
WO2020248924A1 (zh) 显示设备及扫描外部蓝牙设备的方法
CN112073955B (zh) 显示设备及蓝牙设备扫描方法
US20190064953A1 (en) Ultrafine led display that includes sensor elements
TWI796039B (zh) 互動投影輸入輸出設備
WO2023142755A1 (zh) 设备控制方法、装置、用户设备和计算机可读存储介质
US20220228869A1 (en) Method and apparatus for generating semantic map, and readable storage medium
CN100504576C (zh) 光标与光学投影同步操作的装置、方法
WO2021218830A1 (zh) 一种指向遥控方法及系统
WO2021052488A1 (zh) 一种信息处理方法及电子设备
CN112073954A (zh) 显示设备及扫描外部蓝牙设备的方法
WO2022068592A1 (zh) 一种显示方法及电子设备
TWI465828B (zh) 無線互動式投影方法以及系統
JP2020500349A (ja) 電子装置及びその制御方法
EP4242995A1 (en) Remote controller and system for controlling display device
CN114327058B (zh) 显示设备
WO2022166395A1 (zh) 一种屏幕组合方法和装置
US20240333996A1 (en) Devices for Media Handoff
US20210211525A1 (en) Multi-dimensional media data transmission method and apparatus, electronic device, and storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21796220

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2022566030

Country of ref document: JP

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 2021796220

Country of ref document: EP

Effective date: 20221103

ENP Entry into the national phase

Ref document number: 20227041233

Country of ref document: KR

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE