WO2018195827A1

WO2018195827A1 - Interactive remote control, interactive display system and interactive touch-control method

Info

Publication number: WO2018195827A1
Application number: PCT/CN2017/082052
Authority: WO
Inventors: 那庆林; 黄彦; 麦浩晃
Original assignee: 神画科技（深圳）有限公司
Priority date: 2017-04-26
Filing date: 2017-04-26
Publication date: 2018-11-01

Abstract

An interactive remote control, an interactive display system and an interactive touch-control method. An interactive remote control (10) is provided with two monitoring modules (1001, 1002) capable of generating position information about three-dimensional coordinates when a target object (600) enters a pre-set effective active space (500) thereof, and the position information and touch-control information are subjected to signal processing and the processing of a communication unit (400) and are then output as an interactive remote control signal. A display unit (20) can receive the position information and/or touch-control action information from the interactive remote control (10), and complete a corresponding operation, and/or carry out corresponding display on a display picture according to the aforementioned interactive remote control signal. A user can execute an interactive operation based on the position pattern and the touch-control action pattern, and when executing an operation, only needs to look at a display image and does not need to look at the interactive remote control (10).

Description

Title of Invention: An Interactive Remote Control, Interactive Display System, and Interactive Touch Method

[0001] The present invention relates to an intelligent interactive control system and method, and more particularly to an interactive remote controller, an interactive display system, and an interactive touch method for realizing single-point and multi-touch large-screen distances.

Background technique

[0002] In the Chinese utility model patent with the patent number 2007200763408.8, an infrared camera positioning detection touch screen system is disclosed, which is composed of an image acquisition module, a control circuit board and a computer, wherein the image acquisition module is separately installed The two screens on the same side of the screen frame are two infrared cameras, infrared emitters placed on both sides of the infrared camera, and reflective strips attached to the other three sides of the screen frame. According to the retroreflective characteristics of light, the reflective strip is used to make the light emitted by the infrared emitting tube return to the original path, and the infrared light intensity map returned by the infrared camera. If a touch occurs, the infrared light intensity returned by the touch area is weakened, and the occluded infrared image is subtracted from the unoccluded infrared image by the untouched and touched light intensity distribution image, and the absolute value of the light intensity change is obtained. The largest position gives you the occluded coordinates, and the two cameras get the two coordinates of the touch point to determine the position of the touch point. The essence of this patent is a touch screen using optical positioning. Compared with the existing capacitive touch screen, the advantage is that the cost of the large-sized touch screen can be reduced, and the cost is smaller than that of the capacitive touch screen in a small size.

[0003] A very significant breakthrough in consumer electronics products in recent years is the emergence of touch screens. This technology has changed the PC generation features marked by the mouse and keyboard, pushing the easy and fast interactive means of using the finger as the operating medium to the extreme. As a result, the global IT industry has entered the mobile Internet era, and many web applications, including games, are gradually adopting touch screens as the main user interface.

[0004] However, the touch screen technology represented by mobile phones and tablets also has its inherent disadvantages, that is, the display screen is too small. Many sophisticated applications, such as games, spend a lot of manpower, material resources and financial resources to create beautiful pictures, like Hollywood blockbusters, but the entertainment on the mobile phone is greatly reduced. Although the display vector based on large-screen TV and projection has made great progress in recent years, its far-distance distance (not within the range of human arm) can not make people adopt touch screen technology, throwing out the cost of large-screen touch screen. Problem, can't imagine letting consumers Use the touch method to play the game by hand in front of a screen of 60 inches or more.

[0005] Currently, the push screen technology from mobile phones to televisions has progressed, but its operation mode is to operate on mobile phones, and the screened objects such as televisions are merely displays. This creates a painful experience of playing games and constantly switching from mobile screen to TV screen. At present, the realization of massive touch screen games and smooth application experience on large-screen TVs seems to be an impossible dream.

[0006] Some remote methods of operating a projection display are limited to single touch, and many games and applications that require multi-touch are still not available on the platform.

[0007] In addition, in the Chinese invention patent application No. 201610639127.7, an interactive remote controller, an interactive display system, and an interactive touch method are disclosed, wherein the interactive remote controller can enter the target object through the position calibration unit. The preset activity space generates corresponding position information, and the touch panel unit performs effective contact with the target object to generate corresponding touch action information; the display unit can receive the position information and/or touch from the interactive remote controller. The motion information is displayed as a corresponding position pattern and a touch motion pattern at corresponding positions on the display screen. There is only one single monitoring module, that is, only one monitoring lens (113) and imaging chip (114). The disadvantage is that the spatial three-dimensional coordinates of the target object cannot be accurately obtained, which is liable to cause positional deviation, which leads to the inaccuracy of the interactive remote control function.

technical problem

Problem solution

Technical solution

Based on the above drawbacks of the prior art, the present invention provides an improved interactive remote control, interactive display system, and interactive touch method.

[0009] First, the present invention provides an interactive remote controller including a monitoring unit, an infrared light unit, a touch unit, a signal processing and a communication unit;

[0010] The infrared light unit includes an infrared light source for emitting infrared light and forming an infrared light signal layer having a predetermined thickness over the touch surface of the touch unit;

[0011] the monitoring unit includes at least two monitoring modules, each of the monitoring modules includes a monitoring lens and an imaging chip; between an optical axis of each of the monitoring lenses and a touch surface of the touch unit Non-parallel, and the monitoring lens has an overlapping monitoring area for the infrared light signal layer above the touch surface, and an effective active space for monitoring the target object is located in the overlapping monitoring area; [0012] the monitoring module collects an infrared image of the target object into the effective active space, and generates position information of the target object; the touch unit is at the target object and the touch surface The effective contact 吋 generates touch information of the target object;

[0013] The position information and the touch information of the target object are processed by the signal processing and communication unit and output as an interactive remote control signal.

[0014] In the interactive remote controller of the present invention, the monitoring unit and the infrared light monitoring layer are located on the same side of the touch unit; or the touch surface of the touch unit is an infrared light permeable material. The monitoring unit and the infrared light monitoring layer are respectively located on two sides of the touch unit.

[0015] In the interactive remote controller of the present invention, an optical axis of each of the monitoring lenses intersects with a touch surface of the touch unit and forms an angle. Preferably, the included angle is greater than 10 degrees.

[0016] The present invention also provides an interactive display system including a display unit and the aforementioned interactive remote controller; [0017] the display unit is in communication with a signal processing and communication unit in the interactive remote controller to receive the interaction Remotely controlling the signal, and performing corresponding operations according to the interactive remote control signal, and/or performing corresponding display on the display screen of the display unit.

[0018] In the interactive display system of the present invention, the display unit includes a receiving unit communicably connected to the signal processing and communication unit, and the receiving unit includes a 2.4G communication module matched with the signal processing and communication unit. At least one of a Bluetooth communication module and a WIFI communication module.

[0019] In the interactive display system of the present invention, the touch unit and the signal processing and communication unit are formed on a smart device with a touch screen and a communication module.

[0020] The present invention also provides an interactive touch method, wherein, based on the foregoing interactive display system, the following steps are performed for interactive touch:

[0021] Sl, preset the effective activity space in the overlapping monitoring area;

[0022] S2. Presetting a correspondence between any spatial position point in the effective active space and a display position on a display screen of the display unit, wherein the spatial position having the same X, Y coordinate and different Z coordinate The display position on the display unit is the same;

[0023] S3. When the target object enters the effective active space, the monitoring unit identifies three-dimensional coordinate information (Χ, Υ, Ζ) of the target object as the location information, when the target object and The touch surface is in contact with the touch surface, and the touch unit generates touch information of the target object; [0024] S4. The display unit receives an interactive remote control signal composed of the location information and touch information, and performs corresponding operations according to the interactive remote control signal, and/or on a display screen of the display unit. The corresponding display.

[0025] In the step S1 of the interactive touch method of the present invention, four points having different spatial positions are selected in the infrared light signal layer, and any two adjacent points of the four points are connected and formed separately A portion perpendicular to the four planes of the touch surface of the touch unit, and the space formed by the four vertical planes is located within the overlapping monitoring area of the monitoring module, that is, the effective active space.

[0026] In the step S3 of the interactive touch method of the present invention, when the target object performs a vertical downward pressing action in the effective active space, sequence action coordinates (X, Y, Ζ3) are generated, (Χ, Υ, Ζ 2), (Χ, Υ, Ζ1), where (Χ, Υ, Ζ1) is the three-dimensional spatial position that is about to be in contact with the touch surface, when the target object and the touch After the control surface is effectively contacted, the plane coordinates of the touch point are assigned (Χ, Υ).

Advantageous effects of the invention

Beneficial effect

[0027] It can be seen that, in the present invention, the interactive remote controller can generate corresponding position information by the monitoring unit after the target object enters its preset effective active space, and correspondingly generates an effective contact with the target object through the touch unit. The touch unit can receive the position information and the touch information from the interactive remote controller, and complete corresponding operations, and/or perform corresponding display on the display screen of the display unit. The invention allows the user to perform an interactive operation based on the position pattern and the touch action pattern, and the operation only needs to look at the display screen without looking at the interactive remote controller, so that the game or other interactive operation can be easily performed. More importantly, at least two monitoring modules are provided in the present invention, and the spatial three-dimensional coordinates of the target object can be accurately obtained without positional deviation, so that a more accurate interactive remote control function can be realized. Brief description of the drawing

DRAWINGS

[0028] The present invention will be further described below in conjunction with the accompanying drawings and embodiments, in which:

1 is a schematic diagram of an interactive remote control system in accordance with an embodiment of the present invention;

2 is a schematic view of the interactive remote control system shown in FIG. 1 from another perspective; [0030] FIG.

3 is a schematic diagram of an interactive remote control system in another embodiment of the present invention; 4 is a schematic diagram of an interactive remote control system in another embodiment of the present invention;

[0033] FIG. 5 is a schematic diagram of an interactive display system implemented by a smart device in another embodiment of the present invention;

6 is a schematic diagram showing a correspondence relationship between a remote control position and a display position in an embodiment of the present invention;

7 is a schematic diagram of coordinates of a vertical press down in an embodiment of the present invention.

BEST MODE FOR CARRYING OUT THE INVENTION

[0036] In order to more clearly understand the technical features, objects and advantages of the present invention, embodiments of the present invention are described in detail with reference to the accompanying drawings.

An embodiment of the present invention includes the monitoring unit 100, the infrared light unit 200, the touch unit 300, and the signal processing and communication unit 400.

As can be seen from the figure, the infrared light unit 200 includes an infrared light source 201 for emitting infrared light and forming an infrared light signal layer 202 having a predetermined thickness over the touch surface of the touch unit 300.

[0039] The monitoring unit 100 includes two monitoring modules 1001, 1002, each of which includes a monitoring lens 1011, 1012 and imaging chips 1021, 1022; an optical axis of each monitoring lens and a touch surface of the touch unit 300 The two are non-parallel, in this embodiment, perpendicular to the touch surface, and the two monitoring lenses 1011, 1012 have overlapping monitoring areas for the infrared light signal layer 202 above the touch surface (ie, the shaded portion of the triangular dotted line in the figure) The lower active area 500 in which the target object 600 can be monitored is located in the overlapping monitoring area. Specifically, three or more monitoring modules may be provided, but two monitoring modules are more preferable examples.

[0040] In this embodiment, the monitoring unit 100 and the infrared light monitoring layer 202 are located on the same side of the touch unit 300.

[0041] In one embodiment, the infrared light source 201 may be a surface light source formed by an infrared laser light source, and/or an infrared LE

D light source array; infrared light monitoring layer 202 has a thickness of at least 5 mm. A filter with infrared light transmission and visible light filtering function can be installed in front of the monitoring lens or in front of the imaging chip.

[0042] The touch unit 300 can be a touch panel and its supporting electronic system, or a capacitive touch screen and its supporting electronic system, or a resistive touch screen and its supporting electronic system.

[0043] The signal processing and communication unit 400 may include at least one of a 2.4G communication module, a Bluetooth communication module, and a WIFI communication module.

[0044] As shown in FIG. 1 and FIG. 2, two monitoring modules 1001 and 1002 can collect the target object 600 and enter an effective activity. The infrared image of the space 500 , generates the position information of the target object 600; and the touch unit 300 generates the touch information of the target object 600 after the target object 600 is in effective contact with the touch surface.

[0045] The position information and the touch information of the target object 600 can be processed by the signal processing and communication unit 400 and output as an interactive remote control signal.

The display unit 20 is communicatively coupled to the signal processing and communication unit 400 to receive the aforementioned interactive remote control signal, and to perform corresponding operations according to the interactive remote control signal, and/or to perform corresponding display on the display screen of the display unit 20.

[0047] wherein, the display screen can respectively display a position pattern corresponding to the position information and a touch action pattern corresponding to the touch information, and the two can be different patterns, so as to distinguish the screen before and after the touch action is generated; , can also be the same pattern, but differentiated by different colors or other means.

[0048] In this embodiment, the display unit 20 includes a receiving unit communicatively coupled to the signal processing and communication unit 400, and the receiving unit includes a 2.4G communication module, a Bluetooth communication module, and a WIFI communication module that are matched with the signal processing and communication unit 400. At least one of them.

[0049] In particular, the touch unit 300 and the signal processing and communication unit 400 can be formed on a smart device with a touch screen and a communication module, for example, a corresponding application is installed on a product such as a smart phone or a tablet computer. achieve.

[0050]

3 is a schematic diagram of an interactive remote control system according to another embodiment of the present invention. The difference from the embodiment shown in FIG. 1 is that the two monitoring modules 1001 and 1002 are not arranged side by side, and are not between the touch surface and the touch surface. Vertical relationship, but an angle greater than 10 degrees and less than 90 degrees.

[0052]

4 is a schematic diagram of an interactive remote control system according to another embodiment of the present invention. The difference between the monitoring unit 100 and the infrared light monitoring layer 202 is located on both sides of the touch unit 300. Therefore, the touch surface of the touch unit 300 is made of a material that can transmit infrared light.

[0054] Based on the interactive display system shown in FIG. 1 for interactive touch, first, it is necessary to preset an effective active space 500 in the overlapping monitoring area, that is, a lower portion of the shaded portion of the triangular dotted line in the figure. As shown in FIG. 5, four points with different spatial positions are selected in the infrared light signal layer 202, and any two adjacent points of the four points are connected and respectively form four planes perpendicular to the touch surface, four vertical planes. The space formed by the encirclement is located in two prisons The portion of the control modules 1001, 1002 within the overlapping monitoring area is the active active space 500.

[0055] Then, it is required to preset a correspondence relationship between any spatial position point in the effective active space 500 and a display position on the display screen of the display unit 20, wherein the spatial position points having the same X, Y coordinates and different Z coordinates The display position on the display unit is the same. As shown in FIG. 6, in FIG. 6, A, B, C, and D are the four top positions of the active area 500, corresponding to the four corner points of the display screen; likewise, Al, Bl, Cl, D1 is A, B, C, and D respectively. The four position points (corner points) at the bottom of the effective active area 500 are also respectively corresponding to the four corner points of the display screen; P point is the target object 600 entering the effective activity. The position point of the area corresponds to the point P' of the display screen, and the plane coordinates of the point P and point P are both (X, Y).

[0056] When the target object 600 enters the effective active space 500吋, the monitoring unit 100 recognizes the three-dimensional coordinate information (x, Υ, ζ) of the target object 600 as position information, and uses two monitoring lenses similar to the two eyes of the person.

The object seen by one eye has only shape but no sense of distance. If the two eyes see the object, there will be a sense of distance. Therefore, two or more supervised lenses are used to obtain more accurate three-dimensional coordinate information. When the target object 600 is in effective contact with the touch surface, the touch unit 300 generates touch information of the target object 600.

[0057] The display unit 20 receives the interactive remote control signal composed of the position information and the touch information, and performs corresponding operations according to the interactive remote control signal, and/or performs corresponding display on the display screen of the display unit 20.

[0058] As shown in FIG. 7, when the target object 600 is vertically pressed in the effective active space 500, sequence motion coordinates (Χ, Υ, Ζ3), (Χ, Υ, Ζ 2) are generated, (Χ, Υ, Ζ1), where (Χ, Υ, Ζ1) is the three-dimensional position where the touch surface is not yet in contact with the touch surface. When the target object is in effective contact with the touch surface, the plane coordinates of the touch point are assigned. For (Χ, Υ). That is to say, the finger (target object 600) enters the effective active area 500吋, and the point captured by the monitoring lens is the fingertip position. With the vertical pressing action of the finger, the X and Υ coordinate values of the fingertip are unchanged, and the coordinate value is Decrease with the pressing; the coordinates of the point where the fingertip vertically corresponds to the surface of the touch screen 300 are also (Χ, Υ), and when the finger touches the touch screen 300吋, the actual touch point of the touch screen is not At the fingertip, the finger on the right side of the figure touches the center of the area covered by the finger surface of the touch screen. The coordinates of this point are (XI, Y1). Therefore, the assignment of (XI, Y1) needs to be performed. , so that the coordinate value of the point becomes (Χ, Υ) as the report point coordinate.

[0059] It can be seen that at least two monitoring modules are provided in the present invention, and the spatial three-dimensional coordinates of the target object can be accurately obtained, and the position deviation is not generated, so that a more accurate interactive remote control function can be realized. The above is only the embodiment of the present invention, and is not intended to limit the scope of the invention, and the equivalent structure or equivalent process transformations made by the specification and the drawings of the present invention may be directly or indirectly applied to other related technologies. The scope of the invention is included in the scope of patent protection of the present invention.

Claims

Claim

[Claim 1] An interactive remote controller, comprising: a monitoring unit (100), an infrared light unit

(200), a touch unit (300), a signal processing and communication unit ( ⁴⁰⁰ ); the infrared light unit (200) includes an infrared light source (201) for emitting infrared light and forming an overlay on the touch unit An infrared light signal layer (202) having a predetermined thickness above the touch surface of (300);

The monitoring unit (100) includes at least two monitoring modules (1001, 1002), each of which includes a monitoring lens and an imaging chip; an optical axis of each of the monitoring lenses and the touch unit ( The touch surfaces of the 300) are not parallel, and the monitoring lens has an overlapping monitoring area for the infrared light signal layer (202) above the touch surface, which can effectively monitor the target object (600). The activity space (500) is located in the overlapping monitoring area;

The monitoring module (1001, 1002) collects an infrared image of the target object (600) into the effective active space (500), and generates position information of the target object (600); (300) generating touch information of the target object (600) after the target object (600) is in effective contact with the touch surface; position information and touch information of the target object (600) are The signal processing and communication unit (400) is processed and output as an interactive remote control signal.

[Claim 2] The interactive remote controller according to claim 1, wherein the monitoring unit (100)

The infrared light monitoring layer (202) is located on the same side of the touch unit (300); or the touch surface of the touch unit (300) is made of a material that can transmit infrared light, The monitoring unit (100) and the infrared light monitoring layer (202) are respectively located at two sides of the touch unit (300).

[Claim 3] The interactive remote controller according to claim 1, wherein an optical axis of each of the monitoring lenses intersects with a touch surface of the touch unit (300) to form an angle.

[Claim 4] The interactive remote controller according to claim 1, wherein the angle is greater than 10 degrees [Claim 5] An interactive remote control system, comprising a display unit (20), comprising the interactive remote controller (10) according to any one of claims 1-4;

The display unit (20) is communicatively coupled to the signal processing and communication unit (400) in the interactive remote controller (10) to receive the interactive remote control signal, and performs corresponding operations according to the interactive remote control signal, and/ Or corresponding display on the display screen of the display unit (20).

[Claim 6] The interactive display system according to claim 5, wherein the display unit (2)

0) comprising a receiving unit communicatively coupled to the signal processing and communication unit (400), the receiving unit comprising a 2.4G communication module, a Bluetooth communication module, and a WIFI communication module matched with the signal processing and communication unit (400) At least one of them.

[Claim 7] The interactive display system according to claim 5, wherein the touch unit (3)

00) and the signal processing and communication unit (400) are formed on smart devices with touch screens and communication modules.

[Claim 8] An interactive touch method, characterized in that, according to the interactive display system according to any one of claims 5-7, interactive touch is performed as follows:

51. Presetting the effective activity space (500) in the overlapping monitoring area;

52. Presetting a correspondence between any spatial position point in the effective active space (500) and a display position on a display screen of the display unit (20), wherein the same X and Y coordinates are different and different Z coordinates are present. The spatial position point is displayed in the same position on the display unit;

53. When the target object (600) enters the effective active space (500), the monitoring unit (100) identifies three-dimensional coordinate information (X, Y) of the target object (600).

And, as the location information, when the target object (600) is in effective contact with the touch surface, the touch unit (300) generates touch information of the target object (600);

54. The display unit (20) receives an interactive remote control signal composed of the location information and the touch information, and performs a corresponding operation according to the interactive remote control signal, and/or a display on the display unit (20). The corresponding display is performed on the screen. The interactive touch method according to claim 8, wherein in the step S1, four points having different spatial positions are selected in the infrared light signal layer (202), and the fourth Any two adjacent points in the point are connected and form four planes perpendicular to the touch surface of the touch unit (300), and the space formed by the four vertical planes is located in the monitoring module (1001) The part of the overlapping monitoring area of 1002) is the effective active space (500).

[Claim 10] The interactive touch method according to claim 8, wherein in the step S3, when the target object (600) is vertically pressed in the effective active space (500)吋, will generate sequence action coordinates (X, Y, Ζ 3), (Χ, Υ, Ζ 2), (Χ, Υ, Ζ1), where (Χ, Υ, Ζ1) are coming soon and have not yet been in effective contact with the touch surface When the target object is in effective contact with the touch surface, the plane coordinates of the touch point are assigned (Χ, Υ).