WO2023011578A1

WO2023011578A1 - Screen control method, control terminal, screen, and computer-readable storage medium

Info

Publication number: WO2023011578A1
Application number: PCT/CN2022/110195
Authority: WO
Inventors: 曹江; 梁晓琳; 黄晓腾; 李盛义; 王英琪
Original assignee: 重庆康佳光电技术研究院有限公司
Priority date: 2021-08-06
Filing date: 2022-08-04
Publication date: 2023-02-09
Also published as: CN114035759A; CN114035759B

Abstract

The present application relates to a screen control method, a control terminal, a screen, and a computer-readable storage medium. The control terminal is in a control relationship with at least two screens. The method comprises: after screens establish communication with a control terminal, the control terminal acquiring user input information, which is sent by at least one of the controlled screens, and determining at least one display instruction according to the user input information, wherein each display instruction corresponds to at least one screen among the screens, which are in a control relationship with the control terminal; and then, sending the display instruction to a target screen, such that the target screen performs display control according to the display instruction.

Description

Screen control method, control terminal, screen, and computer-readable storage medium

technical field

The present application relates to the field of display control, in particular to a screen control method, a control terminal, a screen and a computer-readable storage medium.

Background technique

With the rapid development of display technology, display screens not only need to be applied to small devices such as terminals and tablets, but also require applications in larger scenarios. Due to the high production and maintenance costs of a single large-scale screen and the difficult process, splicing or distributed large-screen or multi-screen system implementation solutions have become mainstream.

However, for spliced large screens or distributed screens, users cannot conveniently control the screens in the entire system through screen touch and gestures.

Therefore, how to realize convenient control for multi-screen systems such as spliced large screens or distributed screens is an urgent problem to be solved.

technical problem

In view of the deficiencies in the above-mentioned related technologies, the object of the present application is to provide a screen control method, a control terminal, a screen and a computer-readable storage medium, aiming at solving the problem in the related technologies that it is difficult to implement multi-screen systems such as spliced large screens or distributed screens. Convenience control issues.

technical solution

This application provides a screen control method, which is applied to a control terminal. The control terminal has a control relationship with at least two screens. The screen control method includes:

Obtain user input information sent by at least one of the controlled screens;

Determine at least one display instruction according to user input information, each display instruction corresponds to at least one of the screens controlled by the controlled terminal;

Sending the display instruction to the target screen, so that the target screen performs display control according to the display instruction.

Based on the same inventive concept, this application also provides a screen control method applied to the screen, including:

Establish communication with the control terminal;

receiving a display instruction sent by the control terminal, wherein the display instruction is a display instruction determined by the control terminal according to the acquired user input information, and the user input information includes user input information sent to the control terminal by at least one of the screens controlled by the control terminal ;

Perform display control according to the display command.

Based on the same inventive concept, the present application also provides a control terminal, including a processor, a memory, and a communication bus;

The communication bus is used to realize the connection communication between the processor and the memory;

The processor is used to execute one or more computer programs stored in the memory, so as to realize the above steps of the screen control method applied to the control terminal.

Based on the same inventive concept, the present application also provides a control terminal, including:

master device; and

a first communication device connected to the main control device;

The first communication device is configured to communicate with at least two screens: obtain user input information sent by at least one of the screens, and transmit the user input information to the main control device, and obtain display instructions from the main control device, and Send the display instruction to the target screen, so that the target screen performs display control according to the display instruction; the main control device is configured to determine at least one display instruction according to the user input information, and each display instruction is related to at least one of the screens controlled by the controlled terminal. One corresponds.

Based on the same inventive concept, the present application also provides a screen, including a processor, a memory and a communication bus;

The processor is used to execute one or more computer programs stored in the memory, so as to realize the steps of the above screen control method applied to the screen.

Based on the same inventive concept, this application also provides a screen, including:

a second communication device; and

a processor communicatively coupled to the second communication device;

The second communication device is also connected in communication with the control terminal, which is configured to receive a display instruction sent by the control terminal, wherein the display instruction is a display instruction determined by the control terminal according to the acquired user input information, and the user input information is determined by the control terminal. At least one of the controlled screens is sent to the control terminal; the processor is configured to perform display control according to the display instruction.

Based on the same inventive concept, the present application also provides a computer-readable storage medium. The computer-readable storage medium stores one or more computer programs, and one or more computer programs can be executed by one or more processors to realize Steps in at least one of the following methods:

The screen control method applied to the control terminal as above;

The screen control method applied to the screen as above.

Beneficial effect

The above screen control method obtains the user input information sent by at least one screen through the control terminal, determines the display instruction of the screen according to the user input information by the control terminal, and sends the display instruction to the corresponding screen. Unified and convenient control of the screen.

The above screen control method applied to the screen enables the screen to receive the display instructions sent by the control terminal and corresponding to the user's operations on the screen itself and/or other screens controlled by the control terminal, so that the screen can be systematized control. In some implementation processes, the problem that multi-screen systems such as spliced screens and distributed screens are difficult to be uniformly controlled is solved.

The above-mentioned control terminal can determine the display command of the screen according to the actual working conditions of the screen, and send the display command to the corresponding screen, which can not only realize the individual work of each screen, but also complete the coordinated work of the entire display system. Unified and convenient control of splicing large screens or distributed screens.

The above-mentioned screen can receive display instructions sent by the control terminal corresponding to the user's operations on the screen itself and/or other screens controlled by the control terminal, so that the screen can be systematically controlled. In some implementation processes, the problem that multi-screen systems such as spliced screens and distributed screens are difficult to be uniformly controlled is solved.

When the computer program stored in the above-mentioned computer-readable storage medium is executed by the processor, unified and convenient control over the spliced large screen or distributed screen can be realized in some processes.

Description of drawings

FIG. 1 is a schematic flowchart of a screen control method applied to a control terminal provided in an embodiment of the present application;

FIG. 2 is a schematic flowchart of determining at least one display instruction according to user input information provided by an embodiment of the present application;

FIG. 3 is a schematic flowchart of a screen control method applied to a screen provided in an embodiment of the present application;

FIG. 4 is a schematic structural diagram of a control terminal provided in an embodiment of the present application;

Fig. 5a is a schematic structural diagram of a screen provided by an embodiment of the present application;

Fig. 5b is another schematic structural diagram of the screen provided by the embodiment of the present application;

Fig. 5c is another schematic structural diagram of the screen provided by the embodiment of the present application;

Fig. 5d is another schematic structural diagram of the screen provided by the embodiment of the present application;

Fig. 6 is a schematic flow diagram 1 of controlling an independently working screen A controlled by the control terminal provided by the embodiment of the present application;

FIG. 7 is the second schematic flow diagram of controlling an independently working screen A controlled by the control terminal provided by the embodiment of the present application;

FIG. 8 is a schematic flow diagram of controlling multiple synchronously working screens controlled by the control terminal provided by the embodiment of the present application;

FIG. 9 is a schematic flow diagram of controlling the collaborative work screen controlled by the control terminal provided by the embodiment of the present application;

FIG. 10 is a schematic diagram of a spliced display system provided by an embodiment of the present application;

FIG. 11 is a schematic diagram of detecting user gestures by a spliced display system provided by an embodiment of the present application;

Fig. 12 is a schematic flow diagram provided by the embodiment of the present application when multiple screens have acquired the gesture movement trajectory of the user's hand;

FIG. 13 is a schematic structural diagram of a control terminal provided in another optional embodiment of the present application;

FIG. 14 is a schematic structural diagram of a screen provided by another optional embodiment of the present application;

Explanation of reference signs:

Hand-10; Control Terminal-100; Main Control Device-101; First Communication Device-102; Screen-200; Light-emitting Chipset-201; Infrared Emitter-202; Infrared Receiver-203; Color Sensor-204; Processor-205; second communication device-206; display driver-207; first processor-301; first memory-302; first communication bus-303; second processor-401; second memory-402; Second communication bus - 403 .

Embodiments of the present invention

In order to facilitate the understanding of the present application, the present application will be described more fully below with reference to the relevant drawings. Preferred embodiments of the application are shown in the accompanying drawings. However, the present application can be embodied in many different forms and is not limited to the embodiments described herein. On the contrary, the purpose of providing these embodiments is to make the disclosure of the application more thorough and comprehensive.

Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the technical field to which this application belongs. The terminology used herein in the description of the application is only for the purpose of describing specific embodiments, and is not intended to limit the application.

In related technologies, users cannot conveniently control spliced large screens or distributed screens through screen touch, gestures, and other means.

Based on this, the present application hopes to provide a solution capable of solving the above-mentioned technical problems, the details of which will be described in subsequent embodiments.

Example:

This embodiment provides a screen control method, which is applied to a control terminal. The control terminal has a control relationship with at least two screens. Please refer to FIG. 1. The screen control method of this embodiment includes:

S101. Obtain user input information sent by at least one screen in the controlled screens;

S102. Determine at least one display instruction according to the user input information;

Each display instruction corresponds to at least one screen among the screens in which the control terminal has a control relationship;

S103. Send a display instruction to the target screen, so that the target screen performs display control according to the display instruction.

The above control relationship between the control terminal and the screen means that the control terminal can send a display command to the screen, so that the screen can perform display control according to the display command. In this embodiment, the control terminal may have a control relationship with any number of screens, but the screens may be independent, cooperative or synchronous. It can be understood that independent screens can display unrelated content respectively, and the displayed content will not be affected by other screens; collaborative work screens can jointly display related content, such as a multi-screen splicing formed Large screen, each screen on the large screen displays a part of the complete content, so that the large screen can completely present the content to be displayed; the screens that work synchronously display the same content at the same time. In some examples, some of the screens controlled by the control terminal can be independent, some of them can work in cooperation, and the other can work synchronously. That is, this embodiment does not limit the screens controlled by the control terminal to only There is a working relationship, and when the processing capability of the control terminal is sufficient, various working relationships can coexist.

The control terminal can be used as a separate device and set outside each screen. For example, in a distributed screen, the control terminal can be arranged separately in the center of each screen. For example, in an exhibition scene, multiple screens form a spliced screen , and the splicing screen is set on one side of the booth, and the control terminal can be set in the center of the booth; it can also be used as a sub-equipment, set on a certain or a certain part of the screen, for example, in the splicing screen, the control terminal It can be set on the centermost screen of the splicing screen and behind the display surface of the splicing screen.

Through the above-mentioned screen control method of this embodiment, the control terminal determines the display instruction according to the user input information sent by the screen it controls, and sends the display instruction to the corresponding screen to realize display control, and the user does not need to go to the control terminal for input Effective control of multi-screen display scenarios such as spliced large screens or distributed screens can be realized.

In some implementations, as shown in Figure 2, at least one display instruction is determined according to user input information, including:

S1021. Recognize the information input by the user, and obtain a recognition result;

S1022. Generate at least one display instruction according to the recognition result and the working relationship between at least two screens;

Exemplarily, the working relationship between the screens includes collaborative work, and at least one display instruction is generated according to the recognition result and the working relationship between at least two screens, including:

According to the user input information, the target screen and the display instruction corresponding to each target screen are determined from the screens whose working relationship is collaborative work. The target screen in this embodiment includes the screen that needs to be controlled in order to perform the display operation corresponding to the user input information Each display instruction can instruct the corresponding target screen to perform display control, so that each target screen can jointly complete the display operation.

It is understandable that in screen control, not all screens may be involved in every control. For example, the user may only need to turn off or turn on some of the screens, or change the display content of some of the screens. Therefore, before controlling the screens, it is necessary to determine the target screens that need to be controlled. Exemplarily, when it is determined that the display operation corresponding to the user input information is to close the screen, a display command to close the screen is generated, and each screen that needs to be closed is determined, and the control terminal sends the display command to close the screen to each Screens that need to be turned off.

In some other examples, the working relationship includes synchronous work, and at least one display instruction is determined according to the user input information and the working relationship between the screens, including:

Determining that the target screens include screens whose working relationship is synchronous work and determining the display instructions corresponding to each target screen according to the user input information, the display instructions can instruct the corresponding target screens to perform display control, so that each target screen completes the user input respectively The display operation corresponding to the information.

That is to say, the display instructions determined by the control terminal for each screen whose working relationship is synchronous work are the same, and each screen can perform the same display control.

In one example, before at least one display instruction is determined, it is also judged according to user input information whether the screen to be controlled by the user is a screen for collaborative work or a screen for synchronous work, if it is determined that the screen that the user wants to control is a screen for collaborative work , then determine the target screen from the screens whose working relationship is collaborative work according to the user input information, if it is determined that the screen that the user wants to control is a synchronous work screen, then all the screens whose working relationship is synchronous work are used as target screens. In another example, if the control terminal is only set with one working relationship, it is not necessary to judge the working relationship of the screen to be controlled by the user, and the target screen can be directly determined, that is, when the control terminal only controls the screen with collaborative work Directly determine the target screen from the screens whose working relationship is collaborative work, or control only the screens with synchronous work in the control terminal and directly use all synchronous work screens as the target screens.

In some implementations, the working relationship between the screens can be set, and the setting methods include but are not limited to directly inputting instructions on the control terminal to set, or using the screen control method of this embodiment to input on at least one screen The corresponding user input information enables the control terminal to perform settings according to the user input information acquired from the screen side.

In some practical applications, in addition to the above-mentioned working modes (including but not limited to independent work, collaborative work, and synchronous work), the working relationship between each screen can also include the positional relationship of each screen when working (including But not limited to relative and absolute positions), in some implementation processes, according to the positions of the screens, it is determined which screens are controlled and the corresponding display instructions are determined.

In some implementations, each display instruction is sent to all screens controlled by the control terminal. When the screen receives the corresponding display instruction, execute the display instruction. If the display instruction received by the screen is not corresponding to it, then The display command is not executed. This control method is also applicable to broadcast message interaction. The control terminal broadcasts the display command to all screens, and each screen executes the corresponding display command or does not execute the display command. Or you can choose to only transmit the display command to the screen corresponding to the display command. For example, if the determined display command only corresponds to one screen, then only the display command is transmitted to the corresponding screen, saving transmission through more accurate information interaction. resource.

The user input information in this embodiment includes but is not limited to user's gesture image, touch, voice and so on. Taking the user input information as the user's gesture image as an example, identifying the user input information and obtaining the recognition result includes: recognizing the gesture image, obtaining the user's gesture movement trajectory, using the gesture movement trajectory as the recognition result, and generating a display instruction according to the gesture movement trajectory. Similarly, user input information includes touch type identification (including but not limited to sliding, clicking) and/or touch position information (including but not limited to sliding track and click position) when touching, etc. When the information includes voice, the voice is recognized to obtain text or other voice information that the user wants to input.

In some implementations, information is transmitted between the control terminal and the screens it controls through radio frequency, and correspondingly, the user input information sent by at least one of the controlled screens is acquired, including:

Obtaining user input information sent by at least one of the controlled screens through radio frequency;

Send display instructions to the target screen, including:

Send display instructions to the target screen via radio frequency.

Radio frequency includes but is not limited to wifi, bluetooth or other radio frequency communication methods.

In some implementation manners, acquiring user input information sent by at least one of the controlled screens includes:

Acquiring user input information respectively sent by at least two screens under control, and determining target user input information according to at least two user input information;

Determine at least one display instruction according to user input information, including:

At least one display instruction is determined according to the determined target user input information.

For example, if a user performs touch or gesture operations on a spliced large screen, the user's touch track may span multiple screens, or multiple screens near the user's hand may sense the user's gesture, resulting in more than one screen getting the user's input information, and these screens respectively send the acquired user input information to the control terminal, there will be a situation that the control terminal receives the user input information sent by at least two of the controlled screens. Of course, other situations such as multiple users operating multiple screens at the same time may also cause the control terminal to receive input information from more than one user.

Regarding the above situation of receiving user input information sent by at least two screens, target user input information is determined according to the user input information. The target user input information may be the one with the highest accuracy among multiple user input information, or it may be the final target user input information obtained by recalculating multiple user input information, or the final target user input information determined by other methods for final determination. Displays target user input for the command. In some implementation processes, by determining the target user input information according to the user input information sent by at least two screens, the accuracy of judging the user's input can be improved.

It can be understood that, in this embodiment, the screen that sends user input information to the control terminal may be any screen controlled by the control terminal, and the screen may be the screen corresponding to the subsequently determined display instruction (that is, according to the current user input The screen whose information is controlled), may also be a screen that does not receive the display instruction determined by the user input information (that is, the screen is not controlled this time). That is to say, through the implementation of the screen control method by the control terminal, the user can not only control the screen for obtaining user input information, but also control other screens that are difficult for the user to touch through the screen.

In the screen control method of this embodiment, the control terminal obtains the user input information sent by at least one screen, the control terminal determines the display instruction of the screen according to the actual working conditions of the screen, and sends the display instruction to the corresponding screen. Unified and convenient control of splicing large screens or distributed screens. And it can be understood that, in practical applications, the screen control method of this embodiment can not only realize the individual work of each screen, but also complete the cooperative work of the entire display system.

This embodiment also provides a screen control method, the screen control method of this embodiment is applied to the screen, see Figure 3, including:

S201. Establish communication with the control terminal;

The communication connection includes wired or wireless communication. Exemplarily, wireless communication includes but is not limited to radio frequency communication connection, such as wifi, bluetooth or other radio frequency communication methods. In some examples, wireless broadcasting and other communication methods that do not need to establish a connection can also be used. . For wired communication, the process of establishing communication includes but not limited to connecting a communication cable or accessing a communication port; for wireless communication that requires establishing a connection, the process of establishing a communication connection includes but not limited to a pairing connection for wireless communication.

S202. Receive a display instruction sent by the control terminal;

Wherein, the display instruction includes a display instruction determined by the control terminal according to the acquired user input information, and the user input information includes user input information sent to the control terminal by at least one of the screens controlled by the control terminal.

S203. Perform display control according to the display instruction;

Through the screen control method applied to the screen, the screen can be displayed and controlled according to the user input information acquired by the screen controlled by the control terminal, and the user does not need to operate on the control terminal or the controlled screen. In some implementation processes, The screen can be effectively controlled in multi-screen display scenarios such as spliced large screens or distributed screens.

It can be understood that if the control terminal only sends the display command to the corresponding screen, that is, the target screen selected by the control terminal is only the screen that needs to execute the corresponding display command, then after the screen receives the display command from the control terminal, it can Display control is performed directly according to the display command. However, if the control terminal sends the display instruction in a broadcast manner, the screens that receive the display instruction may include all the screens controlled by the control terminal. In this case, after a screen receives the display instruction from the control terminal side, You can first determine whether you are the screen corresponding to the display command, or whether the display command corresponds to this screen, and if it is determined to be yes, then perform display control according to the display command; otherwise, you can discard the corresponding display command , the corresponding operation is not performed. In an example of this embodiment, when the control terminal broadcasts the display instruction, it may carry the unique identification information of the screen corresponding to the display instruction in the display instruction, and after each screen receives the display instruction, it may include the display instruction The carried unique identification information is compared with its own unique identification information to determine whether the screen corresponds to the display instruction.

It can be understood that, in some implementations, the screen implementing the above screen control method can also acquire user input information, which may be used to control other screens in the control terminal, and may also be used to control the acquired to the screen where the user enters information.

The screen can obtain user input information in any way. For example, in some embodiments, before receiving the display instruction sent by the control terminal, it also includes: obtaining infrared reflection information through an infrared transceiver device, and obtaining color information through a color sensor;

The user input information is determined according to the infrared reflection information and the color information, and the user input information is sent to the control terminal for the control terminal to determine the display instruction.

In some examples, the infrared reflection information and color information can be directly used as user input information and sent to the control terminal. In such an example, the control terminal can process the corresponding data (including but not limited to the user's gesture trajectory after processing) In some examples, the infrared reflection information and color information can be processed by the screen, and the processed data can be sent to the control terminal as user input information.

In one example, the infrared transceiver device may specifically include an infrared emitter and an infrared sensor, wherein the infrared emitter is used to emit infrared rays outward, and the infrared sensor can receive infrared rays reflected from the outside, and the infrared reflection information obtained by the infrared transceiver device can determine the Whether there is an object in front of the screen can be used to detect the user's gesture operation and obtain the user's gesture image. The color information acquired by the color sensor can be analyzed and processed in combination with the infrared reflection information to obtain a more accurate image of the user's gestures, and by identifying data such as gesture trajectory, it can be judged what kind of gesture operation the user has performed. Of course, in some examples, user input information such as gesture images can also be determined only through the infrared transceiver device.

Through the above screen control method applied to the screen, the screen can receive the display instructions sent by the control terminal corresponding to the user's operation on the screen itself and/or other screens controlled by the control terminal, so that the screen can be systematized control. In some implementation processes, the problem that multi-screen systems such as spliced screens and distributed screens are difficult to be uniformly controlled has been solved, and users can easily perform operations such as touch, gesture, and voice control on the screens in such multi-screen systems.

In order to better understand the screen control method provided by the present application, the screen control method will be described below with reference to specific examples.

Please refer to FIG. 4 , which illustrates a structure of a control terminal. The control terminal 100 includes a main control device 101 and a first communication device 102. It can be understood that, in addition to the main control device 101 and the first communication device 102, the control terminal 100 , may also include devices such as a memory and a power manager. The first communication device 102 can realize data interaction with at least two screens. In some examples of this embodiment, the first communication device 102 can interact with the screen based on radio frequency, for example, the first communication device 102 is a first radio frequency device.

In some examples of this embodiment, the first communication device 102 may acquire user input information from the screen side, and then send the acquired user input information to the main control device 101, and the main control device 101 may determine at least one display instructions, each display instruction corresponds to at least one of the screens controlled by the control terminal.

Please refer to FIG. 5a for an example of a screen structure. The screen 200 includes a processor 205 and a second communication device 206. The processor 205 and the second communication device 206 are connected in communication. At the same time, the second communication device 206 is also connected to the control terminal communication, it can be understood that the second communication device 206 corresponds to the communication mode of the first communication device 102 in the control terminal 100, for example, when the first communication device 102 is the first radio frequency device, the second communication device 206 can be A second radio frequency device corresponding to the first radio frequency device. Of course, those skilled in the art can understand that, in some other examples of this embodiment, the first communication device 102 and the second communication device 206 may also be wired communication interfaces. In this embodiment, the second communication device 206 may receive a display instruction from the control terminal 100 side, and the processor 205 may perform display control according to the display instruction received by the second communication device 206 . In addition, the processor 205 may also acquire user input information, and control the second communication device 206 to send it to the control terminal 100 .

In other examples of this embodiment, the screen 200 may further include a device for obtaining user input information. For example, in some examples, the device for obtaining user input information includes an infrared transceiver device. The infrared transceiver device can include an infrared emitter 202 and an infrared receiver 203. As shown in FIG. 5 b, the infrared emitter 202 and the infrared receiver 203 are connected to the processor 205 respectively. The top of the screen referred to in this embodiment is when the user watches the screen, the side close to the user) emits infrared rays, and the infrared rays are reflected to the infrared receiver 203 after encountering objects such as the user's palm, and the infrared receiver 203 acquires infrared reflection information, The processor 205 determines the user input information according to the infrared reflection information.

In some examples, the device for obtaining user input information may further include a color sensor 204, as shown in FIG. 5c, the color sensor 204 is used to obtain color information of natural light. After receiving the data transmitted by the infrared receiver 203 and the color sensor 204 (including but not limited to infrared reflection information and color information), the processor 205 performs analysis and processing to obtain the continuous movement trajectory of the palm, that is, to recognize the user's gesture movement trajectory . Exemplarily, the trajectory of the gesture can be compared with the database, the meaning of the gesture can be analyzed, and the user input information (in this example, the data representing the meaning of the gesture) can be transmitted to the second communication device 206, and the second communication device 206 is sent to the control terminal.

It can be understood that the screen 200 should also include necessary components such as a display panel and a display driver 207. In some examples, the processor 205 and the second communication device 206 can be arranged on a circuit board (not shown in the figure) under the display panel in the screen 200 out) on. Please refer to FIG. 5d. It should be noted that FIG. 5d does not show the connection relationship between the devices, but those skilled in the art should understand that this does not mean that there is no connection relationship between the devices. In some examples of this embodiment, the display panel includes a plurality of light-emitting chip groups 201, and each light-emitting chip group 201 includes three light-emitting chips of different colors. The light-emitting chips may include but are not limited to Mini LED (submillimeter light-emitting diode) chips, Micro LED chips (miniature light-emitting diodes), etc. The display driver 207 in the screen 200 is used to provide data to the display panel according to the required control and display content, and the display panel drives each light-emitting chipset 201 to perform specific display actions according to the data provided by the display driver 207 .

Taking Micro LED chips as an example, most of the display panels based on Micro LED chip products are transparent, and Micro LED chips are small in size. The transparent range of the display panel of the LED chip product is extremely high. In such an embodiment, infrared light can be set under the display panel (the lower part of the display panel referred to in this embodiment is the side away from the user when the user watches the screen). Emitter 202 , infrared receiver 203 and color sensor 204 . In practical applications, the information of the part blocked by objects such as Micro LED chips can also be supplemented by algorithms or other part of the reflected light data.

Hereinafter, on the basis of the above-mentioned screen and control terminal, an exemplary description will be given by taking a process in which the user controls the screen through gestures as an example.

Example 1: An independently working screen A controlled by the control terminal is controlled through the screen control method of the above embodiment, see FIG. 6 .

S301. Screen A acquires a gesture image input by a user;

The user gestures in front of screen A, and screen A acquires the gesture image through the infrared emitter, infrared receiver and color sensor, recognizes the movement trajectory of the user's hand, and determines the gesture movement trajectory input by the user.

S302, the screen A sends the gesture movement trajectory to the control terminal;

Specifically, the motion track of the gesture may be sent through the second radio frequency device.

S303. The control terminal acquires the gesture movement trajectory sent by screen A;

Specifically, it may be that the first radio frequency device of the control terminal receives the gesture movement trajectory sent by screen A;

S304. The control terminal determines the display instruction according to the trajectory of the gesture and the working relationship between the screens;

In this example, the control terminal has a control relationship with multiple screens including screen A, but screen A is independent from other screens. The first radio frequency device of the control terminal sends the acquired gesture movement trajectory to the main control device, and the main control device determines the display instruction A corresponding to the screen A only according to the gesture movement trajectory. Referring to FIG. 7, after the control terminal determines the display instruction, it enters S405.

S405. The control terminal sends the display command A to the screen A;

The main control device of the control terminal sends the display instruction A to the first radio frequency device, and the first radio frequency device sends the display instruction to the second radio frequency device of the screen A.

S406. The screen A performs display control according to the display instruction A;

After the second radio frequency device of the screen A receives the display command A, it sends the display command A to the display driver, and the display driver provides data to the display panel of the screen A according to the display command A according to the required control and display content, so that the display panel performs action.

Example 2: Control multiple synchronously working screens controlled by the control terminal through the screen control method of the above embodiment.

In this example, the steps for the control terminal to determine the display instruction are basically the same as S101-S104, and will not be repeated here. Referring to FIG. 8, after the control terminal determines the display instruction, it enters S505.

S505. The control terminal sends the display instruction B to all synchronously working screens;

The main control device of the control terminal sends the display instruction B to the first radio frequency device, and the first radio frequency device sends the display instruction B to the second radio frequency device of each screen in a synchronous working state.

S506, the screen performs display control according to the display instruction B;

After receiving the display command B, the second radio frequency device of each screen in the synchronous working state sends the display command B to the display driver, and the display driver provides data to the display panel of the screen B according to the required control and display content according to the display command B, In order to make the display panel operate. In this example, all the screens in the synchronous working state receive the same display instructions, and all the screens in the synchronous working state perform the same display control according to the display instructions, such as playing the same video.

In some practical application scenarios, multiple screens that work synchronously are distributed and arranged in different places. When users need to control these screens, they only need to make corresponding gestures and other control methods on any screen to achieve unified control of all screens. Effect.

Example 3: Control the collaborative work screen controlled by the control terminal through the screen control method of the above embodiment.

In this example, the steps for the control terminal to determine the display instruction are basically the same as S101-S104, and will not be repeated here. Referring to FIG. 9, after the control terminal determines the display instruction, it enters S605.

It should be noted that, in this example, the control terminal determines the display instruction C and the display instruction D. FIG. Wherein, the display command C is a display command corresponding to the screen C, and the display command D is a display command corresponding to the screen D. In practical applications, the screens for collaborative work may also include other screens other than screen C and screen D, but depending on the control required by the user, it may only be necessary to control the content displayed on screen C and screen D, Therefore, the finally determined display instructions include a display instruction C and a display instruction D. FIG.

S605. The control terminal sends the display command C to the screen C, and sends the display command D to the screen D;

The main control device of the control terminal sends the display command C and the display command D to the first radio frequency device, and the first radio frequency device sends the display command C to the second radio frequency device of the screen C. Similarly, the display command D is sent to the screen d.

S606, the screen C and the screen D perform display control according to the display command C or the display command D respectively;

After receiving the display command C, the second radio frequency device of the screen C in the cooperative working state sends the display command C to the display driver, and the display driver provides data to the display panel of the screen C according to the required control and display content according to the display command C, In order to make the display panel operate. Similarly, after the screen D receives the display instruction D, its display driver controls the display panel of the screen D according to the display instruction D.

Example 4: The spliced screen is controlled through the screen control method of the above embodiment.

It should be understood that, in each of the above examples, the setting manner of each screen is not limited, and may be a distributed setting or a spliced screen. In order to better illustrate the screen control method, this example also describes a control process of the spliced screen.

Please refer to Figure 10 and Figure 11, which are schematic diagrams of the mosaic display system provided in this example;

Including splicing screen, splicing screen is composed of multiple collaborative screens 200, multiple collaborative screens 200 are arranged in an array, and display a part of the display content respectively, all screens 200 on the splicing screen The displayed content is combined to form the complete display content.

When controlling the spliced screen, the user can make a gesture in front of any screen 200, as shown in Figure 11, when the user makes a gesture, there may be multiple screens 200 that have acquired the gesture generated by the user's hand 10 image, and be able to recognize the trajectory of the gesture input by the user. In an example, referring to FIG. 12 , when multiple screens 200 have acquired user gesture images, the process of controlling the screens may include:

S701. Gesture images are acquired by multiple screens;

S702. The screen that has acquired the gesture image sends its determined gesture movement trajectory to the control terminal through the second radio frequency device, and the first radio frequency device of the control terminal receives the gesture movement trajectory;

S703. The control terminal acquires gesture motion tracks sent by multiple screens;

Due to the different positions of the screens 200 that make up the spliced screen, there are actually differences in the acquired gesture motion trajectories.

S704. The control terminal determines a target gesture trajectory according to the gesture trajectory sent by multiple screens;

As mentioned in the foregoing embodiments, the most accurate target gesture trajectory may be selected from the gesture trajectory sent from multiple screens, or a target gesture trajectory may be obtained by recalculating these gesture trajectory. The determined motion track of the target gesture is used to determine the display instruction.

S705. The control terminal determines the display instruction according to the trajectory of the target gesture and the working relationship between the screens;

After determining the display instructions, the first radio frequency device 102 of the control terminal 100 sends each display instruction to the second radio frequency device 206 of the corresponding screen 200 . In the above example, the screen 200 recognizes the trajectory of the gesture, and sends the trajectory of the gesture to the control terminal 100 . In another example, the screen 200 can send the gesture image to the control terminal 100, and the control terminal 100 can recognize the trajectory of the gesture.

Another optional embodiment of this application:

This embodiment also provides a control terminal, which includes but is not limited to various devices or modules that can implement control, such as a controller such as a host computer. Referring to FIG. 13 , the control terminal includes a first processor 301, The first memory 302 and the first communication bus 303, wherein:

The first communication bus 303 is used to realize connection and communication between the first processor 301 and the first memory 302;

The first processor 301 is configured to execute one or more computer programs stored in the first memory 302, so as to realize at least one of the following steps:

Obtain user input information sent by at least one of the controlled screens;

Determine at least one display instruction according to the user input information, and each display instruction corresponds to at least one screen among the screens that have a control relationship with the control terminal;

Sending the display instruction to the target screen, so that the target screen performs display control according to the display instruction. the

In this embodiment, the step of the first processor 301 determining at least one display instruction according to the user input information includes:

Identify the user input information and get the recognition result;

At least one display instruction is generated according to the recognition result and the working relationship between the at least two screens.

In this embodiment, the user input information includes a gesture image, and the user input information is recognized to obtain a recognition result, including:

The gesture image is recognized to obtain a gesture movement trajectory of the user, and the gesture movement trajectory is used as a recognition result.

In this embodiment, information is transmitted between the control terminal and the screens controlled by radio frequency, and the first processor 301 executes the step of acquiring user input information sent by at least one of the controlled screens, including:

The step of sending the display instruction to the screen corresponding to the display instruction includes:

Send display instructions to the target screen via radio frequency.

In this embodiment, the control terminal obtains the user input information sent by the controlled screen, including: obtaining the user input information respectively sent by at least two screens among the controlled screens, and determining the target user input information according to the at least two user input information. information;

At least one display instruction is determined according to the determined target user input information and the working relationship between the various screens.

This embodiment also provides a screen, as shown in FIG. 14 , which includes a second processor 401, a second memory 402 and a second communication bus 403, wherein:

The second communication bus 403 is used to realize connection and communication between the second processor 401 and the second memory 402;

The second processor 401 is configured to execute one or more computer programs stored in the second memory 402, so as to realize at least one of the following steps:

Establish communication with the control terminal;

receiving a display instruction sent by the control terminal, wherein the display instruction is a display instruction corresponding to the screen determined by the control terminal according to the acquired user input information, and the user input information includes at least one screen of the screens controlled by the control terminal to the control terminal sent user input information;

Perform display control according to the display command.

In this embodiment, before receiving the display instruction sent by the control terminal, at least one of the following steps is also implemented:

Obtain infrared reflection information through infrared transceiver devices, and obtain color information through color sensors;

The present embodiment also provides a computer-readable storage medium, which includes information implemented in any method or technology for storing information, such as computer-readable instructions, data structures, computer program modules, or other data. volatile or nonvolatile, removable or non-removable media. Computer-readable storage media include but are not limited to RAM (Random Access Memory, random access memory), ROM (Read-Only Memory, read-only memory), EEPROM (Electrically Erasable Programmable read only memory, charged erasable programmable read-only memory), flash memory or other memory technology, CD-ROM (Compact Disc Read-Only Memory, compact disk read-only memory), digital versatile disk (DVD) or other optical disk storage, magnetic box , magnetic tape, magnetic disk storage or other magnetic storage device, or any other medium that can be used to store desired information and that can be accessed by a computer.

The computer-readable storage medium in this embodiment can be used to store one or more computer programs, and the one or more computer programs stored therein can be executed by the processor, so as to realize at least one step performed by the above-mentioned control terminal and/or screen .

It can be seen that those skilled in the art should understand that all or some of the steps in the methods disclosed above, the functional modules/units in the system and the device can be implemented as software (the computer program code executable by the computing device can be used to realize ), firmware, hardware, and appropriate combinations thereof. In a hardware implementation, the division between functional modules/units mentioned in the above description does not necessarily correspond to the division of physical components; for example, one physical component may have multiple functions, or one function or step may be composed of several physical components. Components cooperate to execute. Some or all of the physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application-specific integrated circuit .

In addition, as is well known to those of ordinary skill in the art, communication media typically embodies computer readable instructions, data structures, computer program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery medium. Therefore, the application is not limited to any specific combination of hardware and software.

It should be understood that the application of the present application is not limited to the above examples, and those skilled in the art can make improvements or changes based on the above descriptions, and all these improvements and changes should belong to the protection scope of the appended claims of the present application.

Claims

A screen control method, applied to a control terminal, where the control terminal has a control relationship with at least two screens, and the screen control method includes:

Obtain user input information sent by at least one of the controlled screens;

Determine at least one display instruction according to the user input information, each of the display instructions corresponds to at least one of the screens controlled by the control terminal;

Sending the display instruction to the target screen, so that the target screen performs display control according to the display instruction.
The screen control method according to claim 1, wherein said determining at least one display instruction according to said user input information comprises:

Recognizing the user input information to obtain a recognition result;

At least one display instruction is generated according to the recognition result and the working relationship between the at least two screens.
The screen control method according to claim 2, wherein the user input information includes a gesture image, and identifying the user input information to obtain a recognition result includes:

The gesture image is recognized to obtain a gesture movement trajectory of the user, and the gesture movement trajectory is used as a recognition result.
The screen control method according to claim 2, wherein the working relationship includes at least one of cooperative work, synchronous work and independent work.
The screen control method according to claim 1, wherein the target screens are all screens controlled by the control terminal.
The screen control method according to claim 1, wherein the information is transmitted between the control terminal and the screen controlled by radio frequency;

The acquisition of user input information sent by at least one of the controlled screens includes:

Obtaining user input information sent by at least one of the controlled screens through radio frequency;

The sending the display instruction to the target screen includes:

Sending the display instruction to the target screen through radio frequency.
The screen control method according to claim 1, wherein said acquiring user input information sent by at least one of the controlled screens comprises:

Acquiring user input information respectively sent by at least two of the controlled screens, and determining target user input information according to the at least two user input information;

The determining at least one display instruction according to the user input information includes:

At least one display instruction is determined according to the determined target user input information.
The screen control method according to claim 7, wherein said determining target user input information according to at least two user input information comprises any of the following:

selecting the user input information with the highest accuracy as the target user input information;

The target user input information is obtained by synthesizing all the user input information and calculating.
A screen control method applied to a screen, comprising:

Establish communication with the control terminal;

receiving a display instruction sent by the control terminal, wherein the display instruction is a display instruction determined by the control terminal according to the acquired user input information, and the user input information is determined by the screen on the screen controlled by the control terminal. at least one is sent to the control terminal;

Display control is performed according to the display instruction.
The screen control method according to claim 9, wherein, before receiving the display instruction sent by the control terminal, further comprising:

Obtain infrared reflection information through infrared transceiver devices;

The user input information is determined according to the infrared reflection information, and the user input information is sent to the control terminal for the control terminal to determine the display instruction.
The screen control method according to claim 10, wherein before determining the user input information according to the infrared reflection information, further comprising: acquiring color information through a color sensor;

The determining the user input information according to the infrared reflection information includes: determining the user input information according to the infrared reflection information and the color information.
The screen control method according to claim 9, wherein, before performing display control according to the display instruction, further comprising:

It is determined that the display instruction corresponds to this screen.
A control terminal comprising:

master device; and

a first communication device connected to the main control device;

The first communication device is configured to communicate with at least two screens: obtain user input information sent by at least one of the screens, and transmit the user input information to the main control device, and obtain the user input information from at least one of the screens. The main control device obtains a display instruction, and sends the display instruction to the target screen, so that the target screen performs display control according to the display instruction; the main control device is configured to determine according to the user input information Issue at least one display instruction, each display instruction corresponds to at least one of the screens controlled by the control terminal.
13. The control terminal of claim 13, wherein said first communication device comprises a first radio frequency device.
A screen comprising:

a second communication device; and

a processor communicatively coupled to said second communications device;

The second communication device is also connected in communication with the control terminal, which is configured to receive a display instruction sent by the control terminal, wherein the display instruction is a display instruction determined by the control terminal according to the acquired user input information , the user input information is sent to the control terminal by at least one of the screens controlled by the control terminal; the processor is configured to perform display control according to the display instruction.
The screen of claim 15, wherein the screen further comprises:

an infrared emitter configured to emit infrared light; and

an infrared receiver configured to acquire infrared reflection information;

The processor is further configured to obtain the user input information according to the infrared reflection information, and control the second communication device to transmit the user input information to the control terminal.
The screen of claim 16, wherein the second communication device comprises a second radio frequency device, the screen further comprising:

a color sensor, the color sensor is configured to acquire color information, and the processor is configured to determine the user input information according to the infrared reflection information and the color information.
A computer-readable storage medium, the computer-readable storage medium stores one or more computer programs, and the one or more computer programs can be executed by one or more processors, so as to realize claims 1 or 9 The steps of the screen control method.