CN113905262B

CN113905262B - Control method, device, system and storage medium

Info

Publication number: CN113905262B
Application number: CN202111151210.7A
Authority: CN
Inventors: 孙声鹏
Original assignee: Huizhou Shiwei New Technology Co Ltd
Current assignee: Huizhou Shiwei New Technology Co Ltd
Priority date: 2021-09-29
Filing date: 2021-09-29
Publication date: 2024-03-12
Anticipated expiration: 2041-09-29
Also published as: CN113905262A

Abstract

The application discloses a control method, a device, a system and a storage medium, wherein the control method comprises the following steps: controlling each pixel of the display interface to output a light signal, wherein the light signal is used for indicating the position of the pixel; responding to a received position signal sent by a remote control end, displaying a cursor in a target area of a display interface, wherein the position signal is used for indicating the position of a target pixel, the target pixel corresponds to an optical signal received by the remote control end, and the position of the target area is the same as the position of the target pixel; and responding to the received determination signal sent by the remote control end, and executing an instruction corresponding to the cursor. Therefore, the control method can avoid the user to control the remote control terminal for many times, and improve the efficiency of remote control display.

Description

Control method, device, system and storage medium

Technical Field

The present application relates to the field of television control technologies, and in particular, to a control method, device, system, and storage medium.

Background

Along with the rapid development of intelligent televisions, the operation experience of a remote controller is more and more limited, the remote controller is often required to be triggered for a plurality of times to move a cursor to a proper position, and the remote controller is used for operating and selecting video playing and displaying very fussy. Therefore, a solution for simplifying the remote control display is needed.

Disclosure of Invention

The application provides a control method, a control device, a control system and a storage medium. The control method can quickly display the cursor on the display interface, so that a user is prevented from operating the remote controller for many times, and the efficiency of remote control display is improved.

In a first aspect, the present application provides a display control method, including:

controlling each pixel of a display interface to output a light signal, wherein the light signal is used for indicating the position of the pixel;

a cursor is displayed in a target area of the display interface in response to a received position signal sent by a remote control end, wherein the position signal is used for indicating the position of a target pixel, the target pixel corresponds to an optical signal received by the remote control end, and the position of the target area is the same as the position of the target pixel;

and responding to the received determining signal sent by the remote control end, and executing the instruction corresponding to the cursor.

In some embodiments, the controlling each pixel of the display interface to output a light signal comprises:

acquiring an initial pixel value of each pixel when the pixel is not coded, wherein the initial pixel value at least comprises a first character and a second character;

encoding the first character according to the row information of the pixel, encoding the second character according to the column information of the pixel, and obtaining an encoded pixel value of the pixel;

And controlling each pixel to output an optical signal on the display interface according to the coded pixel value.

In some embodiments, the encoding the first character according to the row information of the pixel, encoding the second character according to the column information of the pixel, and obtaining the encoded pixel value of the pixel includes:

converting the row information of the pixels into a first array, and dividing the first array into a plurality of first subarrays;

converting the column information of the pixels into a second array, and dividing the second array into a plurality of second subarrays equal to the first subarrays in number;

encoding the first character according to each first subarray to obtain a plurality of third characters;

encoding the second character according to each second subarray to obtain a plurality of fourth characters;

determining one of said third character and one of said fourth character as a sub-coded pixel value of said pixel and obtaining a plurality of said sub-coded pixel values;

said controlling each of said pixels to output an optical signal at said display interface in accordance with said encoded pixel values comprises:

and controlling the pixel to sequentially output a plurality of sub-optical signals at the display interface according to the plurality of sub-coded pixel values, wherein the plurality of sub-optical signals are commonly used for indicating the position of the pixel.

In some embodiments, after the display interface controls each pixel to output a light signal, the method further includes:

and controlling each pixel of the display interface to output a verification light signal for verifying the pixel position.

In a second aspect, the present application provides a remote control method, including:

receiving an optical signal transmitted by a target pixel of a display interface, wherein the optical signal is used for indicating a first position of the target pixel;

transmitting a position signal for indicating the first position to a display end;

and transmitting a determining signal to a display end in response to a cursor displayed in a target area of the display interface, wherein the determining signal is used for indicating the display end to execute an instruction corresponding to the cursor.

In some embodiments, the receiving an optical signal transmitted by a target pixel of a display interface, the optical signal being used to indicate a first position of the target pixel, includes:

a plurality of sub-optical signals transmitted by a target pixel of a display interface are received, the plurality of sub-optical signals collectively being used to indicate a first location of the target pixel.

In some embodiments, after receiving the optical signal transmitted by the target pixel of the display interface, the method further includes:

Receiving a verification light signal transmitted by the target pixel and used for verifying the second position of the target pixel;

determining whether the first location and the second location are the same;

the transmitting, to a display end, a position signal for indicating the first position includes:

and if the first position and the second position are the same, transmitting a position signal for indicating the first position to the display end.

In a third aspect, the present application provides a remote control display control method, which is applied to a display control system, where the display control system includes a display end and a remote control end; the method comprises the following steps:

controlling each pixel of a display interface of the display end to output a light signal, wherein the light signal is used for indicating the position of the pixel;

controlling the remote control end to receive an optical signal transmitted by a target pixel of the display interface, wherein the optical signal transmitted by the target pixel is used for indicating a first position of the target pixel;

controlling the remote control end to transmit a position signal for indicating the first position to a display end;

the display end is controlled to receive the position signal and display a cursor in a target area of the display interface, wherein the position of the target area is the same as the first position;

Controlling the remote control end to transmit a determining signal to the display end;

and controlling the display end to receive the determining signal and execute an instruction corresponding to the cursor.

In a fourth aspect, the present application provides a display device, including:

a pixel control module for controlling each pixel of a display interface to output a light signal, the light signal being used to indicate the position of the pixel;

the cursor display device is used for responding to the received position signal sent by the remote control end, displaying a cursor in a target area of the display interface, wherein the position signal is used for indicating the position of a target pixel, the target pixel corresponds to the light signal received by the remote control end, and the position of the target area is the same as the position of the target pixel;

and the display control module is used for responding to the received determination signal sent by the remote control terminal and executing the instruction corresponding to the cursor.

In a fifth aspect, the present application provides a remote control device comprising:

the display device comprises an optical signal acquisition module, a display module and a display module, wherein the optical signal acquisition module is used for receiving an optical signal transmitted by a target pixel of a display interface, and the optical signal is used for indicating a first position of the target pixel;

the communication module is used for transmitting a position signal for indicating the first position to the display end;

The communication module is further used for responding to a cursor displayed in a target area of the display interface, transmitting a determination signal to a display end, wherein the determination signal is used for indicating the display end to execute an instruction corresponding to the cursor.

In a sixth aspect, the present application provides a display control system, comprising:

a display device comprising a first processor, a first memory and a first computer program stored on the first memory and executable on the first processor, the first computer program implementing the steps of the display control method as described above when executed by the first processor; and/or the number of the groups of groups,

the remote control device comprises a second processor, a second memory and a second computer program stored on the second memory and capable of running on the second processor, wherein the second computer program realizes the steps of the remote control method when being executed by the second processor.

In a seventh aspect, the present application provides a computer readable storage medium having stored thereon a computer program adapted to be loaded by a processor for performing the steps of the display control method as described above; and/or performing the steps of the remote control method as described above.

According to the control method, the device, the system and the storage medium, the display end of the display control method can control each pixel of the display interface to output the optical signal for indicating the pixel position information, and the optical signal can facilitate the remote control end to acquire the position information of the target pixel; when the display receives a position signal which can indicate the position information of the target pixel, a cursor can be displayed on the display interface; when the display receives a determination signal indicating that the cursor position is correct, an instruction corresponding to the cursor may be executed. Based on the display control method, the problem that a cursor can be moved to a target area only by triggering a plurality of remote controllers in the related technology can be solved, and the display control method of the embodiment of the application can acquire the position information of the target area through the optical signals transmitted by the target pixels of the target area only by aiming the remote control end at the target area, so that the display end can rapidly display the control cursor at the target position, the user can be prevented from operating the remote control end for a plurality of times, and the efficiency of remote control display is improved; on the other hand, the display end can only encode the optical signal transmitted by each pixel to indicate the position of the pixel, and the display end does not need to additionally set a hardware structure for position display, so that the cost of the display end is lower; on the other hand, the remote control end receives the optical signals transmitted by the pixels, so that the remote control end is not limited to the type of the display interface, and can perform remote control positioning on the display interface of the display screen and the projected display interface.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the description of the embodiments will be briefly introduced below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a schematic flow chart of a display control method according to an embodiment of the present application.

Fig. 2 is a schematic diagram of pixel encoding according to an embodiment of the present application.

Fig. 3 is a timing diagram of a display end and a remote control end according to an embodiment of the present application.

Fig. 4 is a schematic control flow diagram of a display end according to an embodiment of the present application.

Fig. 5 is a schematic flow chart of a remote control method according to an embodiment of the present application.

Fig. 6 is a schematic control flow diagram of a remote control terminal according to an embodiment of the present application.

Fig. 7 is a schematic flow chart of a remote control display control method according to an embodiment of the present application.

Fig. 8 is a schematic structural diagram of a display device according to an embodiment of the present application.

Fig. 9 is a schematic structural diagram of a remote control device according to an embodiment of the present application.

Fig. 10 is a schematic structural diagram of a display control system according to an embodiment of the present application.

Detailed Description

The technical solutions of the embodiments of the present application will be clearly and completely described below with reference to fig. 1 to 10 of the embodiments of the present application, and it is obvious that the described embodiments are only some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments herein without making any inventive effort, are intended to be within the scope of the present application.

The embodiments of the present application provide a display control method, a remote control method, a remote control display control method, a display device 100, a remote control device 200, a display control system 300, and a computer-readable storage medium. Wherein the display control method may be performed by the display apparatus 100 or by the display control system 300; the remote control method may be performed by the remote control device 200 or by the display control system 300; the remote control display control method may be performed by the display device 100, the remote control device 200, and the display control system 300.

Referring to fig. 1, fig. 1 is a schematic flow chart of a display control method according to an embodiment of the present application. The display control method comprises the following steps:

At 101, each pixel of the display interface is controlled to output a light signal that is used to indicate the location of the pixel.

The display control method may be applied to a display end, where the display end may be a display device 100 such as a television, a projection device, etc., and the display interface may be a display interface presented by a display screen 170 (as shown in fig. 8) of the display end, or the display interface may also be an interface presented by the display end after performing a screen projection operation on other objects. The display end may include a User Interface (UI) module, and when the display end is turned on, the UI module 120 may present multimedia information or setting information, etc. that may be selected by a User on the display Interface.

The display end can be internally provided with a plurality of pixels for displaying information, and the brightness, the color and the like of the light signals emitted outwards by the pixels can be controlled by controlling the pixel values of the pixels, so that the aim of displaying information by the display end is fulfilled. The pixel value of a pixel can be generally represented by R, G, B three characters to represent the color and the brightness, and the value range of R, G, B three characters can be between 0 and 255, for example, when the RGB value of a pixel is (255 ), the pixel can emit white light; when the RGB value of a certain pixel is (0, 0), the pixel may emit black light (not emit light).

The plurality of pixels on the display interface may be arranged in an array, and the position of the pixel may be the position of the pixel on the abscissa and the ordinate of the display interface. For example, the position of the pixel of the 51 st row and 1 st column may be represented as (51, 1) with the abscissa; the position of the pixel of row 51, column 132 may be represented by the abscissa as (51, 132). The display end can encode the position information of the pixel into the light signal emitted by the pixel, so that the display end can output the light signal outwards through each pixel to transmit the position of the pixel through the light signal. Also, when the control pixel emits an optical signal carrying pixel position information, the position coordinates of the pixel may be converted into a binary form, for example, data after conversion of the pixels of the 51 st row to the 132 th column into binary may be 000000110011 to 000010000100.

In some embodiments, controlling each pixel of the display interface to output a light signal includes: acquiring an initial pixel value of each pixel when the pixel is not coded, wherein the initial pixel value at least comprises a first character and a second character; encoding the first character according to the row information of the pixels, encoding the second character according to the column information of the pixels, and obtaining encoded pixel values of the pixels; and controlling each pixel to output an optical signal on a display interface according to the coded pixel value.

It will be appreciated that since each pixel only needs to represent row information and column information, after the original initial pixel value (R, G, B) before each pixel is not encoded is obtained, only two characters of G, B of each pixel may be encoded according to the above encoding rule, and characters of the R value are not encoded, that is, the first character may be a numerical value corresponding to the G value of the pixel, and the second character may be a character corresponding to the B value of the pixel. After the display is turned on and the UI module 120 is turned on, each pixel may first transmit an optical signal, which may be an activation signal, to the outside with an uncoded initial pixel value. Then, the first character and the second character of the G value and the B value of each pixel may be encoded, for example, binary data of row information of the pixel is encoded into the first character, binary data of column information is encoded into the second character, so that each pixel may obtain a new encoded pixel value, and the display end may control each pixel to output an optical signal according to the encoded pixel value.

In some embodiments, since the position coordinates of each pixel are converted to binary and include a plurality of characters, for more accurately displaying the position coordinates of the pixel, encoding the first character according to the row information of the pixel, encoding the second character according to the column information of the pixel, and obtaining the encoded pixel value of the pixel includes: converting the row information of the pixels into a first array, and dividing the first array into a plurality of first subarrays; converting the column information of the pixels into a second array, and dividing the second array into a plurality of second subarrays, the number of which is equal to that of the first subarrays; encoding the first character according to each first subarray to obtain a plurality of third characters; encoding the second characters according to each second subarray to obtain a plurality of fourth characters; a third character and a fourth character are determined as a sub-coded pixel value of the pixel, and a plurality of sub-coded pixel values are obtained. At this time, controlling each pixel to output an optical signal on the display interface according to the encoded pixel value includes: and according to the plurality of sub-coded pixel values, sequentially outputting a plurality of sub-optical signals at the display interface control pixel, wherein the plurality of sub-optical signals are commonly used for indicating the position of the pixel.

The above-described encoding process is exemplarily described below with reference to specific examples. Referring to fig. 2, fig. 2 is a schematic diagram of pixel encoding according to an embodiment of the present application. Taking the pixel of the 51 st row and the 132 th column as an example, after the pixel is converted according to binary, the first array (i.e. row binary data) of the pixel is 000000110011, the second array (i.e. column binary data) of the pixel is 000010000100, and the first array and the second array both comprise 12 characters. At this time, the first array may be divided into 12 first sub-arrays, the second array may be divided into 12 second sub-arrays, the first sub-arrays and the second sub-arrays may be in one-to-one correspondence, and then each first sub-array and one second sub-array corresponding to the first sub-array may be combined to form the G value and the B value in the pixel encoding process; for example, from the above binary right character segmentation, 12 sets of GB values can be obtained: (10) (10), (01), (00), (10), (00), (01), (00). The first character and the second character may then be encoded in the original pixel value of the pixel in accordance with the above-mentioned GB value and new third and fourth characters obtained. For example, the original pixel value of the pixel is (AAA 5C 8), and for better identification of information, when the original G, B value of the specified pixel is 1, the current G, B value is incremented by 1; when the original G, B value is 0, the current G, B value is decremented by 1, so that the plurality of sub-encoded pixel values encoded in accordance with the 12 sets of GB values may be (AAA 6C 7), (AAA 4C 9), (AAA 4C 7), (AAA 6C 7), (AAA 4C 9), (AAA 4C 7). It can be understood that each sub-coded pixel value can make the pixel transmit one sub-optical signal outwards, the pixel can transmit 12 sub-optical signals outwards in one display period, when the remote control end captures the 12 sub-optical signals in one display period, the position of the pixel can be obtained by decoding the GB value of the 12 sub-optical signals.

It will be appreciated that of the 12 sets of GB values described above, the last four GB values are all (00), which results in the last four sets of sub-coded pixel values of the 12 sets of sub-coded pixel values being all (ABA 4C 7), (ABA 4C 7) and (ABA 4C 7). In the actual encoding process, the 4 groups of GB values and four groups of sub-encoded pixel values thereof can be abandoned, only the first 8 groups of GB values and the first 8 groups of sub-encoded pixel values thereof can be encoded, and the pixel can only display sub-optical signals corresponding to the first 8 groups of sub-encoded pixel values in one display period.

It will be appreciated that, to facilitate identifying whether the pixel value is encoded, the R value of the pixel may also be encoded, for example, the R value may be increased by 1 or decreased by 1, and as shown in fig. 2, the plurality of sub-encoded pixel values encoded by the pixel may be (ABA 6C 7), (ABA 4C 9), (ABA 4C 7), (ABA 6C 7), (ABA 4C 9), (ABA 4C 7), and (ABA 4C 7).

In order to further improve the accuracy of displaying the pixel position by the optical signal, after the display interface controls each pixel to output the optical signal, the method further includes: each pixel of the display interface is controlled to output a verification light signal for verifying the position of the pixel. For example, after the pixel has transmitted 12 or 8 sub-optical signals representing the pixel position, a set of check code values may be output, e.g., as shown in fig. 2, where the set of check code values may be (ABA 4C 7). The verification light signals output by the group of verification code values can help the remote control end to confirm whether the acquired pixel positions are correct, so that the accuracy of pixel position coding can be improved.

It should be noted that, the pixel encoding rule in the embodiment of the present application is not limited to the above example, for example, when the original GB value of the pixel is 1, the current GB value may be reduced by 1; when the original GB value is 0, the current GB value is added with 1. The pixel coding rule is not specifically limited in the embodiments of the present application, and all schemes that can code the row and column information of the pixels into the optical signals of the pixels are within the protection scope of the embodiments of the present application.

In 102, a cursor is displayed in a target area of a display interface in response to a received position signal sent by a remote control terminal; the position signal is used for indicating the position of a target pixel, the target pixel corresponds to the light signal received by the remote control end, and the position of the target area is the same as the position of the target pixel.

Referring to fig. 1 in combination with fig. 3, fig. 3 is a timing diagram of a display end and a remote control end according to an embodiment of the present application. After the display end transmits the optical signals and checks the optical signals, the remote control end can acquire the optical signals sent by the target pixels on the display interface, and because the remote control end has directivity, when a user operates the remote control end to point to the target area of the display interface, the remote control end can receive the optical signals transmitted by the target pixels corresponding to the target area, can decode the optical signals and acquire the target positions of the target pixels indicated by the optical signals, and then, the remote control end can regenerate the position signals according to a certain protocol for the target position information and can retransmit the position signals to the display end of the display end. It will be appreciated that the position signal may be used as the position of the target pixel corresponding to the light signal received by the pointing remote.

In some embodiments, the display end may be provided with a first communication module 160, such as, but not limited to, a bluetooth communication module, a wireless fidelity (Wireless Fidelity, wi-Fi) communication module, and an infrared communication module. The communication module can receive the position signals sent by the remote control end through a Bluetooth antenna, a Wi-Fi antenna, an infrared sensor and the like. After the display end receives the position signal, the position signal can be decoded and row and column information can be obtained, and then the display end can display a cursor pattern in a target area of the display interface for confirmation by the remote control end.

In 103, in response to the received determination signal sent by the remote control terminal, an instruction corresponding to the cursor is executed.

When the remote control end determines that the target area where the cursor on the display interface is actually the area which the remote control end wants to control, the remote control end can send a determination signal to the display end, and the display end can execute an instruction corresponding to the cursor according to the determination signal. For example, the content displayed in the target area corresponding to the cursor is "cartoon a", and when the display device receives the determination signal, the display device can control the display device to display the movie work of the cartoon a on the display interface.

It can be understood that, when the target area where the cursor displayed on the display interface of the display end is not the area desired by the user, the user can move the remote control end to another area of the display interface to receive the optical signal and the verification optical signal transmitted by the pixels of the area again, so as to display the cursor on the display interface again.

Referring to fig. 4 in conjunction with fig. 3, fig. 4 is a schematic control flow diagram of a display end according to an embodiment of the present application. The display control method described above is explained below in terms of the display end.

The display terminal is started and initialized, the display terminal can determine whether the display terminal is currently positioned on a display interface of the UI module 120, if not, the display control method of the application is ended, if so, the row and column information of each pixel is encoded into the pixel value of the pixel according to an encoding rule, and an encoded optical signal is obtained; then, the display end can judge whether the position signal transmitted by the remote control end is received, if yes, the cursor display is refreshed, then the display end can judge whether the determination signal is received, if yes, the click operation is executed according to the position indicated by the cursor until the end, and if no determination signal is received, whether the position signal is received is continuously judged again.

According to the display control method, the display end can control each pixel of the display interface to output the optical signal for indicating the pixel position information, and the optical signal can facilitate the remote control end to acquire the position information of the target pixel; when the display receives a position signal which can indicate the position information of the target pixel, a cursor can be displayed on the display interface; when the display receives a determination signal indicating that the cursor position is correct, an instruction corresponding to the cursor may be executed. Based on the display control method, the problem that the cursor can be moved to the target area only by triggering the remote control terminal for a plurality of times in the related art can be solved, and on one hand, the display control method of the embodiment of the application can acquire the position information of the target area through the optical signals transmitted by the target pixels of the target area only by aiming the remote control terminal at the target area, the display terminal can rapidly display the control cursor at the target position, the user can be prevented from operating the remote control terminal for a plurality of times, and the efficiency of remote control display is improved; on the other hand, the display end can only encode the optical signal transmitted by each pixel to indicate the position of the pixel, and the display end does not need to additionally set a hardware structure for position display, so that the cost of the display end is lower; on the other hand, since the remote control terminal receives the optical signals transmitted by the pixels, the remote control terminal in the embodiment of the application is not limited to the type of the display interface, and can perform remote control positioning on both the display interface of the display screen 170 and the projected display interface, so that the control method in the embodiment of the application has wider adaptability.

In addition, in the display control method of the embodiment of the application, in the process of encoding the optical signals output by the pixels, the row and column signals of the optical signals are divided into a plurality of sub-values and encoded into a plurality of sub-encoded pixel values to obtain a plurality of sub-optical signals, and the encoded data character of each sub-optical signal is shorter, so that the decoding of a remote control end can be facilitated, the position recognition efficiency of the remote control end can be improved, and the cursor display efficiency can be improved.

Based on the above display control method, please refer to fig. 3 in combination with fig. 5, and fig. 5 is a schematic flow chart of a remote control method according to an embodiment of the present application. The remote control method comprises the following steps:

in 201, receiving an optical signal transmitted by a target pixel of a display interface, the optical signal transmitted by the target pixel being used to indicate a first location of the target pixel;

after the display end transmits the coded optical signals outwards, the remote control end can receive the optical signals transmitted by the target pixels. The target pixel may be a pixel within a target area of the remote control pointing to the display interface.

The remote control terminal may include an optical lens 222 and a color sensor 221 (as shown in fig. 9), and the optical lens 222 may collect and image the light signal transmitted from the target pixel of the display interface on the light sensing surface of the color sensor 221. The color sensor 221 may acquire an optical signal on the light sensing surface and convert the optical signal into a digital signal, the color sensor 221 may transmit the digital signal to a control module of a remote control end, and the remote control end may decode the digital signal and acquire the first position information corresponding to the target pixel.

In some embodiments, after the display end divides the position information of the target pixel into a plurality of first subarrays and a plurality of second subarrays and forms a plurality of sub-optical signals, the remote control method in the embodiment of the present application receives an optical signal transmitted by the target pixel of the display interface, where the optical signal transmitted by the target pixel is used to indicate the first position of the target pixel, and includes: a plurality of sub-optical signals transmitted by a target pixel of a display interface are received, and the plurality of sub-optical signals transmitted by the target pixel are commonly used for indicating a first position of the target pixel.

It may be appreciated that the color sensor 221 may receive a plurality of sub-optical signals emitted by the target pixel in one display period, and the remote control terminal may decode and determine the first position information corresponding to the target pixel according to the plurality of sub-optical signals.

In some embodiments, after receiving the optical signal transmitted by the target pixel of the display interface, the method further comprises: receiving a verification light signal transmitted by the target pixel and used for verifying the second position of the target pixel; it is determined whether the first location and the second location are the same. At this time, the display terminal may control the target pixel to output a verification light signal for verifying the position of the target pixel, and the verification light signal may indicate the position of the target pixel, that is, the second position, which the display terminal considers. When the first position obtained by decoding the received optical signal by the remote control end is the same as the second position, the information of the first position decoded by the remote control end is considered to be accurate, and the first position information can be reserved. If the first position is different from the second position, the remote control end can discard the captured optical signal and reacquire the optical signal until the first position after the reacquire optical signal is decoded is the same as the second position. Therefore, the accuracy of the remote control end to the determination of the target pixel position can be improved by conveying the verification light signal.

In the remote control method, the optical signals and the calibration optical signals are the optical signals and the calibration optical signals sent by the target pixels, and the specific encoding process of the optical signals and the calibration optical signals sent by the target pixels can be referred to the encoding process of the optical signals and the calibration optical signals output by each pixel in the display control method, which is not described in detail herein.

At 202, transmitting a position signal indicating a first position to a display;

after the remote control end obtains the first position information of the target pixel, the first position information can be regenerated into a position signal capable of being transmitted in a communication mode according to a certain protocol, for example, a second communication module 230 can be arranged in the remote control end, and the remote control end can generate the position signal capable of being transmitted by a Bluetooth antenna, a Wi-Fi antenna and an infrared sensor according to a Bluetooth communication protocol, a Wi-Fi communication protocol, an infrared communication protocol and the like.

It will be appreciated that after the remote control terminal determines whether the first location and the second location are the same, the remote control terminal may transmit a location signal indicating the first location to the display terminal when the first location and the second location are the same.

In 203, in response to the cursor displayed in the target area of the display interface, a determination signal is transmitted to the display end, where the determination signal is used to instruct the display end to execute an instruction corresponding to the cursor.

After the remote control end sends a position signal indicating the position of the target pixel to the display end, the display end can decode and identify the position of the target pixel indicated by the position signal after receiving the position signal, and then the display end can display a cursor in a target area of the display interface. At this time, if the user considers that the position of the cursor is correct, the determination key of the remote control terminal may be turned on so that the remote control terminal may transmit a determination signal to the display terminal through the second communication module 230, and the display terminal may execute an instruction corresponding to the cursor after receiving the determination signal. When the user considers that the target area where the cursor is located is not the area desired by the user, the user can move the remote control end to another area of the display interface to re-receive the optical signals and check the optical signals transmitted by the pixels of the area, so as to re-display the cursor on the display interface.

Referring to fig. 6 in conjunction with fig. 5, fig. 6 is a schematic control flow diagram of a remote control terminal according to an embodiment of the present application. The remote control method is described below in terms of a remote control terminal.

The remote control terminal is started and initialized, and the remote control terminal can determine whether the current mouse mode is in a mouse-free mode, wherein the mouse-free mode is a mode of executing the remote control method by the remote control terminal, and is different from a control mode of moving a cursor step by step according to a UI interface of a display terminal in the related art. If the remote controller does not belong to the air mouse mode, directly ending the remote control scheme of the embodiment of the application; if the remote controller belongs to the air mouse mode, acquiring an optical signal and a verification optical signal emitted by a target pixel of the display end; the remote control end determines whether the optical signal is effective data according to the verification optical signal, if so, generates a position signal according to first position information in the optical signal, and sends the position signal to the display end through the communication module; if the data is not valid data, the mouse mode is judged again or the optical signals are grabbed again and checked again, and the process is carried out again. After the display end displays the cursor according to the position signal, the remote control end can send a confirmation signal to the display end under the confirmation operation of the user, so that the display end can execute clicking operation according to the cursor.

According to the remote control method, the remote control end can decode the first position information of the target pixel according to the received optical signal of the target pixel and can instruct the display end to display a cursor on the display interface, so that the remote control end can be separated from a traditional form and can accurately position the display interface of the display end, large-screen remote control can be realized, a user can be prevented from operating the remote control end for many times, and the efficiency of remote control display is improved. In addition, since the remote control end performs positioning according to the optical signal transmitted by the target pixel, the remote control end in the embodiment of the application is not limited to the type of the display interface, and can perform remote control positioning on both the display interface of the display screen 170 and the projected display interface, so that the adaptability of the remote control method is wider.

Based on the display control method and the remote control method, please refer to fig. 3 and 5 in combination with fig. 7, fig. 7 is a schematic flow chart of the remote control display control method according to an embodiment of the present application. The remote control display control method comprises the following steps:

in 301, controlling each pixel of a display interface of a display end to output an optical signal, wherein the optical signal is used for indicating the position of the pixel;

the display end can be internally provided with a plurality of pixels for displaying information, and the brightness, the color and the like of the light signals emitted outwards by the pixels can be controlled by controlling the pixel values of the pixels. The pixel value of a pixel can be generally represented by R, G, B three characters, and the display end can output a light signal outwards through each pixel so as to transmit the position of the pixel through the light signal.

The plurality of pixels on the display interface may be arranged in an array, and the positions of the pixels may refer to positions of abscissas and ordinates on the display interface where the pixels are located. When the control pixel emits an optical signal carrying the pixel position, the position coordinates of the pixel can be converted into a binary form. The position coordinates are then coded into the pixel value of the pixel so that the position of the pixel can be identified by the light signal emitted by the pixel.

It will be appreciated that the specific process of encoding the position information of the pixels may be found in the description of the previous embodiments and will not be described in detail herein.

In 302, a control remote control receives an optical signal transmitted by a target pixel of a display interface, the optical signal being used to indicate a first position of the target pixel;

after the display end transmits the encoded optical signal outwards, the remote end may receive the optical signal through the optical lens 222 and the color sensor 221. The optical lens 222 may collect and image the light signal transmitted from the target pixel of the display interface on the photosensitive surface of the color sensor 221. The color sensor 221 may acquire an optical signal on the light sensing surface and convert the optical signal into a digital signal, the color sensor 221 may transmit the digital signal to a control module of a remote control end, and the remote control end may decode the digital signal and acquire the first position information corresponding to the target pixel.

In 303, the control remote control end transmits a position signal for indicating the first position to the display end;

In 304, the control display receives the position signal and displays a cursor in a target area of the display interface, wherein the position of the target area is the same as the first position;

the display end can be internally provided with a first communication module 160, after the display end receives the position signal, the position signal can be decoded and row and column information can be obtained, and then the display end can display a cursor pattern in a target area of the display interface for confirmation by the remote control end.

In 305, the control remote control end transmits a determination signal to the display end;

in 306, the control display receives the determination signal and executes an instruction corresponding to the cursor.

When the remote control end determines that the target area where the cursor on the display interface is actually the area which the remote control end wants to control, the remote control end can send a determination signal to the display end such as the display end, and the display end can execute an instruction corresponding to the cursor according to the determination signal. For example, the content displayed in the target area corresponding to the cursor is "cartoon a", and when the display device receives the determination signal, the display device can control the display device to display the movie work of the cartoon a on the display interface.

It can be understood that, when the target area where the cursor displayed on the display interface of the display end is not the area desired by the user, the user can move the remote control end to another area of the display interface to receive the optical signal and check the optical signal transmitted by the pixel of the area again, so as to display the cursor on the display interface again.

According to the remote control display control method, each pixel of the display end can transmit an optical signal carrying the pixel position information outwards, the remote control end can receive the optical signal transmitted by the target pixel, decode the position information of the target pixel and send the position signal to the display end, and the display end can display a cursor according to the position signal and confirm execution operation corresponding to the cursor after receiving a confirmation signal. Based on the above, the remote control display control method of the embodiment of the application can control the cursor of the display end to move and select by using the remote control end, thereby increasing the operation flexibility and reducing the selection difficulty of the display interface; and moreover, the remote control terminal can realize a simulated shooting game by utilizing the control mode, so that the intelligentization and technological degree of the display terminal are increased.

In order to better implement the display control method, the remote control method, and the remote control display control method of the embodiments of the present application, the embodiments of the present application further provide a display device 100, such as a television, based on the display control method. Referring to fig. 8, fig. 8 is a schematic structural diagram of a display device 100 according to an embodiment of the disclosure. The display device 100 includes a first main control module 110, a UI module 120, a pixel control module 130, a cursor display device 140, a display control module 150, a first communication module 160, and a display 170.

The UI module 120 is configured to control the display screen 170 to display an initial UI interface after the display device 100 is started and initialized. The UI interface can present an interface for interaction with a user, and the user can select multimedia information and setting information. The pixel control module 130 may control each pixel of the display interface to output a light signal that may indicate the location of the pixel. The cursor display device 140 may display a cursor on a target area of the display interface in response to the received position signal sent by the remote control terminal, where the position signal is used to indicate a position of a target pixel, and the target pixel corresponds to the optical signal received by the remote control terminal, and the position of the target area is the same as the position of the target pixel. The display control module 150 may execute an instruction corresponding to a cursor at the display apparatus 100 in response to the received determination signal transmitted from the remote control terminal. The first communication module 160 may be in communication connection with the remote control end, and the first communication module 160 may receive the position signal and the determination signal sent by the remote control, so that the cursor display device 140 and the display control module 150 perform corresponding operations. Display 170 may present a display interface to display text and images to a user.

It can be appreciated that the UI module 120, the pixel control module 130, the cursor display device 140, the display control module 150, the first communication module 160, and the display screen 170 may be electrically connected to the first main control module 110, and the first main control module 110 may control the above modules to perform corresponding operations.

In some embodiments, the pixel control module 130 may also be configured to: acquiring an initial pixel value of each pixel when the pixel is not coded, wherein the initial pixel value at least comprises a first character and a second character; encoding the first character according to the row information of the pixels, encoding the second character according to the column information of the pixels, and obtaining encoded pixel values of the pixels; and controlling each pixel to output an optical signal on a display interface according to the coded pixel value.

In some embodiments, the pixel control module 130 may also be configured to: converting the row information of the pixels into a first array, and dividing the first array into a plurality of first subarrays; converting the column information of the pixels into a second array, and dividing the second array into a plurality of second subarrays with the same number as the first subarrays; encoding the first character according to each first subarray to obtain a plurality of third characters, and encoding the second character according to each second subarray to obtain a plurality of fourth characters; determining a third character and a fourth character as a sub-coded pixel value of the pixel, and obtaining a plurality of sub-coded pixel values; and according to the plurality of sub-coded pixel values, sequentially outputting a plurality of sub-optical signals at the display interface control pixel, wherein the plurality of sub-optical signals are commonly used for indicating the position of the pixel.

In some embodiments, the pixel control module 130 may also be configured to: each pixel of the display interface is controlled to output a verification light signal for verifying the position of the pixel.

It should be noted that the display 170 of the display device 100 may be a liquid crystal or light emitting diode display 170 in a physical form of the display device 100, or may be a display carrier of a screen-throwing apparatus after the screen is thrown, such as a curtain, a wall of the screen, and the like. The specific structure of the display 170 is not limited in the embodiment of the present application.

The display device 100 according to the embodiment of the present application may only encode the optical signal transmitted by each pixel so that the optical signal may indicate the position of the pixel, and the display device 100 does not need to additionally provide a hardware structure for displaying the position, so that the cost of the display device 100 is low. In addition, the user can acquire the position information of the target area through the optical signals transmitted by the target pixels of the target area only by aiming the remote control end at the target area, the display device 100 can rapidly display a control cursor at the target position, the user can be prevented from operating the remote control end for many times, and the efficiency of remote control display is improved.

It should be noted that, the display device 100 provided in the embodiment of the present application and the display control method in the above embodiment belong to the same concept, and detailed implementation processes of the display device 100 are shown in the embodiment of the display control method, which is not described herein.

In order to better implement the remote control method of the embodiment of the present application, on the basis of the remote control method, the embodiment of the present application further provides a remote control device 200, for example, a remote controller. Referring to fig. 9, fig. 9 is a schematic structural diagram of a remote control device 200 according to an embodiment of the present application. The remote control device 200 includes a second main control module 210, an optical signal acquisition module 220, and a second communication module 230.

The optical signal acquisition module 220 is configured to: and receiving an optical signal transmitted by a target pixel of a display interface of the display end, wherein the optical signal transmitted by the target pixel is used for indicating a first position of the target pixel. The second main control module 210 is configured to decode, verify, and re-generate a position signal for indicating the first position according to the communication protocol according to the optical signal transmitted by the target pixel; the communication module can transmit the position signal to the display end; the second main control module 210 may also receive a signal input by the user to determine that the position of the cursor is correct, and then the second main control module 210 may control the second communication module 230, so that the second communication module 230 is further configured to: and transmitting a determining signal to the display end in response to a cursor displayed in a target area of the display interface, wherein the determining signal is used for indicating the display end to execute an instruction corresponding to the cursor.

In some embodiments, the optical signal acquisition module 220 may include an optical lens 222 and a color sensor 221, and the optical lens 222 may collect and image the optical signal transmitted by the target pixel of the display interface on the photosurface of the color sensor 221. The color sensor 221 may acquire an optical signal on the light sensing surface and convert the optical signal into a digital signal, the color sensor 221 may transmit the digital signal to a control module of the remote control end, and the remote control device 200 may decode the digital signal and acquire the first position information corresponding to the target pixel.

In some embodiments, the optical signal acquisition module 220 is further configured to: a plurality of sub-optical signals transmitted by a target pixel of a display interface are received, the plurality of sub-optical signals being used together to indicate a first position of the target pixel.

In some embodiments, the optical signal acquisition module 220 is further configured to: receiving a verification light signal transmitted by the target pixel and used for verifying the second position of the target pixel; it is determined whether the first location and the second location are the same. The second communication module 230 is further configured to: and if the first position and the second position are the same, transmitting a position signal for indicating the first position to the display end.

The remote control device 200 of the embodiment of the application can be separated from the traditional mode and can accurately position the display interface of the display end, can realize large-screen remote control, can avoid a user to control the remote control device 200 for many times, and improves the efficiency of remote control display.

It should be noted that, the remote control device 200 provided in the embodiment of the present application and the remote control method in the above embodiment belong to the same concept, and detailed implementation procedures of the remote control device 200 are shown in the remote control method embodiment, which is not repeated here.

In order to better implement the remote control display control method of the embodiment of the present application, on the basis of the remote control display control method, the embodiment of the present application further provides a display control system 300. Referring to fig. 10, fig. 10 is a schematic structural diagram of a display control system 300 according to an embodiment of the present application. The display control system 300 includes the display device 100 and the remote control device 200.

The display device 100 includes a first processor 311, a first memory 312, and a first computer program stored on the first memory 312 and executable on the first processor 311. The first processor 311 may be electrically connected to the first memory 312. The first processor 311 is a control center of the display apparatus 100, connects respective portions of the entire display apparatus 100 using various interfaces and lines, and performs various functions of the display apparatus 100 and processes data by running or loading software programs and/or modules stored in the first memory 312 and calling data stored in the first memory 312, thereby performing overall monitoring of the display apparatus 100.

In this embodiment of the present application, the first processor 311 in the display apparatus 100 loads instructions corresponding to the processes of one or more application programs into the first memory 312 according to the following steps, and the first processor 311 executes the application programs stored in the first memory 312, so as to implement the device control method provided in the present application, for example: controlling each pixel of the display interface to output a light signal, wherein the light signal is used for indicating the position of the pixel; responding to a received position signal sent by a remote control end, displaying a cursor in a target area of a display interface, wherein the position signal is used for indicating the position of a target pixel corresponding to an optical signal received by the remote control end, and the position of the target area is the same as the position of the target pixel; and responding to the received determination signal sent by the remote control end, and executing an instruction corresponding to the cursor.

The remote control device 200 includes a second processor 313, a second memory 314, and a second computer program stored in the second memory 314 and executable on the second processor 313, wherein the second processor 313 is electrically connected to the second memory 314. The second processor 313 is a control center of the display device 100, connects various parts of the entire display device 100 using various interfaces and lines, and performs various functions of the display device 100 and processes data by running or loading software programs and/or modules stored in the second memory 314 and calling data stored in the second memory 314, thereby performing overall monitoring of the remote control device 200.

In this embodiment of the present application, the second processor 313 in the remote control device 200 loads instructions corresponding to the processes of one or more application programs into the second memory 314 according to the following steps, and the second processor 313 runs the application programs stored in the second memory 314, so as to implement the device control method provided in the present application, for example: receiving an optical signal transmitted by a target pixel of a display interface, wherein the optical signal transmitted by the target pixel is used for indicating a first position of the target pixel; transmitting a position signal for indicating the first position to a display end; and transmitting a determining signal to a display end in response to a cursor displayed in a target area of a display interface, wherein the determining signal is used for indicating to execute an instruction corresponding to the cursor.

It will be appreciated that the remote control terminal in the above embodiment may be the remote control device 200; the display end may be the display device 100.

It should be understood that the specific implementation of each operation of the display device 100 and the remote control device 200 can be seen in the previous embodiments, and will not be repeated herein. In the foregoing embodiments, the descriptions of the embodiments are emphasized, and for parts of one embodiment that are not described in detail, reference may be made to related descriptions of other embodiments.

Those of ordinary skill in the art will appreciate that all or a portion of the steps in the various methods of the above embodiments may be performed by instructions, or by instructions controlling associated hardware, which may be stored in a computer-readable storage medium and loaded and executed by a processor.

To this end, embodiments of the present application provide a computer-readable storage medium having a computer program stored therein, which when executed by a processor, implements steps of any one of the display control methods provided in the embodiments of the present application, and/or steps of any one of the remote control methods. For example, the instructions may perform the steps of: controlling each pixel of the display interface to output a light signal, wherein the light signal is used for indicating the position of the pixel; responding to a received position signal sent by a remote control end, displaying a cursor in a target area of a display interface, wherein the position signal is used for indicating the position of a target pixel, the target pixel corresponds to an optical signal received by the remote control end, and the position of the target area is the same as the position of the target pixel; and responding to the received determination signal sent by the remote control end, and executing an instruction corresponding to the cursor. As another example, the instructions may perform the steps of: receiving an optical signal transmitted by a target pixel of a display interface, wherein the optical signal transmitted by the target pixel is used for indicating a first position of the target pixel; transmitting a position signal for indicating the first position to a display end; and transmitting a determining signal to the display end in response to a cursor displayed in a target area of the display interface, wherein the determining signal is used for indicating the display end to execute an instruction corresponding to the cursor.

The specific implementation of each operation above may be referred to the previous embodiments, and will not be described herein.

Wherein the storage medium may include: read Only Memory (ROM), random access Memory (RAM, random Access Memory), magnetic or optical disk, and the like.

The instructions stored in the storage medium may perform any step of the display control method provided in the embodiments of the present application and/or any step of the remote control method, so that any one of the display control method and the remote control method provided in the embodiments of the present application may achieve the beneficial effects that can be achieved, which are detailed in the previous embodiments and are not described herein.

It should be understood that in the description of this application, terms such as "first," "second," and the like are used merely to distinguish between similar objects and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated.

The foregoing has described in detail a control method, apparatus, system and storage medium provided by the embodiments of the present application, and specific examples have been applied herein to illustrate the principles and embodiments of the present application, where the foregoing examples are provided to assist in understanding the methods and core ideas of the present application; meanwhile, those skilled in the art will have variations in the specific embodiments and application scope in light of the ideas of the present application, and the present description should not be construed as limiting the present application in view of the above.

Claims

1. A display control method, characterized by comprising:

according to the multiple sub-coded pixel values, controlling the pixel to sequentially output multiple sub-optical signals on a display interface, wherein the multiple sub-optical signals are commonly used for indicating the position of the pixel;

2. The display control method according to claim 1, further comprising, after the display interface controls the pixels to sequentially output the plurality of sub-light signals:

3. A remote control method, comprising:

receiving a plurality of sub-optical signals transmitted by a target pixel of a display interface, wherein the plurality of sub-optical signals are commonly used for indicating a first position of the target pixel, the plurality of sub-optical signals are initial pixel values obtained by a display end when each pixel is not coded, and the initial pixel values at least comprise a first character and a second character; converting the row information of the pixels into a first array, and dividing the first array into a plurality of first subarrays; converting the column information of the pixels into a second array, and dividing the second array into a plurality of second subarrays equal to the first subarrays in number; encoding the first character according to each first subarray to obtain a plurality of third characters; encoding the second character according to each second subarray to obtain a plurality of fourth characters; determining one of said third character and one of said fourth character as a sub-coded pixel value of said pixel and obtaining a plurality of said sub-coded pixel values; controlling signals sequentially output by the pixels on the display interface according to the plurality of sub-coded pixel values, wherein the target pixels are pixels in a target area of the display interface pointed by a remote control end;

Transmitting a position signal for indicating the first position to the display terminal;

4. The remote control method according to claim 3, wherein after receiving the plurality of sub-light signals transmitted from the target pixel of the display interface, further comprising:

determining whether the first location and the second location are the same;

5. The remote control display control method is characterized by being applied to a display control system, wherein the display control system comprises a display end and a remote control end; the method comprises the following steps:

the display end is controlled to acquire an initial pixel value of each pixel when the pixel is not coded, wherein the initial pixel value at least comprises a first character and a second character; converting the row information of the pixels into a first array, and dividing the first array into a plurality of first subarrays; converting the column information of the pixels into a second array, and dividing the second array into a plurality of second subarrays equal to the first subarrays in number; encoding the first character according to each first subarray to obtain a plurality of third characters; encoding the second character according to each second subarray to obtain a plurality of fourth characters; determining one of said third character and one of said fourth character as a sub-coded pixel value of said pixel and obtaining a plurality of said sub-coded pixel values; according to the multiple sub-coded pixel values, controlling the pixel to sequentially output multiple sub-optical signals on a display interface, wherein the multiple sub-optical signals are commonly used for indicating the position of the pixel;

Controlling the remote control terminal to receive a plurality of sub-optical signals transmitted by a target pixel of the display interface, wherein the plurality of sub-optical signals are commonly used for indicating a first position of the target pixel;

6. A display device, comprising:

the pixel control module is used for acquiring an initial pixel value of each pixel when the pixel is not coded, wherein the initial pixel value at least comprises a first character and a second character; converting the row information of the pixels into a first array, and dividing the first array into a plurality of first subarrays; converting the column information of the pixels into a second array, and dividing the second array into a plurality of second subarrays equal to the first subarrays in number; encoding the first character according to each first subarray to obtain a plurality of third characters; encoding the second character according to each second subarray to obtain a plurality of fourth characters; determining one of said third character and one of said fourth character as a sub-coded pixel value of said pixel and obtaining a plurality of said sub-coded pixel values; according to the multiple sub-coded pixel values, controlling the pixel to sequentially output multiple sub-optical signals on a display interface, wherein the multiple sub-optical signals are commonly used for indicating the position of the pixel;

7. A remote control device, comprising:

the optical signal acquisition module is used for receiving a plurality of sub-optical signals transmitted by a target pixel of a display interface, the plurality of sub-optical signals are commonly used for indicating a first position of the target pixel, the plurality of sub-optical signals are used for acquiring an initial pixel value of each pixel when the pixel is not coded for a display end, and the initial pixel value at least comprises a first character and a second character; converting the row information of the pixels into a first array, and dividing the first array into a plurality of first subarrays; converting the column information of the pixels into a second array, and dividing the second array into a plurality of second subarrays equal to the first subarrays in number; encoding the first character according to each first subarray to obtain a plurality of third characters; encoding the second character according to each second subarray to obtain a plurality of fourth characters; determining one of said third character and one of said fourth character as a sub-coded pixel value of said pixel and obtaining a plurality of said sub-coded pixel values; controlling signals sequentially output by the pixels on the display interface according to the plurality of sub-coded pixel values, wherein the target pixels are pixels in a target area of the display interface pointed by a remote control end; and

8. A display control system, comprising:

display device comprising a first processor, a first memory and a first computer program stored on the first memory and executable on the first processor, the first computer program implementing the steps of the display control method according to any one of claims 1 to 2 when executed by the first processor; and/or the number of the groups of groups,

remote control device comprising a second processor, a second memory and a second computer program stored on the second memory and executable on the second processor, which second computer program, when executed by the second processor, implements the steps of the remote control method according to any one of claims 3 to 4.

9. A computer readable storage medium, characterized in that the computer readable storage medium has stored thereon a computer program adapted to be loaded by a processor for performing the steps of the display control method according to any of claims 1 to 2; and/or performing the steps of the remote control method as claimed in any one of claims 3 to 4.