CN113905262A

CN113905262A - Control method, device, system and storage medium

Info

Publication number: CN113905262A
Application number: CN202111151210.7A
Authority: CN
Inventors: 孙声鹏
Original assignee: Huizhou Shiwei New Technology Co Ltd
Current assignee: Huizhou Shiwei New Technology Co Ltd
Priority date: 2021-09-29
Filing date: 2021-09-29
Publication date: 2022-01-07
Anticipated expiration: 2041-09-29
Also published as: CN113905262B

Abstract

The application discloses a control method, a device, a system and a storage medium, wherein the control method comprises the following steps: controlling each pixel of the display interface to output an optical signal, wherein the optical signal is used for indicating the position of the pixel; responding to a received position signal sent by the remote control end, displaying a cursor in a target area of a display interface, wherein the position signal is used for indicating the position of a target pixel, the target pixel corresponds to the optical signal received by the remote control end, and the position of the target area is the same as the position of the target pixel; and executing the instruction corresponding to the cursor in response to the received determination signal sent by the remote control terminal. Therefore, the control method can avoid the situation that a user controls the remote control end for many times, and improves the efficiency of remote control display.

Description

Control method, device, system and storage medium

Technical Field

The present application relates to the field of television control technologies, and in particular, to a control method, apparatus, system, and storage medium.

Background

Along with the rapid development of the smart television, the operation experience of the remote controller is more and more limited, the remote controller often needs to be triggered for many times to move the cursor to a proper position, and the operation and the selection of the movie playing and displaying by using the remote controller are very complicated. Therefore, a solution that can simplify the remote control display is needed.

Disclosure of Invention

The application provides a control method, a control device, a control system and a storage medium. The control method can quickly display the cursor on the display interface so as to avoid the user from operating the remote controller for many times and improve the efficiency of remote control display.

In a first aspect, the present application provides a display control method, including:

controlling each pixel of a display interface to output an optical signal, wherein the optical signal is used for indicating the position of the pixel;

displaying a cursor in a target area of the display interface in response to a received position signal sent by a remote control end, wherein the position signal is used for indicating the position of a target pixel, the target pixel corresponds to a light signal received by the remote control end, and the position of the target area is the same as the position of the target pixel;

and responding to the received determination signal sent by the remote control terminal, and executing the instruction corresponding to the cursor.

In some embodiments, the controlling each pixel of the display interface to output an optical signal comprises:

acquiring an initial pixel value when each pixel is not coded, wherein the initial pixel value at least comprises a first character and a second character;

coding the first character according to the row information of the pixel, coding the second character according to the column information of the pixel, and obtaining a coded pixel value of the pixel;

and controlling each pixel to output an optical signal on the display interface according to the coded pixel value.

In some embodiments, said encoding said first character according to row information of said pixel, encoding said second character according to column information of said pixel, and obtaining an encoded pixel value of said pixel comprises:

converting the row information of the pixels into a first array, and dividing the first array into a plurality of first sub-arrays;

converting the column information of the pixels into a second array, and dividing the second array into a plurality of second sub-arrays with the number equal to that of the first sub-arrays;

coding the first characters according to each first sub-number group to obtain a plurality of third characters;

coding the second characters according to each second sub-number group to obtain a plurality of fourth characters;

determining one of said third characters and one of said fourth characters as a sub-coded pixel value of said pixel, and obtaining a plurality of said sub-coded pixel values;

the controlling each of the pixels to output an optical signal on the display interface according to the encoded pixel value includes:

and controlling the pixel to sequentially output a plurality of sub-optical signals on the display interface according to the plurality of sub-coded pixel values, wherein the plurality of sub-optical signals are commonly used for indicating the position of the pixel.

In some embodiments, after the controlling the output light signal of each pixel by the display interface, the method further includes:

and controlling each pixel of the display interface to output a verification optical signal for verifying the pixel position.

In a second aspect, the present application provides a remote control method, including:

receiving an optical signal transmitted by a target pixel of a display interface, wherein the optical signal is used for indicating a first position of the target pixel;

transmitting a position signal for indicating the first position to a display end;

and responding to a cursor displayed in a target area of the display interface, and transmitting a determination signal to a display end, wherein the determination signal is used for indicating the display end to execute an instruction corresponding to the cursor.

In some embodiments, the receiving a light signal transmitted by a target pixel of a display interface, the light signal indicating a first position of the target pixel, includes:

the method comprises the steps of receiving a plurality of sub-optical signals transmitted by a target pixel of a display interface, wherein the plurality of sub-optical signals are used for indicating a first position of the target pixel.

In some embodiments, after receiving the optical signal transmitted by the target pixel of the display interface, the method further includes:

receiving a verification optical signal transmitted by the target pixel and used for verifying a second position of the target pixel;

determining whether the first location and the second location are the same;

the transmitting a position signal indicating the first position to a display terminal includes:

and if the first position is the same as the second position, transmitting a position signal for indicating the first position to the display end.

In a third aspect, the present application provides a remote control display control method, which is applied to a display control system, where the display control system includes a display end and a remote control end; the method comprises the following steps:

controlling each pixel of a display interface of the display end to output an optical signal, wherein the optical signal is used for indicating the position of the pixel;

controlling the remote control end to receive an optical signal transmitted by a target pixel of the display interface, wherein the optical signal transmitted by the target pixel is used for indicating a first position of the target pixel;

controlling the remote control end to transmit a position signal for indicating the first position to a display end;

controlling the display end to receive the position signal and display a cursor in a target area of the display interface, wherein the position of the target area is the same as the first position;

controlling the remote control end to transmit a determination signal to the display end;

and controlling the display end to receive the determination signal and execute an instruction corresponding to the cursor.

In a fourth aspect, the present application provides a display device comprising:

the pixel control module is used for controlling each pixel of the display interface to output an optical signal, and the optical signal is used for indicating the position of the pixel;

the cursor display device is used for responding to a received position signal sent by the remote control end and displaying a cursor in a target area of the display interface, wherein the position signal is used for indicating the position of a target pixel, the target pixel corresponds to a light signal received by the remote control end, and the position of the target area is the same as the position of the target pixel;

and the display control module is used for responding to the received determination signal sent by the remote control end and executing the instruction corresponding to the cursor.

In a fifth aspect, the present application provides a remote control device comprising:

the optical signal acquisition module is used for receiving an optical signal transmitted by a target pixel of a display interface, wherein the optical signal is used for indicating a first position of the target pixel;

the communication module is used for transmitting a position signal for indicating the first position to a display end;

the communication module is further used for responding to a cursor displayed in a target area of the display interface and transmitting a determination signal to a display end, wherein the determination signal is used for indicating the display end to execute an instruction corresponding to the cursor.

In a sixth aspect, the present application provides a display control system comprising:

a display device comprising a first processor, a first memory and a first computer program stored on the first memory and executable on the first processor, the first computer program, when executed by the first processor, implementing the steps of the display control method as described above; and/or the presence of a gas in the gas,

remote control device comprising a second processor, a second memory and a second computer program stored on said second memory and executable on said second processor, said second computer program, when executed by said second processor, implementing the steps of the remote control method as described above.

In a seventh aspect, the present application provides a computer readable storage medium having stored thereon a computer program adapted to be loaded by a processor for performing the steps of the display control method as described above; and/or performing the steps of the remote control method as described above.

According to the control method, the device, the system and the storage medium, the display end of the display control method can control each pixel of the display interface to output the optical signal for indicating the position information of the pixel, and the optical signal can be convenient for the remote control end to acquire the position information of the target pixel; after the display end receives the position signal which can indicate the position information of the target pixel, a cursor can be displayed on the display interface; when the display receives a determination signal indicating that the cursor is correctly positioned, the instruction corresponding to the cursor can be executed. Based on the display control method, the problem that the cursor can be moved to the target area only by triggering the remote controller for many times in the related technology can be solved, on one hand, the display control method of the embodiment of the application can obtain the position information of the target area through the optical signal transmitted by the target pixel of the target area only by aligning the remote control end to the target area, the display end can quickly display the control cursor at the target position, the user can be prevented from controlling the remote control end for many times, and the remote control display efficiency is improved; on the other hand, the display end can only encode the optical signal transmitted by each pixel to indicate the position of the pixel, and the display end does not need to additionally arrange a hardware structure for position display, so that the cost of the display end is low; in another aspect, the remote control end receives the optical signal transmitted by the pixel, so that the remote control end of the embodiment of the application is not limited to the type of the display interface, and can perform remote control positioning on both the display interface of the display screen and the projected display interface, and the control method of the embodiment of the application has wider adaptability.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 is a schematic flowchart of a display control method according to an embodiment of the present disclosure.

Fig. 2 is a schematic diagram of pixel encoding according to an embodiment of the present application.

Fig. 3 is a timing diagram of a display terminal and a remote control terminal according to an embodiment of the present disclosure.

Fig. 4 is a schematic control flow diagram of a display end according to an embodiment of the present application.

Fig. 5 is a schematic flowchart of a remote control method according to an embodiment of the present application.

Fig. 6 is a schematic control flow diagram of a remote control end according to an embodiment of the present application.

Fig. 7 is a schematic flowchart of a remote control display control method according to an embodiment of the present application.

Fig. 8 is a schematic structural diagram of a display device according to an embodiment of the present disclosure.

Fig. 9 is a schematic structural diagram of a remote control device according to an embodiment of the present application.

Fig. 10 is a schematic structural diagram of a display control system according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be described clearly and completely with reference to fig. 1 to 10 in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The embodiment of the application provides a display control method, a remote control display control method, a display device 100, a remote control device 200, a display control system 300 and a computer readable storage medium. The display control method may be executed by the display device 100 or the display control system 300; the remote control method may be executed by the remote control device 200 or by the display control system 300; the remote control display control method may be executed by the display apparatus 100, the remote control apparatus 200, and the display control system 300.

Referring to fig. 1, fig. 1 is a schematic flow chart of a display control method according to an embodiment of the present disclosure. The display control method comprises the following steps:

in 101, each pixel of the display interface is controlled to output a light signal indicating a position of the pixel.

The display control method may be applied to a display terminal, where the display terminal may be a display device 100 such as a television or a projection apparatus, and the display interface may be a display interface presented by a display screen 170 (shown in fig. 8) of the display terminal, or the display interface may also be an interface presented after the display terminal performs a screen projection operation on another object. The display end may include a User Interface (UI) module, and when the display end is turned on, the UI module 120 may present multimedia information or setting information that can be selected by a User on the display Interface.

The display end can be internally provided with a plurality of pixels for displaying information, and the brightness, the color and the like of light signals emitted by the pixels can be controlled by controlling the pixel values of the pixels, so that the aim of displaying the information by the display end is fulfilled. The pixel value of a pixel can be represented by R, G, B three characters, and the value range of R, G, B three characters can be between 0 and 255, for example, when the RGB value of a pixel is (255 ), the pixel can emit white light; when the RGB value of a certain pixel is (0, 0), the pixel may emit black light (no light emission).

The plurality of pixels on the display interface may be arranged in an array, and the position of the pixel may be a position of a horizontal coordinate and a vertical coordinate of the pixel on the display interface. For example, the position of the pixel in row 51, column 1 may be represented by (51, 1) in the horizontal and vertical coordinates; the position of the pixel in row 51 and column 132 can be represented by (51, 132) in the horizontal and vertical axes. The display end can encode the position information of the pixel into the optical signal emitted by the pixel, so that the display end can output the optical signal outwards through each pixel to transfer the position of the pixel through the optical signal. Also, when the control pixels emit light signals carrying pixel position information, the position coordinates of the pixels may be converted into a binary form, for example, the data after the pixels of 51 st row to 132 th column are converted into a binary may be 000000110011 to 000010000100.

In some embodiments, controlling each pixel of the display interface to output an optical signal comprises: acquiring an initial pixel value when each pixel is not coded, wherein the initial pixel value at least comprises a first character and a second character; coding a first character according to the row information of the pixel, coding a second character according to the column information of the pixel, and obtaining a coding pixel value of the pixel; and controlling each pixel to output an optical signal on the display interface according to the encoded pixel value.

It can be understood that, since each pixel only needs to represent row information and column information, after the original initial pixel value (R, G, B) of each pixel before encoding is obtained, only G, B two characters of each pixel may be encoded according to the above encoding rule, instead of encoding the character of the R value, that is, the first character may be a numerical value corresponding to the G value of the pixel, and the second character may be a character corresponding to the B value of the pixel. After the display is turned on and the UI module 120 is activated, each pixel may first transmit an optical signal, which may be an activation signal, to the outside with an uncoded initial pixel value. Then, the first character and the second character of the G value and the B value of each pixel may be encoded, for example, binary data of row information of the pixel is encoded into the first character, binary data of column information is encoded into the second character, so that each pixel may obtain a new encoded pixel value, and the display end may control each pixel to output an optical signal according to the encoded pixel value.

In some embodiments, since the position coordinates of each pixel include a plurality of characters after being converted into a binary system, in order to more accurately display the position coordinates of the pixel, encoding a first character according to row information of the pixel, encoding a second character according to column information of the pixel, and obtaining an encoded pixel value of the pixel includes: converting the row information of the pixels into a first array, and dividing the first array into a plurality of first sub-arrays; converting the column information of the pixels into a second array, and dividing the second array into a plurality of second sub-arrays with the number equal to that of the first sub-arrays; coding the first character according to each first sub-number group to obtain a plurality of third characters; coding the second characters according to each second sub-number group to obtain a plurality of fourth characters; a third character and a fourth character are determined as a sub-coded pixel value of the pixel, and a plurality of sub-coded pixel values are obtained. At this time, controlling each pixel to output an optical signal on a display interface according to the encoded pixel value includes: and controlling the pixels to sequentially output a plurality of sub-optical signals on the display interface according to the plurality of sub-coded pixel values, wherein the plurality of sub-optical signals are commonly used for indicating the positions of the pixels.

The above encoding process is exemplarily described below with reference to specific examples. Referring to fig. 2, fig. 2 is a schematic diagram of pixel encoding according to an embodiment of the present disclosure. Taking the pixel of row 51, column 132 as an example, after the pixel is binary-converted, the first array (i.e. row binary data) of the pixel is 000000110011, the second array (i.e. column binary data) of the pixel is 000010000100, and the first array and the second array both contain 12 characters. At this time, the first array may be divided into 12 first sub-arrays, the second array may be divided into 12 second sub-arrays, the first sub-arrays and the second sub-arrays are in one-to-one correspondence, and then each first sub-array and one second sub-array corresponding to the first sub-array may be combined to form a G value and a B value in the pixel encoding process; for example, by dividing from the right character of the binary system, 12 groups of GB values can be obtained: (10) (10), (01), (00), (10), (00), (01), (00). The first character and the second character may then be encoded in the original pixel value of the pixel according to the GB value and new third and fourth characters may be obtained. For example, the original pixel value of the pixel is (AAA5C8), and for better information identification, when the original G, B value of the pixel is defined as 1, the current G, B value is increased by 1; when the original G, B value is 0, the current G, B value is reduced by 1, so that a plurality of sub-encoded pixel values encoded according to 12 groups of GB values may be (AAA6C7), (AAA6C7), (AAA4C9), (AAA4C7), (AAA6C7), (AAA6C7), (AAA4C7), (AAA4C9), (AAA4C7), (AAA4C7), (AAA4C7), or AAA4C 7. It can be understood that each sub-coded pixel value may enable the pixel to transmit one sub-optical signal outwards, the pixel may transmit 12 sub-optical signals outwards in one display period, and when the remote control end captures the 12 sub-optical signals in one display period, the GB value of the 12 sub-optical signals is decoded to obtain the position of the pixel.

It is understood that the last four GB values of the 12 GB values are all (00), which results in the last four sub-encoded pixel values of the 12 sub-encoded pixel values being all (ABA4C7), (ABA4C7), (ABA4C7), and (ABA4C 7). In the actual encoding process, the 4 groups of GB values and four groups of sub-encoding pixel values thereof can be abandoned, only the first 8 groups of GB values and the first 8 groups of sub-encoding pixel values thereof are encoded, and the pixel can only display sub-optical signals corresponding to the first 8 groups of sub-encoding pixel values in one display period.

It is understood that, in order to facilitate to identify whether the pixel value is encoded, the R value of the pixel may also be encoded, for example, the R value may be increased by 1 or decreased by 1, and as shown in fig. 2, the plurality of sub-encoded pixel values after the pixel is encoded may be (ABA6C7), (ABA6C7), (ABA4C9), (ABA4C7), (ABA6C7), (ABA6C7), (ABA4C7), (ABA4C9), (ABA4C7), (ABA4C7), (ABA4C7), or (ABA4C 7).

In order to further improve the accuracy of the pixel position displayed by the pixel through the optical signal, after the display interface controls each pixel to output the optical signal, the method further includes: and controlling each pixel of the display interface to output a verification optical signal for verifying the position of the pixel. For example, after the pixel has sent 12 or 8 sub-optical signals that may represent the pixel position, a set of parity encoding values may also be output, such as shown in fig. 2, which may be (ABA4C 7). The check optical signal output by the group of check coding values can help the remote control end to confirm whether the pixel position obtained by the remote control end is correct or not, so that the accuracy of pixel position coding can be improved.

It should be noted that the pixel coding rule of the embodiment of the present application is not limited to the above example, for example, when the original GB value of a pixel is 1, the current GB value is reduced by 1; when the original GB value is 0, adding 1 to the current GB value. The embodiment of the present application does not specifically limit the pixel encoding rule, and all schemes that can encode the row and column information of the pixels into the optical signals of the pixels are within the scope of the embodiment of the present application.

In 102, a cursor is displayed in a target area of a display interface in response to the received position signal sent by the remote control terminal; the position signal is used for indicating the position of a target pixel, the target pixel corresponds to the optical signal received by the remote control end, and the position of the target area is the same as that of the target pixel.

Please refer to fig. 3 in conjunction with fig. 1, fig. 3 is a timing diagram of a display terminal and a remote control terminal according to an embodiment of the present disclosure. When the user operates the remote control end to point to the target area of the display interface, the remote control end can receive the optical signal transmitted by the target pixel corresponding to the target area, decode the optical signal and acquire the target position of the target pixel indicated by the optical signal, and then the remote control end can regenerate the position signal according to a certain protocol for the target position information and can transmit the position signal to the display end of the display end again. It will be appreciated that the position signal may be indicative of the position of the target pixel to which the light signal received at the remote control terminal corresponds.

In some embodiments, a first communication module 160, such as but not limited to a bluetooth communication module, a Wireless Fidelity (Wi-Fi) communication module, and an infrared communication module, may be disposed inside the display terminal. The communication module can receive the position signal sent by the remote control end through a Bluetooth antenna, a Wi-Fi antenna, an infrared sensor and the like. After the display end receives the position signal, the position signal can be decoded to obtain row and column information, and then the display end can display a cursor pattern in a target area of the display interface for the remote control end to confirm.

In 103, in response to the received determination signal sent by the remote control terminal, an instruction corresponding to the cursor is executed.

When the remote control end determines that the target area where the cursor on the display interface is located is indeed the area which the remote control end actually wants to control, the remote control end can send a determination signal to the display end, and the display end can execute the instruction corresponding to the cursor according to the determination signal. For example, the content displayed in the target area corresponding to the cursor is "animation a", and after the display end receives the determination signal, the display end can control the display interface to display the movie and television works of the animation a.

It can be understood that, when the target area where the cursor displayed on the display interface of the display end is located is not the area that the user wants, the user may move the remote control end to another area of the display interface to re-receive the optical signal and the verification optical signal transmitted by the pixel of the area, so as to re-display the cursor on the display interface.

Referring to fig. 4 in conjunction with fig. 3, fig. 4 is a schematic control flow diagram of a display end according to an embodiment of the present application. The above display control method is explained below in terms of the display end.

The display end is started and initialized, the display end can determine whether the display end is currently positioned on the display interface of the UI module 120, if not, the display control method of the application is ended, if so, the row and column information of each pixel is coded into the pixel value of the pixel according to the coding rule, and the coded optical signal is obtained; then, the display end can judge whether a position signal transmitted by the remote control end is received or not, if so, the cursor display is refreshed, then, the display end can judge whether a determination signal is received or not, if so, the click operation is executed according to the position indicated by the cursor until the end, and if not, the display end continues to judge whether the position signal is received or not again.

According to the display control method, the display end can control each pixel of the display interface to output the optical signal for indicating the position information of the pixel, and the optical signal can facilitate the remote control end to acquire the position information of the target pixel; after the display end receives the position signal which can indicate the position information of the target pixel, a cursor can be displayed on the display interface; when the display receives a determination signal indicating that the cursor is correctly positioned, the instruction corresponding to the cursor can be executed. Based on the display control method, the display control method of the embodiment of the application can solve the problem that the cursor can be moved to the target area only by triggering the remote control end for multiple times in the related technology, on one hand, a user can obtain the position information of the target area through the optical signal transmitted by the target pixel of the target area only by aligning the remote control end to the target area, the display end can quickly display the control cursor at the target position, the user can be prevented from controlling the remote control end for multiple times, and the efficiency of remote control display is improved; on the other hand, the display end can only encode the optical signal transmitted by each pixel to indicate the position of the pixel, and the display end does not need to additionally arrange a hardware structure for position display, so that the cost of the display end is low; on the other hand, the remote control end receives the optical signal transmitted by the pixel, so that the remote control end of the embodiment of the application is not limited to the type of the display interface, and can perform remote control positioning on the display interface of the display screen 170 and the projected display interface, and the control method of the embodiment of the application has wider adaptability.

In addition, in the display control method of the embodiment of the application, in the process of encoding the optical signal output by the pixel, the row and column signal of the optical signal is divided into a plurality of sub-numerical values and encoded into a plurality of sub-encoded pixel values to obtain a plurality of sub-optical signals, and the encoded data character of each sub-optical signal is short, so that the decoding at the remote control end is facilitated, the efficiency of identifying the position of the remote control end can be improved, and the efficiency of displaying the cursor can be improved.

Based on the above display control method, please refer to fig. 5 in combination with fig. 3, and fig. 5 is a schematic flow chart of a remote control method according to an embodiment of the present application. The remote control method comprises the following steps:

receiving a light signal transmitted by a target pixel of a display interface, wherein the light signal transmitted by the target pixel is used for indicating a first position of the target pixel in 201;

when the display end transmits the coded optical signal to the outside, the remote control end can receive the optical signal transmitted by the target pixel. The target pixel may be a pixel within a target area of the remote control pointing to the display interface.

The remote control end may include an optical lens 222 and a color sensor 221 (as shown in fig. 9), and the optical lens 222 may collect and image the optical signal transmitted by the target pixel of the display interface onto the photosensitive surface of the color sensor 221. The color sensor 221 may acquire an optical signal on the photosensitive surface thereof and convert the optical signal into a digital signal, the color sensor 221 may transmit the digital signal to a control module of a remote control end, and the remote control end may decode the digital signal and acquire first position information corresponding to the target pixel.

In some embodiments, after the display end divides the position information of the target pixel into a plurality of first sub-arrays and a plurality of second sub-arrays and forms a plurality of sub-optical signals, the remote control method according to the embodiment of the present application receives an optical signal transmitted by the target pixel of the display interface, where the optical signal transmitted by the target pixel is used to indicate the first position of the target pixel, including: the method comprises the steps of receiving a plurality of sub-optical signals transmitted by a target pixel of a display interface, wherein the plurality of sub-optical signals transmitted by the target pixel are used for indicating a first position of the target pixel.

It is understood that the color sensor 221 may receive a plurality of sub-optical signals emitted by a target pixel in a display period, and the remote control end may decode and determine first position information corresponding to the target pixel according to the plurality of sub-optical signals.

In some embodiments, after receiving the optical signal transmitted by the target pixel of the display interface, the method further includes: receiving a verification optical signal which is transmitted by the target pixel and is used for verifying a second position of the target pixel; it is determined whether the first location and the second location are the same. At this time, the display terminal may control the target pixel to output a verification optical signal for verifying the position of the target pixel, and the verification optical signal may indicate the position of the target pixel, i.e., the second position, which is considered by the display terminal. When the first position obtained by the remote control end after decoding according to the received optical signal is the same as the second position, the information of the first position after decoding by the remote control end is considered to be accurate, and the information of the first position can be reserved. If the first position is different from the second position, the remote control end can discard the captured optical signal and re-acquire the optical signal until the decoded first position of the re-acquired optical signal is the same as the second position. Therefore, the accuracy of determining the target pixel position by the remote control end can be improved by transmitting the verification optical signal.

It should be noted that, in the remote control method, the optical signal and the verification optical signal are the optical signal and the verification optical signal emitted by the target pixel, and the specific encoding process of the optical signal and the verification optical signal emitted by the target pixel may refer to the encoding process of the optical signal and the verification optical signal output by each pixel in the foregoing display control method, and details thereof are not described herein.

At 202, transmitting a position signal for indicating a first position to a display end;

after the remote control end acquires the first position information of the target pixel, the information of the first position may be regenerated into a position signal that can be transmitted in a communication manner according to a certain protocol, for example, the second communication module 230 may be disposed inside the remote control end, and the remote control end may generate a position signal that can be transmitted by a bluetooth antenna, a Wi-Fi antenna, and an infrared sensor according to a bluetooth communication protocol, a Wi-Fi communication protocol, an infrared communication protocol, and the like.

It is understood that after the remote control terminal determines whether the first position and the second position are the same, the remote control terminal may transmit a position signal indicating the first position to the display terminal when the first position and the second position are the same.

In 203, responding to a cursor displayed in a target area of the display interface, transmitting a determination signal to the display end, wherein the determination signal is used for instructing the display end to execute an instruction corresponding to the cursor.

After the remote control end sends the position signal indicating the position of the target pixel to the display end, the display end can decode and identify the position of the target pixel indicated by the position signal after receiving the position signal, and then the display end can display a cursor in a target area of the display interface. At this time, if the user thinks that the position of the cursor is correct, the user may use the enter key of the remote control end of the motor to enable the remote control end to transmit an enter signal to the display end through the second communication module 230, and the display end may execute the instruction corresponding to the cursor after receiving the enter signal. When the user thinks that the target area where the cursor is located is not the area that the user wants, at this time, the user can move the remote control end to another area of the display interface to re-receive the optical signal transmitted by the pixels of the area and the verification optical signal, so as to re-display the cursor on the display interface.

Referring to fig. 6 in conjunction with fig. 5, fig. 6 is a schematic control flow diagram of a remote control end according to an embodiment of the present application. The above remote control method is explained in the following in terms of a remote control end.

The remote control end is started and initialized, the remote control end can determine whether the remote control end is in a null mouse mode currently, the null mouse mode is a mode of executing the remote control method by the remote control end, and the null mouse mode is different from a control mode of moving a cursor step by step according to a display end UI interface in the related art. If the remote controller does not belong to the empty mouse mode, directly ending the remote control scheme of the embodiment of the application; if the remote controller belongs to the air mouse mode, acquiring an optical signal and a check optical signal emitted by a target pixel of a display end; the remote control end determines whether the optical signal is valid data or not according to the check optical signal, if so, generates a position signal according to first position information in the optical signal and sends the position signal to the display end through the communication module; and if the data is not valid data, judging the empty mouse mode again or capturing the optical signal and the verification optical signal again, and performing the process again. After the display end displays the cursor according to the position signal, the remote control end can send a confirmation signal to the display end under the confirmation operation of the user, so that the display end can execute the click operation according to the cursor.

According to the remote control method, the remote control end can decode the first position information of the target pixel according to the optical signal of the received target pixel and can instruct the display end to display the cursor on the display interface, so that the remote control end can be separated from the traditional form and can accurately position the display interface of the display end, large-screen remote control can be realized, a user can be prevented from controlling the remote control end for many times, and the efficiency of remote control display is improved. In addition, the remote control end is positioned according to the optical signal transmitted by the target pixel, so that the remote control end of the embodiment of the application is not limited to the type of the display interface, can perform remote control positioning on the display interface of the display screen 170 and the projected display interface, and has wider adaptability of a remote control method.

Based on the display control method and the remote control method, please refer to fig. 7 in combination with fig. 3 and fig. 5, and fig. 7 is a schematic flow chart of the remote control display control method according to an embodiment of the present disclosure. The remote control display control method comprises the following steps:

in 301, each pixel of a display interface of a display end is controlled to output an optical signal, where the optical signal is used to indicate a position of the pixel;

the display terminal may be provided inside with a plurality of pixels for displaying information, and the luminance, color, etc. of light signals emitted from the pixels to the outside may be controlled by controlling the pixel values of the pixels. The pixel value of a pixel can be represented by R, G, B characters, and the display end can output an optical signal outwards through each pixel to transfer the position of the pixel through the optical signal.

The plurality of pixels on the display interface may be arranged in an array, and the position of the pixel may refer to a position of a horizontal coordinate and a vertical coordinate on the display interface where the pixel is located. When the control pixel emits the optical signal carrying the pixel position, the position coordinates of the pixel can be converted into a binary form. The position coordinates are then mapped into the pixel values of the pixels, so that the position of the pixel can be identified by the light signal emitted by the pixel.

It is to be understood that the specific process of encoding the position information of the pixel can be referred to the description of the foregoing embodiments, and will not be described in detail herein.

In 302, the remote control terminal is controlled to receive an optical signal transmitted by a target pixel of the display interface, wherein the optical signal is used for indicating a first position of the target pixel;

after the display end transmits the coded light signal to the outside, the remote control end can receive the light signal through the optical lens 222 and the color sensor 221. The optical lens 222 can collect and image the optical signal transmitted by the target pixel of the display interface on the photosensitive surface of the color sensor 221. The color sensor 221 may acquire an optical signal on the photosensitive surface thereof and convert the optical signal into a digital signal, the color sensor 221 may transmit the digital signal to a control module of a remote control end, and the remote control end may decode the digital signal and acquire first position information corresponding to the target pixel.

In 303, controlling the remote control terminal to transmit a position signal for indicating the first position to the display terminal;

In 304, controlling the display terminal to receive the position signal and display a cursor in a target area of the display interface, wherein the position of the target area is the same as the first position;

the display end may be internally provided with a first communication module 160, and after receiving the position signal, the display end may decode the position signal to obtain row and column information, and then the display end may display a cursor pattern in a target area of the display interface for the remote control end to confirm.

In 305, controlling the remote control terminal to transmit a determination signal to the display terminal;

at 306, the control display receives the determination signal and executes an instruction corresponding to the cursor.

When the remote control end determines that the target area where the cursor on the display interface is located is indeed the area which the remote control end actually wants to control, the remote control end can send a determination signal to the display ends such as the display end, and the display end can execute the instruction corresponding to the cursor according to the determination signal. For example, the content displayed in the target area corresponding to the cursor is "animation a", and after the display end receives the determination signal, the display end can control the display interface to display the movie and television works of the animation a.

It can be understood that, when the target area where the cursor displayed on the display interface of the display end is located is not the area that the user wants, at this time, the user may move the remote control end to another area of the display interface to re-receive the optical signal transmitted by the pixel of the area and verify the optical signal, so as to re-display the cursor on the display interface.

According to the remote control display control method, each pixel of the display end can transmit an optical signal carrying the pixel position information outwards, the remote control end can receive the optical signal transmitted by the target pixel, decode the position information of the target pixel and send the position signal to the display end, and the display end can display a cursor according to the position signal and confirm the execution operation corresponding to the cursor after receiving the confirmation signal. Based on this, the remote control display control method of the embodiment of the application can control the cursor of the display end to move and select by using the remote control end, thereby increasing the operation flexibility and reducing the selection difficulty of the display interface; moreover, the remote control end can realize the simulated shooting game by utilizing the control mode, and the intelligent and technological degrees of the display end are increased.

In order to better implement the display control method, the remote control method, and the remote control display control method of the embodiments of the present application, on the basis of the display control method, the embodiments of the present application further provide a display apparatus 100, such as a television. Referring to fig. 8, fig. 8 is a schematic structural diagram of a display device 100 according to an embodiment of the present disclosure. The display device 100 includes a first main control module 110, a UI module 120, a pixel control module 130, a cursor display device 140, a display control module 150, a first communication module 160, and a display screen 170.

The UI module 120 is configured to control the display screen 170 to display an initial UI interface after the display apparatus 100 is powered on and initialized. The UI interface may present an interface for interaction with a user, allowing the user to select multimedia information and set information. The pixel control module 130 may control each pixel of the display interface to output an optical signal, where the optical signal may indicate a position of the pixel. The cursor display device 140 may display a cursor in a target area of the display interface in response to a received position signal transmitted by the remote control terminal at the display device 100, the position signal indicating a position of a target pixel, the target pixel corresponding to the light signal received by the remote control terminal, the position of the target area being the same as the position of the target pixel. The display control module 150 may execute an instruction corresponding to the cursor on the display device 100 in response to the received determination signal transmitted from the remote control terminal. The first communication module 160 can be in communication connection with the remote control end, and the first communication module 160 can receive the position signal and the determination signal sent by the remote control, so that the cursor display device 140 and the display control module 150 can perform corresponding operations. The display screen 170 may present a display interface to display text and images to the user.

It is understood that the UI module 120, the pixel control module 130, the cursor display device 140, the display control module 150, the first communication module 160, and the display screen 170 may be electrically connected to the first main control module 110, and the first main control module 110 may control the above modules to perform corresponding operations.

In some embodiments, the pixel control module 130 may also be configured to: acquiring an initial pixel value when each pixel is not coded, wherein the initial pixel value at least comprises a first character and a second character; coding a first character according to the row information of the pixel, coding a second character according to the column information of the pixel, and obtaining a coding pixel value of the pixel; and controlling each pixel to output an optical signal on the display interface according to the encoded pixel value.

In some embodiments, the pixel control module 130 may also be configured to: converting the row information of the pixels into a first array, and dividing the first array into a plurality of first sub-arrays; converting the column information of the pixels into a second array, and dividing the second array into a plurality of second sub-arrays with the number equal to that of the first sub-arrays; coding the first character according to each first sub-number group to obtain a plurality of third characters, and coding the second character according to each second sub-number group to obtain a plurality of fourth characters; determining a third character and a fourth character as a sub-coded pixel value of the pixel, and obtaining a plurality of sub-coded pixel values; and controlling the pixels to sequentially output a plurality of sub-optical signals on the display interface according to the plurality of sub-coded pixel values, wherein the plurality of sub-optical signals are commonly used for indicating the positions of the pixels.

In some embodiments, the pixel control module 130 may also be configured to: and controlling each pixel of the display interface to output a verification optical signal for verifying the position of the pixel.

It should be noted that the display screen 170 of the display apparatus 100 may be a liquid crystal or light emitting diode display screen 170 in the physical form of the display apparatus 100, or may be a display carrier after being projected by a screen projection device, such as a curtain, a wall of the screen projection, and the like. The embodiment of the present application does not limit the specific structure of the display screen 170.

The display device 100 according to the embodiment of the application can only encode the optical signal transmitted by each pixel to indicate the position of the pixel, and the display device 100 does not need to additionally provide a hardware structure for position display, so that the cost of the display device 100 is low. Moreover, the user can acquire the position information of the target area through the optical signal transmitted by the target pixel of the target area only by aligning the remote control end with the target area, and the display device 100 can quickly display the control cursor at the target position, so that the user can be prevented from operating the remote control end for many times, and the remote control display efficiency is improved.

It should be noted that the display device 100 provided in the embodiment of the present application and the display control method in the foregoing embodiments belong to the same concept, and specific implementation processes of the display device 100 are described in detail in the embodiment of the display control method and are not described herein again.

In order to better implement the remote control method of the embodiment of the present application, on the basis of the above remote control method, the embodiment of the present application further provides a remote control device 200, such as a remote controller. Referring to fig. 9, fig. 9 is a schematic structural diagram of a remote control device 200 according to an embodiment of the present disclosure. The remote control device 200 includes a second main control module 210, an optical signal acquisition module 220, and a second communication module 230.

The optical signal acquisition module 220 is configured to: and receiving an optical signal transmitted by a target pixel of a display interface of the display end, wherein the optical signal transmitted by the target pixel is used for indicating a first position of the target pixel. The second main control module 210 is configured to perform decoding, checking, and generating a position signal indicating the first position according to the optical signal transmitted by the target pixel; the communication module can transmit the position signal to the display end; the second master module 210 may also receive a signal input by the user to determine that the cursor position is correct, and then the second master module 210 may control the second communication module 230, so that the second communication module 230 is further configured to: and responding to a cursor displayed in a target area of the display interface, and transmitting a determination signal to the display end, wherein the determination signal is used for indicating the display end to execute an instruction corresponding to the cursor.

In some embodiments, the optical signal acquisition module 220 may include an optical lens 222 and a color sensor 221, and the optical lens 222 may collect and image the optical signal transmitted by the target pixel of the display interface on the photosensitive surface of the color sensor 221. The color sensor 221 may acquire the optical signal on the photosensitive surface thereof and convert the optical signal into a digital signal, the color sensor 221 may transmit the digital signal to a control module of a remote control end, and the remote control device 200 may decode the digital signal and acquire the first position information corresponding to the target pixel.

In some embodiments, the optical signal acquisition module 220 is further configured to: the method comprises the steps of receiving a plurality of sub-optical signals transmitted by a target pixel of a display interface, wherein the plurality of sub-optical signals are used for indicating a first position of the target pixel.

In some embodiments, the optical signal acquisition module 220 is further configured to: receiving a verification optical signal which is transmitted by the target pixel and is used for verifying a second position of the target pixel; it is determined whether the first location and the second location are the same. The second communication module 230 is further configured to: and if the first position is the same as the second position, transmitting a position signal for indicating the first position to the display end.

The remote control device 200 of the embodiment of the application can be separated from the traditional form and can accurately position the display interface of the display end, large-screen remote control can be realized, a user can be prevented from controlling the remote control device 200 for many times, and the efficiency of remote control display is improved.

It should be noted that the remote control device 200 provided in the embodiment of the present application and the remote control method in the foregoing embodiment belong to the same concept, and specific implementation processes of the remote control device 200 are described in detail in the remote control method embodiment and are not described herein again.

In order to better implement the remote control display control method of the embodiment of the present application, on the basis of the above remote control display control method, the embodiment of the present application further provides a display control system 300. Referring to fig. 10, fig. 10 is a schematic structural diagram of a display control system 300 according to an embodiment of the present disclosure. The display control system 300 includes the display apparatus 100 and the remote control apparatus 200.

The display device 100 includes a first processor 311, a first memory 312, and a first computer program stored on the first memory 312 and executable on the first processor 311. The first processor 311 may be electrically connected to the first memory 312. The first processor 311 is a control center of the display apparatus 100, connects various parts of the entire display apparatus 100 using various interfaces and lines, performs various functions of the display apparatus 100 and processes data by running or loading software programs and/or modules stored in the first memory 312 and calling data stored in the first memory 312, thereby performing overall monitoring of the display apparatus 100.

In this embodiment, the first processor 311 in the display device 100 loads instructions corresponding to processes of one or more application programs into the first memory 312, and the first processor 311 runs the application programs stored in the first memory 312, so as to implement the device control method provided by the present application, for example: controlling each pixel of the display interface to output an optical signal, wherein the optical signal is used for indicating the position of the pixel; responding to a received position signal sent by the remote control end, displaying a cursor in a target area of a display interface, wherein the position signal is used for indicating the position of a target pixel corresponding to the optical signal received by the remote control end, and the position of the target area is the same as that of the target pixel; and executing the instruction corresponding to the cursor in response to the received determination signal sent by the remote control terminal.

The remote control device 200 includes a second processor 313, a second memory 314, and a second computer program stored in the second memory 314 and operable on the second processor 313, wherein the second processor 313 can be electrically connected to the second memory 314. The second processor 313 is a control center of the display apparatus 100, connects various parts of the entire display apparatus 100 using various interfaces and lines, performs various functions of the display apparatus 100 and processes data by running or loading software programs and/or modules stored in the second memory 314, and calling data stored in the second memory 314, thereby performing overall monitoring of the remote control apparatus 200.

In the embodiment of the present application, the second processor 313 in the remote control device 200 loads instructions corresponding to processes of one or more application programs into the second memory 314 according to the following steps, and the second processor 313 executes the application programs stored in the second memory 314, so as to implement the device control method provided by the present application, for example: receiving an optical signal transmitted by a target pixel of a display interface, wherein the optical signal transmitted by the target pixel is used for indicating a first position of the target pixel; transmitting a position signal for indicating a first position to a display end; and responding to a cursor displayed in a target area of the display interface, and transmitting a determination signal to the display end, wherein the determination signal is used for indicating to execute an instruction corresponding to the cursor.

It is understood that the remote control terminal in the above embodiments may be the remote control device 200; the display terminal may be the display device 100.

It is understood that the detailed implementation of the operations of the display device 100 and the remote control device 200 can refer to the foregoing embodiments, and the detailed description is omitted here. In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.

It will be understood by those skilled in the art that all or part of the steps of the methods of the above embodiments may be performed by instructions or by associated hardware controlled by the instructions, which may be stored in a computer readable storage medium and loaded and executed by a processor.

To this end, embodiments of the present application provide a computer-readable storage medium, in which a computer program is stored, and when the computer program is executed by a processor, the steps of any one of the display control methods provided by the embodiments of the present application and/or the steps of any one of the remote control methods are implemented. For example, the instructions may perform the steps of: controlling each pixel of the display interface to output an optical signal, wherein the optical signal is used for indicating the position of the pixel; responding to a received position signal sent by the remote control end, displaying a cursor in a target area of a display interface, wherein the position signal is used for indicating the position of a target pixel, the target pixel corresponds to the optical signal received by the remote control end, and the position of the target area is the same as the position of the target pixel; and executing the instruction corresponding to the cursor in response to the received determination signal sent by the remote control terminal. For another example, the instructions may perform the steps of: receiving an optical signal transmitted by a target pixel of a display interface, wherein the optical signal transmitted by the target pixel is used for indicating a first position of the target pixel; transmitting a position signal for indicating a first position to a display end; and responding to a cursor displayed in a target area of the display interface, and transmitting a determination signal to the display end, wherein the determination signal is used for indicating the display end to execute an instruction corresponding to the cursor.

The above operations can be implemented in the foregoing embodiments, and are not described in detail herein.

Wherein the storage medium may include: read Only Memory (ROM), Random Access Memory (RAM), magnetic or optical disks, and the like.

Since the instructions stored in the storage medium may execute the steps of any display control method and/or any remote control method provided in the embodiments of the present application, the beneficial effects that can be achieved by any display control method and any remote control method provided in the embodiments of the present application may be achieved, which are detailed in the foregoing embodiments and will not be described herein again.

It is to be understood that, in the description of the present application, terms such as "first", "second", and the like are used merely to distinguish similar objects and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated.

The foregoing detailed description is directed to a control method, apparatus, system, and storage medium provided in the embodiments of the present application, and specific examples are used herein to explain the principles and implementations of the present application, and the descriptions of the foregoing embodiments are only used to help understand the method and the core ideas of the present application; meanwhile, for those skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims

1. A display control method, comprising:

2. The method according to claim 1, wherein controlling each pixel of the display interface to output an optical signal comprises:

3. The method according to claim 2, wherein the encoding the first character according to the row information of the pixel, encoding the second character according to the column information of the pixel, and obtaining an encoded pixel value of the pixel comprises:

4. The method according to any one of claims 1 to 3, wherein after each pixel of the control display interface outputs the optical signal, the method further comprises:

5. A remote control method, comprising:

6. The remote control method according to claim 5, wherein the receiving a light signal transmitted by a target pixel of a display interface, the light signal indicating a first position of the target pixel, comprises:

7. The remote control method according to claim 5, wherein after receiving the optical signal transmitted by the target pixel of the display interface, the method further comprises:

determining whether the first location and the second location are the same;

8. A remote control display control method is characterized by being applied to a display control system, wherein the display control system comprises a display end and a remote control end; the method comprises the following steps:

9. A display device, comprising:

10. A remote control device, comprising:

the optical signal acquisition module is used for receiving an optical signal transmitted by a target pixel of a display interface, wherein the optical signal is used for indicating a first position of the target pixel; and

11. A display control system, comprising:

a display device comprising a first processor, a first memory and a first computer program stored on the first memory and executable on the first processor, the first computer program, when executed by the first processor, implementing the steps of the display control method according to any one of claims 1 to 4; and/or the presence of a gas in the gas,

remote control device comprising a second processor, a second memory and a second computer program stored on said second memory and executable on said second processor, said second computer program, when executed by said second processor, implementing the steps of the remote control method according to any one of claims 5 to 7.

12. A computer-readable storage medium, having stored thereon a computer program adapted to be loaded by a processor for performing the steps of the display control method according to any one of claims 1 to 4; and/or the steps of performing the remote control method according to any one of claims 5 to 7.