WO2023082423A1

WO2023082423A1 - Display method and apparatus, and device, system and readable storage medium

Info

Publication number: WO2023082423A1
Application number: PCT/CN2021/139081
Authority: WO
Inventors: 王杰; 梁植权
Original assignee: 西安青松光电技术有限公司
Priority date: 2021-11-12
Filing date: 2021-12-17
Publication date: 2023-05-19
Also published as: CN116126196A

Abstract

Provided are a display method and apparatus, and a device, a system and a readable storage medium, which relate to the technical field of image processing, and solve the problems of operations of an operator being tedious and the user experience being poor when a display screen displays pieces of content from different input devices. The display method comprises: acquiring an object display instruction, which is sent by a control device (S310); determining an object to be processed, which is in the current display content and is indicated by the object display instruction (S320); and in response to the object display instruction, displaying a target object in a first display manner, and displaying, in a second display manner, the object to be processed (S330), wherein the second display manner is different from the first display manner. Operations on pieces of content on a display device that are input by at least two input devices are implemented by means of one control device, thereby improving the convenience of operations of an operator on display content of a display screen, and improving the user experience.

Description

Display method, device, equipment, system and readable storage medium

This application claims the priority of the Chinese patent application with the application number 202111339228.X and the title of the invention "display method, device, equipment, system and readable storage medium" submitted to the State Intellectual Property Office on November 12, 2021. The entire contents are incorporated by reference in this application.

technical field

The present application relates to the technical field of image processing, for example, to a display method, device, equipment, system and readable storage medium.

Background technique

In a large conference or activity scene, a large-size (such as 70-inch, 100-inch, etc.) display screen is usually used to display relevant content. Generally, a large-size display screen can be connected to multiple input devices at the same time, and simultaneously display the content input by the multiple input devices.

In practical applications, there is often a need to remind the viewing user to pay special attention to certain/some content. In the related art, if the viewer wants to remind the viewing user to pay special attention to a certain content displayed on the large-size display screen, the operator needs to perform related operations (such as increasing the display brightness operation, rendering start operation, etc.) on the input device corresponding to the content. In this way, in the scene where the content that needs to be watched by the user includes content from different input devices, the operator needs to operate each input device one by one, which is cumbersome and reduces user experience.

Contents of the invention

Based on this, aiming at the above technical problems, a display method, device, equipment, system and readable storage medium are provided.

On the one hand, the embodiment of the present application provides a display method, including the following steps: After obtaining the object display instruction sent by the control device, determine the current display content (the current display content includes content from at least two input devices). The object to be processed indicated by the object display instruction, and in response to the object display instruction, display the target object in the first display mode (the target object includes other objects in the currently displayed content except the object to be processed, or includes other objects in the content to be operated except the object to be processed) Objects other than the processing object; the content to be operated is the content input by the input device corresponding to the object to be processed), and the object to be processed is displayed in a second display manner. The above-mentioned second display mode is different from the first display mode.

Optionally, in one mode, the value of the feature parameter in the first display mode is lower than the value of the feature parameter in the second display mode, and the feature parameter includes at least one of brightness, chroma, and display scale.

Optionally, the above "determining the object to be processed indicated by the object display instruction in the current display content" includes: obtaining the location information indicated by the object display instruction by parsing the object display instruction; The display position information adapted by the display screen; determine the content corresponding to the target position in the current display content, and then use the determined content as the object to be processed, wherein the target position is the position represented by the display position information.

Optionally, the above object display instruction includes location information. Correspondingly, the above-mentioned "analyzing the object display instruction to obtain the location information in the built-in canvas" includes: parsing and extracting the location information in the object display instruction.

Optionally, the above-mentioned object display instruction includes a start determination sub-instruction and an end determination sub-instruction. Correspondingly, the above-mentioned "parsing the object display instruction to obtain the position information indicated by the object display instruction" includes: parsing and extracting the start position information in the start determination sub-instruction; Position information; then determine the position information according to the start position information, end position information and preset algorithm.

Optionally, the above-mentioned "mapping the position information to obtain display position information adapted to the display screen" includes: obtaining the ratio between the size of the built-in canvas and the size of the display screen; Coordinate system conversion processing to obtain display position information.

Optionally, the object to be processed includes at least one of the following: an area to be processed, a person object to be processed, an item object to be processed, and a text object to be processed.

Optionally, the above "responsive to the object display instruction, using the first display method to display the target object, and using the second display method to display the object to be processed" includes: responding to the object display instruction, providing an input device corresponding to the object display instruction Send a processing instruction; the processing instruction corresponds to the object display instruction; receive the display information sent from the corresponding input device, and based on the display information, use the first display method to display the target object, and use the second display method to display the object to be processed; the display information is The display content after the corresponding input device processes the content to be displayed according to the processing instruction.

In a second aspect, the embodiment of the present application further provides a display device, including an instruction acquisition module, an object determination module, and an object processing module. The instruction obtaining module is used for obtaining the object display instruction sent by the control device. The object determining module is used for determining the object to be processed indicated by the object display instruction in the currently displayed content (the currently displayed content includes content from at least two input devices). The object processing module is used for displaying the target object in the first display manner and displaying the object to be processed in the second display manner in response to the object display instruction. Wherein, the second display mode is different from the first display mode. The target object includes other objects in the currently displayed content except the object to be processed, or includes other objects in the content to be operated except the object to be processed; the content to be operated is the content input by the input device corresponding to the object to be processed.

Optionally, the value of the characteristic parameter in the first display mode is lower than the value of the characteristic parameter in the second display mode, and the characteristic parameter includes at least one of brightness, chroma, and display scale.

Optionally, the above-mentioned object determination module includes an analysis unit, a mapping unit and a content determination unit. The parsing unit is used for parsing the object display instruction obtained by the instruction obtaining module, so as to obtain the position information indicated by the object display instruction. The mapping unit is configured to perform mapping processing on the position information obtained by the analysis unit to obtain display position information adapted to the display screen. The above-mentioned content determining unit is configured to determine the content corresponding to the target position in the currently displayed content, and use the determined content as an object to be processed. The target position is the position represented by the display position information obtained by the mapping unit.

Optionally, when the object display instruction includes location information, the parsing unit is configured to parse and extract the location information in the object display instruction.

Optionally, when the object display instruction includes a start determination sub-instruction and an end determination sub-instruction, the above parsing unit is configured to parse and extract the start position information in the start determination sub-instruction, and parse and extract the termination determination sub-instruction The end location information of the computer and the location information are determined according to the start location information, end location information and preset algorithm.

Optionally, the above-mentioned mapping unit is configured to: obtain the ratio between the size of the built-in canvas and the size of the display screen, and based on the ratio, perform coordinate system conversion processing on the position information to obtain display position information.

Optionally, the above-mentioned object processing module is configured to: send a processing instruction to the input device corresponding to the object display instruction in response to the object display instruction; the processing instruction corresponds to the object display instruction; receive display information sent from the corresponding input device, and Based on the display information, the target object is displayed in the first display mode, and the object to be processed is displayed in the second display mode; the display information is the display content after the corresponding input device processes the content to be displayed according to the processing instruction.

In a third aspect, the embodiment of the present application further provides a display device, including a display screen, a memory, and a processor. The display screen, memory and processor are coupled. The memory is used for storing computer-executable instructions, and the processor is used for invoking computer-executable instructions, so that when the display device is running, the computer-executable instructions are executed to realize the above-mentioned display method.

In a fourth aspect, the embodiment of the present application further provides a display system, including a control device and the above-mentioned display device; the control device is connected to the display device.

Optionally, the control device is an air mouse or a mobile terminal.

In the fifth aspect, the embodiment of the present application further provides a computer-readable storage medium, including computer instructions, and when the computer instructions are run on the display device, the display device is made to execute the above-mentioned display method.

After acquiring the object display instruction sent by the control device, the display device determines the object to be processed indicated by the object display instruction in the current display content (including content from at least two input devices) according to the object display instruction, and adopts the first display Mode target object (the target object includes other objects in the currently displayed content except the object to be processed, or includes other objects in the content to be operated except the object to be processed; the content to be operated is the content input by the input device corresponding to the object to be processed ), and display the object to be processed in the second display manner. The first display mode is different from the second display mode, so that the object to be processed and the target object can be effectively distinguished. It can be seen that in the display method provided by the present application, the display device communicates directly with the control device. No matter which input device the object to be processed comes from, the operator can manipulate the control device to realize the display of the object to be processed in different display modes in the display device. Objects and other objects effectively reduce the cumbersomeness of operations and improve the convenience and user experience of operators.

Description of drawings

Fig. 1 is a schematic diagram of the application environment of the display method in the embodiment of the present application;

FIG. 2 is an internal structural diagram of a display device in an embodiment of the present application;

Fig. 3 is a schematic flow chart of the display method in the embodiment of the present application;

FIG. 4 is a schematic view of a display screen in an embodiment of the present application;

FIG. 5 is a schematic flow chart of the step of determining an object in the embodiment of the present application;

FIG. 6 is a schematic diagram of the first display in which the object to be processed in the display screen becomes brighter in the embodiment of the present application;

FIG. 7 is a schematic diagram of a second display in which the object to be processed in the display screen becomes brighter in the embodiment of the present application;

Fig. 8 is a schematic diagram showing the darkening of the object to be processed in the display screen in the embodiment of the present application;

FIG. 9 is an enlarged display schematic diagram of objects to be processed in the display screen in the embodiment of the present application;

Fig. 10 is a schematic diagram showing bold and framed objects to be processed in the display screen in the embodiment of the present application;

Fig. 11 is a schematic diagram showing the indication graphics in the display screen in the embodiment of the present application;

FIG. 12 is a schematic diagram of a scenario in which a user operates a mobile terminal in an embodiment of the present application;

FIG. 13 is a schematic structural diagram of a display device in an embodiment of the present application.

Detailed ways

In order to make the purpose, technical solution and advantages of the present application clearer, the present application will be described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the embodiments described here are used to explain the present application, not to limit the present application.

The display method provided in this application can be applied to a display system. In one example, as shown in FIG. 1, the display system may include a display device 102, a control device 104, and at least one input device connected to the display device 102 (a first input device, a second input device as shown in FIG. , third input device). The display device 102 and the control device 104 may be wired or wirelessly connected (for example, Bluetooth connection, network connection, etc.), which is not limited in this embodiment of the present application. Similarly, the display device 102 and each input device may be wired or wirelessly connected (for example, Bluetooth connection, network connection, etc.), which is not limited in this embodiment of the present application.

It should be noted that the first input device, the second input device, and the third input device shown in FIG. 1 are examples of input devices connected to the display device 102, and the number of input devices is not limited.

The display device 102 can be a large size (such as 47 inches, 55 inches, 70 inches, etc.) LED display device, which can receive and display data from each input device. It can be understood that if the display device 102 receives data from multiple input devices within a certain period of time, it will display the contents of the multiple received data, that is, it may display the content input from different input devices at the same time.

The control device 104 is but not limited to: air mouse, mobile terminal. Wherein, the mobile terminal may be a smart phone, a tablet computer, or the like. The control device 104 sends an object display instruction to the display device 102, and the display device 102 executes the steps of the display method of this application after receiving the object display instruction.

The display device 102 may include a processor 31 , a memory 32 , a communication interface 33 , a bus 34 , a display screen 35 and a logic programmable controller 36 . The processor 31 , the memory 32 , the communication interface 33 , the display screen 35 and the logic programmable controller 36 may be connected through a bus 34 .

The processor 31 is the control center of the display device 102, and may be one processor, or may be a general term for multiple processing elements. For example, the processor 31 may be a general-purpose central processing unit (central processing unit, CPU), or other general-purpose processors. Wherein, the general-purpose processor may be a microprocessor or any conventional processor. Exemplarily, the processor 31 may include at least one CPU. For example, CPU0 and CPU1 shown in Figure 2.

Memory 32 may be read-only memory (read-only memory, ROM) or other types of static storage devices that can store static information and instructions, random access memory (random access memory, RAM) or other types that can store information and instructions The dynamic storage device can also be an electrically erasable programmable read-only memory (electrically erasable programmable read-only memory, EEPROM), a magnetic disk storage medium or other magnetic storage device, or can be used to carry or store instructions or data structures. desired program code and any other medium that can be accessed by a computer, but is not limited thereto.

In a possible implementation manner, the memory 32 may exist independently of the processor 31 , and the memory 32 may be connected to the processor 31 through the bus 34 to store instructions or program codes. When the processor 31 invokes and executes the instructions or program codes stored in the memory 32, the display method provided by the following embodiments of the present application can be realized.

In the embodiment of the present application, for the control device 104 and the input device, the software programs stored in the memory 32 are different, so the functions realized by the control device 104 and the input device are different. The functions performed by each device will be described in conjunction with the flow chart below.

In another possible implementation manner, the memory 32 may also be integrated with the processor 31 .

The communication interface 33 is used to connect the computing device to other devices through a communication network, and the communication network may be Ethernet, radio access network (radio access network, RAN), wireless local area network (wireless local area networks, WLAN) and the like. The communication interface 33 may include a receiving unit for receiving data, and a sending unit for sending data.

The bus 34 may be an Industry Standard Architecture (Industry Standard Architecture, ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (Extended Industry Standard Architecture, EISA) bus, etc. The bus can be divided into address bus, data bus, control bus and so on. For ease of representation, only one thick line is used in FIG. 2 , but it does not mean that there is only one bus or one type of bus.

The display screen 35 is used to display information such as images and videos. The display screen 35 may be an LED display screen, a liquid crystal display (Liquid Crystal Display, LCD), or an organic light emitting semiconductor (Organic Electroluminescence Display, OLED) display, which is not limited in this embodiment of the present application.

The logic programmable controller 36 can be a field programmable gate array (Field-Programmable Gate Array, FPGA) controller, also can be a single-chip microcomputer, can also be a digital signal processor (Digital Signal Processor, DSP) processor, the application implements Examples are not limited to this.

In a possible implementation manner, the logic programmable controller 36 can exist independently of the processor 31, and the logic programmable controller 36 can be connected to the processor 31 through the bus 34 to control the display mode and display of the display screen 35. content etc.

In another possible implementation manner, the logic programmable controller 36 may also be integrated with the processor 31 .

For ease of understanding, the subsequent content of the embodiment of the present application is described by taking the logic programmable controller 36 and the processor 31 independently as an example.

It should be noted that the structure shown in FIG. 2 does not limit the display device 102 . In addition to the components shown in FIG. 2, the display device 102 may include more or fewer components than shown, or combine certain components, or have a different arrangement of components.

The hardware structure of the control device 104 and the input device in FIG. 1 is similar to that of the display device 102 , and will not be repeated here.

The display method provided by the embodiment of the present application is executed by a display device. The display device may be the above-mentioned display device 102, or the CPU in the above-mentioned display device 102, or a control module for controlling display in the above-mentioned display device 102, or a control module for controlling display in the above-mentioned display device 102. client. In this embodiment of the present application, the display method provided by the present application is described by taking the display device 102 executing the display method as an example.

The display method of the present application will be described in detail below in combination with the above-mentioned display system and the hardware structure of the display device 102 . Exemplarily, as shown in Figure 3, the display method provided by the embodiment of the present application includes the following steps:

S310, the display device 102 acquires an object display instruction sent by the control device 104.

The object display instruction is used to instruct the display device 102 to display the target object in the first display manner, and to display the object to be processed in the second display manner. Wherein, the target object includes other objects in the currently displayed content except the object to be processed, or includes other objects in the content to be operated except the object to be processed; the content to be operated is the content input by the input device corresponding to the object to be processed.

In one example, the object display instruction includes at least position information for indicating the position of the object to be processed in the built-in canvas. The built-in canvas is a preset canvas in the operating system (for example, Android system, IOS system, etc.) of the display device 102 . The location information included in the object display instruction may be the location information of a point, the location information of a line segment, or the location information of an area, which is not limited in this embodiment of the present application.

In practical applications, the method of generating the object display instruction depends on the control device 104 . Different types of control devices 104 may generate object display instructions in different ways.

For example, if the control device 104 is an air mouse, when the air mouse detects that it is moved, or when the air mouse detects that a button on it is pressed, it generates a corresponding object display instruction, and the air mouse transmits the generated object display instruction to the display device 102. In an embodiment, when the position information is the position information of a point, the corresponding object display instruction can be generated by the air mouse after detecting that the corresponding key is pressed. When the position information is the position information of a line segment, after the air mouse detects that the corresponding button is pressed, it can detect the path of the moving line to generate a corresponding object display instruction. When the position information is the position information of an area, the corresponding object display command can be generated by detecting the area delineated by the moving path after the air mouse detects that the corresponding button is pressed.

If the control device 104 is a mobile terminal, the control device 104 may be regarded as a touch panel, a remote controller, or the like. In one embodiment, the mobile terminal is simulated as a touch panel and a remote controller by using a simulation program in the mobile terminal. The simulation program in the mobile terminal may be pre-built or installed when needed, which is not limited in this embodiment of the present application.

After the mobile terminal is simulated as a touch panel, when a touch action is detected, the mobile terminal generates an object display instruction according to the touch action. Exemplarily, when the mobile terminal detects that the touch action is a click action, it generates an object display instruction including position information of the point. When the mobile terminal detects that the touch action is continuously drawn into a line segment, an object display instruction including position information of the line segment is generated. When the mobile terminal detects that a touch action is continuously drawn into an area (for example, a circle, a square, a triangle, an irregular figure, etc.), an object display instruction including position information of the area is generated.

In another example, the object display instruction includes at least a start determination sub-instruction and an end determination sub-instruction. In practical applications, the control device (air mouse or mobile terminal) directly sends at least a start determination sub-instruction and an end determination sub-instruction to the display device. The display device parses the start determination sub-command and the termination determination sub-command to obtain corresponding start position information and end position information.

S320, the display device 102 determines the object to be processed indicated by the object display instruction in the currently displayed content.

The currently displayed content includes content from at least two input devices. The data types of the content input by different input devices may be the same or different. Wherein, the data type may be a document, image, video, chart, user interface, web page, and the like.

For ease of understanding, the subsequent examples assume that the current display content of the display device 102 includes content from the first input device and the second input device, the data type of the content of the first input device is text, and the data type of the content of the second input device is is an image as an example for illustration.

Exemplarily, as shown in FIG. 4 , the display screen of the display device 102 includes a first display area 41 and a second display area 43, the first display area 41 displays text from the first input device, and the second display area 43 displays There is an image from a second input device.

After acquiring the object display instruction, the display device 102 responds to the object display instruction and determines the object to be processed indicated by the object display instruction. The object to be processed includes at least one of the following: an area to be processed, a character object to be processed, an item object to be processed, and a text object to be processed.

With reference to the foregoing description, the object display instruction may include position information of the object to be processed in the built-in canvas. When the location information is the location information of a point, the associated content pointed to by the location information of the point is the object to be processed. When the position information is the position information of a line segment, the associated content pointed to by the position information of the line segment is the object to be processed. When the location information is the location information of an area, the associated content delineated by the area is the object to be processed.

In one example, referring to FIG. 3 , as shown in FIG. 5 , the object to be processed indicated by the object display instruction in the currently displayed content is determined based on the following S520-S550.

S520. The display device 102 parses the object display instruction to acquire location information indicated by the object display instruction.

The control device 104 sends the object display command carrying the location information to the display device 102 .

In one example, a possible explanation is provided. In this example, the object display instruction includes location information. Correspondingly, the step of the display device 102 analyzing the object display instruction and obtaining the location information indicated by the object display instruction includes: analyzing and extracting the location information in the object display instruction. In this case, the control device 104 sends the object display instruction to the display device 102 during a transmission process, the object display instruction includes position information, and the display device 102 obtains the object display instruction, and analyzes the object display instruction Obtain the location information carried in it.

In another example, another possible parsing method is provided. In this example, the object display instruction includes a start determination sub-instruction and an end determination sub-instruction. Correspondingly, in the step of parsing the object display instruction to obtain the position information indicated by the object display instruction: parsing and extracting the start position information in the start determination sub-command; parsing and extracting the termination position information in the termination determination sub-command; according to The starting position information, the ending position information and the preset algorithm determine the position information. The preset algorithm may be, but not limited to: De Castrio algorithm, Bessel interpolation.

In this example, after the display device 102 acquires the start location information and the end location information sent by the control device 104, the display device 102 determines the location information by combining the start location information, the end location information and a preset algorithm. The process is: the control device 104 sends a start determination sub-command to the display device 102, where the start determination sub-command includes start position information. After the display device 102 acquires the initial location information, the display device 102 uses the initial location information as a starting point. The control device 104 sends a termination determination sub-command to the display device 102, where the termination determination sub-command includes termination location information, and the display device 102 ends with the termination location information. The display device 102 draws a corresponding line between the start point and the end point according to a preset algorithm, so as to draw a corresponding shape in the built-in canvas in real time.

For example, when the starting point coincides with the ending point, the display device 102 draws a closed area between the starting point and the ending point according to a preset algorithm. When the starting point and the ending point do not coincide, the display device 102 draws a line segment or an unclosed area between the starting point and the ending point according to a preset algorithm.

S530. The display device 102 performs mapping processing on the position information to obtain display position information adapted to the display screen.

It can be seen from the above description that in S520, the position information of the display device 102 acquired by the display device 102 is the position information in the built-in canvas. The display device 102 maps the position information onto the display screen, and the object to be processed can be determined according to the position on the display screen.

In one embodiment, the processor 31 of the display device 102 (the installed operating system has a built-in canvas) parses out the location information, and maps the location information to obtain display location information, and the processor 31 transmits the display location information to the logic Programmable controller 36, the logic programmable controller 36 (the display screen control system is installed inside) projects the display position information onto the display screen. Wherein, the displayed position information is the position information on the display screen, and in one example, the displayed position information is the coordinate value on the display screen.

In an example, the mapping process is completed through the following steps: obtaining the ratio between the size of the built-in canvas and the size of the display screen; and performing coordinate system conversion processing on the position information based on the ratio to obtain display position information.

It can be understood that there is a mapping relationship between the coordinate system of the built-in canvas and the coordinate system of the display screen. The ratio between the size of the built-in canvas and the size of the display screen is obtained, and the position information is enlarged or reduced according to the ratio to obtain the display position information.

For example, when the position information includes the position information of a point, the position information of the point is mapped to the display screen to obtain the coordinates of a point corresponding thereto. When the position information includes the position information of a line segment, the position information of the line segment is mapped to the display screen to obtain the coordinates of a line segment corresponding thereto. When the position information includes the position information of an area, the position information of the area is mapped to the display screen to obtain the coordinates of a corresponding area.

S540. The display device 102 determines the content corresponding to the target position in the currently displayed content, and takes the determined content as an object to be processed.

Wherein, the target position is a position where the representation of the position information is displayed. The content corresponding to the target location is the object to be processed. Here, the content corresponding to the target location may be the content at the target location, or the object to which the content at the target location belongs.

For example, the target position represented by the displayed position information includes the coordinates of a point, and the coordinates of the point fall on an object such as a character, a character, or an animal in the currently displayed content, and the display device 102 can use the , an animal and other objects are identified as objects to be processed.

Similarly, the target position represented by the displayed position information includes the coordinates of a line segment on which objects such as characters, characters, animals, and objects in the currently displayed content fall on the line segment, and the display device 102 can display the characters, characters, animals, objects, etc. Items and other objects are identified as objects to be processed.

Similarly, the target location represented by the displayed location information includes the coordinates of an area, and the display device 102 can use the complete object corresponding to the content enclosed by the area or the content enclosed by the area as the object to be processed.

For example: if the target position indicates the area of "日" in the word "star", the display device 102 can identify and determine the complete object as the word "star", therefore, the display device 102 determines the word "star" as the object to be processed.

For another example, if the target position indicates the area of "日" in the character "星", therefore, the display device 102 determines that "日" is the object to be processed.

S330. In response to the object display instruction, the display device 102 displays the target object in a first display manner, and displays the object to be processed in a second display manner, and the second display manner is different from the first display manner.

In the above first application scenario, the target object includes other objects in the currently displayed content except the object to be processed. In this application scenario, after determining the object to be processed, the display device 102 divides the currently displayed content into two parts, one part is the object to be processed, and the other part is the content other than the object to be processed (target object) in the currently displayed content. The target object is displayed in the first display manner, and the object to be processed is displayed in the second display manner.

In the above-mentioned second application scenario, the target object includes objects other than the object to be processed in the content to be operated. The content to be operated is the content input by the input device corresponding to the object to be processed. When the display device 102 determines the object to be processed, it recognizes which input device the object to be processed is input by, and after determining the input device corresponding to the object to be processed, it recognizes all the content input by the input device and takes it as the content to be operated. . In this application scenario, the display device 102 divides the content to be operated into two parts, one part is the object to be processed, and the other part is the content (target object) in the content to be operated except the object to be processed. The target object is displayed in the first display manner, and the object to be processed is displayed in the second display manner.

When the object to be processed is determined, the display device 102 displays the target object in the first display manner, and displays the object to be processed in the second display manner, so as to distinguish the target object displayed in the first display manner from the target object displayed in the second display manner. Processing object, the first display mode is different from the second display mode.

In an example, the value of the characteristic parameter (the first characteristic parameter includes at least one of brightness, chroma, and display scale) in the first display manner is lower than the value of the characteristic parameter in the second display manner.

If the brightness of the first display mode is different from that of the second display mode, the brightness of the second display mode can be brighter or darker than that of the first display mode.

For example, referring to FIG. 4 and the above-mentioned first application scenario, after receiving the object display instruction sent by the control device 104, the display device 102 parses and extracts the position information (the position information is a square area) in the object display instruction, and according to the The square area identifies the objects to be processed. Afterwards, the display device 102 increases the brightness of the object to be processed, and decreases the brightness of the target object. In this way, the display interface of the display device 102 can be converted from the display effect shown in FIG. 4 to the display effect shown in FIG. 6 .

For another example, referring to FIG. 4 and the above-mentioned second application scenario, after receiving the object display instruction sent by the control device 104, the display device 102 parses and extracts the position information (the position information is a square area) in the object display instruction, and according to This square area identifies the objects to be processed. Afterwards, the display device 102 determines the content to be operated, increases the brightness of the object to be processed, and decreases the brightness of the target object. In this way, the display interface of the display device 102 can be converted from the display effect shown in FIG. 4 to the display effect shown in FIG. 7 .

For another example, referring to FIG. 4 and the above-mentioned first application scenario, after receiving the object display instruction sent by the control device 104, the display device 102 parses and extracts the position information (the position information is a circular area) in the object display instruction, and The object to be processed according to the circular area. Afterwards, the display device 102 reduces the brightness of the object to be processed and increases the brightness of the target object. In this way, the display interface of the display device 102 can be converted from the display effect shown in FIG. 4 to the display effect shown in FIG. 8 .

Of course, in practical applications, it can be set according to requirements to keep the first display mode (or the second display mode) consistent with the current display mode, and only need to change another display mode. As in the example corresponding to FIG. 6 above, after the display device 102 determines the object to be processed, it controls the brightness of the object to be processed to remain unchanged, and reduces the brightness of the target object.

Optionally, if the chromaticity of the first display mode is different from the chromaticity of the second display mode, after the display device 102 determines the object to be processed, it can add a bright color (for example, red, yellow, fluorescent color) to the object to be processed. color, etc.), it can also add a bright color bottom layer to the object to be processed.

Optionally, if the display ratios of the first display manner and the second display manner are different, the display device 102 may enlarge and display the pair to be processed after determining the object to be processed. For example, referring to FIG. 4 and the above-mentioned first application scenario or the second application scenario, after receiving the object display instruction sent by the control device 104, the display device 102 parses and extracts the position information in the object display instruction (the location information is a square area ), and the objects to be processed are determined according to the square area. Afterwards, the display device 102 performs zoom-in display ratio processing on the object to be processed. In this way, the display interface of the display device 102 can be converted from the display effect shown in FIG. 4 to the display effect shown in FIG. 9 .

It should be noted that, in practical applications, the display device 102 can adjust the display mode in various ways, which are not listed here, as long as the first display mode is different from the second display mode. Of course, different types of data may be adjusted differently in the same time period.

In practical applications, the first display mode or the second display mode may also be a page-turning display.

For example, the adjustment method for text-type data is to bold and enlarge the font size, and the adjustment method for image-type data is to add a frame. Referring to FIG. 4, after the control device 104 sends an object display instruction to the display device 102, the display device 102 determines that the object to be processed includes the object a to be processed (that is, the word "document" shown in the figure) and the object to be processed according to the object display instruction. Object b (ie, the girl image and the doll image shown in the figure) is processed. Subsequently, the display device 102 bolds and enlarges the font size of the word "document", adds a frame to the object b to be processed, and does not process the rest of the text in the text data and the rest of the image content in the image data. In this way, the display interface of the display device 102 is converted from the display effect shown in FIG. 4 to the display effect shown in FIG. 10 .

Optionally, in order to strengthen the prompt function, after the display device 102 displays the object to be processed in the second display mode, it may also generate an indication graphic for indicating the object to be processed. The indicating graphic may be an arrow, a five-pointed star, etc., which is not limited in this embodiment of the present application. In order to have a better prompting effect, bright colors such as red, green, and orange can be used for the indicator graphics.

For example, with reference to FIG. 10 , as shown in FIG. 11 , the display device 102 displays a five-pointed star-shaped instruction graphic around the “document”, and displays an arrow, which is used to indicate the object b to be processed after being framed, In this way, the to-be-processed object a and the to-be-processed object b can be more prominent.

In order to facilitate understanding of the display method provided by the embodiment of the present application, the following uses a mobile terminal to control the display of the display device 102 as an example for description.

As shown in FIG. 12 , in the scene where the map image and the landscape image respectively input by two input devices are displayed on the display device 102, the user operates the mobile terminal (such as the device held in the hand as shown in FIG. 12 ) to In response to the instruction sent by the mobile terminal, the display device 102 changes the display mode of the displayed content. After receiving the object display instruction sent by the mobile terminal, the display device 102 parses the object display instruction to obtain location information. Afterwards, the display device 102 performs coordinate system conversion processing on the position information according to the ratio between the size of the built-in canvas and the size of the display screen, to obtain display position information corresponding to the position information. Assuming that the display position information is used to indicate the range of "Chongqing City" in the map image, the display device 102 determines that the image content of "Chongqing City" is an object to be processed according to the display position information. Subsequently, the display device 102 fills the image content of "Chongqing City" with "oblique line graphics", and does not fill other content in the map image. In this way, viewers watching the display device 102 can focus on the image content of "Chongqing City" in the map image.

The above example is described by taking the display device 102 as an example to process the content input by the input device. In another feasible manner, the input device may also process the content, and the input device sends the processed content to the display device 102 for display.

In one embodiment, in response to the object display instruction, the display device 102 sends a processing instruction to the input device corresponding to the object display instruction (the processing instruction corresponds to the object display instruction); subsequently, the display device 102 receives the processing instruction from the corresponding input device displaying information, displaying target objects in a first display manner based on the display information, and displaying objects to be processed in a second display manner. The display information here is the display content after the corresponding input device processes its own content to be displayed according to the processing instruction.

Wherein, the processing instruction and the object display instruction may be the same instruction or different instructions. This embodiment of the present application does not limit it.

Exemplarily, with reference to Fig. 1, the input device includes a first input device, a second input device and a third input device as an example for illustration. After receiving the display instruction sent by the control device 104, the display device 102 analyzes the display instruction, generates processing instructions corresponding to the first input device, the second input device, and the third input device, and corresponds the processing instructions one by one. is sent to the first input device, the second input device, and the third input device.

It should be noted that, in combination with the above description of the display system, it can be seen that in practical applications, the display content of the display device 102 may only include content from one input device. The display method provided in the embodiment of the present application is also applicable to this scenario. The embodiment of the present application does not describe the flow of the method in this scenario in detail. In addition, the presenting manners of the first display manner and the second display manner in the foregoing embodiments are illustrated as examples, and do not constitute limitations on the presenting manners of the first display manner and the second display manner.

It can be seen from the above description that in the display method provided by the present application, the display device 102 communicates with the control device 104 . After the display device 102 obtains the object display instruction sent by the control device 104, according to the object display instruction, it obtains the object to be processed indicated by the object display instruction in the current display content (including content from at least two input devices), and uses the first A display mode is used to display the target object, and a second display mode is used to display the object to be processed. Since the first display mode is different from the second display mode, it can guarantee to distinguish between the object to be processed and other content other than the object to be processed, so as to meet the requirement of the viewing object to pay more attention to the specially reminded content. In the display method of the present application, the control device 104 is used to operate the content input by at least two input devices on the display device 102, which improves the convenience of operating the content displayed on the display screen.

It should be understood that although the steps in the flow charts of FIG. 3 and FIG. 5 are shown sequentially as indicated by the arrows, these steps are not necessarily executed sequentially in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and these steps can be executed in other orders. Moreover, at least some of the steps in Fig. 3 and Fig. 5 may include a plurality of sub-steps or stages, these sub-steps or stages are not necessarily executed at the same time, but may be executed at different times, these sub-steps or The execution order of the stages is not necessarily performed sequentially, but may be executed alternately or alternately with at least a part of other steps or substeps of other steps or stages.

The foregoing mainly introduces the solutions provided by the embodiments of the present application from the perspective of methods. In order to realize the above functions, it includes corresponding hardware structures and/or software modules for performing various functions. Those skilled in the art should easily realize that the present application can be implemented in the form of hardware or a combination of hardware and computer software in combination with the units and algorithm steps of each example described in the embodiments disclosed herein. Whether a certain function is executed by hardware or computer software drives hardware depends on the specific application and design constraints of the technical solution. Skilled artisans may use different methods to implement the described functions for each specific application, but such implementation should not be regarded as exceeding the scope of the present application.

In the embodiment of the present application, the display device (the display device may be the above-mentioned display device 102, or the processor in the above-mentioned display device 102) may be divided into functional modules according to the above-mentioned method example, for example, each function may be divided corresponding to each function module, or integrate two or more functions into one processing module. The above-mentioned integrated modules can be implemented in the form of hardware or in the form of software function modules. It should be noted that the division of modules in the embodiment of the present application is schematic and is a logical function division, and there may be another division manner in actual implementation.

An embodiment of the present application provides a display device. As shown in FIG. 13 , the display device includes an instruction acquisition module 1301 , an object determination module 1303 and an object processing module 1305 .

In an embodiment, the instruction acquiring module 1301 is configured to acquire the object display instruction sent by the control device 104 .

The object determination module 1303 is configured to determine the object to be processed indicated by the object display instruction in the currently displayed content; the currently displayed content includes content from at least two input devices.

The object processing module 1305 is configured to display the target object in a first display manner and display the object to be processed in a second display manner in response to the object display instruction, and the second display manner is different from the first display manner. In an application scenario, the target object includes other objects in the currently displayed content except the object to be processed. In another application scenario, the target object includes objects other than the object to be processed in the content to be operated. The content to be operated is the content input by the input device corresponding to the object to be processed.

Optionally, the object determining module 1303 includes a parsing unit, a mapping unit and a content determining unit.

In an embodiment, the parsing unit is configured to parse the object display instruction obtained by the instruction obtaining module to obtain the position information indicated by the object display instruction.

The mapping unit is configured to perform mapping processing on the position information obtained by the analysis unit, to obtain display position information adapted to the display screen.

The content determining unit is configured to determine the content corresponding to the target position in the currently displayed content, and use the determined content as an object to be processed. The target position is the position represented by the display position information obtained by the mapping unit.

In an example, if the object display instruction is an area display instruction, the parsing unit is configured to parse and extract the position information in the object display instruction.

In another example, if the object display instruction includes a start determination sub-instruction and an end determination sub-instruction, the parsing unit is configured to parse and extract the start position information in the start determination sub-instruction, and parse and extract the end determination sub-instruction The end position information in the , and also used to determine the position information according to the start position information, end position information and preset algorithm.

In one example, the mapping unit includes: obtaining a ratio between the size of the built-in canvas and the size of the display screen, and based on the ratio, performing coordinate system conversion processing on the position information to obtain display position information.

In one example, the display device further includes a graphic generation module. The graph generation module is used to generate an indication graph indicating an object to be processed.

In an example, the object processing module 1305 is configured to: respond to the object display instruction, send a processing instruction to the input device corresponding to the object display instruction; the processing instruction corresponds to the object display instruction; receive display information sent from the corresponding input device, Based on the display information, the target object is displayed in the first display mode, and the object to be processed is displayed in the second display mode; the display information is the display content after the corresponding input device processes the content to be displayed according to the processing instruction.

Regarding the definition of the display device, reference may be made to the above definition of the display method, which will not be repeated here. Each module in the above display device can be fully or partially realized by software, hardware and a combination thereof. The above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, and can also be stored in the memory of the computer device in the form of software, so that the processor can invoke and execute the corresponding operations of the above-mentioned modules.

In another embodiment of the present application, a computer-readable storage medium is also provided. The computer-readable storage medium includes computer instructions, and when the computer instructions are run on the display device, the display device is made to execute the display method as shown in FIG. 3 .

Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above-mentioned embodiments can be completed by instructing related hardware through computer programs, and the computer programs can be stored in a non-volatile computer-readable memory In the medium, when the computer program is executed, it may include the processes of the embodiments of the above-mentioned methods. Wherein, any references to memory, storage, database or other media used in the various embodiments provided in the present application may include non-volatile and/or volatile memory. Nonvolatile memory can include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in many forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Chain Synchlink DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

The technical features of the above embodiments can be combined arbitrarily. To make the description concise, all possible combinations of the technical features in the above embodiments are not described. However, as long as there is no contradiction in the combination of these technical features, they should be It is considered to be within the range described in this specification.

The above-mentioned embodiments only express several implementation modes of the present application, and the description thereof is relatively detailed, but should not be construed as limiting the scope of the patent application. It should be noted that those skilled in the art can make several modifications and improvements without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the scope of protection of the patent application should be based on the appended claims.

Claims

A display method, comprising:

Obtain the object display instruction sent by the control device;

determining the object to be processed indicated by the object display instruction in the currently displayed content; the currently displayed content includes content from at least two input devices;

In response to the object display instruction, display the target object in a first display manner, and display the object to be processed in a second display manner, the second display manner is different from the first display manner, and the target object includes Objects other than the object to be processed in the currently displayed content, or objects other than the object to be processed in the content to be operated; the content to be operated is the object corresponding to the object to be processed Enter what the device is typing.
The display method according to claim 1, wherein,

The value of the characteristic parameter in the first display mode is lower than the value of the characteristic parameter in the second display mode, and the characteristic parameter includes at least one of brightness, chroma, and display scale.
The display method according to claim 1 or 2, wherein said determining the object to be processed indicated by the object display instruction in the currently displayed content comprises:

parsing the object display instruction to obtain position information indicated by the object display instruction;

performing mapping processing on the position information to obtain display position information adapted to the display screen;

Determine the content corresponding to the target position in the currently displayed content, and use the determined content as the object to be processed, and the target position is the position represented by the display position information.
The display method according to claim 3, wherein the object display instruction includes the position information;

The parsing the object display instruction to obtain the position information indicated by the object display instruction includes:

Parsing and extracting the location information in the object display instruction.
The display method according to claim 3, wherein the object display instruction includes at least a start determination sub-instruction and an end determination sub-instruction;

The parsing the object display instruction to obtain the position information indicated by the object display instruction includes:

Parse and extract the start position information in the start determination sub-instruction;

parsing and extracting the termination location information in the termination determination sub-instruction;

The location information is determined according to the starting location information, the ending location information and a preset algorithm.
The display method according to claim 3, wherein said mapping the position information to obtain display position information adapted to the display screen includes:

Get the ratio between the size of the built-in canvas and the size of the display;

Based on the ratio, coordinate system conversion processing is performed on the position information to obtain the display position information.
The display method according to any one of claims 1 or 2, 4-6, wherein in response to the object display instruction, the target object is displayed in a first display manner, and the target object is displayed in a second display manner. Objects to be processed include:

In response to the object display instruction, sending a processing instruction to an input device corresponding to the object display instruction; the processing instruction corresponds to the object display instruction;

receiving display information sent from the corresponding input device, and displaying the target object in a first display manner based on the display information, and displaying the object to be processed in a second display manner; the display information is the corresponding The display content after the input device processes the content to be displayed according to the processing instruction.
A display device, including:

An instruction acquisition module, configured to acquire an object display instruction sent by the control device;

An object determination module, configured to determine the object to be processed indicated by the object display instruction in the currently displayed content; the currently displayed content includes content from at least two input devices;

An object processing module, configured to display the target object in a first display manner in response to the object display instruction, and display the object to be processed in a second display manner, the second display manner being different from the first display manner , the target object includes objects other than the object to be processed in the currently displayed content, or includes objects other than the object to be processed in the content to be operated; the content to be operated is related to the object to be processed Content input by the input device corresponding to the processing object.
The display device according to claim 8, wherein,

The value of the characteristic parameter in the first display mode is lower than the value of the characteristic parameter in the second display mode, and the characteristic parameter includes at least one of brightness, chroma, and display scale.
The display device according to claim 8 or 9, wherein the object determination module includes an analysis unit, a mapping unit and a content determination unit;

The parsing unit is configured to parse the object display instruction acquired by the instruction acquisition module, so as to obtain the position information indicated by the object display instruction;

The mapping unit is configured to perform mapping processing on the location information acquired by the parsing unit to obtain display location information adapted to the display screen;

The content determining unit is configured to determine the content corresponding to the target position in the currently displayed content, and use the determined content as the object to be processed, and the target position is the display position obtained by the mapping unit The location of the information representation.
The display device according to claim 10, wherein the object display instruction includes position information;

The parsing unit is configured to parse and extract the position information in the object display instruction.
The display device according to claim 10, wherein the object display instruction includes a start determination sub-instruction and an end determination sub-instruction; the parsing unit is configured to:

Parse and extract the start position information in the start determination sub-instruction;

parsing and extracting the termination location information in the termination determination sub-instruction;

The location information is determined according to the starting location information, the ending location information and a preset algorithm.
The display device according to claim 10, wherein the mapping unit is configured to:

Get the ratio between the size of the built-in canvas and the size of the display;

Based on the ratio, coordinate system conversion processing is performed on the position information to obtain the display position information.
The display method according to any one of claims 8 or 9, 11-13, wherein the object processing module is used for:

In response to the object display instruction, sending a processing instruction to an input device corresponding to the object display instruction; the processing instruction corresponds to the object display instruction;

receiving display information sent from the corresponding input device, and displaying the target object in a first display manner based on the display information, and displaying the object to be processed in a second display manner; the display information is the corresponding The display content after the input device processes the content to be displayed according to the processing instruction.
A display device, including a display screen, a memory, and a processor; the display screen, the memory, and the processor are coupled; the memory is used to store computer-executable instructions, and the processor is used to call the computer The instructions are executed so that when the display device is running, the computer executes the instructions to implement the display method according to any one of claims 1-7.
A display system, comprising a control device and the display device according to claim 15; the control device is connected to the display device.
A computer-readable storage medium, including computer instructions, which, when the computer instructions are run on a display device, cause the display device to execute the display method according to any one of claims 1-7.