WO2021147756A1

WO2021147756A1 - Method, apparatus, and product for display

Info

Publication number: WO2021147756A1
Application number: PCT/CN2021/071704
Authority: WO
Inventors: 刁鸿浩; 黄玲溪
Original assignee: 北京芯海视界三维科技有限公司; 视觉技术创投私人有限公司
Priority date: 2020-01-20
Filing date: 2021-01-14
Publication date: 2021-07-29
Also published as: US20230012591A1; CN113138734A; EP4089520A1; TW202131165A; EP4089520A4; TWI817079B

Abstract

The present application relates to the technical field of display. Disclosed is a method for display, comprising: obtaining the user priority of a user; and according to the user priority, performing pixel distribution on a viewpoint where the user is located. The method for display relates to performing pixel distribution, according to the user priority, on the viewpoint where the user is located, thereby realizing the display of differentiated users, realizing the diversity of display modes, and further improving the display efficiency and improving a display effect. Further disclosed in the present application are an apparatus and product for display, a computer readable storage medium, and a computer program product.

Description

Method, device and product for display

This application claims the priority of a Chinese patent application filed with the China Intellectual Property Office, the application number is 202010073042.3, and the invention title is "Methods, Apparatuses and Products for Display" on January 20, 2020. The entire contents are incorporated by reference in In this application.

Technical field

This application relates to the field of display technology, for example, to methods, devices, and products for display.

Background technique

At present, when the display device is displaying, it will display all users in the scene indiscriminately, that is: the display device will display all users in the scene indiscriminately, and all users on the scene can see the content displayed by the display device .

In the process of implementing the embodiments of the present disclosure, it is found that at least the following problems exist in the related technology:

The display mode of the display device for indiscriminate display to all users on site is too single, which is not conducive to the improvement of display efficiency and display effect.

Summary of the invention

In order to have a basic understanding of some aspects of the disclosed embodiments, a brief summary is given below. This summary is not a general comment, nor is it intended to determine key/important components or describe the scope of protection of these embodiments, but serves as a prelude to the detailed description that follows.

The embodiments of the present disclosure provide a display method, device and product, computer readable storage medium, and computer program product, so as to solve the problem that the display mode of the display device to display all users in the scene indiscriminately is too single, which is not conducive to display. Technical issues related to the improvement of efficiency and display effect.

The display method provided by the embodiment of the present disclosure includes:

Obtain the user priority of the user;

According to the priority of the user, the pixels are allocated to the viewpoint of the user.

In some embodiments, obtaining user priority may include:

Obtain user information of users;

According to the corresponding relationship between the user information and the user priority, the user priority corresponding to the user information is obtained.

In some embodiments, the user priority can also be preset.

In some embodiments, assigning pixels to the viewpoint of the user according to the priority of the user may include:

Determine the user priority of all users at the above viewpoint;

Assign the pixels corresponding to the viewpoint to the user with the highest user priority.

In some embodiments, being located at the viewpoint may include: part or all of the user's eyes fall within the position range of the viewpoint.

In some embodiments, the peripheral viewpoints of the users located at the aforementioned viewpoints may also be allocated pixels according to the user priority.

In some embodiments, assigning pixels to peripheral viewpoints may include:

Determine the priority of the peripheral viewpoint of the peripheral viewpoint relative to the eyes of the user located at the aforementioned viewpoint;

Peripheral viewpoints are allocated pixels according to their priority.

In some embodiments, determining the peripheral viewpoint priority of the peripheral viewpoint may include:

The farther the peripheral viewpoint is from the user whose viewpoint is located above, the lower the priority of the peripheral viewpoint for determining the peripheral viewpoint.

In some embodiments, assigning pixels to peripheral viewpoints may include:

In the case where there is no user with a higher user priority from the peripheral viewpoint, the pixels corresponding to the peripheral viewpoint are allocated to the user located at the aforementioned viewpoint.

In some embodiments, it is also possible to allocate pixels corresponding to the peripheral viewpoint to users with higher user priority when there are users with higher user priority in the peripheral viewpoint.

The display device provided by the embodiment of the present disclosure includes a processor and a memory storing program instructions; the processor is configured to execute the above-mentioned display method when the program instructions are executed.

The display device provided by the embodiment of the present disclosure includes:

The eye displacement sensor is configured to obtain the user priority of the user;

Pixel processing module. Pixel allocation performs pixel allocation to the user's viewpoint according to the user's priority.

In some embodiments, the eye displacement sensor may be configured as:

Obtain user information of users;

In some embodiments, the eye displacement sensor may also be configured as:

Set user priority in advance.

In some embodiments, the pixel processing module may be configured as:

Determine the user priority of all users at the above viewpoint;

In some embodiments, the pixel processing module may also be configured as:

The peripheral viewpoints of the users located at the above viewpoints are allocated pixels according to the user priority.

In some embodiments, when pixel allocation is performed on the peripheral viewpoint, the eye displacement sensor may be configured to determine the peripheral viewpoint priority of the peripheral viewpoint relative to the eyes of the user located at the aforementioned viewpoint. Optionally, the pixel processing module may be configured to perform pixel allocation to the peripheral viewpoints according to the priority of the peripheral viewpoints.

In some embodiments, the eye displacement sensor may be configured as:

In some embodiments, the pixel processing module may be configured as:

In some embodiments, the pixel processing module may also be configured as:

In the case where there is a user with a higher user priority in the peripheral viewpoint, the pixels corresponding to the peripheral viewpoint are allocated to the user with a higher user priority.

In some embodiments, the eye displacement sensor may be a camera.

In some embodiments, the pixel processing module may be a data processing chip or include a logic circuit.

The product for display provided by the embodiment of the present disclosure includes the above-mentioned device for display.

The computer-readable storage medium provided by the embodiments of the present disclosure stores computer-executable instructions, and the computer-executable instructions are configured to execute the above-mentioned display method.

The computer program product provided by the embodiments of the present disclosure includes a computer program stored on a computer-readable storage medium. The computer program includes program instructions. When the program instructions are executed by a computer, the computer executes the above-mentioned display method.

The display method, device and product, computer readable storage medium, and computer program product provided by the embodiments of the present disclosure can achieve the following technical effects:

According to the priority of the user, the pixels are allocated to the viewpoint of the user to realize the display that distinguishes the user, and the diversity of the display mode is realized, thereby improving the display efficiency and the display effect.

The above general description and the following description are only exemplary and explanatory, and are not used to limit the application.

Description of the drawings

One or more embodiments are exemplified by the accompanying drawings. These exemplified descriptions and drawings do not constitute a limitation on the embodiments. Elements with the same reference numerals in the drawings are shown as similar elements. The drawings do not constitute a scale limitation, and among them:

FIG. 1 is a schematic flowchart of a display method provided by an embodiment of the present disclosure;

FIG. 2 is another schematic flowchart of the method for displaying according to an embodiment of the present disclosure;

FIG. 3 is another schematic flow chart of the method for displaying according to an embodiment of the present disclosure;

FIG. 4 is another schematic flowchart of the method for displaying provided by an embodiment of the present disclosure;

FIG. 5 is a schematic diagram of a display device provided by an embodiment of the present disclosure;

FIG. 6 is a schematic diagram of another device for display provided by an embodiment of the present disclosure;

Fig. 7 is a schematic structural diagram of a product for display provided by an embodiment of the present disclosure.

Reference signs:

500: device for display; 510: processor; 520: memory; 530: communication interface; 540: bus; 610: eye displacement sensor; 620: pixel processing module; 700: product for display.

Detailed ways

In order to have a more detailed understanding of the features and technical content of the embodiments of the present disclosure, the implementation of the embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. The attached drawings are for reference only and are not used to limit the embodiments of the present disclosure. In the following technical description, for the convenience of explanation, a number of details are used to provide a sufficient understanding of the disclosed embodiments. However, without these details, one or more embodiments can still be implemented. In other cases, in order to simplify the drawings, well-known structures and devices may be simplified for display.

Referring to FIG. 1, an embodiment of the present disclosure provides a method for displaying, including:

S110: Obtain the user priority of the user;

S120: Perform pixel allocation to the viewpoint of the user according to the user priority.

Referring to Figure 2, in some embodiments, obtaining user priority may include:

S210: Obtain user information of the user;

S220: Obtain the user priority corresponding to the user information according to the corresponding relationship between the user information and the user priority.

In some embodiments, the user information may be a feature of the user's eyes, such as an image of the user's eyes. Optionally, the user information may also be other information that can effectively identify different users.

In some embodiments, the user priority can also be preset.

Referring to FIG. 3, in some embodiments, assigning pixels to the viewpoint of the user according to the user priority may include:

S310: Determine the user priority of all users located at the above viewpoint;

S320: Allocate the pixel corresponding to the viewpoint to the user with the highest user priority.

In some embodiments, being located at the viewpoint may include: part or all of the user's eyes fall within the position range of the viewpoint. Optionally, according to a preset strategy or actual situation, if the user's eyes all fall within the position range of the viewpoint, confirm that the user is located at the viewpoint; or, if part of the user's eyes fall within the position range of the viewpoint If it is inside, confirm that the user is at the viewpoint.

In some embodiments, the peripheral viewpoints of the users located at the aforementioned viewpoints may also be allocated pixels according to the user priority. In this way, if the user moves to the peripheral viewpoint, the display to the user can still be maintained.

Referring to FIG. 4, in some embodiments, performing pixel allocation to peripheral viewpoints may include:

S410: Determine the peripheral viewpoint priority of the peripheral viewpoint relative to the eyes of the user located at the aforementioned viewpoint;

S420: Perform pixel allocation to the surrounding viewpoints according to the priority of the surrounding viewpoints.

In some embodiments, assigning pixels to peripheral viewpoints may include:

In some embodiments, it is also possible to allocate pixels corresponding to the peripheral viewpoint to users with higher user priority when there are users with higher user priority in the peripheral viewpoint. In this way, it is possible to avoid conflicts when the peripheral viewpoints assign pixels to users with different priorities.

In some embodiments, after the above-mentioned pixel allocation is completed, subsequent display operations such as pixel rendering can also be performed.

In some embodiments, the peripheral view priority of the peripheral view can be flexibly determined according to a preset strategy or actual situation, as long as the display can be performed normally for the user and conflicts in pixel allocation for users of different priorities can be avoided.

The embodiment of the present disclosure provides a display device, including a processor and a memory storing program instructions; the processor is configured to execute the above-mentioned display method when the program instructions are executed.

In some embodiments, the structure of the above-mentioned display device 500 is shown in FIG. 5, and includes:

The processor (processor) 510 and the memory (memory) 520 may also include a communication interface (Communication Interface) 530 and a bus 540. Among them, the processor 510, the communication interface 530, and the memory 520 can communicate with each other through the bus 540. The communication interface 530 can be used for information transmission. The processor 510 may call logic instructions in the memory 520 to execute the display method of the foregoing embodiment.

In addition, the aforementioned logic instructions in the memory 520 can be implemented in the form of a software functional unit and when sold or used as an independent product, they can be stored in a computer readable storage medium.

As a computer-readable storage medium, the memory 520 can be used to store software programs and computer-executable programs, such as program instructions/modules corresponding to the methods in the embodiments of the present disclosure. The processor 510 executes functional applications and data processing by running the program instructions/modules stored in the memory 520, that is, implements the display method in the foregoing method embodiment.

The memory 520 may include a storage program area and a storage data area. The storage program area may store an operating system and an application program required by at least one function; the storage data area may store data created according to the use of the terminal device, and the like. In addition, the memory 520 may include a high-speed random access memory, and may also include a non-volatile memory.

Referring to FIG. 6, an embodiment of the present disclosure provides an apparatus 500 for display, including:

The eye displacement sensor 610 is configured to obtain the user priority of the user;

The pixel processing module 620 allocates pixels to the viewpoint of the user according to the priority of the user.

In some embodiments, the eye displacement sensor 610 may be configured as:

Obtain user information of users;

In some embodiments, the eye displacement sensor 610 may also be configured as:

Set user priority in advance.

In some embodiments, the pixel processing module 620 may be configured as:

Determine the user priority of all users at the above viewpoint;

In some embodiments, the pixel processing module 620 may also be configured as:

The peripheral viewpoints of the users located at the above viewpoints are allocated pixels according to the user priority. In this way, if the user moves to the peripheral viewpoint, the display to the user can still be maintained.

In some embodiments, when pixel allocation is performed on peripheral viewpoints, the eye displacement sensor 610 may be configured to determine the peripheral viewpoint priority of the peripheral viewpoint relative to the eyes of the user located at the aforementioned viewpoint. Optionally, the pixel processing module 620 may be configured to perform pixel allocation to the peripheral viewpoints according to the priority of the peripheral viewpoints.

In some embodiments, the eye displacement sensor 610 may be configured as:

In some embodiments, the pixel processing module 620 may be configured as:

In some embodiments, the pixel processing module 620 may also be configured as:

In the case where there is a user with a higher user priority in the peripheral viewpoint, the pixels corresponding to the peripheral viewpoint are allocated to the user with a higher user priority. In this way, it is possible to avoid conflicts when the peripheral viewpoints assign pixels to users with different priorities.

In some embodiments, the eye displacement sensor 610 may be a camera. Optionally, the number of cameras may be one or more than one.

In some embodiments, the pixel processing module 620 may be a data processing chip, a single-chip microcomputer, etc., or include a logic circuit to implement the above-mentioned corresponding functions.

Referring to FIG. 7, an embodiment of the present disclosure provides a product 700 for display, including the above-mentioned device 500 for display.

In some embodiments, the above-mentioned product 700 for display may be a system for display embodied in the form of a server or the like. Optionally, the above products may also include other control circuits, auxiliary circuits, structures, etc., to support the normal operation of the display device 500.

According to the method, device and product for display provided by the embodiments of the present disclosure, pixels are allocated to the viewpoint of the user according to the priority of the user, so as to realize the display that distinguishes the user, realize the diversity of the display mode, and further improve the display efficiency and improvement. The display effect.

The embodiments of the present disclosure provide a computer-readable storage medium that stores computer-executable instructions, and the computer-executable instructions are configured to execute the above-mentioned display method.

The embodiments of the present disclosure provide a computer program product, including a computer program stored on a computer-readable storage medium, the computer program including program instructions, when the program instructions are executed by a computer, the computer executes the above-mentioned display Methods.

The aforementioned computer-readable storage medium may be a transitory computer-readable storage medium or a non-transitory computer-readable storage medium.

The computer-readable storage medium and computer program product provided by the embodiments of the present disclosure allocate pixels to the user’s viewpoint according to the user priority, so as to realize the display that distinguishes the user, realize the diversity of the display mode, and further improve the display efficiency and improvement. The display effect.

The technical solutions of the embodiments of the present disclosure can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes one or more instructions to enable a computer device (which can be a personal computer, a server, or a network). Equipment, etc.) execute all or part of the steps of the method of the embodiment of the present disclosure. The aforementioned storage medium may be a non-transitory storage medium, including: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disks or optical disks, etc. A medium that can store program codes, or it can be a transient storage medium.

The above description and drawings sufficiently illustrate the embodiments of the present disclosure to enable those skilled in the art to practice them. Other embodiments may include structural, logical, electrical, procedural, and other changes. The examples only represent possible changes. Unless explicitly required, the individual components and functions are optional, and the order of operations can be changed. Parts and features of some embodiments may be included in or substituted for parts and features of other embodiments. The scope of the embodiments of the present disclosure includes the entire scope of the claims and all available equivalents of the claims. When used in this application, although the terms "first", "second", etc. may be used in this application to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another element. For example, without changing the meaning of the description, the first element can be called the second element, and likewise, the second element can be called the first element, as long as all occurrences of the "first element" are renamed consistently and all occurrences "Second component" can be renamed consistently. The first element and the second element are both elements, but they may not be the same element. Moreover, the terms used in this application are only used to describe the embodiments and are not used to limit the claims. As used in the description of the embodiments and claims, unless the context clearly indicates, the singular forms "a" (a), "an" (an) and "the" (the) are intended to also include plural forms . Similarly, the term "and/or" as used in this application refers to any and all possible combinations that include one or more of the associated lists. In addition, when used in this application, the term "comprise" (comprise) and its variants "comprises" and/or including (comprising) and the like refer to the stated features, wholes, steps, operations, elements, and/or The existence of components does not exclude the existence or addition of one or more other features, wholes, steps, operations, elements, components, and/or groups of these. If there are no more restrictions, the element defined by the sentence "including a..." does not exclude the existence of other identical elements in the process, method, or device that includes the element. In this article, each embodiment focuses on the differences from other embodiments, and the same or similar parts between the various embodiments can be referred to each other. For the methods, products, etc. disclosed in the embodiments, if they correspond to the method parts disclosed in the embodiments, then the related parts can be referred to the description of the method parts.

Those skilled in the art may realize that the units and algorithm steps of the examples described in combination with the embodiments disclosed herein can be implemented by electronic hardware or a combination of computer software and electronic hardware. Whether these functions are performed by hardware or software may depend on the specific application and design constraint conditions of the technical solution. Those skilled in the art may use different methods for each specific application to realize the described functions, but such realization should not be considered as going beyond the scope of the embodiments of the present disclosure. Those skilled in the art can clearly understand that, for the convenience and conciseness of the description, the specific working process of the system, device and unit described above can refer to the corresponding process in the foregoing method embodiment, which will not be repeated here.

In the embodiments disclosed herein, the disclosed methods and products (including but not limited to devices, equipment, etc.) can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of units may only be a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components may be combined or may be Integrate into another system, or some features can be ignored or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms. The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to implement this embodiment. In addition, the functional units in the embodiments of the present disclosure may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.

The flowcharts and block diagrams in the accompanying drawings show the possible implementation architecture, functions, and operations of the system, method, and computer program product according to the embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, program segment, or part of the code, and the above-mentioned module, program segment, or part of the code contains one or more options for realizing the specified logic function. Execute instructions. In some alternative implementations, the functions marked in the block may also occur in a different order from the order marked in the drawings. For example, two consecutive blocks can actually be executed substantially in parallel, and they can sometimes be executed in the reverse order, depending on the functions involved. In the descriptions corresponding to the flowcharts and block diagrams in the drawings, the operations or steps corresponding to different blocks can also occur in a different order than that disclosed in the description, and sometimes there is no specific operation or step between different operations or steps. order. For example, two consecutive operations or steps can actually be performed substantially in parallel, and they can sometimes be performed in the reverse order, which may depend on the functions involved. Each block in the block diagram and/or flowchart, and the combination of the blocks in the block diagram and/or flowchart, can be implemented by a dedicated hardware-based system that performs the specified functions or actions, or can be implemented by dedicated hardware Realized in combination with computer instructions.

Claims

A method for display, including:

Obtain the user priority of the user;

Pixel allocation is performed on the viewpoint of the user according to the user priority.
The method according to claim 1, wherein obtaining the user priority includes:

Obtain user information of the user;

According to the correspondence between the user information and the user priority, the user priority corresponding to the user information is obtained.
The method according to claim 2, further comprising:

The user priority is set in advance.
The method according to any one of claims 1 to 3, wherein the pixel allocation to the viewpoint of the user according to the user priority comprises:

Determine the user priority of all users located at the viewpoint;

The pixels corresponding to the viewpoint are allocated to the user with the highest user priority.
The method according to claim 4, wherein being located at the viewpoint includes: part or all of the user's eyes fall within the position range of the viewpoint.
The method according to claim 4, further comprising:

Pixel allocation is performed on the peripheral viewpoint of the user located at the viewpoint according to the user priority.
The method according to claim 6, wherein the pixel allocation to the peripheral viewpoint comprises:

Determining the peripheral viewpoint priority of the peripheral viewpoint relative to the eyes of the user located at the viewpoint;

Pixel allocation is performed on the peripheral viewpoint according to the priority of the peripheral viewpoint.
The method according to claim 7, wherein determining the peripheral viewpoint priority of the peripheral viewpoint comprises:

The farther the peripheral viewpoint is from the user located at the viewpoint, the lower the priority of the peripheral viewpoint for determining the peripheral viewpoint.
The method according to claim 7, wherein the pixel allocation to the peripheral viewpoint comprises:

In the case that there is no user with a higher user priority at the peripheral viewpoint, the pixels corresponding to the peripheral viewpoint are allocated to the user located at the viewpoint.
The method according to claim 9, further comprising:

In the case where there is a user with a higher user priority at the peripheral viewpoint, the pixels corresponding to the peripheral viewpoint are allocated to the user with a higher user priority.
A display device, comprising a processor and a memory storing program instructions, the processor is configured to execute the method according to any one of claims 1 to 10 when the program instructions are executed.
A display device, including:

The eye displacement sensor is configured to obtain the user priority of the user;

A pixel processing module, which allocates pixels to the viewpoint of the user according to the user priority.
The device according to claim 12, wherein the eye displacement sensor is configured to:

Obtain user information of the user;

According to the correspondence between the user information and the user priority, the user priority corresponding to the user information is obtained.
The device according to claim 13, wherein the eye displacement sensor is further configured to:

The user priority is set in advance.
The device according to any one of claims 12 to 14, wherein the pixel processing module is configured to:

Determine the user priority of all users located at the viewpoint;

The pixels corresponding to the viewpoint are allocated to the user with the highest user priority.
The device according to claim 15, wherein being located at the viewpoint includes: part or all of the user's eyes fall within the position range of the viewpoint.
The device according to claim 15, wherein the pixel processing module is further configured to:

Pixel allocation is performed on the peripheral viewpoint of the user located at the viewpoint according to the user priority.
The device according to claim 17, wherein when pixel allocation is performed on the peripheral viewpoint,

The eye displacement sensor is configured to: determine the peripheral viewpoint priority of the peripheral viewpoint relative to the user's eye located at the viewpoint;

The pixel processing module is configured to perform pixel allocation to the peripheral viewpoint according to the priority of the peripheral viewpoint.
The device according to claim 18, wherein the eye displacement sensor is configured to:

The farther the peripheral viewpoint is from the user located at the viewpoint, the lower the priority of the peripheral viewpoint for determining the peripheral viewpoint.
The device according to claim 18, wherein the pixel processing module is configured to:

In the case that there is no user with a higher user priority at the peripheral viewpoint, the pixels corresponding to the peripheral viewpoint are allocated to the user located at the viewpoint.
The device according to claim 20, wherein the pixel processing module is further configured to:

In the case where there is a user with a higher user priority at the peripheral viewpoint, the pixels corresponding to the peripheral viewpoint are allocated to the user with a higher user priority.
The device according to claim 12, wherein the eye displacement sensor is a camera.
The device according to claim 12, wherein the pixel processing module is a data processing chip or includes a logic circuit.
A product for display, comprising the device according to any one of claims 11 or 12 to 23.
A computer-readable storage medium storing computer-executable instructions, the computer-executable instructions being configured to execute the method according to any one of claims 1 to 10.
A computer program product, comprising a computer program stored on a computer-readable storage medium, the computer program comprising program instructions, when the program instructions are executed by a computer, the computer executes any one of claims 1 to 10 The method described.