WO2019113792A1

WO2019113792A1 - Method and device for display control, and display

Info

Publication number: WO2019113792A1
Application number: PCT/CN2017/115724
Authority: WO
Inventors: 谢俊
Original assignee: 深圳市柔宇科技有限公司
Priority date: 2017-12-12
Filing date: 2017-12-12
Publication date: 2019-06-20
Also published as: CN111316222A

Abstract

A method and device for display control, and a display. The method comprises: utilizing at least one distance sensor to detect the location of a user; determining, on the basis of the location of the user, a target area that needs to be displayed in the display; utilizing the target area to display an object to be displayed, and controlling the area other than the target area in the display not to display. Embodiments of the present invention allow the display to display only a corresponding partial area on the basis of the location of the user, thus reducing unnecessary display and effectively reducing display power consumption.

Description

Display control method, device and display

Technical field

The present invention relates to the field of electronic technologies, and in particular, to a display control method, apparatus, and display.

Background technique

At present, most electronic products are seeking to highlight the slimness and portability of products. In the design of electronic products, batteries with limited capacity and small capacity are usually used. However, in order to meet user needs, the display size of electronic products is usually designed to be larger. As a result, the power consumption is large, and the power consumption of the display is relatively large in the overall power consumption of the electronic product. Therefore, how to effectively reduce the display power consumption of the display has become an urgent problem to be solved.

Summary of the invention

The embodiment of the invention discloses a display control method, device and display, which can display only a corresponding partial area of the display according to the position of the user, which reduces unnecessary display and can effectively reduce display power consumption.

A first aspect of the embodiments of the present invention discloses a display control method, which is applied to a display, and the display is provided with at least one distance sensor, and the method includes:

The position at which the user is located is detected by the at least one distance sensor.

A target area to be displayed in the display is determined according to a location where the user is located.

The object to be displayed is displayed by the target area, and an area other than the target area in the display is controlled from being displayed.

A second aspect of the embodiments of the present invention discloses a display control device, which is applied to a display, and the display is provided with at least one distance sensor, and the device includes:

And a detecting module, configured to detect, by the at least one distance sensor, a location where the user is located.

And a determining module, configured to determine a target area in the display that needs to be displayed according to a location where the user is located.

And a display module, configured to display an object to be displayed by using the target area.

a control module, configured to control an area of the display other than the target area not to be displayed Show.

A third aspect of the embodiments of the present invention discloses a display comprising the display control device according to the second aspect described above.

A fourth aspect of the embodiments of the present invention discloses a computer readable storage medium storing instructions that, when run on a computer, cause the computer to implement the display control method described in the above first aspect.

A fifth aspect of an embodiment of the present invention discloses a computer program product comprising instructions which, when run on a computer, cause the computer to implement the display control method of the first aspect.

The embodiment of the present invention can detect the location of the user by using at least one distance sensor on the display, determine the target area to be displayed in the display according to the location of the user, and display the object to be displayed by using the target area, and control the display. The area other than the target area is not displayed, and the display can only display the corresponding partial area according to the position of the user, which reduces unnecessary display and can effectively reduce display power consumption.

DRAWINGS

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings to be used in the embodiments will be briefly described below. It is obvious that the drawings in the following description are only some embodiments of the present invention. Those skilled in the art can also obtain other drawings based on these drawings without paying for creative labor.

1 is a schematic structural diagram of a display according to an embodiment of the present invention;

2 is a schematic flow chart of a display control method according to an embodiment of the present invention;

FIG. 3a is a schematic diagram of distance detection of a display according to an embodiment of the present invention; FIG.

FIG. 3b is a schematic diagram of a usage scenario of a display according to an embodiment of the present invention; FIG.

3c is a schematic diagram of a mapping relationship of a display according to an embodiment of the present invention;

FIG. 3 is a schematic diagram showing a display effect of a display according to an embodiment of the present invention; FIG.

FIG. 3e is a schematic diagram of zooming of an object to be displayed according to an embodiment of the present invention; FIG.

FIG. 4 is a schematic structural diagram of a display control apparatus according to an embodiment of the present invention.

Detailed ways

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

The embodiment of the invention discloses a display control method, device and display, which can display only a corresponding partial area of the display according to the position of the user, which reduces unnecessary display and can effectively reduce display power consumption. The details are described below separately.

FIG. 1 is a schematic structural diagram of a display according to an embodiment of the present invention. The display described in this embodiment may specifically be a curved display, the display includes: a processor and at least one distance sensor, the processor may be a central processing unit (CPU), and the processor may also be other General-purpose processor, Digital Signal Processor (DSP), Application Specific Integrated Circuit (ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic device, discrete Gate or transistor logic, discrete hardware components, etc. The general purpose processor may be a microprocessor or the processor or any conventional processor or the like. The processor runs on a computer system, such as a general purpose computer or an embedded computing system, for computing operations such as converting a object to be displayed (such as a 3D model) into a 2D image, the at least one distance sensor is used to detect a distance between the user and the display. ,among them:

The processor is configured to detect a location where the user is located by using the at least one distance sensor, and specifically may determine a location where the user is located according to a distance between the user and the display detected by the at least one distance sensor.

The processor is further configured to determine a target area to be displayed in the display according to the location of the user, and display the object to be displayed by using the target area, and also control an area of the display other than the target area not to be displayed, thereby The position of the user is such that the display has only a corresponding partial area for display, which reduces unnecessary display and can effectively reduce display power consumption.

Optionally, the display further includes a communication interface, wherein:

A communication interface for receiving an input model and related configuration parameters, such as a position change policy set for an object to be displayed.

The processor is further configured to determine a placement position and orientation of the object to be displayed according to the location and location change policy of the user.

Optionally, the display is cylindrical, and the at least one distance sensor is radially distributed at a position near the bottom of the display.

Please refer to FIG. 2 , which is a schematic flowchart diagram of a display control method provided by the display shown in FIG. 1 according to an embodiment of the present invention. The display control method described in this embodiment includes:

201. The display utilizes at least one distance sensor to detect a location of the user.

In some possible implementations, the at least one distance sensor may be specifically distributed radially around the display, and may measure the distance of objects in the space, such as a user near the display, to the display.

Specifically, in the sensing range of the distance sensor, when the user approaches the sensing range of the display, the distance detection result of the partial distance sensor is smaller than the distance detection result of the other distance sensors, and the display can acquire each distance of the at least one distance sensor. a distance detection result of the sensor, determining, from the at least one distance sensor, a target distance sensor whose distance detection result is less than or equal to a preset distance threshold (for example, 2 m/m), thereby detecting the result according to the distance of the target distance sensor and on the display The location can determine the location of the current user, including the orientation of the user relative to the display, the distance from the display, and the like.

As shown in FIG. 3a, the circle formed by the shaded area represents the sensing range of the distance sensor, the inner circumference of the ring represents the display, and the square represents the user, and the distance detection result of the distance sensor (ie, the target distance sensor) facing the user will be The distance detection result is smaller than other distance sensors, and the position of the user relative to the display can be determined according to the position distribution of the target distance sensor on the display, and the distance between the user and the display can be determined according to the distance detection result of the target distance sensor, thereby determining the current The location of the user.

202. The display determines a target area in the display that needs to be displayed according to a location where the user is located.

Specifically, after the display determines the location of the user, since the range of the visual field that the user can see is limited, the display can be controlled to perform only partial display, so that the area to be displayed in the display can be determined according to the location of the user ( Recorded as the target area).

In some possible implementations, the display may be a curved display and is cylindrical, and is tangent to the circumference of the display from the position where the user is located, and obtains two tangent points on the circumference of the display, which the user can view. The area to which it is reached can be determined to be the area enclosed by the portion between the two tangent points in the display, that is, the target area.

203. The display displays an object to be displayed by using the target area, and controls an area of the display other than the target area not to be displayed.

The object to be displayed may specifically be a 3D model.

Specifically, the display can convert the three-dimensional image of the object to be displayed into a two-dimensional image by perspective transformation, and then display the two-dimensional image of the object to be displayed by using the target area. Among them, the perspective point can be the location of the user.

In addition, the display can also control that the area other than the target area is not displayed, including: if the area other than the target area is currently displayed, the display turns off the display of the other area; if the other area is currently displayed off, The display then controls the other areas to remain off display. The specific manner in which the display turns off the display of the other area may be: the display sets the red, green, blue, and RGB values of the respective pixels included in the other areas to zero.

In the embodiment of the present invention, the display may detect the location of the user by using at least one distance sensor, determine the target area to be displayed in the display according to the location of the user, and display the object to be displayed by using the target area, and control the display. The area outside the target area is not displayed, so that the display can only display the corresponding partial area according to the position of the user, which reduces unnecessary display, can effectively reduce display power consumption, and also ensures the user's viewing experience. .

In some feasible implementation manners, as shown in FIG. 3b, different parts of the object to be displayed may be displayed according to different positions of the user, and the display may determine the target part of the object to be displayed according to the position of the user, thereby utilizing The target area displays the target portion, thereby realizing that the change of the position where the user is located displays different parts of the object to be displayed.

In some feasible implementation manners, the specific manner in which the display uses the target area to display the target part may be: the display determines a mapping relationship between the pixel included in the target area and the display plane of the target part according to the location of the user, and uses the mapping relationship. The pixel values of the respective pixels included in the target area are obtained, so that the color of the display of the respective pixels is controlled according to the pixel value, so that the target area displays the target part, thereby eliminating the distortion of the appearance of the curved display.

For example, as shown in FIG. 3c, the circumference represents a spatial top view of the display, and the Cartesian coordinate system XAY is established with the center point A as the origin, the B point represents the position of the user, and BC and BE are the two tangent lines of the B point and the circle. C, E are tangent points, D, F are two intersections of the circumference and the X-axis. When the user views the display at point B, only the area corresponding to the arc of the CE on the circumference (ie, the above target area) can be seen. Since the arc CE is a curved surface, if the linear mapping is directly performed to display the target portion of the object to be displayed, the picture (ie, the target portion) seen from the user's perspective is also curved, that is, distortion is generated, which affects the look and feel. Therefore, it can be assumed that the display plane seen by the user is the position of the line segment CE, and the mapping relationship between the pixel included in the target area corresponding to the arc CE and the display plane is indicated by an arrow between the arc CE and the line segment CE, that is, The mapping relationship for the projection. The line segment CE can be regarded as the middle part of the line segment DF, and the line segment DF represents the position of the target part of the object to be displayed, which is the theoretical maximum target area, corresponding to when the user is infinity from the display, and the distance sensor The range of sensing is not limited.

Further, R and L are the radius of the display and the distance from the user to the display (here, the closest distance). In ΔABC, AB=R+L, AC=R, ∠C is a right angle, and the cosine of ∠CAB is R/(R+L), that is, cos∠CAB=R/(R+L), so that ∠CAB is obtained. The value, ∠ CAD = 90 ° - ∠ CAB, the target area corresponds to the current Cartesian coordinate system, the angle is -∠CAD to -180 ° + ∠ CAD, radius R is the arc CE. According to the parameter equation of the circle, for any point H(x, y) on the arc CE, there are: x=R*cos(t), y=R*sin(t), -180°+∠CAD≤t ≤-∠CAD, so that the display can obtain a one-to-one mapping relationship between the arc CE (ie, the target area) and the line segment CE (ie, the display plane of the target part) by the x coordinate. It is also possible to achieve the effect as shown in Fig. 3d, so that the user can see the same picture as the flat display regardless of the direction, and does not deform due to the curvature of the curved display.

In some feasible implementations, assuming that the target portion is located at the point A shown in FIG. 3c, the display can dynamically adjust the size of the displayed target portion according to the position of the user, so that the target portion appears to be standing. The virtual effect of point A. Specifically, the display may determine a scaling factor for the target portion according to the location of the user and geometric parameters (eg, width) of the target portion, and then use the scaling factor to scale the target portion.

For example, as shown in FIG. 3e, R and L are the radius of the display and the distance from the user to the display (here, the closest distance), and the two lines BM and BN represent the visual angle of the human eye, in order to realize a hypothesis. The object at position A (ie, the target part) is placed at the point of K point display, and the scaling factor of the object needs to be determined, and the one-dimensional case of the scaled object such as the length relationship between the line segment ST and the line segment PQ. According to In the description of the surface, the display can find each side and each angle of ΔABC, CK is the perpendicular of AB, ΔACK can also solve each edge and each angle, so AK can also be found, KB can also be found (ie AB-AK=R+L-AK). In the case where KB, AB, and PQ (which may refer to the width of the target portion) are known, the display is proportional to the corresponding side of the similar triangle, that is, the length of ST can be obtained, and ST/PQ can be used as the scaling factor in the dimension. In turn, the scaling factor of each dimension can be determined, so that in the specific display, each dimension can be simultaneously scaled according to the corresponding scaling factor.

It should be noted that the above is assuming that the position of the target portion is at point A, and it is actually assumed that the target portion is at an arbitrary position, and the processing method is the same.

In some possible implementations, the user may be allowed to set a location change policy of the object to be displayed, the location change policy is related to the user requirement, and the user is required to input into the computer system of the display before use. Before the display uses the target area to display the object to be displayed, the position change strategy set for the object to be displayed may be acquired, and the placement position and orientation of the object to be displayed are determined according to the position and position change strategy of the user. The position change strategy may specifically include: following the position following the user movement and the position remains unchanged, wherein the position following the user movement refers to the user wanting the object to be displayed to follow to move together (for example, following a moving billboard), that is, the object to be displayed. The position of the object to be displayed always faces the user as the position of the user changes; the position remains unchanged means that the user wishes to stand at different positions to see different surfaces of the object to be displayed (for example, a model display of the museum) System), that is, the object to be displayed remains in the same position.

It should be noted that the location change policy may include, but is not limited to, the above two strategies, and a more complex location change policy may be formulated according to specific requirements, such as dynamically adjusting the position of the object to be displayed in combination with the distance between the user and the display (eg, the farther the user is away from the display) The object to be displayed is also farther away from the display and close to the user).

In some possible implementations, the location change strategy may be specifically input to the computer system of the display by a tabular function or an expression formal function. For example, the center of the bottom of the display cylinder may be the origin, and any one direction establishes the polar coordinates in the positive direction, and the polar coordinates of the position where the user is located are used as parameters (corresponding to the distance between the user and the center of the display cylinder, the angle between the user and the positive direction). The plurality of functions include a correspondence between the user polar coordinates and the position of the object to be displayed, a correspondence relationship with the orientation of the object to be displayed, a correspondence relationship with the size of the object to be displayed, and the like.

FIG. 4 is a schematic structural diagram of a display control apparatus according to an embodiment of the present invention. The display control device described in this embodiment is applied to a display, and the display is provided with at least one distance sensor, and the display control device includes:

The detecting module 401 is configured to detect, by using the at least one distance sensor, a location where the user is located.

The determining module 402 is configured to determine, according to the location where the user is located, a target area in the display that needs to be displayed.

The display module 403 is configured to display an object to be displayed by using the target area.

The control module 404 is configured to control an area of the display other than the target area not to be displayed.

Optionally, the display module 403 is configured to display an object to be displayed by using the target area, and specifically includes:

A target portion of the object to be displayed is determined according to the location where the user is located.

The target portion is displayed using the target area.

Optionally, the display module 403 is configured to display the target part by using the target area, and specifically includes:

Determining a mapping relationship between a pixel included in the target area and a display plane of the target part according to a location where the user is located.

The pixel values of the respective pixels included in the target area are acquired by using the mapping relationship.

The color displayed by each of the pixels is controlled according to the pixel value such that the target area displays the target portion.

Optionally, the display control device further includes a scaling module 405, where:

The determining module 402 is further configured to determine a scaling factor for the target portion according to a location where the user is located and a geometric parameter of the target portion.

The scaling module 405 is configured to scale the target portion by using the scaling factor.

Optionally, the display control device further includes an obtaining module 406, where:

The obtaining module 406 is configured to acquire a position change policy set for the object to be displayed before the display module displays the object to be displayed by using the target area.

The determining module 402 is further configured to determine a placement position and orientation of the object to be displayed according to the location where the user is located and the location change policy.

Optionally, the detecting module 401 is configured to detect, by using the at least one distance sensor, a location where the user is located, and specifically includes:

Obtaining a distance detection result of the at least one distance sensor.

A target distance sensor whose distance detection result is less than or equal to a preset distance threshold is determined from the at least one distance sensor.

The position of the user is determined by the distance detection result of the target distance sensor.

Optionally, the target area is an area enclosed by a portion between two tangent points corresponding to a position where the user is located in the display.

It is to be understood that the functions of the functional modules of the display control device of the present embodiment may be specifically implemented according to the method in the foregoing method embodiments. For the specific implementation process, refer to the related description of the foregoing method embodiments, and details are not described herein again.

In the embodiment of the present invention, the detecting module 401 detects the location of the user by using at least one distance sensor on the display, and the determining module 402 determines the target area to be displayed in the display according to the position of the user, and the display module 403 displays the target area by using the target area. The object to be displayed, the control module 404 controls the area of the display other than the target area to be displayed, and the display can only display the corresponding partial area according to the position of the user, thereby reducing unnecessary display and effectively reducing the display work. Consumption.

The embodiment of the invention further provides a display comprising the display control device in the above embodiment.

Optionally, the display is a curved display, and the at least one distance sensor is radially distributed at a position near the bottom of the display.

Embodiments of the present invention also provide a computer readable storage medium storing instructions that, when run on a computer, cause the computer to implement the above method embodiments.

Embodiments of the present invention also provide a computer program product comprising instructions that, when run on a computer, cause the computer to implement the above-described method embodiments.

It should be noted that, for the foregoing various method embodiments, for the sake of simple description, they are all expressed as a series of action combinations, but those skilled in the art should know that the present invention is not described. The order of the actions is limited, as some steps may be performed in other orders or simultaneously in accordance with the present invention. In addition, those skilled in the art should also understand that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present invention.

A person skilled in the art may understand that all or part of the various steps of the foregoing embodiments may be performed by a program to instruct related hardware. The program may be stored in a computer readable storage medium, and the storage medium may include: Flash disk, Read-Only Memory (ROM), Random Access Memory (RAM), disk or optical disk.

The above disclosure is only a preferred embodiment of the present invention, and of course, the scope of the present invention is not limited thereto, and those skilled in the art can understand all or part of the process of implementing the above embodiments, and according to the present invention. The equivalent changes required are still within the scope of the invention.

Claims

A display control method is applied to a display, wherein the display is provided with at least one distance sensor, and the method includes:

Detecting, by the at least one distance sensor, a location where the user is located;

Determining a target area in the display that needs to be displayed according to a location where the user is located;

The object to be displayed is displayed by the target area, and an area other than the target area in the display is controlled from being displayed.
The method according to claim 1, wherein the displaying the object to be displayed by using the target area comprises:

Determining a target portion of the object to be displayed according to the location of the user;

The target portion is displayed using the target area.
The method of claim 2 wherein said display is a curved display.
The method according to claim 3, wherein the displaying the target portion by using the target area comprises:

Determining, according to a location where the user is located, a mapping relationship between a pixel included in the target area and a display plane of the target part;

Obtaining pixel values of respective pixels included in the target area by using the mapping relationship;

The color displayed by each of the pixels is controlled according to the pixel value such that the target area displays the target portion.
The method according to any one of claims 2 to 4, wherein the method further comprises:

Determining a scaling factor for the target portion according to a location where the user is located and a geometric parameter of the target portion;

The target portion is scaled using the scaling factor.
The method according to any one of claims 1 to 4, wherein said utilizing said mesh Before the target area displays the object to be displayed, the method further includes:

Obtaining a location change policy set for the object to be displayed;

And determining a placement position and orientation of the object to be displayed according to the location where the user is located and the location change policy.
The method of claim 6 wherein said location change policy comprises one or more of location following user movement and location remaining unchanged.
The method according to claim 1, wherein the detecting the location of the user by using the at least one distance sensor comprises:

Obtaining a distance detection result of the at least one distance sensor;

Determining, from the at least one distance sensor, a target distance sensor whose distance detection result is less than or equal to a preset distance threshold;

The position of the user is determined by the distance detection result of the target distance sensor.
The method of claim 3 wherein said display is cylindrical and said at least one distance sensor is radially distributed at a location near said bottom of said display.
The method of claim 9 wherein said target area is an area enclosed by a portion of said display between two tangent points corresponding to a location at which said user is located.
A display control device is applied to a display, wherein the display is provided with at least one distance sensor, and the device comprises:

a detecting module, configured to detect, by using the at least one distance sensor, a location where the user is located;

a determining module, configured to determine, according to a location where the user is located, a target area in the display that needs to be displayed;

a display module, configured to display an object to be displayed by using the target area;

And a control module, configured to control an area of the display other than the target area not to be displayed.
The display control device according to claim 11, wherein the display module is configured to display the object to be displayed by using the target area, and specifically includes:

Determining a target portion of the object to be displayed according to the location of the user;

The target portion is displayed using the target area.
The display control device according to claim 12, wherein the display module is configured to display the target portion by using the target area, and specifically includes:

Determining, according to a location where the user is located, a mapping relationship between a pixel included in the target area and a display plane of the target part;

Obtaining pixel values of respective pixels included in the target area by using the mapping relationship;

The color displayed by each of the pixels is controlled according to the pixel value such that the target area displays the target portion.
The display control device according to claim 12 or 13, wherein the display control device further comprises a scaling module, wherein:

The determining module is further configured to determine a scaling factor for the target part according to a location where the user is located and a geometric parameter of the target part;

The scaling module is configured to scale the target portion by using the scaling factor.
The display control device according to any one of claims 11 to 14, wherein the display control device further comprises an acquisition module, wherein:

The acquiring module is configured to acquire a position change policy set for the object to be displayed before the display module displays the object to be displayed by using the target area;

The determining module is further configured to determine a placement position and orientation of the object to be displayed according to the location where the user is located and the location change policy.
The display control device according to claim 11, wherein the detecting module is configured to detect the location of the user by using the at least one distance sensor, and specifically includes:

Obtaining a distance detection result of the at least one distance sensor;

Determining, from the at least one distance sensor, a target distance sensor whose distance detection result is less than or equal to a preset distance threshold;

The position of the user is determined by the distance detection result of the target distance sensor.
The display control device according to claim 11, wherein the target area is an area surrounded by a portion between the two tangent points corresponding to the position where the user is located in the display.
A display comprising the display control device according to any one of claims 11 to 17.
The display of claim 18 wherein said display is a curved display and said at least one distance sensor is radially distributed at a location near said bottom of said display.
A computer readable storage medium, wherein the storage medium stores instructions that, when run on a computer, cause the computer to implement the display control method according to any one of claims 1 to 10.