TW202337206A - Projection object adjustment method and apparatus for display, and display - Google Patents

Abstract

The present application relates to the technical field of optics, and discloses a projection object adjustment method for a display, comprising: obtaining facial images of a plurality of viewing objects of a display, the facial images comprising a plurality of facial areas corresponding to the plurality of viewing objects; obtaining a distance change amount of each facial area in the plurality of facial areas relative to the display; and dynamically adjusting, on the basis of the distance change amount, a target facial area corresponding to the viewing object to which projection is to be made by the display. According to the projection object adjustment method for a display provided by the present application, the projection object of the display can be dynamically adjusted when there are more than one persons viewing the display, so that the viewing experience is improved. The present application further discloses a projection object adjustment apparatus for a display, a display, a computer readable storage medium, and a computer program product.

Description

Projection object adjustment method, adjustment device, display, computer-readable recording medium and computer program product for display

The present application relates to the field of optical technology, such as projection object adjustment methods and devices for displays, and displays.

Currently, when displaying a 3D image, a monitor can project a 3D image based on the facial features (such as eye position) of the viewing object. However, when there are multiple viewing objects in the viewing scene, the display needs to select a projection object from the many viewing objects to display the image.

In the related technology, the monitor will continuously deliver 3D images to viewing objects corresponding to fixed positions. As a result, viewing objects at other locations cannot be projected with 3D images even if they are more willing to watch (for example, close to the monitor), thereby affecting viewing. experience.

In order to provide a basic understanding of some aspects of the disclosed embodiments, a simplified summary is provided below. This summary is not intended to be a general review, nor is it intended to identify key/important elements or delineate the scope of protection of these embodiments, but is intended to serve as a prelude to the detailed description that follows.

Embodiments of the present disclosure provide a projection object adjustment method and device for a display, a display, a computer-readable recording medium, and a computer program product, so as to solve the technical problem that the viewing object is fixed when multiple people watch.

Embodiments of the present disclosure provide a projection object adjustment method for a display, including: Obtain facial images of a plurality of viewing objects on the display, where the facial images include a plurality of facial areas corresponding to the plurality of viewing objects; Obtain the distance change of each of the plurality of facial areas relative to the display; Based on the distance change, the target facial area corresponding to the viewing object placed on the display is dynamically adjusted.

In some embodiments, obtaining the distance change of each of the plurality of facial areas relative to the display may include: Get the distance change of each facial area relative to a reference point in the display.

In some embodiments, reference points may include: Preset fixed reference points, or feature points shown on the monitor.

In some embodiments, fixed reference points may include: Any point on the display, or between the display and the object being viewed.

In some embodiments, feature points may include: A monitor displays a specified point in a characteristic area of the screen.

In some embodiments, the feature area changes dynamically according to changes in features of the displayed image.

In some embodiments, dynamically adjusting the target facial area corresponding to the viewing object placed by the display based on the distance change may include: Obtain the velocity change of each facial area based on the distance change; The target facial area is determined based on the amount of velocity change.

In some embodiments, the speed change may include: At least one of a velocity parameter and an acceleration parameter.

In some embodiments, determining the target facial area based on the speed change may include: When the velocity change includes an acceleration parameter, the facial area with the largest acceleration parameter is determined to be the target facial area.

An embodiment of the present disclosure also provides a projection object adjustment device for a display, including a processor and a memory storing program instructions. The processor is configured to execute the above-mentioned method for the display when executing the program instructions. Projection object adjustment method.

An embodiment of the present disclosure also provides a projection object adjustment device for a display, including: The first acquisition module is configured to acquire facial images of a plurality of viewing objects on the display, where the facial images include a plurality of facial areas corresponding to the plurality of viewing objects; The second acquisition module is configured to acquire the change in distance of each of the plurality of facial areas relative to the display; The object adjustment module is configured to dynamically adjust the target facial area corresponding to the viewing object placed by the display based on the distance change.

In some embodiments, the second acquisition module can be configured as: Get the distance change of each facial area relative to a reference point in the display.

In some embodiments, reference points may include: Preset fixed reference points, or feature points shown on the monitor.

In some embodiments, fixed reference points may include: Any point on the display, or between the display and the object being viewed.

In some embodiments, feature points may include: A monitor displays a specified point in a characteristic area of the screen.

In some embodiments, the feature area changes dynamically according to changes in features of the displayed image.

In some embodiments, the object adjustment module can be configured to: Obtain the velocity change of each facial area based on the distance change; The target facial area is determined based on the amount of velocity change.

In some embodiments, the speed change may include: At least one of a velocity parameter and an acceleration parameter.

In some embodiments, the object adjustment module determines the target facial area based on the speed change, and may be configured as: When the velocity change includes an acceleration parameter, the facial area with the largest acceleration parameter is determined to be the target facial area.

An embodiment of the present disclosure also provides a display, which includes the above-mentioned projection object adjustment device for a display.

In some embodiments, a computer-readable recording medium stores computer-executable instructions, and the computer-executable instructions are configured to execute the above-mentioned projection object adjustment method for a display.

In some embodiments, the computer program product includes a computer program stored on a computer-readable recording medium. The computer program includes program instructions that, when executed by the computer, cause the computer to perform the above-mentioned projection for the display. Object adjustment methods.

The projection object adjustment method, device, display, computer-readable recording medium, and computer program product for a display provided by embodiments of the present disclosure can achieve the following technical effects: When multiple people are watching the display, the projection object of the display can be dynamically adjusted based on changes in the distance between the viewing object and the display to improve the viewing experience.

The above general description and the following description are exemplary and explanatory only and are not intended to limit the application.

In order to understand the characteristics and technical content of the embodiments of the present disclosure in more detail, the implementation of the embodiments of the present disclosure will be described in detail below in conjunction with the drawings. The attached drawings are for reference only and are not used to limit the embodiments of the present disclosure. In the following technical description, for convenience of explanation, numerous details are provided to provide a thorough understanding of the disclosed embodiments. However, at least one embodiment may still be practiced without these details. In other instances, well-known structures and devices are used to simplify the illustrations.

As shown in Figure 1, an embodiment of the present disclosure provides a projection object adjustment method for a display, including: S101, obtain facial images of multiple viewing objects on the display, where the facial images include multiple facial areas corresponding to multiple viewing objects; S102, obtain the distance change of each facial area in the plurality of facial areas relative to the display; S103. Based on the distance change, dynamically adjust the target facial area corresponding to the viewing object placed on the display.

The present disclosure can dynamically adjust the projection object of the display by comparing the viewing desire of the viewing object based on the change in the distance between the viewing object and the display when multiple people are watching the display. Therefore, the viewing needs of viewing objects with high viewing desire can be satisfied as much as possible. Improve viewing experience.

In some embodiments, the display can be used in various display scenarios, such as mobile phone display, tablet computer display, computer display, television display, cinema screen, etc.

In some embodiments, the display can obtain the eyeball position of the viewing subject based on the facial area of the viewing subject, so as to project a three-dimensional stereoscopic image to the viewing subject based on the eyeball position. When multiple viewing objects watch the same display, the display can obtain the facial area corresponding to each viewing in the plurality of viewing objects, and then the display can select one or a plurality of target facial areas in these facial areas, and then based on the selection The displayed eyeball positions in one or more target facial areas are used to project images to one or more corresponding viewing objects, so that the projected viewing objects can view a three-dimensional image with a better effect.

In some embodiments, the scene as shown in FIG. 2 includes viewing object A, viewing object B, and viewing object C (the figure exemplarily shows three viewing objects, and the number of actual viewing objects is not limited). When displaying the interface 12 , the display 10 can obtain the facial images 20 of the plurality of current viewing objects through the camera 11 . The facial image 20 includes a plurality of facial areas corresponding to a plurality of viewing objects. As shown in FIG. 3 , the facial area 21 corresponding to the viewing object A, the facial area 22 corresponding to the viewing object B, and the facial area 22 corresponding to the viewing object C facial area 23. Alternatively, the facial area may be an area covered by the outer contour of the face of the viewing subject, or an area covered by a smallest rectangle containing the outer contour of the face, or an area covered by other shapes including the outer contour of the face.

In some embodiments, the camera 11 may be a built-in camera of the display 10 or an external camera of the display 10 . Optionally, the camera 11 may be a single-eye camera, a binocular camera, a 3D camera, a ToF (Time of Flight) camera, etc.

In some embodiments, the display 10 obtaining the distance change amount of each facial area in the plurality of facial areas relative to the display may include: obtaining the distance change amount of each facial area relative to a reference point in the display 10 . Optionally, the above distance change amount may be the distance change amount within a period of time. The distance change can be calculated based on facial images corresponding to at least two moments. The at least two moments may be adjacent moments, or at least two moments acquired according to a fixed period, or at least two specified moments.

For example, assuming that the camera 11 captures one frame of facial image 20 every second, if the display 10 needs to obtain the distance change of the facial area relative to the reference point in the display 10 within a period of time (such as 2 seconds), the display 10 can obtain The two frames of historical facial images including the current frame are calculated to obtain the distance change of the facial area relative to the reference point in the display 10 within 2 seconds. Optionally, the two frames of facial images can be facial images acquired two consecutive seconds, or they can be facial images acquired at non-adjacent times, such as a frame of facial images in the first second and a frame of facial images in the third second. A frame of facial image.

For example, assuming that the camera 11 captures one frame of facial image 20 every second, if the display 10 needs to obtain the distance change of the facial area relative to the reference point in the display 10 within a period of time (such as 10 seconds), the display 10 can obtain The 10 frames of historical facial images including the current frame are calculated to obtain the distance change of the facial area relative to the reference point in the display 10 within 10 seconds.

In some embodiments, the facial image 20 may include position information under a spatial coordinate system of each facial region, where the position information may include depth information. The facial image 20 can also be converted through a coordinate system to obtain position information in a spatial coordinate system including each facial region.

As shown in Figure 4, the distance change of the facial area relative to the reference point in the display 10 can be the facial area under the spatial coordinate system and the reference point P in the display on each coordinate axis (such as the X axis, Y axis, Z axis) The corresponding distance change can also be the linear distance change between the facial area under the spatial coordinate system and the reference point P on the display, or the linear distance change between the facial area under the plane coordinate system and the reference point P on the display. quantity. For example, under the spatial coordinate system, the coordinates of the reference point in the display are (0, 0, 0), and the coordinates of the first frame of a specified point in a certain facial area (such as the center point of the facial area or the eyeball) are (1 , 2, 3), the coordinates of the second frame of the designated point are (4, 5, 6), then the distance change may include at least one of the following situations: The corresponding distance change on the X-axis between the facial area and the reference point under the spatial coordinate system, that is, 4-1=3; The corresponding distance change on the Y-axis between the facial area and the reference point under the spatial coordinate system, that is, 5-2=3; The corresponding distance change on the Z-axis between the facial area and the reference point under the spatial coordinate system, that is, 6-3=3; The linear distance change between the facial area and the reference point under the plane coordinate system, that is, the Euclidean distance between (1, 2) and (4, 5) = SQRT((4-1)^2+(5-2)^2 )=SQRT(18)≈4; The linear distance change between the facial area and the reference point under the spatial coordinate system, that is, the Euclidean distance between (1, 2, 3) and (4, 5, 6) =SQRT((4-1)^2+(5- 2)^2+(6-3)^2)=SQRT(27)≈5.

In some embodiments, the reference point may include: a preset fixed reference point, or a feature point displayed on the display.

In some embodiments, the preset fixed reference point may be a point with a fixed position, and the fixed reference point may include: any point in the display, or any point between the display and the viewing object. in: Any point in the display, such as the optical center of the camera 11, or the center point of the display interface 12 of the display 10, or the upper left corner of the display 10, etc., is a point located at any fixed position in the display or on the surface of the display; as shown in the figure As shown in 4, the reference point P is located at the optical center of the camera 11.

Any point between the display and the viewing object, for example, a straight line perpendicular to the optical center of the camera 11 , a point at any spatial position between the display and the viewing object; or a straight line perpendicular to the center point of the display interface 12 of the display 10 , a point at any spatial position between the viewing object and the viewing object; it can also be a point at other spatial positions within the shooting range of the camera 11 between the display and the viewing object. As shown in FIG. 5 , the reference point P is located on a straight line perpendicular to the optical center of the camera 11 .

In some embodiments, the facial image 20 may include position information of each facial region under the image pixel coordinate system of the facial image 20 . As shown in Figure 6, the image center point in the facial image 20 can be used as the reference point P, and the distance of each facial area relative to the reference point can be determined by: making a minimum rectangle in each facial area (the dotted line frame in Figure 6 (shown in the figure), the center point of the minimum rectangle (not shown in the figure) is the designated point of the facial area, and the distance change of the facial area relative to the reference point is calculated based on the designated point of the facial area and the reference point P.

In some embodiments, the characteristic points displayed by the display may include specified points in the characteristic area of the display screen. An area with specified characteristics in the picture displayed by the monitor may be called a characteristic area. Since the display content will continue to change, the characteristic area will also dynamically change according to the characteristic changes of the display screen.

Optionally, image areas with obvious 3D effects in the display screen can be used as feature areas. As shown in Figure 7, the display screen of the display 10 includes display content 30 and display content 40. The pilot content 30 has a better 3D effect than the display content 40. Therefore, the image area where the display content 30 is located can be In the feature area, a certain point in the displayed content 30 can be used as a feature point.

Optionally, when multiple display contents have 3D effects, the area where the main body of the picture is located can be used as the characteristic area. As shown in Figure 8, the display screen of the display 10 includes display content 30, display content 40, and display content 50. The pilot in display content 30 and the Saturn in display content 50 both have obvious 3D effects, and display content 30 is the largest and Close to the center of the screen, the displayed content 30 is the main body of the screen. Therefore, the area where the main body of the screen (displayed content 30) is located is the feature area, and a certain point in the displayed content 30 can be used as a feature point. When the displayed content changes subsequently, as shown in Figure 9, the displayed content 50 is the largest and close to the center of the screen, so the displayed content 50 becomes the main body of the screen, and the area where the displayed content 50 is located is used as a new feature area, and the displayed content A certain point among 50 can be used as a new feature point.

In some embodiments, specified points in the feature area can be used as feature points. For example, the center point of the picture in the feature area can be used as the feature point.

In some embodiments, the display can dynamically adjust the target facial area corresponding to the viewing object placed by the display based on the above distance change. For example, the one with the largest distance change in the direction close to the reference point can be selected from a plurality of facial areas. The facial area is the target facial area. Since this facial area is closer to the reference point than other facial areas, it can be explained that the viewing object corresponding to this facial area has a tendency to move closer to the reference point, thus inferring that the viewing object is compared with other viewing objects. have higher viewing expectations, so using this viewing object as the viewing object placed on the display best meets the user's needs.

In some embodiments, the display can dynamically adjust the target facial area corresponding to the viewing object placed by the display based on the distance change, which may specifically include: first obtaining the speed change of each facial area based on the distance change, and then The target facial area is determined based on the amount of speed change. The optional speed change may include but is not limited to: at least one of speed parameters and acceleration parameters.

In some embodiments, the display can calculate the time period of each facial area within this time period by using a speed or acceleration formula based on the time period of the acquired facial image and the distance change of each facial area in the facial image. Moving speed parameters and acceleration parameters. Assume that a certain facial area moves at a constant speed, and the distance change within 5 seconds is 100cm, then the speed parameter is 100cm/5s=0.2m/s; assuming that a certain facial area moves at an accelerated speed, within 5 seconds, the distance change per second The distance changes are 10cm, 20cm, 30cm, 40cm, and 50cm respectively, then the speed parameters per second are 10cm/1s=0.1m/s, 20cm/1s=0.2m/s, 30cm/1s=0.3m/ s, 40cm/1s=0.4m/s, 50cm/1s=0.5m/s, then the acceleration parameter for these 5 seconds is: (0.5-0.1)/5=0.08m/s ² .

In some embodiments, when the display determines the target facial area based on the speed variation, the target facial area may be determined based on at least one of the speed parameter or the acceleration parameter.

Alternatively, when there is only a speed parameter in the speed variation, the target facial area can be determined based on the size of the speed parameter. For example, the facial area with the largest speed parameter can be used as the target facial area.

Optionally, when the velocity change includes an acceleration parameter, it can be determined that the facial area with the largest acceleration parameter can be used as the target facial area.

Optionally, when the acceleration parameter is included in the velocity change, the target facial area can also be determined by combining velocity and acceleration. For example, a smaller weight value is set for the velocity parameter and a larger weight value is set for the acceleration parameter. The speed parameter and acceleration parameter are weighted, and the facial area with the largest value can be used as the target facial area.

In some embodiments, taking the scenes shown in Figures 8 and 10 as an example, assuming that the viewing scene at the first moment is as shown in Figure 8, and the facial image of the viewing subject captured by the camera of the display 10 is as shown in Figure 3, this When the viewing object A is closest to the display, assuming that the facial area of the viewing object A is currently used as the target facial area, the eyeball position of the viewing object A can be obtained based on the facial area 21 of the viewing object A, so that the display of the display 10 is performed based on the eyeball position. The screen is projected in the direction of the eyeballs of viewing subject A. If the viewing scene at the second moment is as shown in Figure 10, at this time the viewing object B moves towards the display, from the position of the viewing object B' at the first moment to the current position of the viewing object B, the viewing object A and the viewing object C There is no movement, so the content of the facial image 20 taken at the second moment has changed. The facial image 20 at the second moment is shown in FIG. 11 , and the position and size of the facial area corresponding to the viewing object B have changed. In order to better compare the changes in the facial area, see Figure 12. Comparing the facial area 22' of the viewing object B' before the movement with the facial area 22 of the viewing object B after the movement can determine the distance change d of the movement of the viewing object B. Assume that the optical center of the display's camera is the reference point. Since viewing object A and viewing object C do not move, viewing object B moves toward the reference point, so the distance change between viewing object A and viewing object C is 0, and the distance that viewing object B moves is The amount of change is d. Therefore, it is determined that the facial area 22 of the viewing object B in the facial image 20 is used as the target facial area, and the eyeball position of the viewing object B can be obtained based on the facial area 22 of the viewing object B, so that the display screen of the display 10 can be changed based on the eyeball position. Throw it in the direction of the eyeballs of viewing subject B. According to this embodiment, it can be seen that the viewing object B moves closer to the display, which means that the viewing desire of the viewing object B is greater. Therefore, placing the display screen on the viewing object B can satisfy the user's needs.

In some embodiments, when the distance change between the viewing object and the reference point changes due to a change in the position of the reference point, the projected object will also change. Taking the scenes shown in Figures 8 and 9 as an example, assuming that the viewing scene at the first moment is as shown in Figure 8, the reference point at this time is the center point of the display content 30, and assuming that the viewing object A is closest to the reference point at this time, then If the facial area of the viewing object A is currently used as the target facial area, the eyeball position of the viewing object A can be obtained based on the facial area 21 of the viewing object A, so that the display 10 can display the display content 30 in the direction of the eyeballs of the viewing object A based on the eyeball position. The effect is relatively best. If the viewing scene at the second moment is as shown in Figure 9, and the displayed content 50 becomes the center of the screen, then the center point of the displayed content 50 becomes the new reference point. Since the reference point has changed, the viewing object has not moved. , the distance between the viewing object and the reference point will also change. Assuming that the distance change of the viewing object B is the largest at this time, it is determined that the facial area 22 of the viewing object B in the facial image 20 of FIG. 3 is used as the target facial area, and the viewing object B can be obtained based on the facial area 22 of the viewing object B. Therefore, based on the eyeball position, the effect of displaying the display content 50 on the display 10 in the direction of the eyeball of the viewing object B is relatively optimal. Therefore, even if the position of the viewing object remains unchanged, when the display content changes, the projection object can be adjusted based on the distance change, thereby allowing the user to experience a better viewing effect.

In some embodiments, if some or all of the viewing objects leave the viewing scene during the period of obtaining the distance change, the distance changes of these viewing objects are deleted.

In some embodiments, if one or more viewing objects are added to the viewing scene during the period of obtaining the distance change, the newly added viewing objects can be compared with the currently existing viewing objects. The time parameter for calculating the speed change of the new viewing object remains unchanged, and the time parameter for calculating the speed change of the newly added viewing object is calculated from the time when the viewing scene is entered.

Embodiments of the present disclosure provide a projection object adjustment device for a display, including a processor and a memory storing program instructions. The processor is configured to execute the above-mentioned projection object adjustment method for a display when executing the program instructions. .

Referring to Figure 13, in some embodiments, the projection object adjustment device 80 for a display may include: a processor (processor) 801 and a memory (memory) 802, and may also include a communication interface (Communication Interface) 803 and a bus 804. . Among them, the processor 801, the communication interface 802, and the memory 802 can communicate with each other through the bus 804. The communication interface 803 can be used for information transmission. The processor 801 can call logical instructions in the memory 802 to execute the projection object adjustment method for the display in the above embodiment.

In addition, the above-mentioned logical instructions in the memory 802 can be implemented in the form of software functional units and can be stored in a computer-readable recording medium when sold or used as an independent product.

As a computer-readable recording medium, the memory 802 can be used to store software programs and computer executable programs, such as program instructions/modules corresponding to the methods in the embodiments of the present disclosure. The processor 801 executes the program instructions/modules stored in the memory 802 to execute functional applications and data processing, that is, to implement the projection object adjustment method for the display in the above method embodiment.

The memory 802 may include a program storage area and a data storage area, where the program storage area may store an operating system and at least one application required for a function; the data storage area may store data created based on the use of the terminal device, etc. In addition, the memory 802 may include high-speed random access memory and may also include non-volatile memory.

An embodiment of the present disclosure provides another projection object adjustment device for a display. Referring to Figure 14, in some embodiments, the projection object adjustment device 90 for a display may include: The first acquisition module 901 is configured to acquire facial images of a plurality of viewing objects on the display, where the facial images include a plurality of facial areas corresponding to the plurality of viewing objects; The second acquisition module 902 is configured to acquire the distance change of each facial area in the plurality of facial areas relative to the display; The object adjustment module 903 is configured to dynamically adjust the target facial area corresponding to the viewing object placed by the display based on the distance change.

In some embodiments, the second acquisition module 902 may be configured as: Get the distance change of each facial area relative to a reference point in the display.

In some embodiments, reference points may include: Preset fixed reference points, or feature points shown on the monitor.

In some embodiments, fixed reference points may include: Any point on the display, or between the display and the object being viewed.

In some embodiments, feature points may include: A monitor displays a specified point in a characteristic area of the screen.

In some embodiments, the feature area changes dynamically according to changes in features of the displayed image.

In some embodiments, the object adjustment module 903 may be configured to: Obtain the velocity change of each facial area based on the distance change; The target facial area is determined based on the amount of velocity change.

In some embodiments, the velocity variation may include: at least one of a velocity parameter and an acceleration parameter.

In some embodiments, the object adjustment module determines the target facial area based on the velocity change and is configured as: When the velocity change includes an acceleration parameter, the facial area with the largest acceleration parameter is determined to be the target facial area.

In some embodiments, each module in the projection object adjustment device 90 for a display may be a virtual functional module or logical hardware, and each module has a logical connection relationship.

An embodiment of the present disclosure provides a display, including the above-mentioned projection object adjustment device for the display.

The projection object adjustment method, device and display for a display provided by embodiments of the present disclosure can dynamically adjust the projection object of the display when multiple people watch the display, thereby improving the viewing experience.

Embodiments of the present disclosure provide a computer-readable recording medium that stores computer-executable instructions. The computer-executable instructions are configured to execute the above-mentioned projection object adjustment method for a display.

Embodiments of the present disclosure provide a computer program product, which includes a computer program stored on a computer-readable recording medium. The computer program includes program instructions. When the program instructions are executed by a computer, the computer is caused to execute the above-mentioned program for a display. Projection object adjustment method.

The above-mentioned computer-readable recording medium may be a transient computer-readable recording medium or a non-transitory computer-readable recording medium.

The computer-readable recording media and computer program products provided by embodiments of the present disclosure can dynamically adjust the projection object of the display when multiple people watch the display, thereby improving the viewing experience.

The technical solution of the embodiments of the present disclosure can be embodied in the form of a software product. The computer software product is stored in a recording medium and includes at least one instruction to enable a computer device (which can be a personal computer, a server, or a network equipment, etc.) to perform all or part of the steps of the methods of the embodiments of the present disclosure. The aforementioned recording media can be non-transitory recording media, including: pen drives, mobile hard drives, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disks, or Various media such as optical discs can store program codes, and they can also be temporary recording media.

The foregoing description and drawings illustrate embodiments of the disclosure sufficiently to enable those skilled in the art to practice them. Other embodiments may incorporate structural, logical, electrical, process, and other changes. The examples represent only possible variations. Unless explicitly required, individual components and features are optional and the order of operations may vary. Portions and features of some embodiments may be included in or substituted for those of other embodiments. The scope of the disclosed embodiments includes the entire scope of the claimed claims, and all available equivalents of the claimed claims. When used in this application, although the terms "first," "second," etc. may be used in this application to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another element. For example, without changing the meaning of the description, a first element can be called a second element, and similarly, a second element can be called a first element, as long as all occurrences of "first element" are renamed consistently and all occurrences of "first element" Just rename the "second component" consistently. The first element and the second element are both elements, but may not be the same element. Furthermore, the words used in this application are only used to describe the embodiments and are not used to limit the patent scope of the application. As used in the description of the embodiments and the claimed scope, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. form. Similarly, the term "and/or" as used in this application is meant to encompass any and all possible combinations of one or more of the associated listed items. In addition, when used in this application, the term "comprise" and its variations "comprises" and/or "comprising" etc. refer to stated features, integers, steps, operations, elements, and/or The presence of an element does not exclude the presence or addition of one or more other features, integers, steps, operations, elements, elements and/or groupings of these. Without further limitation, an element defined by the statement "comprises a..." does not exclude the presence of additional identical elements in a process, method or apparatus that includes that element. In this article, each embodiment may focus on its differences from other embodiments, and the same and similar parts among various embodiments may be referred to each other. For the methods, products, etc. disclosed in the embodiments, if they correspond to the method part disclosed in the embodiment, then the relevant parts can be referred to the description of the method part.

Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented with electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software may depend on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but such implementations should not be considered to be beyond the scope of the disclosed embodiments. Those skilled in the art can clearly understand that for the convenience and simplicity of description, the working processes of the systems, devices and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be described again here.

In the embodiments disclosed herein, the disclosed methods and products (including but not limited to devices, equipment, etc.) can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of units may only be a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated. to another system, or some features can be ignored, or not implemented. In addition, the coupling or direct coupling or communication connection between each other shown or discussed may be through some interfaces, and the indirect coupling or communication connection of the devices or units may be in electrical, mechanical or other forms. A unit described as a separate component may or may not be physically separate. A component shown as a unit may or may not be a physical unit, that is, it may be located in one place, or it may be distributed to a plurality of network units. Some or all of the units may be selected according to actual needs to implement this embodiment. In addition, each functional unit in the embodiment of the present disclosure can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit.

In the drawings, the width, length, thickness, etc. of structures such as components or layers may be exaggerated for clarity and description. When an element or layer, such as a structure, is referred to as being "disposed on" (or "mounted on," "laid on," "fitted to," "coated on," or similar descriptions) another element or layer ”, the element or layer or other structure may be directly “disposed on” or “on” the other element or layer mentioned above, or there may be an intermediate element or layer or other structure between the other element or layer mentioned above. , or even partially embedded in another element or layer mentioned above.

The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code that contains at least one operable function for implementing the specified logical function. Execute instructions. In some alternative implementations, the functions noted in the blocks may occur out of the order noted in the diagrams. For example, two or more blocks may actually execute substantially in parallel, and they may sometimes execute in reverse order, depending on the functionality involved. In the descriptions corresponding to the flowcharts and block diagrams in the figures, the operations or steps corresponding to different blocks may also occur in a sequence different from that disclosed in the description, and sometimes there is no specific relationship between the different operations or steps. order. For example, two or more operations or steps may actually be performed substantially in parallel, and they may sometimes be performed in reverse order, depending on the functionality involved. Each block in the block diagram and/or flowchart illustration, and combinations of blocks in the block diagram and/or flowchart illustration, may be implemented by special purpose hardware-based systems that perform the specified functions or actions, or may be implemented by special purpose hardware-based systems that perform the specified functions or actions. Achieved by a combination of hardware and computer instructions. The above-mentioned methods can be applied to diagrams and their corresponding descriptions, and can also be applied to descriptions that do not correspond to diagrams.

10:Display 11:Camera 12:Display interface A,B,B’,C: viewing object 20: Facial image 21,22,22’,23: Facial area 30,40,50:Display content 80: Projection object adjustment device for display 801: Processor 802:Memory 803: Communication interface 804:Bus 90: Projection object adjustment device for display 901:First acquisition module 902: Second acquisition module 903:Object adjustment module S101~S103: Steps P: reference point

At least one embodiment is exemplified by corresponding drawings. These exemplary descriptions and drawings do not constitute limitations to the embodiment. Components with the same symbol in the drawings are shown as similar components. The drawings does not constitute a proportional limitation and where: Figure 1 is a schematic flowchart of a method for adjusting a projection object for a display provided by an embodiment of the present disclosure; Figure 2 is a schematic diagram of a viewing scene provided by an embodiment of the present disclosure; Figure 3 is a schematic diagram of a facial image provided by an embodiment of the present disclosure; Figure 4 is a schematic diagram of a reference point provided by an embodiment of the present disclosure; Figure 5 is a schematic diagram of another reference point provided by an embodiment of the present disclosure; Figure 6 is a schematic diagram of another reference point provided by an embodiment of the present disclosure; Figure 7 is a schematic diagram of another viewing scene provided by an embodiment of the present disclosure; Figure 8 is a schematic diagram of another viewing scene provided by an embodiment of the present disclosure; Figure 9 is a schematic diagram of a viewing scene after a reference point is changed according to an embodiment of the present disclosure; Figure 10 is a schematic diagram of a viewing scene after the viewing object is moved according to an embodiment of the present disclosure; Figure 11 is a schematic diagram of a facial image after movement of the viewing object provided by an embodiment of the present disclosure; Figure 12 is a schematic diagram comparing facial images before and after the viewing object moves according to an embodiment of the present disclosure; Figure 13 is a schematic structural diagram of a projection object adjustment device for a display provided by an embodiment of the present disclosure; FIG. 14 is a schematic structural diagram of another projection object adjustment device for a display provided by an embodiment of the present disclosure.

S101~S103: Steps

Claims (22)

A method for adjusting projection objects on a display, including: Obtaining facial images of a plurality of viewing objects on the display, the facial images including a plurality of facial regions corresponding to the plurality of viewing objects; Obtaining a change in distance of each of the plurality of facial areas relative to the display; Based on the distance change, the target facial area corresponding to the viewing object placed by the display is dynamically adjusted. The projection object adjustment method for a display as in claim 1, wherein said obtaining the change in distance of each of the plurality of facial areas relative to the display includes: Obtain the distance change of each facial area relative to a reference point in the display. The projection object adjustment method for a display as in claim 2, wherein the reference points include: Preset fixed reference points, or feature points displayed on the monitor. The projection object adjustment method for a display as in claim 3, wherein the fixed reference point includes: Any point in the display, or any point between the display and the viewing object. As in claim 3, the projection object adjustment method for a display is provided, wherein the feature points include: The display displays a designated point in a characteristic area of the picture. For example, the projection object adjustment method for a display according to claim 5, wherein: The characteristic area changes dynamically according to the characteristic change of the display screen. The projection object adjustment method for a display according to any one of claims 1 to 6, wherein the dynamically adjusting the target facial area corresponding to the viewing object projected by the display based on the distance change includes: Obtain the speed variation of each facial area based on the distance variation; The target facial area is determined based on the speed change amount. The projection object adjustment method for a display as in claim 7, wherein the speed change includes: At least one of a velocity parameter and an acceleration parameter. The projection object adjustment method for a display as claimed in claim 8, wherein the determining the target facial area based on the speed change includes: When the velocity variation includes an acceleration parameter, the facial area with the largest acceleration parameter is determined to be the target facial area. A projection object adjustment device for a display, including a processor and a memory storing program instructions. The processor is configured to perform any one of claims 1 to 9 when executing the program instructions. How to adjust the projection object of the monitor. A projection object adjustment device for a display, including: A first acquisition module configured to acquire facial images of a plurality of viewing objects on the display, where the facial images include a plurality of facial areas corresponding to the plurality of viewing objects; a second acquisition module configured to acquire the change in distance of each of the plurality of facial areas relative to the display; The object adjustment module is configured to dynamically adjust the target facial area corresponding to the viewing object placed by the display based on the distance change. The projection object adjustment device for a display according to claim 11, wherein the second acquisition module is configured as: Obtain the distance change of each facial area relative to a reference point in the display. The projection object adjustment device for a display as claimed in claim 12, wherein the reference point includes: Preset fixed reference points, or feature points displayed on the monitor. The projection object adjustment device for a display as claimed in claim 13, wherein the fixed reference point includes: Any point in the display, or any point between the display and the viewing object. The projection object adjustment device for a display as claimed in claim 13, wherein the feature points include: The display displays a designated point in a characteristic area of the picture. The projection object adjustment device for a display as claimed in claim 15, wherein, The characteristic area changes dynamically according to the characteristic change of the display screen. The projection object adjustment device for a display according to any one of claims 11 to 16, wherein the object adjustment module is configured as: Obtain the speed variation of each facial area based on the distance variation; The target facial area is determined based on the speed change amount. The projection object adjustment device for a display as claimed in claim 17, wherein the speed change includes: At least one of a velocity parameter and an acceleration parameter. The projection object adjustment device for a display as claimed in claim 18, wherein the object adjustment module determines the target facial area based on the speed variation, is configured as: When the velocity variation includes an acceleration parameter, the facial area with the largest acceleration parameter is determined to be the target facial area. A display comprising a projection object adjustment device for a display according to any one of claims 11 to 19. A computer-readable recording medium stores computer-executable instructions, and the computer-executable instructions are configured to execute the projection object adjustment method for a display according to any one of claims 1 to 9. A computer program product, including a computer program stored on a computer-readable recording medium. The computer program includes program instructions. When the program instructions are executed by a computer, the computer is caused to execute any one of claims 1 to 9. It is used to adjust the projection object of the display.

Images