CN110597391A - Display control method, display control device, computer equipment and storage medium - Google Patents

Display control method, display control device, computer equipment and storage medium Download PDF

Info

Publication number
CN110597391A
CN110597391A CN201910875369.XA CN201910875369A CN110597391A CN 110597391 A CN110597391 A CN 110597391A CN 201910875369 A CN201910875369 A CN 201910875369A CN 110597391 A CN110597391 A CN 110597391A
Authority
CN
China
Prior art keywords
human body
display screen
deflection angle
angle
deflection
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910875369.XA
Other languages
Chinese (zh)
Inventor
孔凡阳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN201910875369.XA priority Critical patent/CN110597391A/en
Publication of CN110597391A publication Critical patent/CN110597391A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04847Interaction techniques to control parameter settings, e.g. interaction with sliders or dials

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

The application relates to a display control method, a display control device, computer equipment and a storage medium, and relates to the technical field of computer display. The method comprises the following steps: when a picture is displayed in a display screen corresponding to the display equipment, acquiring a human body image acquired by the image acquisition assembly; acquiring a first deflection angle of a human body in the human body image relative to a vertical direction, wherein the vertical direction is a direction perpendicular to the ground, and the human body image comprises the human body; and controlling the deflection of the picture displayed in the display screen relative to the display screen according to the first deflection angle. By the method, the display picture in the display screen can be automatically adjusted according to the deflection angle of the human body, and the angle of the display screen does not need to be manually adjusted by a user, so that the accuracy of angle adjustment of the display picture is improved.

Description

Display control method, display control device, computer equipment and storage medium
Technical Field
The present disclosure relates to the field of computer display technologies, and in particular, to a display control method and apparatus, a computer device, and a storage medium.
Background
In real life, people often need to adjust the angle of a display picture in a display screen in order to obtain better viewing experience.
In the related art, the adjustment of the angle of the display screen is usually achieved by adjusting the angle of the display screen. For example, in a display apparatus with an adjustable display angle, a supporting point of a display screen is designed as a rotatable shaft, and a user can manually adjust the shaft so that the angle of the display screen is adjusted to a position desired by the user.
However, the above-mentioned related art solution for adjusting the rotation angle of the display screen requires the user to manually adjust the rotation shaft, which results in poor accuracy of angle adjustment of the display screen.
Disclosure of Invention
The embodiment of the application provides a display control method, a display control device, computer equipment and a storage medium, which can improve the accuracy of angle adjustment of a display picture, and the technical scheme is as follows:
in one aspect, a display control method is provided, the method being performed by a display device including an image capture component, the method comprising:
when a picture is displayed in a display screen corresponding to the display equipment, acquiring a human body image acquired by the image acquisition assembly;
acquiring a first deflection angle of a human body in the human body image relative to a vertical direction, wherein the vertical direction is a direction perpendicular to the ground, and the human body image comprises the human body;
and controlling the deflection of the picture displayed in the display screen relative to the display screen according to the first deflection angle.
In one aspect, a display control apparatus is provided, where the apparatus is applied in a display device including an image capturing component, and the apparatus includes:
the first acquisition module is used for acquiring a human body image acquired by the image acquisition assembly when a picture is displayed in a display screen corresponding to the display equipment;
the second acquisition module is used for acquiring a first deflection angle of a human body in the human body image relative to a vertical direction, wherein the vertical direction is a direction perpendicular to the ground, and the human body image comprises the human body;
and the deflection module is used for controlling the deflection of the picture displayed in the display screen relative to the display screen according to the first deflection angle.
Optionally, the second obtaining module is configured to,
identifying a waist position of a human body in the human body image and a head position of the human body in the human body image;
and determining an included angle between a connecting line between the waist position and the head position and the vertical direction as the first deflection angle.
Optionally, the apparatus further comprises:
the third obtaining module is used for obtaining an angle difference value between the first deflection angle and a reference angle before the deflection module controls the picture displayed in the display screen to deflect relative to the display screen according to the first deflection angle;
and the deflection module is further used for controlling the picture displayed in the display screen to deflect relative to the display screen according to the first deflection angle when the absolute value of the angle difference is not smaller than the difference threshold.
Optionally, when the picture displayed in the display screen is not deflected, the reference angle is 0 degree;
when the picture displayed in the display screen is already deflected, the reference angle is the deflection angle of the human body relative to the vertical direction when the picture displayed in the display screen is deflected last time.
Optionally, the second obtaining module is further configured to obtain a first deflection angle of the human body in the human body image with respect to a vertical direction when the number of the human bodies in the human body image is 1.
Optionally, the second obtaining module is further configured to, when the number of human bodies in the human body image is greater than or equal to 2, obtain a deflection angle of each human body in the human body image with respect to a vertical direction;
and acquiring the first deflection angle according to the deflection angle of each human body in the human body image relative to the vertical direction.
Optionally, the second obtaining module is further configured to determine, when the number of human bodies in the human body image is greater than or equal to 2, a minimum angle of deflection angles of each human body in the human body image with respect to a vertical direction as the first deflection angle;
or, determining a maximum angle of deflection angles of each human body in the human body image relative to a vertical direction as the first deflection angle;
or, determining an average angle of deflection angles of each human body in the human body image relative to a vertical direction as the first deflection angle;
or, any one of a minimum angle and a maximum angle among deflection angles of the respective human bodies in the human body image with respect to a vertical direction is determined as the first deflection angle.
Optionally, the apparatus further comprises:
the screening module is used for screening each human body in the human body image and determining an effective human body in each human body in the human body image;
the second obtaining module is further configured to obtain the first deflection angle according to a deflection angle of an effective human body in the human body image relative to a vertical direction.
Optionally, the screening module is further configured to identify face orientations of respective human bodies in the human body image;
and determining the human body of which the face faces to the direction of the display screen in each human body as the effective human body.
Optionally, the apparatus further comprises:
the fourth acquisition module is used for acquiring the screen size of the display screen;
a fifth obtaining module, configured to obtain a scaling of a picture displayed in the display screen according to the screen size of the display screen and the first deflection angle;
and the zooming module is used for zooming the picture displayed in the display screen according to the zooming proportion.
In one aspect, a computer device is provided, the computer device comprising a processor and a memory, the memory storing at least one instruction, at least one program, a set of codes, or a set of instructions, the at least one instruction, the at least one program, the set of codes, or the set of instructions being loaded and executed by the processor to implement the above display control method.
In one aspect, a computer-readable storage medium is provided, in which at least one instruction, at least one program, a set of codes, or a set of instructions is stored, and the at least one instruction, the at least one program, the set of codes, or the set of instructions is loaded and executed by the processor to implement the above display control method.
The technical scheme provided by the application can comprise the following beneficial effects:
when a picture is displayed in a display screen corresponding to the display equipment, the human body image collected by the image collecting assembly is obtained, the deflection angle of a human body in the human body image relative to the vertical direction is obtained, and therefore the picture displayed in the display screen is controlled to deflect relative to the display screen according to the deflection angle, the picture displayed in the display screen can be kept parallel to the human body, the display picture in the display screen can be automatically adjusted according to the deflection angle of the human body, the angle of the display screen does not need to be manually adjusted by a user, and therefore the accuracy of angle adjustment of the display picture is improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and together with the description, serve to explain the principles of the application.
FIG. 1 is a far-field computer vision interaction scenario diagram according to various embodiments of the present application;
FIG. 2 is a flow chart illustrating a display control method according to an exemplary embodiment of the present application;
fig. 3 is a schematic diagram of a human body image of a display control method according to an embodiment of the present application;
fig. 4 is a schematic diagram of another human body image of a display control method according to an embodiment of the present application;
fig. 5 is a schematic diagram of another human body image of the display control method according to the embodiment of the present application;
FIG. 6 is a flow chart of a display control method provided in another exemplary embodiment of the present application;
fig. 7 is a flowchart of display control function initiation according to an embodiment of the present application;
fig. 8 is a human body diagram illustrating a display control method according to an embodiment of the present application;
fig. 9 is a schematic diagram of a first deflection angle determination method of a display control method according to an embodiment of the present application;
fig. 10 is a schematic diagram illustrating a method for determining an angle difference value according to a display control method according to an embodiment of the present application;
fig. 11 is a schematic diagram illustrating a method for determining a scaling of a screen displayed on a display screen according to a display control method according to an embodiment of the present application;
fig. 12 is a flowchart of a display control method according to another exemplary embodiment of the present application;
fig. 13 is a schematic view of effective human body recognition in the display control method according to the embodiment of the present application;
fig. 14 is a schematic diagram illustrating a method for determining a first deflection angle according to a display control method according to an embodiment of the present application;
fig. 15 is a schematic diagram of another method for determining a first deflection angle of a display control method according to an embodiment of the present application;
FIG. 16 is a flowchart of a display control method provided in another exemplary embodiment of the present application;
fig. 17 is a schematic view of a guidance page of a display control method according to an embodiment of the present application;
FIG. 18 is a flowchart of a display control method provided in another exemplary embodiment of the present application;
fig. 19 is a block diagram of a display control apparatus provided in an exemplary embodiment of the present application;
FIG. 20 is a block diagram illustrating the structure of a computer device according to an example embodiment.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.
It is to be understood that reference herein to "a number" means one or more and "a plurality" means two or more. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship.
With the popularity of smart televisions and derivatives thereof, computer vision interaction between human and machines, especially far-field machine vision interaction, gradually becomes an important human-machine interaction interface and is considered as the most important user traffic entrance in the future. The display equipment provided with the image acquisition assembly can acquire image signals in the surrounding space and process the image signals according to a preset mode so as to realize the application of human-computer interaction and the like based on computer vision, and has wide application prospect in artificial intelligence scenes such as computer vision interaction and the like.
The display device may have different product forms according to different application scenarios, for example, the display device including the image capturing component may be, but is not limited to, at least one of a smart television, a smart television set-top box, and a smart vehicle-mounted device.
For example, please refer to fig. 1, which illustrates a far-field computer visual interaction scene diagram according to various embodiments of the present application. As shown in fig. 1, display devices including an image acquisition component, such as a smart television 110 and a smart television set-top box 120, are placed in a room, a user makes a command gesture, such as sliding right, within a range in which the image acquisition component can acquire an image, and after the command gesture made by the user is received by the image acquisition component, the image acquisition component processes and identifies the command gesture, so as to obtain a corresponding command instruction, and control a display interface of a display to turn pages.
Optionally, a video client may be installed in the smart television 110 or the smart television set-top box 120. Optionally, the installed video client of the smart television 110 or the smart television set-top box 120 may also be connected to a video server disposed in the internet through a wired or wireless network; accordingly, the smart tv 110 or the smart tv set-top box 120 may receive the network service provided by the video server, for example, the smart tv 110 or the smart tv set-top box 120 may obtain video data from the video server and play the video data.
With the continuous development of the application scene of the image acquisition and processing technology, the requirement on the image acquisition assembly is higher and higher, the display method provided by the application can ensure that the accuracy of the angle adjustment of the display picture is effectively improved while the display interface rotates the display angle. For ease of understanding, several terms referred to in this application are explained below.
1) Artificial Intelligence (AI)
Artificial intelligence is a theory, method, technique and application system that uses a digital computer or a machine controlled by a digital computer to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge and use the knowledge to obtain the best results. In other words, artificial intelligence is a comprehensive technique of computer science that attempts to understand the essence of intelligence and produce a new intelligent machine that can react in a manner similar to human intelligence. Artificial intelligence is the research of the design principle and the realization method of various intelligent machines, so that the machines have the functions of perception, reasoning and decision making.
The artificial intelligence technology is a comprehensive subject and relates to the field of extensive technology, namely the technology of a hardware level and the technology of a software level. The artificial intelligence infrastructure generally includes technologies such as sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing technologies, operation/interaction systems, mechatronics, and the like. The artificial intelligence software technology mainly comprises a computer vision technology, a voice processing technology, a natural language processing technology, machine learning/deep learning and the like. The display device comprising the image acquisition component mainly relates to the computer vision technology and the machine learning/depth learning direction.
2) Computer Vision technology (CV) Computer Vision is a science for researching how to make a machine "see", and further refers to that a camera and a Computer are used to replace human eyes to perform machine Vision such as identification, tracking and measurement on a target, and further image processing is performed, so that the Computer processing becomes an image more suitable for human eyes to observe or transmitted to an instrument to detect. As a scientific discipline, computer vision research-related theories and techniques attempt to build artificial intelligence systems that can capture information from images or multidimensional data. Computer vision technologies generally include image processing, image recognition, image semantic understanding, image retrieval, OCR, video processing, video semantic understanding, video content/behavior recognition, three-dimensional object reconstruction, 3D technologies, virtual reality, augmented reality, synchronous positioning, map construction, and other technologies, and also include common biometric technologies such as face recognition and fingerprint recognition.
3) Machine Learning (ML) is a multi-domain cross discipline, and relates to a plurality of disciplines such as probability theory, statistics, approximation theory, convex analysis, algorithm complexity theory and the like. The special research on how a computer simulates or realizes the learning behavior of human beings so as to acquire new knowledge or skills and reorganize the existing knowledge structure to continuously improve the performance of the computer. Machine learning is the core of artificial intelligence, is the fundamental approach for computers to have intelligence, and is applied to all fields of artificial intelligence. Machine learning and deep learning generally include techniques such as artificial neural networks, belief networks, reinforcement learning, transfer learning, inductive learning, and formal education learning.
4) Image acquisition assembly
In this application, the image capturing component refers to a hardware device component that converts an image into an analog signal (electrical signal), and optionally, a part of the image capturing component may further convert an obtained analog signal into a digital signal.
The image acquisition component may be various photosensitive cameras (such as a separate or built-in camera assembly), remote sensing devices, X-ray tomography cameras, radars, ultrasonic receivers, and the like.
Referring to fig. 2, a flowchart of a display control method according to an exemplary embodiment of the present application is shown. The display control method can be executed by a display device containing an image acquisition component, for example, the display device can include but is not limited to a smart television, a smart television set-top box, a smart vehicle-mounted device and the like. As shown in fig. 2, the display control method may include the steps of:
step 210, when a screen is displayed in a display screen corresponding to the display device, a human body image acquired by the image acquisition assembly is acquired.
In the embodiment of the application, the display device comprises an image acquisition assembly, and the human body image refers to an image which is acquired by the image acquisition assembly and contains a human body. For example, in the intelligent scene shown in fig. 1, the human body image captured by the image capturing component may include contents of the ground, the human body of the user, a sofa, a wall, and the like.
Optionally, the image not including the human body does not belong to the human body image, for example, when the acquired image includes the image of the ground, the sofa, and the wall, but does not include the image of the human body of the user, the image may be regarded as not belonging to the human body image.
Step 220, a first deflection angle of the human body in the human body image relative to the vertical direction is obtained.
For example, please refer to fig. 3, fig. 3 shows a schematic diagram of a human body image of the display control method according to the embodiment of the present application, as shown in fig. 3, the human body image includes a ground 310, a human body 320, a sofa 330, and a tea table 340, and the vertical direction is an image of the human body image perpendicular to the ground in the image; referring to fig. 4, fig. 4 is a schematic diagram of another human body image of the display control method according to the embodiment of the present application, as shown in fig. 4, or if it is difficult to clearly identify the ground area in the human body image, the vertical direction is a direction perpendicular to the plane of the object with an object parallel to the ground in the human body image as a reference, and in the scene shown in fig. 4, the vertical direction is a direction perpendicular to the plane of the sofa 410.
In one possible case, the human body image is tilted with a direction of a vertical ground in the human body image as a vertical direction. Referring to fig. 5, fig. 5 is a schematic diagram of another human body image of the display control method according to the embodiment of the present application, as shown in fig. 5, which may be caused by physical deflection of the display, but still using the ground 510 in fig. 5 as a reference object, and the vertical direction is a direction perpendicular to the ground 510.
In the embodiment of the present application, the first deflection angle may be a positive direction of the deflection to the right hand side of the human body in the human body image, a negative direction of the deflection to the left hand side of the human body in the human body image, or a positive direction of the deflection to the left hand side of the human body in the human body image, and a negative direction of the deflection to the right hand side of the human body in the human body image.
In the following scheme of the embodiment of the application, the direction of the right-hand side deflection of the human body in the human body image can be taken as the positive direction side, and the direction of the left-hand side deflection of the human body in the human body image is taken as the negative direction for description.
And step 230, controlling the image displayed in the display screen to deflect relative to the display screen according to the first deflection angle.
In the embodiment of the application, the display device can maintain the angle of the display screen unchanged and deflect the picture displayed in the display screen.
The control of the deflection of the picture displayed in the display screen with respect to the display screen may be the control of the deflection of the picture displayed in the display screen with respect to a reference line, where the reference line may be a line passing through a center point of the display screen and perpendicular to a lower edge of the display screen.
In an exemplary scheme, the deflection of the picture displayed in the display screen may be kept consistent with the first deflection angle, that is, an angle value of the deflection angle of the picture displayed in the display screen is the same as an angle value of the first deflection angle, and a deflection direction of the picture displayed in the display screen is also the same as a deflection direction of the first deflection angle.
In this embodiment of the application, the determination of the deflection of the picture displayed in the control display screen with respect to the display screen, the calculation of the deflection angle, and the deflection of the picture displayed in the control display screen are performed in the background, and what a user can directly observe is that the current display screen deflects along with the deflection of the human body, so that the deflection direction of the picture displayed by the control display screen is always parallel to the deflection direction of the human body.
To sum up, the display control method provided in the embodiment of the present application obtains the human body image collected by the image collecting assembly when the display screen corresponding to the display device displays the image, and obtains the deflection angle of the human body in the human body image relative to the vertical direction, so as to control the deflection of the image displayed in the display screen relative to the display screen according to the deflection angle, thereby realizing the automatic adjustment of the display screen according to the deflection angle of the human body, without the need of manually adjusting the angle of the display screen by the user, and thus improving the accuracy of the angle adjustment of the display screen.
In addition, the scheme shown in the embodiment of the application does not need to adjust the angle of the display screen, avoids the problems that the rotation of the rotating shaft easily causes the abrasion of hardware equipment such as the display and the like, and shortens the service life of the hardware equipment such as the display and the like, and accordingly prolongs the service life of the hardware equipment such as the display and the like.
Referring to fig. 6, a flowchart of a display control method according to an exemplary embodiment of the present application is shown. The display control method can be executed by a display device containing an image acquisition component, for example, the display device can include but is not limited to a smart television, a smart television set-top box, a smart vehicle-mounted device and the like. As shown in fig. 6, the display control method may include the steps of:
and step 610, when a picture is displayed in a display screen corresponding to the display equipment, acquiring a human body image acquired by the image acquisition assembly.
Optionally, the step of acquiring the human body image by the image acquisition assembly and subsequently adjusting the angle of the display picture may be performed by an application program installed in the display device. When the application program is started, whether to start the display control function may be determined, please refer to fig. 7, and fig. 7 shows a flowchart of starting the display control function according to an embodiment of the present application.
Step 6101, start the application, which can execute the display control method described above.
Optionally, the application may be a video client installed in the display device, and a video server corresponding to the video client is also provided on the internet side.
Step 6102, determine if the display device has an image capture assembly.
When the Application program is started for the first time, the Application program judges whether the display device has a function corresponding to the image acquisition component through an Application Programming Interface (API) provided by a system of the display device, so as to determine whether the display device has the image acquisition component.
When the application program detects that the display equipment is provided with an image acquisition component, the application program writes the characteristics of the image acquisition component into a local configuration file of the application program;
and when the program application program detects that the display equipment does not have the image acquisition component, determining that the display equipment does not have the capability of executing the display control method, and determining that the display control function is not started.
Step 6103, determine if the application settings page is open.
The application program setting page is used for setting whether the application program authorizes starting of a display control function corresponding to the display control method.
Optionally, the application settings page is opened by a user through a related interaction with the application.
When the application program setting page is opened, the application program reads whether the local configuration file of the application program contains the image acquisition component characteristics, and when the local configuration file of the application program is read to contain the image acquisition component characteristics, the application program generates a configuration switch for displaying the control function, and the switch can jump to a guide page for displaying the control function.
When the application setting page is not opened, it is determined that the display control function is not activated.
Step 6104, determine if the configuration switch of the display control method is turned on.
That is, the application program determines whether the user turns on the configuration switch of the display control function generated in step 6103.
When a configuration switch of the display control method is turned on, indicating to jump to a guide page of the display control method;
and when the configuration switch of the display control method is in a closed state, determining that the display control function is not started.
Alternatively, the user may turn off the display control function by turning off a configuration switch of the display control function, i.e. the application program does not execute the display control method any more subsequently until the configuration switch is turned on again.
In step 6105, jump to the guide page, which is the configuration switch of the display control function in step 6103 indicating the jump page.
Optionally, the guidance page is divided into an upper part and a lower part, where the upper part is a function display area for displaying the display control function and the right required by the application program to run the display control function; the lower half part is an operation button area which is used for switching the content of the function display area or opening an application program permission granting interface through the button of the operation button area.
Step 6106, determine whether the application program has permission to run the display control function, i.e., whether to execute the subsequent display control method.
When the user grants the application program the right to execute the display control function, the application program starts the display control function;
when the user does not authorize the application to perform the rights required for the display control function, the application does not initiate the display control function.
Optionally, after the user grants the application program the right required for executing the display control function, the application program ends the right setting part, and returns to the home page of the application program.
Step 6107, perform display control function.
When the application program obtains the authority required by executing the display control function, the display control function can be executed.
6108, judging whether the display screen corresponding to the display device displays the image; if so, go to step 6109, otherwise, determine that the display control function is not enabled.
Step 6109, acquiring the human body image acquired by the image acquisition assembly.
When a display screen corresponding to the display equipment displays a picture, the application program executes the display control function, and the image acquisition assembly of the display equipment acquires the human body image within the acquisition range of the image acquisition assembly.
Step 620, a first deflection angle of the human body in the human body image relative to the vertical direction is obtained.
Optionally, when the first deflection angle is obtained, the application program may identify a waist position of the human body in the human body image and a head position of the human body in the human body image, and determine an included angle between a connecting line between the waist position and the head position and the vertical direction as the first deflection angle.
Referring to fig. 8, fig. 8 is a human body diagram illustrating a display control method according to an embodiment of the present application. As shown in fig. 8, when a person is in a viewing state, a sitting posture 820 or a sitting posture 830 is generally presented, and a standing posture 810 is rarely presented, but even in the standing posture 810 state, the relationship between the human body and the ground is often in a mutually perpendicular state, and when the human body is in a sitting posture, the relationship between the human body and the ground can be presented at the positions of the head and the waist of the human body.
Please refer to fig. 9, which illustrates a schematic diagram of a first deflection angle determination method of a display control method according to an embodiment of the present application. As shown in FIG. 9, the human body head 910 is connected to the human body waist 920 to form a human body ray, a vertical line perpendicular to the ground surface 930 is formed, the vertical line is perpendicular to the ground surface, and the human body ray intersects with an extension line of the ground surface vertical line at a point to form a first deflection angle 940.
Optionally, when the number of the human bodies in the human body image is 1, the application program may acquire a first deflection angle of the human body in the human body image with respect to the vertical direction.
In the embodiment of the present application, in order to avoid that the viewing experience of a part of users is affected by the adjustment of the picture angle, when the human body image acquired by the image acquisition component only contains one human body, the step of acquiring the first deflection angle of the human body in the human body image relative to the vertical direction may be performed. Optionally, if the human body image acquired by the image acquisition assembly includes more than one human body, the application program may not perform the step of acquiring the first deflection angle of the human body in the human body image relative to the vertical direction.
In step 630, an angular difference between the first deflection angle and the reference angle is obtained.
Optionally, when the picture displayed in the display screen is not deflected, the reference angle is 0 degree;
when the picture displayed in the display screen is already deflected, the reference angle is the deflection angle of the human body relative to the vertical direction when the picture displayed in the display screen is deflected last time.
For example, in one possible implementation, the initial deflection angle at the time of starting the application program is 0, that is, the reference angle is 0, the initial deflection angle is a deflection angle of a picture displayed in the display screen with respect to a boundary of the display screen, and does not refer to a deflection of a display picture in the display screen due to a mechanical deflection of hardware such as a display, which is seen by the display screen at a user viewing angle.
When the frame in the display screen is already deflected due to the deflection of the human body in the human body image, and the human body in the human body image collected by the image collecting assembly next time is deflected, the reference angle of the application program when the frame displayed in the display screen is deflected is the deflection angle of the human body relative to the vertical direction when the frame displayed in the display screen is deflected last time.
Referring to fig. 10, a schematic diagram illustrating a method for determining an angle difference value of a display control method according to an embodiment of the present application is shown. As shown in fig. 10, when the previous time of deflecting the picture displayed on the display screen, the deflection angle of the human body with respect to the vertical direction is 1010, the right hand side of the human body is taken as the positive direction, and if the human body in the human body image is deflected with respect to the human body when the previous time of adjusting the picture angle is performed, and the deflection angle is 1020, the reference angle is the previous deflection angle 1010, and the angle difference is the difference between the deflection angle 1020 and the previous deflection angle 1010.
As shown in part (a) of fig. 10, it shows a schematic diagram of a method for determining a deflection angle as an angle difference of deflection in a positive direction, where a human body in the human body image is deflected to the right with respect to a previous human body deflection, and the angle difference is a deflection angle 1020 minus a previous deflection angle 1010.
As shown in part (B) of fig. 10, it is a schematic diagram illustrating another method for determining an angle difference value of deflection in a positive direction, in which a human body in the human body image is deflected to the left with respect to the previous human body deflection, and the angle difference value is the previous deflection angle 1010 minus the deflection angle 1020.
As shown in part (C) of fig. 10, it shows a schematic diagram of a method for determining an angle difference value of deflection in a negative direction, in which the human body in the human body image is deflected to the left relative to the previous human body, the reference angle is the previous deflection angle 1010, the value of the deflection angle 1020 is negative, and the angle difference value is the previous deflection angle 1010 minus the deflection angle 1020.
For example, in a possible case, when the picture displayed on the display screen is deflected last time, the deflection angle 1010 of the human body with respect to the vertical direction is 20 degrees, the right hand side of the human body is taken as the positive direction side, and when the human body in the human body image is deflected to the right with respect to the previous deflection angle, the deflection angle 1020 is 30 degrees, that is, the deflection angle of the human body in the human body image with respect to the vertical direction is 30 degrees, an angle difference between the two is obtained as 10 degrees, that is, the human body in the human body image is deflected to the right by 10 degrees with respect to the previous deflection angle.
In another possible case, when the picture displayed on the display screen is deflected last time, the deflection angle 1010 of the human body relative to the vertical direction is 20 degrees, the right hand side of the human body is taken as the positive direction side, when the human body in the human body image is deflected to the left relative to the previous deflection angle, the deflection angle 1020 is 10 degrees, that is, the deflection angle of the human body in the human body image relative to the vertical direction is 10 degrees, and the angle difference between the two is 10 degrees, that is, the human body in the human body image is deflected to the left by 10 degrees relative to the previous deflection angle.
In another possible case, when the picture displayed in the display screen is deflected last time, the deflection angle 1010 of the human body relative to the vertical direction is 20 degrees, the right hand side of the human body is taken as the positive direction side, when the human body in the human body image is deflected to the left relative to the previous deflection angle, the deflection angle 1020 is-20 degrees, that is, the deflection angle of the human body in the human body image relative to the vertical direction is-20 degrees, and the difference between the two is 40 degrees, that is, the human body in the human body image is deflected to the left by 40 degrees relative to the previous deflection angle.
And step 640, controlling the image displayed in the display screen to deflect relative to the display screen according to the first deflection angle.
Optionally, when the absolute value of the angle difference is not smaller than the difference threshold, the application program controls the image displayed in the display screen to deflect relative to the display screen according to the first deflection angle.
Alternatively, the difference threshold may be set by the user. Alternatively, the difference threshold may be preset by a developer.
When the angle difference is smaller than the difference threshold, the application may not perform the above-mentioned display control function, for example, in a possible case, the angle difference smaller than the difference threshold may be caused by a slight shaking of a human body, and in order to avoid an unnecessary adjustment step, when the angle difference is smaller than the difference threshold, the step of adjusting the angle of the display screen may not be performed.
For example, when the picture displayed on the display screen is deflected last time, the deflection angle of the human body relative to the vertical direction is 20 degrees, the right hand side of the human body is taken as the positive direction side, when the human body in the human body image deflects left, the deflection angle is 11 degrees, that is, the deflection angle of the human body in the human body image relative to the vertical direction is 11 degrees, the difference between the two is 9 degrees, that is, the deflection angle of the human body in the human body image relative to the previous time is deflected 9 degrees left, and the difference threshold is set to be 10 degrees, it is determined that the angle difference smaller than the difference threshold is caused by slight shaking of the human body, and the picture displayed on the display screen may not be deflected at this time.
The above controlling the deflection of the picture displayed in the display screen relative to the display screen according to the first deflection angle means that the picture displayed in the display screen is deflected in the same direction and at the same angle as the first deflection angle on the basis of the vertical direction; and for the reference angle, deflecting according to the angle difference on the basis of the reference angle.
Step 650, acquiring the screen size of the display screen.
The obtaining of the screen size of the display screen may refer to obtaining a width and a height of the display screen, where the width and the height of the display screen may be obtained by the application program reading a system API of the display device.
Optionally, after the application program obtains the width and the height of the display screen, the center of the display screen and the length of the diagonal line of the display screen may be determined according to the width and the height of the display screen.
And 660, acquiring the scaling of the picture displayed in the display screen according to the screen size of the display screen and the first deflection angle.
Referring to fig. 11, fig. 11 is a schematic diagram illustrating a method for determining a scaling of a picture displayed on a display screen according to a display control method according to an embodiment of the present application. As shown in fig. 11, the scaling calculation formula of the picture displayed in the display screen is:
wherein, Z is the scaling of the picture displayed in the display screen, B is half of the length of the diagonal line of the display screen, a is the distance from the intersection point of the diagonal line of the rotated display screen and the long side of the display screen to the center of the display screen, H is the screen width of the display screen, n is the included angle between the diagonal line of the rotated display screen on the side exceeding the boundary of the display screen and the vertical line of the television, and the vertical line 1110 of the television refers to the vertical line passing through the center of the display screen and making the long side of the display screen.
The calculation formula of the included angle n between the diagonal line of one side of the rotated display picture beyond the boundary of the display screen and the vertical line of the television is as follows:
n=α-m;
where α is an angle between a display image ray and a display image diagonal, the display image ray 1120 is an extension line of a perpendicular line passing through the center of the display screen and serving as a long side of the display image, m is a first deflection angle, H is a half of the width H of the display screen, L is a half of the width L of the display screen, and s is a half of the length of the display screen diagonal.
And step 670, zooming the picture displayed in the display screen according to the zooming ratio.
In this embodiment of the application, the application program may scale the picture displayed in the display screen according to the scaling Z calculated in step 660, so that the scaled display picture can be completely displayed in the display screen, and the problem that a part of the picture area cannot be displayed due to picture deflection is avoided.
To sum up, the display control method provided in the embodiment of the present application obtains the human body image collected by the image collecting assembly when the display screen corresponding to the display device displays the image, and obtains the deflection angle of the human body in the human body image relative to the vertical direction, so as to control the deflection of the image displayed in the display screen relative to the display screen according to the deflection angle, thereby realizing the automatic adjustment of the display screen according to the deflection angle of the human body, without the need of manually adjusting the angle of the display screen by the user, and thus improving the accuracy of the angle adjustment of the display screen.
In addition, the scheme shown in the embodiment of the application does not need to adjust the angle of the display screen, avoids the problems that the rotation of the rotating shaft easily causes the abrasion of hardware equipment such as the display and the like, and shortens the service life of the hardware equipment such as the display and the like, and accordingly prolongs the service life of the hardware equipment such as the display and the like.
Referring to fig. 12, a flowchart of a display control method according to an exemplary embodiment of the present application is shown. The display control method can be executed by a display device containing an image acquisition component, for example, the display device can include but is not limited to a smart television, a smart television set-top box, a smart vehicle-mounted device and the like. As shown in fig. 12, the display control method may include the steps of:
step 1210, when a picture is displayed in a display screen corresponding to the display device, obtaining a human body image collected by the image collecting assembly.
And step 1220, when the number of the human bodies in the human body image is greater than or equal to 2, screening each human body in the human body image, and determining an effective human body in each human body in the human body image.
Optionally, when each human body in the human body image is screened, the application program may identify the face orientation of each human body in the human body image; and determining the human body of which the face points to the direction of the display screen in each human body as an effective human body.
Referring to fig. 13, which shows a schematic diagram of effective human body recognition of the display control method according to the embodiment of the present application, as shown in fig. 13, if a human body 1310 faces a direction of a display screen and a human body 1320 faces a direction of the display screen, an application program may determine that the human body 1310 is an effective human body and the human body 1320 is an ineffective human body.
Step 1230, a first deflection angle of the human body in the human body image relative to the vertical direction is obtained.
Optionally, the application program may obtain the first deflection angle according to a deflection angle of the effective human body in the human body image relative to the vertical direction.
In the above steps of the embodiment of the present application, a scheme of obtaining a first deflection angle from a deflection angle of an effective human body in a human body image with respect to a vertical direction is described as an example. Optionally, when the number of the human bodies in the human body image is greater than or equal to 2, the application program may also obtain a deflection angle of each human body in the human body image with respect to the vertical direction; and acquiring a first deflection angle according to the deflection angle of each human body in the human body image relative to the vertical direction.
Optionally, when the first deflection angle is obtained according to the deflection angle of each human body in the human body image relative to the vertical direction, the application program may determine the minimum angle of the deflection angles of each human body in the human body image relative to the vertical direction as the first deflection angle; or determining the maximum angle of the deflection angles of each human body in the human body image relative to the vertical direction as a first deflection angle; or, the application program may also determine an average angle of the deflection angles of the respective human bodies in the human body image with respect to the vertical direction as the first deflection angle; or, any one of the minimum and maximum angles among the deflection angles of the respective human bodies in the human body image with respect to the vertical direction is determined as the first deflection angle.
When the first deflection angle is obtained according to the deflection angle of each human body in the human body image relative to the vertical direction, the method can be executed in combination with an effective human body screening scheme, that is, if the number of the screened effective human bodies is greater than or equal to 2, the minimum angle or the maximum angle in the deflection angles of each effective human body in the human body image relative to the vertical direction is determined as the first deflection angle; alternatively, the application program may determine an average angle of the deflection angles of the respective effective human bodies in the human body image with respect to the vertical direction as the first deflection angle.
Optionally, the application program may set the first deflection angle to any angle in a range interval formed by a minimum angle and a maximum angle of the deflection angles of the respective human bodies in the human body image with respect to the vertical direction. For example, the application program may randomly determine an angle in the angle interval formed by the minimum angle and the maximum angle as the first deflection angle.
In a possible embodiment, the intelligent scene shown in fig. 1 includes a plurality of effective human bodies, and the directions of the deflection angles of the plurality of effective human bodies are the same, for example, please refer to fig. 14, which shows a schematic diagram of a method for determining a first deflection angle of the display control method according to the embodiment of the present application. As shown in fig. 14, the deflection angle of the effective human body 1410 is 1430 and the deflection angle of the effective human body 1420 is 1440, and according to the above method, the first deflection angle may be the smallest angle in the numerical values of the deflection angle 1430 and the deflection angle 1440, that is, the smallest angle taking the absolute value of the deflection angle regardless of the positive or negative of the deflection angle, that is, the deflection angle 1440 in fig. 14, or the average value of the deflection angle 1430 and the deflection angle 1440.
In another possible embodiment, the intelligent scene shown in fig. 1 includes a plurality of effective human bodies, and the directions of the deflection angles of the plurality of effective human bodies are not the same, for example, please refer to fig. 15, which shows a schematic diagram of another method for determining the first deflection angle of the display control method according to the embodiment of the present application. As shown in fig. 15, the deflection angle of the effective human body 1510 is 1530 and the deflection angle of the effective human body 1520 is 1540, and according to the above method, the first deflection angle may be the smallest angle in terms of the numerical value between the deflection angle 1530 and the deflection angle 1540, that is, the smallest angle in terms of the absolute value of the deflection angle, regardless of the positive or negative of the deflection angle, that is, the deflection angle 1540 in fig. 15, or the average value between the deflection angle 1530 and the deflection angle 1540.
And step 1240, controlling the picture displayed in the display screen to deflect relative to the display screen according to the first deflection angle.
The implementation process of step 1210 and step 1240 may refer to the related description in the embodiment shown in fig. 2 or fig. 5, and is not described herein again.
To sum up, the display control method provided in the embodiment of the present application obtains the human body image collected by the image collecting assembly when the display screen corresponding to the display device displays the image, and obtains the deflection angle of the human body in the human body image relative to the vertical direction, so as to control the deflection of the image displayed in the display screen relative to the display screen according to the deflection angle, thereby realizing the automatic adjustment of the display screen according to the deflection angle of the human body, without the need of manually adjusting the angle of the display screen by the user, and thus improving the accuracy of the angle adjustment of the display screen.
In addition, the scheme shown in the embodiment of the application does not need to adjust the angle of the display screen, avoids the problems that the rotation of the rotating shaft easily causes the abrasion of hardware equipment such as the display and the like, and shortens the service life of the hardware equipment such as the display and the like, and accordingly prolongs the service life of the hardware equipment such as the display and the like.
Referring to fig. 16, a flowchart of a display control method according to an exemplary embodiment of the present application is shown. The display control method can be executed by a display device containing an image acquisition component, for example, the display device can include but is not limited to a smart television, a smart television set-top box, a smart vehicle-mounted device and the like. As shown in fig. 16, the display control method may include the steps of:
step 1610, running a monitoring service (MonitorService) to perform polling check on the peripheral devices.
Optionally, before the monitoring service is run, when the display device including the image capturing component initially uses the application program for capturing the human body image by using the image capturing component, guidance for setting the application program needs to be performed on the user.
Referring to fig. 17, fig. 17 shows a schematic view of a guidance page of a display control method according to an embodiment of the present application. As shown in fig. 17, the upper half is a function presentation area 1710, which is a gallery implemented using a multi-page switcher (ViewPager) that presents functions and usages of a display control method by scrolling, and rights required for the application to execute the display control method, and which includes-1 screen guidance content 1711, home screen guidance content 1712, +1 screen guidance content 1713, and the like, wherein the home screen guidance content refers to guidance content currently displayed in the display screen, -1 screen guidance content refers to guidance content that has been displayed in the display screen, and +1 screen guidance content refers to guidance content that has not been displayed therein. The lower half part is an operation button area 1720, buttons of the area are fixed and can be clicked, the operation button area 1720 can comprise a previous step button 1721 and a next step button 1722, when the previous step button 1721 receives a click signal, the display content in the display screen is switched from the guide content displayed in the current display screen to-1 screen guide content, and when the next step button 1722 receives the click signal, the display content in the display screen is switched from the guide content displayed in the current display screen to +1 screen guide content.
Optionally, the ViewPager may use an adapter mode, bind different guidance contents to different pages through the adapter, create different fragments (fragments) when sliding to different indexed guidance pages, where each Fragment corresponds to a page of guidance contents, where the guidance contents may be configured in the background, such as functions and required permissions of the image position correction system.
In a possible embodiment, the operating button area includes a button, the button is a skip button, during the gallery rolling display, the button displays "next page" to instruct the user to perform a page-turning operation, when the gallery rolling display reaches the last page, the display content of the button is changed to "confirm open", and when the button receives a user click operation on the button, the application pops up an authority granting interface, and the authority required by the application to execute the display control method, including the image acquisition component access authority, is displayed in the interface. And when receiving the authority required by the application program to operate the display control method granted by the user, ending the authority setting part, and returning to the home page of the application program to display the content of the application program.
Optionally, the jump button is a control button linked with the ViewPager, and a viewer pager is triggered in a listener (occlicklistener) of the jump button to slide from the current screen of the ViewPager to the content of the +1 screen. After the content sliding of all the viewpagers is completed, the next jump action of the jump button pulls up the authority authorization page of the system, and the application program executes the display control method after the page is authorized.
In an exemplary embodiment, after the application acquires the right required for executing the display control method, when the display screen displays a screen, the application runs on a background monitor service (monitor service) polling check, which is a Central Processing Unit (CPU) that periodically issues an inquiry to sequentially inquire whether each peripheral device needs its service. The monitoring service will send a delay message through the Handler (Handler).
And step 1620, the processor (Handler) sends the delay message and detects the human body image collected by the image collection component in a timing manner. The time delay message is used for indicating the frequency of acquiring the human body image acquired by the image acquisition component. When the time delay is reached, the application program acquires a frame of image acquired by the image acquisition assembly at the moment, and if the image is a human body image, the image is processed, analyzed and calculated; and if the image is not a human body image, acquiring a frame of image acquired by the image acquisition assembly at the next delay time when the next delay arrives.
Step 1630, a first deflection angle of the human body in the human body image relative to the vertical direction is obtained.
At step 1640, it is determined whether the angular difference between the first deflection angle and the reference angle is not less than the difference threshold. The monitoring service processes, analyzes and calculates the obtained human body image to obtain a first deflection angle, compares the difference value between the first deflection angle and the reference angle with a difference threshold value to judge whether the angle difference value between the first deflection angle and the reference angle is not less than the difference threshold value, if so, the step 1650 is carried out, otherwise, the step 1680 is carried out.
Step 1650, the monitoring service sends a message to the main thread, and when the angle difference between the first deflection angle and the reference angle is not less than the difference threshold, the monitoring service calculates a scaling ratio in combination with the deflected human body image, and sends a message to the main thread through broadcasting, the message being used to indicate the deflection direction, the deflection angle, and the scaling ratio of the deflection performed on the picture by the main thread when the picture displayed in the display screen is drawn in the next frame.
Step 1660, the main thread sends a drawing picture request to the system of the display device, and after receiving the message, the main thread triggers the drawing picture to work and sends the drawing picture to the system of the display device, and changes the deflection angle of the self-rotation view group (rotaviewgroup) to be a first deflection angle.
Step 1670, the rotaviewgroup rotates and scales the Canvas (Canvas), and when the next frame of drawing comes, the rotaviewgroup draws the next frame of display picture on the adjusted Canvas according to the first deflection angle and the scaling ratio.
Step 1680, determine whether the monitoring service is closed, if yes, then end, otherwise, go to step 1620.
To sum up, the display control method provided in the embodiment of the present application obtains the human body image collected by the image collecting assembly when the display screen corresponding to the display device displays the image, and obtains the deflection angle of the human body in the human body image relative to the vertical direction, so as to deflect the image displayed in the display screen according to the deflection angle, thereby automatically adjusting the display image in the display screen according to the deflection angle of the human body, without manually adjusting the angle of the display screen by a user, and thereby improving the accuracy of adjusting the angle of the display image.
In addition, the scheme shown in the embodiment of the application does not need to adjust the angle of the display screen, avoids the problems that the rotation of the rotating shaft easily causes the abrasion of hardware equipment such as the display and the like, and shortens the service life of the hardware equipment such as the display and the like, and accordingly prolongs the service life of the hardware equipment such as the display and the like.
Referring to fig. 18, a flowchart of a display control method according to an exemplary embodiment of the present application is shown. The display control method can be executed by a display device containing an image acquisition component, for example, the display device can include but is not limited to a smart television, a smart television set-top box, a smart vehicle-mounted device and the like. As shown in fig. 18, the display control method may include the steps of:
step 1810, the image capture component is turned on.
And 1820, monitoring and acquiring the human body image in a silent manner by the image acquisition component, and transmitting the acquired human body image to the application program.
Step 1830, calculate the first deflection angle, and the application program calculates the deflection angle of the human body in the human body image according to the collected human body image.
Step 1840, judging whether the human body deflection angle changes by comparing the first deflection angle with the reference angle, and judging that the human body deflection angle changes when the angle difference value between the first deflection angle and the reference angle is not less than the difference threshold value.
Step 1850, adjusting a deflection angle of the picture displayed in the display screen, and deflecting the picture displayed in the display screen to keep the same as the deflection angle of the human body when the deflection angle of the human body changes.
Step 1860, the picture displayed in the display screen is refreshed, and the adjusted picture is displayed on the display screen.
To sum up, the display control method provided in the embodiment of the present application obtains the human body image collected by the image collecting assembly when the display screen corresponding to the display device displays the image, and obtains the deflection angle of the human body in the human body image relative to the vertical direction, so as to deflect the image displayed in the display screen according to the deflection angle, thereby automatically adjusting the display image in the display screen according to the deflection angle of the human body, without manually adjusting the angle of the display screen by a user, and thereby improving the accuracy of adjusting the angle of the display image.
In addition, the scheme shown in the embodiment of the application does not need to adjust the angle of the display screen, avoids the problems that the rotation of the rotating shaft easily causes the abrasion of hardware equipment such as the display and the like, and shortens the service life of the hardware equipment such as the display and the like, and accordingly prolongs the service life of the hardware equipment such as the display and the like.
Referring to fig. 19, a block diagram of a display control apparatus according to an exemplary embodiment of the present application is shown. The device is applied to a display device comprising an image acquisition assembly to execute all or part of the steps of the method shown in any one of the embodiments of fig. 2, 6, 12, 16 or 18. The display control apparatus may include:
a first obtaining module 1910, configured to obtain a human body image collected by an image collecting assembly when a screen is displayed in a display screen corresponding to a display device;
the second obtaining module 1920 is configured to obtain a first deflection angle of the human body in the human body image relative to a vertical direction, where the vertical direction is a direction perpendicular to the ground, and the human body image includes the human body;
the deflection module 1930 is configured to control, according to the first deflection angle, a picture displayed in the display screen to deflect relative to the display screen.
Optionally, the second obtaining module 1920 is configured to,
identifying a waist position of a human body in the human body image and a head position of the human body in the human body image;
and determining an included angle between a connecting line between the waist position and the head position and the vertical direction as a first deflection angle.
Optionally, the apparatus further comprises:
the third obtaining module is used for obtaining an angle difference value between the first deflection angle and the reference angle before the deflection module controls the picture displayed in the display screen to deflect relative to the display screen according to the first deflection angle;
and a deflection module 1930, configured to control, when the absolute value of the angle difference is not smaller than the difference threshold, a picture displayed in the display screen to deflect relative to the display screen according to the first deflection angle.
Optionally, when the picture displayed in the display screen is not deflected, the reference angle is 0 degree;
when the picture displayed in the display screen is already deflected, the reference angle is the deflection angle of the human body relative to the vertical direction when the picture displayed in the display screen is deflected last time.
Optionally, the second obtaining module 1920 is configured to obtain a first deflection angle of the human body in the human body image with respect to the vertical direction when the number of the human bodies in the human body image is 1.
Optionally, the second obtaining module 1920 is configured to obtain a deflection angle of each human body in the human body image with respect to the vertical direction when the number of human bodies in the human body image is greater than or equal to 2;
and acquiring a first deflection angle according to the deflection angle of each human body in the human body image relative to the vertical direction.
Optionally, the second obtaining module 1920 is configured to, when the number of human bodies in the human body image is greater than or equal to 2,
determining the minimum angle of the deflection angles of all human bodies in the human body image relative to the vertical direction as a first deflection angle;
or, determining a maximum angle of deflection angles of each human body in the human body image relative to a vertical direction as the first deflection angle;
or, an average angle of the deflection angles of the respective human bodies in the human body image with respect to the vertical direction is determined as the first deflection angle.
Or, any one of a minimum angle and a maximum angle among deflection angles of the respective human bodies in the human body image with respect to a vertical direction is determined as the first deflection angle.
Optionally, the apparatus further comprises:
the screening module is used for screening each human body in the human body image and determining an effective human body in each human body in the human body image;
the second obtaining module 1920 is configured to obtain the first deflection angle according to the deflection angle of the effective human body in the human body image with respect to the vertical direction.
Optionally, the screening module is configured to identify face orientations of respective human bodies in the human body image;
and determining the human body of which the face points to the direction of the display screen in each human body as an effective human body.
Optionally, the apparatus further comprises:
the fourth acquisition module is used for acquiring the screen size of the display screen;
the fifth obtaining module is used for obtaining the scaling of the picture displayed in the display screen according to the screen size of the display screen and the first deflection angle;
and the zooming module is used for zooming the picture displayed in the display screen according to the zooming proportion.
To sum up, the display control device provided in the embodiment of the present application, when the display control device is applied to a display device including an image capturing component, acquires a human body image captured by the image capturing component when a picture is displayed in a display screen corresponding to the display device, and acquires a deflection angle of a human body in the human body image relative to a vertical direction, so as to control the deflection of the picture displayed in the display screen relative to the display screen according to the deflection angle, thereby realizing automatic adjustment of the display picture in the display screen according to the deflection angle of the human body, and not requiring a user to manually adjust the angle of the display screen, thereby improving the accuracy of angle adjustment of the display picture.
In addition, the scheme shown in the embodiment of the application does not need to adjust the angle of the display screen, avoids the problems that the rotation of the rotating shaft easily causes the abrasion of hardware equipment such as the display and the like, and shortens the service life of the hardware equipment such as the display and the like, and accordingly prolongs the service life of the hardware equipment such as the display and the like.
Fig. 20 is a block diagram illustrating the structure of a computer device 2000, according to an example embodiment. The computer device 2000 may be a display device comprising an image acquisition component, such as a smart television, a smart television set-top box, or a smart car device.
Generally, the computer device 2000 includes: a processor 2001 and a memory 2002.
The processor 2001 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and so on. The processor 2001 may be implemented in at least one hardware form of a DSP (Digital Signal Processing), an FPGA (Field-Programmable Gate Array), and a PLA (Programmable Logic Array). The processor 2001 may also include a main processor and a coprocessor. In some embodiments, the processor 2001 may be integrated with a GPU (Graphics Processing Unit). In some embodiments, the processor 2001 may further include an AI (Artificial Intelligence) processor for processing computing operations related to machine learning.
The memory 2002 may include one or more computer-readable storage media, which may be non-transitory. The memory 2002 may also include high-speed random access memory, as well as non-volatile memory. In some embodiments, a non-transitory computer readable storage medium in memory 2002 is used to store at least one instruction for execution by processor 2001 to implement the methods provided by the method embodiments herein.
In some embodiments, the computer device 2000 may further optionally include: a peripheral interface 2003 and at least one peripheral. The processor 2001, memory 2002 and peripheral interface 2003 may be connected by buses or signal lines. Various peripheral devices may be connected to peripheral interface 2003 through a bus, signal line, or circuit board. Specifically, the peripheral device includes: at least one of a radio frequency circuit 2004, a touch display 2005, a camera 2006, an audio circuit 2007, a positioning assembly 2008, and a power supply 2009.
The peripheral interface 2003 may be used to connect at least one peripheral related to I/O (Input/Output) to the processor 2001 and the memory 2002.
The Radio Frequency circuit 2004 is used for receiving and transmitting RF (Radio Frequency) signals, also called electromagnetic signals. Optionally, the radio frequency circuit 2004 comprises: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a subscriber identity module card, and so forth.
The display screen 2005 is used to display a UI (user interface). The UI may include graphics, text, icons, video, and any combination thereof. When the display screen 2005 is a touch display screen, the display screen 2005 also has the ability to capture touch signals on or over the surface of the display screen 2005. The touch signal may be input to the processor 2001 as a control signal for processing.
Camera assembly 2006 is used to capture images or video.
The audio circuitry 2007 may include a microphone and a speaker. The microphone is used for collecting sound waves of a user and the environment, converting the sound waves into electric signals, and inputting the electric signals to the processor 2001 for processing or inputting the electric signals to the radio frequency circuit 2004 so as to realize voice communication. The speaker is used to convert electrical signals from the processor 2001 or the radio frequency circuit 2004 into sound waves. In some embodiments, the audio circuitry 2007 may also include a headphone jack.
The Location component 2008 is configured to locate a current geographic Location of the computer device 2000 to implement navigation or LBS (Location Based Service).
A power supply 2009 is used to power the various components of the computer device 2000. The power supply 2009 may be an alternating current, a direct current, a disposable battery, or a rechargeable battery.
In some embodiments, the computer device 2000 also includes one or more sensors 2010. The one or more sensors 2010 include, but are not limited to: acceleration sensor 2011, gyro sensor 2012, pressure sensor 2013, fingerprint sensor 2014, optical sensor 2015, and proximity sensor 2016.
Those skilled in the art will appreciate that the configuration shown in FIG. 20 is not intended to be limiting of the computer device 2000 and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components may be used.
In an exemplary embodiment, a non-transitory computer readable storage medium including instructions, such as a memory including at least one instruction, at least one program, set of codes, or set of instructions executable by a processor to perform all or part of the steps of the method illustrated in any of the embodiments of fig. 2, 6, 12, 16 or 18 described above, is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
Other embodiments of the present application will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the application and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the application being indicated by the following claims.
It will be understood that the present application is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the application is limited only by the appended claims.

Claims (15)

1. A display control method performed by a display device including an image capture component, the method comprising:
when a picture is displayed in a display screen corresponding to the display equipment, acquiring a human body image acquired by the image acquisition assembly;
acquiring a first deflection angle of a human body in the human body image relative to a vertical direction, wherein the vertical direction is a direction perpendicular to the ground, and the human body image comprises the human body;
and controlling the deflection of the picture displayed in the display screen relative to the display screen according to the first deflection angle.
2. The method of claim 1, wherein the obtaining a first deflection angle of the human body in the human body image relative to a vertical direction comprises:
identifying a waist position of a human body in the human body image and a head position of the human body in the human body image;
and determining an included angle between a connecting line between the waist position and the head position and the vertical direction as the first deflection angle.
3. The method according to claim 1, wherein before controlling the picture displayed in the display screen to be deflected relative to the display screen according to the first deflection angle, the method further comprises:
obtaining an angle difference between the first deflection angle and a reference angle;
the controlling, according to the first deflection angle, the deflection of the picture displayed in the display screen with respect to the display screen includes:
and when the absolute value of the angle difference is not smaller than the difference threshold, controlling the picture displayed in the display screen to deflect relative to the display screen according to the first deflection angle.
4. The method of claim 3,
when the picture displayed in the display screen is not deflected, the reference angle is 0 degree;
when the picture displayed in the display screen is already deflected, the reference angle is the deflection angle of the human body relative to the vertical direction when the picture displayed in the display screen is deflected last time.
5. The method of claim 1, wherein the obtaining a first deflection angle of the human body in the human body image relative to a vertical direction comprises:
when the number of the human bodies in the human body image is 1, acquiring a first deflection angle of the human body in the human body image relative to a vertical direction.
6. The method of claim 1, wherein the obtaining a first deflection angle of the human body in the human body image relative to a vertical direction comprises:
when the number of the human bodies in the human body image is larger than or equal to 2, acquiring the deflection angle of each human body in the human body image relative to the vertical direction;
and acquiring the first deflection angle according to the deflection angle of each human body in the human body image relative to the vertical direction.
7. The method according to claim 6, wherein the obtaining the first deflection angle according to the deflection angle of each human body in the human body image relative to the vertical direction comprises:
determining a minimum angle of deflection angles of each human body in the human body image relative to a vertical direction as the first deflection angle;
or, determining a maximum angle of deflection angles of each human body in the human body image relative to a vertical direction as the first deflection angle;
or, determining an average angle of deflection angles of each human body in the human body image relative to a vertical direction as the first deflection angle;
or, any one of a minimum angle and a maximum angle among deflection angles of the respective human bodies in the human body image with respect to a vertical direction is determined as the first deflection angle.
8. The method according to claim 6, wherein before the obtaining the first deflection angle according to the deflection angle of each human body in the human body image relative to the vertical direction, further comprising:
screening each human body in the human body image, and determining an effective human body in each human body in the human body image;
the obtaining the first deflection angle according to the deflection angle of each human body in the human body image relative to the vertical direction includes:
and acquiring the first deflection angle according to the deflection angle of the effective human body in the human body image relative to the vertical direction.
9. The method according to claim 8, wherein the screening each human body in the human body image to determine an effective human body in each human body in the human body image comprises:
identifying face orientations of respective human bodies in the human body image;
and determining the human body of which the face faces to the direction of the display screen in each human body as the effective human body.
10. The method of claim 1, further comprising:
acquiring the screen size of the display screen;
acquiring the scaling of a picture displayed in the display screen according to the screen size of the display screen and the first deflection angle;
and zooming the picture displayed in the display screen according to the zooming proportion.
11. A display control apparatus, wherein the apparatus is used in a display device including an image capturing component, the apparatus comprising:
the first acquisition module is used for acquiring a human body image acquired by the image acquisition assembly when a picture is displayed in a display screen corresponding to the display equipment;
the second acquisition module is used for acquiring a first deflection angle of a human body in the human body image relative to a vertical direction, wherein the vertical direction is a direction perpendicular to the ground, and the human body image comprises the human body;
and the deflection module is used for controlling the deflection of the picture displayed in the display screen relative to the display screen according to the first deflection angle.
12. The apparatus of claim 11, wherein the second obtaining module is configured to,
identifying a waist position of a human body in the human body image and a head position of the human body in the human body image;
and determining an included angle between a connecting line between the waist position and the head position and the vertical direction as the first deflection angle.
13. The apparatus of claim 11, further comprising:
the third obtaining module is used for obtaining an angle difference value between the first deflection angle and a reference angle before the deflection module controls the picture displayed in the display screen to deflect relative to the display screen according to the first deflection angle;
and the deflection module is used for controlling the deflection of the picture displayed in the display screen relative to the display screen according to the first deflection angle when the absolute value of the angle difference is not less than the difference threshold value.
14. A computer device comprising a processor and a memory, said memory having stored therein at least one instruction, at least one program, set of codes, or set of instructions, said at least one instruction, said at least one program, said set of codes, or set of instructions being loaded and executed by said processor to implement a display control method according to any one of claims 1 to 10.
15. A computer readable storage medium having stored therein at least one instruction, at least one program, a set of codes, or a set of instructions, which is loaded and executed by the processor to implement the display control method according to any one of claims 1 to 10.
CN201910875369.XA 2019-09-17 2019-09-17 Display control method, display control device, computer equipment and storage medium Pending CN110597391A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910875369.XA CN110597391A (en) 2019-09-17 2019-09-17 Display control method, display control device, computer equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910875369.XA CN110597391A (en) 2019-09-17 2019-09-17 Display control method, display control device, computer equipment and storage medium

Publications (1)

Publication Number Publication Date
CN110597391A true CN110597391A (en) 2019-12-20

Family

ID=68860034

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910875369.XA Pending CN110597391A (en) 2019-09-17 2019-09-17 Display control method, display control device, computer equipment and storage medium

Country Status (1)

Country Link
CN (1) CN110597391A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113900526A (en) * 2021-10-29 2022-01-07 深圳Tcl数字技术有限公司 Three-dimensional human body image display control method and device, storage medium and display equipment
WO2022042111A1 (en) * 2020-08-26 2022-03-03 深圳创维-Rgb电子有限公司 Video image display method and apparatus, and multimedia device and storage medium
CN115086470A (en) * 2022-05-31 2022-09-20 超变量(北京)科技有限公司 Method for realizing face-to-face transmission of business cards through mobile phone

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120075166A1 (en) * 2010-09-29 2012-03-29 Samsung Electronics Co. Ltd. Actuated adaptive display systems
CN103024579A (en) * 2012-12-24 2013-04-03 深圳Tcl新技术有限公司 Method and device for automatic rotation of display device images
CN103279260A (en) * 2013-04-10 2013-09-04 苏州三星电子电脑有限公司 Direction self-adaptation display system and adjusting method thereof
CN103645749A (en) * 2013-12-23 2014-03-19 张志增 Automatic adjusting type display device and adjusting method thereof
CN106843821A (en) * 2015-12-07 2017-06-13 百度在线网络技术(北京)有限公司 The method and apparatus of adjust automatically screen
CN109558842A (en) * 2018-11-30 2019-04-02 北京七鑫易维信息技术有限公司 A kind of method, apparatus, equipment and medium adjusting image display direction
US10353219B1 (en) * 2015-08-20 2019-07-16 Verily Life Sciences Llc Device, method and system to provide accommodation during a stereoscopic display

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120075166A1 (en) * 2010-09-29 2012-03-29 Samsung Electronics Co. Ltd. Actuated adaptive display systems
CN103024579A (en) * 2012-12-24 2013-04-03 深圳Tcl新技术有限公司 Method and device for automatic rotation of display device images
CN103279260A (en) * 2013-04-10 2013-09-04 苏州三星电子电脑有限公司 Direction self-adaptation display system and adjusting method thereof
CN103645749A (en) * 2013-12-23 2014-03-19 张志增 Automatic adjusting type display device and adjusting method thereof
US10353219B1 (en) * 2015-08-20 2019-07-16 Verily Life Sciences Llc Device, method and system to provide accommodation during a stereoscopic display
CN106843821A (en) * 2015-12-07 2017-06-13 百度在线网络技术(北京)有限公司 The method and apparatus of adjust automatically screen
CN109558842A (en) * 2018-11-30 2019-04-02 北京七鑫易维信息技术有限公司 A kind of method, apparatus, equipment and medium adjusting image display direction

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022042111A1 (en) * 2020-08-26 2022-03-03 深圳创维-Rgb电子有限公司 Video image display method and apparatus, and multimedia device and storage medium
CN113900526A (en) * 2021-10-29 2022-01-07 深圳Tcl数字技术有限公司 Three-dimensional human body image display control method and device, storage medium and display equipment
CN115086470A (en) * 2022-05-31 2022-09-20 超变量(北京)科技有限公司 Method for realizing face-to-face transmission of business cards through mobile phone
CN115086470B (en) * 2022-05-31 2024-03-29 广东二进制科技有限公司 Method for realizing face-to-face business card transmission through mobile phone

Similar Documents

Publication Publication Date Title
CN108810538B (en) Video coding method, device, terminal and storage medium
CN111541907B (en) Article display method, apparatus, device and storage medium
CN110597391A (en) Display control method, display control device, computer equipment and storage medium
US20220309836A1 (en) Ai-based face recognition method and apparatus, device, and medium
KR102565977B1 (en) Method for detecting region of interest based on line of sight and electronic device thereof
CN111432245B (en) Multimedia information playing control method, device, equipment and storage medium
CN111062981A (en) Image processing method, device and storage medium
CN111444748B (en) Sitting posture detection method, device, equipment and storage medium
CN112578971B (en) Page content display method and device, computer equipment and storage medium
US20240051475A1 (en) Display adjustment method and apparatus
CN113570645A (en) Image registration method, image registration device, computer equipment and medium
KR20220127568A (en) Method for providing home tranninig service and a display apparatus performing the same
CN110675473B (en) Method, device, electronic equipment and medium for generating GIF dynamic diagram
EP2888716B1 (en) Target object angle determination using multiple cameras
US20150086074A1 (en) Information processing device, information processing method, and program
EP2831702B1 (en) Information processing device, information processing method and program
US20220345619A1 (en) Apparatus, image processing system, communication system, method for setting, image processing method, and recording medium
CN114296627A (en) Content display method, device, equipment and storage medium
CN110377145B (en) Electronic device determination method, system, computer system and readable storage medium
US20150049909A1 (en) Information processing device, information processing method and program
US20130127841A1 (en) Three-dimensional (3d) image display method and apparatus for 3d imaging and displaying contents according to start or end of operation
CN115348438B (en) Control method and related device for three-dimensional display equipment
CN117351074B (en) Viewpoint position detection method and device based on head-mounted eye tracker and depth camera
CN111369566B (en) Method, device, equipment and storage medium for determining position of pavement blanking point
US20230308764A1 (en) Display terminal, communication system, method for displaying, method for communicating, and recording medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 40019499

Country of ref document: HK