CN115904079A - Display equipment adjusting method, device, terminal and storage medium - Google Patents
Display equipment adjusting method, device, terminal and storage medium Download PDFInfo
- Publication number
- CN115904079A CN115904079A CN202211585270.4A CN202211585270A CN115904079A CN 115904079 A CN115904079 A CN 115904079A CN 202211585270 A CN202211585270 A CN 202211585270A CN 115904079 A CN115904079 A CN 115904079A
- Authority
- CN
- China
- Prior art keywords
- target object
- display
- display screen
- display device
- adjusting
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The embodiment of the application discloses a display equipment adjusting method, a display equipment adjusting device, a terminal and a storage medium, and belongs to the technical field of computers. The method comprises the following steps: determining an intersection point of a sight line of a target object and a display screen of display equipment based on a plurality of face key points of the target object; adjusting the height of the display device based on the vertical distance between the intersection point and the central point of the display screen, so that the central point of the display screen and the intersection point are positioned at the same horizontal height; based on the sight with the display screen is in the contained angle between the perpendicular bisector at centre point department, adjust display device's orientation, so that contained angle between sight and the perpendicular bisector is less than the angle threshold value. The method can automatically adjust the position and the angle of the display equipment according to the sight of the user without manual adjustment of the user, and improves the adjustment efficiency.
Description
Technical Field
The embodiment of the application relates to the technical field of computers, in particular to a display device adjusting method, a display device adjusting device, a terminal and a storage medium.
Background
With the development of computer technology, various electronic devices have also gradually gained popularity. When a user uses a terminal having a display device, such as a desktop computer or a notebook computer, the user often needs to keep the same posture for a long time to view the display device. Users are prone to fatigue if the display device is not properly positioned. Therefore, how to relieve the fatigue of the user is a problem to be solved.
At present, generally, a height-adjustable support is configured for display equipment, a user can adjust the height of the display equipment through manually adjusting the support according to own sitting posture and habit, so that the height of the display equipment is in the optimal sight range of the user, and therefore the fatigue of the user in watching the display equipment for a long time is relieved. However, with this method, manual adjustment is required, which is cumbersome to operate and inefficient.
Disclosure of Invention
The embodiment of the application provides a display device adjusting method, a display device adjusting device, a terminal and a storage medium, which can automatically adjust the position and the angle of a display device according to the sight of a user. The technical scheme is as follows:
in one aspect, a method for adjusting a display device is provided, where the method includes:
determining an intersection point of a sight line of a target object and a display screen of display equipment based on a plurality of face key points of the target object;
adjusting the height of the display device based on the vertical distance between the intersection point and the central point of the display screen, so that the central point of the display screen and the intersection point are located at the same horizontal height;
based on the sight with the display screen is in the contained angle between the perpendicular bisector of central point department, adjust display device's orientation, so that the contained angle between sight and the perpendicular bisector is less than the angle threshold value.
In some embodiments, the adjusting the height of the display device based on the vertical distance between the intersection point and the center point of the display screen so that the center point of the display screen and the intersection point are located at the same horizontal height comprises:
and under the condition that the vertical distance is not greater than the distance threshold, adjusting the display equipment by adopting a first adjusting mode, wherein the first adjusting mode is used for indicating that the height of the display equipment is adjusted by adopting a first speed.
In some embodiments, the method further comprises:
displaying prompt information on the display screen when the vertical distance is greater than the distance threshold, wherein the prompt information is used for prompting the target object to suspend using the display device, and the height of the display device is to be adjusted for the target object;
and responding to the confirmation operation of the target object on the prompt message, and adjusting the display equipment by adopting a second adjustment mode, wherein the second adjustment mode is used for indicating that the height of the display equipment is adjusted by a second speed under the condition that the target object suspends the use of the display equipment, and the second speed is greater than the first speed.
In some embodiments, the method further comprises:
horizontally adjusting the display device based on a horizontal distance between the intersection point and a center point of the display screen so that the intersection point is located at the center point of the display screen.
In some embodiments, the method further comprises:
determining an included angle between the sight line of the target object and a plane where the display screen is located based on the plurality of face key points of the target object;
and adjusting the pitching angle of the display equipment based on the included angle between the sight line of the target object and the plane where the display screen is located, so that the sight line of the target object is perpendicular to the plane where the display screen is located.
In some embodiments, before determining the intersection of the line of sight of the target object with the display screen of the display device based on the plurality of face keypoints of the target object, the method further comprises: and carrying out face recognition on the target object, and determining a plurality of face key points of the target object.
In some embodiments, the method further comprises:
performing gesture recognition on the target object, and determining a plurality of bone key points of the target object;
determining a distance between the target object and the display device based on a ratio of a size of the skeletal keypoints to a size of standard skeletal keypoints, the size of the standard skeletal keypoints being indicative of a preset distance between the target object and the display device;
adjusting at least one of a display brightness, a display content size, and a screen resolution of the display screen based on a distance between the target object and the display device.
In another aspect, there is provided a display device adjustment apparatus, the apparatus including:
the device comprises a first determination module, a second determination module and a display module, wherein the first determination module is used for determining an intersection point of a sight line of a target object and a display screen of display equipment based on a plurality of face key points of the target object;
the first adjusting module is used for adjusting the height of the display equipment based on the vertical distance between the intersection point and the central point of the display screen, so that the central point of the display screen and the intersection point are positioned at the same horizontal height;
and the second adjusting module is used for adjusting the orientation of the display equipment based on the included angle between the sight line and the perpendicular bisector of the central point on the basis of the included angle between the sight line and the perpendicular bisector, so that the included angle between the sight line and the perpendicular bisector is smaller than an angle threshold value.
In some embodiments, the first adjusting module is configured to adjust the display device in a first adjusting manner if the vertical distance is not greater than a distance threshold, where the first adjusting manner is used to instruct to adjust the height of the display device in a first speed.
In some embodiments, the first adjusting module is configured to, if the vertical distance is greater than the distance threshold, display a prompt message on the display screen, the prompt message being configured to prompt the target object to suspend using the display device, and adjust a height of the display device for the target object; responding to the confirmation operation of the target object on the prompt message, and adjusting the display equipment by adopting a second adjusting mode, wherein the second adjusting mode is used for indicating that the height of the display equipment is adjusted through a second speed under the condition that the target object suspends the use of the display equipment, and the second speed is greater than the first speed.
In some embodiments, the first adjusting module is configured to horizontally adjust the display device based on a horizontal distance between the intersection point and a center point of the display screen, so that the intersection point is located at the center point of the display screen.
In some embodiments, the second adjusting module is configured to determine, based on a plurality of face key points of the target object, an included angle between a line of sight of the target object and a plane where the display screen is located; and adjusting the pitching angle of the display equipment based on the included angle between the sight line of the target object and the plane where the display screen is located, so that the sight line of the target object is perpendicular to the plane where the display screen is located.
In some embodiments, the apparatus further comprises:
and the second determining module is used for carrying out face recognition on the target object and determining a plurality of face key points of the target object.
In some embodiments, the apparatus further comprises:
the third determination module is used for carrying out gesture recognition on the target object and determining a plurality of bone key points of the target object;
a fourth determining module, configured to determine a distance between the target object and the display device based on a ratio of a size of the bone keypoint to a size of a standard bone keypoint, where the size of the standard bone keypoint is used to indicate a preset distance between the target object and the display device;
and the third adjusting module is used for adjusting at least one of the display brightness, the display content size and the screen resolution of the display screen based on the distance between the target object and the display equipment.
In another aspect, a terminal is provided, the terminal includes a processor and a memory, the memory stores at least one computer program, and the at least one computer program is loaded and executed by the processor to implement the display device adjustment method according to the above aspect.
In another aspect, there is provided a computer-readable storage medium having at least one computer program stored therein, the at least one computer program being loaded and executed by a processor to implement the display apparatus adjustment method according to the above aspect.
In another aspect, a computer program product is provided, comprising a computer program, which is loaded and executed by a processor, to implement the display device adjustment method according to the above aspect.
The embodiment of the application provides a display device adjusting scheme, and the direction of the sight line of a target object and the intersection point of the sight line of the target object and a display screen of a display device can be determined through a plurality of face key points of the target object. And adjusting the height of the display equipment according to the distance between the intersection point and the central point of the display screen in the vertical direction, so that the intersection point of the central point of the display screen and the sight line on the display screen is positioned at the same horizontal height. Under the condition that the display screen is not over against the target object, the perpendicular bisector of the display screen at the central point and the sight of the target object form a certain included angle, the orientation of the display device is adjusted based on the included angle, the included angle between the sight and the perpendicular bisector can be smaller than an angle threshold value, and therefore the display screen is adjusted to be over against the orientation of the target object. Therefore, the height and the orientation of the display device are adjusted through the plurality of face key points of the target object, the position and the angle of the display device can be automatically adjusted according to the sight of the user, manual adjustment of the user is not needed, and the adjustment efficiency is improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the description below are only some embodiments of the present application, and it is obvious for those skilled in the art that other drawings may be obtained according to the drawings without creative efforts.
FIG. 1 is a schematic diagram of an implementation environment provided by an embodiment of the present application;
fig. 2 is a flowchart of a display device adjustment method according to an embodiment of the present disclosure;
fig. 3 is a flowchart of another display device adjustment method provided in an embodiment of the present application;
fig. 4 is a schematic diagram of a display device provided in an embodiment of the present application;
fig. 5 is a schematic structural diagram of an adjusting apparatus of a display device according to an embodiment of the present disclosure;
fig. 6 is a schematic structural diagram of another adjustment apparatus for a display device according to an embodiment of the present disclosure;
fig. 7 is a schematic structural diagram of a terminal according to an embodiment of the present application.
Detailed Description
To make the objects, technical solutions and advantages of the embodiments of the present application more clear, the embodiments of the present application will be further described in detail with reference to the accompanying drawings.
The terms "first," "second," and the like in this application are used for distinguishing between similar items and items that have substantially the same function or similar functionality, and it should be understood that "first," "second," and "nth" do not have any logical or temporal dependency or limitation on the number or order of execution.
The term "at least one" in this application means one or more, and the meaning of "a plurality" means two or more.
It should be noted that information (including but not limited to user equipment information, user personal information, etc.), data (including but not limited to data for analysis, stored data, presented data, etc.), and signals referred to in this application are authorized by the user or sufficiently authorized by various parties, and the collection, use, and processing of the relevant data is required to comply with relevant laws and regulations and standards in relevant countries and regions. For example, a plurality of face key points of the target object referred to in the present application are obtained under sufficient authorization.
Fig. 1 is a schematic diagram of an implementation environment provided in an embodiment of the present application, and referring to fig. 1, the implementation environment includes: a display device 101, a photographing device 102, and a three-axis rotating stand 103.
The display device 101 and the photographing device 102 can be directly or indirectly connected through wired or wireless communication, and the present application is not limited thereto.
In some embodiments, the display device 101 is a desktop computer with a display screen, a laptop computer, a tablet computer, a smart phone, a smart voice interaction device, and a Virtual Reality device such as VR (Virtual Reality), AR (Augmented Reality), and the like, but is not limited thereto. The display apparatus 101 is installed and operated with an application program supporting adjustment of the display apparatus 101. Illustratively, by using the application program, the height of the display apparatus 101 can be automatically adjusted based on the line of sight of the user.
In some embodiments, the display device 101 is configured with a three-axis rotating mount 103. The adjustment direction of the three-axis rotating bracket 103 includes three axial directions of an X axis, a Y axis, and a Z axis, and can provide multi-dimensional adjustment of height, orientation, and pitch for the display apparatus 101.
In some embodiments, the photographing apparatus 102 is an apparatus having a photographing function, such as a camera, a still camera, a video camera, and a 3D motion sensing camera. The photographing device 102 is used for performing face recognition and gesture recognition on the user, and determining a plurality of face key points and a plurality of bone key points of the user, thereby determining the sight line of the user and the distance between the user and the display device 101. Illustratively, an application installed on the display device 101 can determine the height, orientation and pitch angle of the display device 101 to be adjusted based on the user's line of sight determined by the photographing device 102, so as to control the three-axis rotating bracket 103 to make corresponding adjustments to the display device 101.
In some embodiments, the implementation environment further includes a server. The server is an independent physical server, may be a server cluster or a distributed system formed by a plurality of physical servers, and may be a cloud server providing basic cloud computing services such as a cloud service, a cloud database, cloud computing, a cloud function, cloud storage, a web service, cloud communication, middleware service, a domain name service, a security service, a CDN (Content Delivery Network), a big data and artificial intelligence platform, and the like. The server is used for providing background services for the application program. In some embodiments, the server undertakes primary computing work and the display device 101 undertakes secondary computing work; or, the server undertakes the secondary computing work, and the display device 101 undertakes the primary computing work; alternatively, the server and the display device 101 perform cooperative computing by using a distributed computing architecture.
Those skilled in the art will appreciate that the number of display devices described above may be greater or fewer. For example, the number of the display devices may be only one, or the number of the display devices may be several tens or hundreds, or more. The number and the type of the display devices are not limited in the embodiments of the present application.
Fig. 2 is a flowchart of a display device adjustment method provided in an embodiment of the present application, where the display device is executed by a display device, and the display device may be a terminal or a device externally connected to the terminal and used for displaying an image. Referring to fig. 2, the method includes:
201. based on the plurality of face key points of the target object, an intersection point of the sight line of the target object and a display screen of the display device is determined.
In the embodiment of the present application, the target object is a user using a display device. The display device is mounted with a display screen and a photographing device. The photographing apparatus is capable of capturing face information of a target object in real time while the target object views a display screen of the display apparatus to determine a plurality of face key points of the target object. The key points of the human face comprise key points such as eyebrows, eyes, pupils, a nose, a mouth and the like.
Based on a plurality of face key points captured by the shooting equipment, the movement direction of the pupil key point of the target object relative to other face key points can be determined, namely, the eye movement direction of the target object is determined, and then the sight line direction of the target object is determined. Under the condition that a target object watches a certain position of a display screen for a long time, a pixel point corresponding to the sight direction on the display screen can be determined according to the sight direction of the target object, and the pixel point is used as the intersection point of the sight of the target object and the display screen.
202. And adjusting the height of the display device based on the vertical distance between the intersection point and the central point of the display screen, so that the central point of the display screen and the intersection point are positioned at the same horizontal height.
In the embodiment of the application, based on the size of the display screen, a pixel point located in the center of the display screen can be determined, and the pixel point is used as the center point of the display screen. If the pixel point corresponding to the central point of the display screen and the pixel point corresponding to the intersection point have a certain distance in the vertical direction, the height of the display device does not accord with the optimal viewing height of the target object, and the height of the display device needs to be adjusted. Among them, the optimum viewing height is a height at which a user does not easily feel tired when viewing the display screen. The optimal viewing height can be set empirically at the time of shipment of the display device, or can be set by a user as desired.
In the embodiment of the application, the display device is provided with a three-axis rotating bracket. This triaxial rotating bracket can support and adjust in three different axial to for display device provides height, orientation and pitch's multidimension degree adjustment. And the distance between the pixel point corresponding to the central point of the display screen and the pixel point corresponding to the intersection point in the vertical direction is used as the vertical distance between the intersection point and the central point of the display screen by the display equipment. The height of the display device is adjusted in the vertical direction by controlling the three-axis rotating support based on the vertical distance until the central point and the intersection point of the display screen are located at the same horizontal height, at the moment, the vertical distance is 0, and the height of the display device accords with the optimal viewing height of the target object.
203. Based on an angle between the line of sight and a perpendicular bisector of the display screen at the center point, an orientation of the display device is adjusted such that the angle between the line of sight and the perpendicular bisector is less than an angle threshold.
In the embodiment of the application, the perpendicular bisector of the display screen at the central point is perpendicular to the plane of the display screen, and can reflect the orientation of the display screen. In the case where the line of sight of the target object is at an angle to the perpendicular bisector, the display screen is not oriented directly over the target object. The display device adjusts the orientation of the display device by controlling the three-axis rotating support based on the included angle between the sight line of the target object and the perpendicular bisector until the included angle between the sight line of the target object and the perpendicular bisector is smaller than an angle threshold value, and at the moment, the orientation of the display screen is over against the target object. The angle threshold may be a preset angle, such as 5 °, 7 °, or 10 °, and the angle threshold is not limited in the embodiment of the present application.
The embodiment of the application provides a display device adjusting method, which can determine the direction of the sight line of a target object and the intersection point of the sight line of the target object and a display screen of a display device through a plurality of face key points of the target object. The height of the display device is adjusted according to the distance between the intersection point and the center point of the display screen in the vertical direction, so that the intersection point of the center point of the display screen and the sight line on the display screen can be positioned at the same horizontal height. Under the condition that the display screen is not over against the target object, the perpendicular bisector of the display screen at the central point and the sight line of the target object form a certain included angle, the orientation of the display device is adjusted based on the included angle, the included angle between the sight line and the perpendicular bisector can be smaller than an angle threshold value, and therefore the display screen is adjusted to be over against the orientation of the target object. Therefore, the height and the orientation of the display device are adjusted through the plurality of face key points of the target object, the position and the angle of the display device can be automatically adjusted according to the sight of the user, manual adjustment of the user is not needed, and the adjustment efficiency is improved.
Fig. 3 is a flowchart of another display device adjustment method provided in the embodiment of the present application, where the display device is executed by a display device, and the display device may be a terminal or a device externally connected to the terminal and used for displaying an image. Referring to fig. 3, the method includes:
301. and carrying out face recognition on the target object, and determining a plurality of face key points of the target object.
In the embodiment of the present application, the target object is a user using a display device. The display device is mounted with a display screen and a photographing device. The photographing apparatus is capable of capturing face information of a target object in real time while the target object views a display screen of the display apparatus to determine a plurality of face key points of the target object. The key points of the human face comprise key points such as eyebrows, eyes, pupils, a nose, a mouth and the like.
In some embodiments, the display device is capable of determining a plurality of face keypoints for the target object based on facial information of the target object by means of a face recognition model. Correspondingly, based on the face recognition model, face key point recognition is carried out on the face information of the target object captured by the shooting equipment, and a plurality of face key points of eyebrows, eyes, pupils, noses, mouths and the like of the target object are determined. The face recognition model is used for determining a plurality of face key points of the target object and the position of each face key point based on the input face information of the target object. The face recognition model has the autonomous learning capability, namely the more the face recognition times of the face recognition model are, the stronger the autonomous learning capability of the model is, and further the face key points obtained based on the face information are more accurate, so that the positions of the plurality of face key points and each face key point of the target object can be more accurately determined.
302. Based on the plurality of face key points of the target object, an intersection point of the sight line of the target object and a display screen of the display device is determined.
In the embodiment of the application, based on a plurality of face key points of a target object and the position of each face key point, the movement direction of a pupil key point of the target object relative to other face key points can be determined, that is, the eye movement direction of the target object is determined, and then the sight line direction of the target object is determined. Under the condition that a target object watches a certain position of a display screen for a long time, a pixel point corresponding to the sight direction on the display screen can be determined according to the sight direction of the target object, and the pixel point is used as the intersection point of the sight of the target object and the display screen.
In some embodiments, the capture device is an infrared-enabled camera. The shooting device can project controllable infrared light spots, infrared rays or infrared light surfaces to the target object through the infrared light source so as to collect a reflected image of the target object on the projected infrared light. And then, based on the collected reflection image and the positions of a plurality of key points of the human face, the reflection of infrared light on the key points of the pupil of the target object is identified, and the eye movement direction of the target object is determined. Based on the moving direction of the eye movement direction of the target object relative to the key points of other human faces, the sight line direction of the target object can be determined.
303. And adjusting the height of the display device based on the vertical distance between the intersection point and the central point of the display screen, so that the central point of the display screen and the intersection point are positioned at the same horizontal height.
In the embodiment of the application, based on the size of the display screen, a pixel point located in the center of the display screen can be determined, and the pixel point is used as the center point of the display screen. If the pixel point corresponding to the central point of the display screen and the pixel point corresponding to the intersection point have a certain distance in the vertical direction, the height of the display device does not accord with the optimal viewing height of the target object, and the height of the display device needs to be adjusted. The optimal viewing height is a height at which a user is not easily tired when viewing a display screen. The optimal viewing height can be set empirically at the time of shipment of the display device, or can be set by the user as desired.
In the embodiment of the application, the display device is provided with a three-axis rotating bracket. This triaxial rotating bracket can support and adjust in three different axial to for display device provides height, orientation and pitch's multidimension degree adjustment. And the distance between the pixel point corresponding to the central point of the display screen and the pixel point corresponding to the intersection point in the vertical direction is used as the vertical distance between the intersection point and the central point of the display screen by the display equipment. The height of the display equipment is adjusted in the vertical direction by controlling the three-axis rotating support based on the vertical distance until the central point and the intersection point of the display screen are positioned at the same horizontal height, at the moment, the vertical distance is 0, and the height of the display equipment accords with the optimal viewing height of the target object.
In some embodiments, the display device is mounted with a telescopic, adjustable angle joystick. As shown in fig. 4, the display device 401 can determine an intersection point of the line of sight of the target object and the display screen based on the facial information of the target object collected by the photographing device 402, and adjust the height of the display device by controlling the joystick 403 with a telescopic adjustable angle according to the vertical distance between the intersection point and the center point of the display screen, so that the center point of the display screen and the intersection point are located at the same horizontal height.
It should be noted that the display device can be adjusted by the following two adjustment methods based on the vertical distance between the intersection point and the center point of the display screen.
In the first mode, under the condition that the vertical distance is not greater than the distance threshold, the adjustment range of the display device is small, so that the display device is adjusted by adopting a first adjustment mode. The distance threshold may be a preset distance, such as 3 cm, 5 cm, or 7 cm, and the distance threshold is not limited in this embodiment. The first adjustment mode is used for indicating that the height of the display device is adjusted at a first speed. Wherein the first speed is the slower speed. Correspondingly, the display device controls the three-axis rotating support to slowly fine adjust the height of the display device in a first adjusting mode, the central point of the display screen can be adjusted to be located at the same horizontal height with the intersection point under the condition that a target user uses the display device, the vertical distance is 0 at the moment, and the height of the display device accords with the optimal viewing height of a target object.
In the second mode, when the vertical distance is greater than the distance threshold, the adjustment range of the display device is large, and therefore the height of the display device needs to be adjusted at a high speed when the target object stops using the display device, so that the adjustment efficiency is improved. Accordingly, in the case where the vertical distance is greater than the distance threshold, a prompt message is displayed on the display screen. The prompt information is used for prompting the target object to suspend using the display device, and the height of the display device is adjusted for the target object at a higher speed. Responding to the confirmation operation of the target object on the prompt message, the display device controls the three-axis rotating support to adjust the display device in a second adjusting mode, wherein the second adjusting mode is used for indicating that the height of the display device is adjusted at a second speed under the condition that the target object stops using the display device until the central point and the intersection point of the display screen are located at the same horizontal height, the vertical distance is 0, and the height of the display device accords with the optimal viewing height of the target object. The second speed is a faster speed, and the second speed is greater than the first speed.
In some embodiments, the display device can also be horizontally adjusted. If the pixel point corresponding to the central point of the display screen and the pixel point corresponding to the intersection point have a certain distance in the horizontal direction, the sight of the target object does not face the central point of the display screen, so that the display device is adjusted in the horizontal direction. And the distance between the pixel point corresponding to the central point of the display screen and the pixel point corresponding to the intersection point in the horizontal direction is used as the horizontal distance between the intersection point and the central point of the display screen by the display equipment. The display device controls the three-axis rotating support to horizontally adjust the display device based on the horizontal distance between the intersection point and the central point of the display screen until the intersection point is located at the central point of the display screen, at the moment, the horizontal distance is 0, the central point of the display device is over against the sight of the target object, and the target object is not easy to feel tired even if the display screen is watched for a long time.
304. Based on an included angle between the sight line and the perpendicular bisector of the display screen at the center point, the orientation of the display device is adjusted so that the included angle between the sight line and the perpendicular bisector is smaller than an angle threshold.
In the embodiment of the application, the perpendicular bisector of the display screen at the central point is perpendicular to the plane of the display screen, and can reflect the orientation of the display screen. In the case where the line of sight of the target object is at an angle to the perpendicular bisector, the display screen is not oriented directly over the target object. The display device adjusts the orientation of the display device by controlling the three-axis rotating support based on the included angle between the sight line of the target object and the perpendicular bisector until the included angle between the sight line of the target object and the perpendicular bisector is smaller than an angle threshold value, and at the moment, the orientation of the display screen is over against the target object. The angle threshold may be a preset angle, such as 5 °, 7 °, or 10 °, and the angle threshold is not limited in the embodiment of the present application.
In some embodiments, the pitch angle of the display device can be adjusted based on the line of sight of the target object. The display device determines a gaze direction of the target object based on the plurality of face key points of the target object. Under the condition that the target object watches a certain position of the display screen, the included angle between the sight line of the target object and the plane where the display screen is located can be determined according to the sight line direction of the target object and the plane where the display screen is located. In the case where the angle is not 90 °, the pitch angle of the display screen does not conform to the optimal viewing angle of the user, and the user may easily feel tired when viewing the display screen at the non-optimal viewing angle. Therefore, the pitch angle of the display device needs to be adjusted based on the included angle between the line of sight of the target object and the plane where the display screen is located, so that the line of sight of the target object is perpendicular to the plane where the display screen is located, at this time, the pitch angle of the display screen meets the optimal viewing angle of the user, and when the user views the display screen through the optimal viewing angle, fatigue is not easy to generate.
In some embodiments, the parameters of the display screen can be adjusted based on the distance between the target object and the display device. The shooting device can determine a plurality of skeletal key points of the target object by performing posture recognition on the target object. The display device determines a distance between the target object and the display device based on a ratio of a size of a skeletal keypoint of the target object to a size of a standard skeletal keypoint, the size of the standard skeletal keypoint being used to indicate a preset distance between the target object and the display device. The preset distance is a distance which is not easy to generate fatigue when a user watches the display screen. The preset distance may be set according to experience when the display device leaves a factory, or may be set by a user according to a requirement. At least one of a display brightness, a display content size, and a screen resolution of the display screen is adjusted based on a distance between the target object and the display device.
For example, if the distance between the target object and the display device is greater than the preset distance and the distance between the target object and the display device is greater, the content displayed on the display screen is increased; under the condition that the distance between the target object and the display equipment is smaller than the preset distance, the distance between the target object and the display equipment is smaller, the display brightness of the display screen is adjusted to be low, and visual fatigue caused when the target object watches the brighter display screen for a long time is avoided.
In some embodiments, the display device can detect the fatigue degree of the target object based on the face key points or the bone key points acquired by the photographing device. And further, according to the fatigue degree of the target object, the display device is adjusted to reduce the fatigue feeling of the target object. For example, the degree of fatigue of the target object is high when the size of the eye key point of the target object is smaller than a preset size, or the degree of similarity between the bone key point of the target object and the corresponding bone key point in the fatigue state is high. The preset size is the size of the eye key point when the target object is in a non-fatigue state. Accordingly, the display device adjusts the content displayed on the display screen to be larger, or adjusts the brightness of the display screen to be higher, or adjusts the distance between the display device and the target object to be smaller. The target object can be enabled to more clearly view the content of the display screen, thereby alleviating the fatigue feeling of the target object to some extent.
The embodiment of the application provides a display device adjusting method, which can determine the direction of the sight line of a target object and the intersection point of the sight line of the target object and a display screen of a display device through a plurality of face key points of the target object. And adjusting the height of the display equipment according to the distance between the intersection point and the central point of the display screen in the vertical direction, so that the intersection point of the central point of the display screen and the sight line on the display screen is positioned at the same horizontal height. Under the condition that the display screen is not over against the target object, the perpendicular bisector of the display screen at the central point and the sight line of the target object form a certain included angle, the orientation of the display device is adjusted based on the included angle, the included angle between the sight line and the perpendicular bisector can be smaller than an angle threshold value, and therefore the display screen is adjusted to be over against the orientation of the target object. Therefore, the height and the orientation of the display device are adjusted through the plurality of face key points of the target object, the position and the angle of the display device can be automatically adjusted according to the sight of the user, manual adjustment of the user is not needed, and the adjustment efficiency is improved.
Fig. 5 is a schematic structural diagram of an adjusting apparatus for a display device according to an embodiment of the present application. Referring to fig. 5, the apparatus includes: a first determination module 501, a first adjustment module 502, and a second adjustment module 503.
A first determining module 501, configured to determine, based on a plurality of face key points of a target object, an intersection point between a line of sight of the target object and a display screen of a display device;
a first adjusting module 502, configured to adjust a height of the display device based on a vertical distance between the intersection point and a center point of the display screen, so that the center point of the display screen and the intersection point are located at the same horizontal height;
the second adjusting module 503 is configured to adjust an orientation of the display device based on an angle between the line of sight and the perpendicular bisector of the display screen at the center point, so that the angle between the line of sight and the perpendicular bisector is smaller than an angle threshold.
In some embodiments, the first adjusting module 502 is configured to adjust the display device in a first adjusting manner if the vertical distance is not greater than the distance threshold, where the first adjusting manner is used to instruct to adjust the height of the display device in a first speed.
In some embodiments, the first adjusting module 502 is configured to display a prompt message on the display screen if the vertical distance is greater than the distance threshold, where the prompt message is used to prompt the target object to suspend using the display device, and the height of the display device is to be adjusted for the target object; and in response to the confirmation operation of the target object on the prompt message, adjusting the display device by adopting a second adjustment mode, wherein the second adjustment mode is used for indicating that the height of the display device is adjusted by a second speed under the condition that the target object suspends the use of the display device, and the second speed is greater than the first speed.
In some embodiments, the first adjusting module 502 is configured to horizontally adjust the display device based on a horizontal distance between the intersection point and a center point of the display screen, so that the intersection point is located at the center point of the display screen.
In some embodiments, the second adjusting module 503 is configured to determine an included angle between a line of sight of the target object and a plane where the display screen is located, based on a plurality of face key points of the target object; and adjusting the pitching angle of the display equipment based on the included angle between the sight line of the target object and the plane where the display screen is located, so that the sight line of the target object is perpendicular to the plane where the display screen is located.
In some embodiments, fig. 6 is a schematic structural diagram of another display device adjustment apparatus provided in an embodiment of the present application, and as shown in fig. 6, the apparatus further includes:
a second determining module 504, configured to perform face recognition on the target object, and determine a plurality of face key points of the target object.
In some embodiments, as shown in fig. 6, the apparatus further comprises:
the third determining module 505 is configured to perform gesture recognition on the target object, and determine a plurality of bone key points of the target object;
a fourth determining module 506, configured to determine a distance between the target object and the display device based on a ratio of a size of the skeletal keypoint to a size of a standard skeletal keypoint, where the size of the standard skeletal keypoint is used to indicate a preset distance between the target object and the display device;
a third adjusting module 507, configured to adjust at least one of a display brightness, a display content size, and a screen resolution of the display screen based on a distance between the target object and the display device.
The embodiment of the application provides a display device adjusting device, which can determine the direction of the sight line of a target object and the intersection point of the sight line of the target object and a display screen of a display device through a plurality of face key points of the target object. The height of the display device is adjusted according to the distance between the intersection point and the center point of the display screen in the vertical direction, so that the intersection point of the center point of the display screen and the sight line on the display screen can be positioned at the same horizontal height. Under the condition that the display screen is not over against the target object, the perpendicular bisector of the display screen at the central point and the sight line of the target object form a certain included angle, the orientation of the display device is adjusted based on the included angle, the included angle between the sight line and the perpendicular bisector can be smaller than an angle threshold value, and therefore the display screen is adjusted to be over against the orientation of the target object. Therefore, the height and the orientation of the display device are adjusted through the plurality of face key points of the target object, the position and the angle of the display device can be automatically adjusted according to the sight of the user, manual adjustment of the user is not needed, and the adjustment efficiency is improved.
It should be noted that: the display device adjusting apparatus provided in the foregoing embodiment is only illustrated by dividing each of the functional modules, and in practical applications, the above functions may be distributed by different functional modules according to needs, that is, the internal structure of the terminal is divided into different functional modules to complete all or part of the above described functions. In addition, the display device adjusting apparatus and the display device adjusting method provided by the above embodiments belong to the same concept, and specific implementation processes thereof are detailed in the method embodiments and are not described herein again.
The embodiment of the present application further provides a terminal, where the terminal includes a processor and a memory, where the memory stores at least one computer program, and the at least one computer program is loaded and executed by the processor, so as to implement the display device adjustment method according to the embodiment.
Fig. 7 is a schematic structural diagram of a terminal according to an embodiment of the present application.
The terminal 700 includes: a processor 701 and a memory 702.
The processor 701 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and so on. The processor 701 may be implemented in at least one hardware form of a DSP (Digital Signal Processing), an FPGA (Field Programmable Gate Array), and a PLA (Programmable Logic Array). The processor 701 may also include a main processor and a coprocessor, where the main processor is a processor for Processing data in an awake state, and is also called a Central Processing Unit (CPU); a coprocessor is a low power processor for processing data in a standby state. In some embodiments, the processor 701 may be integrated with a GPU (Graphics Processing Unit, image Processing interactor) that is responsible for rendering and drawing content that a display screen needs to display. In some embodiments, the processor 701 may further include an AI (Artificial Intelligence) processor for processing computing operations related to machine learning.
In some embodiments, the terminal 700 may further optionally include: a peripheral interface 703 and at least one peripheral. The processor 701, the memory 702, and the peripheral interface 703 may be connected by buses or signal lines. Various peripheral devices may be connected to the peripheral interface 703 via a bus, signal line, or circuit board. Optionally, the peripheral device comprises: at least one of a radio frequency circuit 704, a display screen 705, a camera assembly 706, an audio circuit 707, and a power supply 708.
The peripheral interface 703 may be used to connect at least one peripheral related to I/O (Input/Output) to the processor 701 and the memory 702. In some embodiments, processor 701, memory 702, and peripheral interface 703 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 701, the memory 702, and the peripheral interface 703 may be implemented on a separate chip or circuit board, which is not limited in this embodiment.
The Radio Frequency circuit 704 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuitry 704 communicates with communication networks and other communication devices via electromagnetic signals. The rf circuit 704 converts an electrical signal into an electromagnetic signal to transmit, or converts a received electromagnetic signal into an electrical signal. Optionally, the radio frequency circuit 704 comprises: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a subscriber identity module card, and so forth. The radio frequency circuitry 704 may communicate with other devices via at least one wireless communication protocol. The wireless communication protocols include, but are not limited to: metropolitan area networks, various generation mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks, and/or WiFi (Wireless Fidelity) networks. In some embodiments, the radio frequency circuit 704 may also include NFC (Near Field Communication) related circuits, which are not limited in this application.
The display screen 705 is used to display a UI (User Interface). The UI may include graphics, text, icons, video, and any combination thereof. When the display screen 705 is a touch display screen, the display screen 705 also has the ability to capture touch signals on or above the surface of the display screen 705. The touch signal may be input to the processor 701 as a control signal for processing. At this point, the display 705 may also be used to provide virtual buttons and/or a virtual keyboard, also referred to as soft buttons and/or a soft keyboard. In some embodiments, the display 705 may be one, disposed on a front panel of the terminal 700; in other embodiments, the display 705 can be at least two, respectively disposed on different surfaces of the terminal 700 or in a folded design; in other embodiments, the display 705 may be a flexible display disposed on a curved surface or a folded surface of the terminal 700. Even more, the display 705 may be arranged in a non-rectangular irregular pattern, i.e. a shaped screen. The Display 705 may be made of LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode), or the like.
The camera assembly 706 is used to capture images or video. Optionally, camera assembly 706 includes a front camera and a rear camera. The front camera is disposed at a front panel of the terminal 700, and the rear camera is disposed at a rear surface of the terminal 700. In some embodiments, the number of the rear cameras is at least two, and each rear camera is any one of a main camera, a depth-of-field camera, a wide-angle camera and a telephoto camera, so that the main camera and the depth-of-field camera are fused to realize a background blurring function, and the main camera and the wide-angle camera are fused to realize panoramic shooting and VR (Virtual Reality) shooting functions or other fusion shooting functions. In some embodiments, camera assembly 706 may also include a flash. The flash lamp can be a single-color temperature flash lamp or a double-color temperature flash lamp. The double-color-temperature flash lamp is a combination of a warm-light flash lamp and a cold-light flash lamp, and can be used for light compensation at different color temperatures.
The audio circuitry 707 may include a microphone and a speaker. The microphone is used for collecting sound waves of a user and the environment, converting the sound waves into electric signals, and inputting the electric signals to the processor 701 for processing or inputting the electric signals to the radio frequency circuit 704 to realize voice communication. For the purpose of stereo sound collection or noise reduction, a plurality of microphones may be provided at different portions of the terminal 700. The microphone may also be an array microphone or an omni-directional pick-up microphone. The speaker is used to convert electrical signals from the processor 701 or the radio frequency circuit 704 into sound waves. The loudspeaker can be a traditional film loudspeaker or a piezoelectric ceramic loudspeaker. When the speaker is a piezoelectric ceramic speaker, the speaker can be used for purposes such as converting an electric signal into a sound wave audible to a human being, or converting an electric signal into a sound wave inaudible to a human being to measure a distance. In some embodiments, the audio circuitry 707 may also include a headphone jack.
The power supply 708 is used to power the various components in the terminal 700. The power source 708 may be alternating current, direct current, disposable batteries, or rechargeable batteries. When power source 708 includes a rechargeable battery, the rechargeable battery may support wired or wireless charging. The rechargeable battery may also be used to support fast charge technology.
In some embodiments, terminal 700 can also include one or more sensors 709. The one or more sensors 709 include, but are not limited to: acceleration sensor 710, gyro sensor 711, pressure sensor 712, optical sensor 713, and proximity sensor 714.
The acceleration sensor 710 may detect the magnitude of acceleration in three coordinate axes of a coordinate system established with the terminal 700. For example, the acceleration sensor 710 may be used to detect components of gravitational acceleration in three coordinate axes. The processor 701 may control the display screen 705 to display the user interface in a landscape view or a portrait view according to the gravitational acceleration signal collected by the acceleration sensor 710. The acceleration sensor 710 may also be used for acquisition of motion data of a game or a user.
The gyro sensor 711 may detect a body direction and a rotation angle of the terminal 700, and the gyro sensor 711 may cooperate with the acceleration sensor 710 to collect a 3D motion of the user on the terminal 700. The processor 701 may implement the following functions according to the data collected by the gyro sensor 711: motion sensing (such as changing the UI according to a user's tilting operation), image stabilization while shooting, game control, and inertial navigation.
Pressure sensor 712 may be disposed on a side bezel of terminal 700 and/or underlying display 705. When the pressure sensor 712 is disposed on the side frame of the terminal 700, a user's holding signal of the terminal 700 can be detected, and the processor 701 performs left-right hand recognition or shortcut operation according to the holding signal collected by the pressure sensor 712. When the pressure sensor 712 is disposed at the lower layer of the display 705, the processor 701 controls the operability control on the UI interface according to the pressure operation of the user on the display 705. The operability control comprises at least one of a button control, a scroll bar control, an icon control and a menu control.
The optical sensor 713 is used to collect ambient light intensity. In one embodiment, the processor 701 may control the display brightness of the display screen 705 based on the ambient light intensity collected by the optical sensor 713. Optionally, when the ambient light intensity is higher, the display brightness of the display screen 705 is increased; when the ambient light intensity is low, the display brightness of the display screen 705 is adjusted down. In another embodiment, the processor 701 may also dynamically adjust the shooting parameters of the camera assembly 706 according to the ambient light intensity collected by the optical sensor 713.
A proximity sensor 714, also referred to as a distance sensor, is disposed on a front panel of the terminal 700. The proximity sensor 714 is used to collect a distance between the user and the front surface of the terminal 700. In one embodiment, when the proximity sensor 714 detects that the distance between the user and the front surface of the terminal 700 gradually decreases, the processor 701 controls the display 705 to switch from the bright screen state to the dark screen state; when the proximity sensor 714 detects that the distance between the user and the front surface of the terminal 700 gradually becomes larger, the processor 701 controls the display 705 to switch from the breath screen state to the bright screen state.
Those skilled in the art will appreciate that the configuration shown in fig. 7 is not intended to be limiting of terminal 700 and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components may be used.
An embodiment of the present application further provides a computer-readable storage medium, where at least one computer program is stored in the computer-readable storage medium, and the at least one computer program is loaded and executed by a processor, so as to implement the display device adjustment method provided in the foregoing embodiment.
The embodiment of the present application further provides a computer program product, which includes a computer program, and the computer program is loaded and executed by a processor to implement the display device adjustment method provided in the foregoing embodiment.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, and the program may be stored in a computer-readable storage medium, and the storage medium may be a read-only memory, a magnetic disk or an optical disk.
The above description is only an alternative embodiment of the present application, and is not intended to limit the present application, and any modifications, equivalents, improvements and the like made within the spirit and principle of the present application should be included in the protection scope of the present application.
Claims (10)
1. A method for adjusting a display device, the method comprising:
determining an intersection point of a sight line of a target object and a display screen of display equipment based on a plurality of face key points of the target object;
adjusting the height of the display device based on the vertical distance between the intersection point and the central point of the display screen, so that the central point of the display screen and the intersection point are positioned at the same horizontal height;
based on the sight with the display screen is in the contained angle between the perpendicular bisector of central point department, adjust display device's orientation, so that the contained angle between sight and the perpendicular bisector is less than the angle threshold value.
2. The method of claim 1, wherein the adjusting the height of the display device based on the vertical distance between the intersection point and the center point of the display screen so that the center point of the display screen and the intersection point are located at the same horizontal height comprises:
and under the condition that the vertical distance is not greater than the distance threshold, adjusting the display equipment by adopting a first adjusting mode, wherein the first adjusting mode is used for indicating that the height of the display equipment is adjusted by adopting a first speed.
3. The method of claim 2, further comprising:
displaying prompt information on the display screen when the vertical distance is greater than the distance threshold, wherein the prompt information is used for prompting the target object to suspend using the display device, and the height of the display device is to be adjusted for the target object;
and responding to the confirmation operation of the target object on the prompt message, and adjusting the display equipment by adopting a second adjustment mode, wherein the second adjustment mode is used for indicating that the height of the display equipment is adjusted by a second speed under the condition that the target object suspends the use of the display equipment, and the second speed is greater than the first speed.
4. The method of claim 1, further comprising:
and horizontally adjusting the display equipment based on the horizontal distance between the intersection point and the central point of the display screen, so that the intersection point is positioned at the central point of the display screen.
5. The method of claim 1, further comprising:
determining an included angle between the sight of the target object and a plane where the display screen is located based on the plurality of face key points of the target object;
and adjusting the pitching angle of the display equipment based on the included angle between the sight line of the target object and the plane where the display screen is located, so that the sight line of the target object is perpendicular to the plane where the display screen is located.
6. The method of claim 1, further comprising:
performing gesture recognition on the target object, and determining a plurality of bone key points of the target object;
determining a distance between the target object and the display device based on a ratio of a size of the skeletal keypoints to a size of standard skeletal keypoints, the size of the standard skeletal keypoints being indicative of a preset distance between the target object and the display device;
adjusting at least one of a display brightness, a display content size, and a screen resolution of the display screen based on a distance between the target object and the display device.
7. An apparatus for adjusting a display device, the apparatus comprising:
the device comprises a first determination module, a second determination module and a display module, wherein the first determination module is used for determining an intersection point of a sight line of a target object and a display screen of display equipment based on a plurality of face key points of the target object;
the first adjusting module is used for adjusting the height of the display equipment based on the vertical distance between the intersection point and the central point of the display screen, so that the central point of the display screen and the intersection point are positioned at the same horizontal height;
and the second adjusting module is used for adjusting the orientation of the display equipment based on the included angle between the sight line and the perpendicular bisector of the central point on the basis of the included angle between the sight line and the perpendicular bisector, so that the included angle between the sight line and the perpendicular bisector is smaller than an angle threshold value.
8. A terminal, characterized in that the terminal comprises a processor and a memory, wherein at least one computer program is stored in the memory, and the at least one computer program is loaded and executed by the processor to implement the display device adjustment method according to any one of claims 1 to 6.
9. A computer-readable storage medium, in which at least one computer program is stored, the at least one computer program being loaded and executed by a processor to implement the display device adjustment method according to any one of claims 1 to 6.
10. A computer program product comprising a computer program, wherein the computer program is loaded and executed by a processor to implement a display device adjustment method according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211585270.4A CN115904079A (en) | 2022-12-09 | 2022-12-09 | Display equipment adjusting method, device, terminal and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211585270.4A CN115904079A (en) | 2022-12-09 | 2022-12-09 | Display equipment adjusting method, device, terminal and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115904079A true CN115904079A (en) | 2023-04-04 |
Family
ID=86481350
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211585270.4A Pending CN115904079A (en) | 2022-12-09 | 2022-12-09 | Display equipment adjusting method, device, terminal and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115904079A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117742388A (en) * | 2024-02-07 | 2024-03-22 | 广东海洋大学 | Intelligent control method and system based on reading furniture |
-
2022
- 2022-12-09 CN CN202211585270.4A patent/CN115904079A/en active Pending
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117742388A (en) * | 2024-02-07 | 2024-03-22 | 广东海洋大学 | Intelligent control method and system based on reading furniture |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108499105B (en) | Method, device and storage medium for adjusting visual angle in virtual environment | |
| CN110488977B (en) | Virtual reality display method, device and system and storage medium | |
| CN110992493B (en) | Image processing method, device, electronic equipment and storage medium | |
| CN109712224B (en) | Virtual scene rendering method and device and intelligent device | |
| CN110427110B (en) | Live broadcast method and device and live broadcast server | |
| CN108803896B (en) | Method, device, terminal and storage medium for controlling screen | |
| CN109308205B (en) | Display adaptation method, device, equipment and storage medium of application program | |
| CN111324250B (en) | Three-dimensional image adjusting method, device and equipment and readable storage medium | |
| CN109862412B (en) | Method and device for video co-shooting and storage medium | |
| CN110933452B (en) | Method and device for displaying lovely face gift and storage medium | |
| CN111028144B (en) | Video face changing method and device and storage medium | |
| WO2022134632A1 (en) | Work processing method and apparatus | |
| WO2020151594A1 (en) | Viewing angle rotation method, device, apparatus and storage medium | |
| CN112565806B (en) | Virtual gift giving method, device, computer equipment and medium | |
| CN109634688B (en) | Session interface display method, device, terminal and storage medium | |
| CN108848405B (en) | Image processing method and device | |
| CN110956580A (en) | Image face changing method and device, computer equipment and storage medium | |
| CN110705614A (en) | Model training method and device, electronic equipment and storage medium | |
| WO2022199102A1 (en) | Image processing method and device | |
| CN115904079A (en) | Display equipment adjusting method, device, terminal and storage medium | |
| CN112860046A (en) | Method, apparatus, electronic device and medium for selecting operation mode | |
| CN112967261B (en) | Image fusion method, device, equipment and storage medium | |
| WO2021218926A1 (en) | Image display method and apparatus, and computer device | |
| CN111583375B (en) | Virtual picture display method, device, equipment and storage medium | |
| CN114594885A (en) | Application icon management method, device and equipment and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |