CN114449319B - Video picture dynamic adjustment method and device, intelligent terminal and storage medium - Google Patents
Video picture dynamic adjustment method and device, intelligent terminal and storage medium Download PDFInfo
- Publication number
- CN114449319B CN114449319B CN202011218472.6A CN202011218472A CN114449319B CN 114449319 B CN114449319 B CN 114449319B CN 202011218472 A CN202011218472 A CN 202011218472A CN 114449319 B CN114449319 B CN 114449319B
- Authority
- CN
- China
- Prior art keywords
- user
- remote control
- eyes
- deflection
- determining
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 30
- 235000002194 Pithecellobium dulce Nutrition 0.000 claims description 3
- 235000007891 Pithecellobium lobatum Nutrition 0.000 claims description 3
- 241000596422 Pithecellobium Species 0.000 claims 2
- 235000002673 Dioscorea communis Nutrition 0.000 description 6
- 241000544230 Dioscorea communis Species 0.000 description 6
- 208000035753 Periorbital contusion Diseases 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 230000000694 effects Effects 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 5
- 230000003044 adaptive effect Effects 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000001360 synchronised effect Effects 0.000 description 2
- 244000126010 Pithecellobium dulce Species 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000010411 cooking Methods 0.000 description 1
- 210000000887 face Anatomy 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
- H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
- H04N21/42221—Transmission circuitry, e.g. infrared [IR] or radio frequency [RF]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44213—Monitoring of end-user related data
- H04N21/44218—Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- General Health & Medical Sciences (AREA)
- Theoretical Computer Science (AREA)
- Social Psychology (AREA)
- Health & Medical Sciences (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- User Interface Of Digital Computer (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a video picture dynamic adjustment method, a device, an intelligent terminal and a storage medium, wherein the method comprises the following steps: acquiring deflection direction data of the remote control equipment, and determining the moving direction of the remote control equipment according to the deflection direction data; acquiring direction tracking data of eyes of a user, and determining the direction of viewing lines of eyes of the user according to the direction tracking data; and controlling video picture adjustment according to the moving direction of the remote control device and the direction of the viewing line of human eyes of the user. According to the invention, the video picture is moved according to the moving direction of the remote control device and the viewing line direction of human eyes of the user, so that the video picture can rotate along with the line of sight of the human eyes, the user can be ensured to better see the panoramic video picture, the viewing line direction of the user is ensured to be perpendicular to the video picture of the intelligent terminal, and the picture distortion phenomenon can not occur.
Description
Technical Field
The present invention relates to the field of video frame control technologies, and in particular, to a method and apparatus for dynamically adjusting a video frame, an intelligent terminal, and a storage medium.
Background
Today in technology assisted life, people and various terminal devices such as photocopies have been surrounded in life by devices such as mobile phones, tablets, computers, televisions. At present, many intelligent terminals have video and audio playing functions, but in general, the placement position of the intelligent terminal is fixed and is often placed at a certain height. When a user sits at a position outside the viewing area right in front of the screen level of the intelligent terminal, for example, sits on the floor of a living room, the sight of the user is not vertical to the screen of the intelligent terminal, so that the problems of picture distortion and the like are easily caused, and the viewing quality of the user is seriously influenced. Although the panorama picture effect can be obtained by adjusting the screen angle of the intelligent terminal through the remote controller in the prior art, the user frequently adjusts the screen angle of the intelligent terminal through the remote controller, and the operation is extremely inconvenient.
Accordingly, there is a need for improvement and advancement in the art.
Disclosure of Invention
The invention aims to solve the technical problems that a user cannot conveniently watch a video picture at a position outside a watching area right in front of the screen level of an intelligent terminal in the prior art, and the watching quality is affected.
In order to solve the technical problems, the technical scheme adopted by the invention is as follows:
In a first aspect, the present invention provides a method for dynamically adjusting a video frame, including:
acquiring deflection direction data of the remote control equipment, and determining the moving direction of the remote control equipment according to the deflection direction data;
Acquiring direction tracking data of eyes of a user, and determining the direction of viewing lines of eyes of the user according to the direction tracking data;
And controlling video picture adjustment according to the moving direction of the remote control device and the direction of the viewing line of human eyes of the user.
In a second aspect, an embodiment of the present invention further provides a video frame dynamic mobile device, including:
A moving direction determining unit for acquiring deflection direction data of the remote control device and determining a moving direction of the remote control device according to the deflection direction data;
the video line direction determining unit is used for acquiring direction tracking data of eyes of the user and determining the video line direction of the eyes of the user according to the direction tracking data;
and the video picture adjusting unit is used for controlling video picture adjustment according to the moving direction of the remote control device and the direction of the watching video line of the eyes of the user.
In a third aspect, an embodiment of the present invention further provides an intelligent terminal, where the intelligent terminal includes a memory, a processor, and a video frame dynamic movement program stored in the memory and capable of running on the processor, and the processor implements the method of any one of the above schemes when executing the video frame dynamic movement program.
In a fourth aspect, an embodiment of the present invention further provides a computer readable storage medium, where a video frame dynamic movement program is stored, where the video frame dynamic movement program when executed by a processor implements a method according to any one of the above schemes.
The beneficial effects are that: compared with the prior art, the invention provides a video picture dynamic adjustment method, which comprises the steps of firstly, acquiring deflection direction data of remote control equipment and determining the moving direction of the remote control equipment according to the deflection direction data. Then, the invention obtains the direction tracking data of the eyes of the user, and determines the direction of the video line of the eyes of the user according to the direction tracking data. The determined moving direction of the remote control device can reflect which direction the screen of the intelligent terminal is shifted, and the direction of the viewing line of the eyes of the user can reflect which place the sight of the user is directed. Therefore, the invention can control the video picture adjustment according to the moving direction of the remote control equipment and the viewing line direction of the eyes of the user, thereby controlling the adaptive picture of the intelligent terminal to rotate along with the line of sight of the eyes of the user, ensuring that the user can better see the panoramic video picture, ensuring that the viewing line direction of the user is vertical to the video picture of the intelligent terminal, and avoiding the picture distortion phenomenon.
Drawings
Fig. 1 is a flowchart of a specific implementation of a video picture dynamic adjustment method according to an embodiment of the present invention.
Fig. 2 is a flowchart of a method for obtaining a moving direction of a remote control device in a video frame dynamic adjustment method according to an embodiment of the present invention.
Fig. 3 is a flowchart of a method for dynamically adjusting a video frame according to an embodiment of the present invention to obtain a direction of a viewing line of a user's eyes.
Fig. 4 is a flowchart of controlling video frame adjustment in the video frame dynamic adjustment method according to an embodiment of the present invention.
Fig. 5 is a schematic block diagram of a video picture dynamic mobile device according to an embodiment of the present invention.
Fig. 6 is a schematic block diagram of an internal structure of an intelligent terminal according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and effects of the present invention clearer and more specific, the present invention will be described in further detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
Today in technology assisted life, people and various terminal devices such as photocopies have been surrounded in life by devices such as mobile phones, tablets, computers, televisions. At present, many intelligent terminals have video and audio playing functions, but in general, the placement position of the intelligent terminal is fixed and is often placed at a certain height. When a user sits at a position outside the viewing area right in front of the screen level of the intelligent terminal, for example, sits on the floor of a living room, the sight of the user is not vertical to the screen of the intelligent terminal, so that the problems of picture distortion and the like are easily caused, and the viewing quality of the user is seriously influenced. For example, in the prior art, the intelligent refrigerator is more and more favored by users by virtue of the increasingly mature video entertainment function, and becomes a non-two choice of video entertainment for users during dining and cooking. With the maturity of audio-visual technology, various intelligent large screens including intelligent refrigerator large screens can already carry panoramic video technology, provides better viewing experience for the user. However, under the traditional condition, because the placing positions of the intelligent refrigerator and the dining table of the user often need to lift the head to watch the large screen of the intelligent refrigerator when the user eats, the sight of the user cannot be perpendicular to the large screen of the intelligent refrigerator, and the watching quality of the user is seriously affected. Although the panorama picture effect can be obtained by adjusting the screen angle of the intelligent terminal through the remote controller in the prior art, the user frequently adjusts the screen angle of the intelligent terminal through the remote controller, and the operation is extremely inconvenient.
In order to solve the problems in the prior art, when the embodiment is implemented, the embodiment firstly obtains deflection direction data of the remote control device and determines the moving direction of the remote control device according to the deflection direction data. Then, the embodiment obtains the direction tracking data of the eyes of the user, and determines the direction of the video line of the eyes of the user according to the direction tracking data. The determined moving direction of the remote control device can reflect which offset the screen of the intelligent terminal is towards, and also reflect that the viewing direction of the user is deviated from the forward direction of the screen of the intelligent terminal at the moment, so that the direction of the remote control needs to be changed. The direction of the viewing line of the eyes of the user can reflect which place the user is looking at. Therefore, the embodiment can control the adjustment of the video picture according to the moving direction of the remote control device and the direction of the viewing line of the eyes of the user, thereby controlling the adaptive picture of the intelligent terminal to rotate along with the line of sight of the eyes, ensuring that the user can better see the panoramic video picture, ensuring that the direction of the viewing line of the user is perpendicular to the video picture of the intelligent terminal, and avoiding the picture distortion.
Exemplary method
The method of the embodiment can be applied to an intelligent terminal, and when being implemented, as shown in fig. 1, the method specifically includes the following steps:
And step S100, the intelligent terminal acquires deflection direction data of the remote control equipment, and determines the moving direction of the remote control equipment according to the deflection direction data.
When the user is at a position other than the viewing position vertically in front of the intelligent terminal, the sight of the user cannot be vertical to the video picture, and the viewing effect is seriously reduced. And because the sight of the user is not right against the screen of the intelligent terminal, the video picture is distorted in the eyes of the user and even unclear due to the problems of inclination of the visual angle, light and the like. In order to solve the above technical problem, the present embodiment needs to control the video frame of the intelligent terminal to move along with the human eyes, so that the user can clearly view the video frame even if sitting at a position deviated from the forward viewing area of the intelligent terminal.
Specifically, when the user is at a position other than the viewing position vertically in front of the smart terminal, the user does not face the forward use of the smart terminal when using the remote control device, but rather deflects the use toward the screen of the smart terminal. For example, when the user is located at the lower side of the screen of the intelligent terminal, the user uses the remote control device to control the intelligent terminal, and the remote control device is used at the upper side (even if the remote control device faces to the upper side), so that the infrared light emitted by the remote control device can be received by the intelligent terminal, and the control of the intelligent terminal is realized. Thus, when the user's direction of use of the remote control device is not vertically facing the smart terminal, it means that the user is not at a viewing position vertically in front of the smart terminal at this time. Therefore, the deflection direction data of the remote control device can be acquired at this time, so that the direction of the remote control device can be determined according to the deflection direction data of the remote control device, and the movement of the video picture on the intelligent terminal can be controlled according to the direction of the remote control device.
In one implementation, as shown in fig. 2, the step S100 specifically includes:
step S101, an intelligent terminal acquires gyroscope motion data of a gyroscope in remote control equipment;
Step S102, the intelligent terminal determines deflection direction data of the remote control equipment according to the gyroscope motion data;
step S103, the intelligent terminal obtains the first times of the deflection direction data of the remote control equipment in the first preset time period, and determines the moving direction of the remote control equipment according to the first times.
In specific implementation, the intelligent terminal of the embodiment is realized based on the gyroscope in the remote control device when acquiring the deflection direction data of the remote control device. When the remote control device deflects in direction during use, the gyroscope in the remote control device generates gyroscope motion data, and the gyroscope motion data can reflect the deflection direction data of the remote control device to a certain extent, so that the moving direction of the remote control device can be reflected. For example, when the gyroscope motion data is deflected upward to the right and is within the interval of 90 ° -180 °, then it can be determined that the deflection direction data of the remote control device is deflected upward. When the gyroscope motion data are deflected to the upper left and are located in the range of 0-90 degrees, the deflection direction data of the remote control device can be determined to be deflected upwards. When the gyroscope motion data are deflected leftwards and downwards and are located in the range of 180-270 degrees, the deflection direction data of the remote control equipment can be determined to be deflected downwards. When the gyroscope motion data are deflected downwards to the right and are located in the interval of 270-360 degrees, the deflection direction data of the remote control equipment can be determined to be deflected downwards at the moment. It can be seen that the deflection direction data of the remote control device in this embodiment includes the upward deflection of the remote control device and the downward deflection of the remote control device.
The remote control device can be used for controlling the intelligent terminal for a plurality of times when a user watches the video picture. Therefore, in order to accurately determine the moving direction of the remote control device, the present embodiment obtains the first number of times when the remote control device generates the deflection direction data in the first preset time period, and determines the moving direction of the remote control device according to the first number of times. For example, the present embodiment acquires the number of times the remote control device has been deflected upward and the number of times the remote control device has been deflected downward in 1S, and then uses the deflection direction data of the number of times as the true moving direction of the remote control device. Specifically, the embodiment obtains the number of times of upward deflection of the remote control device and the number of times of downward deflection of the remote control device in a first preset time period respectively, and takes the number of times of upward deflection of the remote control device and the number of times of downward deflection of the remote control device as the first number of times. In one implementation, if the number of times the remote control device deflects upward is greater than the number of times the remote control device deflects downward, then the direction of movement of the remote control device is determined to be upward movement. Or in another implementation manner, if the number of times of upward deflection of the remote control device is smaller than the number of times of downward deflection of the remote control device, determining that the moving direction of the remote control device is downward movement, so that the moving direction of the remote control device can be accurately determined, and the video picture of the intelligent terminal can be controlled to be dynamically adjusted according to the remote control device in the subsequent steps.
Step S200, the intelligent terminal acquires direction tracking data of the eyes of the user, and determines the direction of the video line of the eyes of the user according to the direction tracking data.
When the user is at a position other than the viewing position vertically in front of the intelligent terminal, the line of sight of the user cannot be vertical to the video picture. Therefore, in order not to affect the viewing effect of the user, the present embodiment needs to control the video frame to be perpendicular to the viewing line direction of the user. For this reason, the present embodiment needs to acquire the viewing line direction of the user's eyes. When the implementation direction is acquired, the embodiment firstly acquires the direction tracking data of the eyes of the user, and then determines the direction of the video line of the eyes of the user according to the direction tracking data. In this embodiment, the direction tracking data is determined based on the state of the black eye in the user's eyes, for example, when the black eye of the user's eyes is at a position above the eyes, the direction tracking data indicating the user's eyes is viewed upward at this time, and when the black eye of the user's eyes is at a position below the eyes, the direction tracking data indicating the user's eyes is viewed downward at this time. Therefore, the direction of the viewing line of the eyes of the user can be further determined according to the direction tracking data.
In one implementation, as shown in fig. 3, the step S200 specifically includes the following steps:
Step S201, the intelligent terminal acquires image data of the eyes of a user;
Step S302, the intelligent terminal determines the direction tracking data of the eyes of the user according to the image data;
Step S203, the intelligent terminal acquires second times of the direction tracking data of the eyes of the user in a second preset time period, and determines the direction of the video line of the eyes of the user according to the second times.
In a specific implementation, the intelligent terminal in this embodiment obtains the direction tracking data of the user's eyes based on the image data of the user's eyes. In this embodiment, image data of a user's eyes may be obtained through a photographing device of an intelligent terminal, and then the image data of the user's eyes may be analyzed to obtain direction tracking data of the user's eyes. Specifically, since the image data is obtained by photographing the eyes of the user, the image data includes an image of the eyes of the user. The position state of the black eye in the user eye directly reflects the direction of the viewing line of the user eye, for example, when the black eye in the user eye is at the position above the eye, the direction tracking data of the user eye is shown to be viewed upwards by the user, and when the black eye in the user eye is at the position below the eye, the direction tracking data of the user eye is shown to be viewed downwards by the user, and then the direction of the viewing line of the user eye can be further determined according to the direction tracking data. Therefore, the present embodiment can determine the direction tracking data according to the image data and analyze the black pixels (i.e. the black beads) in the image data.
The intelligent terminal of the embodiment determines the positioning center point of the black pixel in the user's eye and the positioning center point of the whole pixel of the user's eye according to the image data. In one implementation, if the positioning center point of the black pixel is located above the positioning center point of the whole pixel, the positioning center point indicates that the user is looking up when watching the video picture, and the direction tracking data of the eyes of the user is determined to be looking up by the user. Or in another implementation, if the positioning center point of the black pixel is located below the positioning center point of the whole pixel, the positioning center point indicates that the user is looking down when watching the video picture, and the direction tracking data of the eyes of the user is determined to be looking down by the user. It follows that the direction tracking data of the user's eyes includes either upward viewing by the user or downward viewing by the user.
When the intelligent terminal is positioned at a position other than the vertical front viewing position of the intelligent terminal, the sight line of the user cannot be vertical to the video picture, but the sight line of the user can also be changed, for example, the user sits on a dining table to watch a large screen on the intelligent refrigerator for playing video when the user watches the large screen on the intelligent refrigerator with a dining side, at the moment, the sight line of the user is changed, namely, the sight line of the user is downward when the user watches the video, and the realization is upward when the user watches the video. Therefore, in order to accurately acquire the direction of the viewing line of the eyes of the user, the embodiment acquires the second times of the direction tracking data of the eyes of the user in the second preset time period, and determines the direction of the viewing line of the eyes of the user according to the second times. For example, the embodiment may obtain the number of times the user watches upwards and the number of times the user watches downwards in 4S, and take the number of times the user watches upwards and the number of times the user watches downwards as the second number of times, and then determine the direction of the viewing line of the eyes of the user according to the number of times the user watches upwards and the number of times the user watches downwards. In one implementation, when the number of times the user views upwards is greater than the number of times the user views downwards, the direction of the viewing line of the eyes of the user is determined to be upward. Or in another implementation, when the number of times that the user watches upwards is smaller than the number of times that the user watches downwards, determining that the direction of the viewing line of the human eyes of the user is upward. Therefore, the direction of the video line of the eyes of the user can be accurately determined, so that the video picture can be adjusted according to the direction of the video line in the subsequent step.
And step S300, the intelligent terminal controls the video picture adjustment according to the moving direction of the remote control device and the direction of the viewing line of the eyes of the user.
In this embodiment, the moving direction of the remote control device and the viewing line direction of the eyes of the user may both reflect the deviation between the vertical front of the intelligent terminal and the viewing line direction of the eyes of the user. Therefore, in this embodiment, after determining the moving direction of the remote control device and the viewing line direction of the user's eyes, the video picture adjustment is controlled according to the moving direction of the remote control device and the viewing line direction of the user's eyes, so that the viewing line direction of the user's eyes is perpendicular to the video picture of the intelligent terminal, and thus distortion of the video picture is not caused, and the viewing quality of the user is ensured.
In one implementation, as shown in fig. 4, step S300 specifically includes the following steps:
step S301, the intelligent terminal acquires a step weight corresponding to the moving direction of the remote control equipment;
Step S302, the intelligent terminal controls the video picture to deflect according to the step weight according to the video line direction of the eyes of the user, so that the video line direction of the eyes of the user is perpendicular to the video picture.
In specific implementation, the embodiment sets a step weight for the moving direction of the remote control device in advance, and the intelligent terminal can adjust according to the step weight when moving the video picture. Specifically, the movement direction of the remote control device includes upward movement and downward movement. And the remote control device moving upward again comprises: the gyroscope motion data are both deflected upward to the right and lie in the interval 90 ° -180 ° and the gyroscope motion data are deflected upward to the left and lie in the interval 0 ° -90 °. The step weight for the upward movement of the remote control device is set in this embodiment as the yaw angle divided by the percentage of 10. For example, the gyroscope motion data are deflected upwards to the right and are positioned in the range of step weights of 9% -18% in the interval of 90 ° -180 °; the gyroscope motion data are deflected upwards to the right and lie in the range of 0-9% of step weights in the interval of 0-90 degrees.
Likewise, the remote control device moving downward again includes: the gyroscope motion data are both deflected downward and to the left and lie in the interval 180 ° -270 °, and the gyroscope motion data are deflected downward and to the right and lie in the interval 270 ° -360 °. The step weight for the downward movement of the remote control device is set in this embodiment as the deflection angle divided by the percentage of 10. For example, the gyroscope motion data are deflected leftwards and downwards and are positioned in a range of 18% -27% of step weights in a range of 180 ° -270 °; the gyroscope motion data are deflected upwards to the right and lie in the range of 27% -36% of step weights in the interval of 270 ° -360 °. After the step weight is determined, the embodiment can control the video picture of the intelligent terminal to move little by little according to the set step weight, and finally the video picture is vertical to the direction of the watching video line of the user, so that the user can watch the video picture conveniently. When the video picture of the intelligent terminal is controlled to move, the embodiment can be realized by controlling the screen of the intelligent terminal, for example, when the direction of the video watching line of the user is upward, the video picture needs to be moved downward, and the video picture can be perpendicular to the direction of the video watching line of the user by controlling the screen of the intelligent terminal to rotate downward.
It can be seen that the present embodiment first obtains the yaw direction data of the remote control device, and determines the moving direction of the remote control device according to the yaw direction data. And then, acquiring direction tracking data of the eyes of the user, and determining the direction of the video line of the eyes of the user according to the direction tracking data. The determined moving direction of the remote control device can reflect which direction the screen of the intelligent terminal is shifted, and the direction of the viewing line of the eyes of the user can reflect which place the sight of the user is directed. Therefore, the embodiment can control the video picture adjustment according to the moving direction of the remote control device and the viewing line direction of the eyes of the user, thereby controlling the adaptive picture of the intelligent terminal to rotate along with the line of sight of the eyes, ensuring that the user can better see the panoramic video picture, ensuring that the viewing line direction of the user is perpendicular to the video picture of the intelligent terminal, and avoiding picture distortion.
Exemplary apparatus
As shown in fig. 5, an embodiment of the present invention provides a video picture dynamic adjustment apparatus, which includes: a moving direction determining unit 10, a viewing line direction determining unit 20, a video picture adjusting unit 30. Specifically, the movement direction determining unit 10 is configured to acquire deflection direction data of the remote control device, and determine a movement direction of the remote control device according to the deflection direction data. The viewing line direction determining unit 20 is configured to obtain direction tracking data of a user's eyes, and determine a viewing line direction of the user's eyes according to the direction tracking data. The video picture adjustment unit 30 is used for controlling the video picture adjustment according to the moving direction of the remote control device and the direction of the viewing line of the eyes of the user.
Based on the above embodiment, the present invention also provides an intelligent terminal, and a functional block diagram thereof may be shown in fig. 6. The intelligent terminal comprises a processor, a memory, a network interface, a display screen and a temperature sensor which are connected through a system bus. The processor of the intelligent terminal is used for providing computing and control capabilities. The memory of the intelligent terminal comprises a nonvolatile storage medium and an internal memory. The nonvolatile storage medium stores an operating system and a video picture dynamic movement program. The internal memory provides an environment for the operation of an operating system and video picture dynamic movement programs in a non-volatile storage medium. The network interface of the intelligent terminal is used for communicating with an external terminal through network connection. The video picture dynamic moving program is executed by a processor to realize a video picture dynamic adjusting method. The display screen of the intelligent terminal can be a liquid crystal display screen or an electronic ink display screen, and a temperature sensor of the intelligent terminal is arranged in the intelligent terminal in advance and used for detecting the running temperature of internal equipment.
It will be appreciated by those skilled in the art that the schematic block diagram shown in fig. 6 is merely a block diagram of a portion of the structure associated with the present inventive arrangements and is not limiting of the smart terminal to which the present inventive arrangements are applied, and that a particular smart terminal may include more or fewer components than shown, or may combine some of the components, or have a different arrangement of components.
In one embodiment, a computer readable storage medium is provided, comprising a memory, a processor, and a video frame dynamic movement program stored in the memory and executable on the processor, the processor implementing the following method when executing the video frame dynamic movement program:
acquiring deflection direction data of the remote control equipment, and determining the moving direction of the remote control equipment according to the deflection direction data;
Acquiring direction tracking data of eyes of a user, and determining the direction of viewing lines of eyes of the user according to the direction tracking data;
And controlling video picture adjustment according to the moving direction of the remote control device and the direction of the viewing line of human eyes of the user.
Those skilled in the art will appreciate that implementing all or part of the above-described methods may be accomplished by way of a computer program, which may be stored in a computer-readable storage medium and which, when executed, may comprise the steps of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in embodiments provided herein may include non-volatile and/or volatile memory. The nonvolatile memory can include Read Only Memory (ROM), programmable ROM (PROM), electrically Programmable ROM (EPROM), electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double Data Rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (SYNCHLINK) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), among others.
In summary, the invention discloses a video picture dynamic adjustment method, a device, an intelligent terminal and a storage medium, wherein the method comprises the following steps: acquiring deflection direction data of the remote control equipment, and determining the moving direction of the remote control equipment according to the deflection direction data; acquiring direction tracking data of eyes of a user, and determining the direction of viewing lines of eyes of the user according to the direction tracking data; and controlling video picture adjustment according to the moving direction of the remote control device and the direction of the viewing line of human eyes of the user. According to the invention, the video picture is moved according to the moving direction of the remote control device and the viewing line direction of human eyes of the user, so that the video picture can rotate along with the line of sight of the human eyes, the user can be ensured to better see the panoramic video picture, the viewing line direction of the user is ensured to be perpendicular to the video picture of the intelligent terminal, and the picture distortion phenomenon can not occur.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present invention, and are not limiting; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims (6)
1. A method for dynamically adjusting a video frame, comprising:
acquiring deflection direction data of remote control equipment, and determining the moving direction of the remote control equipment according to the deflection direction data;
the obtaining deflection direction data of the remote control equipment and determining the moving direction of the remote control equipment according to the deflection direction data comprises the following steps:
Acquiring gyroscope motion data of a gyroscope in remote control equipment;
determining deflection direction data of the remote control device according to the gyroscope motion data;
acquiring a first time of occurrence of the deflection direction data of the remote control equipment in a first preset time period, and determining the moving direction of the remote control equipment according to the first time;
The deflection direction data includes that the remote control device deflects upwards and the remote control device deflects downwards, the first times of the deflection direction data of the remote control device in a first preset time period are obtained, and the moving direction of the remote control device is determined according to the first times, and the method includes the steps of:
Respectively acquiring the upward deflection times and the downward deflection times of the remote control equipment in a first preset time period, and taking the upward deflection times and the downward deflection times of the remote control equipment as the first times;
if the number of times of upward deflection of the remote control equipment is larger than the number of times of downward deflection of the remote control equipment, determining that the moving direction of the remote control equipment is upward movement; or alternatively
If the number of the upward deflection times of the remote control equipment is smaller than the number of the downward deflection times of the remote control equipment, determining that the moving direction of the remote control equipment is downward movement;
acquiring direction tracking data of a user's eyes, and determining the direction of a viewing line of the user's eyes according to the direction tracking data, wherein the direction tracking data is determined based on the state of black beads in the user's eyes;
The obtaining the direction tracking data of the eyes of the user and determining the direction of the video line of the eyes of the user according to the direction tracking data comprises the following steps:
acquiring image data of the eyes of the user;
determining direction tracking data of the user's eyes according to the image data;
acquiring second times of the direction tracking data of the eyes of the user in a second preset time period, and determining the direction of the video line of the eyes of the user according to the second times;
Controlling video picture adjustment according to the moving direction of the remote control device and the viewing line direction of the eyes of the user;
The controlling the video picture adjustment according to the moving direction of the remote control device and the viewing line direction of the eyes of the user comprises the following steps:
Acquiring a step weight corresponding to the moving direction of the remote control equipment;
According to the video line direction of the eyes of the user, controlling the video picture to deflect according to the step weight so that the video line direction of the eyes of the user is perpendicular to the video picture;
the step weights for both the upward and downward movement of the remote control device are set to be the deflection angle divided by a percentage of 10.
2. The method of claim 1, wherein the direction-tracking data comprises user-up view and user-down view, and wherein determining the direction-tracking data for the user's human eye from the image data comprises:
determining a positioning center point of a black pixel in the human eye of the user and a positioning center point of the whole pixel of the human eye of the user according to the image data;
If the locating center point of the black pixel is located above the locating center point of the whole pixel, determining that the direction tracking data of the user eyes are watched upwards by the user; or alternatively
And if the positioning center point of the black pixel is positioned below the positioning center point of the whole pixel, determining that the direction tracking data of the human eyes of the user is downwards watched by the user.
3. The method according to claim 2, wherein the obtaining a second number of times of the direction tracking data of the human eye of the user within the second preset period of time, and determining the direction of the viewing line of the human eye of the user according to the second number of times, includes:
respectively obtaining the number of times of upward watching of the user and the number of times of downward watching of the user in a second preset time period, and taking the number of times of upward watching of the user and the number of times of downward watching of the user as the second number of times;
If the number of upward watching times of the user is larger than the number of upward watching times of the user, determining that the direction of the video line of the human eyes of the user is upward; or alternatively
And if the number of times of upward watching of the user is smaller than the number of times of upward watching of the user, determining that the direction of the video line of the eyes of the user is downward.
4. A video picture dynamic moving apparatus, comprising:
a moving direction determining unit, configured to obtain deflection direction data of a remote control device, and determine a moving direction of the remote control device according to the deflection direction data;
The moving direction determining unit is specifically configured to:
Acquiring gyroscope motion data of a gyroscope in remote control equipment;
determining deflection direction data of the remote control device according to the gyroscope motion data;
acquiring a first time of occurrence of the deflection direction data of the remote control equipment in a first preset time period, and determining the moving direction of the remote control equipment according to the first time;
The deflection direction data includes that the remote control device deflects upwards and the remote control device deflects downwards, the first times of the deflection direction data of the remote control device in a first preset time period are obtained, and the moving direction of the remote control device is determined according to the first times, and the method includes the steps of:
Respectively acquiring the upward deflection times and the downward deflection times of the remote control equipment in a first preset time period, and taking the upward deflection times and the downward deflection times of the remote control equipment as the first times;
if the number of times of upward deflection of the remote control equipment is larger than the number of times of downward deflection of the remote control equipment, determining that the moving direction of the remote control equipment is upward movement; or alternatively
If the number of the upward deflection times of the remote control equipment is smaller than the number of the downward deflection times of the remote control equipment, determining that the moving direction of the remote control equipment is downward movement;
The video line direction determining unit is used for obtaining direction tracking data of the eyes of the user and determining the video line direction of the eyes of the user according to the direction tracking data, wherein the direction tracking data is determined based on the state of black beads in the eyes of the user;
The obtaining the direction tracking data of the eyes of the user and determining the direction of the video line of the eyes of the user according to the direction tracking data comprises the following steps:
acquiring image data of the eyes of the user;
determining direction tracking data of the user's eyes according to the image data;
acquiring second times of the direction tracking data of the eyes of the user in a second preset time period, and determining the direction of the video line of the eyes of the user according to the second times;
a video picture adjusting unit for controlling video picture adjustment according to the moving direction of the remote control device and the viewing line direction of the eyes of the user;
The controlling the video picture adjustment according to the moving direction of the remote control device and the viewing line direction of the eyes of the user comprises the following steps:
Acquiring a step weight corresponding to the moving direction of the remote control equipment;
According to the video line direction of the eyes of the user, controlling the video picture to deflect according to the step weight so that the video line direction of the eyes of the user is perpendicular to the video picture;
the step weights for both the upward and downward movement of the remote control device are set to be the deflection angle divided by a percentage of 10.
5. An intelligent terminal, characterized in that the intelligent terminal comprises a memory, a processor and a video picture dynamic moving program stored in the memory and capable of running on the processor, wherein the processor implements the method according to any one of claims 1-3 when executing the video picture dynamic moving program.
6. A computer readable storage medium, characterized in that the computer readable storage medium has stored therein a video picture dynamic movement program, which when executed by a processor, implements the method according to any of claims 1-3.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011218472.6A CN114449319B (en) | 2020-11-04 | 2020-11-04 | Video picture dynamic adjustment method and device, intelligent terminal and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011218472.6A CN114449319B (en) | 2020-11-04 | 2020-11-04 | Video picture dynamic adjustment method and device, intelligent terminal and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114449319A CN114449319A (en) | 2022-05-06 |
| CN114449319B true CN114449319B (en) | 2024-06-04 |
Family
ID=81361705
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011218472.6A Active CN114449319B (en) | 2020-11-04 | 2020-11-04 | Video picture dynamic adjustment method and device, intelligent terminal and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114449319B (en) |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20040058455A (en) * | 2002-12-26 | 2004-07-05 | 엘지전자 주식회사 | Display adjusting system in television according to input signal and method of the same |
| CN103561635A (en) * | 2011-05-11 | 2014-02-05 | 谷歌公司 | Gaze tracking system |
| CN105516577A (en) * | 2014-09-24 | 2016-04-20 | 深圳Tcl数字技术有限公司 | Camera shooting control method and system |
| CN106851405A (en) * | 2016-12-13 | 2017-06-13 | 合网络技术（北京）有限公司 | Video broadcasting method and device based on oblique viewing angle detection |
| CN107329568A (en) * | 2017-06-27 | 2017-11-07 | 乐视致新电子科技（天津）有限公司 | Method of adjustment, device and electronic equipment that panorama is played |
| CN108650500A (en) * | 2018-04-02 | 2018-10-12 | 北京奇艺世纪科技有限公司 | A kind of panoramic video processing method and processing device |
| CN109309873A (en) * | 2017-07-28 | 2019-02-05 | 腾讯科技（深圳）有限公司 | Screen angle method of adjustment, device and storage medium |
| CN110458104A (en) * | 2019-08-12 | 2019-11-15 | 广州小鹏汽车科技有限公司 | The human eye sight direction of human eye sight detection system determines method and system |
| CN110488494A (en) * | 2019-08-30 | 2019-11-22 | 京东方科技集团股份有限公司 | A kind of nearly eye display device, augmented reality equipment and virtual reality device |
| CN110825220A (en) * | 2019-09-29 | 2020-02-21 | 深圳市火乐科技发展有限公司 | Eyeball tracking control method and device, intelligent projector and storage medium |
| CN111385649A (en) * | 2018-12-28 | 2020-07-07 | 深圳Tcl新技术有限公司 | Television sound transmission control method and device, smart television and storage medium |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW201441918A (en) * | 2013-04-29 | 2014-11-01 | Hon Hai Prec Ind Co Ltd | System and method for automatically adjusting images displayed on a display screen |
| KR20160045084A (en) * | 2013-08-21 | 2016-04-26 | 톰슨 라이센싱 | Video display with pan function controlled by viewing direction |
| US9674563B2 (en) * | 2013-11-04 | 2017-06-06 | Rovi Guides, Inc. | Systems and methods for recommending content |
| CN105898460A (en) * | 2015-12-10 | 2016-08-24 | 乐视网信息技术（北京）股份有限公司 | Method and device for adjusting panorama video play visual angle of intelligent TV |
-
2020
- 2020-11-04 CN CN202011218472.6A patent/CN114449319B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20040058455A (en) * | 2002-12-26 | 2004-07-05 | 엘지전자 주식회사 | Display adjusting system in television according to input signal and method of the same |
| CN103561635A (en) * | 2011-05-11 | 2014-02-05 | 谷歌公司 | Gaze tracking system |
| CN105516577A (en) * | 2014-09-24 | 2016-04-20 | 深圳Tcl数字技术有限公司 | Camera shooting control method and system |
| CN106851405A (en) * | 2016-12-13 | 2017-06-13 | 合网络技术（北京）有限公司 | Video broadcasting method and device based on oblique viewing angle detection |
| CN107329568A (en) * | 2017-06-27 | 2017-11-07 | 乐视致新电子科技（天津）有限公司 | Method of adjustment, device and electronic equipment that panorama is played |
| CN109309873A (en) * | 2017-07-28 | 2019-02-05 | 腾讯科技（深圳）有限公司 | Screen angle method of adjustment, device and storage medium |
| CN108650500A (en) * | 2018-04-02 | 2018-10-12 | 北京奇艺世纪科技有限公司 | A kind of panoramic video processing method and processing device |
| CN111385649A (en) * | 2018-12-28 | 2020-07-07 | 深圳Tcl新技术有限公司 | Television sound transmission control method and device, smart television and storage medium |
| CN110458104A (en) * | 2019-08-12 | 2019-11-15 | 广州小鹏汽车科技有限公司 | The human eye sight direction of human eye sight detection system determines method and system |
| CN110488494A (en) * | 2019-08-30 | 2019-11-22 | 京东方科技集团股份有限公司 | A kind of nearly eye display device, augmented reality equipment and virtual reality device |
| CN110825220A (en) * | 2019-09-29 | 2020-02-21 | 深圳市火乐科技发展有限公司 | Eyeball tracking control method and device, intelligent projector and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 钱谦.视线感知与视觉注意转移交互原理和分析.云南大学出版社,2017,第1-2页. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114449319A (en) | 2022-05-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10026381B2 (en) | Method and device for adjusting and displaying image | |
| CN101110942B (en) | Remote instruction system and method | |
| EP1501019A2 (en) | Apparatus and method for automatically compensating for an image gradient of a mobile communication terminal | |
| CN107888984B (en) | Short video playing method and device | |
| JP2015075877A (en) | Imaging system | |
| CN107590780B (en) | Image display method, terminal and computer readable storage medium | |
| US20020180733A1 (en) | Method and apparatus for adjusting an image to compensate for an offset position of a user | |
| EP4387249A1 (en) | Method and apparatus for picture stability processing under digital zoom, mobile terminal, and medium | |
| US20170046813A1 (en) | An apparatus and associated methods for image capture | |
| US20190027118A1 (en) | Terminal device and display method | |
| CN111240780A (en) | Image display method, image display device, display terminal and readable storage medium | |
| WO2018219290A1 (en) | Information terminal | |
| CN115668913A (en) | Stereoscopic display method, device, medium and system for field performance | |
| CN114449319B (en) | Video picture dynamic adjustment method and device, intelligent terminal and storage medium | |
| KR20130081439A (en) | Apparatus and method for displaying camera view area in a portable terminal | |
| US8774556B2 (en) | Perspective correction using a reflection | |
| WO2020000393A1 (en) | Image processing method and apparatus, first electronic device, and image processing system | |
| CN112333391A (en) | Method and device for automatically tracking portrait based on sound, intelligent terminal and medium | |
| EP3376758A1 (en) | Dynamic videotelephony systems and methods of using the same | |
| CN110741308A (en) | Eyepiece adjusting method for head-mounted display device, and computer-readable storage medium | |
| CN111355843A (en) | Brightness adjusting method and device, mobile terminal and storage medium | |
| US11747899B2 (en) | Gaze-based window adjustments | |
| CN112911362B (en) | Video picture moving and scaling method and device, electronic equipment and readable storage medium | |
| CN113422967B (en) | Screen projection display control method and device, terminal equipment and storage medium | |
| CN113241044A (en) | Screen brightness adjusting method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |