CN108965767A - A kind of method for processing video frequency and system improving the experience of person to person's video interactive - Google Patents
A kind of method for processing video frequency and system improving the experience of person to person's video interactive Download PDFInfo
- Publication number
- CN108965767A CN108965767A CN201810833798.6A CN201810833798A CN108965767A CN 108965767 A CN108965767 A CN 108965767A CN 201810833798 A CN201810833798 A CN 201810833798A CN 108965767 A CN108965767 A CN 108965767A
- Authority
- CN
- China
- Prior art keywords
- video
- person
- human eye
- screen
- experience
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
Abstract
The present invention provides the method for processing video frequency and system of a kind of improvement person to person's video interactive experience, and the method for processing video frequency for improving the experience of person to person's video interactive obtains location information of the camera relative to screen in acquisition video the following steps are included: step S1；Step S2 obtains the location information that human eye focuses in acquisition video；Step S3 focuses location information on the screen relative to the location information and human eye of screen according to the camera, calculates human eye and focus on camera direction and focus on the misalignment angle in screen between human eye direction, obtain misalignment angle parameter；Step S4 acquires the human eye focusing angle in video according to the misalignment angle parameters revision, then revised video is encoded and transmitted again.The present invention can be realized the effect for seeing that the human eye of other side faces oneself during video interactive, so that can accomplish the communicative effect of more vivid and true to nature " face-to-face " in video interactive, improve user experience.
Description
Technical field
The present invention relates at a kind of method for processing video frequency more particularly to a kind of video for improving the experience of person to person's video interactive
Reason method, and be related to using the processing system for video of the method for processing video frequency of improvement person to person's video interactive experience.
Background technique
Current interpersonal video interactive is to acquire figure information by camera, is arrived by encoding compression transmission
Then counterpart device is displayed on the screen by decoding, obtain the video image information of other side by watching screen.And due to view
Frequency acquisition camera and screen between there are certain positional distances, between camera and human eye there is also certain position away from
Walk-off angle degree, during video interactive, what the eyes of other side stared at is not camera in fact but screen, then, it will give
People feels that other side does not look at oneself, and this feeling is not that the communication way faced is a kind of bad interactive experience.
Summary of the invention
The technical problem to be solved by the present invention is to need to provide a kind of view that can improve the experience of person to person's video interactive
Frequency processing method, and then improve the user experience of video interactive.
In this regard, the present invention provides a kind of method for processing video frequency of improvement person to person's video interactive experience, comprising the following steps:
Step S1 obtains location information of the camera relative to screen in acquisition video；
Step S2 obtains the location information that human eye focuses in acquisition video；
Step S3 focuses location information on the screen, meter relative to the location information and human eye of screen according to the camera
The misalignment angle between the human eye direction in the camera direction that human eye focuses and focusing screen is calculated, misalignment angle parameter is obtained；；
Step S4 acquires the human eye focusing angle in video, then again to amendment according to the misalignment angle parameters revision
Video afterwards is encoded and is transmitted.
A further improvement of the present invention is that the step S2 includes following sub-step:
Step S201 obtains the focus direction of practical human eye in acquisition video；
Step S202 obtains location information of the human eye in screen in decompressing video；
Step S203, by adjusting people in the focus direction and the step S202 for making the practical human eye in the step S201
Location information of the eye in screen is consistent.
A further improvement of the present invention is that the position by adjusting human eye in screen, so that in the step S201
Practical human eye pupil center surface vertical extension line by the human eye in the decompressing video so that the step
The focus direction of practical human eye in S201 is consistent with location information of the human eye in screen in the step S202.
A further improvement of the present invention is that in the step S3, between the pupil center and camera of practical human eye
As the first line, the line in the pupil center of practical human eye and screen between the pupil center of human eye connects line as second
Line, included angle of the misalignment angle between the first line and the second line.
A further improvement of the present invention is that correcting the human eye focusing angle in the acquisition video in the step S4
Process be by image procossing, to be carried out again according to the included angle of the misalignment angle to pupil of human in acquisition video
It draws.
A further improvement of the present invention is that obtaining it according to the included angle of the misalignment angle in the step S4
Vertical missing value and horizontal departure value, pupil of human carries out vertical direction according to the vertical missing value in the acquisition video
Mobile, pupil of human carries out the movement of horizontal direction according to the horizontal departure value in the acquisition video, then to movement after
Pupil of human repainted.
A further improvement of the present invention is that further include step S5, the step S5 real-time detection and sdi video is judged
Whether position changes, if then return step S1；If otherwise continuing real-time detection and judging the position of the camera.
A further improvement of the present invention is that in the step S5, if the image of camera acquisition passes through after image recognition
It was found that the object in video background is displaced, then it is judged as that sdi video position is changed.
A further improvement of the present invention is that it is poly- to obtain human eye in acquisition video by video identification in the step S2
Burnt location information.
The present invention also provides a kind of processing system for video of improvement person to person's video interactive experience, use as described above
The method for processing video frequency of person to person's video interactive experience.
Compared with prior art, a further improvement of the present invention is that: acquired by image processing techniques and calculate human eye
It focuses on camera position direction and focuses on the misalignment angle in video between human eye direction, then corrected with this in video
The direction that human eye focuses in interaction, and another party is then forwarded to after recompiling to revised video, and then realize
During video interactive, it can see that the human eye of other side is the effect for facing oneself in video, so that the video in person to person is handed over
In mutually, it can accomplish the communicative effect of more vivid and true to nature " face-to-face ", improve user experience.
Detailed description of the invention
Fig. 1 is the workflow schematic diagram of an embodiment of the present invention；
Fig. 2 is the schematic illustration of an embodiment of the present invention.
Specific embodiment
With reference to the accompanying drawing, preferably embodiment of the invention is described in further detail.
As shown in Figure 1, this example provides a kind of method for processing video frequency of improvement person to person's video interactive experience, including following step
It is rapid:
Step S1 obtains location information of the camera 2 relative to screen 3 in acquisition video；
Step S2 obtains the location information that human eye focuses in acquisition video；
Step S3 calculates human eye according to the location information that the camera 2 is focused relative to the location information and human eye of screen 3
It focuses on 2 direction of camera and focuses on the angle in video between human eye direction, obtain misalignment angle parameter, the misalignment angle
Parameter includes angle 5(misalignment angle)；
Step S4 acquires the human eye focusing angle in video, then again to amendment according to the misalignment angle parameters revision
Video afterwards is encoded and is transmitted.Revised video is encoded and is transmitted the deviation for referring to image procossing pupil
After angle, whole image is recompiled, then is transmitted.
That is, this example is intended to through the real-time processing to video image, and then change the people in human image collecting video
The focus direction of eye 4, it is poor to eliminate camera 2 and the focusing angle of the human eye 4 in screen 3, so that interaction both sides are visually
All think that other side links up looking at oneself.
Preferably, as shown in Figure 1, step S2 described in this example includes following sub-step:
Step S201 obtains the focus direction of practical human eye 1 in acquisition video；
Step S202 obtains location information of the human eye 4 in screen 3 in decompressing video；
Step S203, by adjusting position of the human eye 4 in screen 3, so that practical human eye 1 in the step S201
Focus direction is consistent with location information of the human eye 4 in screen 3 in the step S202.Practical human eye in the step S201
1 focus direction is consistent with location information of the human eye 4 in screen 3 in the step S202, refers to by video image
Real-time processing so that the human eye focus direction of practical human eye 1 is overlapped with the focusing of the human eye 4 in screen 3, in other words,
Exactly make pupil center's surface vertical extension line of practical human eye 1 by the human eye 4 in decompressing video, so that practical human eye 1
Focusing focus human eye 4 on the screen on.It is noted that practical human eye 1 refers to true eyes of user, and screen 3
In human eye 4, refer to the virtual eyes in the video image of the inside of screen 3, as shown in Figure 2.
As shown in Fig. 2, the step S203 is preferably a judgement and set-up procedure in fact, if the focusing of practical human eye 1
Direction is not consistent with location information of the human eye 4 in screen 3 in the step S202, then adjusts position of the human eye 4 in screen 3
It sets, and then carried out to the position of the focus direction and human eye 4 adjusted of practical human eye 1 in screen 3 is obtained in acquisition video
It compares, judges whether to be consistent, just jump to the step S3 until being consistent.
Position of this example by adjusting human eye 4 in screen 3, so that 4 pupil center of human eye in the step S201
Surface vertical extension line is by the human eye 4 in the decompressing video, so that the human eye focus direction in the step S201
It is consistent with location information of the human eye 4 in screen 3 in the step S202.
As shown in Fig. 2, the line conduct in step S3 described in this example, between the pupil center and camera 2 of practical human eye 1
First line, the line in the pupil center of practical human eye 1 and screen between the pupil center of human eye 4 is as the second line, institute
State the included angle of angle 5 of the misalignment angle between the first line and the second line.
In step S4 described in this example, the process for correcting the human eye focusing angle in the acquisition video is, at image
Reason, according to the angle 5(misalignment angle) included angle to acquisition video in human eye 4 repaint.
If camera 2, in the surface or underface of screen 3, misalignment angle is an angle of vertical direction,
For example, it is particularly the case for the layout of most of notebooks, tablet terminal and mobile phone, in this case, only one is vertical inclined
Declinate, also referred to as vertical missing value.
If camera 2, in the other positions of screen 3, horizontal direction also needs a misalignment angle, then, it is necessary to it will
The focus direction adjustment of human eye 4 is by Simplified two-dimension to one-dimensional, that is, other than vertical missing value (vertical deviation angle), it is also possible to
There are horizontal angle of deviations, also referred to as horizontal departure value；The focusing of human eye 4 is adjusted the angle including the vertical missing in vertical direction at this time
The horizontal departure value of value and horizontal direction, that is to say, that adjustment needs to do the adjustment of both direction；The vertical missing value is vertical
The upward deviation of histogram, the horizontal departure value are the deviation in horizontal direction.
Therefore, more preferably, in step S4 described in this example, it is vertical that it is obtained according to the included angle of the misalignment angle
Deviation and horizontal departure value, the shifting for acquiring 4 pupil of human eye in video and carrying out vertical direction according to the vertical missing value
Dynamic, 4 pupil of human eye carries out the movement of horizontal direction according to the horizontal departure value in the acquisition video, then to movement after
4 pupil of human eye is repainted.
This example further preferably includes step S5, the step S5 real-time detection and judges whether sdi video position becomes
Change, if then return step S1, to guarantee the accuracy of video processing；If otherwise continuing real-time detection and judging the camera
2 position.In the step S5, if the image that camera 2 acquires is by finding the object hair in video background after image recognition
Displacement has been given birth to, then has been judged as that sdi video position is changed.
In step S2 described in this example, the focal position information of human eye 4 in acquisition video is obtained by video identification.
This example also provides a kind of processing system for video of improvement person to person's video interactive experience, uses people as described above
With the method for processing video frequency of people's video interactive experience.
In conclusion this example acquires and calculates people in 2 position angle of camera and acquisition video by image processing techniques
Then misalignment angle between eye focusing angle corrects the direction that in video interactive human eye focuses with this, and to amendment after
Video recompiled after be then forwarded to another party, and then realize that the human eye 4 that other side is seen during video interactive is
The effect of oneself is faced, so that can accomplish more vivid and true to nature " face-to-face " in the video interactive of person to person
Communicative effect improves user experience.
The above content is a further detailed description of the present invention in conjunction with specific preferred embodiments, and it cannot be said that
Specific implementation of the invention is only limited to these instructions.For those of ordinary skill in the art to which the present invention belongs, exist
Under the premise of not departing from present inventive concept, a number of simple deductions or replacements can also be made, all shall be regarded as belonging to of the invention
Protection scope.
Claims (10)
1. a kind of method for processing video frequency for improving the experience of person to person's video interactive, which comprises the following steps:
Step S1 obtains location information of the camera relative to screen in acquisition video；
Step S2 obtains the location information that human eye focuses in acquisition video；
Step S3 focuses location information on the screen, meter relative to the location information and human eye of screen according to the camera
It calculates human eye to focus on camera direction and focus on the misalignment angle in screen between human eye direction, obtains misalignment angle parameter；；
Step S4 acquires the human eye focusing angle in video, then again to amendment according to the misalignment angle parameters revision
Video afterwards is encoded and is transmitted.
2. the method for processing video frequency according to claim 1 for improving the experience of person to person's video interactive, which is characterized in that described
Step S2 includes following sub-step:
Step S201 obtains the focus direction of practical human eye in acquisition video；
Step S202 obtains location information of the human eye in screen in decompressing video；
Step S203, by adjusting people in the focus direction and the step S202 for making the practical human eye in the step S201
Location information of the eye in screen is consistent.
3. the method for processing video frequency according to claim 2 for improving the experience of person to person's video interactive, which is characterized in that pass through
Position of the human eye in screen is adjusted, so that the surface vertical extension line of the pupil center of the practical human eye in the step S201
By the human eye in the decompressing video, so that the focus direction of the practical human eye in the step S201 and the step
Location information of the human eye in screen is consistent in S202.
4. special according to claim 1 to the method for processing video frequency of improvement person to person's video interactive experience described in 3 any one
Sign is, in the step S3, the line between the pupil center and camera of practical human eye is as the first line, practical human eye
Pupil center and screen in human eye pupil center between line as the second line, the misalignment angle is the first line
And the second included angle between line.
5. the method for processing video frequency according to claim 4 for improving the experience of person to person's video interactive, which is characterized in that described
In step S4, the process for correcting the human eye focusing angle in the acquisition video is, by image procossing, according to the angle of deviation
The included angle of degree repaints pupil of human in acquisition video.
6. the method for processing video frequency according to claim 5 for improving the experience of person to person's video interactive, which is characterized in that described
In step S4, its vertical missing value and horizontal departure value, the acquisition video are obtained according to the included angle of the misalignment angle
Middle pupil of human carries out the movement of vertical direction according to the vertical missing value, and pupil of human is according in the acquisition video
Horizontal departure value carries out the movement of horizontal direction, then repaints to the pupil of human after movement.
7. according to claim according to claim 1 to the video that improvement person to person's video interactive is experienced described in 3 any one
Processing method, which is characterized in that further include step S5, the step S5 real-time detection and judge whether sdi video position occurs
Variation, if then return step S1；If otherwise continuing real-time detection and judging the position of the camera.
8. the method for processing video frequency according to claim 7 for improving the experience of person to person's video interactive, which is characterized in that described
In step S5, if the image of camera acquisition is sentenced by finding that the object in video background is displaced after image recognition
Break and is changed for sdi video position.
9. according to claim according to claim 1 to the video that improvement person to person's video interactive is experienced described in 3 any one
Processing method, which is characterized in that in the step S2, the position that human eye focuses in acquisition video is obtained by video identification and is believed
Breath.
10. a kind of processing system for video for improving the experience of person to person's video interactive, which is characterized in that use such as claim 1
The method for processing video frequency experienced to person to person's video interactive described in 9 any one.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810833798.6A CN108965767A (en) | 2018-07-26 | 2018-07-26 | A kind of method for processing video frequency and system improving the experience of person to person's video interactive |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810833798.6A CN108965767A (en) | 2018-07-26 | 2018-07-26 | A kind of method for processing video frequency and system improving the experience of person to person's video interactive |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108965767A true CN108965767A (en) | 2018-12-07 |
Family
ID=64464052
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810833798.6A Pending CN108965767A (en) | 2018-07-26 | 2018-07-26 | A kind of method for processing video frequency and system improving the experience of person to person's video interactive |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108965767A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110141422A (en) * | 2019-05-10 | 2019-08-20 | 东华大学 | A kind of blind person's social intelligence glasses |
| WO2022143426A1 (en) * | 2020-12-31 | 2022-07-07 | 华为技术有限公司 | Conference device and conference system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102483854A (en) * | 2009-09-11 | 2012-05-30 | 皇家飞利浦电子股份有限公司 | Image processing system |
| CN104574321A (en) * | 2015-01-29 | 2015-04-29 | 京东方科技集团股份有限公司 | Image correction method and device and video system |
| CN105763829A (en) * | 2014-12-18 | 2016-07-13 | 联想(北京)有限公司 | Image processing method and electronic device |
| CN105787884A (en) * | 2014-12-18 | 2016-07-20 | 联想(北京)有限公司 | Image processing method and electronic device |
-
2018
- 2018-07-26 CN CN201810833798.6A patent/CN108965767A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102483854A (en) * | 2009-09-11 | 2012-05-30 | 皇家飞利浦电子股份有限公司 | Image processing system |
| CN105763829A (en) * | 2014-12-18 | 2016-07-13 | 联想(北京)有限公司 | Image processing method and electronic device |
| CN105787884A (en) * | 2014-12-18 | 2016-07-20 | 联想(北京)有限公司 | Image processing method and electronic device |
| CN104574321A (en) * | 2015-01-29 | 2015-04-29 | 京东方科技集团股份有限公司 | Image correction method and device and video system |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110141422A (en) * | 2019-05-10 | 2019-08-20 | 东华大学 | A kind of blind person's social intelligence glasses |
| WO2022143426A1 (en) * | 2020-12-31 | 2022-07-07 | 华为技术有限公司 | Conference device and conference system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9325939B2 (en) | Method and system for providing gaze-directed correction during a video conferencing session | |
| US10593088B2 (en) | System and method for enabling mirror video chat using a wearable display device | |
| US7486806B2 (en) | Iris encoding method, individual authentication method, iris code registration device, iris authentication device, and iris authentication program | |
| Muir et al. | Perception of sign language and its application to visual communications for deaf people | |
| JP3945474B2 (en) | Eye image input device, authentication device, and image processing method | |
| US20150139509A1 (en) | Head-mounted display apparatus and login method thereof | |
| CN105989577B (en) | Image correction method and device | |
| RU2672502C1 (en) | Device and method for forming cornea image | |
| CN110049324A (en) | Method for video coding, system, equipment and computer readable storage medium | |
| CN107847354A (en) | System and method for showing video image | |
| KR100307854B1 (en) | Method and Apparatus of Gaze Compensation for Eye Contact Using Single Camera | |
| JPWO2005008590A1 (en) | Iris code generation method, personal authentication method, iris code registration device, personal authentication device, and personal authentication program | |
| CN108965767A (en) | A kind of method for processing video frequency and system improving the experience of person to person's video interactive | |
| CN105787884A (en) | Image processing method and electronic device | |
| CN108478184A (en) | Eyesight measurement method and device, VR equipment based on VR | |
| CN105763829A (en) | Image processing method and electronic device | |
| CN109283997A (en) | Display methods, device and system | |
| KR101987837B1 (en) | Method for providing eyesight shielding service based on multi-media device | |
| Guo et al. | Modeling peripheral vision impact on perceptual quality of immersive images | |
| CN109194952B (en) | Head-mounted eye movement tracking device and eye movement tracking method thereof | |
| Tran et al. | A perception-based quality metric for omnidirectional images | |
| JP2016134668A (en) | Electronic spectacle and electronic spectacle control method | |
| Zannoli et al. | The perceptual consequences of curved screens | |
| US20160350622A1 (en) | Augmented reality and object recognition device | |
| CN106919246A (en) | The display methods and device of a kind of application interface |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181207 |