CN105635624A - Video image processing method, device and system - Google Patents

Video image processing method, device and system Download PDF

Info

Publication number
CN105635624A
CN105635624A CN201410582230.3A CN201410582230A CN105635624A CN 105635624 A CN105635624 A CN 105635624A CN 201410582230 A CN201410582230 A CN 201410582230A CN 105635624 A CN105635624 A CN 105635624A
Authority
CN
China
Prior art keywords
area
video image
user
nontarget
end equipment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201410582230.3A
Other languages
Chinese (zh)
Other versions
CN105635624B (en
Inventor
傅佳莉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN201410582230.3A priority Critical patent/CN105635624B/en
Priority to PCT/CN2015/082359 priority patent/WO2016065913A1/en
Publication of CN105635624A publication Critical patent/CN105635624A/en
Application granted granted Critical
Publication of CN105635624B publication Critical patent/CN105635624B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer

Abstract

The embodiments of the present invention disclose a video image processing method, a device and a system. According to the technical scheme of the invention, the user experience is ensured, and the utilization rate of the network bandwidth resource is improved. The embodiment of the method comprises the steps of determining the ocular fixation area of a user by a display terminal device; and sending the area indication information to a video image collection terminal device. In this way, the video image collection terminal device is enabled to adjust the parameters of at least one video image in a target region or a non-target region based on the area indication information and the network bandwidth. Meanwhile, the quality of video images in the target region is not lower than the quality of video images in the non-target region. According to the embodiments of the invention, the user experience is ensured. Meanwhile, the utilization rate of the network bandwidth resource is improved.

Description

The processing method of video image, equipment and system
Technical field
The present invention relates to computer realm, particularly relate to the processing method of video image, equipment and system.
Background technology
Development along with video communication technology, video communication technology is applied to the every field of society gradually, many bitcoms all with the addition of the function of video communication, such as, various chat softwares, enterprise's conference software etc., user can pass through the computer with photographic head, mobile phone, flat board etc. carries out video communication.
Intelligence is really the high-end applications of long-distance video communication field, can provide the user true man's size face-to-face, eye the video of eye is linked up, build a kind of with strange land dialogue side altogether in the truly feels of a meeting room. Existing immersion meeting is experienced the true system of intelligence and is adopted the video camera hdtv video image of ultra high-definition ultra-wide angle to gather, and by the top technology of the industries such as ultimate attainment HD video, is provided that first-class widescreen meeting is experienced, and supports that 1:1 true man's size is linked up face-to-face; Audio frequency aspect, the audio frequency effect listening sound to distinguish the great spatial impression such as position, labial synchronization can be realized, thus build a kind of with strange land dialogue side altogether in the truly feels of a meeting room, and then make user have good Experience Degree, intelligence really generally comprises two ends, i.e. video image acquisition end equipment and video image display end equipment, video image acquisition end can pass through to image first-class collection video image, to be sent to video image display end equipment after the encoding video pictures collected, video image can be displayed after receiving this frame of video by video image display end equipment.
In the prior art, frame of video is to be transmitted by network, and when the network bandwidth is relatively low, thus the Quality Down of video image that display end equipment receives can be caused, and then cause that the Experience Degree of user is poor.
Summary of the invention
Embodiments providing the processing method of a kind of video image, equipment and system, thus ensure that the Experience Degree of user, improve the utilization rate of network bandwidth resources.
Embodiment of the present invention first aspect provides the processing method of a kind of video image, including:
Display end equipment determines the watching area of user;
Described display end equipment indicates information to video image acquisition end equipment sending zone, make described video image acquisition end equipment indicate information and the network bandwidth that the parameter of the video image of at least one in the target area of video image viewing area or nontarget area is adjusted according to described region, and make the quality of video image that the quality of the video image in described target area is not less than in described nontarget area.
In conjunction with the first aspect of the embodiment of the present invention, in the first implementation of the first aspect of the embodiment of the present invention, described display end equipment determines that the watching area of user includes:
The distance of the direction of gaze of described display end equipment Inspection user and described user and video image;
The described display end equipment wide viewing angle according to the user of the direction of gaze of the described user detected, the distance of described user and video image and acquisition, obtains the watching area of user.
The first implementation in conjunction with the first aspect of the embodiment of the present invention, in the second implementation of the first aspect of the embodiment of the present invention, the described display end equipment distance according to the direction of gaze of the described user detected and the wide viewing angle of user of acquisition, described user and video image, the watching area obtaining user includes:
The described display end equipment distance according to the direction of gaze of the described user detected and the wide viewing angle of user of acquisition, described user and video image, determine described user overlay area, the visual field on video image viewing area, using the described user overlay area, the visual field on the video image viewing area watching area as described user.
The second implementation in conjunction with the first aspect of the embodiment of the present invention or the first implementation of first aspect or first aspect, in the third implementation of the first aspect of the embodiment of the present invention, described region instruction information includes the target area of video image viewing area and the positional information of nontarget area;
Described display end equipment is to before video image acquisition end equipment sending zone instruction information, and described method also includes:
Described display end equipment determines target area and the nontarget area of video image viewing area according to the watching area of described user, and described target area is corresponding with the watching area of described user.
The third implementation in conjunction with the first aspect of the embodiment of the present invention, in the 4th kind of implementation of the first aspect of the embodiment of the present invention, according to the watching area of described user, described display end equipment determines that the target area of video image viewing area and nontarget area specifically include:
Video image viewing area is divided into target area and nontarget area according to the watching area of described user according to horizontal direction by described display end equipment;
Video image viewing area is divided into target area and nontarget area according to the watching area of described user according to vertical direction by described display end equipment;
Or,
Described display end equipment according to the watching area of described user according to horizontally and vertically video image viewing area being divided into target area and nontarget area.
In conjunction with the third implementation of the first aspect of the embodiment of the present invention, in the 5th kind of implementation of the first aspect of the embodiment of the present invention, when there being multiple user, described display end equipment determines that the watching area of user specifically includes:
Described display end equipment determines the watching area of all users;
According to the watching area of described user, described display end equipment determines that the target area of video image viewing area and nontarget area include:
The watching area of all users is merged into comprehensive watching area by described display end equipment, determines target area and the nontarget area of video image viewing area according to described comprehensive watching area.
In conjunction with the third implementation of the first aspect of the embodiment of the present invention, in the 6th kind of implementation of the first aspect of the embodiment of the present invention, when there being multiple user, described display end equipment determines that the watching area of user specifically includes:
Described display end equipment determines targeted customer according to pre-conditioned, and determines the watching area of described targeted customer;
When described targeted customer is one, according to the watching area of described user, described display end equipment determines that the target area of video image viewing area and nontarget area include:
Described display end equipment determines target area and the nontarget area of video image viewing area according to the watching area of described targeted customer;
When described targeted customer is multiple, according to the watching area of described user, described display end equipment determines that the target area of video image viewing area and nontarget area include:
The watching area of the plurality of targeted customer is merged into comprehensive watching area by described display end equipment, determines target area and the nontarget area of video image viewing area according to described comprehensive watching area.
In conjunction with the 6th kind of implementation of the first aspect of the embodiment of the present invention, in the 7th kind of implementation of the first aspect of the embodiment of the present invention, described display end equipment includes according to the pre-conditioned targeted customer of determination:
Described display end equipment obtains the positional information of the plurality of user and video image, it is determined that the user in the middle of the plurality of user is targeted customer.
The 7th kind of implementation in conjunction with the third implementation of first aspect of the embodiment of the present invention or the 5th kind of implementation of the 4th kind of implementation of first aspect or first aspect or the 6th kind of implementation of first aspect or first aspect, in the 8th kind of implementation of the first aspect of the embodiment of the present invention, described method also includes:
When the angle that the direction of gaze of described user changes within the time set is more than or equal to default value, described display end equipment redefines the watching area of described user and determines target area and the nontarget area of video image viewing area according to the watching area of described user;
Or,
When the time that the direction of gaze of described user keeps after changing more than or equal to preset threshold value time, described display end equipment redefines the watching area of described user and determines target area and the nontarget area of video image viewing area according to the watching area of described user;
Or,
When described user direction of gaze set time in change angle more than or equal to default value, and the direction of gaze of described user change after time of keeping more than or equal to preset threshold value time, described display end equipment redefines the watching area of described user and determines target area and the nontarget area of video image viewing area according to the watching area of described user.
The second implementation in conjunction with the first implementation of first aspect of the embodiment of the present invention or first aspect, in the 9th kind of implementation of the first aspect of the embodiment of the present invention, described region instruction information includes the direction of gaze information of described user and the range information of described user and video image.
In conjunction with the first implementation of first aspect of the embodiment of the present invention to arbitrary implementation in the 9th kind of implementation of first aspect, in the tenth kind of implementation of the first aspect of the embodiment of the present invention, described parameter at least includes one in resolution, frame per second and code check.
The second aspect of the embodiment of the present invention provides the processing method of a kind of video image, including:
Video image acquisition end equipment receives the region instruction information that display end equipment sends;
Described video image acquisition end equipment indicates information and the network bandwidth that the parameter of the video image of at least one in the target area of video image viewing area or nontarget area is adjusted according to described region, and makes the quality of video image that the quality of the video image in described target area is not less than in described nontarget area.
In conjunction with the second aspect of the embodiment of the present invention, in the first implementation of the second aspect of the embodiment of the present invention, described region instruction information includes described target area and the positional information of described nontarget area.
In conjunction with the second aspect of the embodiment of the present invention, in the second implementation of the second aspect of the embodiment of the present invention, described region instruction information includes the direction of gaze information of described user and the range information of described user and video image;
Before in described video image acquisition end equipment indicates information and the network bandwidth to the target area of video image viewing area or nontarget area according to described region, the parameter of the video image of at least one is adjusted, described method also includes:
The described video image acquisition end equipment wide viewing angle according to the user of the direction of gaze information of described user, the range information of described user and video image and acquisition, determine described user overlay area, the visual field on video image viewing area, using the described user overlay area, the visual field on the video image viewing area watching area as described user;
Described video image acquisition end equipment determines target area and the nontarget area of video image viewing area according to the watching area of described user, determining described target area and the described nontarget area positional information on described video image viewing area, described target area is corresponding with the watching area of described user.
The first implementation of second aspect or the second implementation in conjunction with the embodiment of the present invention, in the third implementation of the second aspect of the embodiment of the present invention, described video image acquisition end equipment indicates information and the network bandwidth to be adjusted including to the parameter of the video image of at least one in the target area of video image viewing area or nontarget area according to described region:
When the network bandwidth is less than the first preset threshold value, described video image acquisition end equipment adjusts the parameter of the video image in described nontarget area according to the described network bandwidth and described positional information, and making the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area, described parameter at least includes one in resolution, frame per second and code check;
Or,
When the network bandwidth is less than the first preset threshold value, described video image acquisition end equipment adjusts the parameter of the video image in described nontarget area according to the described network bandwidth and described positional information, and adjust the parameter of video image in described target area, and making the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area, described parameter at least includes one in resolution, frame per second and code check;
Or,
When the network bandwidth is more than or equal to the first preset threshold value, described video image acquisition end equipment adjusts the parameter of the video image in described target area according to the described network bandwidth and described positional information, and making the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area, described parameter at least includes one in resolution, frame per second and code check;
Or,
When the network bandwidth is more than or equal to the first preset threshold value, described video image acquisition end equipment adjusts the parameter of the video image in described target area and described nontarget area according to the described network bandwidth and described positional information, and making the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area, described parameter at least includes one in resolution, frame per second and code check.
The first implementation of second aspect or the second implementation in conjunction with the embodiment of the present invention, in the 4th kind of implementation of the second aspect of the embodiment of the present invention, described video image acquisition end equipment indicates information and the network bandwidth to be adjusted specifically including to the parameter of the video image of at least one in the target area of video image viewing area or nontarget area according to described region:
Obtain the meansigma methods of the network bandwidth in the setting time in real time;
When the numerical value that the meansigma methods of the relatively last network bandwidth obtained of the meansigma methods of the network bandwidth obtained reduces is more than or equal to the second preset threshold value, described video image acquisition end equipment adjusts the parameter of the video image in described nontarget area according to the described network bandwidth and described positional information, and making the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area, described parameter at least includes one in resolution, frame per second and code check;
Or,
When the numerical value that the meansigma methods of the relatively last network bandwidth obtained of the meansigma methods of the network bandwidth obtained reduces is more than or equal to the second preset threshold value, described video image acquisition end equipment adjusts the parameter of the video image in described nontarget area according to the described network bandwidth and described positional information, and adjust the parameter of video image in described target area, and make the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area, described parameter at least includes resolution, frame per second, with in code check,
Or,
When the numerical value that the meansigma methods of the relatively last network bandwidth obtained of the meansigma methods of the network bandwidth obtained raises is more than or equal to three preset threshold values, described video image acquisition end equipment adjusts the parameter of the video image in described target area according to the described network bandwidth and described positional information, and making the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area, described parameter at least includes one in resolution, frame per second and code check.
The embodiment of the present invention third aspect provides a kind of terminal unit, including:
First determines unit, for determining the watching area of user;
Transmitting element, for indicating information to video image acquisition end equipment sending zone, make described video image acquisition end equipment indicate information and the network bandwidth that the parameter of the video image of at least one in the target area of video image viewing area or nontarget area is adjusted according to described region, and make the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area.
In conjunction with the third aspect of the embodiment of the present invention, in the first implementation of the third aspect of the embodiment of the present invention, described first determines that unit includes:
Detection sub-unit, for detecting the direction of gaze of user and the distance of user and video image;
Determine subelement, for the wide viewing angle of the distance according to the direction of gaze of described user detected, described user and video image and the user of acquisition, obtain the watching area of user.
The first implementation in conjunction with the third aspect of the embodiment of the present invention, in the second implementation of the third aspect of the embodiment of the present invention, described determine that subelement is specifically for the distance according to the direction of gaze of described user detected and the wide viewing angle of user of acquisition, described user and video image, determine described user overlay area, the visual field on video image viewing area, using the described user overlay area, the visual field on the video image viewing area watching area as described user.
In conjunction with the second implementation of the third aspect of the embodiment of the present invention or the first implementation of the third aspect or the third aspect, in the third implementation of the third aspect of the embodiment of the present invention, described terminal unit also includes:
Second determines unit, during for including the positional information of the target area of video image viewing area and nontarget area in described region instruction information, at described transmitting element to before video image acquisition end equipment sending zone instruction information, watching area according to described user determines target area and the nontarget area of video image viewing area, and described target area is corresponding with the watching area of described user.
In conjunction with the third implementation of the third aspect of the embodiment of the present invention, in the 4th kind of implementation of the third aspect of the embodiment of the present invention, described second determine unit specifically for
Video image viewing area is divided into target area and nontarget area according to horizontal direction by the watching area according to described user;
Or,
Video image viewing area is divided into target area and nontarget area according to vertical direction by the watching area according to described user;
Or,
Watching area according to described user is according to video image viewing area is horizontally and vertically divided into target area and nontarget area.
In conjunction with the third implementation of the third aspect of the embodiment of the present invention, in the 5th kind of implementation of the third aspect of the embodiment of the present invention, when there being multiple user, described first determines that unit is additionally operable to determine the watching area of all users;
Described second determines that unit is additionally operable to the watching area of all users is merged into comprehensive watching area, determines target area and the nontarget area of video image viewing area according to described comprehensive watching area.
The third implementation in conjunction with the third aspect of the embodiment of the present invention, in the 6th kind of implementation of the third aspect of the embodiment of the present invention, when there being multiple user, described first determines that unit is additionally operable to determine targeted customer according to pre-conditioned, and determines the watching area of described targeted customer;
When described targeted customer is one, described second determines that unit is additionally operable to the watching area according to described targeted customer and determines target area and the nontarget area of video image viewing area;
When described targeted customer is multiple, described second determines that unit is additionally operable to the watching area of the plurality of targeted customer is merged into comprehensive watching area, determines target area and the nontarget area of video image viewing area according to described comprehensive watching area.
The 6th kind of implementation in conjunction with the third aspect of the embodiment of the present invention, in the 7th kind of implementation of the third aspect of the embodiment of the present invention, described first determines that unit is additionally operable to the positional information obtaining the plurality of user with video image, it is determined that the user in the middle of the plurality of user is targeted customer.
In conjunction with the third implementation of the third aspect of the embodiment of the present invention to any one implementation in the 7th kind of implementation of the third aspect, in the 8th kind of implementation of the third aspect of the embodiment of the present invention,
Described terminal unit also includes:
First updating block, for when the angle that the direction of gaze of described user changes within the time set is more than or equal to default value, redefining the watching area of described user and determine target area and the nontarget area of video image viewing area according to the watching area of described user;
Or,
Second updating block, for when keeping the time changed more than or equal to preset threshold value after the direction of gaze of described user, redefining the watching area of described user and determine target area and the nontarget area of video image viewing area according to the watching area of described user;
Or,
3rd updating block, for when described user direction of gaze set time in change angle more than or equal to default value, and the direction of gaze of described user change after time of keeping more than or equal to preset threshold value time, redefine the watching area of described user and determine target area and the nontarget area of video image viewing area according to the watching area of described user.
In conjunction with the third implementation of the third aspect of the embodiment of the present invention to any one implementation in the 8th kind of implementation of the third aspect, in the 9th kind of implementation of the third aspect of the embodiment of the present invention,
Described region instruction information includes the direction of gaze information of described user and the range information of described user and video image.
Embodiment of the present invention fourth aspect provides a kind of equipment providing video image, including:
Receive unit, for receiving the region instruction information that display end equipment sends;
Adjustment unit, for indicating information and the network bandwidth that the parameter of the video image of at least one in the target area of video image viewing area or nontarget area is adjusted according to described region, and make the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area.
In conjunction with the fourth aspect of the embodiment of the present invention, in the first implementation of the fourth aspect of the embodiment of the present invention, the described region instruction information that described reception unit receives includes described target area and the positional information of described nontarget area.
In conjunction with the fourth aspect of the embodiment of the present invention, in the second implementation of the fourth aspect of the embodiment of the present invention, described equipment also includes:
Determine unit, during for including the range information of the direction of gaze information of described user and described user and video image in described region instruction information, before in described adjustment unit indicates information and the network bandwidth to target area or nontarget area according to described region, the parameter of the video image of at least one is adjusted, direction of gaze information according to described user, the wide viewing angle of the range information of described user and video image and the user of acquisition, determine described user overlay area, the visual field on video image viewing area, using the described user overlay area, the visual field on the video image viewing area watching area as described user, watching area according to described user determines target area and the nontarget area of video image viewing area, determining described target area and the described nontarget area positional information on described video image viewing area, described target area is corresponding with the watching area of described user.
In conjunction with the second implementation of the first implementation of fourth aspect of the embodiment of the present invention or fourth aspect, in the third implementation of the fourth aspect of the embodiment of the present invention, described equipment also includes:
Described adjustment unit specifically for
When the network bandwidth is less than the first preset threshold value, the parameter of the video image in described nontarget area is adjusted according to the described network bandwidth and described positional information, and making the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area, described parameter at least includes one in resolution, frame per second and code check;
Or,
When the network bandwidth is less than the first preset threshold value, the parameter of the video image in described nontarget area is adjusted according to the described network bandwidth and described positional information, and adjust the parameter of video image in described target area, and making the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area, described parameter at least includes one in resolution, frame per second and code check;
Or,
When the network bandwidth is more than or equal to the first preset threshold value, the parameter of the video image in described target area is adjusted according to the described network bandwidth and described positional information, and making the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area, described parameter at least includes one in resolution, frame per second and code check;
Or,
When the network bandwidth is more than or equal to the first preset threshold value, the parameter of the video image in described target area and described nontarget area is adjusted according to the described network bandwidth and described positional information, and making the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area, described parameter at least includes one in resolution, frame per second and code check.
In conjunction with the second implementation of the first implementation of fourth aspect of the embodiment of the present invention or fourth aspect, in the 4th kind of implementation of the fourth aspect of the embodiment of the present invention, described equipment also includes:
Described adjustment unit is specifically for obtaining the meansigma methods of the network bandwidth in the setting time in real time;
When the numerical value that the meansigma methods of the relatively last network bandwidth obtained of the meansigma methods of the network bandwidth obtained reduces is more than or equal to the second preset threshold value, the parameter of the video image in described nontarget area is adjusted according to the described network bandwidth and described positional information, and making the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area, described parameter at least includes one in resolution, frame per second and code check;
Or,
When the numerical value that the meansigma methods of the relatively last network bandwidth obtained of the meansigma methods of the network bandwidth obtained reduces is more than or equal to the second preset threshold value, the parameter of the video image in described nontarget area is adjusted according to the described network bandwidth and described positional information, and adjust the parameter of video image in described target area, and making the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area, described parameter at least includes one in resolution, frame per second and code check;
Or,
When the numerical value that the meansigma methods of the relatively last network bandwidth obtained of the meansigma methods of the network bandwidth obtained raises is more than or equal to three preset threshold values, the parameter of the video image in described target area is adjusted according to the described network bandwidth and described positional information, and making the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area, described parameter at least includes one in resolution, frame per second and code check.
The embodiment of the present invention the 5th aspect provides a kind of video image processing system, including:
Display end equipment, for determining the watching area of user, and indicates information to video image acquisition end equipment sending zone;
Video image acquisition end equipment, for receiving the region instruction information that described display end equipment sends, indicate information and the network bandwidth that the parameter of the video image of at least one in the target area of video image viewing area or nontarget area is adjusted according to described region, and make the quality of video image that the quality of the video image in described target area is not less than in described nontarget area.
The 5th aspect in conjunction with the embodiment of the present invention, in the first implementation in the 5th of the embodiment of the present invention the, described display end equipment is additionally operable to when described region instruction information includes the positional information of described target area and described nontarget area, before video image acquisition end equipment sending zone instruction information, watching area according to described user determines target area and the nontarget area of video image viewing area, and described target area is corresponding with the watching area of described user.
The 5th aspect in conjunction with the embodiment of the present invention, in the second implementation in the 5th of the embodiment of the present invention the, the distance of described display end equipment direction of gaze and described user and video image specifically for detecting user, indicate information to described video image acquisition end equipment sending zone, described region instruction information includes the direction of gaze information of described user and the range information of described user and video image;
Before described video image acquisition end equipment is additionally operable in indicating information and the network bandwidth to described target area or described nontarget area according to described region that the parameter of the video image of at least one is adjusted, the wide viewing angle of the range information of the direction of gaze information according to described user, described user and video image and the user of acquisition, determine described user overlay area, the visual field on video image viewing area, using the described user overlay area, the visual field on the video image viewing area watching area as described user; Watching area according to described user determines target area and the nontarget area of video image viewing area, determining described target area and the described nontarget area positional information on described video image viewing area, described target area is corresponding with the watching area of described user.
As can be seen from the above technical solutions, the embodiment of the present invention has the advantage that
After in the embodiment of the present invention, display end equipment determines the watching area of user, information is indicated to video image acquisition end equipment sending zone, video image acquisition end equipment and can be made to be adjusted according to the parameter of the video image of at least one in the network bandwidth target area to video image viewing area or nontarget area, the display quality making target area that user is currently just being look at and nontarget area is adjusted according to the network bandwidth, thus ensure that the Experience Degree of user, improve the utilization rate of network bandwidth resources.
Accompanying drawing explanation
Fig. 1 is an embodiment schematic diagram of the processing method of video image in the embodiment of the present invention;
Fig. 2 is another embodiment schematic diagram of the processing method of video image in the embodiment of the present invention;
Fig. 3 is another embodiment schematic diagram of the processing method of video image in the embodiment of the present invention;
The target area of the determination video image viewing area that Fig. 3-1 provides for the embodiment of the present invention and a kind of method schematic diagram of nontarget area;
The target area of the determination video image viewing area that Fig. 3-2 provides for the embodiment of the present invention and the another kind of method schematic diagram of nontarget area;
The target area of the determination video image viewing area that Fig. 3-3 provides for the embodiment of the present invention and the another kind of method schematic diagram of nontarget area;
Fig. 4 is another embodiment schematic diagram of the processing method of video image in the embodiment of the present invention;
Fig. 5 is another embodiment schematic diagram of the processing method of video image in the embodiment of the present invention;
Fig. 6 is another embodiment schematic diagram of the processing method of video image in the embodiment of the present invention;
Fig. 7 is another embodiment schematic diagram of the processing method of video image in the embodiment of the present invention;
Fig. 8 is another embodiment schematic diagram of the processing method of video image in the embodiment of the present invention;
Fig. 9 is another embodiment schematic diagram of the processing method of video image in the embodiment of the present invention;
Figure 10 is an embodiment schematic diagram of terminal unit in the embodiment of the present invention;
Figure 11 is another embodiment schematic diagram of terminal unit in the embodiment of the present invention;
Figure 12 is another embodiment schematic diagram of terminal unit in the embodiment of the present invention;
Figure 13 is another embodiment schematic diagram of terminal unit in the embodiment of the present invention;
Figure 14 is for providing an embodiment schematic diagram of the equipment of video image in the embodiment of the present invention;
Figure 15 is for providing another embodiment schematic diagram of the equipment of video image in the embodiment of the present invention;
Figure 16 is another embodiment schematic diagram of the process system of video image in the embodiment of the present invention.
Detailed description of the invention
Embodiments providing the processing method of a kind of video image, equipment and system, thus ensure that the Experience Degree of user, improve the utilization rate of network bandwidth resources.
Term " first " in description and claims of this specification and above-mentioned accompanying drawing, " second ", " the 3rd ", " the 4th " etc. are for distinguishing similar object, without being used for describing specific order or precedence. Should be appreciated that the data of so use can be exchanged in appropriate circumstances, in order to the embodiment of the present invention described herein such as can with except here diagram or describe those except order implement.
Referring to Fig. 1, an embodiment of the processing method of the video image that the embodiment of the present invention provides includes:
101, display end equipment determines the watching area of user;
Remote video system has been applied to society's every field, and remote video system generally includes two ends, and one end is video image acquisition end equipment, and the other end is video image display end equipment, video image acquisition end equipment can carry out the collection of video image by video image capture apparatus, the display end equipment of video image can carry out the display of video image by video image display device, above-mentioned video image acquisition end equipment may include that video image capture apparatus and video image acquisition terminal, can also be an equipment of video image capture apparatus and video image acquisition terminal set, it is not construed as limiting herein, above-mentioned video image display end equipment may include that above-mentioned video image display device and display terminal, can also be an equipment of video image display device and display terminal set, it is not construed as limiting herein.
Above-mentioned video image capture apparatus carries out the collection of video image, and the video image collected is sent above-mentioned video image acquisition terminal, after above-mentioned video image acquisition terminal receives the video image that above-mentioned video image capture apparatus sends, the display quality of this video image can be processed, and by the video image after process, it is sent to above-mentioned display terminal by network, the video image now sent has the video image parameter of acquiescence, the above-mentioned video image received can be shown on above-mentioned video image display device by this display terminal, the video image of display on the video image viewing area of user's having video capable of being watched image display, above-mentioned display terminal is mainly useful the broadcasting to video image and is controlled.
When user watches the video image on the video image viewing area of above-mentioned video image display device, above-mentioned display end equipment can determine the first area in the above-mentioned video image viewing area that this user is watching by sensor, and the first area this user watched is as the watching area of this user.
102, display end equipment indicates information to video image acquisition end equipment sending zone, make described video image acquisition end equipment indicate information and the network bandwidth that the parameter of the video image of at least one in the target area of video image viewing area or nontarget area is adjusted according to described region, and make the quality of video image that the quality of the video image in described target area is not less than in described nontarget area;
In the present embodiment, after display end equipment determines the watching area of user, information can be indicated to video image acquisition end equipment sending zone, information is indicated according to region, video image acquisition end equipment may determine that target area and the nontarget area of video image viewing area, video image acquisition end equipment is made to indicate information and the network bandwidth that the parameter of the video image of at least one in the target area of video image viewing area or nontarget area is adjusted according to described region, when adjusting, also need to ensure the quality of the video image that the quality of the video image in described target area is not less than in described nontarget area.
It should be noted that above-mentioned target area can only one of which also can have multiple, above-mentioned nontarget area can only one of which also can have multiple, and the area of above-mentioned target area is more than or equal to the watching area of above-mentioned user.
After display end equipment determines the watching area of user, information can be indicated to video image acquisition end equipment sending zone, after this video image acquisition end equipment receives this region instruction information, information and the current network bandwidth can be indicated according to this region, the parameter of the video image in above-mentioned target area is adjusted by video image acquisition end equipment video image acquisition end equipment, or, the parameter of the video image in above-mentioned nontarget area is adjusted, or, the parameter of the video image in above-mentioned target area and nontarget area is adjusted simultaneously, and the display quality of the display quality of the video image in the guarantee target area video image that is not less than in nontarget area.
Video image acquisition end equipment indicates information and the network bandwidth to be adjusted specifically may is that to the parameter of the video image of at least one in described target area or described nontarget area according to described region
When network bandwidth resources abundance, the video image parameter in target area can be adjusted, improve the display quality of video image in target area, or adjust the video image parameter in target area and nontarget area simultaneously, improve the display quality of video image in target area and nontarget area simultaneously, but ensure the display quality of video image that the display quality of the video image in target area is not less than in nontarget area.
When network bandwidth resources deficiency, the video image parameter in nontarget area can be adjusted, reduce the display quality of video image in mark region, or adjust the video image parameter in target area and nontarget area simultaneously, reduce the display quality of video image in target area and nontarget area simultaneously, but ensure the display quality of video image that the display quality of the video image in target area is not less than in nontarget area.
In the present embodiment, after display end equipment determines the watching area of user, and video image acquisition end equipment is adjusted according to the parameter of the video image of at least one in the network bandwidth target area to video image viewing area or nontarget area, the display quality making target area that user is currently just being look at and nontarget area is adjusted according to the network bandwidth, thus ensureing the Experience Degree of user, improve the utilization rate of network bandwidth resources.
In embodiment described in Fig. 1, display end equipment determines that the watching area of user may is that the direction of gaze of display end equipment Inspection user and the distance of described user and video image; The display end equipment wide viewing angle according to the user of the direction of gaze of the described user detected, the distance of described user and video image and acquisition, obtain the watching area of user, it is described in detail with a specific embodiment below, referring to Fig. 2, another embodiment of the processing method of the video image that the embodiment of the present invention provides includes:
201, the distance of the direction of gaze of display end equipment Inspection user and user and video image;
In the present embodiment, video image display end equipment may include that above-mentioned video image display device and display terminal, it is also possible to is an equipment of video image display device and display terminal set, is not construed as limiting herein.
When video image on the video image viewing area that user watches above-mentioned video image display end equipment, above-mentioned display end equipment includes sensor, can pass through sensor detection and determine the direction of gaze of this eyes of user and the distance of user and video image.
It should be noted that in the present embodiment, the direction of gaze of the eyes of above-mentioned user is preset as the dead ahead of this user, and user specifically sets also dependent on demand, is specifically not construed as limiting herein.
It is understood that the viewing area of above-mentioned video image display device can be ball-type region, it is also possible to be plane domain, it is also possible to be the region of other shapes, be specifically not construed as limiting herein.
It is understood that above-mentioned video image capture apparatus comprises the steps that video camera or the terminal with photographic head, specifically it is not construed as limiting herein.
It is understood that above-mentioned video image display device comprises the steps that one or more LCD display or one or more projector, specifically it is not construed as limiting herein.
202, the display end equipment wide viewing angle according to the user of the direction of gaze of the described user detected, the distance of described user and video image and acquisition, obtains the watching area of user;
In the present embodiment, video image acquisition end equipment may include that video image capture apparatus and video image acquisition terminal, it is also possible to is an equipment of video image capture apparatus and video image acquisition terminal set, is not construed as limiting herein.
After display end equipment determines the direction of gaze of above-mentioned user and the distance of this user and above-mentioned video image, can according to the direction of gaze of user, the wide viewing angle of the distance of user and video image and the user of acquisition, calculate the watching area obtaining user, it is understandable that, the wide viewing angle of the user obtained can be the meansigma methods of the wide viewing angle statistics of preset user, average level visual angle such as user is 110 degree, average vertical visual angle is 90 degree, it can also be the wide viewing angle of the described user obtained in advance, the wide viewing angle information of this user as pre-saved, the horizontal view angle of this user as pre-saved is 115 degree, average vertical visual angle is 89 degree, specifically it is not construed as limiting herein.
It should be noted that, the wide viewing angle of the distance of the direction of gaze of described user, user and video image that above-mentioned basis detects and the user of acquisition, the watching area obtaining user specifically may include that the direction of gaze according to the user detected and the distance of the wide viewing angle of user of acquisition, this user and video image, this user overlay area, the visual field on video image viewing area is determined, using this user overlay area, the visual field on video image viewing area watching area as described user by calculating.
Such as: above-mentioned video image viewing area is plane viewing area, the vertical angle of view width �� of this user is obtained1Being 90 degree, horizontal view angle width is 120 degree, and the distance of this user and video image is L is 1 meter, and the direction of gaze of user is the dead ahead of user, and this user is facing perpendicularly to video image viewing area, then the area S of the overlay area, the visual field of this user can be:
S = θ 1 πL 180 × θ 2 πL 180
Obtain thus calculating, the area S of the overlay area, the visual field of this user is 3.287 square metres, this user is then the region that area is 3.287 square metres on the video image viewing area of this user's dead ahead in the overlay area, the visual field of video image viewing area, and using this overlay area, visual field watching area as user, it is understandable that, it it is only a citing to the watching area determining user herein, in actual applications, may also include other modes obtaining user's watching area, be specifically not construed as limiting herein.
Video image capture apparatus carries out the collection of video image, and the video image collected is sent above-mentioned video image acquisition terminal, after above-mentioned video image acquisition terminal receives the video image that above-mentioned video image capture apparatus sends, the display quality of this video image can be processed, and by the video image after process, it is sent to above-mentioned display terminal by network, the video image now sent has the video image parameter of acquiescence, the above-mentioned video image received can be shown on above-mentioned video image display device by this display terminal, the video image of display on the video image viewing area of user's having video capable of being watched image display, above-mentioned display terminal is mainly useful the broadcasting to video image and is controlled.
When user watches the video image on the video image viewing area of above-mentioned video image display device, above-mentioned display end equipment can determine the first area in the above-mentioned video image viewing area that this user is watching by sensor, and the first area this user watched is as the watching area of this user.
203, display end equipment indicates information to video image acquisition end equipment sending zone;
In the present embodiment, after display end equipment determines the watching area of user, information can be indicated to video image acquisition end equipment sending zone, information is indicated according to region, video image acquisition end equipment may determine that target area and the nontarget area of video image viewing area, described video image acquisition end equipment is made to indicate information and the network bandwidth that the parameter of the video image of at least one in the target area of video image viewing area or described nontarget area is adjusted according to described region, when adjusting, also need to ensure the quality of the video image that the quality of the video image in described target area is not less than in described nontarget area.
It should be noted that the parameter of the video image adjusted at least includes in resolution, frame per second and code check, it is not construed as limiting herein.
Above-mentioned target area can only one of which also can have multiple, and above-mentioned nontarget area can only one of which also can have multiple, is not construed as limiting herein, and the area of above-mentioned target area is more than or equal to the watching area of above-mentioned user.
After display end equipment determines the watching area of user, information can be indicated to video image acquisition end equipment sending zone, after this video image acquisition end equipment receives this region instruction information, information and the current network bandwidth can be indicated according to this region, the parameter of the video image in above-mentioned target area is adjusted by video image acquisition end equipment video image acquisition end equipment, or, the parameter of the video image in above-mentioned nontarget area is adjusted, or, the parameter of the video image in above-mentioned target area and nontarget area is adjusted simultaneously, and the display quality of the display quality of the video image in the guarantee target area video image that is not less than in nontarget area.
Video image acquisition end equipment indicates information and the network bandwidth to be adjusted specifically may is that to the parameter of the video image of at least one in described target area or described nontarget area according to described region
When network bandwidth resources abundance, the video image parameter in target area can be adjusted, improve the display quality of video image in target area, or adjust the video image parameter in target area and nontarget area simultaneously, improve the display quality of video image in target area and nontarget area simultaneously, but ensure the display quality of video image that the display quality of the video image in target area is not less than in nontarget area.
When network bandwidth resources deficiency, the video image parameter in nontarget area can be adjusted, reduce the display quality of video image in mark region, or adjust the video image parameter in target area and nontarget area simultaneously, reduce the display quality of video image in target area and nontarget area simultaneously, but ensure the display quality of video image that the display quality of the video image in target area is not less than in nontarget area.
In the present embodiment, after display end equipment determines the watching area of user, information is indicated to video image acquisition end equipment sending zone, make video image acquisition end equipment according to the network bandwidth target area to video image viewing area or in the parameter of video image at least one nontarget area be adjusted, the display quality making target area that user is currently just being look at and nontarget area is adjusted according to the network bandwidth, thus ensureing the Experience Degree of user, improve the utilization rate of network bandwidth resources;
Secondly, describe the detailed process that display end equipment determines the watching area of user in detail, make implementation more diversified.
In embodiment shown in Fig. 1 and Fig. 2, it instruction information in region can be multiple possibility, region instruction information include target area and nontarget area as described in positional information on video image viewing area, or region instruction information includes the direction of gaze information of user and the range information of user and video image, when region instruction information includes target area and the nontarget area positional information on described video image viewing area, display end equipment also needs to the watching area according to user and determines target area and the nontarget area of video image viewing area, it is described in detail with a specific embodiment below, refer to Fig. 3, another embodiment of the processing method of the video image that the embodiment of the present invention provides includes:
301, the distance of the direction of gaze of display end equipment Inspection user and described user and video image;
In the present embodiment, video image display end equipment may include that above-mentioned video image display device and display terminal, it is also possible to is an equipment of video image display device and display terminal set, is not construed as limiting herein.
When video image on the video image viewing area that user watches above-mentioned video image display end equipment, above-mentioned display end equipment includes sensor, can pass through sensor detection and determine the direction of gaze of this eyes of user and the distance of user and video image.
It should be noted that in the present embodiment, the direction of gaze of the eyes of above-mentioned user is preset as the dead ahead of this user, and user specifically sets also dependent on demand, is specifically not construed as limiting herein.
It is understood that the viewing area of above-mentioned video image display device can be ball-type region, it is also possible to be plane domain, it is also possible to be the region of other shapes, be specifically not construed as limiting herein.
It is understood that above-mentioned video image capture apparatus comprises the steps that video camera or the terminal with photographic head, specifically it is not construed as limiting herein.
It is understood that above-mentioned video image display device comprises the steps that one or more LCD display or one or more projector, specifically it is not construed as limiting herein.
302, the display end equipment wide viewing angle according to the user of the direction of gaze of the described user detected, the distance of described user and video image and acquisition, obtains the watching area of user;
In the present embodiment, video image acquisition end equipment may include that video image capture apparatus and video image acquisition terminal, it is also possible to is an equipment of video image capture apparatus and video image acquisition terminal set, is not construed as limiting herein.
After display end equipment determines the direction of gaze of above-mentioned user and the distance of this user and above-mentioned video image, can according to the direction of gaze of user, the wide viewing angle of the distance of user and video image and the user of acquisition, calculate the watching area obtaining user, it is understandable that, the wide viewing angle of the user obtained can be the meansigma methods of the wide viewing angle statistics of preset user, average level visual angle such as user is 110 degree, average vertical visual angle is 90 degree, it can also be the wide viewing angle of the described user obtained in advance, the wide viewing angle information of this user as pre-saved, the horizontal view angle of this user as pre-saved is 115 degree, average vertical visual angle is 89 degree, specifically it is not construed as limiting herein.
It should be noted that, the wide viewing angle of the distance of the direction of gaze of described user, user and video image that above-mentioned basis detects and the user of acquisition, the watching area obtaining user specifically may include that the direction of gaze according to the user detected and the distance of the wide viewing angle of user of acquisition, this user and video image, this user overlay area, the visual field on video image viewing area is determined, using this user overlay area, the visual field on video image viewing area watching area as described user by calculating.
Above-mentioned video image viewing area is plane viewing area, obtains the vertical angle of view width �� of this user1Being 90 degree, horizontal view angle width is 120 degree, and the distance of this user and video image is L is 1 meter, and the direction of gaze of user is the dead ahead of user, and this user is facing perpendicularly to video image viewing area, then the area S of the overlay area, the visual field of this user can be:
S = θ 1 πL 180 × θ 2 πL 180
Obtain thus calculating, the area S of the overlay area, the visual field of this user is 3.287 square metres, this user is then the region that area is 3.287 square metres on the video image viewing area of this user's dead ahead in the overlay area, the visual field of video image viewing area, and using this overlay area, visual field watching area as user, it is understandable that, it it is only a citing to the watching area determining user herein, in actual applications, may also include other modes obtaining user's watching area, be specifically not construed as limiting herein.
When user watches the video image on the video image viewing area of above-mentioned video image display device, above-mentioned display end equipment can determine the first area in the above-mentioned video image viewing area that this user is watching by sensor, and the first area this user watched is as the watching area of this user.
303, display end equipment determines target area and the nontarget area of video image viewing area according to the watching area of user;
In the present embodiment, described target area is corresponding with the watching area of described user;
After display end equipment determines the watching area of user, according to the watching area of this user, video image viewing area can being divided into target area and nontarget area, this target area is corresponding with the watching area of above-mentioned user.
It should be noted that above-mentioned target area can only one of which also can have multiple, above-mentioned nontarget area can only one of which also can have multiple, and the area of above-mentioned target area is more than or equal to the watching area of above-mentioned user.
Video image viewing area is divided into the concrete division methods of target area and nontarget area by display end equipment can be had multiple, describes in detail for above-mentioned video image viewing area for spheric region below, for instance:
A, watching area according to user, be divided into target area and nontarget area according to horizontal direction by video image viewing area;
As shown in figure 3-1, user A is positioned at spherical video image viewing area central point, the direction of gaze of this user A is surface, preset user horizontal view angle width is 110 degree, user A is r to the distance of video image, then can according to the direction of gaze of user A, the width of preset user perspective, user A to the distance of video image, calculating the watching area obtaining user A is H1, then above-mentioned video image viewing area according to the watching area of user A, can be divided into target area H1 and nontarget area H2 and H3 according to horizontal direction by display end equipment.
B, watching area according to user, be divided into target area and nontarget area according to vertical direction by video image viewing area;
As shown in figure 3-2, user A is positioned at spherical video image viewing area central point, the direction of gaze of this user A is front-right, preset user horizontal view angle width is 110 degree, preset user vertical angle of view width is 90 degree, user A is r to the distance of video image, then can according to the direction of gaze of user A, the width of the user perspective obtained, user A is to the distance of video image, calculating the watching area obtaining user A is V1, then display end equipment can according to the watching area of user A, according to horizontal direction, above-mentioned video image viewing area is divided into target area V1 and nontarget area V2.
C, watching area according to user, according to video image viewing area is horizontally and vertically divided into target area and nontarget area.
In conjunction with Fig. 3-1 and Fig. 3-2, as shown in Fig. 3-3, user A is positioned at spherical video image viewing area central point, the direction of gaze of this user A is dead ahead side, the user vertical angle of view width obtained is 90 degree, user A is r to the distance of video image, then can according to the direction of gaze of user A, the width of preset user perspective, user A is to the distance of video image, calculating the watching area obtaining user A is H1V1, then display end equipment can according to the watching area of user A, according to horizontal direction, above-mentioned video image viewing area is divided into target area H1V1 and nontarget area H1V2, H2V2, H3V2, H2V1, H3V1.
In the present embodiment, display end equipment, behind the target area and the nontarget area that determine video image viewing area according to the watching area of user, namely may know that the positional information of the target area of video image viewing area and nontarget area.
304, display end equipment indicates information to video image acquisition end equipment sending zone;
In the present embodiment, described region instruction information includes the target area of video image viewing area and the positional information of nontarget area, it should be noted that, instruction information in region can not include the target area of video image viewing area and the positional information of nontarget area, the direction of gaze information of user as described in can including in region instruction information and as described in the range information of user and video image, send this region instruction information to video image acquisition end equipment, video image acquisition end equipment is allowed to be determined the target area of video image viewing area and the step of nontarget area, then in the present embodiment, step 303 can be cancelled, it is not construed as limiting herein.
After display end equipment determines the watching area of user, information can be indicated to video image acquisition end equipment sending zone, information is indicated according to region, video image acquisition end equipment may determine that target area and the nontarget area of video image viewing area, described video image acquisition end equipment is made to indicate information and the network bandwidth that the parameter of the video image of at least one in the target area of video image viewing area or described nontarget area is adjusted according to described region, when adjusting, also need to ensure the quality of the video image that the quality of the video image in described target area is not less than in described nontarget area.
It should be noted that the parameter of the video image adjusted at least includes in resolution, frame per second and code check, it is not construed as limiting herein.
Above-mentioned target area can only one of which also can have multiple, and above-mentioned nontarget area can only one of which also can have multiple, and the area of above-mentioned target area is more than or equal to the watching area of above-mentioned user.
After display end equipment determines the watching area of user, information can be indicated to video image acquisition end equipment sending zone, after this video image acquisition end equipment receives this region instruction information, information and the current network bandwidth can be indicated according to this region, the parameter of the video image in above-mentioned target area is adjusted by video image acquisition end equipment video image acquisition end equipment, or, the parameter of the video image in above-mentioned nontarget area is adjusted, or, the parameter of the video image in above-mentioned target area and nontarget area is adjusted simultaneously, and the display quality of the display quality of the video image in the guarantee target area video image that is not less than in nontarget area.
Video image acquisition end equipment indicates information and the network bandwidth to be adjusted specifically may is that to the parameter of the video image of at least one in described target area or described nontarget area according to described region
When network bandwidth resources abundance, the video image parameter in target area can be adjusted, improve the display quality of video image in target area, or adjust the video image parameter in target area and nontarget area simultaneously, improve the display quality of video image in target area and nontarget area simultaneously, but ensure the display quality of video image that the display quality of the video image in target area is not less than in nontarget area.
When network bandwidth resources deficiency, the video image parameter in nontarget area can be adjusted, reduce the display quality of video image in mark region, or adjust the video image parameter in target area and nontarget area simultaneously, reduce the display quality of video image in target area and nontarget area simultaneously, but ensure the display quality of video image that the display quality of the video image in target area is not less than in nontarget area.
In the present embodiment, after display end equipment determines the watching area of user, information is indicated to video image acquisition end equipment sending zone, can so that video image acquisition end equipment be adjusted according to the parameter of the video image of at least one in the network bandwidth target area to video image viewing area or nontarget area, the display quality making target area that user is currently just being look at and nontarget area is adjusted according to the network bandwidth, thus ensureing the Experience Degree of user, improve the utilization rate of network bandwidth resources;
Secondly, describe in detail and instruction information in region can directly include the target area of video image viewing area and the positional information of nontarget area, make video image acquisition end equipment, according to the network bandwidth, the parameter of the video image of at least one in this target area or nontarget area are made directly adjustment, described target area and nontarget area need not be determined by video image acquisition end equipment, decrease the workload of video image acquisition end equipment.
In embodiment illustrated in fig. 3, description is the situation of a user, and in actual applications, when there being multiple user, display end equipment can determine above-mentioned target area and nontarget area in several ways, is described in detail separately below:
One, the watching area of multiple users is merged into comprehensive watching area
Referring to Fig. 4, another embodiment of the processing method of the video image that the embodiment of the present invention provides includes:
401, display end equipment detects the direction of gaze of each user and the distance of each user and video image respectively;
In the present embodiment, video image display end equipment may include that above-mentioned video image display device and display terminal, it is also possible to is an equipment of video image display device and display terminal set, is not construed as limiting herein.
In the present embodiment, user has multiple, when video image on the video image viewing area that user watches above-mentioned video image display end equipment, above-mentioned display end equipment can detect the direction of gaze of all eyes of user and the distance of user and video image by sensor, detection mode can be the distance of direction of gaze and user and the video image detecting multiple eyes of user successively, disposal ability according to display end equipment can also be detect simultaneously, is not construed as limiting herein.
It should be noted that in the present embodiment, the direction of gaze of the eyes of user is preset as the dead ahead of this user, and user specifically sets also dependent on demand, is specifically not construed as limiting herein.
It is understood that the viewing area of above-mentioned video image display device can be ball-type region, it is also possible to be plane domain, it is also possible to be the region of other shapes, be specifically not construed as limiting herein.
It is understood that above-mentioned video image capture apparatus comprises the steps that video camera or the terminal with photographic head, specifically it is not construed as limiting herein.
It is understood that above-mentioned video image display device comprises the steps that one or more LCD display or one or more projector, specifically it is not construed as limiting herein.
402, the display end equipment wide viewing angle according to the user of the direction of gaze of each user detected, the distance of each user and video image and acquisition, respectively obtains the watching area of each user;
In the present embodiment, video image acquisition end equipment may include that video image capture apparatus and video image acquisition terminal, it is also possible to is an equipment of video image capture apparatus and video image acquisition terminal set, is not construed as limiting herein.
After display end equipment determines the direction of gaze of each user and the distance of this user and above-mentioned video image, can according to the direction of gaze of user, the wide viewing angle of the distance of user and video image and the user of acquisition, calculate the watching area obtaining user, it is understandable that, the wide viewing angle of the user obtained can be the meansigma methods of the wide viewing angle statistics of preset user, average level visual angle such as user is 110 degree, average vertical visual angle is 90 degree, it can also be the wide viewing angle of the described user obtained in advance, the wide viewing angle information of this user as pre-saved, the horizontal view angle of this user as pre-saved is 115 degree, average vertical visual angle is 89 degree, specifically it is not construed as limiting herein.
It should be noted that, the wide viewing angle of the distance of the direction of gaze of each user, user and video image that above-mentioned basis detects and the user of acquisition, the watching area obtaining each user specifically may include that the direction of gaze according to each user detected and the distance of the wide viewing angle of user of acquisition, this user and video image, this user overlay area, the visual field on video image viewing area is determined, using this user overlay area, the visual field on video image viewing area watching area as described user by calculating.
Such as: above-mentioned video image viewing area is plane viewing area, the vertical angle of view width �� of this user1Being 90 degree, horizontal view angle width is 120 degree, and the distance of this user and video image is L is 1 meter, and the direction of gaze of user is the dead ahead of user, and this user is facing perpendicularly to video image viewing area, then the area S of the overlay area, the visual field of this user can be:
S = θ 1 πL 180 × θ 2 πL 180
Obtain thus calculating, the area S of the overlay area, the visual field of this user is 3.287 square metres, this user is then the region that area is 3.287 square metres on the video image viewing area of this user's dead ahead in the overlay area, the visual field of video image viewing area, and using this overlay area, visual field watching area as user, it is understandable that, it it is only a citing to the watching area determining user herein, in actual applications, may also include other modes obtaining user's watching area, be specifically not construed as limiting herein.
When user watches the video image on the video image viewing area of above-mentioned video image display device, display end equipment can determine the first area in the above-mentioned video image viewing area that this user is watching by sensor, and the first area this user watched is as the watching area of this user.
Display end equipment respectively obtains the watching area of each user, namely completes to determine the watching area of all users.
403, the watching area of all users is merged into comprehensive watching area by display end equipment, determines target area and the nontarget area of video image viewing area according to described comprehensive watching area;
In the present embodiment, described target area is corresponding with described comprehensive watching area;
After display end equipment determines the watching area of all users, can according to the watching area of all users, the watching area of all users is merged into comprehensive watching area, then video image viewing area is divided into target area and nontarget area, and this target area is corresponding with above-mentioned comprehensive watching area.
It should be noted that above-mentioned target area can only one of which also can have multiple, above-mentioned nontarget area can only one of which also can have multiple, and the area of above-mentioned target area is more than or equal to the watching area of above-mentioned user.
Video image viewing area is divided into the concrete division methods of target area and nontarget area by display end equipment can be had multiple, describes in detail for above-mentioned video image viewing area for spheric region below, for instance:
A, according to comprehensive watching area, according to horizontal direction, video image viewing area is divided into target area and nontarget area;
B, according to comprehensive watching area, according to vertical direction, video image viewing area is divided into target area and nontarget area;
C, according to comprehensive watching area, according to horizontally and vertically video image viewing area being divided into target area and nontarget area.
The comprehensive watching area of above-mentioned basis, is divided into video image viewing area target area and the three of nontarget area kinds of modes similar with the embodiment shown in Fig. 3 (substituting the watching area of user with comprehensive watching area), repeats no more herein.
In the present embodiment, display end equipment, behind the target area and the nontarget area that determine video image viewing area according to comprehensive watching area, namely may know that the positional information of the target area of video image viewing area and nontarget area.
404, display end equipment indicates information to video image acquisition end equipment sending zone;
In the present embodiment, described region instruction information includes the target area of video image viewing area and the positional information of nontarget area, it should be noted that, instruction information in region can not include the target area of video image viewing area and the positional information of nontarget area, the direction of gaze information of user as described in can including in region instruction information and as described in the range information of user and video image, send this region instruction information to video image acquisition end equipment, video image acquisition end equipment is allowed to be determined the target area of video image viewing area and the step of nontarget area, then in the present embodiment, step 403 can be cancelled, it is not construed as limiting herein.
After display end equipment determines the watching area of user, information can be indicated to video image acquisition end equipment sending zone, information is indicated according to region, video image acquisition end equipment may determine that target area and the nontarget area of video image viewing area, described video image acquisition end equipment is made to indicate information and the network bandwidth that the parameter of the video image of at least one in the target area of video image viewing area or described nontarget area is adjusted according to described region, when adjusting, also need to ensure the quality of the video image that the quality of the video image in described target area is not less than in described nontarget area.
It should be noted that the parameter of the video image adjusted at least includes in resolution, frame per second and code check, it is not construed as limiting herein.
Above-mentioned target area can only one of which also can have multiple, and above-mentioned nontarget area can only one of which also can have multiple, and the area of above-mentioned target area is more than or equal to the watching area of above-mentioned user.
After display end equipment determines the watching area of user, information can be indicated to video image acquisition end equipment sending zone, after this video image acquisition end equipment receives this region instruction information, information and the current network bandwidth can be indicated according to this region, the parameter of the video image in above-mentioned target area is adjusted by video image acquisition end equipment video image acquisition end equipment, or, the parameter of the video image in above-mentioned nontarget area is adjusted, or, the parameter of the video image in above-mentioned target area and nontarget area is adjusted simultaneously, and the display quality of the display quality of the video image in the guarantee target area video image that is not less than in nontarget area.
Video image acquisition end equipment indicates information and the network bandwidth to be adjusted specifically may is that to the parameter of the video image of at least one in described target area or described nontarget area according to described region
When network bandwidth resources abundance, the video image parameter in target area can be adjusted, improve the display quality of video image in target area, or adjust the video image parameter in target area and nontarget area simultaneously, improve the display quality of video image in target area and nontarget area simultaneously, but ensure the display quality of video image that the display quality of the video image in target area is not less than in nontarget area.
When network bandwidth resources deficiency, the video image parameter in nontarget area can be adjusted, reduce the display quality of video image in mark region, or adjust the video image parameter in target area and nontarget area simultaneously, reduce the display quality of video image in target area and nontarget area simultaneously, but ensure the display quality of video image that the display quality of the video image in target area is not less than in nontarget area.
In the present embodiment, the direction of gaze of user may be real-time change, the target area of video image viewing area and nontarget area are likely to also can change, in order to improve user experience, can set that the condition of the angle that the direction of gaze of time that the direction of gaze of user changes or/and user changes, when meeting these conditions, display end equipment can redefine the watching area of described user and determine target area and the nontarget area of video image viewing area according to the watching area of described user.
Display end equipment can redefine the watching area of described user and the watching area according to described user determines that the target area of video image viewing area and nontarget area may include that
When the angle that the direction of gaze of described user changes within the time set is more than or equal to default value, described display end equipment redefines the watching area of described user and determines target area and the nontarget area of video image viewing area according to the watching area of described user, such as, assume that time of setting is as 5s, presetting angle numerical value is 10 ��, when the direction of gaze of user changes 11 �� (having exceeded 10 ��) in 5s, then display end equipment redefines the watching area of described user and determines target area and the nontarget area of video image viewing area according to the watching area of described user,
Or,
When after the direction of gaze of described user changes, the time of maintenance is more than or equal to preset threshold value, described display end equipment redefines the watching area of described user and determines target area and the nontarget area of video image viewing area according to the watching area of described user, such as assume that preset time threshold is 3s, assume that the direction of gaze of user is 4s (having exceeded 3s) in the time that this gaze angle keeps after changing, then display end equipment redefines the watching area of described user and determines target area and the nontarget area of video image viewing area according to the watching area of described user, now then can be left out the size that user's gaze angle changes,
Or,
When described user direction of gaze set time in change angle more than or equal to default value, and the direction of gaze of described user change after time of keeping more than or equal to preset threshold value time, described display end equipment redefines the watching area of described user and determines target area and the nontarget area of video image viewing area according to the watching area of described user, the time that the direction of gaze of user keeps after changing is the calculating when the angle-determining that the direction of gaze of user changes, such as assume that time of setting is as 5s, presetting angle numerical value is 10 ��, preset time threshold is 3s, when the direction of gaze of user changes 11 �� (having exceeded 10 ��) in 5s, and the direction of gaze of user to change after 11 �� in the time that this gaze angle keeps be 4s (having exceeded 3s), then display end equipment redefines the watching area of described user and determines target area and the nontarget area of video image viewing area according to the watching area of described user.
Above-mentioned display end equipment redefines the watching area of described user and determines that the target area of video image viewing area and the mode of nontarget area are referred to step 401 and determine the target area of video image viewing area and the mode of nontarget area to user in 404 according to the watching area of described user, repeats no more herein.
Two, the watching area of one or more targeted customers in multiple user is determined;
Referring to Fig. 5, another embodiment of the processing method of the video image that the embodiment of the present invention provides includes:
501, display end equipment detects the direction of gaze of each user and the distance of each user and video image respectively;
In the present embodiment, video image display end equipment may include that above-mentioned video image display device and display terminal, it is also possible to is an equipment of video image display device and display terminal set, is not construed as limiting herein.
In the present embodiment, user has multiple, when video image on the video image viewing area that user watches above-mentioned video image display end equipment, above-mentioned display end equipment can detect the direction of gaze of all eyes of user and the distance of user and video image by sensor, detection mode can be the distance of direction of gaze and user and the video image detecting multiple eyes of user successively, disposal ability according to display end equipment can also be detect simultaneously, is not construed as limiting herein.
It should be noted that in the present embodiment, the direction of gaze of the eyes of user is preset as the dead ahead of this user, and user specifically sets also dependent on demand, is specifically not construed as limiting herein.
It is understood that the viewing area of above-mentioned video image display device can be ball-type region, it is also possible to be plane domain, it is also possible to be the region of other shapes, be specifically not construed as limiting herein.
It is understood that above-mentioned video image capture apparatus comprises the steps that video camera or the terminal with photographic head, specifically it is not construed as limiting herein.
It is understood that above-mentioned video image display device comprises the steps that one or more LCD display or one or more projector, specifically it is not construed as limiting herein.
502, the display end equipment wide viewing angle according to the user of the direction of gaze of each user detected, the distance of each user and video image and acquisition, respectively obtains the watching area of each user;
In the present embodiment, video image acquisition end equipment may include that video image capture apparatus and video image acquisition terminal, it is also possible to is an equipment of video image capture apparatus and video image acquisition terminal set, is not construed as limiting herein.
After display end equipment determines the direction of gaze of above-mentioned user and the distance of this user and above-mentioned video image, can according to the direction of gaze of user, the wide viewing angle of the distance of user and video image and the user of acquisition, calculate the watching area obtaining user, it is understandable that, the wide viewing angle of the user obtained can be the meansigma methods of the wide viewing angle statistics of preset user, average level visual angle such as user is 110 degree, average vertical visual angle is 90 degree, it can also be the wide viewing angle of the described user obtained in advance, the wide viewing angle information of this user as pre-saved, the horizontal view angle of this user as pre-saved is 115 degree, average vertical visual angle is 89 degree, specifically it is not construed as limiting herein.
It should be noted that, the wide viewing angle of the distance of the direction of gaze of each user, user and video image that above-mentioned basis detects and the user of acquisition, the watching area obtaining each user specifically may include that the direction of gaze according to each user detected and the distance of the wide viewing angle of user of acquisition, this user and video image, this user overlay area, the visual field on video image viewing area is determined, using this user overlay area, the visual field on video image viewing area watching area as described user by calculating.
Such as: above-mentioned video image viewing area is plane viewing area, the vertical angle of view width �� of this user1Being 90 degree, horizontal view angle width is 120 degree, and the distance of this user and video image is L is 1 meter, and the direction of gaze of user is the dead ahead of user, and this user is facing perpendicularly to video image viewing area, then the area S of the overlay area, the visual field of this user can be:
S = θ 1 πL 180 × θ 2 πL 180
Obtain thus calculating, the area S of the overlay area, the visual field of this user is 3.287 square metres, this user is then the region that area is 3.287 square metres on the video image viewing area of this user's dead ahead in the overlay area, the visual field of video image viewing area, and using this overlay area, visual field watching area as user, it is understandable that, it it is only a citing to the watching area determining user herein, in actual applications, may also include other modes obtaining user's watching area, be specifically not construed as limiting herein.
When user watches the video image on the video image viewing area of above-mentioned video image display device, display end equipment can determine the first area in the above-mentioned video image viewing area that this user is watching by sensor, and the first area this user watched is as the watching area of this user.
Display end equipment respectively obtains the watching area of each user, namely completes to determine the watching area of all users.
503, display end equipment determines targeted customer according to pre-conditioned, and determines the watching area of targeted customer;
Described display end equipment may include that according to the pre-conditioned targeted customer of determination
Described display end equipment obtains the positional information of the plurality of user and video image, determine that the user in the middle of the plurality of user is targeted customer, user in the middle of multiple users for video image viewing area just to direction be reference direction, when described number of users is even number, middle user is even number, now, the even number user that can select centre is targeted customer, such as, when number of users is 2, can select two users is targeted customer, when number of users is 4, 2 users that can select centre are targeted customer, when number of users is 6, 2 users of centre now both can be selected, 4 users of centre can also be selected, certainly, when number of users is even number, the user of centre can also be first determined by mode above, then the more than one user choosing centre is targeted customer, when described number of users is odd number, one that can directly select middle is targeted customer, can also determine that middle odd number is for targeted customer, when being 5 such as number of users, determine that middle 1 user is targeted customer, or determine that 3 users of centre are targeted customer, the concrete mode of the above-mentioned targeted customer of determination is not construed as limiting herein.
After determining targeted customer, can according to the watching area obtaining each user obtained in above-mentioned steps, it is determined that the watching area of targeted customer.
504, display end equipment determines target area and the nontarget area of video image viewing area according to the watching area of targeted customer;
When described targeted customer is one, according to the watching area of described user, described display end equipment determines that the target area of video image viewing area and nontarget area include:
Described display end equipment determines target area and the nontarget area of video image viewing area according to the watching area of described targeted customer;
When described targeted customer is multiple, according to the watching area of described user, described display end equipment determines that the target area of video image viewing area and nontarget area include:
The watching area of the plurality of targeted customer is merged into comprehensive watching area by described display end equipment, determines target area and the nontarget area of video image viewing area according to described comprehensive watching area.
The watching area of the above-mentioned comprehensive watching area according to multiple targeted customers or targeted customer, is divided into video image viewing area target area similar with the embodiment shown in Fig. 4 or Fig. 3 with the three of nontarget area kinds of modes, repeats no more herein.
In the present embodiment, display end equipment, behind the target area and the nontarget area that determine video image viewing area according to comprehensive watching area, namely may know that the positional information of the target area of video image viewing area and nontarget area.
504, display end equipment indicates information to video image acquisition end equipment sending zone;
In the present embodiment, described region instruction information includes the target area of video image viewing area and the positional information of nontarget area, it should be noted that, instruction information in region can not include the target area of video image viewing area and the positional information of nontarget area, the direction of gaze information of user as described in can including in region instruction information and as described in the range information of user and video image, send this region instruction information to video image acquisition end equipment, video image acquisition end equipment is allowed to be determined the target area of video image viewing area and the step of nontarget area, then in the present embodiment, step 503 can be cancelled, it is not construed as limiting herein.
After display end equipment determines the watching area of user, information can be indicated to video image acquisition end equipment sending zone, information is indicated according to region, video image acquisition end equipment may determine that target area and the nontarget area of video image viewing area, described video image acquisition end equipment is made to indicate information and the network bandwidth that the parameter of the video image of at least one in the target area of video image viewing area or described nontarget area is adjusted according to described region, when adjusting, also need to ensure the quality of the video image that the quality of the video image in described target area is not less than in described nontarget area.
It should be noted that the parameter of the video image adjusted at least includes in resolution, frame per second and code check, it is not construed as limiting herein.
Above-mentioned target area can only one of which also can have multiple, and above-mentioned nontarget area can only one of which also can have multiple, and the area of above-mentioned target area is more than or equal to the watching area of above-mentioned user.
After display end equipment determines the watching area of user, information can be indicated to video image acquisition end equipment sending zone, after this video image acquisition end equipment receives this region instruction information, information and the current network bandwidth can be indicated according to this region, the parameter of the video image in above-mentioned target area is adjusted by video image acquisition end equipment video image acquisition end equipment, or, the parameter of the video image in above-mentioned nontarget area is adjusted, or, the parameter of the video image in above-mentioned target area and nontarget area is adjusted simultaneously, and the display quality of the display quality of the video image in the guarantee target area video image that is not less than in nontarget area.
Video image acquisition end equipment indicates information and the network bandwidth to be adjusted specifically may is that to the parameter of the video image of at least one in described target area or described nontarget area according to described region
When network bandwidth resources abundance, the video image parameter in target area can be adjusted, improve the display quality of video image in target area, or adjust the video image parameter in target area and nontarget area simultaneously, improve the display quality of video image in target area and nontarget area simultaneously, but ensure the display quality of video image that the display quality of the video image in target area is not less than in nontarget area.
When network bandwidth resources deficiency, the video image parameter in nontarget area can be adjusted, reduce the display quality of video image in mark region, or adjust the video image parameter in target area and nontarget area simultaneously, reduce the display quality of video image in target area and nontarget area simultaneously, but ensure the display quality of video image that the display quality of the video image in target area is not less than in nontarget area.
In the present embodiment, the direction of gaze of user may be real-time change, the target area of video image viewing area and nontarget area are likely to also can change, in order to improve user experience, can set that time that the direction of gaze of user changes or/and the condition of angle that changes of the direction of gaze of user, when meeting these conditions, display end equipment can redefine the watching area of described user and determine target area and the nontarget area of video image viewing area according to the watching area of described user.
Display end equipment can redefine the watching area of described user and the watching area according to described user determines that the target area of video image viewing area and nontarget area may include that
When the angle that the direction of gaze of described user changes within the time set is more than or equal to default value, described display end equipment redefines the watching area of described user and determines target area and the nontarget area of video image viewing area according to the watching area of described user, such as, assume that time of setting is as 5s, presetting angle numerical value is 10 ��, when the direction of gaze of user changes 11 �� (having exceeded 10 ��) in 5s, then display end equipment redefines the watching area of described user and determines target area and the nontarget area of video image viewing area according to the watching area of described user,
Or,
When after the direction of gaze of described user changes, the time of maintenance is more than or equal to preset threshold value, described display end equipment redefines the watching area of described user and determines target area and the nontarget area of video image viewing area according to the watching area of described user, such as assume that preset time threshold is 3s, assume that the direction of gaze of user is 4s (having exceeded 3s) in the time that this gaze angle keeps after changing, then display end equipment redefines the watching area of described user and determines target area and the nontarget area of video image viewing area according to the watching area of described user, now then can be left out the size that user's gaze angle changes,
Or,
When described user direction of gaze set time in change angle more than or equal to default value, and the direction of gaze of described user change after time of keeping more than or equal to preset threshold value time, described display end equipment redefines the watching area of described user and determines target area and the nontarget area of video image viewing area according to the watching area of described user, the time that the direction of gaze of user keeps after changing is the calculating when the angle-determining that the direction of gaze of user changes, such as assume that time of setting is as 5s, presetting angle numerical value is 10 ��, preset time threshold is 3s, when the direction of gaze of user changes 11 �� (having exceeded 10 ��) in 5s, and the direction of gaze of user to change after 11 �� in the time that this gaze angle keeps be 4s (having exceeded 3s), then display end equipment redefines the watching area of described user and determines target area and the nontarget area of video image viewing area according to the watching area of described user.
Above-mentioned display end equipment redefines the watching area of described user and determines that the target area of video image viewing area and the mode of nontarget area are referred in Fig. 3 to Fig. 4 one or more users and determine the target area of video image viewing area and the mode of nontarget area according to the watching area of described user, repeats no more herein.
The processing method of the video image that the embodiment of the present invention provides is described by the embodiment shown in Fig. 1 to Fig. 5 from display end equipment side, from video image acquisition end equipment side, the processing method of the video image that the embodiment of the present invention provides is described in detail below, referring to Fig. 6, another embodiment of the processing method of the video image that the embodiment of the present invention provides includes:
601, video image acquisition end equipment receives the region instruction information that display end equipment sends;
Remote video system has been applied to society's every field, and remote video system generally includes two ends, and one end is video image acquisition end equipment, and the other end is video image display end equipment, video image acquisition end equipment can carry out the collection of video image by video image capture apparatus, the display end equipment of video image can carry out the display of video image by video image display device, above-mentioned video image acquisition end equipment may include that video image capture apparatus and video image acquisition terminal, can also be an equipment of video image capture apparatus and video image acquisition terminal set, it is not construed as limiting herein, above-mentioned video image display end equipment may include that above-mentioned video image display device and display terminal, can also be an equipment of video image display device and display terminal set, it is not construed as limiting herein.
Video image capture apparatus carries out the collection of video image, and the video image collected is sent above-mentioned video image acquisition terminal, after above-mentioned video image acquisition terminal receives the video image that above-mentioned video image capture apparatus sends, the display quality of this video image can be processed, and by the video image after process, it is sent to above-mentioned display terminal by network, the video image now sent has the video image parameter of acquiescence, the above-mentioned video image received can be shown on above-mentioned video image display device by this display terminal, the video image of display on the video image viewing area of user's having video capable of being watched image display, above-mentioned display terminal is mainly useful the broadcasting to video image and is controlled.
When user watches the video image on the video image viewing area of above-mentioned video image display device, above-mentioned display end equipment can determine the first area in the above-mentioned video image viewing area that this user is watching by sensor, and the first area this user watched is as the watching area of this user.
In the present embodiment, after display end equipment determines the watching area of user, information can be indicated to video image acquisition end equipment sending zone.
602, video image acquisition end equipment indicates information and the network bandwidth that the parameter of the video image of at least one in the target area of video image viewing area or nontarget area is adjusted according to region;
Information is indicated according to region, video image acquisition end equipment may determine that target area and the nontarget area of video image viewing area, video image acquisition end equipment is made to indicate information and the network bandwidth that the parameter of the video image of at least one in the target area of video image viewing area or nontarget area is adjusted according to described region, when adjusting, in addition it is also necessary to ensure the quality of the video image that the quality of the video image in described target area is not less than in described nontarget area.
It should be noted that above-mentioned target area can only one of which also can have multiple, above-mentioned nontarget area can only one of which also can have multiple, and the area of above-mentioned target area is more than or equal to the watching area of above-mentioned user.
After video image acquisition end equipment receives this region instruction information, information and the current network bandwidth can be indicated according to this region, the parameter of the video image in above-mentioned target area is adjusted by video image acquisition end equipment video image acquisition end equipment, or, the parameter of the video image in above-mentioned nontarget area is adjusted, or, the parameter of the video image in above-mentioned target area and nontarget area is adjusted simultaneously, and the display quality of the display quality of the video image in the guarantee target area video image that is not less than in nontarget area.
Video image acquisition end equipment indicates information and the network bandwidth to be adjusted specifically may is that to the parameter of the video image of at least one in described target area or described nontarget area according to described region
When network bandwidth resources abundance, the video image parameter in target area can be adjusted, improve the display quality of video image in target area, or adjust the video image parameter in target area and nontarget area simultaneously, improve the display quality of video image in target area and nontarget area simultaneously, but ensure the display quality of video image that the display quality of the video image in target area is not less than in nontarget area.
When network bandwidth resources deficiency, the video image parameter in nontarget area can be adjusted, reduce the display quality of video image in mark region, or adjust the video image parameter in target area and nontarget area simultaneously, reduce the display quality of video image in target area and nontarget area simultaneously, but ensure the display quality of video image that the display quality of the video image in target area is not less than in nontarget area.
In the present embodiment, video image acquisition end equipment receives the region instruction information that display end equipment sends, indicate information and the network bandwidth that the parameter of the video image of at least one in the target area of video image viewing area or nontarget area is adjusted according to region, the display quality making target area that user is currently just being look at and nontarget area is adjusted according to the network bandwidth, thus ensureing the Experience Degree of user, improve the utilization rate of network bandwidth resources.
In embodiment illustrated in fig. 6, region instruction information can have various ways, region instruction information include as described in target area and as described in the positional information of nontarget area, or region instruction information includes the direction of gaze information of user and the range information of user and video image, it is discussed in detail with specific embodiment below:
One, instruction information in region includes described target area and the positional information of described nontarget area;
Video image acquisition end equipment indicates information to may determine that the target area of video image viewing area and described nontarget area according to region, and video image acquisition end equipment indicates information and the network bandwidth that the parameter of the video image of at least one in the target area of video image viewing area or described nontarget area is adjusted according to described region.
Two, instruction information in region includes the direction of gaze information of user and the range information of user and video image;
Referring to Fig. 7, another embodiment of the processing method of the video image that the embodiment of the present invention provides includes:
701, video image acquisition end equipment receives the region instruction information that display end equipment sends;
In the present embodiment, region instruction information includes the direction of gaze information of user and the range information of user and video image;
Video image acquisition end equipment may include that video image capture apparatus and video image acquisition terminal, can also be an equipment of video image capture apparatus and video image acquisition terminal set, it is not construed as limiting herein, above-mentioned video image display end equipment may include that above-mentioned video image display device and display terminal, can also be an equipment of video image display device and display terminal set, be not construed as limiting herein.
Video image capture apparatus carries out the collection of video image, and the video image collected is sent above-mentioned video image acquisition terminal, after above-mentioned video image acquisition terminal receives the video image that above-mentioned video image capture apparatus sends, the display quality of this video image can be processed, and by the video image after process, it is sent to above-mentioned display terminal by network, the video image now sent has the video image parameter of acquiescence, the above-mentioned video image received can be shown on above-mentioned video image display device by this display terminal, the video image of display on the video image viewing area of user's having video capable of being watched image display, above-mentioned display terminal is mainly useful the broadcasting to video image and is controlled.
When user watches the video image on the video image viewing area of above-mentioned video image display device, above-mentioned display end equipment can determine the first area in the above-mentioned video image viewing area that this user is watching by sensor, and the first area this user watched is as the watching area of this user.
It is understood that above-mentioned video image capture apparatus comprises the steps that video camera or the terminal with photographic head, specifically it is not construed as limiting herein.
It is understood that video image display device comprises the steps that one or more LCD display or one or more projector, specifically it is not construed as limiting herein.
It is understood that the viewing area of video image display device can be ball-type region, it is also possible to be plane domain, it is also possible to be the region of other shapes, be specifically not construed as limiting herein.
In the present embodiment, instruction information in region can also include the wide viewing angle information of user, after display end equipment determines the watching area of user, information can be indicated to video image acquisition end equipment sending zone.
702, the video image acquisition end equipment wide viewing angle according to the range information of the direction of gaze information of user, user and video image and the user of acquisition, determine described user overlay area, the visual field on video image viewing area, using the described user overlay area, the visual field on the video image viewing area watching area as described user;
After video image acquisition end equipment obtains the direction of gaze of the user in region instruction information and the distance of this user and video image, can according to the wide viewing angle of the distance of the direction of gaze of user, user and video image and the user of acquisition, calculate the watching area obtaining user, it is understandable that, the wide viewing angle of the user obtained can be the meansigma methods of the wide viewing angle statistics of preset user, can also be the wide viewing angle information of the described user obtained in step 701, specifically be not construed as limiting herein.
It should be noted that, the wide viewing angle of the distance of the direction of gaze of described user, user and video image that above-mentioned basis detects and the user of acquisition, the watching area obtaining user specifically may include that the direction of gaze according to the user detected and the distance of the wide viewing angle of user, this user and video image, this user overlay area, the visual field on video image viewing area is determined, using this user overlay area, the visual field on video image viewing area watching area as described user by calculating.
Such as: above-mentioned video image viewing area is plane viewing area, the vertical angle of view width �� of this user1Being 90 degree, horizontal view angle width is 120 degree, and the distance of this user and video image is L is 1 meter, and the direction of gaze of user is the dead ahead of user, and this user is facing perpendicularly to video image viewing area, then the area S of the overlay area, the visual field of this user can be:
S = θ 1 πL 180 × θ 2 πL 180
Obtain thus calculating, the area S of the overlay area, the visual field of this user is 3.287 square metres, this user is then the region that area is 3.287 square metres on the video image viewing area of this user's dead ahead in the overlay area, the visual field of video image viewing area, and using this overlay area, visual field watching area as user, it is understandable that, it it is only a citing to the watching area determining user herein, in actual applications, may also include other modes obtaining user's watching area, be specifically not construed as limiting herein.
703, video image acquisition end equipment determines target area and the nontarget area of video image viewing area according to the watching area of user, it is determined that described target area and the described nontarget area positional information on described video image viewing area;
In the present embodiment, described target area is corresponding with the watching area of described user;
After video image acquisition end equipment determines the watching area of user, according to the watching area of this user, video image viewing area can being divided into target area and nontarget area, this target area is corresponding with the watching area of above-mentioned user.
It should be noted that above-mentioned target area can only one of which also can have multiple, above-mentioned nontarget area can only one of which also can have multiple, and the area of above-mentioned target area is more than or equal to the watching area of above-mentioned user.
Video image viewing area is divided into the concrete division methods of target area and nontarget area by video image acquisition end equipment can be had multiple, describes in detail for above-mentioned video image viewing area for spheric region below, for instance:
A, watching area according to user, be divided into target area and nontarget area according to horizontal direction by video image viewing area;
B, watching area according to user, be divided into target area and nontarget area according to vertical direction by video image viewing area;
C, watching area according to user, according to video image viewing area is horizontally and vertically divided into target area and nontarget area.
The watching area of above-mentioned user, is divided into video image viewing area target area and the three of nontarget area kinds of modes similar with the embodiment shown in Fig. 3 (video image acquisition end equipment replaces display end equipment), repeats no more herein.
In the present embodiment, video image acquisition end equipment, behind the target area and the nontarget area that determine video image viewing area according to the watching area of user, namely may know that the positional information of the target area of video image viewing area and nontarget area.
704, video image acquisition end equipment indicates information and the network bandwidth that the parameter of the video image of at least one in the target area of video image viewing area or nontarget area is adjusted according to region;
Information is indicated according to region, video image acquisition end equipment may determine that target area and the nontarget area of video image viewing area, video image acquisition end equipment is made to indicate information and the network bandwidth that the parameter of the video image of at least one in the target area of video image viewing area or nontarget area is adjusted according to described region, when adjusting, in addition it is also necessary to ensure the quality of the video image that the quality of the video image in described target area is not less than in described nontarget area.
It should be noted that above-mentioned target area can only one of which also can have multiple, above-mentioned nontarget area can only one of which also can have multiple, and the area of above-mentioned target area is more than or equal to the watching area of above-mentioned user.
After video image acquisition end equipment receives this region instruction information, information and the current network bandwidth can be indicated according to this region, the parameter of the video image in above-mentioned target area is adjusted by video image acquisition end equipment video image acquisition end equipment, or, the parameter of the video image in above-mentioned nontarget area is adjusted, or, the parameter of the video image in above-mentioned target area and nontarget area is adjusted simultaneously, and the display quality of the display quality of the video image in the guarantee target area video image that is not less than in nontarget area.
Video image acquisition end equipment indicates information and the network bandwidth to be adjusted specifically may is that to the parameter of the video image of at least one in described target area or described nontarget area according to described region
When network bandwidth resources abundance, the video image parameter in target area can be adjusted, improve the display quality of video image in target area, or adjust the video image parameter in target area and nontarget area simultaneously, improve the display quality of video image in target area and nontarget area simultaneously, but ensure the display quality of video image that the display quality of the video image in target area is not less than in nontarget area.
When network bandwidth resources deficiency, the video image parameter in nontarget area can be adjusted, reduce the display quality of video image in mark region, or adjust the video image parameter in target area and nontarget area simultaneously, reduce the display quality of video image in target area and nontarget area simultaneously, but ensure the display quality of video image that the display quality of the video image in target area is not less than in nontarget area.
In above embodiment, the direction of gaze of user may be real-time change, the target area of video image viewing area and nontarget area are likely to also can change, in order to improve user experience, can set that the condition of the angle that the direction of gaze of time that the direction of gaze of user changes or user changes, when meeting these conditions, video image acquisition end equipment can redefine the watching area of described user and determine target area and the nontarget area of video image viewing area according to the watching area of described user.
Video image acquisition end equipment can redefine the watching area of described user and the watching area according to described user determines that the target area of video image viewing area and nontarget area may include that
When the angle that the direction of gaze of described user changes within the time set is more than or equal to default value, described video image acquisition end equipment redefines the watching area of described user and determines target area and the nontarget area of video image viewing area according to the watching area of described user, such as, assume that time of setting is as 5s, presetting angle numerical value is 10 ��, when the direction of gaze of user changes 11 �� (having exceeded 10 ��) in 5s, then display end equipment redefines the watching area of described user and determines target area and the nontarget area of video image viewing area according to the watching area of described user,
Or,
When after the direction of gaze of described user changes, the time of maintenance is more than or equal to preset threshold value, described video image acquisition end equipment redefines the watching area of described user and determines target area and the nontarget area of video image viewing area according to the watching area of described user, such as assume that preset time threshold is 3s, assume that the direction of gaze of user is 4s (having exceeded 3s) in the time that this gaze angle keeps after changing, then display end equipment redefines the watching area of described user and determines target area and the nontarget area of video image viewing area according to the watching area of described user, now then can be left out the size that user's gaze angle changes,
Or,
When described user direction of gaze set time in change angle more than or equal to default value, and the direction of gaze of described user change after time of keeping more than or equal to preset threshold value time, described video image acquisition end equipment redefines the watching area of described user and determines target area and the nontarget area of video image viewing area according to the watching area of described user, the time that the direction of gaze of user keeps after changing is the calculating when the angle-determining that the direction of gaze of user changes, such as assume that time of setting is as 5s, presetting angle numerical value is 10 ��, preset time threshold is 3s, when the direction of gaze of user changes 11 �� (having exceeded 10 ��) in 5s, and the direction of gaze of user to change after 11 �� in the time that this gaze angle keeps be 4s (having exceeded 3s), then display end equipment redefines the watching area of described user and determines target area and the nontarget area of video image viewing area according to the watching area of described user.
Above-mentioned video image acquisition end equipment redefines the watching area of described user and determines that the target area of video image viewing area and the mode of nontarget area are referred in Fig. 3 to Fig. 4 one or more users and determine the target area of video image viewing area and the mode of nontarget area according to the watching area of described user, repeats no more herein.
In above embodiment, video image acquisition end equipment indicates information and the network bandwidth that the parameter of the video image of at least one in the target area of video image viewing area or described nontarget area has been adjusted multiple implementation according to region, is discussed in detail below in conjunction with specific embodiment:
One, when network bandwidth size meets pre-conditioned, video image acquisition end equipment adjusts the parameter of the video image of at least one in described target area or described nontarget area according to the described network bandwidth and described positional information;
Referring to Fig. 8, another embodiment of the processing method of the video image that the embodiment of the present invention provides includes:
801, video image acquisition end equipment receives the region instruction information that display end equipment sends;
In the present embodiment, region instruction information includes the direction of gaze information of user and the range information of user and video image;
Video image acquisition end equipment may include that video image capture apparatus and video image acquisition terminal, can also be an equipment of video image capture apparatus and video image acquisition terminal set, it is not construed as limiting herein, above-mentioned video image display end equipment may include that above-mentioned video image display device and display terminal, can also be an equipment of video image display device and display terminal set, be not construed as limiting herein.
Video image capture apparatus carries out the collection of video image, and the video image collected is sent above-mentioned video image acquisition terminal, after above-mentioned video image acquisition terminal receives the video image that above-mentioned video image capture apparatus sends, the display quality of this video image can be processed, and by the video image after process, it is sent to above-mentioned display terminal by network, the video image now sent has the video image parameter of acquiescence, the above-mentioned video image received can be shown on above-mentioned video image display device by this display terminal, the video image of display on the video image viewing area of user's having video capable of being watched image display, above-mentioned display terminal is mainly useful the broadcasting to video image and is controlled.
When user watches the video image on the video image viewing area of above-mentioned video image display device, above-mentioned display end equipment can determine the first area in the above-mentioned video image viewing area that this user is watching by sensor, and the first area this user watched is as the watching area of this user.
It is understood that above-mentioned video image capture apparatus comprises the steps that video camera or the terminal with photographic head, specifically it is not construed as limiting herein.
It is understood that video image display device comprises the steps that one or more LCD display or one or more projector, specifically it is not construed as limiting herein.
It is understood that the viewing area of video image display device can be ball-type region, it is also possible to be plane domain, it is also possible to be the region of other shapes, be specifically not construed as limiting herein.
In the present embodiment, after display end equipment determines the watching area of user, information can be indicated to video image acquisition end equipment sending zone.
802, the video image acquisition end equipment wide viewing angle according to the range information of the direction of gaze information of user, user and video image and the user of acquisition, determine described user overlay area, the visual field on video image viewing area, using the described user overlay area, the visual field on the video image viewing area watching area as described user;
After video image acquisition end equipment obtains the direction of gaze of the user in region instruction information and the distance of this user and video image, can according to the wide viewing angle of the distance of the direction of gaze of user, user and video image and the user of acquisition, calculate the watching area obtaining user, it is understandable that, the wide viewing angle of the user obtained can be the meansigma methods of the wide viewing angle statistics of preset user, it can also be the wide viewing angle of the described user obtained in advance, the wide viewing angle information of this user as pre-saved, is specifically not construed as limiting herein.
It should be noted that, the wide viewing angle of the distance of the direction of gaze of described user, user and video image that above-mentioned basis detects and the user of acquisition, the watching area obtaining user specifically may include that the direction of gaze according to the user detected and the distance of the wide viewing angle of user of acquisition, this user and video image, this user overlay area, the visual field on video image viewing area is determined, using this user overlay area, the visual field on video image viewing area watching area as described user by calculating.
Such as: above-mentioned video image viewing area is plane viewing area, the vertical angle of view width �� of this user1Being 90 degree, horizontal view angle width is 120 degree, and the distance of this user and video image is L is 1 meter, and the direction of gaze of user is the dead ahead of user, and this user is facing perpendicularly to video image viewing area, then the area S of the overlay area, the visual field of this user can be:
S = θ 1 πL 180 × θ 2 πL 180
Obtain thus calculating, the area S of the overlay area, the visual field of this user is 3.287 square metres, this user is then the region that area is 3.287 square metres on the video image viewing area of this user's dead ahead in the overlay area, the visual field of video image viewing area, and using this overlay area, visual field watching area as user, it is understandable that, it it is only a citing to the watching area determining user herein, in actual applications, may also include other modes obtaining user's watching area, be specifically not construed as limiting herein.
803, video image acquisition end equipment determines target area and the nontarget area of video image viewing area according to the watching area of user, it is determined that described target area and the described nontarget area positional information on described video image viewing area;
In the present embodiment, described target area is corresponding with the watching area of described user;
After video image acquisition end equipment determines the watching area of user, according to the watching area of this user, video image viewing area can being divided into target area and nontarget area, this target area is corresponding with the watching area of above-mentioned user.
It should be noted that above-mentioned target area can only one of which also can have multiple, above-mentioned nontarget area can only one of which also can have multiple, and the area of above-mentioned target area is more than or equal to the watching area of above-mentioned user.
Video image viewing area is divided into the concrete division methods of target area and nontarget area by video image acquisition end equipment can be had multiple, describes in detail for above-mentioned video image viewing area for spheric region below, for instance:
A, watching area according to user, be divided into target area and nontarget area according to horizontal direction by video image viewing area;
B, watching area according to user, be divided into target area and nontarget area according to vertical direction by video image viewing area;
C, watching area according to user, according to video image viewing area is horizontally and vertically divided into target area and nontarget area.
The watching area of above-mentioned user, is divided into video image viewing area target area and the three of nontarget area kinds of modes similar with the embodiment shown in Fig. 3 (video image acquisition end equipment replaces display end equipment), repeats no more herein.
In the present embodiment, video image acquisition end equipment, behind the target area and the nontarget area that determine video image viewing area according to the watching area of user, namely may know that the positional information of the target area of video image viewing area and nontarget area.
804, when network bandwidth size meets pre-conditioned, video image acquisition end equipment adjusts the parameter of the video image of at least one in described target area or described nontarget area according to the described network bandwidth and described positional information;
Information is indicated according to region, video image acquisition end equipment may determine that target area and the nontarget area of video image viewing area, video image acquisition end equipment is made to indicate information and the network bandwidth that the parameter of the video image of at least one in the target area of video image viewing area or nontarget area is adjusted according to described region, when adjusting, in addition it is also necessary to ensure the quality of the video image that the quality of the video image in described target area is not less than in described nontarget area.
It should be noted that above-mentioned target area can only one of which also can have multiple, above-mentioned nontarget area can only one of which also can have multiple, and the area of above-mentioned target area is more than or equal to the watching area of above-mentioned user.
After video image acquisition end equipment receives this region instruction information, information and the current network bandwidth can be indicated according to this region, the parameter of the video image in above-mentioned target area is adjusted by video image acquisition end equipment video image acquisition end equipment, or, the parameter of the video image in above-mentioned nontarget area is adjusted, or, the parameter of the video image in above-mentioned target area and nontarget area is adjusted simultaneously, and the display quality of the display quality of the video image in the guarantee target area video image that is not less than in nontarget area.
Video image acquisition end equipment indicates information and the network bandwidth to be adjusted specifically may is that to the parameter of the video image of at least one in described target area or described nontarget area according to described region
When network bandwidth resources abundance, the video image parameter in target area can be adjusted, improve the display quality of video image in target area, or adjust the video image parameter in target area and nontarget area simultaneously, improve the display quality of video image in target area and nontarget area simultaneously, but ensure the display quality of video image that the display quality of the video image in target area is not less than in nontarget area.
When network bandwidth resources deficiency, the video image parameter in nontarget area can be adjusted, reduce the display quality of video image in mark region, or adjust the video image parameter in target area and nontarget area simultaneously, reduce the display quality of video image in target area and nontarget area simultaneously, but ensure the display quality of video image that the display quality of the video image in target area is not less than in nontarget area.
In the present embodiment, network bandwidth situation can be detected in real time, when network bandwidth size meets pre-conditioned, video image acquisition end equipment adjusts the parameter of the video image of at least one in described target area or described nontarget area according to the described network bandwidth and described positional information and may include that
When the network bandwidth is less than the first preset threshold value, described video image acquisition end equipment adjusts the parameter of the video image in described nontarget area according to the described network bandwidth and described positional information, and making the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area, described parameter at least includes one in resolution, frame per second and code check;
Or,
When the network bandwidth is less than the first preset threshold value, described video image acquisition end equipment adjusts the parameter of the video image in described nontarget area according to the described network bandwidth and described positional information, and adjust the parameter of video image in described target area, and making the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area, described parameter at least includes one in resolution, frame per second and code check;
Or,
When the network bandwidth is more than or equal to the first preset threshold value, described video image acquisition end equipment adjusts the parameter of the video image in described target area according to the described network bandwidth and described positional information, and making the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area, described parameter at least includes one in resolution, frame per second and code check;
Or,
When the network bandwidth is more than or equal to the first preset threshold value, described video image acquisition end equipment adjusts the parameter of the video image in described target area and described nontarget area according to the described network bandwidth and described positional information, and making the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area, described parameter at least includes one in resolution, frame per second and code check.
Two, when the numerical value of network bandwidth change meets pre-conditioned, video image acquisition end equipment is adjusted according to the parameter of the video image of at least one in target area to video image viewing area of described positional information and the network bandwidth or described nontarget area;
Referring to Fig. 9, another embodiment of the processing method of the video image that the embodiment of the present invention provides includes:
901, video image acquisition end equipment receives the region instruction information that display end equipment sends;
In the present embodiment, region instruction information includes the direction of gaze information of user and the range information of user and video image;
Video image acquisition end equipment may include that video image capture apparatus and video image acquisition terminal, can also be an equipment of video image capture apparatus and video image acquisition terminal set, it is not construed as limiting herein, above-mentioned video image display end equipment may include that above-mentioned video image display device and display terminal, can also be an equipment of video image display device and display terminal set, be not construed as limiting herein.
Video image capture apparatus carries out the collection of video image, and the video image collected is sent above-mentioned video image acquisition terminal, after above-mentioned video image acquisition terminal receives the video image that above-mentioned video image capture apparatus sends, the display quality of this video image can be processed, and by the video image after process, it is sent to above-mentioned display terminal by network, the video image now sent has the video image parameter of acquiescence, the above-mentioned video image received can be shown on above-mentioned video image display device by this display terminal, the video image of display on the video image viewing area of user's having video capable of being watched image display, above-mentioned display terminal is mainly useful the broadcasting to video image and is controlled.
When user watches the video image on the video image viewing area of above-mentioned video image display device, above-mentioned display end equipment can determine the first area in the above-mentioned video image viewing area that this user is watching by sensor, and the first area this user watched is as the watching area of this user.
It is understood that above-mentioned video image capture apparatus comprises the steps that video camera or the terminal with photographic head, specifically it is not construed as limiting herein.
It is understood that video image display device comprises the steps that one or more LCD display or one or more projector, specifically it is not construed as limiting herein.
It is understood that the viewing area of video image display device can be ball-type region, it is also possible to be plane domain, it is also possible to be the region of other shapes, be specifically not construed as limiting herein.
In the present embodiment, after display end equipment determines the watching area of user, information can be indicated to video image acquisition end equipment sending zone.
902, the video image acquisition end equipment wide viewing angle according to the range information of the direction of gaze information of user, user and video image and the user of acquisition, determine described user overlay area, the visual field on video image viewing area, using the described user overlay area, the visual field on the video image viewing area watching area as described user;
After video image acquisition end equipment obtains the direction of gaze of the user in region instruction information and the distance of this user and video image, can according to the wide viewing angle of the distance of the direction of gaze of user, user and video image and the user of acquisition, calculate the watching area obtaining user, it is understandable that, the wide viewing angle of the user obtained can be the meansigma methods of the wide viewing angle statistics of preset user, it can also be the wide viewing angle of the described user obtained in advance, the wide viewing angle information of this user as pre-saved, is specifically not construed as limiting herein.
It should be noted that, the wide viewing angle of the distance of the direction of gaze of described user, user and video image that above-mentioned basis detects and the user of acquisition, the watching area obtaining user specifically may include that the direction of gaze according to the user detected and the distance of the wide viewing angle of user of acquisition, this user and video image, this user overlay area, the visual field on video image viewing area is determined, using this user overlay area, the visual field on video image viewing area watching area as described user by calculating.
Such as: above-mentioned video image viewing area is plane viewing area, the vertical angle of view width �� of this user1Being 90 degree, horizontal view angle width is 120 degree, and the distance of this user and video image is L is 1 meter, and the direction of gaze of user is the dead ahead of user, and this user is facing perpendicularly to video image viewing area, then the area S of the overlay area, the visual field of this user can be:
S = θ 1 πL 180 × θ 2 πL 180
Obtain thus calculating, the area S of the overlay area, the visual field of this user is 3.287 square metres, this user is then the region that area is 3.287 square metres on the video image viewing area of this user's dead ahead in the overlay area, the visual field of video image viewing area, and using this overlay area, visual field watching area as user, it is understandable that, it it is only a citing to the watching area determining user herein, in actual applications, may also include other modes obtaining user's watching area, be specifically not construed as limiting herein.
903, video image acquisition end equipment determines target area and the nontarget area of video image viewing area according to the watching area of user, it is determined that described target area and the described nontarget area positional information on described video image viewing area;
In the present embodiment, described target area is corresponding with the watching area of described user;
After video image acquisition end equipment determines the watching area of user, according to the watching area of this user, video image viewing area can being divided into target area and nontarget area, this target area is corresponding with the watching area of above-mentioned user.
It should be noted that above-mentioned target area can only one of which also can have multiple, above-mentioned nontarget area can only one of which also can have multiple, and the area of above-mentioned target area is more than or equal to the watching area of above-mentioned user.
Video image viewing area is divided into the concrete division methods of target area and nontarget area by video image acquisition end equipment can be had multiple, describes in detail for above-mentioned video image viewing area for spheric region below, for instance:
A, watching area according to user, be divided into target area and nontarget area according to horizontal direction by video image viewing area;
B, watching area according to user, be divided into target area and nontarget area according to vertical direction by video image viewing area;
C, watching area according to user, according to video image viewing area is horizontally and vertically divided into target area and nontarget area.
The watching area of above-mentioned user, is divided into video image viewing area target area and the three of nontarget area kinds of modes similar with the embodiment shown in Fig. 3 (video image acquisition end equipment replaces display end equipment), repeats no more herein.
In the present embodiment, video image acquisition end equipment, behind the target area and the nontarget area that determine video image viewing area according to the watching area of user, namely may know that the positional information of the target area of video image viewing area and nontarget area.
904, when the numerical value of network bandwidth change meets pre-conditioned, video image acquisition end equipment is adjusted according to the parameter of the video image of at least one in target area to video image viewing area of described positional information and the network bandwidth or described nontarget area;
Information is indicated according to region, video image acquisition end equipment may determine that target area and the nontarget area of video image viewing area, video image acquisition end equipment is made to indicate information and the network bandwidth that the parameter of the video image of at least one in the target area of video image viewing area or nontarget area is adjusted according to described region, when adjusting, in addition it is also necessary to ensure the quality of the video image that the quality of the video image in described target area is not less than in described nontarget area.
It should be noted that above-mentioned target area can only one of which also can have multiple, above-mentioned nontarget area can only one of which also can have multiple, and the area of above-mentioned target area is more than or equal to the watching area of above-mentioned user.
After video image acquisition end equipment receives this region instruction information, information and the current network bandwidth can be indicated according to this region, the parameter of the video image in above-mentioned target area is adjusted by video image acquisition end equipment video image acquisition end equipment, or, the parameter of the video image in above-mentioned nontarget area is adjusted, or, the parameter of the video image in above-mentioned target area and nontarget area is adjusted simultaneously, and the display quality of the display quality of the video image in the guarantee target area video image that is not less than in nontarget area.
Video image acquisition end equipment indicates information and the network bandwidth to be adjusted specifically may is that to the parameter of the video image of at least one in described target area or described nontarget area according to described region
When network bandwidth resources abundance, the video image parameter in target area can be adjusted, improve the display quality of video image in target area, or adjust the video image parameter in target area and nontarget area simultaneously, improve the display quality of video image in target area and nontarget area simultaneously, but ensure the display quality of video image that the display quality of the video image in target area is not less than in nontarget area.
When network bandwidth resources deficiency, the video image parameter in nontarget area can be adjusted, reduce the display quality of video image in mark region, or adjust the video image parameter in target area and nontarget area simultaneously, reduce the display quality of video image in target area and nontarget area simultaneously, but ensure the display quality of video image that the display quality of the video image in target area is not less than in nontarget area.
In the present embodiment, when the numerical value of network bandwidth change meets pre-conditioned, video image acquisition end equipment can also be adjusted may include that according to the parameter of the video image of at least one in described positional information and the network bandwidth target area to video image viewing area or described nontarget area
Obtain the meansigma methods of the network bandwidth in the setting time in real time;
Owing to burst change can occur the value of the network bandwidth sometimes, as taken the value of the network bandwidth of a moment point, it is likely to result in error, obtain the meansigma methods of the network bandwidth in the setting time in real time, namely before obtaining current time in real time, the meansigma methods of the network bandwidth in the time period set, after having spent the appointment time (such as 3s), again obtain the meansigma methods of the network bandwidth in the setting time, meansigma methods can more accurately reflect the situation of the network bandwidth, in the setting time, the meansigma methods of the network bandwidth can pass through to detect in real time the situation of the network bandwidth, calculate the meansigma methods of the network bandwidth in the setting time, such as, before acquisition current time, the meansigma methods of the network bandwidth of 10s is 2M, before obtaining this moment after 3s, the meansigma methods of the network bandwidth of 10s is 3M,
When the numerical value that the meansigma methods of the relatively last network bandwidth obtained of the meansigma methods of the network bandwidth obtained reduces is more than or equal to the second preset threshold value, described video image acquisition end equipment adjusts the parameter of the video image in described nontarget area according to the described network bandwidth and described positional information, and make the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area, described parameter at least includes resolution, frame per second, with in code check, such as, assume that the second preset threshold value of setting is as 1M, before acquisition current time, the meansigma methods of the network bandwidth of 10s is 2M, (assumed that the 3s that sets calculated a meansigma methods) after 3s and obtain before this moment that the meansigma methods of the network bandwidth of 10s is as 1M, the numerical value (2M-1M=1M) that the meansigma methods (2M) of the relatively last network bandwidth obtained of the meansigma methods (1M) of the network bandwidth then obtained reduces is equal to the second preset threshold value (1M), now video image acquisition end equipment can adjust the parameter of the video image in described nontarget area according to the described network bandwidth and described positional information,
Or,
When the numerical value that the meansigma methods of the relatively last network bandwidth obtained of the meansigma methods of the network bandwidth obtained reduces is more than or equal to the second preset threshold value, described video image acquisition end equipment adjusts the parameter of the video image in described nontarget area according to the described network bandwidth and described positional information, and adjust the parameter of video image in described target area, and make the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area, described parameter at least includes resolution, frame per second, with in code check, such as, assume that the second preset threshold value of setting is as 1M, before acquisition current time, the meansigma methods of the network bandwidth of 10s is 2M, (assumed that the 3s that sets calculated a meansigma methods) after 3s and obtain before this moment that the meansigma methods of the network bandwidth of 10s is as 1M, the numerical value (2M-1M=1M) that the meansigma methods (2M) of the relatively last network bandwidth obtained of the meansigma methods (1M) of the network bandwidth then obtained reduces is equal to the second preset threshold value (1M), now video image acquisition end equipment adjusts the parameter of the video image in described nontarget area according to the described network bandwidth and described positional information, and adjust the parameter of video image in described target area,
Or,
When the numerical value that the meansigma methods of the relatively last network bandwidth obtained of the meansigma methods of the network bandwidth obtained raises is more than or equal to three preset threshold values, described video image acquisition end equipment adjusts the parameter of the video image in described target area according to the described network bandwidth and described positional information, and make the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area, described parameter at least includes resolution, frame per second, with in code check, such as, assume that the second preset threshold value of setting is as 1M, before acquisition current time, the meansigma methods of the network bandwidth of 10s is 2M, (assumed that the 3s that sets calculated a meansigma methods) after 3s and obtain before this moment that the meansigma methods of the network bandwidth of 10s is as 1M, the numerical value (2M-1M=1M) that the meansigma methods (2M) of the relatively last network bandwidth obtained of the meansigma methods (1M) of the network bandwidth then obtained reduces is equal to the second preset threshold value (1M), now video image acquisition end equipment adjusts the parameter of the video image in described target area according to the described network bandwidth and described positional information.
In embodiments shown above, the concrete mode that the parameter of the video image in target area or nontarget area is adjusted by video image acquisition terminal according to the network bandwidth and area information is described above in seven kinds of modes when the network bandwidth meets pre-conditioned and when the numerical value of network bandwidth change meets pre-conditioned, it is understandable that, in actual applications, the parameter of the video image in target area or nontarget area can also be adjusted by video image acquisition terminal by more mode, does not specifically limit herein.
It is understandable that, video image acquisition terminal according to the network bandwidth and area information to target area and or nontarget area in the parameter of video image be adjusted time, different adjustment can be carried out for the different parameters of video image, for the ease of understanding, citing below is described in detail, for instance:
Such as Fig. 3-1, Fig. 3-2, shown in Fig. 3-3, video image viewing area can be divided into target area H1 according to horizontal direction by display terminal, with nontarget area H2, H3, video image viewing area also can be divided into target area V1 according to vertical direction by display terminal, with nontarget area V2, display terminal also can according to horizontally and vertically video image viewing area being divided into target area H1V1, with nontarget area H2V1, H1V2, H3V1, H2V2, H3V2, the numerical value reduced for the network bandwidth below is described more than or equal to the second preset threshold values, video image acquisition terminal adjusts the concrete mode of the parameter of the video image of at least one in target area or nontarget area and comprises the steps that
1, adjustment order: first adjust the parameter of video image in nontarget area farther out, target area, adjust the parameter of video image in the nontarget area close to target area again, adjust the parameter of video image in target area again, such as, adjustment order is: H3, H2, H1, or V2, V1, or H3V2, H2V2, H3V1, H1V2, H2V1, H1V1.
2, adjust parameter: the parameter adjustment resolution of the video image in nontarget area and code check, the parameter adjustment code check of the video image in target area or do not adjust.
3, adjust intensity: the parameter adjustment intensity of the video image in the nontarget area that distance objective region is more remote is more big, and the parameter adjustment intensity of the video image in target area is minimum.
The detailed description in order to make it easy to understand, illustrate below, for instance the initial parameter of video image is identical, namely resolution, frame per second, code check respectively 1920x1080,30fps, 8M, bandwidth fluctuation is 8M-> 5M-> 2M, and for level side's picture, the concrete grammar of its parameter adjustment can be:
Table 1 is for when the network bandwidth is reduced to 5M, the video image acquisition terminal method of adjustment to the parameter of the video image in target area and nontarget area, as shown in table 1, when the network bandwidth is for being reduced to 5M, only reduce resolution and the code check of the video image in H3 region:
Table 1
Region Resolution Frame per second Code check
H1 1920x1080 30fps 8M
H2 1920x1080 30fps 8M
H3 1280x720 30fps 2M
Table 2 is when the network bandwidth is reduced to 2M, the method for adjustment of the parameter of target area and the video image in nontarget area, as shown in table 1, when the network bandwidth is for being reduced to 2M, reduces resolution and the code check of the video image in H3 and H2 region:
Table 2
Region Resolution Frame per second Code check
H1 1920x1080 30fps 8M
H2 1280x720 30fps 2M
H3 960x540 30fps 1M
As shown in above-mentioned table 1 and table 2, when the network bandwidth reduces, the first parameter of the video image in adjustment nontarget area farther out, distance objective region, and the parameter adjustment intensity of the video image in more remote nontarget area, distance objective region is more big, it is understandable that, above-mentioned video image parameter adjusts mode can adjust the arbitrary combination parameter of resolution, frame per second, code check, simultaneously, horizontal direction, vertical direction combination in any region can also be adjusted, specifically be not construed as limiting herein.
Above example is the explanation made of the processing method to the video image that the embodiment of the present invention provides, below terminal unit provided by the invention (the display end equipment with reference in preceding method embodiment) is described in detail, referring to Figure 10, an embodiment of the terminal unit 1000 that the embodiment of the present invention provides includes:
First determines unit 1001, for determining the watching area of user;
Transmitting element 1002, for indicating information to video image acquisition end equipment sending zone, make described video image acquisition end equipment indicate information and the network bandwidth that the parameter of the video image of at least one in the target area of video image viewing area or nontarget area is adjusted according to described region, and make the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area.
In the present embodiment, first determine the watching area that unit 1001 determines user after, transmitting element 1002 indicates information to video image acquisition end equipment sending zone, can so that video image acquisition end equipment be adjusted according to the parameter of the video image of at least one in the network bandwidth target area to video image viewing area or nontarget area, the display quality making target area that user is currently just being look at and nontarget area is adjusted according to the network bandwidth, thus ensureing the Experience Degree of user, improve the utilization rate of network bandwidth resources.
Referring to Figure 11, another embodiment of the terminal unit 1100 that the embodiment of the present invention provides includes:
First determines unit 1101, for determining the watching area of user;
Transmitting element 1102, for indicating information to video image acquisition end equipment sending zone, make described video image acquisition end equipment indicate information and the network bandwidth that the parameter of the video image of at least one in the target area of video image viewing area or nontarget area is adjusted according to described region, and make the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area.
In described terminal unit, described first determines that unit 1101 may include that further
Detection sub-unit 11011, for detecting the direction of gaze of user and the distance of user and video image;
Determine subelement 11012, for the wide viewing angle of the distance according to the direction of gaze of described user detected, described user and video image and the user of acquisition, obtain the watching area of user.
Described determine that subelement 11012 specifically may be used for the distance according to the direction of gaze of described user detected and the wide viewing angle of user, described user and video image, determine described user overlay area, the visual field on video image viewing area, using the described user overlay area, the visual field on the video image viewing area watching area as described user.
In the present embodiment, first determine the watching area that unit 1101 determines user after, transmitting element 1102 indicates information to video image acquisition end equipment sending zone, can so that video image acquisition end equipment be adjusted according to the parameter of the video image of at least one in the network bandwidth target area to video image viewing area or nontarget area, the display quality making target area that user is currently just being look at and nontarget area is adjusted according to the network bandwidth, thus ensureing the Experience Degree of user, improve the utilization rate of network bandwidth resources;
Secondly, describe the first concrete structure determining unit 1101 in detail, make the structure of terminal unit arrange more diversified.
Referring to Figure 12, another embodiment of the terminal unit 1200 that the embodiment of the present invention provides includes:
First determines unit 1201, for determining the watching area of user;
Transmitting element 1202, for indicating information to video image acquisition end equipment sending zone, make described video image acquisition end equipment indicate information and the network bandwidth that the parameter of the video image of at least one in the target area of video image viewing area or nontarget area is adjusted according to described region, and make the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area.
In described terminal unit, described first determines that unit 1201 may include that further
Detection sub-unit 12011, for detecting the direction of gaze of user and the distance of user and video image;
Determine subelement 12012, for the wide viewing angle of the distance according to the direction of gaze of described user detected, described user and video image and the user of acquisition, obtain the watching area of user.
Described determine that subelement 12012 specifically may be used for the distance according to the direction of gaze of described user detected and the wide viewing angle of user of acquisition, described user and video image, determine described user overlay area, the visual field on video image viewing area, using the described user overlay area, the visual field on the video image viewing area watching area as described user.
Described terminal unit can further include:
Second determines unit 1203, during for including the positional information of the target area of video image viewing area and nontarget area in described region instruction information, at described transmitting element to before video image acquisition end equipment sending zone instruction information, watching area according to described user determines target area and the nontarget area of video image viewing area, and described target area is corresponding with the watching area of described user.
Optionally, described second determines that unit 1203 specifically may be used for
Video image viewing area is divided into target area and nontarget area according to horizontal direction by the watching area according to described user;
Or,
Video image viewing area is divided into target area and nontarget area according to vertical direction by the watching area according to described user;
Or,
Watching area according to described user is according to video image viewing area is horizontally and vertically divided into target area and nontarget area.
When there being multiple user, described first determines that unit 1201 can be also used for determining the watching area of all users; Described second determines that unit 1203 can be also used for the watching area of all users is merged into comprehensive watching area, determines target area and the nontarget area of video image viewing area according to described comprehensive watching area.
When having multiple user, described first determines that unit 1201 can be also used for determining targeted customer according to pre-conditioned, and determines the watching area of described targeted customer;
When described targeted customer is one, described second determines that unit 1203 can be also used for the watching area according to described targeted customer and determines target area and the nontarget area of video image viewing area;
When described targeted customer is multiple, described second determines that unit 1203 can be also used for the watching area of the plurality of targeted customer is merged into comprehensive watching area, determines target area and the nontarget area of video image viewing area according to described comprehensive watching area.
Described first determines that unit 1201 can be also used for the positional information obtaining the plurality of user with video image, it is determined that the user in the middle of the plurality of user is targeted customer.
Preferably, terminal unit described above can further include:
First updating block, for when the angle that the direction of gaze of described user changes within the time set is more than or equal to default value, redefining the watching area of described user and determine target area and the nontarget area of video image viewing area according to the watching area of described user;
Or,
Second updating block, for when the time kept after the direction of gaze of described user changes more than or equal to preset threshold value time, redefine the watching area of described user and determine target area and the nontarget area of video image viewing area according to the watching area of described user;
Or,
3rd updating block, for when described user direction of gaze set time in change angle more than or equal to default value, and the direction of gaze of described user change after time of keeping more than or equal to preset threshold value time, redefine the watching area of described user and determine target area and the nontarget area of video image viewing area according to the watching area of described user.
Preferably, described region instruction information can include the direction of gaze information of described user and the range information of described user and video image.
In the present embodiment, first determine the watching area that unit 1201 determines user after, transmitting element 1202 indicates information to video image acquisition end equipment sending zone, can so that video image acquisition end equipment be adjusted according to the parameter of the video image of at least one in the network bandwidth target area to video image viewing area or nontarget area, the display quality making target area that user is currently just being look at and nontarget area is adjusted according to the network bandwidth, thus ensureing the Experience Degree of user, improve the utilization rate of network bandwidth resources;
Secondly, terminal unit increases by second and determines unit, when region instruction information includes the positional information of the target area of video image viewing area and nontarget area, at transmitting element 1202 to before video image acquisition end equipment sending zone instruction information, watching area according to described user determines target area and the nontarget area of video image viewing area, decreases the workload of video image acquisition end equipment.
From the angle of blocking functional entity, the terminal unit the embodiment of the present invention is described above, from the angle of hardware handles, the terminal unit the embodiment of the present invention is described below, referring to Figure 13, another embodiment of the terminal unit 1300 in the embodiment of the present invention includes:
Input equipment 1301, output device 1302, processor 1303 and memorizer 1304 (wherein the quantity of the processor 1303 in terminal unit 1300 can be one or more, for a processor 1303 in Figure 13). In some embodiments of the invention, input equipment 1301, output device 1302, processor 1303 and memorizer 1304 can pass through bus or alternate manner connects, wherein, to be connected as example by bus in Figure 13.
Wherein, by calling the operational order of memorizer 1304 storage, processor 1303 is used for performing following steps:
Determine the watching area of user;
By output device 1302 to video image acquisition end equipment sending zone indicate information, make described video image acquisition end equipment indicate information and the network bandwidth that the parameter of the video image of at least one in the target area of video image viewing area or nontarget area is adjusted according to described region, and make the quality of video image that the quality of the video image in described target area is not less than in described nontarget area.
In the present embodiment, output device 1302 can include transmitter.
In some embodiments of the present invention, processor 1303 also executes the following steps:
Detected the direction of gaze of user and the distance of described user and video image by input equipment 1301, input equipment 1301 can be sensor;
The wide viewing angle of the user according to the direction of gaze of the described user detected, the distance of described user and video image and acquisition, obtains the watching area of user.
In some embodiments of the present invention, processor 1303 also executes the following steps:
Direction of gaze according to the described user detected and the wide viewing angle of the user of acquisition, described user and video image distance, determine described user overlay area, the visual field on video image viewing area, using the described user overlay area, the visual field on the video image viewing area watching area as described user.
In some embodiments of the present invention, processor 1303 also executes the following steps:
When described region instruction information includes the positional information of the target area of video image viewing area and nontarget area, watching area according to described user determines target area and the nontarget area of video image viewing area, and described target area is corresponding with the watching area of described user.
In some embodiments of the present invention, processor 1303 also executes the following steps:
Video image viewing area is divided into target area and nontarget area according to horizontal direction by the watching area according to described user;
Or,
Video image viewing area is divided into target area and nontarget area according to vertical direction by the watching area according to described user;
Or,
Watching area according to described user is according to video image viewing area is horizontally and vertically divided into target area and nontarget area.
In some embodiments of the present invention, processor 1303 also executes the following steps:
When there being multiple user, it is determined that the watching area of all users, the watching area of all users is merged into comprehensive watching area, determine target area and the nontarget area of video image viewing area according to described comprehensive watching area.
In some embodiments of the present invention, processor 1303 also executes the following steps:
Determine targeted customer according to pre-conditioned, and determine the watching area of described targeted customer;
When described targeted customer is one, determine target area and the nontarget area of video image viewing area according to the watching area of described targeted customer;
When described targeted customer is multiple, the watching area of the plurality of targeted customer is merged into comprehensive watching area, determine target area and the nontarget area of video image viewing area according to described comprehensive watching area.
In some embodiments of the present invention, processor 1303 also executes the following steps:
The positional information of the plurality of user and video image is obtained, it is determined that the user in the middle of the plurality of user is targeted customer by input equipment 1301.
The positional information of the plurality of user and video image is obtained by input equipment 1301, determine that the user in the middle of the plurality of user is targeted customer, user in the middle of multiple users for video image viewing area just to direction be reference direction, it is determined that mode can be such that
When described number of users is even number, middle user is even number, now, the even number user that can select centre is targeted customer, such as, when number of users is 2, can select two users is targeted customer, when number of users is 4, 2 users that can select centre are targeted customer, when number of users is 6, 2 users of centre now both can be selected, 4 users of centre can also be selected, certainly, when number of users is even number, the user of centre can also be first determined by mode above, then the more than one user choosing centre is targeted customer, when described number of users is odd number, one that can directly select middle is targeted customer, can also determine that middle odd number is for targeted customer, when being 5 such as number of users, determine that middle 1 user is targeted customer, or determine that 3 users of centre are targeted customer, the concrete mode of the above-mentioned targeted customer of determination is not construed as limiting herein.
After determining targeted customer, can according to the watching area obtaining each user, it is determined that the watching area of targeted customer.
In some embodiments of the present invention, processor 1303 also executes the following steps:
When the angle that the direction of gaze of described user changes within the time set is more than or equal to default value, redefines the watching area of described user and determine target area and the nontarget area of video image viewing area according to the watching area of described user;
Or,
When the time that the direction of gaze of described user keeps after changing more than or equal to preset threshold value time, redefine the watching area of described user and determine target area and the nontarget area of video image viewing area according to the watching area of described user;
Or,
When described user direction of gaze set time in change angle more than or equal to default value, and the direction of gaze of described user change after time of keeping more than or equal to preset threshold value time, redefine the watching area of described user and determine target area and the nontarget area of video image viewing area according to the watching area of described user.
Instruction information in region described above can also only include the direction of gaze information of described user and the range information of described user and video image.
The terminal unit above embodiment of the present invention provided has been described in detail, the equipment (the video image acquisition end equipment with reference in preceding method embodiment) providing the video image below embodiment of the present invention provided is described in detail, referring to Figure 14, an embodiment of the equipment 1400 providing video image that the embodiment of the present invention provides includes:
Receive unit 1401, for receiving the region instruction information that display end equipment sends;
Adjustment unit 1402, for indicating information and the network bandwidth that the parameter of the video image of at least one in the target area of video image viewing area or nontarget area is adjusted according to described region, and make the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area.
In some embodiments of the invention, the described region instruction information that described reception unit 1401 receives can include described target area and the positional information of described nontarget area.
In some embodiments of the invention, the equipment of described offer video image can also include:
Determine unit, during for including the range information of the direction of gaze information of described user and described user and video image in described region instruction information, before in described adjustment unit indicates information and the network bandwidth to described target area or described nontarget area according to described region, the parameter of the video image of at least one is adjusted, direction of gaze information according to described user, the wide viewing angle of the range information of described user and video image and the user of acquisition, determine described user overlay area, the visual field on video image viewing area, using the described user overlay area, the visual field on the video image viewing area watching area as described user, watching area according to described user determines target area and the nontarget area of video image viewing area, determining described target area and the described nontarget area positional information on described video image viewing area, described target area is corresponding with the watching area of described user.
In some embodiments of the invention, described adjustment unit 1402 specifically may be used for
When the network bandwidth is less than the first preset threshold value, adjusting the parameter of the video image in described nontarget area according to the described network bandwidth and described positional information, described parameter at least includes one in resolution, frame per second and code check;
Or,
When the network bandwidth is less than the first preset threshold value, the parameter of the video image in described nontarget area is adjusted according to the described network bandwidth and described positional information, and adjusting the parameter of video image in described target area, described parameter at least includes one in resolution, frame per second and code check;
Or,
When the network bandwidth is more than or equal to the first preset threshold value, adjusting the parameter of the video image in described target area according to the described network bandwidth and described positional information, described parameter at least includes one in resolution, frame per second and code check;
Or,
When the network bandwidth is more than or equal to the first preset threshold value, adjust the parameter of the video image in described target area and described nontarget area according to the described network bandwidth and described positional information, described parameter at least includes one in resolution, frame per second and code check.
In some embodiments of the invention, described adjustment unit 1402 specifically can be also used for
Obtain the meansigma methods of the network bandwidth in the setting time in real time;
When the numerical value that the meansigma methods of the relatively last network bandwidth obtained of the meansigma methods of the network bandwidth obtained reduces is more than or equal to the second preset threshold value, the parameter of the video image in described nontarget area is adjusted according to the described network bandwidth and described positional information, and making the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area, described parameter at least includes one in resolution, frame per second and code check;
Or,
When the numerical value that the meansigma methods of the relatively last network bandwidth obtained of the meansigma methods of the network bandwidth obtained reduces is more than or equal to the second preset threshold value, the parameter of the video image in described nontarget area is adjusted according to the described network bandwidth and described positional information, and adjust the parameter of video image in described target area, and making the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area, described parameter at least includes one in resolution, frame per second and code check;
Or,
When the numerical value that the meansigma methods of the relatively last network bandwidth obtained of the meansigma methods of the network bandwidth obtained raises is more than or equal to three preset threshold values, the parameter of the video image in described target area is adjusted according to the described network bandwidth and described positional information, and making the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area, described parameter at least includes one in resolution, frame per second and code check.
In the present embodiment, receive unit 1401 and receive the region instruction information that display end equipment sends, adjustment unit 1402 indicates information and the network bandwidth that the parameter of the video image of at least one in the target area of video image viewing area or nontarget area is adjusted according to region, the display quality making target area that user is currently just being look at and nontarget area is adjusted according to the network bandwidth, thus ensureing the Experience Degree of user, improve the utilization rate of network bandwidth resources.
From the angle of blocking functional entity, the equipment providing video image the embodiment of the present invention is described above, from the angle of hardware handles, the equipment providing video image the embodiment of the present invention is described below, referring to Figure 15, another embodiment of equipment 1500 providing video image in the embodiment of the present invention includes:
Input equipment 1501, output device 1502, processor 1503 and memorizer 1504 (quantity wherein providing the processor 1503 in the equipment 1500 of video image can be one or more, for a processor 1503 in Figure 15). In some embodiments of the invention, input equipment 1501, output device 1502, processor 1503 and memorizer 1504 can pass through bus or alternate manner connects, wherein, to be connected as example by bus in Figure 15.
Wherein, by calling the operational order of memorizer 1504 storage, processor 1503 is used for performing following steps:
Receiving, by input equipment 1501, the region instruction information that display end equipment sends, input equipment 1501 can include receptor;
Indicate information and the network bandwidth that the parameter of the video image of at least one in the target area of video image viewing area or nontarget area is adjusted according to described region, and make the quality of video image that the quality of the video image in described target area is not less than in described nontarget area.
The described region instruction information that described reception unit receives can include described target area and the positional information of described nontarget area.
In some embodiments of the present invention, processor 1503 can be also used for performing following steps:
When described region instruction information includes the range information of the direction of gaze information of described user and described user and video image, the wide viewing angle of the range information of the direction of gaze information according to described user, described user and video image and the user of acquisition, determine described user overlay area, the visual field on video image viewing area, using the described user overlay area, the visual field on the video image viewing area watching area as described user;
Watching area according to described user determines target area and the nontarget area of video image viewing area, determining described target area and the described nontarget area positional information on described video image viewing area, described target area is corresponding with the watching area of described user.
In some embodiments of the present invention, processor 1503 can be also used for performing following steps:
When the network bandwidth is less than the first preset threshold value, adjusting the parameter of the video image in described nontarget area according to the described network bandwidth and described positional information, described parameter at least includes one in resolution, frame per second and code check;
Or,
When the network bandwidth is less than the first preset threshold value, the parameter of the video image in described nontarget area is adjusted according to the described network bandwidth and described positional information, and adjusting the parameter of video image in described target area, described parameter at least includes one in resolution, frame per second and code check;
Or,
When the network bandwidth is more than or equal to the first preset threshold value, adjusting the parameter of the video image in described target area according to the described network bandwidth and described positional information, described parameter at least includes one in resolution, frame per second and code check;
Or,
When the network bandwidth is more than or equal to the first preset threshold value, adjust the parameter of the video image in described target area and described nontarget area according to the described network bandwidth and described positional information, described parameter at least includes one in resolution, frame per second and code check.
In some embodiments of the present invention, processor 1503 can be also used for performing following steps:
Obtain the meansigma methods of the network bandwidth in the setting time in real time;
When the numerical value that the meansigma methods of the relatively last network bandwidth obtained of the meansigma methods of the network bandwidth obtained reduces is more than or equal to the second preset threshold value, the parameter of the video image in described nontarget area is adjusted according to the described network bandwidth and described positional information, and making the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area, described parameter at least includes one in resolution, frame per second and code check;
Or,
When the numerical value that the meansigma methods of the relatively last network bandwidth obtained of the meansigma methods of the network bandwidth obtained reduces is more than or equal to the second preset threshold value, the parameter of the video image in described nontarget area is adjusted according to the described network bandwidth and described positional information, and adjust the parameter of video image in described target area, and making the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area, described parameter at least includes one in resolution, frame per second and code check;
Or,
When the numerical value that the meansigma methods of the relatively last network bandwidth obtained of the meansigma methods of the network bandwidth obtained raises is more than or equal to three preset threshold values, the parameter of the video image in described target area is adjusted according to the described network bandwidth and described positional information, and making the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area, described parameter at least includes one in resolution, frame per second and code check.
Above the equipment of the terminal unit in the embodiment of the present invention and offer video image is described, below the video image processing system in the embodiment of the present invention is described, referring to Figure 16, in the embodiment of the present invention, 1,600 1 embodiments of video image processing system include:
Display end equipment 1601, for determining the watching area of user, and indicates information to video image acquisition end equipment 1602 sending zone;
Video image acquisition end equipment 1602, for receiving the region instruction information that described display end equipment 1601 sends, indicate information and the network bandwidth that the parameter of the video image of at least one in the target area of video image viewing area or nontarget area is adjusted according to described region, and make the quality of video image that the quality of the video image in described target area is not less than in described nontarget area.
Described display end equipment 1601 is additionally operable to when described region instruction information includes the positional information of described target area and described nontarget area, before video image acquisition end equipment 1602 sending zone instruction information, watching area according to described user determines target area and the nontarget area of video image viewing area, and described target area is corresponding with the watching area of described user.
Described display end equipment 1601 specifically can be also used for the direction of gaze of detection user and the distance of described user and video image, indicate information to described video image acquisition end equipment 1602 sending zone, described region instruction information includes the direction of gaze information of described user and the range information of described user and video image;
Described video image acquisition end equipment 1602 can be also used in indicating information and the network bandwidth to described target area or described nontarget area according to described region before the parameter of the video image of at least one is adjusted, the wide viewing angle of the range information of the direction of gaze information according to described user, described user and video image and the user of acquisition, determine described user overlay area, the visual field on video image viewing area, using the described user overlay area, the visual field on the video image viewing area watching area as described user; Watching area according to described user determines target area and the nontarget area of video image viewing area, determining described target area and the described nontarget area positional information on described video image viewing area, described target area is corresponding with the watching area of described user.
Those skilled in the art is it can be understood that arrive, for convenience and simplicity of description, the system of foregoing description, the specific works process of device and unit, it is possible to reference to the corresponding process in preceding method embodiment, do not repeat them here.
In several embodiments provided herein, it should be understood that disclosed system, apparatus and method, it is possible to realize by another way. Such as, device embodiment described above is merely schematic, such as, the division of described unit, being only a kind of logic function to divide, actual can have other dividing mode when realizing, for instance multiple unit or assembly can in conjunction with or be desirably integrated into another system, or some features can ignore, or do not perform. Another point, shown or discussed coupling each other or direct-coupling or communication connection can be through INDIRECT COUPLING or the communication connection of some interfaces, device or unit, it is possible to be electrical, machinery or other form.
The described unit illustrated as separating component can be or may not be physically separate, and the parts shown as unit can be or may not be physical location, namely may be located at a place, or can also be distributed on multiple NE. Some or all of unit therein can be selected according to the actual needs to realize the purpose of the present embodiment scheme.
It addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, it is also possible to be that unit is individually physically present, it is also possible to two or more unit are integrated in a unit. Above-mentioned integrated unit both can adopt the form of hardware to realize, it would however also be possible to employ the form of SFU software functional unit realizes.
The above, above example only in order to technical scheme to be described, is not intended to limit; Although the present invention being described in detail with reference to previous embodiment, it will be understood by those within the art that: the technical scheme described in foregoing embodiments still can be modified by it, or wherein portion of techniques feature is carried out equivalent replacement; And these amendments or replacement, do not make the essence of appropriate technical solution depart from the spirit and scope of various embodiments of the present invention technical scheme.

Claims (34)

1. the processing method of a video image, it is characterised in that including:
Display end equipment determines the watching area of user;
Described display end equipment indicates information to video image acquisition end equipment sending zone, make described video image acquisition end equipment indicate information and the network bandwidth that the parameter of the video image of at least one in the target area of video image viewing area or nontarget area is adjusted according to described region, and make the quality of video image that the quality of the video image in described target area is not less than in described nontarget area.
2. method according to claim 1, it is characterised in that described display end equipment determines that the watching area of user includes:
The distance of the direction of gaze of described display end equipment Inspection user and described user and video image;
Described display end equipment, according to the wide viewing angle of user obtained and the direction of gaze of described user detected, described user and the distance of video image, obtains the watching area of user.
3. method according to claim 2, it is characterised in that the described display end equipment distance according to the wide viewing angle of user obtained and the direction of gaze of described user detected, described user and video image, the watching area obtaining user includes:
The described display end equipment distance according to the direction of gaze of the described user detected and the wide viewing angle of user of acquisition, described user and video image, determine described user overlay area, the visual field on video image viewing area, using the described user overlay area, the visual field on the video image viewing area watching area as described user.
4. according to described method arbitrary in claims 1 to 3, it is characterised in that described region instruction information includes the target area of video image viewing area and the positional information of nontarget area;
Described display end equipment is to before video image acquisition end equipment sending zone instruction information, and described method also includes:
Described display end equipment determines target area and the nontarget area of video image viewing area according to the watching area of described user, and described target area is corresponding with the watching area of described user.
5. method according to claim 4, it is characterised in that according to the watching area of described user, described display end equipment determines that the target area of video image viewing area and nontarget area specifically include:
Described display end equipment according to the watching area of described user according to horizontal direction video image viewing area is divided into target area and nontarget area,
Described display end equipment according to the watching area of described user according to vertical direction video image viewing area is divided into target area and nontarget area,
Or,
Described display end equipment according to the watching area of described user according to horizontally and vertically video image viewing area being divided into target area and nontarget area.
6. method according to claim 4, it is characterised in that when there being multiple user, described display end equipment determines that the watching area of user specifically includes:
Described display end equipment determines the watching area of all users;
According to the watching area of described user, described display end equipment determines that the target area of video image viewing area and nontarget area include:
The watching area of all users is merged into comprehensive watching area by described display end equipment, determines target area and the nontarget area of video image viewing area according to described comprehensive watching area.
7. method according to claim 4, it is characterised in that when there being multiple user, described display end equipment determines that the watching area of user specifically includes:
Described display end equipment determines targeted customer according to pre-conditioned, and determines the watching area of described targeted customer;
When described targeted customer is one, according to the watching area of described user, described display end equipment determines that the target area of video image viewing area and nontarget area include:
Described display end equipment determines target area and the nontarget area of video image viewing area according to the watching area of described targeted customer;
When described targeted customer is multiple, according to the watching area of described user, described display end equipment determines that the target area of video image viewing area and nontarget area include:
The watching area of the plurality of targeted customer is merged into comprehensive watching area by described display end equipment, determines target area and the nontarget area of video image viewing area according to described comprehensive watching area.
8. method according to claim 7, it is characterised in that described display end equipment includes according to the pre-conditioned targeted customer of determination:
Described display end equipment obtains the positional information of the plurality of user and video image, it is determined that the user in the middle of the plurality of user is targeted customer.
9. according to described method arbitrary in claim 4 to 8, it is characterised in that described method also includes:
When the angle that the direction of gaze of described user changes within the time set is more than or equal to default value, described display end equipment redefines the watching area of described user and determines target area and the nontarget area of video image viewing area according to the watching area of described user;
Or,
When the time that the direction of gaze of described user keeps after changing more than or equal to preset threshold value time, described display end equipment redefines the watching area of described user and determines target area and the nontarget area of video image viewing area according to the watching area of described user;
Or,
When described user direction of gaze set time in change angle more than or equal to default value, and the direction of gaze of described user change after time of keeping more than or equal to preset threshold value time, described display end equipment redefines the watching area of described user and determines target area and the nontarget area of video image viewing area according to the watching area of described user.
10. the method according to claim 2 to 3, it is characterised in that described region instruction information includes the direction of gaze information of described user and the range information of described user and video image.
11. method according to any one of claim 1 to 10, it is characterised in that described parameter at least includes in resolution, frame per second and code check.
12. the processing method of a video image, it is characterised in that including:
Video image acquisition end equipment receives the region instruction information that display end equipment sends;
Described video image acquisition end equipment indicates information and the network bandwidth that the parameter of the video image of at least one in the target area of video image viewing area or nontarget area is adjusted according to described region, and makes the quality of video image that the quality of the video image in described target area is not less than in described nontarget area.
13. method according to claim 12, it is characterised in that described region instruction information includes described target area and the positional information of described nontarget area.
14. method according to claim 12, it is characterised in that described region instruction information includes the direction of gaze information of described user and the range information of described user and video image;
Before in described video image acquisition end equipment indicates information and the network bandwidth to the target area of video image viewing area or nontarget area according to described region, the parameter of the video image of at least one is adjusted, described method also includes:
The described video image acquisition end equipment wide viewing angle according to the user of the direction of gaze information of described user, the range information of described user and video image and acquisition, determine described user overlay area, the visual field on video image viewing area, using the described user overlay area, the visual field on the video image viewing area watching area as described user;
Described video image acquisition end equipment determines target area and the nontarget area of video image viewing area according to the watching area of described user, determining described target area and the described nontarget area positional information on described video image viewing area, described target area is corresponding with the watching area of described user.
15. the method according to claim 13 or 14, it is characterized in that, described video image acquisition end equipment indicates information and the network bandwidth to be adjusted including to the parameter of the video image of at least one in the target area of video image viewing area or nontarget area according to described region:
When the network bandwidth is less than the first preset threshold value, described video image acquisition end equipment adjusts the parameter of the video image in described nontarget area according to the described network bandwidth and described positional information, and making the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area, described parameter at least includes one in resolution, frame per second and code check;
Or,
When the network bandwidth is less than the first preset threshold value, described video image acquisition end equipment adjusts the parameter of the video image in described nontarget area according to the described network bandwidth and described positional information, and adjust the parameter of video image in described target area, and making the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area, described parameter at least includes one in resolution, frame per second and code check;
Or,
When the network bandwidth is more than or equal to the first preset threshold value, described video image acquisition end equipment adjusts the parameter of the video image in described target area according to the described network bandwidth and described positional information, and making the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area, described parameter at least includes one in resolution, frame per second and code check;
Or,
When the network bandwidth is more than or equal to the first preset threshold value, described video image acquisition end equipment adjusts the parameter of the video image in described target area and described nontarget area according to the described network bandwidth and described positional information, and making the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area, described parameter at least includes one in resolution, frame per second and code check.
16. the method according to claim 13 or 14, it is characterized in that, described video image acquisition end equipment indicates information and the network bandwidth to be adjusted specifically including to the parameter of the video image of at least one in the target area of video image viewing area or nontarget area according to described region:
Obtain the meansigma methods of the network bandwidth in the setting time in real time;
When the numerical value that the meansigma methods of the relatively last network bandwidth obtained of the meansigma methods of the network bandwidth obtained reduces is more than or equal to the second preset threshold value, described video image acquisition end equipment adjusts the parameter of the video image in described nontarget area according to the described network bandwidth and described positional information, and making the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area, described parameter at least includes one in resolution, frame per second and code check;
Or,
When the numerical value that the meansigma methods of the relatively last network bandwidth obtained of the meansigma methods of the network bandwidth obtained reduces is more than or equal to the second preset threshold value, described video image acquisition end equipment adjusts the parameter of the video image in described nontarget area according to the described network bandwidth and described positional information, and adjust the parameter of video image in described target area, and make the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area, described parameter at least includes resolution, frame per second, with in code check,
Or,
When the numerical value that the meansigma methods of the relatively last network bandwidth obtained of the meansigma methods of the network bandwidth obtained raises is more than or equal to three preset threshold values, described video image acquisition end equipment adjusts the parameter of the video image in described target area according to the described network bandwidth and described positional information, and making the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area, described parameter at least includes one in resolution, frame per second and code check.
17. a terminal unit, it is characterised in that including:
First determines unit, for determining the watching area of user;
Transmitting element, for indicating information to video image acquisition end equipment sending zone, make described video image acquisition end equipment indicate information and the network bandwidth that the parameter of the video image of at least one in the target area of video image viewing area or nontarget area is adjusted according to described region, and make the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area.
18. terminal unit according to claim 17, it is characterised in that described first determines that unit includes:
Detection sub-unit, for detecting the direction of gaze of user and the distance of user and video image;
Determine subelement, for the wide viewing angle of the distance according to the direction of gaze of described user detected, described user and video image and the user of acquisition, obtain the watching area of user.
19. terminal unit according to claim 18, it is characterized in that, described determine that subelement is specifically for the distance according to the direction of gaze of described user detected and the wide viewing angle of user of acquisition, described user and video image, determine described user overlay area, the visual field on video image viewing area, using the described user overlay area, the visual field on the video image viewing area watching area as described user.
20. according to described terminal unit arbitrary in claim 17 to 19, it is characterised in that described terminal unit also includes:
Second determines unit, during for including the positional information of the target area of video image viewing area and nontarget area in described region instruction information, at described transmitting element to before video image acquisition end equipment sending zone instruction information, watching area according to described user determines target area and the nontarget area of video image viewing area, and described target area is corresponding with the watching area of described user.
21. terminal unit according to claim 20, it is characterised in that described second determine unit specifically for
Video image viewing area is divided into target area and nontarget area according to horizontal direction by the watching area according to described user;
Or,
Video image viewing area is divided into target area and nontarget area according to vertical direction by the watching area according to described user;
Or,
Watching area according to described user is according to video image viewing area is horizontally and vertically divided into target area and nontarget area.
22. terminal unit according to claim 20, it is characterised in that when there being multiple user, described first determines that unit is additionally operable to determine the watching area of all users;
Described second determines that unit is additionally operable to the watching area of all users is merged into comprehensive watching area, determines target area and the nontarget area of video image viewing area according to described comprehensive watching area.
23. terminal unit according to claim 20, it is characterised in that when there being multiple user, described first determines that unit is additionally operable to determine targeted customer according to pre-conditioned, and determines the watching area of described targeted customer;
When described targeted customer is one, described second determines that unit is additionally operable to the watching area according to described targeted customer and determines target area and the nontarget area of video image viewing area;
When described targeted customer is multiple, described second determines that unit is additionally operable to the watching area of the plurality of targeted customer is merged into comprehensive watching area, determines target area and the nontarget area of video image viewing area according to described comprehensive watching area.
24. terminal unit according to claim 23, it is characterised in that described first determines that unit is additionally operable to the positional information obtaining the plurality of user with video image, it is determined that the user in the middle of the plurality of user is targeted customer.
25. the terminal unit according to claim 20 to 24, it is characterised in that
Described terminal unit also includes:
First updating block, for when the angle that the direction of gaze of described user changes within the time set is more than or equal to default value, redefining the watching area of described user and determine target area and the nontarget area of video image viewing area according to the watching area of described user;
Or,
Second updating block, for when keeping the time changed more than or equal to preset threshold value after the direction of gaze of described user, redefining the watching area of described user and determine target area and the nontarget area of video image viewing area according to the watching area of described user;
Or,
3rd updating block, for when described user direction of gaze set time in change angle more than or equal to default value, and the direction of gaze of described user change after time of keeping more than or equal to preset threshold value time, redefine the watching area of described user and determine target area and the nontarget area of video image viewing area according to the watching area of described user.
26. the terminal unit according to claim 17 to 25, it is characterised in that described region instruction information includes the direction of gaze information of described user and the range information of described user and video image.
27. the equipment that video image is provided, it is characterised in that including:
Receive unit, for receiving the region instruction information that display end equipment sends;
Adjustment unit, for indicating information and the network bandwidth that the parameter of the video image of at least one in the target area of video image viewing area or nontarget area is adjusted according to described region, and make the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area.
28. equipment according to claim 27, it is characterised in that the described region instruction information that described reception unit receives includes described target area and the positional information of described nontarget area.
29. equipment according to claim 27, it is characterised in that described equipment also includes:
Determine unit, during for including the range information of the direction of gaze information of described user and described user and video image in described region instruction information, before in described adjustment unit indicates information and the network bandwidth to target area or nontarget area according to described region, the parameter of the video image of at least one is adjusted, direction of gaze information according to described user, the wide viewing angle of the range information of described user and video image and the user of acquisition, determine described user overlay area, the visual field on video image viewing area, using the described user overlay area, the visual field on the video image viewing area watching area as described user, watching area according to described user determines target area and the nontarget area of video image viewing area, determining described target area and the described nontarget area positional information on described video image viewing area, described target area is corresponding with the watching area of described user.
30. the equipment according to claim 28 or 29, it is characterised in that
Described adjustment unit specifically for
When the network bandwidth is less than the first preset threshold value, the parameter of the video image in described nontarget area is adjusted according to the described network bandwidth and described positional information, and making the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area, described parameter at least includes one in resolution, frame per second and code check;
Or,
When the network bandwidth is less than the first preset threshold value, the parameter of the video image in described nontarget area is adjusted according to the described network bandwidth and described positional information, and adjust the parameter of video image in described target area, and making the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area, described parameter at least includes one in resolution, frame per second and code check;
Or,
When the network bandwidth is more than or equal to the first preset threshold value, the parameter of the video image in described target area is adjusted according to the described network bandwidth and described positional information, and making the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area, described parameter at least includes one in resolution, frame per second and code check;
Or,
When the network bandwidth is more than or equal to the first preset threshold value, the parameter of the video image in described target area and described nontarget area is adjusted according to the described network bandwidth and described positional information, and making the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area, described parameter at least includes one in resolution, frame per second and code check.
31. the equipment according to claim 28 or 29, it is characterised in that described adjustment unit is specifically for obtaining the meansigma methods of the network bandwidth in the setting time in real time;
When the numerical value that the meansigma methods of the relatively last network bandwidth obtained of the meansigma methods of the network bandwidth obtained reduces is more than or equal to the second preset threshold value, the parameter of the video image in described nontarget area is adjusted according to the described network bandwidth and described positional information, and making the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area, described parameter at least includes one in resolution, frame per second and code check;
Or,
When the numerical value that the meansigma methods of the relatively last network bandwidth obtained of the meansigma methods of the network bandwidth obtained reduces is more than or equal to the second preset threshold value, the parameter of the video image in described nontarget area is adjusted according to the described network bandwidth and described positional information, and adjust the parameter of video image in described target area, and making the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area, described parameter at least includes one in resolution, frame per second and code check;
Or,
When the numerical value that the meansigma methods of the relatively last network bandwidth obtained of the meansigma methods of the network bandwidth obtained raises is more than or equal to three preset threshold values, the parameter of the video image in described target area is adjusted according to the described network bandwidth and described positional information, and making the display quality of video image that the display quality of the video image in described target area is not less than in described nontarget area, described parameter at least includes one in resolution, frame per second and code check.
32. a video image processing system, it is characterised in that including:
Display end equipment, for determining the watching area of user, and indicates information to video image acquisition end equipment sending zone;
Video image acquisition end equipment, for receiving the region instruction information that described display end equipment sends, indicate information and the network bandwidth that the parameter of the video image of at least one in the target area of video image viewing area or nontarget area is adjusted according to described region, and make the quality of video image that the quality of the video image in described target area is not less than in described nontarget area.
33. video image processing system according to claim 32, it is characterised in that
Described display end equipment is additionally operable to when described region instruction information includes the positional information of described target area and described nontarget area, before video image acquisition end equipment sending zone instruction information, watching area according to described user determines target area and the nontarget area of video image viewing area, and described target area is corresponding with the watching area of described user.
34. video image processing system according to claim 32, it is characterized in that, the distance of described display end equipment direction of gaze and described user and video image specifically for detecting user, indicate information to described video image acquisition end equipment sending zone, described region instruction information includes the direction of gaze information of described user and the range information of described user and video image;
Before described video image acquisition end equipment is additionally operable in indicating information and the network bandwidth to described target area or described nontarget area according to described region that the parameter of the video image of at least one is adjusted, the wide viewing angle of the range information of the direction of gaze information according to described user, described user and video image and the user of acquisition, determine described user overlay area, the visual field on video image viewing area, using the described user overlay area, the visual field on the video image viewing area watching area as described user; Watching area according to described user determines target area and the nontarget area of video image viewing area, determining described target area and the described nontarget area positional information on described video image viewing area, described target area is corresponding with the watching area of described user.
CN201410582230.3A 2014-10-27 2014-10-27 Processing method, equipment and the system of video image Active CN105635624B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201410582230.3A CN105635624B (en) 2014-10-27 2014-10-27 Processing method, equipment and the system of video image
PCT/CN2015/082359 WO2016065913A1 (en) 2014-10-27 2015-06-25 Video image processing method, device and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410582230.3A CN105635624B (en) 2014-10-27 2014-10-27 Processing method, equipment and the system of video image

Publications (2)

Publication Number Publication Date
CN105635624A true CN105635624A (en) 2016-06-01
CN105635624B CN105635624B (en) 2019-05-03

Family

ID=55856533

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410582230.3A Active CN105635624B (en) 2014-10-27 2014-10-27 Processing method, equipment and the system of video image

Country Status (2)

Country Link
CN (1) CN105635624B (en)
WO (1) WO2016065913A1 (en)

Cited By (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107153519A (en) * 2017-04-28 2017-09-12 北京七鑫易维信息技术有限公司 Image transfer method, method for displaying image and image processing apparatus
CN107547790A (en) * 2016-06-27 2018-01-05 中兴通讯股份有限公司 The processing method of IMAQ, apparatus and system
CN107950017A (en) * 2016-06-15 2018-04-20 索尼公司 Image processing equipment, image processing method and picture pick-up device
WO2018077142A1 (en) * 2016-10-26 2018-05-03 深圳市道通智能航空技术有限公司 Panoramic video processing method, device and system
WO2018120519A1 (en) * 2016-12-26 2018-07-05 华为技术有限公司 Image processing method and device
CN108366245A (en) * 2018-03-16 2018-08-03 北京虚拟映画科技有限公司 Imaged image transmission method and device
CN108366244A (en) * 2018-03-16 2018-08-03 北京虚拟映画科技有限公司 video image transmission method and device
CN108508600A (en) * 2017-02-28 2018-09-07 精工爱普生株式会社 Head-mount type display unit and image-forming optical system
CN108664847A (en) * 2017-03-29 2018-10-16 华为技术有限公司 A kind of object identifying method, equipment and system
WO2018196598A1 (en) * 2017-04-28 2018-11-01 北京七鑫易维信息技术有限公司 Method and device for transmitting image data, storage medium, and processor
WO2018205593A1 (en) * 2017-05-12 2018-11-15 京东方科技集团股份有限公司 Display control device and method, and display system
CN109194923A (en) * 2018-10-18 2019-01-11 眸芯科技（上海）有限公司 Video image processing apparatus, system and method based on non-uniformed resolution ratio
CN109716265A (en) * 2016-09-20 2019-05-03 托比股份公司 Based on the graphical manipulation watched attentively and swept
CN110572656A (en) * 2019-09-19 2019-12-13 北京视博云科技有限公司 coding method, image processing method, device and system
CN111654647A (en) * 2020-06-02 2020-09-11 苏州睿新微系统技术有限公司 Induction imaging control method, device and control circuit of infrared detector
CN112911191A (en) * 2021-01-28 2021-06-04 联想(北京)有限公司 Video call quality adjusting method and device, electronic equipment and storage medium
CN113810725A (en) * 2021-10-12 2021-12-17 深圳市华胜软件技术有限公司 Video processing method, device, storage medium and video communication terminal
CN114449162A (en) * 2021-12-22 2022-05-06 天翼云科技有限公司 Method and device for playing panoramic video, computer equipment and storage medium
CN114520905A (en) * 2020-11-19 2022-05-20 京东方科技集团股份有限公司 Image processing method, image display method and image display system
CN115348478A (en) * 2022-07-25 2022-11-15 深圳市九洲电器有限公司 Device interaction display method and device, electronic device and readable storage medium
CN114449162B (en) * 2021-12-22 2024-04-30 天翼云科技有限公司 Method, device, computer equipment and storage medium for playing panoramic video

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130219012A1 (en) * 2012-02-22 2013-08-22 Citrix Systems, Inc. Hierarchical Display
CN103559006A (en) * 2010-12-08 2014-02-05 索尼电脑娱乐公司 Adaptive displays using gaze tracking

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101441513B (en) * 2008-11-26 2010-08-11 北京科技大学 System for performing non-contact type human-machine interaction by vision
US9361718B2 (en) * 2011-09-08 2016-06-07 Intel Corporation Interactive screen viewing
CN103699308A (en) * 2013-12-24 2014-04-02 惠州Tcl移动通信有限公司 Automatic paging method and device

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103559006A (en) * 2010-12-08 2014-02-05 索尼电脑娱乐公司 Adaptive displays using gaze tracking
US20130219012A1 (en) * 2012-02-22 2013-08-22 Citrix Systems, Inc. Hierarchical Display

Cited By (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107950017A (en) * 2016-06-15 2018-04-20 索尼公司 Image processing equipment, image processing method and picture pick-up device
CN107547790A (en) * 2016-06-27 2018-01-05 中兴通讯股份有限公司 The processing method of IMAQ, apparatus and system
CN109716265A (en) * 2016-09-20 2019-05-03 托比股份公司 Based on the graphical manipulation watched attentively and swept
CN112445339A (en) * 2016-09-20 2021-03-05 托比股份公司 Gaze and glance based graphical manipulation
WO2018077142A1 (en) * 2016-10-26 2018-05-03 深圳市道通智能航空技术有限公司 Panoramic video processing method, device and system
WO2018120519A1 (en) * 2016-12-26 2018-07-05 华为技术有限公司 Image processing method and device
CN109804409A (en) * 2016-12-26 2019-05-24 华为技术有限公司 The method and apparatus of image procossing
CN108508600B (en) * 2017-02-28 2022-08-05 精工爱普生株式会社 Head-mounted display device and image forming optical system
CN108508600A (en) * 2017-02-28 2018-09-07 精工爱普生株式会社 Head-mount type display unit and image-forming optical system
CN108664847B (en) * 2017-03-29 2021-10-22 华为技术有限公司 Object identification method, device and system
CN108664847A (en) * 2017-03-29 2018-10-16 华为技术有限公司 A kind of object identifying method, equipment and system
US10650497B2 (en) * 2017-04-28 2020-05-12 Beijing 7Invensun Technology Co., Ltd. Method and device for transmitting and displaying image, storage medium, and processor
AU2018256967B2 (en) * 2017-04-28 2020-10-22 Beijing 7Invensun Technology Co., Ltd. Method and device for transmitting and displaying image, storage medium, and processor
WO2018196598A1 (en) * 2017-04-28 2018-11-01 北京七鑫易维信息技术有限公司 Method and device for transmitting image data, storage medium, and processor
WO2018196597A1 (en) * 2017-04-28 2018-11-01 北京七鑫易维信息技术有限公司 Method and device for transmitting and displaying image, storage medium, and processor
CN107153519A (en) * 2017-04-28 2017-09-12 北京七鑫易维信息技术有限公司 Image transfer method, method for displaying image and image processing apparatus
US10930252B2 (en) 2017-04-28 2021-02-23 Beijing 7Invensun Technology Co., Ltd. Dividing image data into regional images of different resolutions based on a gaze point and transmitting the divided image data
WO2018205593A1 (en) * 2017-05-12 2018-11-15 京东方科技集团股份有限公司 Display control device and method, and display system
CN108366245A (en) * 2018-03-16 2018-08-03 北京虚拟映画科技有限公司 Imaged image transmission method and device
CN108366244A (en) * 2018-03-16 2018-08-03 北京虚拟映画科技有限公司 video image transmission method and device
CN109194923B (en) * 2018-10-18 2023-08-29 眸芯科技（上海）有限公司 Video image processing device, system and method based on local non-uniform resolution
CN109194923A (en) * 2018-10-18 2019-01-11 眸芯科技（上海）有限公司 Video image processing apparatus, system and method based on non-uniformed resolution ratio
CN110572656B (en) * 2019-09-19 2021-11-19 江苏视博云信息技术有限公司 Encoding method, image processing method, device, system, storage medium and equipment
CN110572656A (en) * 2019-09-19 2019-12-13 北京视博云科技有限公司 coding method, image processing method, device and system
CN111654647A (en) * 2020-06-02 2020-09-11 苏州睿新微系统技术有限公司 Induction imaging control method, device and control circuit of infrared detector
CN111654647B (en) * 2020-06-02 2022-12-09 苏州睿新微系统技术有限公司 Induction imaging control method, device and control circuit of infrared detector
CN114520905A (en) * 2020-11-19 2022-05-20 京东方科技集团股份有限公司 Image processing method, image display method and image display system
US11800079B2 (en) 2020-11-19 2023-10-24 Beijing Boe Optoelectronics Technology Co., Ltd. Image processing method, image display method and image display system
CN114520905B (en) * 2020-11-19 2024-04-19 京东方科技集团股份有限公司 Image processing method, image display method and image display system
CN112911191A (en) * 2021-01-28 2021-06-04 联想(北京)有限公司 Video call quality adjusting method and device, electronic equipment and storage medium
CN113810725A (en) * 2021-10-12 2021-12-17 深圳市华胜软件技术有限公司 Video processing method, device, storage medium and video communication terminal
CN114449162A (en) * 2021-12-22 2022-05-06 天翼云科技有限公司 Method and device for playing panoramic video, computer equipment and storage medium
CN114449162B (en) * 2021-12-22 2024-04-30 天翼云科技有限公司 Method, device, computer equipment and storage medium for playing panoramic video
CN115348478A (en) * 2022-07-25 2022-11-15 深圳市九洲电器有限公司 Device interaction display method and device, electronic device and readable storage medium
CN115348478B (en) * 2022-07-25 2023-09-19 深圳市九洲电器有限公司 Equipment interactive display method and device, electronic equipment and readable storage medium

Also Published As

Publication number Publication date
CN105635624B (en) 2019-05-03
WO2016065913A1 (en) 2016-05-06

Similar Documents

Publication Publication Date Title
CN105635624A (en) Video image processing method, device and system
US10572010B2 (en) Adaptive parallax adjustment method and virtual reality display device
CN204887281U (en) Stereoscopic display device
CN104735449A (en) Image transmission method and system based on rectangular segmentation and interlaced scanning
CN110149555B (en) Video processing method and video receiving device
US10593028B2 (en) Method and apparatus for view-dependent tone mapping of virtual reality images
US20130141550A1 (en) Method, apparatus and computer program for selecting a stereoscopic imaging viewpoint pair
CN103037241B (en) Automatic test system of reproduction ratio
CN104767992A (en) Head-wearing type display system and image low-bandwidth transmission method
JPWO2004056133A1 (en) 3D image generation apparatus and 3D image distribution method
CN104571474A (en) Method and device for adaptively adjusting contents displayed on terminal screen
CN103873822A (en) Method, equipment and system for monitoring system to select camera to browse in real time
CN103379351A (en) Video processing method and video processing device
AU2017405914B2 (en) Virtual reality image sending method and apparatus
WO2016197792A1 (en) Data sharing system
CN102402970B (en) Method and device for adjusting contrast of display screen
CN104601981A (en) Method for adjusting viewing angles based on human eyes tracking and holographic display device
CN104749980A (en) Display control method and electronic equipment
CN110191369A (en) Image interception method, apparatus, equipment and storage medium
CN110312142A (en) A kind of AR live broadcast system based on 5G technology
CN113612979A (en) Projection method, electronic equipment and computer equipment
CN111325201A (en) Image processing method and device, movable equipment, unmanned aerial vehicle remote controller and system
US8212853B2 (en) Instant video messaging system and instant video messaging method thereof
CN101917642B (en) LED stereoscopic display and display system
US20150091796A1 (en) Display apparatus and control method thereof

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant