WO2020000521A1 - 全景视频的画面质量显示方法及装置 - Google Patents

全景视频的画面质量显示方法及装置 Download PDF

Info

Publication number
WO2020000521A1
WO2020000521A1 PCT/CN2018/095328 CN2018095328W WO2020000521A1 WO 2020000521 A1 WO2020000521 A1 WO 2020000521A1 CN 2018095328 W CN2018095328 W CN 2018095328W WO 2020000521 A1 WO2020000521 A1 WO 2020000521A1
Authority
WO
WIPO (PCT)
Prior art keywords
attention
parameter
picture
picture quality
resolution distribution
Prior art date
Application number
PCT/CN2018/095328
Other languages
English (en)
French (fr)
Inventor
蒋小可
马睿
马志友
Original Assignee
深圳看到科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳看到科技有限公司 filed Critical 深圳看到科技有限公司
Priority to US17/266,112 priority Critical patent/US11533469B2/en
Publication of WO2020000521A1 publication Critical patent/WO2020000521A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/366—Image reproducers using viewer tracking
    • H04N13/383—Image reproducers using viewer tracking for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00—Diagnosis, testing or measuring for television systems or their details
    • H04N17/02—Diagnosis, testing or measuring for television systems or their details for colour television signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/139—Format conversion, e.g. of frame-rate or size
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/15—Processing image signals for colour aspects of image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00—Diagnosis, testing or measuring for television systems or their details
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture

Definitions

  • the present invention relates to the field of multimedia technology, and in particular, to a picture quality display method and a picture quality display device for a panoramic video.
  • Panoramic video technology is an extension of panoramic photo technology. It is a 360-degree video shot with a 3D camera. It carries a wealth of information and can play changing scenes in real time. People can choose viewing angles in the horizontal and vertical directions, and browse the scenes of interest in the panoramic video as if they were immersive.
  • the user can watch the panoramic video through the VR helmet.
  • the panoramic video player can cut the panoramic video picture according to the viewing angle of the user. For example, if the user views the front picture, only the part of the user's front picture can be transmitted to the VR helmet for viewing.
  • panoramic video In order to meet the user's higher visual experience, panoramic video has higher and higher requirements for picture quality, but the amount of panoramic video data is huge, which obviously increases the difficulty of shooting and transmission of the screen content, which causes the display device to fail to play high-resolution The cost of panoramic video and playback is getting higher and higher.
  • it may be considered to perform a resolution reduction operation on part of the content of the screen to reduce shooting costs and playback costs. Therefore, it is necessary to study the degree of interest of users in different pictures and provide reference for picture adjustment based on the degree of interest of users.
  • the abscissa is the frame of the panoramic video (that is, the playback time), and the ordinate is the angle information of the user viewing the panoramic frame.
  • FIG. 1 for a specific schematic diagram. It can be known from FIG. 1 that the trajectory of the picture of interest in the prior art is a flat display mode, and the trajectory of the picture of interest cannot display picture quality, and cannot provide accurate picture quality reference standards for panoramic videos intuitively and accurately.
  • Embodiments of the present invention provide a method and a device for displaying picture quality of a panoramic video, so as to solve a technical problem that the prior art cannot intuitively and accurately provide an accurate picture quality reference standard for a panoramic video.
  • the present invention provides a picture quality display method for a panoramic video, including:
  • the attention information curve taking the time point as a polar diameter, and the horizontal angle of the picture obtained at the time point as a polar angle;
  • the acquiring picture quality parameters specifically includes:
  • an attention focus parameter which is used to indicate a user's level of attention to a picture, the attention focus parameter being a function of the horizontal angle of the picture;
  • Obtaining a resolution distribution parameter where the resolution distribution parameter is used to represent a resolution distribution situation of a picture, and the resolution distribution parameter is a function of a horizontal angle of the picture;
  • the attention focus parameter and the resolution distribution parameter are synthesized to obtain the picture quality parameter.
  • the present invention provides a picture quality display method for a panoramic video, including:
  • the attention information curve taking the time point as a polar diameter, and the horizontal angle of the picture obtained at the time point as a polar angle;
  • marking the picture quality parameter on the attention information curve to display the picture quality parameter specifically includes:
  • a line style is set on the attention information curve, and the picture quality parameter is displayed by the line style, and different line widths represent different picture quality parameters.
  • the obtaining a picture quality parameter specifically includes obtaining an attention focus parameter, where the attention focus parameter is used to indicate a user's level of attention to the picture, and the attention focus parameter is the picture A function of the horizontal angle; obtaining a resolution distribution parameter, which is used to represent the resolution distribution of the picture, the resolution distribution parameter is a function of the horizontal angle of the picture; synthesizing the attention focus parameter and The resolution distribution parameter to obtain the picture quality parameter.
  • the synthesizing the attention focus parameter and the resolution distribution parameter to obtain the picture quality parameter specifically includes:
  • F (x, y) is an attention focusing parameter
  • P (x, y) is a resolution distribution parameter
  • the attention position information further includes a vertical angle of the picture.
  • a method for displaying a picture quality of a panoramic video further includes: adjusting the picture quality parameter according to the display of the attention information curve, so that the adjusted picture quality parameter meets a quality requirement.
  • the acquiring the user's attention position information at different time points within a preset time period specifically includes:
  • a plurality of attention position information of a user in a preset time period is acquired at a preset time interval, each time point corresponds to one of the attention position information, and the horizontal angle of the picture is the user's eyes to the horizontal direction at the time point Attention position on the screen.
  • the present invention provides a picture quality display device for a panoramic video, including:
  • a first acquisition module configured to acquire attention position information of a user at different time points within a preset time period, where the attention position information includes a horizontal angle of a picture
  • a second acquisition module configured to acquire a picture quality parameter
  • a creation module configured to create an attention information curve in a polar coordinate system, the attention information curve taking the time point as a pole diameter, and the picture acquired by the first acquisition module at the time point
  • the horizontal angle is a polar angle
  • the processing module is configured to mark the picture quality parameter obtained by the second obtaining module on the attention information curve created by the creating module, so as to display the picture quality parameter.
  • the processing module may be specifically configured to execute: setting a color on the attention information curve, displaying the picture quality parameter by the color, and different colors representing different picture quality parameters; and / or,
  • a line style is set on the attention information curve, and the picture quality parameter is displayed by the line style, and different line widths represent different picture quality parameters.
  • the second acquisition module specifically includes a first sub acquisition module, a second sub acquisition module, and a third sub acquisition module:
  • the first sub-acquisition module is configured to obtain an attention focus parameter, which is used to indicate a user's level of attention to a picture, and the attention focus parameter is a function of the horizontal angle of the picture;
  • the second sub-acquisition module is configured to acquire a resolution distribution parameter, where the resolution distribution parameter is used to represent a resolution distribution of a picture, and the resolution distribution parameter is a function of a horizontal angle of the picture;
  • the third sub-acquisition module is configured to synthesize the attention focus parameter obtained by the first sub-acquisition module and the resolution distribution parameter obtained by the second sub-acquisition module to obtain the picture quality parameter;
  • the third sub-acquisition module is specifically configured to execute:
  • F (x, y) is an attention focusing parameter
  • P (x, y) is a resolution distribution parameter
  • the attention position information further includes a vertical angle of the picture.
  • the picture quality display device for panoramic video may further include: an adjustment module;
  • the adjustment module is configured to adjust the picture quality parameter according to the display of the attention information curve, so that the adjusted picture quality parameter meets quality requirements.
  • the method and device for displaying the picture quality of a panoramic video acquire the user's attention position information at different time points in a preset time period, where the attention position information includes the horizontal angle of the picture, and is in a polar coordinate system.
  • Attention information curve is created in the method.
  • the attention information curve takes the time point as the extreme diameter and the horizontal angle of the picture obtained at the time point as the polar angle. It is also possible to obtain picture quality parameters and The picture quality parameter is marked on the attention information curve in order to display the picture quality parameter.
  • the attention trajectory of the user's attention position and the change in picture quality can be clearly obtained through the attention information curve; and because the display angle range of the polar coordinate system is 360 degrees, when viewing videos with panoramic video users
  • the horizontal angle of the picture is more consistent, and the attention information curve is created in polar coordinates, which can more accurately and intuitively obtain the change trajectory of the attention position and the picture quality of each area; it solves the picture trajectory of interest for panoramic video in the prior art It is a flat display method, and it cannot display the picture quality, and it cannot technically provide an accurate picture quality reference standard for the panoramic video intuitively and accurately.
  • FIG. 1 is a schematic diagram of a picture track of interest in the prior art
  • FIG. 2 is a flowchart of a method for displaying a picture quality of a panoramic video according to an embodiment of the present invention
  • FIG. 3 is a schematic diagram of an attention information curve according to an embodiment of the present invention.
  • FIG. 4 is another schematic diagram of an attention information curve according to an embodiment of the present invention.
  • FIG. 5 is a schematic structural diagram of a picture quality display device for a panoramic video according to an embodiment of the present invention.
  • FIG. 6 is another flowchart of a method for displaying a picture quality of a panoramic video according to an embodiment of the present invention.
  • the method and device for displaying picture quality of a panoramic video acquire user's attention position information at different time points in a preset time period, the attention position information includes a horizontal angle of the screen, and creates attention information in a polar coordinate system Curve, the attention information curve takes the time point as the extreme diameter, and the horizontal angle of the picture obtained at the time point is the polar angle, and picture quality parameters can also be obtained, and on the attention information curve Marking the picture quality parameter so as to display the picture quality parameter.
  • the attention trajectory of the user's attention position and the change in picture quality can be clearly obtained through the attention information curve; and because the display angle range of the polar coordinate system is 360 degrees, when viewing videos with panoramic video users
  • the horizontal angle of the picture is more consistent, and the attention information curve is created in polar coordinates, which can more accurately and intuitively obtain the change trajectory of the attention position and the picture quality of each area; it solves the picture trajectory of interest for panoramic video in the prior art It is a flat display method, and it cannot display the picture quality, and it cannot technically provide an accurate picture quality reference standard for the panoramic video intuitively and accurately.
  • the method for displaying the picture quality of the panoramic video includes the following steps: obtaining attention position information of the user at different time points within a preset time period, and the attention position
  • the information includes the horizontal angle of the picture; creating an attention information curve in a polar coordinate system, the attention information curve taking the time point as a polar diameter, and the horizontal angle of the picture obtained at the time point as a polar angle; Picture quality parameters, and marking the picture quality parameters on the attention information curve so as to display the picture quality parameters.
  • FIG. 2 is a method flowchart of a method for displaying a picture quality of a panoramic video according to an embodiment of the present invention, which may include:
  • Step S101 Obtain attention position information of a user at different time points in a preset time period, where the attention position information includes a horizontal angle of a picture;
  • Panoramic video can provide users with 360-degree video viewing angle, but the user can only pay attention to a certain position in the picture at a certain point in time, using this position as the attention position information, which includes the horizontal angle of the picture, the horizontal angle of the picture Refers to the attention position information of the user's eyes on the picture in the horizontal direction.
  • the change in attention position information in a panoramic video over a period of time can be obtained, and the change in attention position information in a full panoramic video can also be obtained. That is, the preset time period can be a playback time of the panoramic video, or Is the full playback time of the entire panoramic video.
  • attention position information may be obtained at a certain time interval, and the specific time interval is determined by the user, which is not limited in the present invention.
  • attention position information is acquired every 10 frames, or attention position information is acquired every 1 frame.
  • this video can collect 2000 attention position information.
  • the attention position information of different users may be slightly different, which results in that the attention position information of different users may be different.
  • the attention position information of each user may be obtained. Construct attention curve separately to show the change of attention position of different users. In this way, the viewing habits of different users can be obtained, and the personalized characteristics of each user can be obtained.
  • acquiring the attention position information may specifically include: acquiring multiple attention position information of each user within a preset time period at preset time intervals, each time point corresponding to one of the attention positions The information is then displayed on the attention information curve based on the obtained position information of each user.
  • a large data collection method is used to obtain a large number of users 'attention position information and general users' attention position information, thereby satisfying most The viewing needs of users. It is also possible to introduce a correction value, use the correction value to correct the acquired attention position information, and use the corrected attention position information to construct an attention information curve.
  • Step S102 Create an attention information curve in a polar coordinate system, where the attention information curve uses the time point as a polar diameter, and the horizontal angle of the screen obtained at the time point is a polar angle;
  • the attention position information at each time point is obtained in the foregoing step S101.
  • the attention information curve can be constructed based on the attention position information in a polar coordinate system, where the polar axis of the polar coordinate system is time, and the attention is constructed.
  • the information curve takes the time point as a polar diameter, and the horizontal angle of the picture obtained at the time point as a polar angle.
  • multiple attention position information may be acquired at preset time intervals, and then the multiple attention position information is marked in a polar coordinate system with coordinate points, and then each is connected Coordinate points to get a complete attention curve. For example, taking a complete playback of a video with a duration of 2000 frames and a time interval of 10 frames as an example, attention position information can be obtained every 10 frames, and each coordinate point is marked in polar coordinates. The coordinate point is the time point and An ordered number pair of attention position information can obtain a total of 200 coordinate points, and connecting these 200 coordinate points can obtain a complete attention information curve.
  • the method of connecting the coordinate points includes, but is not limited to, a spline curve method, a curve fitting method, or an interpolation spline curve method.
  • a 360-degree picture in the horizontal direction can be arbitrarily switched, and the displayable range of the polar coordinate system is 360 degrees, which is more consistent with the horizontal angle of the picture when the panoramic video user watches the video.
  • Creating the attention information curve in polar coordinates can more accurately and intuitively obtain the change trajectory of the attention position and the picture quality of each area.
  • Step S103 Acquire a picture quality parameter
  • a picture quality parameter at each time point can be obtained in a preset method, and the picture quality parameter is related to a user's attention position at the time point, such as a picture horizontal angle.
  • an embodiment of the present invention provides a method for acquiring a picture quality parameter, which may specifically include the following steps:
  • Step A1 Obtain an attention focus parameter, where the attention focus parameter is used to indicate a user's level of attention to a picture, and the attention focus parameter is a function of the horizontal angle of the picture;
  • Step A2 Obtain a resolution distribution parameter, where the resolution distribution parameter is used to represent a resolution distribution of a picture, and the resolution distribution parameter is a function of a horizontal angle of the picture;
  • Step A3 Synthesize the attention focus parameter and the resolution distribution parameter to obtain the picture quality parameter.
  • the resolution distribution parameter may be obtained specifically through the resolution estimation and the horizontal angle of the screen, that is, the step of obtaining the resolution distribution parameter may specifically include: generating a video picture according to the attention focusing parameter.
  • the resolution estimates of the horizontal angles of the respective pictures are generated, and the resolution distribution parameters are generated according to the resolution estimates of the horizontal angles of the respective pictures of the video picture.
  • a manner of synthesizing the attention focus parameter and the resolution distribution parameter may be an integration operation, and a specific algorithm may include at least the following situations:
  • F (x) is the attention focus parameter
  • P (x) is the resolution distribution parameter
  • the value of the horizontal angle of the picture ranges from 0-2 ⁇ ;
  • the integration of the picture horizontal angle and the picture vertical angle to the attention focus parameter and the resolution distribution parameter to obtain the picture quality parameter Q is the attention focus parameter
  • P (x, y) is the resolution distribution parameter.
  • the attention position information also includes the vertical angle of the picture, and the value of the horizontal angle of the picture ranges from 0 to 2 ⁇ . The vertical angle of the picture ranges from 0- ⁇ .
  • the picture quality parameter obtained based on the data of a single user can be evaluated according to the calculation result of a single user, or the picture quality can be evaluated according to the calculation results of multiple users.
  • an average value can be taken to obtain the average picture quality parameter, and the picture quality is evaluated according to the average picture quality parameter. That is to say, the quality of the video picture generated by the current picture cutting mode is evaluated.
  • step S103 has nothing to do with the timing of steps S101 and S102. Steps S101 and S102 may be performed first, and then step S103 is performed, and vice versa, or steps S101 and S103 may be performed simultaneously.
  • Step S104 Mark the picture quality parameter on the attention information curve so as to display the picture quality parameter.
  • the manner of marking the picture quality parameter on the attention information curve may be various, for example, the picture quality parameter is marked on the attention information curve by color, line width, line type, etc., different colors, line widths, lines
  • the type of attention information curve can represent different picture quality parameters.
  • continuous quality scores can be represented on the attention information curve by gradients of color, line width, and line type (the expression of the picture quality parameter is a numerical value, corresponding to the quality score).
  • the RGB gradient of the color with a higher B hue, indicates a higher quality score, and a higher R hue, indicates a lower quality score;
  • a gradient of the line width, a thicker line width indicates a higher quality score, and vice versa;
  • the change of the line style is related to the quality score. The higher the quality score, the better the picture quality.
  • the picture quality parameters are subdivided numerically, and the picture quality scores at different times / different attention positions can be grasped at any time on the attention information curve, and the picture quality can be fine-tuned and adjusted more accurately.
  • FIG. 3 is a schematic diagram showing the attention information curve in polar coordinates.
  • the attention information curve in the figure indicates the value of the picture quality parameter by color. Among them, for convenience, FIG. 3 uses different values of RGB.
  • the gray color represents different picture quality parameters.
  • the gray color histogram in the figure shows the correspondence between the values of the picture quality parameters and the different RGB values. It can be known from FIG. 3 that the attention information curve of the 2000-frame picture is marked in the polar coordinate system.
  • the value range of the picture quality parameter is 0-1.0. The smaller the RGB value of the gray color is, the larger the picture quality parameter value is.
  • the size of the picture quality parameters at different times / different attention positions can be grasped at any time on the attention information curve, and the trajectory and picture quality of the user's attention position can be accurately and intuitively obtained. , You can make finer adjustments to the picture quality.
  • whether the picture quality meets the quality requirements can be represented on the attention information curve through differences in color, line width, and line type (the expression of the picture quality parameter is whether the quality requirements are met). For example, a warm color indicates that the picture quality meets the quality requirements, and a cold color indicates that the picture quality does not meet the quality requirements; the line width of the attention information curve exceeds a certain size indicates that the picture quality meets the quality requirements, and vice versa Requirements; when the linearity of the attention information curve is a solid line, it means that the picture quality meets the quality requirements.
  • the attention information curve in the embodiment of the present invention can quickly identify whether the picture quality meets the quality requirements, and can quickly adjust the pictures that do not meet the quality requirements.
  • FIG. 4 is a schematic diagram showing a curve of attention information in polar coordinates.
  • the thickness of the line on the attention information curve indicates whether the picture quality meets the quality requirements.
  • the attention information curve of the 2000 frame picture is marked in the polar coordinate system, and the thick solid line indicates the picture quality parameter Meet the quality requirements, the thin solid line indicates that the picture quality parameters do not meet the quality requirements.
  • the change trajectory of the user's attention position and the picture quality can be obtained, and it can be quickly identified whether the picture quality meets the quality requirements, and the pictures that do not meet the quality requirements can be quickly adjusted.
  • the picture quality parameter may be adjusted, that is, after step S104, the embodiment of the present invention may further include: adjusting the picture according to the display of the attention information curve Quality parameters so that the adjusted picture quality parameters meet quality requirements. For example, when the picture quality parameter is less than the quality parameter threshold, the resolution estimation can be adjusted, or the picture can be cut based on the user's focus position, so that the picture quality parameter meets the quality requirements. Among them, when the picture quality is too high, the picture quality can also be appropriately reduced to reduce the playback cost.
  • the picture quality parameters of the user's attention picture in the main viewing area of the panoramic video can be increased to meet the needs of the picture quality parameters of a part of the panoramic video. For example, in a stage play performance, it is not necessary to improve all the video pictures in the stage area of the panoramic video, and only need to adjust the picture quality parameters of the video pictures in the stage area with high user attention.
  • the embodiment of the present invention focuses on attention position information at different time points, and constructs an attention information curve in a polar coordinate system to obtain a change trajectory of a user's attention position.
  • the picture quality parameter is marked on the attention information curve, the change track of the user's attention position and the change of the picture quality can be clearly obtained by observing the attention information curve;
  • the display angle range is 360 degrees, which is more consistent with the horizontal angle of the picture when the panoramic video user watches the video.
  • the attention information curve is created in polar coordinates, which can more accurately and intuitively obtain the change track of the attention position and the picture of each area. quality.
  • an embodiment of the present invention also provides a picture display device 200 for panoramic video, which mainly includes a first obtaining module 201, a second obtaining module 202, a creating module 203, and a processing module 204.
  • FIG. 5 is a schematic structural diagram of a picture display device for panoramic video.
  • the apparatus 200 for displaying a panoramic video in an embodiment of the present invention may mainly include:
  • a first acquisition module 201 configured to acquire attention position information of a user at different time points within a preset time period, where the attention position information includes a horizontal angle of a picture;
  • a second acquisition module 202 configured to acquire a picture quality parameter
  • the creating module 203 is configured to create an attention information curve in a polar coordinate system, where the attention information curve uses the time point as a pole diameter, and the screen acquired by the first acquisition module 201 at the time point
  • the horizontal angle is a polar angle
  • the processing module 204 is configured to mark the picture quality parameters obtained by the second obtaining module 202 on the attention information curve created by the creating module 203 so as to display the picture quality parameters.
  • the preset time period described in this embodiment may be a playback time of the panoramic video, or a complete playback time of the entire panoramic video.
  • the manner of marking the picture quality parameter on the attention information curve may be various, for example, the picture quality parameter is marked on the attention information curve by color, line width, line type, and the like. Attention information curves of different colors, line widths, and line types can represent different picture quality parameters.
  • the processing module 204 may be specifically configured to perform: setting a color on the attention information curve, displaying the picture quality parameter by the color, and different colors representing different picture qualities Parameters; and / or, setting a line width on the attention information curve, displaying the picture quality parameter by the line width, and different line widths representing different picture quality parameters; and / or, in the attention A line style is set on the information curve, and the picture quality parameter is displayed by the line style, and different line widths represent different picture quality parameters.
  • the RGB gradient of the color the higher the R color, the higher the quality score
  • the gradient of the line width the thicker the line width, the higher the quality score
  • the line style change which is related to the quality score, and so on.
  • the quality score (the expression of the picture quality parameter is a numerical value, corresponding to the quality score). In this way, the picture quality parameter is subdivided numerically, and the attention information curve can be grasped at different times / different attention positions at any time. Picture quality score, you can make finer adjustments to picture quality and make adjustments more accurate.
  • a warm color indicates that the picture quality meets the quality requirements
  • a cold color indicates that the picture quality does not meet the quality requirements
  • the line width of the attention information curve exceeds a certain size indicates that the picture quality meets the quality requirements, and vice versa Requirements
  • the linearity of the attention information curve is a solid line, it means that the picture quality meets the quality requirements to indicate whether the picture quality meets the quality requirements (the expression of the picture quality parameter is whether the quality requirements are met).
  • the attention information curve can be Quickly identify whether the picture quality meets the quality requirements, and can quickly adjust the pictures that do not meet the quality requirements.
  • the second obtaining module 202 specifically includes a first sub obtaining module, a second sub obtaining module, and a third sub obtaining module;
  • the first sub-acquisition module is configured to obtain an attention focus parameter, where the attention focus parameter is used to indicate a user's attention level to a picture, and the attention focus parameter is a function of the horizontal angle of the picture;
  • the second sub-acquisition module is configured to obtain a resolution distribution parameter, where the resolution distribution parameter is used to represent a resolution distribution situation of a picture, and the resolution distribution parameter is a function of a horizontal angle of the picture; specifically
  • the second sub-acquisition module may be specifically configured to obtain the resolution distribution parameter through the resolution estimation and the horizontal angle of the picture, which may include: generating the resolution of each horizontal angle of the video picture according to the attention focusing parameter. Estimate, and generate the resolution distribution parameter according to a resolution estimate of each horizontal angle of the video picture.
  • the third sub-acquisition module is configured to synthesize the attention focus parameter obtained by the first sub-acquisition module and the resolution distribution parameter obtained by the second sub-acquisition module to obtain the picture quality parameter;
  • the third sub-acquisition module is specifically configured to perform: integrating the horizontal focus angle of the screen on the attention focus parameter and the resolution distribution parameter To obtain the picture quality parameter Q, Among them, F (x) is the attention focus parameter, P (x) is the resolution distribution parameter, and the range of the horizontal angle of the screen is 0-2 ⁇ .
  • the third sub-acquisition module is specifically configured to execute: Integrating the horizontal focus angle and vertical angle of the picture with the attention focus parameter and the resolution distribution parameter to obtain the picture quality parameter Q, Among them, F (x, y) is the attention focus parameter, and P (x, y) is the resolution distribution parameter.
  • the attention position information also includes the vertical angle of the picture, and the value of the horizontal angle of the picture ranges from 0 to 2 ⁇ . The vertical angle of the picture ranges from 0- ⁇ .
  • the picture display device for a panoramic video may further include an adjustment module 205 configured to adjust the picture quality parameter according to the display of the attention information curve to Make the adjusted picture quality parameters meet the quality requirements.
  • the resolution estimation can be adjusted, or the screen can be cut based on the user's focus position.
  • FIG. 6 is a picture quality of the panoramic video Method flowchart showing method.
  • Step S301 Obtain a horizontal angle of a picture when a user watches a picture at different points in time during a panoramic video playing time;
  • Step S302 Create an attention information curve in a polar coordinate system, where the attention information curve uses the time point as a polar diameter, and the horizontal angle of the screen obtained at the time point is a polar angle;
  • the time point and the horizontal angle of the picture can be used as the polar diameter and the polar axis in the polar coordinate system, respectively.
  • a time point corresponds to a horizontal angle of the picture.
  • Multiple horizontal angles of the picture can be obtained during the playback time of the panoramic video, so that in the polar coordinate system Create Attention Information Curves.
  • Step S303 Acquire a picture quality parameter
  • Q is the picture quality parameter
  • F (x) is the attention focus parameter
  • P (x) is the resolution distribution parameter
  • x is the horizontal angle of the picture
  • Q is the picture quality parameter
  • F (x, y) is the attention focus parameter
  • P (x, y) is the resolution distribution parameter
  • x is the horizontal angle of the picture
  • y is the vertical angle of the picture
  • the value range of x is 0-2 ⁇
  • the range of y is 0- ⁇ .
  • the resolution distribution parameter can be obtained by resolution estimation and attention focus position, that is, the resolution estimation of each user's attention focus position of the video screen can be generated according to the attention focus parameter, according to The resolution estimation of the resolution focus position of each user of the video picture generates the resolution distribution parameter.
  • Step S304 Mark the picture quality parameter with color on the attention information curve, so as to judge the picture quality situation by color;
  • FIG. 3 is a schematic diagram showing the attention information curve in polar coordinates.
  • the attention information curve in the figure indicates the value of the picture quality parameter by color.
  • FIG. 3 uses different values.
  • RGB gray represents different picture quality parameters.
  • the gray color histogram in the figure shows the corresponding relationship between the values of the picture quality parameters and different RGB values.
  • the value range of the picture quality parameter is 0-1.0. The smaller the RGB value of the gray color is, the larger the picture quality parameter value is.
  • Step S305 Adjust the picture quality parameter according to the color display on the attention information curve, so that the adjusted picture quality parameter meets quality requirements.
  • the picture frames that need to be adjusted for picture quality parameters can be accurately obtained, so that the picture frames with lower picture quality parameters can be quickly adjusted for quality so that the adjusted picture quality parameters can meet the quality requirements.
  • the resolution estimation can be adjusted, or the screen can be cut based on the user's focus position.
  • the method and device for displaying picture quality of a panoramic video acquire user's attention position information at different time points in a preset time period, the attention position information includes a horizontal angle of the screen, and creates attention information in a polar coordinate system Curve, the attention information curve takes the time point as the extreme diameter, and the horizontal angle of the picture obtained at the time point is the polar angle, and picture quality parameters can also be obtained, and on the attention information curve Marking the picture quality parameter so as to display the picture quality parameter.
  • the attention trajectory of the user's attention position and the change in picture quality can be clearly obtained through the attention information curve; and because the display angle range of the polar coordinate system is 360 degrees, when viewing videos with panoramic video users
  • the horizontal angle of the picture is more consistent, and the attention information curve is created in polar coordinates, which can more accurately and intuitively obtain the change trajectory of the attention position and the picture quality of each area; it solves the picture trajectory of interest for panoramic video in the prior art It is a flat display method, and it cannot display the picture quality, and it cannot technically provide an accurate picture quality reference standard for the panoramic video intuitively and accurately.
  • a component may be, but is not limited to being, a process running on a processor, a processor, an object, an executable application, a thread of execution, a program, and / or a computer.
  • an application running on a controller and the controller can be a component.
  • One or more components can reside within a process and / or thread of execution and a component may be localized on one computer and / or distributed between two or more computers.
  • the one or more operations may constitute computer-readable instructions stored on one or more computer-readable media, which when executed by an electronic device, will cause a computing device to perform the operations.
  • the order in which some or all operations are described should not be interpreted as implying that the operations must be order related. Those skilled in the art will understand alternative rankings having the benefits of this specification. Moreover, it should be understood that not all operations need to be present in every embodiment provided herein.
  • the term "preferred” as used herein is meant to serve as an example, instance, or illustration. Any aspect or design described by Fengwen as “preferred” is not necessarily to be construed as advantageous over other aspects or designs. Rather, the use of the word “preferred” is intended to present concepts in a concrete manner.
  • the term “or” as used in this application is intended to mean an inclusive “or” rather than an exclusive “or”. That is, unless otherwise specified or clear from the context, "X uses A or B” means naturally including any one of the permutations. That is, if X uses A; X uses B; or X uses both A and B, then "X uses A or B" is satisfied in any of the foregoing examples.
  • Each functional unit in the embodiment of the present invention may be integrated in one processing module, or each unit may exist separately physically, or two or more units may be integrated in one module.
  • the above integrated modules can be implemented in the form of hardware or software functional modules. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.
  • the aforementioned storage medium may be a read-only memory, a magnetic disk, or an optical disk.
  • Each device or system described above may execute the method in the corresponding method embodiment.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Image Processing (AREA)

Abstract

本发明提供一种全景视频的画面质量显示以及装置，通过获取用户在预设时间段内不同时间点的注意力位置信息，注意力位置信息包括画面水平角度，在极坐标系中创建注意力信息曲线，注意力信息曲线以所述时间点为极径，以时间点获取到的所述画面水平角度为极角，还可以获取画面质量参数，并在注意力信息曲线上标示画面质量参数，以便对画面质量参数进行显示。

Description

全景视频的画面质量显示方法及装置
本申请要求于2018年06月27日提交中国专利局、申请号为201810682259.7、发明名称为“全景视频的画面质量显示方法及装置”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本发明涉及多媒体技术领域，特别是涉及一种全景视频的画面质量显示方法和画面质量显示装置。
背景技术
随着视频采集和处理技术的进步，全景视频开始逐步进入人们的生活。全景视频技术在全景照片技术之上发展延伸而来，是一种用3D摄像机进行全方位360度进行拍摄的视频，其承载着丰富的信息量，可以将变化的场景进行实时播放。人们可以在水平和垂直方向任意选择观看角度，对全景视频中感兴趣的场景进行浏览，如同身临其境。
用户可通过VR头盔观看全景视频，全景视频播放器可针对用户的观看视角对全景视频画面进行切流操作，如用户观看前方画面，可仅将用户前方部分画面传输至VR头盔进行观看即可。
为了满足用户更高的视觉体验，全景视频对画质的要求越来越高，但全景视频数据量巨大，这样显然提高了画面内容的拍摄难度和传输难度，导致显示设备无法流畅播放高分辨率全景视频，以及播放的成本越来越高。为了解决高画质的全景视频的现状，可以考虑对画面的部分内容进行分辨率降低操作来减少拍摄成本和播放成本。因此有必要研究用户对不同画面的感兴趣程度，以用户的感兴趣程度为画面调整提供参考。
现有技术中，在平面直角坐标系中，以横坐标为全景视频的画面帧(即播放时间)，纵坐标为用户观看全景画面的角度信息，构建感兴趣画面轨迹，通过研究感兴趣画面轨迹来为全景视频的拍摄和播放来提供参考，具体的示意图可参阅图1。由图1可知，现有技术的感兴趣画面轨迹是扁平化的展示方式，且感兴趣画面轨迹无法显示画面质量，无法直观、准确地为全景视频提供准确的画面质量参考标准。
故，有必要提供一种全景视频的画面质量显示方法及装置，以解决现有技术所存在的问题。
发明内容
本发明实施例提供一种全景视频的画面质量显示方法及装置；以解决现有技术无法直观、准确地为全景视频提供准确的画面质量参考标准的技术问题。
第一方面，本发明提供了一种全景视频的画面质量显示方法，包括：
获取用户在预设时间段内不同时间点的注意力位置信息，所述注意力位置信息包括画面水平角度；
在极坐标系中创建注意力信息曲线，所述注意力信息曲线以所述时间点为极径，以所述时间点获取到的所述画面水平角度为极角；
获取画面质量参数，并在所述注意力信息曲线上设置颜色，通过颜色来对所述画面质量参数进行显 示，不同颜色表示不同的画面质量参数；和/或，
在所述注意力信息曲线上设置线条宽度，通过线条宽度来对所述画面质量参数进行显示，不同线条宽度表示不同的画面质量参数；和/或，
在所述注意力信息曲线上设置线条样式，通过线条样式来对所述画面质量参数进行显示，不同线条宽度表示不同的画面质量参数；
所述获取画面质量参数，具体包括：
获取注意力聚焦参数，所述注意力聚焦参数用于表示用户对画面的注意力水平，所述注意力聚焦参数是所述画面水平角度的函数；
获取分辨率分布参数，所述分辨率分布参数用于表示画面的分辨率分布情况，所述分辨率分布参数是所述画面水平角度的函数；
合成所述注意力聚焦参数和所述分辨率分布参数，得到所述画面质量参数。
第二方面，本发明提供了一种全景视频的画面质量显示方法，包括：
获取用户在预设时间段内不同时间点的注意力位置信息，所述注意力位置信息包括画面水平角度；
在极坐标系中创建注意力信息曲线，所述注意力信息曲线以所述时间点为极径，以所述时间点获取到的所述画面水平角度为极角；
获取画面质量参数，并在所述注意力信息曲线上标示所述画面质量参数，以便对所述画面质量参数进行显示。
在一种实施方式中，所述在所述注意力信息曲线上标示所述画面质量参数，以便对所述画面质量参数进行显示，具体包括：
在所述注意力信息曲线上设置颜色，通过颜色来对所述画面质量参数进行显示，不同颜色表示不同的画面质量参数；和/或，
在所述注意力信息曲线上设置线条宽度，通过线条宽度来对所述画面质量参数进行显示，不同线条宽度表示不同的画面质量参数；和/或，
在所述注意力信息曲线上设置线条样式，通过线条样式来对所述画面质量参数进行显示，不同线条宽度表示不同的画面质量参数。
在一种实施方式中，所述获取画面质量参数，具体包括：获取注意力聚焦参数，所述注意力聚焦参数用于表示用户对画面的注意力水平，所述注意力聚焦参数是所述画面水平角度的函数；获取分辨率分布参数，所述分辨率分布参数用于表示画面的分辨率分布情况，所述分辨率分布参数是所述画面水平角度的函数；合成所述注意力聚焦参数和所述分辨率分布参数，得到所述画面质量参数。
在一种实施方式中，所述合成所述注意力聚焦参数和所述分辨率分布参数，得到所述画面质量参数， 具体包括：
对所述注意力聚焦参数和所述分辨率分布参数进行画面水平角度的积分，得到所述画面质量参数Q，
Figure PCTCN2018095328-appb-000001
其中，F(x)为注意力聚焦参数，P(x)为分辨率分布参数；
或，对所述注意力聚焦参数和所述分辨率分布参数进行画面水平角度和画面垂直角度的积分，得到所述画面质量参数Q，
Figure PCTCN2018095328-appb-000002
其中，F(x，y)为注意力聚焦参数，P(x，y)为分辨率分布参数，所述注意力位置信息还包括画面垂直角度。
在一种实施方式中，全景视频的画面质量显示方法还包括：根据所述注意力信息曲线的显示调节所述画面质量参数，以使得调节后的画面质量参数满足质量要求。
在一种实施方式中，所述获取用户在预设时间段内不同时间点的注意力位置信息，具体包括：
以预设时间间隔获取用户在预设时间段内的多个注意力位置信息，每个时间点对应一个所述注意力位置信息，所述画面水平角度是用户在所述时间点眼睛对水平方向上画面的注意力位置。
第三方面，本发明提供了一种全景视频的画面质量显示装置，包括：
第一获取模块，被配置为获取用户在预设时间段内不同时间点的注意力位置信息，所述注意力位置信息包括画面水平角度；
第二获取模块，被配置为获取画面质量参数；
创建模块，被配置为在极坐标系中创建注意力信息曲线，所述注意力信息曲线以所述时间点为极径，以所述第一获取模块在所述时间点获取到的所述画面水平角度为极角；
处理模块，被配置为在所述创建模块创建的注意力信息曲线上标示所述第二获取模块获取的画面质量参数，以便对所述画面质量参数进行显示。
在一种实施方式中，所述处理模块，具体可配置为执行：在所述注意力信息曲线上设置颜色，通过颜色来对所述画面质量参数进行显示，不同颜色表示不同的画面质量参数；和/或，
在所述注意力信息曲线上设置线条宽度，通过线条宽度来对所述画面质量参数进行显示，不同线条宽度表示不同的画面质量参数；和/或，
在所述注意力信息曲线上设置线条样式，通过线条样式来对所述画面质量参数进行显示，不同线条宽度表示不同的画面质量参数。
在一种实施方式中，所述第二获取模块，具体包括第一子获取模块、第二子获取模块和第三子获取模块：
所述第一子获取模块，被配置为获取注意力聚焦参数，所述注意力聚焦参数用于表示用户对画面的 注意力水平，所述注意力聚焦参数是所述画面水平角度的函数；
所述第二子获取模块，被配置为获取分辨率分布参数，所述分辨率分布参数用于表示画面的分辨率分布情况，所述分辨率分布参数是所述画面水平角度的函数；
所述第三子获取模块，被配置为合成所述第一子获取模块获取的注意力聚焦参数和第二子获取模块获取的所述分辨率分布参数，得到所述画面质量参数；
其中，所述第三子获取模块，具体被配置为执行：
对所述注意力聚焦参数和所述分辨率分布参数进行画面水平角度的积分，得到所述画面质量参数Q，
Figure PCTCN2018095328-appb-000003
其中，F(x)为注意力聚焦参数，P(x)为分辨率分布参数；或，
对所述注意力聚焦参数和所述分辨率分布参数进行画面水平角度和画面垂直角度的积分，得到所述画面质量参数Q，
Figure PCTCN2018095328-appb-000004
其中，F(x，y)为注意力聚焦参数，P(x，y)为分辨率分布参数，所述注意力位置信息还包括画面垂直角度。
在一种实施方式中，全景视频的画面质量显示装置还可以包括：调整模块；
所述调整模块，被配置为根据所述注意力信息曲线的显示调节所述画面质量参数，以使得调节后的画面质量参数满足质量要求。
相对现有技术，本发明的全景视频的画面质量显示方法及装置，获取用户在预设时间段内不同时间点的注意力位置信息，所述注意力位置信息包括画面水平角度，在极坐标系中创建注意力信息曲线，所述注意力信息曲线以所述时间点为极径，以所述时间点获取到的所述画面水平角度为极角，还可以获取画面质量参数，并在所述注意力信息曲线上标示所述画面质量参数，以便对所述画面质量参数进行显示。这样，通过注意力信息曲线便可以清楚地获得用户的注意力位置的变化轨迹，以及画面质量的变化情况；并且，由于极坐标系的可展示角度范围为360度，与全景视频用户观看视频时的画面水平角度更一致，在极坐标中创建注意力信息曲线，可以更准确、直观地获得注意力位置的变化轨迹和各个区域的画面质量；解决了现有技术对全景视频的感兴趣画面轨迹是扁平化展示方式，且无法显示画面质量，无法直观、准确地为全景视频提供准确的画面质量参考标准的技术问题。
附图说明
下面根据附图和实施例对本发明作进一步详细说明。
图1为现有技术的感兴趣画面轨迹的示意图；
图2为本发明实施例的全景视频的画面质量显示方法的一个流程图；
图3为本发明实施例的注意力信息曲线的一个示意图；
图4为本发明实施例的注意力信息曲线的另一个示意图；
图5为本发明实施例的全景视频的画面质量显示装置的结构示意图；
图6为本发明实施例的全景视频的画面质量显示方法的另一个流程图。
具体实施方式
下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。
本发明的全景视频的画面质量显示方法及装置，获取用户在预设时间段内不同时间点的注意力位置信息，所述注意力位置信息包括画面水平角度，在极坐标系中创建注意力信息曲线，所述注意力信息曲线以所述时间点为极径，以所述时间点获取到的所述画面水平角度为极角，还可以获取画面质量参数，并在所述注意力信息曲线上标示所述画面质量参数，以便对所述画面质量参数进行显示。这样，通过注意力信息曲线便可以清楚地获得用户的注意力位置的变化轨迹，以及画面质量的变化情况；并且，由于极坐标系的可展示角度范围为360度，与全景视频用户观看视频时的画面水平角度更一致，在极坐标中创建注意力信息曲线，可以更准确、直观地获得注意力位置的变化轨迹和各个区域的画面质量；解决了现有技术对全景视频的感兴趣画面轨迹是扁平化展示方式，且无法显示画面质量，无法直观、准确地为全景视频提供准确的画面质量参考标准的技术问题。
下面以具体实施例对本发明的提供的全景视频的画面质量显示方法进行详细说明，所述方法包括如下步骤：获取用户在预设时间段内不同时间点的注意力位置信息，所述注意力位置信息包括画面水平角度；在极坐标系中创建注意力信息曲线，所述注意力信息曲线以所述时间点为极径，以所述时间点获取到的所述画面水平角度为极角；获取画面质量参数，并在所述注意力信息曲线上标示所述画面质量参数，以便对所述画面质量参数进行显示。
请参阅图2，图2是本发明实施例提供的全景视频的画面质量显示方法的一个方法流程图，可以包括：
步骤S101、获取用户在预设时间段内不同时间点的注意力位置信息，所述注意力位置信息包括画面水平角度；
全景视频可为用户提供360度的视频观看角度，但用户在某个时间点只能关注到画面中的某一个位置，以该位置为注意力位置信息，其包括画面水平角度，该画面水平角度指的是用户的眼睛对水平方向上画面的注意力位置信息。
本实施例中可以获取全景视频中的一段时间的注意力位置信息变化，也可以获取完整全景视频的注意力位置信息变化，也就是说，预设时间段可以是全景视频的一段播放时间，或者是整个全景视频的完 整播放时间。
在一可选实施例中，为了减少计算量，可以以一定时间间隔来获取注意力位置信息，具体的时间间隔以用户设定为准，本发明中不做限定。比如，每隔10帧获取一个注意力位置信息，或者每隔1帧获取一个注意力位置信息。若以一部完整播放时长为2000帧，采集注意力位置信息的时间间隔为1帧的全景视频为例，该段视频可以采集到2000个注意力位置信息。
可以理解的是，不同用户的注意力位置信息可能略有差异，这就导致不同用户的注意力位置信息可能会各不相同，为了解决这一问题，可以将获取的各个用户的注意力位置信息分别构建注意力信息曲线，以此展示不同用户的注意力位置变化。这样，可以获取不同用户的观看习惯，得到各个用户的个性化特征。
在一可选实施例中，获取注意力位置信息具体可以包括：以预设时间间隔获取各个用户在预设时间段内的多个注意力位置信息，每个时间点对应一个所述注意力位置信息，然后以获取的各个用户的位置信息为依据显示在注意力信息曲线上。
需说明的是，也可以采用其他方式来准确获取用户的注意力位置信息，比如采用大数据的采集方式，获取大量用户的注意力位置信息，得到一般用户的注意力位置信息，从而满足大部分用户的观影需求。还可以引入校正数值，用该校正数值对获取到的注意力位置信息进行校正，采用校正后的注意力位置信息来构建注意力信息曲线。
步骤S102、在极坐标系中创建注意力信息曲线，所述注意力信息曲线以所述时间点为极径，以所述时间点获取到的所述画面水平角度为极角；
本发明在上述步骤S101获取到了各个时间点的注意力位置信息，可以在极坐标系中根据这些注意力位置信息构建注意力信息曲线，其中，极坐标系的极轴为时间，构建的注意力信息曲线以所述时间点为极径，以所述时间点获取到的所述画面水平角度为极角。
在一可选实施例中，为了减少计算量，可以以预设时间间隔获取到多个注意力位置信息，然后将这多个注意力位置信息以坐标点标示在极坐标系中，然后连接各个坐标点，得到完整的注意力信息曲线。比如，以完整播放时长为2000帧，时间间隔为10帧的视频为例，每隔10帧可以获得一个注意力位置信息，并将各个坐标点标注在极坐标中，该坐标点是时间点与注意力位置信息的有序数对，共可以获取到200个坐标点，连接这200个坐标点可以得到完整的注意力信息曲线。其中，连接各个坐标点的方式包括不限于样条曲线法、曲线拟合法或插值样条曲线法等。
本发明由于用户观看全景视频时，可以实现在水平方向上的360度画面的随意切换，而极坐标系的可展示角度范围为360度，与全景视频用户观看视频时的画面水平角度更一致，在极坐标中创建注意力 信息曲线，可以更准确、直观地获得注意力位置的变化轨迹和各个区域的画面质量。
步骤S103、获取画面质量参数；
本实施例可以以预设的方法获取各个时间点的画面质量参数，该画面质量参数与该时间点用户的注意力位置有关，比如画面水平角度。
在一可选实施例中，本发明实施例提供了画面质量参数的获取方法，其具体可以包括如下步骤：
步骤A1、获取注意力聚焦参数，所述注意力聚焦参数用于表示用户对画面的注意力水平，所述注意力聚焦参数是所述画面水平角度的函数；
步骤A2、获取分辨率分布参数，所述分辨率分布参数用于表示画面的分辨率分布情况，所述分辨率分布参数是所述画面水平角度的函数；
步骤A3、合成所述注意力聚焦参数和所述分辨率分布参数，得到所述画面质量参数。
在上述步骤A2中，具体可以通过分辨率估值及画面水平角度来获取分辨率分布参数，也就是说，获取分辨率分布参数的步骤具体可以包括：根据所述注意力聚焦参数，生成视频画面的各个画面水平角度的分辨率估值，根据所述视频画面的各个画面水平角度的分辨率估值生成所述分辨率分布参数。
在上述步骤A3中，合成所述注意力聚焦参数和所述分辨率分布参数的方式可以是进行积分运算，具体的运算法则可至少包括如下情况：
一种方式是，用户对垂直方向的画面内容关注度差异不大时，可以只对所述注意力聚焦参数和所述分辨率分布参数进行画面水平角度的积分，得到所述画面质量参数Q，
Figure PCTCN2018095328-appb-000005
其中，F(x)为注意力聚焦参数，P(x)为分辨率分布参数，画面水平角度的取值范围为0-2π；
另一种方式是，当用户对垂直方向的画面内容和水平方向的画面内容均关注较多，也就是说画面的垂直内容和水平内容差异较大时，为了更好地保证画面质量评估的准确性，对所述注意力聚焦参数和所述分辨率分布参数进行画面水平角度和画面垂直角度的积分，得到所述画面质量参数Q，
Figure PCTCN2018095328-appb-000006
其中，F(x，y)为注意力聚焦参数，P(x，y)为分辨率分布参数，所述注意力位置信息还包括画面垂直角度，画面水平角度的取值范围为0-2π，画面垂直角度的取值范围为0-π。
其中，上述是根据单个用户的数据来获取到的画面质量参数，本实施例可以根据单个用户的计算结果来评估画面质量，也可以根据多个用户的计算结果来评估画面质量。其中，若要通过多个用户的计算结果来评估画面质量，则在获取到多个用户的画面质量参数后，可以取平均值来得到平均画面质量参数， 根据平均画面质量参数来评估画面质量，即评估当前画面切流方式生成的视频画面的画面质量的好坏。
需说明的是，步骤S103的时序与步骤S101和步骤S102时序无关，可以先执行步骤S101和步骤S102，再执行步骤S103，反之也可以，或者可以步骤S101和步骤S103同时执行。
步骤S104、在所述注意力信息曲线上标示所述画面质量参数，以便对所述画面质量参数进行显示。
在所述注意力信息曲线上标示所述画面质量参数的方式可以是多样的，比如通过颜色、线宽、线型等在注意力信息曲线标示所述画面质量参数，不同颜色、线宽、线型的注意力信息曲线可表示不同的画面质量参数。
在一可选实施例中，可以在注意力信息曲线上通过颜色、线宽及线型的渐变来表示连续的质量得分(画面质量参数的表达方式为数值，对应为质量得分)。比如，颜色的RGB渐变，以B色调越高表示质量分越高，R色调越高表示质量分越低；线宽的粗细的渐变，以线宽越粗表示质量分越高，反之越低；线型的样式变化与质量分关联等。其中，质量分越高表示画面质量越好。本发明实施例对画面质量参数进行了数值上的细分，在注意力信息曲线上可以随时掌握不同时间/不同注意力位置的画面质量得分，可以对画面质量进行更细微的调节，调节更准确。
请参阅图3，图3是在极坐标中标示注意力信息曲线的示意图，图中的注意力信息曲线上通过颜色来表示画面质量参数的数值，其中，为了表示方便，图3以不同数值RGB的灰色来表示不同的画面质量参数，图中的灰颜色直方图表示了画面质量参数的取值与不同RGB取值的对应关系。由图3可知，极坐标系中标示了2000帧画面的注意力信息曲线，画面质量参数的取值范围为0-1.0，灰颜色的RGB值越小表示画面质量参数的值越大。通过图3的注意力信息曲线的显示，在注意力信息曲线上可以随时掌握不同时间/不同注意力位置的画面质量参数的大小，可准确、直观地获得用户注意力位置的变化轨迹和画面质量的情况，可以对画面质量进行更细微的调节。
在一可选实施例中，可以在注意力信息曲线通过颜色、线宽及线型的不同来表示画面质量是否符合质量要求(画面质量参数的表达方式为是否满足质量要求)。比如，颜色为暖色调则表示画面质量符合质量要求，颜色为冷色调则表示画面质量不符合质量要求；注意力信息曲线的线条宽度超过一定大小则表示画面质量符合质量要求，反之则不符合质量要求；注意力信息曲线的线性为实线时则表示画面质量符合质量要求等。本发明实施例的注意力信息曲线可以快速辨认该画面质量是否符合质量要求，可以快速调节不符合质量要求的画面。
请参阅图4，图4是在极坐标中标示注意力信息曲线的示意图。本实施例在注意力信息曲线上通过线条的粗细来表示画面质量是否符合质量要求，由图4可知，极坐标系中标示了2000帧画面的注意力信息曲线，粗实线表示了画面质量参数符合质量要求，细实线表示了画面质量参数不符合质量要求。通 过图4的注意力信息曲线的显示，可获得用户注意力位置的变化轨迹和画面质量的情况，可以快速辨认该画面质量是否符合质量要求，可以快速调节不符合质量要求的画面。
进一步地，当画面质量参数不符合要求时，可以对画面质量参数进行调整，也就是说，在步骤S104之后，本发明实施例还可以包括：根据所述注意力信息曲线的显示调节所述画面质量参数，以使得调节后的画面质量参数满足质量要求。比如，当画面质量参数小于质量参数阈值时，可以对分辨率估值进行调整，或者根据用户的注意力聚焦位置对画面进行切流操作，从而使得画面质量参数满足质量要求。其中，当画面质量过高时，也可以适当的降低画面质量，以降低播放成本。
由于极坐标可以清楚的显示用户在任何时刻的观看位置，因此可以将全景视频的主要观看区域的用户关注画面的画面质量参数调高，从而满足对全景视频的部分区域的画面质量参数的需求。比如舞台剧表演，不需要提高该全景视频的舞台区域的所有视频画面，只需要对用户关注度比较高的舞台区域的视频画面进行画面质量参数调高即可。
本发明实施例重点关注在不同时间点下的注意力位置信息，在极坐标系中构建了注意力信息曲线，可以获得用户注意力位置的变化轨迹。并且，在所述注意力信息曲线上标示所述画面质量参数，则通过观察注意力信息曲线便可以清楚地获得用户的注意力位置的变化轨迹，以及画面质量的变化情况；由于极坐标系的可展示角度范围为360度，与全景视频用户观看视频时的画面水平角度更一致，在极坐标中创建注意力信息曲线，可以更准确、直观地获得注意力位置的变化轨迹和各个区域的画面质量。
此外，本发明实施例还提供了一种全景视频的画面显示装置200，其主要包括第一获取模块201、第二获取模块202、创建模块203和处理模块204。
请参阅图5，图5是全景视频的画面显示装置的结构示意图。本发明实施例的全景视频的画面显示装置200，主要可以包括：
第一获取模块201，被配置为获取用户在预设时间段内不同时间点的注意力位置信息，所述注意力位置信息包括画面水平角度；
第二获取模块202，被配置为获取画面质量参数；
创建模块203，被配置为在极坐标系中创建注意力信息曲线，所述注意力信息曲线以所述时间点为极径，以第一获取模块201在所述时间点获取到的所述画面水平角度为极角；
处理模块204，被配置为在所述创建模块203创建的注意力信息曲线上标示所述第二获取模块202获取的画面质量参数，以便对所述画面质量参数进行显示。
本实施例中的所描述的预设时间段可以是全景视频的一段播放时间，或者是整个全景视频的完整播放时间。
在一可选实施例中，在所述注意力信息曲线上标示所述画面质量参数的方式可以是多样的，比如通过颜色、线宽、线型等在注意力信息曲线标示所述画面质量参数，不同颜色、线宽、线型的注意力信息曲线可表示不同的画面质量参数。
在一可选实施例中，所述处理模块204，具体可配置为执行：在所述注意力信息曲线上设置颜色，通过颜色来对所述画面质量参数进行显示，不同颜色表示不同的画面质量参数；和/或，在所述注意力信息曲线上设置线条宽度，通过线条宽度来对所述画面质量参数进行显示，不同线条宽度表示不同的画面质量参数；和/或，在所述注意力信息曲线上设置线条样式，通过线条样式来对所述画面质量参数进行显示，不同线条宽度表示不同的画面质量参数。
比如，以颜色的RGB渐变，以R色调越多表示质量分越高；线宽的粗细的渐变，以线宽越粗表示质量分越高；线型的样式变化与质量分关联等来表示连续的质量得分(画面质量参数的表达方式为数值，对应为质量得分)，这样，对画面质量参数进行了数值上的细分，在注意力信息曲线上可以随时掌握不同时间/不同注意力位置的画面质量得分，可以对画面质量进行更细微的调节，调节更准确。比如，颜色为暖色调则表示画面质量符合质量要求，颜色为冷色调则表示画面质量不符合质量要求；注意力信息曲线的线条宽度超过一定大小则表示画面质量符合质量要求，反之则不符合质量要求；注意力信息曲线的线性为实线时则表示画面质量符合质量要求等来表示画面质量是否符合质量要求(画面质量参数的表达方式为是否满足质量要求)，这样，从注意力信息曲线可以快速辨认该画面质量是否符合质量要求，可以快速调节不符合质量要求的画面。
在一可选实施例中，所述第二获取模块202，具体包括第一子获取模块、第二子获取模块和第三子获取模块；
所述第一子获取模块，被配置为获取注意力聚焦参数，所述注意力聚焦参数用于表示用户对画面的注意力水平，所述注意力聚焦参数是所述画面水平角度的函数；
所述第二子获取模块，被配置为获取分辨率分布参数，所述分辨率分布参数用于表示画面的分辨率分布情况，所述分辨率分布参数是所述画面水平角度的函数；具体的，第二子获取模块，具体可被配置为通过分辨率估值及画面水平角度来获取分辨率分布参数，可包括：根据所述注意力聚焦参数，生成视频画面的各个画面水平角度的分辨率估值，根据所述视频画面的各个画面水平角度的分辨率估值生成所述分辨率分布参数。
所述第三子获取模块，被配置为合成所述第一子获取模块获取的注意力聚焦参数和第二子获取模块获取的所述分辨率分布参数，得到所述画面质量参数；
其中，用户对垂直方向的画面内容关注度差异不大时，所述第三子获取模块，具体被配置为执行：对所述注意力聚焦参数和所述分辨率分布参数进行画面水平角度的积分，得到所述画面质量参数Q，
Figure PCTCN2018095328-appb-000007
其中，F(x)为注意力聚焦参数，P(x)为分辨率分布参数，画面水平角度的取值范围为0-2π。
其中，当用户对垂直方向的画面内容和水平方向的画面内容均关注较多，也就是说画面的垂直内容和水平内容差异较大时，所述第三子获取模块，具体被配置为执行：对所述注意力聚焦参数和所述分辨率分布参数进行画面水平角度和画面垂直角度的积分，得到所述画面质量参数Q，
Figure PCTCN2018095328-appb-000008
其中，F(x，y)为注意力聚焦参数，P(x，y)为分辨率分布参数，所述注意力位置信息还包括画面垂直角度，画面水平角度的取值范围为0-2π，画面垂直角度的取值范围为0-π。
进一步地，请参阅图5，本发明的全景视频的画面显示装置还可以包括调整模块205，所述调整模块205，被配置为根据所述注意力信息曲线的显示调节所述画面质量参数，以使得调节后的画面质量参数满足质量要求。例如，可以对分辨率估值进行调整，或者根据用户的注意力聚焦位置对画面进行切流操作。
需说明的是，本发明的装置实施例的具体实施可参见上述方法实施例，本实施例中不做赘述。
进一步地，为了更好地理解本发明提供的全景视频的画面质量显示方法及装置，本发明实施例还提供了具体的应用例进行详细说明，请参阅图6，图6是全景视频的画面质量显示方法的方法流程图。
步骤S301、获取用户在全景视频播放时间内不同时间点观看画面时的画面水平角度；
步骤S302、在极坐标系中创建注意力信息曲线，所述注意力信息曲线以所述时间点为极径，以所述时间点获取到的所述画面水平角度为极角；
时间点和画面水平角度可以分别作为极坐标系中的极径和极轴，一个时间点对应一个画面水平角度，在全景视频播放时间内可以获取到多个画面水平角度，从而在极坐标系中创建注意力信息曲线。
步骤S303、获取画面质量参数；
当用户对垂直方向的画面内容关注度差异不大时，
Figure PCTCN2018095328-appb-000009
其中，Q是画面质量参数，F(x)为注意力聚焦参数，P(x)为分辨率分布参数，x是画面水平角度；
当用户对垂直方向的画面内容和水平方向的画面内容均关注较多，也就是说画面的垂直内容和水平内容差异较大时，
Figure PCTCN2018095328-appb-000010
其中，Q是画面质量参数，F(x，y)为注 意力聚焦参数，P(x，y)为分辨率分布参数，x是画面水平角度，y是画面垂直角度，x的取值范围为0-2π，y的取值范围为0-π。
其中，分辨率分布参数可以通过分辨率估值及注意力聚焦位置来获取，也就是说，可以根据所述注意力聚焦参数，生成视频画面的各个用户注意力聚焦位置的分辨率估值，根据所述视频画面的各个用户注意力聚焦位置的分辨率估值生成所述分辨率分布参数。
步骤S304、在所述注意力信息曲线上以颜色标示所述画面质量参数，以便通过颜色判断画面质量情况；
请参阅图3，图3是在极坐标中标示注意力信息曲线的一个示意图，图中的注意力信息曲线上通过颜色来表示画面质量参数的数值，其中，为了表示方便，图3以不同数值RGB的灰色来表示不同的画面质量参数，图中的灰颜色直方图表示了画面质量参数的取值与不同RGB取值的对应关系。由图3可知，极坐标系中标示了2000帧画面的注意力信息曲线，画面质量参数的取值范围为0-1.0，灰颜色的RGB值越小表示画面质量参数的值越大。通过图3的注意力信息曲线的显示，可准确、直观地获得用户注意力位置的变化轨迹和画面质量的情况。
步骤S305、根据所述注意力信息曲线上的颜色显示调节所述画面质量参数，以使得调节后的画面质量参数满足质量要求。
根据注意力信息曲线上的颜色显示，可以准确获取需要调节画面质量参数的画面帧，从而快速对这些画面质量参数较低的画面帧进行质量调整，以使得调节后的画面质量参数满足质量要求。例如，可以对分辨率估值进行调整，或者根据用户的注意力聚焦位置对画面进行切流操作。
这样即完成了本发明的全景视频的画面质量显示方法的画面质量显示以及调整过程。
本发明的全景视频的画面质量显示方法及装置，获取用户在预设时间段内不同时间点的注意力位置信息，所述注意力位置信息包括画面水平角度，在极坐标系中创建注意力信息曲线，所述注意力信息曲线以所述时间点为极径，以所述时间点获取到的所述画面水平角度为极角，还可以获取画面质量参数，并在所述注意力信息曲线上标示所述画面质量参数，以便对所述画面质量参数进行显示。这样，通过注意力信息曲线便可以清楚地获得用户的注意力位置的变化轨迹，以及画面质量的变化情况；并且，由于极坐标系的可展示角度范围为360度，与全景视频用户观看视频时的画面水平角度更一致，在极坐标中创建注意力信息曲线，可以更准确、直观地获得注意力位置的变化轨迹和各个区域的画面质量；解决了现有技术对全景视频的感兴趣画面轨迹是扁平化展示方式，且无法显示画面质量，无法直观、准确地为全景视频提供准确的画面质量参考标准的技术问题。
如本申请所使用的术语“组件”、“模块”、“系统”、“接口”、“进程”等等一般地旨在指计算机相关实 体：硬件、硬件和软件的组合、软件或执行中的软件。例如，组件可以是但不限于是运行在处理器上的进程、处理器、对象、可执行应用、执行的线程、程序和/或计算机。通过图示，运行在控制器上的应用和该控制器二者都可以是组件。一个或多个组件可以有在于执行的进程和/或线程内，并且组件可以位于一个计算机上和/或分布在两个或更多计算机之间。
本文提供了实施例的各种操作。在一个实施例中，所述的一个或多个操作可以构成一个或多个计算机可读介质上存储的计算机可读指令，其在被电子设备执行时将使得计算设备执行所述操作。描述一些或所有操作的顺序不应当被解释为暗示这些操作必需是顺序相关的。本领域技术人员将理解具有本说明书的益处的可替代的排序。而且，应当理解，不是所有操作必需在本文所提供的每个实施例中存在。
而且，本文所使用的词语“优选的”意指用作实例、示例或例证。奉文描述为“优选的”任意方面或设计不必被解释为比其他方面或设计更有利。相反，词语“优选的”的使用旨在以具体方式提出概念。如本申请中所使用的术语“或”旨在意指包含的“或”而非排除的“或”。即，除非另外指定或从上下文中清楚，“X使用A或B”意指自然包括排列的任意一个。即，如果X使用A；X使用B；或X使用A和B二者，则“X使用A或B”在前述任一示例中得到满足。
而且，尽管已经相对于一个或多个实现方式示出并描述了本公开，但是本领域技术人员基于对本说明书和附图的阅读和理解将会想到等价变型和修改。本公开包括所有这样的修改和变型，并且仅由所附权利要求的范围限制。特别地关于由上述组件(例如元件、资源等)执行的各种功能，用于描述这样的组件的术语旨在对应于执行所述组件的指定功能(例如其在功能上是等价的)的任意组件(除非另外指示)，即使在结构上与执行本文所示的本公开的示范性实现方式中的功能的公开结构不等同。此外，尽管本公开的特定特征已经相对于若干实现方式中的仅一个被公开，但是这种特征可以与如可以对给定或特定应用而言是期望和有利的其他实现方式的一个或多个其他特征组合。而且，就术语“包括”、“具有”、“含有”或其变形被用在具体实施方式或权利要求中而言，这样的术语旨在以与术语“包含”相似的方式包括。
本发明实施例中的各功能单元可以集成在一个处理模块中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个模块中。上述集成的模块既可以采用硬件的形式实现，也可以采用软件功能模块的形式实现。所述集成的模块如果以软件功能模块的形式实现并作为独立的产品销售或使用时，也可以存储在一个计算机可读取存储介质中。上述提到的存储介质可以是只读存储器，磁盘或光盘等。上述的各装置或系统，可以执行相应方法实施例中的方法。
综上所述，虽然本发明已以优选实施例揭露如上，但上述优选实施例并非用以限制本发明，本领域的普通技术人员，在不脱离本发明的精神和范围内，均可作各种更动与润饰，因此本发明的保护范围以权利要求界定的范围为准。

Claims (14)

  1. 一种全景视频的画面质量显示方法，其包括：
    获取用户在预设时间段内不同时间点的注意力位置信息，所述注意力位置信息包括画面水平角度；
    在极坐标系中创建注意力信息曲线，所述注意力信息曲线以所述时间点为极径，以所述时间点获取到的所述画面水平角度为极角；
    获取画面质量参数，并在所述注意力信息曲线上设置颜色，通过颜色来对所述画面质量参数进行显示，不同颜色表示不同的画面质量参数；和/或，
    在所述注意力信息曲线上设置线条宽度，通过线条宽度来对所述画面质量参数进行显示，不同线条宽度表示不同的画面质量参数；和/或，
    在所述注意力信息曲线上设置线条样式，通过线条样式来对所述画面质量参数进行显示，不同线条宽度表示不同的画面质量参数；
    所述获取画面质量参数，具体包括：
    获取注意力聚焦参数，所述注意力聚焦参数用于表示用户对画面的注意力水平，所述注意力聚焦参数是所述画面水平角度的函数；
    获取分辨率分布参数，所述分辨率分布参数用于表示画面的分辨率分布情况，所述分辨率分布参数是所述画面水平角度的函数；
    合成所述注意力聚焦参数和所述分辨率分布参数，得到所述画面质量参数。
  2. 根据权利要求1所述的方法，其中所述合成所述注意力聚焦参数和所述分辨率分布参数，得到所述画面质量参数，具体包括：
    对所述注意力聚焦参数和所述分辨率分布参数进行画面水平角度的积分，得到所述画面质量参数Q，
    Figure PCTCN2018095328-appb-100001
    其中，F(x)为注意力聚焦参数，P(x)为分辨率分布参数；
    或，对所述注意力聚焦参数和所述分辨率分布参数进行画面水平角度和画面垂直角度的积分，得到所述画面质量参数Q，
    Figure PCTCN2018095328-appb-100002
    其中，F(x，y)为注意力聚焦参数，P(x，y)为分辨率分布参数，所述注意力位置信息还包括画面垂直角度。
  3. 根据权利要求1所述的方法，其中所述方法还包括：
    根据所述注意力信息曲线的显示调节所述画面质量参数，以使得调节后的画面质量参数满足质量要求。
  4. 根据权利要求1所述的方法，其中所述获取用户在预设时间段内不同时间点的注意力位置信息，具体包括：
    以预设时间间隔获取用户在预设时间段内的多个注意力位置信息，每个时间点对应一个所述注意力位置信息，所述画面水平角度是用户在所述时间点眼睛对水平方向上画面的注意力位置。
  5. 一种全景视频的画面质量显示方法，其包括：
    获取用户在预设时间段内不同时间点的注意力位置信息，所述注意力位置信息包括画面水平角度；
    在极坐标系中创建注意力信息曲线，所述注意力信息曲线以所述时间点为极径，以所述时间点获取到的所述画面水平角度为极角；
    获取画面质量参数，并在所述注意力信息曲线上标示所述画面质量参数，以便对所述画面质量参数进行显示。
  6. 根据权利要求5所述的方法，其中所述在所述注意力信息曲线上标示所述画面质量参数，以便对所述画面质量参数进行显示，具体包括：
    在所述注意力信息曲线上设置颜色，通过颜色来对所述画面质量参数进行显示，不同颜色表示不同的画面质量参数；和/或，
    在所述注意力信息曲线上设置线条宽度，通过线条宽度来对所述画面质量参数进行显示，不同线条宽度表示不同的画面质量参数；和/或，
    在所述注意力信息曲线上设置线条样式，通过线条样式来对所述画面质量参数进行显示，不同线条宽度表示不同的画面质量参数。
  7. 根据权利要求5所述的方法，其中所述获取画面质量参数，具体包括：
    获取注意力聚焦参数，所述注意力聚焦参数用于表示用户对画面的注意力水平，所述注意力聚焦参数是所述画面水平角度的函数；
    获取分辨率分布参数，所述分辨率分布参数用于表示画面的分辨率分布情况，所述分辨率分布参数是所述画面水平角度的函数；
    合成所述注意力聚焦参数和所述分辨率分布参数，得到所述画面质量参数。
  8. 根据权利要求7所述的方法，其中所述合成所述注意力聚焦参数和所述分辨率分布参数，得到所述画面质量参数，具体包括：
    对所述注意力聚焦参数和所述分辨率分布参数进行画面水平角度的积分，得到所述画面质量参数Q，
    Figure PCTCN2018095328-appb-100003
    其中，F(x)为注意力聚焦参数，P(x)为分辨率分布参数；
    或，对所述注意力聚焦参数和所述分辨率分布参数进行画面水平角度和画面垂直角度的积分，得到 所述画面质量参数Q，
    Figure PCTCN2018095328-appb-100004
    其中，F(x，y)为注意力聚焦参数，P(x，y)为分辨率分布参数，所述注意力位置信息还包括画面垂直角度。
  9. 根据权利要求5所述的方法，其中所述方法还包括：
    根据所述注意力信息曲线的显示调节所述画面质量参数，以使得调节后的画面质量参数满足质量要求。
  10. 根据权利要求5所述的方法，其中所述获取用户在预设时间段内不同时间点的注意力位置信息，具体包括：
    以预设时间间隔获取用户在预设时间段内的多个注意力位置信息，每个时间点对应一个所述注意力位置信息，所述画面水平角度是用户在所述时间点眼睛对水平方向上画面的注意力位置。
  11. 一种全景视频的画面质量显示装置，其包括：
    第一获取模块，被配置为获取用户在预设时间段内不同时间点的注意力位置信息，所述注意力位置信息包括画面水平角度；
    第二获取模块，被配置为获取画面质量参数；
    创建模块，被配置为在极坐标系中创建注意力信息曲线，所述注意力信息曲线以所述时间点为极径，以所述第一获取模块在所述时间点获取到的所述画面水平角度为极角；
    处理模块，被配置为在所述创建模块创建的注意力信息曲线上标示所述第二获取模块获取的画面质量参数，以便对所述画面质量参数进行显示。
  12. 根据权利要求11所述的装置，其中所述装置还包括：
    所述处理模块，具体可配置为执行：在所述注意力信息曲线上设置颜色，通过颜色来对所述画面质量参数进行显示，不同颜色表示不同的画面质量参数；和/或，
    在所述注意力信息曲线上设置线条宽度，通过线条宽度来对所述画面质量参数进行显示，不同线条宽度表示不同的画面质量参数；和/或，
    在所述注意力信息曲线上设置线条样式，通过线条样式来对所述画面质量参数进行显示，不同线条宽度表示不同的画面质量参数。
  13. 根据权利要求11所述的装置，其中所述第二获取模块，具体包括第一子获取模块、第二子获取模块和第三子获取模块：
    所述第一子获取模块，被配置为获取注意力聚焦参数，所述注意力聚焦参数用于表示用户对画面的注意力水平，所述注意力聚焦参数是所述画面水平角度的函数；
    所述第二子获取模块，被配置为获取分辨率分布参数，所述分辨率分布参数用于表示画面的分辨率 分布情况，所述分辨率分布参数是所述画面水平角度的函数；
    所述第三子获取模块，被配置为合成所述第一子获取模块获取的注意力聚焦参数和第二子获取模块获取的所述分辨率分布参数，得到所述画面质量参数；
    其中，所述第三子获取模块，具体被配置为执行：
    对所述注意力聚焦参数和所述分辨率分布参数进行画面水平角度的积分，得到所述画面质量参数Q，
    Figure PCTCN2018095328-appb-100005
    其中，F(x)为注意力聚焦参数，P(x)为分辨率分布参数；或，
    对所述注意力聚焦参数和所述分辨率分布参数进行画面水平角度和画面垂直角度的积分，得到所述画面质量参数Q，
    Figure PCTCN2018095328-appb-100006
    其中，F(x，y)为注意力聚焦参数，P(x，y)为分辨率分布参数，所述注意力位置信息还包括画面垂直角度。
  14. 根据权利要求11所述的装置，其中所述装置还包括：调整模块；
    所述调整模块，被配置为根据所述注意力信息曲线的显示调节所述画面质量参数，以使得调节后的画面质量参数满足质量要求。
PCT/CN2018/095328 2018-06-27 2018-07-11 全景视频的画面质量显示方法及装置 WO2020000521A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US17/266,112 US11533469B2 (en) 2018-06-27 2018-07-11 Panoramic video picture quality display method and device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810682259.7A CN108810513B (zh) 2018-06-27 2018-06-27 全景视频的画面质量显示方法及装置
CN201810682259.7 2018-06-27

Publications (1)

Publication Number Publication Date
WO2020000521A1 true WO2020000521A1 (zh) 2020-01-02

Family

ID=64072140

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/095328 WO2020000521A1 (zh) 2018-06-27 2018-07-11 全景视频的画面质量显示方法及装置

Country Status (3)

Country Link
US (1) US11533469B2 (zh)
CN (1) CN108810513B (zh)
WO (1) WO2020000521A1 (zh)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108833976B (zh) 2018-06-27 2020-01-24 深圳看到科技有限公司 一种全景视频动态切流后的画面质量评估方法及装置
CN113158720A (zh) * 2020-12-15 2021-07-23 嘉兴学院 一种基于双模特征和注意力机制的视频摘要方法及装置
CN113286197A (zh) * 2021-05-14 2021-08-20 北京字跳网络技术有限公司 信息展示方法、装置、电子设备和存储介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20090113409A (ko) * 2008-04-28 2009-11-02 엘지디스플레이 주식회사 표시 장치의 화질 평가 방법
CN102316333A (zh) * 2010-07-06 2012-01-11 宏碁股份有限公司 显示系统与提示系统
CN102821301A (zh) * 2012-08-31 2012-12-12 天津大学 基于hvs的立体信息客观质量评价方法
CN106303513A (zh) * 2016-08-26 2017-01-04 宁波大学 一种降参考三维视频质量评价方法

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6246413B1 (en) * 1998-08-17 2001-06-12 Mgi Software Corporation Method and system for creating panoramas
US7706303B2 (en) * 2006-06-26 2010-04-27 Cisco Technology, Inc. Port pooling
WO2012132237A1 (ja) * 2011-03-31 2012-10-04 パナソニック株式会社 立体視画像の描画を行う画像描画装置、画像描画方法、画像描画プログラム
CN103942754B (zh) * 2013-01-18 2017-07-04 深圳市腾讯计算机系统有限公司 全景图像补全方法及装置
TWI578781B (zh) * 2014-10-21 2017-04-11 群暉科技股份有限公司 藉助於全景地圖來管理一監視系統之方法與裝置

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20090113409A (ko) * 2008-04-28 2009-11-02 엘지디스플레이 주식회사 표시 장치의 화질 평가 방법
CN102316333A (zh) * 2010-07-06 2012-01-11 宏碁股份有限公司 显示系统与提示系统
CN102821301A (zh) * 2012-08-31 2012-12-12 天津大学 基于hvs的立体信息客观质量评价方法
CN106303513A (zh) * 2016-08-26 2017-01-04 宁波大学 一种降参考三维视频质量评价方法

Also Published As

Publication number Publication date
CN108810513A (zh) 2018-11-13
CN108810513B (zh) 2020-03-13
US20210297654A1 (en) 2021-09-23
US11533469B2 (en) 2022-12-20

Similar Documents

Publication Publication Date Title
US10692197B2 (en) Systems and techniques for automatic image haze removal across multiple video frames
US10916048B2 (en) Image processing apparatus, image processing method, and storage medium
EP3105921B1 (en) Photo composition and position guidance in an imaging device
JP3450833B2 (ja) 画像処理装置及びその方法並びにプログラムコード、記憶媒体
US9412169B2 (en) Real-time visual feedback for user positioning with respect to a camera and a display
KR101605983B1 (ko) 얼굴 검출을 이용한 이미지 재구성
WO2018019282A1 (zh) 双目全景图像获取方法，装置及存储介质
US20110109720A1 (en) Stereoscopic editing for video production, post-production and display adaptation
WO2012025042A1 (zh) 视频画面显示方法及装置
JP2019079552A (ja) イメージ形成における及びイメージ形成に関する改良
US20130057644A1 (en) Synthesizing views based on image domain warping
WO2019159617A1 (ja) 画像処理装置、画像処理方法およびプログラム
WO2020000521A1 (zh) 全景视频的画面质量显示方法及装置
CN109191506B (zh) 深度图的处理方法、系统及计算机可读存储介质
WO2017032035A1 (zh) 调节方法、调节装置和终端
WO2015188666A1 (zh) 三维视频滤波方法和装置
WO2022126674A1 (zh) 立体全景图像的质量评价方法、系统
WO2020259123A1 (zh) 一种调整图像画质方法、装置及可读存储介质
CN110166700B (zh) 用于创建选择性虚拟长曝光图像的方法和系统
WO2021136035A1 (zh) 拍照方法、装置、存储介质及电子设备
JP2014006604A (ja) 画像生成装置、画像生成方法及びプログラム
WO2023010796A1 (zh) 图像处理方法及相关装置
US10114447B2 (en) Image processing method and apparatus for operating in low-power mode
CN113408452A (zh) 表情重定向训练方法、装置、电子设备和可读存储介质
CN108833976B (zh) 一种全景视频动态切流后的画面质量评估方法及装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18924052

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 12.05.2021)

122 Ep: pct application non-entry in european phase

Ref document number: 18924052

Country of ref document: EP

Kind code of ref document: A1