WO2018205055A1 - 一种图像处理方法和系统 - Google Patents
一种图像处理方法和系统 Download PDFInfo
- Publication number
- WO2018205055A1 WO2018205055A1 PCT/CN2017/083369 CN2017083369W WO2018205055A1 WO 2018205055 A1 WO2018205055 A1 WO 2018205055A1 CN 2017083369 W CN2017083369 W CN 2017083369W WO 2018205055 A1 WO2018205055 A1 WO 2018205055A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- viewer
- display surface
- size
- display
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
Definitions
- the present invention relates to the field of information processing technologies, and in particular, to an image processing method and system.
- large-sized flat panel displays have become a major development direction for home or commercial flat panel displays. Users can watch dynamic video information such as movies through liquid crystal displays or LED displays, while large-size liquid crystal displays or LED displays can give users a more realistic and rich viewing experience.
- the large size of the flat panel display also causes the images that the user sees at different positions to be inconsistent, or when the user is in a fixed position, if the user's head moves, the user's viewing line of sight changes, etc.
- the size of the image that is caused by the user is distorted.
- the distortion of the image size formed by the large-sized flat panel display for different viewing positions or viewing of the line of sight poses a great challenge to improving the image display quality of the large-sized flat panel display.
- the technical problem to be solved by the present invention is that the large-size flat panel display of the prior art cannot avoid the image size distortion caused by the viewer viewing the line of sight change, and the image size distortion phenomenon may cause the viewer to target
- the same frame image will obtain different size viewing effects at different viewing angles, which causes the viewer to continuously change the image size perceived by the viewer while continuously changing the viewing line, which seriously affects the image of the large-sized flat panel display.
- the quality of the display also causes the viewer to feel dizzy by viewing images that vary in size.
- an embodiment of the present invention provides an image processing method, which is characterized in that The method includes:
- S101 acquiring a viewer position, a line of sight direction of the viewer viewing the image, and a relative positional relationship between the display surfaces;
- feature point information about the viewer is extracted in an image taken by the viewer, and a relative distance between the viewer and the display surface is calculated based on the feature point information ;
- an action pattern matching process is performed on the eye movement process of the viewer to acquire a line of sight direction function of the eye to calculate a clip between the line of sight direction and the normal direction of the display surface. angle;
- the viewpoint distance is calculated based on a relative distance between the viewer and the display surface, and an angle between the line of sight direction and a normal direction of the display surface;
- a size adjustment ratio of the image on the display surface is acquired according to the viewpoint distance, and the image is resized according to the size adjustment ratio.
- an embodiment of the present invention further provides an image processing system, wherein the system includes a control unit, an imaging unit, and a size adjustment unit, and the control unit is configured to control the image capturing unit and the image size adjustment.
- the image capturing unit is configured to capture an image of a viewer, and the control unit acquires a relative positional relationship between the viewer position, the line of sight direction of the viewer's viewing image, and the display surface based on the image of the viewer, and calculates The viewer's viewpoint distance;
- the image resizing unit is capable of adjusting a display size of an image on the display surface based on the viewpoint distance;
- control unit is further capable of extracting feature point information about the viewer in an image taken by the viewer, and calculating between the viewer and the display surface based on the feature point information relative distance;
- control unit is further capable of performing an action on the eye movement process of the viewer a pattern matching process of acquiring a line of sight direction function of the eye to calculate an angle between the line of sight direction and a normal direction of the display surface;
- system further includes an image size calculation unit configured to calculate an aspect ratio of the image on the display surface or a number of pixels occupied by the image on the display surface as an original image display size;
- the image size adjustment unit performs display size adjustment of the image according to the image size adjustment ratio
- the image size adjustment ratio is calculated based on the original display size of the image and the image adjustment target size.
- the present invention provides an image processing method and system for calculating a relative positional relationship between a viewer position, a line of sight direction of a viewer's viewing image, and a display surface by the above technical solution to calculate the viewer relative to the display surface.
- the viewpoint distance and according to the viewpoint distance, by calculating a comparison table or a calculation comparison function, calculating an ideal display size of an image of the image on the display surface at the viewpoint distance, thereby, according to the ideal display size of the image
- the current display size of an image is adjusted, and the method and system can avoid visually causing image reduction due to position and/or line of sight changes; in addition, the method and system can also adjust image size while Different types of distortions in the image are corrected to prevent the distortion of the image from being magnified due to size adjustment.
- FIG. 1 is a schematic flowchart of an image processing method according to an embodiment of the present invention.
- FIG. 2 is a schematic structural diagram of an image processing system according to an embodiment of the present invention.
- FIG. 1 is a schematic flowchart of an image processing method according to an embodiment of the present invention.
- the method includes:
- the image processing method may be implemented for a flat panel display such as a liquid crystal display, an LED display, or a plasma display, or may be implemented for a projection display; wherein the flat panel display and the projection display have corresponding display surfaces.
- the display surface can be a display screen or a projection screen or the like.
- the display surface is capable of displaying a picture
- the picture may include an image and/or text
- the distance between the viewer and the display surface becomes larger or the viewer's line of sight and The larger the deviation angle between the normals of the display surface, the smaller the image or text perceived by the user from the display surface becomes smaller, and the user cannot obtain the display surface when the distance or the deviation angle is increased to a certain extent.
- the image or text is separated on the top.
- the method captures the viewer by the camera unit and calculates the captured viewer image through the control unit.
- the relevant position information of the above three is obtained by processing, and the imaging unit is usually disposed at a position coplanar with the display surface.
- the image capturing unit performs tracking shooting on the viewer, and the tracking shooting may be continuous video shooting for the viewer, or frame image shooting for the viewer, and the image capturing unit transmits the captured viewer image information to
- the control unit identifies the viewer's eye position based on the viewer image information, thereby calculating a relative distance between the viewer and the camera unit and a relative between the viewer and the display surface normal angle.
- the control unit After receiving the viewer image information, the control unit extracts feature points of the facial features such as eyes from the viewer image information, and calculates the binocular distance of the viewer and/or the viewing by image pixel analysis processing. Data of the face size of the viewer; then, the control unit establishes a plane coordinate system about the face of the viewer with the midpoint of the viewer's binocular connection as the origin, and the control unit compares the camera by the plane coordinate system Two different photographing states of the feature points of the viewer's face image, thereby calculating the viewer's eyes or face by calculating the image aberration The relative distance between the surfaces is displayed and the relative distance is quantified as the position of the viewer relative to the display surface.
- control unit further performs an action pattern matching process on the viewer image information, and the action pattern matching process can view the eyes of the viewer in the image information as an action primitive, and record the image of the viewer's eyes in several frames.
- the function performs a matching process with a motion curve function library in the storage unit, and the matching process performs a similarity calculation between the curve function and each function model in the motion curve function library through a neural network learning model, and the curve function is The function model with the highest similarity is used as the line of sight direction function of the viewer's eye, and finally the control unit calculates the line of sight direction of the viewer and the angle between the line of sight direction and the normal direction of the display surface according to the line of sight direction function. Or off the angle.
- the relative distance D between the viewer's eyes or face and the display surface is obtained by calculation, and the angle between the line of sight of the viewer and the normal direction of the display surface or the angle of deviation Parameters, and the two parameters are used to characterize the position of the viewer, the direction of the line of sight of the viewer viewing the image, and the relative positional relationship between the display surfaces.
- the control unit calculates the relative distance D between the viewer's eyes or face and the display surface, and the angle or deviation angle ⁇ between the line of sight of the viewer and the normal direction of the display surface. Extending the line of sight direction of the viewer to the display surface and selecting an intersection of the line of sight extension line and the display surface as a reference image point, the control unit establishing an origin with the reference image point with respect to the viewer and the A spatial polar coordinate system of the display surface, wherein the spatial polar coordinate system is characterized because it accurately and conveniently reflects the relative point-to-line relationship between the viewer's eye and the display surface.
- the process of obtaining the viewpoint distance of the viewer may be: after the control unit determines the intersection of the line-of-sight extension line on the display surface, establishing a midpoint of the viewer binocular connection, the line-of-sight extension line, and the display surface a space triangle of the intersection of the normal of the display surface and the intersection of the display surface, and calculating the binocular connection of the viewer by triangulation positioning Pointing a distance S between the line of sight extension line and the intersection of the display surface, and using the distance S as the viewer's viewpoint distance, since the distance S is based on the viewer's eye or between the face and the display surface
- the relative distance D, and the angle between the line of sight of the viewer and the normal direction of the display surface or the deviation angle ⁇ are calculated, so that the change of the distance S can simultaneously reflect the relative distance D and The change in the angle ⁇ .
- control unit controls the image size calculation unit to acquire the display size of the image on the display surface, and the display size of the image may be represented by the actual length and width values of the image on the display surface, or The number of pixels occupied by the image on the display surface is characterized and the display size of the image is transferred to the control unit.
- a comparison table between the viewpoint distance S and the display size A of the image or a comparison function between the viewpoint distance S and the display size A of the image is also stored in the storage unit, wherein the adjustment comparison table and the comparison The function displays the relationship between the viewpoint distance S and the display size A of the image, and the control unit calculates the display on the display surface at the current viewpoint distance by searching the comparison table or calculating the comparison function.
- the image is an ideal display size.
- the ideal display size means that the viewer is at the current viewpoint distance, and the viewer can clearly distinguish the boundary between two different images connected.
- the control unit calculates the image size adjustment ratio based on the image ideal display size and the current display size of the corresponding image on the display surface, and transmits the image size adjustment ratio information to the image size adjustment unit, the image size adjustment unit is based on The image size adjustment ratio resizes the corresponding image.
- control unit is further capable of calculating image distortion such as pincushion distortion, barrel distortion and/or keystone distortion of the currently displayed image on the display surface, and calculating correction for different types of image distortion according to the corresponding image distortion correction function.
- image size adjustment unit is capable of performing distortion correction and size adjustment on the image on the display surface based on the correction amount of the image distortion and the image size adjustment ratio; preferentially, the distortion correction and the size adjustment of the pair of images may be gradual Formally implemented to prevent the viewer from viewing a mutated image on the display surface to create a visual stun.
- the image processing method calculates the viewpoint position of the viewer relative to the display surface by acquiring the position of the viewer, the direction of the line of sight of the viewer's viewing image, and the relative positional relationship between the display surfaces.
- the size, thereby adjusting the current display size of the image according to the ideal display size of the image the method can avoid the phenomenon that the viewer visually produces image reduction due to position and/or line of sight change; Different types of distortion in the image can be corrected while the image display size is adjusted to prevent the distortion of the image from being enlarged due to size adjustment.
- the image processing system is capable of displaying an image on the display surface according to a viewpoint distance between a viewer and a display surface.
- the display size is adjusted, and the system is also capable of acquiring the distortion of the image on the display surface, so that the image can be corrected for image distortion during the display size adjustment, thereby improving the display adaptability of the display surface to different viewpoint distances.
- the image processing unit includes a control unit, an imaging unit, a storage unit, an image size calculation unit, and an image resizing unit.
- the control unit is configured to control an operating state of the image capturing unit, the storage unit, the image size calculating unit, and the image resizing unit, and information data communication between each other.
- the camera unit is configured to capture a viewer by the unit, and obtain the relevant position information of the three by the calculation process of the captured viewer image by the control unit, where the camera unit is generally disposed in a plane coplanar with the display surface. Location.
- the storage unit is configured to store a library of motion curve functions, and a comparison table between the viewpoint distance S and the display size A of the image or a comparison function between the viewpoint distance S and the display size A of the image.
- the image size calculation unit is configured to acquire a display size of an image on the display surface, the display size of the image may be represented by an actual length and width value of the image on the display surface, or the image may be displayed on the display surface
- the number of pixels occupied is characterized.
- the image resizing unit is configured to resize the corresponding image based on the image resizing ratio calculated by the control unit, and perform images on the display surface on the pincushion distortion, barrel distortion, and/or keystone distortion. Correction of distortion.
- the image processing system calculates the viewpoint position of the viewer relative to the display surface by acquiring the position of the viewer, the direction of the line of sight of the viewer's viewing image, and the relative positional relationship between the display surfaces. Distance, and according to the distance of the viewpoint, by looking up a comparison table or a calculation pair Calculating the ideal display size of an image of the image on the display surface according to the function, thereby adjusting the current display size of the image according to the ideal display size of the image, and the system can avoid the position And/or change of line of sight causes the viewer to visually reduce the image; in addition, the system can correct different types of distortion in the image while adjusting the size of the image display to prevent distortion of the image due to size adjustment. It is enlarged.
- the storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
一种图像处理方法及图像处理系统，所述方法包括：S101、获取观看者位置、观看者观看图像的视线方向以及显示表面三者之间的相对位置关系（S101）；S102、基于所述相对位置关系，获取所述显示表面上与所述视线方向对应的图像点位置，并以此获取观看者的视点距离（S102）；S103、基于所述视点距离，调整该显示表面上图像的显示尺寸（S103）。上述方法提供一种简单可靠和快捷的图像处理方法。
Description
本发明涉及信息处理技术领域，尤其涉及一种图像处理方法和系统。
随着平板显示技术的发展，大尺寸的平板显示器已经成为家用或者商用平板显示器的一个主要发展方向。用户可通过液晶显示器或者LED显示器来观看电影等动态视频信息，而大尺寸的液晶显示器或者LED显示器能够使用户获得更加逼真和丰富的观看观感。但是，平板显示器的大尺寸化也导致用户在不同位置处所观看到的图像大小并不一致，或者当用户处于固定位置时，若用户头部发生运动而使得用户的观看视线发生倾斜等变化，也会导致用户观看到的图像尺寸发生扭曲，这种大尺寸平板显示器在针对不同观看位置或者观看视线而形成的图像尺寸扭曲现象对改善大尺寸平板显示器的图像显示质量带来极大的挑战。目前已经存在通过在观看者身上设置感应单元，并通过感应单元获取观看者与平板显示器的屏幕之间的距离，从而根据该距离的变化来改变平板显示器上显示的图像尺寸，上述方式能够在一定程度上减轻因观看者与平板显示器之间距离的变化而图像尺寸扭曲现象，但是上述方式依然无法避免在观看者的位置不变而视线变化情况下引起的图像尺寸扭曲现象。可见，现有技术亟需一种能够解决上述图像尺寸扭曲现象的图像处理方法。
发明内容
针对上述现有技术存在的缺陷，本发明所要解决的技术问题在于现有技术的大尺寸平板显示器无法避免观看者观看视线变化而导致的图像尺寸扭曲现象，该图像尺寸扭曲现象会使观看者针对同一帧图片在不同观看角度下会获得不同尺寸的观看效果，这导致观看者在连续变化观看视线的情况下，观看者感知的图像尺寸也是连续变化的，这严重地影响大尺寸平板显示器的图像显示质量，同时也会导致观看者因观看到尺寸连续变化的图像而产生眩晕感。
为了解决上述技术问题，本发明实施例提供一种图像处理方法，其特征在
于，所述方法包括：
S101、获取观看者位置、观看者观看图像的视线方向以及显示表面三者之间的相对位置关系；
S102、基于所述相对位置关系，获取所述显示表面上与所述视线方向对应的图像点位置，并以此获取观看者的视点距离；
S103、基于所述视点距离，调整该显示表面上图像的显示尺寸；
进一步，在S101中，在对所述观看者拍摄的图像中，提取关于所述观看者的特征点信息，并基于所述特征点信息计算所述观看者与所述显示表面之间的相对距离；
进一步，在S101中，通过对所述观看者的眼睛动作过程进行动作模式匹配处理，获取所述眼睛的视线方向函数，以计算出所述视线方向与所述显示表面法向方向之间的夹角；
进一步，在S102中，所述视点距离是基于所述观看者与所述显示表面之间的相对距离、以及所述视线方向与所述显示表面法向方向之间的夹角计算得出的；
进一步，在S103中，根据所述视点距离获取所述显示表面上图像的尺寸调整比例，再根据所述尺寸调整比例对所述图像进行尺寸调整。
相应地，本发明实施例还提供一种图像处理系统，其特征在于，所述系统包括控制单元、摄像单元和尺寸调整单元，所述控制单元用于控制所述摄像单元和所述图像尺寸调整单元的工作状态；
所述摄像单元用于拍摄观看者的图像，所述控制单元基于所述观看者的图像获取观看者位置、观看者观看图像的视线方向以及显示表面三者之间的相对位置关系，并计算出所述观看者的视点距离；
所述图像尺寸调整单元能够基于所述视点距离，调整该显示表面上图像的显示尺寸；
进一步，所述控制单元还能够在对所述观看者拍摄的图像中，提取关于所述观看者的特征点信息，并基于所述特征点信息计算所述观看者与所述显示表面之间的相对距离；
进一步，所述控制单元还能够通过对所述观看者的眼睛动作过程进行动作
模式匹配处理，获取所述眼睛的视线方向函数，以计算出所述视线方向与所述显示表面法向方向之间的夹角；
进一步，所述系统还包括图像尺寸计算单元，其用于计算所述显示表面上图像的长宽尺寸或者所述显示表面上图像所占的像素数量作为图像原始显示尺寸；
进一步，所述图像尺寸调整单元是依据图像尺寸调整比例来进行图像的显示尺寸调整；
其中，所述图像尺寸调整比例是基于所述图像原始显示尺寸和图像调整目标尺寸计算得出的。
本发明通过上述技术方案提供一种图像处理方法和系统通过获取观看者位置、观看者观看图像的视线方向以及显示表面三者之间的相对位置关系，以计算出该观看者相对于该显示表面的视点距离，并依据该视点距离通过查找对照表或者演算对照函数的方式计算出在该视点距离下，该显示表面上某一图像的图像理想显示尺寸，从而根据该图像理想显示尺寸对该某一图像当前的显示尺寸进行调整，该方法和系统能够避免因位置和/或视线变化而导致观看者在视觉上产生图像缩小的现象；此外，该方法和系统还能在图像显示尺寸调整的同时对图像中不同类型的畸变进行校正，以防止该图像的畸变因尺寸调整而被放大。
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1是本发明实施例提供的一种图像处理方法的流程示意图；
图2是本发明实施例提供的一种图像处理系统的结构示意图。
下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清
楚、完整地描述，显然，所描述的实施例仅仅是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。
参见图1，为本发明实施例提供的一种图像处理方法的流程示意图，在本发明实施例中，所述方法包括：
S101、获取观看者位置、观看者观看图像的视线方向以及显示表面三者之间的相对位置关系。
具体而言，该图像处理方法可以是针对液晶显示器、LED显示器或者等离子显示器等平板显示器实施的，也可以是针对投影式显示器实施的；其中，该平板显示器和投影式显示器具有相应的显示表面，该显示表面可以是显示屏或者投影屏幕等。该显示表面能够显示画面，该画面可包括图像和/或文字，若该画面中的图像或者文字的显示尺寸不变，当观看者与该显示表面之间的距离变大或者观看者的视线与该显示表面的法线之间的偏离角度越大，用户从该显示表面感知到的图像或者文字就会相应地变小，当该距离或者偏离角度增加到一定程度时用户就无法从该显示表面上分别出该图像或者文字。为了获取观看者的位置、观看者观看图像的视线方向以及该显示表面三者之间的位置关系，该方法通过摄像单元对观看者进行拍摄，并将拍摄到的观看者图像经过控制单元的计算处理而得出上述三者的相关位置信息，该摄像单元通常设置在与该显示表面共面的位置上。该摄像单元对该观看者进行跟踪拍摄，该跟踪拍摄可以是针对观看者进行连续视频拍摄，也可以是针对观看者进行间隔的帧图像拍摄，该摄像单元将拍摄到的观看者图像信息传送至控制单元中，该控制单元基于该观看者图像信息识别该观看者的眼睛位置，从而计算出该观看者与该摄像单元之间的相对距离以及该观看者与该显示表面法线之间的相对角度。
该控制单元接收到该观看者图像信息后，从该观看者图像信息中提取如眼睛等五官部位的特征点，并通过图像像元分析处理计算出该观看者的双目距离和/或该观看者的面部尺寸等数据；接着，该控制单元以该观看者双目连线的中点为原点建立关于该观看者的面部的平面坐标系，该控制单元通过在该平面坐标系上对照该摄像单元拍摄的两张关于该观看者面部图像中特征点的不同的分布状态，从而通过计算图像像差的方式计算出该观看者眼睛或者面部与该
显示表面之间的相对距离，并将该相对距离作为该观看者相对该显示表面的位置标定量。
此外，该控制单元还对该观看者图像信息进行动作模式匹配处理，该动作模式匹配处理能够将该图像信息中观看者的眼睛视为动作基元，并通过记录该观看者眼睛在若干帧图像之间的动作轨迹或者该观看者眼睛在某一视频流中的动作轨迹，并将该动作轨迹通过最小二乘法等方式转换成平面坐标系中相应的函数曲线；随后，该控制单元将该曲线函数与存储单元中的运动曲线函数库进行匹配处理，该匹配处理是通过神经网络学习模型将该曲线函数与该运动曲线函数库中的每一个函数模型进行相似度计算，并将与该曲线函数具有最高相似度的函数模型作为该观看者眼睛的视线方向函数，最终该控制单元根据该视线方向函数计算出该观看者的视线方向以及该视线方向与该显示表面法线方向之间的夹角或者偏离角度。其中，该存储单元中的运动曲线函数库是通过计算统计集合中每个样本的眼睛运动规律而形成的。
在上述步骤中，通过计算获得该观看者眼睛或者面部与该显示表面之间的相对距离D，以及该观看者的视线方向与该显示表面法线方向之间的夹角或者偏离角度这两个参量，并将该两个参量用于表征观看者位置、观看者观看图像的视线方向以及显示表面三者之间的相对位置关系。
S102、基于该相对位置关系，获取该显示表面上与该视线方向对应的图像点位置，并以此获取观看者的视点距离。
具体而言，该控制单元计算获得该观看者眼睛或者面部与该显示表面之间的相对距离D以及该观看者的视线方向与该显示表面法线方向之间的夹角或者偏离角β后，将该观看者的视线方向延伸到该显示表面上并将该视线方向延长线与该显示表面的交点选定为参考图像点，该控制单元与该参考图像点为原点建立关于该观看者与该显示表面的空间极坐标系，其中，采用该空间极坐标系表征是由于其能够准确以及便捷地反映该观看者眼睛与该显示表面之间的相对点-线关系。该获取观看者的视点距离的过程可为：该控制单元在该显示表面上确定该视线方向延长线的交点后，建立该观看者双目连接的中点、该视线方向延长线与该显示表面的交点以及该显示表面的法线与该显示表面交点这三者的空间三角形，并通过三角测量定位的方法计算出该观看者双目连线的
点至该视线方向延长线与该显示表面的交点之间的距离S，并将该距离S作为该观看者的视点距离，由于该距离S是基于观看者眼睛或者面部与该显示表面之间的相对距离D，以及该观看者的视线方向与该显示表面法线方向之间的夹角或者偏离角β这两者计算得出的，故该距离S的变化能够同时反映出该相对距离D和夹角β的变化。
S103、基于该视点距离，调整该显示表面上图像的显示尺寸。
具体而言，该控制单元控制图像尺寸计算单元获取当前该显示表面上图像的显示尺寸，该图像的显示尺寸可通过该图像在该显示表面上的实际长度和宽度数值进行表征，也可通过该图像在该显示表面上所占的像素数量进行表征，并将该图像的显示尺寸传送至该控制单元中。该存储单元中还保存有该视点距离S与该图像的显示尺寸A之间的对照表或者关于该视点距离S与该图像的显示尺寸A之间的对照函数，其中，该调整对照表和对照函数都显示出该视点距离S与该图像的显示尺寸A之间的变化关系，该控制单元通过查找该对照表或者演算该对照函数的方式，计算出在当前视点距离下，该显示表面上显示的图像理想显示尺寸，该理想显示尺寸是指该观看者处于该当前视点距离下，观看者能够清楚地分辨出相连两个不同的图像之间的分界线。该控制单元基于该图像理想显示尺寸和当前该显示表面上对应图像的显示尺寸，计算出该图像尺寸调整比例，并将该图像尺寸调整比例信息传送给图像尺寸调整单元，该图像尺寸调整单元基于该图像尺寸调整比例对相应的图像进行尺寸调整。
此外，该控制单元还能够计算该显示表面上当前显示图像的枕形畸变、桶形畸变和/或梯形畸变等图像畸变，并根据相应的图像畸变纠正函数计算出针对不同类型的图像畸变的纠正量，该图像尺寸调整单元能够基于该图像畸变的纠正量和图像尺寸调整比例同时对该显示表面上的图像进行畸变校正和尺寸调整；优先地，该对图像的畸变校正和尺寸调整可以渐变的形式实施的，以防止该观看者在该显示表面上观看到突变的图像而产生视觉眩晕感。
从上述实施例可以看出，该图像处理方法通过获取观看者位置、观看者观看图像的视线方向以及显示表面三者之间的相对位置关系，以计算出该观看者相对于该显示表面的视点距离，并依据该视点距离通过查找对照表或者演算对照函数的方式计算出在该视点距离下，该显示表面上某一图像的图像理想显示
尺寸，从而根据该图像理想显示尺寸对该某一图像当前的显示尺寸进行调整，该方法能够避免因位置和/或视线变化而导致观看者在视觉上产生图像缩小的现象；此外，该方法还能在图像显示尺寸调整的同时对图像中不同类型的畸变进行校正，以防止该图像的畸变因尺寸调整而被放大。
参见图2，为本发明实施例提供的一种图像处理系统的结构示意图，在本发明实施例中，该图像处理系统能够根据观看者与显示表面之间的视点距离对该显示表面上图像的显示尺寸进行调整，同时该系统还能够获取该显示表面上图像的畸变，以使得该图像在显示尺寸调整的过程中也能进行图像畸变校正，从而改善显示表面对不同视点距离的显示适应性。
该图像处理单元包括控制单元、摄像单元、存储单元、图像尺寸计算单元和图像尺寸调整单元。该控制单元用于控制该摄像单元、存储单元、图像尺寸计算单元和图像尺寸调整单元的工作状态以及相互之间的信息数据通信。
该摄像单元用于单元对观看者进行拍摄，并将拍摄到的观看者图像经过控制单元的计算处理而得出上述三者的相关位置信息，该摄像单元通常设置在与该显示表面共面的位置上。
该存储单元用于保存运动曲线函数库、以及该视点距离S与该图像的显示尺寸A之间的对照表或者关于该视点距离S与该图像的显示尺寸A之间的对照函数。
该图像尺寸计算单元用于获取当前该显示表面上图像的显示尺寸，该图像的显示尺寸可通过该图像在该显示表面上的实际长度和宽度数值进行表征，也可通过该图像在该显示表面上所占的像素数量进行表征。
该图像尺寸调整单元用于基于该控制单元计算出的图像尺寸调整比例对相应的图像进行尺寸调整，以及对该显示面表上图像进行关于枕形畸变、桶形畸变和/或梯形畸变等图像畸变的校正。
关于本实施例涉及的术语的含义以及举例，可以参考图1对应的实施例。此处不再赘述。
从上述实施例可以看出，该图像处理系统通过获取观看者位置、观看者观看图像的视线方向以及显示表面三者之间的相对位置关系，以计算出该观看者相对于该显示表面的视点距离，并依据该视点距离通过查找对照表或者演算对
照函数的方式计算出在该视点距离下，该显示表面上某一图像的图像理想显示尺寸，从而根据该图像理想显示尺寸对该某一图像当前的显示尺寸进行调整，该系统能够避免因位置和/或视线变化而导致观看者在视觉上产生图像缩小的现象；此外，该系统还能在图像显示尺寸调整的同时对图像中不同类型的畸变进行校正，以防止该图像的畸变因尺寸调整而被放大。
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程，是可以通过计算机程序来指令相关的硬件来完成，所述的程序可存储于一计算机可读取存储介质中，该程序在执行时，可包括如上述各方法的实施例的流程。其中，所述的存储介质可为磁碟、光盘、只读存储记忆体(Read-Only Memory，ROM)或随机存储记忆体(Random Access Memory，RAM)等。
以上所揭露的仅为本发明一种较佳实施例而已，当然不能以此来限定本发明之权利范围，本领域普通技术人员可以理解实现上述实施例的全部或部分流程，并依本发明权利要求所作的等同变化，仍属于发明所涵盖的范围。
Claims (10)
- 一种图像处理方法，其特征在于，所述方法包括：S101、获取观看者位置、观看者观看图像的视线方向以及显示表面三者之间的相对位置关系；S102、基于所述相对位置关系，获取所述显示表面上与所述视线方向对应的图像点位置，并以此获取观看者的视点距离；S103、基于所述视点距离，调整该显示表面上图像的显示尺寸。
- 根据权利要求1所述的方法，其特征在于，在S101中，在对所述观看者拍摄的图像中，提取关于所述观看者的特征点信息，并基于所述特征点信息计算所述观看者与所述显示表面之间的相对距离。
- 根据权利要求1所述的方法，其特征在于，在S101中，通过对所述观看者的眼睛动作过程进行动作模式匹配处理，获取所述眼睛的视线方向函数，以计算出所述视线方向与所述显示表面法向方向之间的夹角。
- 根据权利要求1所述的方法，其特征在于，在S102中，所述视点距离是基于所述观看者与所述显示表面之间的相对距离、以及所述视线方向与所述显示表面法向方向之间的夹角计算得出的。
- 根据权利要求1所述的方法，其特征在于，在S103中，根据所述视点距离获取所述显示表面上图像的尺寸调整比例，再根据所述尺寸调整比例对所述图像进行尺寸调整。
- 一种图像处理系统，其特征在于，所述系统包括控制单元、摄像单元和尺寸调整单元，所述控制单元用于控制所述摄像单元和所述图像尺寸调整单 元的工作状态；所述摄像单元用于拍摄观看者的图像，所述控制单元基于所述观看者的图像获取观看者位置、观看者观看图像的视线方向以及显示表面三者之间的相对位置关系，并计算出所述观看者的视点距离；所述图像尺寸调整单元能够基于所述视点距离，调整该显示表面上图像的显示尺寸。
- 根据权利要求6所述的系统，其特征在于，所述控制单元还能够在对所述观看者拍摄的图像中，提取关于所述观看者的特征点信息，并基于所述特征点信息计算所述观看者与所述显示表面之间的相对距离。
- 根据权利要求6所述的系统，其特征在于，所述控制单元还能够通过对所述观看者的眼睛动作过程进行动作模式匹配处理，获取所述眼睛的视线方向函数，以计算出所述视线方向与所述显示表面法向方向之间的夹角。
- 根据权利要求6所述的系统，其特征在于，所述系统还包括图像尺寸计算单元，其用于计算所述显示表面上图像的长宽尺寸或者所述显示表面上图像所占的像素数量作为图像原始显示尺寸。
- 根据权利要求9所述的系统，其特征在于，所述图像尺寸调整单元是依据图像尺寸调整比例来进行图像的显示尺寸调整；其中，所述图像尺寸调整比例是基于所述图像原始显示尺寸和图像调整目标尺寸计算得出的。
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2017/083369 WO2018205055A1 (zh) | 2017-05-07 | 2017-05-07 | 一种图像处理方法和系统 |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2017/083369 WO2018205055A1 (zh) | 2017-05-07 | 2017-05-07 | 一种图像处理方法和系统 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2018205055A1 true WO2018205055A1 (zh) | 2018-11-15 |
Family
ID=64104110
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2017/083369 WO2018205055A1 (zh) | 2017-05-07 | 2017-05-07 | 一种图像处理方法和系统 |
Country Status (1)
| Country | Link |
|---|---|
| WO (1) | WO2018205055A1 (zh) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102158721A (zh) * | 2011-04-06 | 2011-08-17 | 青岛海信电器股份有限公司 | 调节三维立体图像的方法、装置及电视机 |
| CN102693067A (zh) * | 2011-03-25 | 2012-09-26 | 鸿富锦精密工业（深圳）有限公司 | 字体大小的调整系统及方法 |
| CN103499886A (zh) * | 2013-09-30 | 2014-01-08 | 北京智谷睿拓技术服务有限公司 | 成像装置和方法 |
| US20150102995A1 (en) * | 2013-10-15 | 2015-04-16 | Microsoft Corporation | Automatic view adjustment |
| CN104581350A (zh) * | 2015-02-04 | 2015-04-29 | 京东方科技集团股份有限公司 | 一种显示方法和显示装置 |
| CN105474303A (zh) * | 2013-09-02 | 2016-04-06 | 索尼公司 | 信息处理装置、信息处理方法及程序 |
-
2017
- 2017-05-07 WO PCT/CN2017/083369 patent/WO2018205055A1/zh active Application Filing
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102693067A (zh) * | 2011-03-25 | 2012-09-26 | 鸿富锦精密工业（深圳）有限公司 | 字体大小的调整系统及方法 |
| CN102158721A (zh) * | 2011-04-06 | 2011-08-17 | 青岛海信电器股份有限公司 | 调节三维立体图像的方法、装置及电视机 |
| CN105474303A (zh) * | 2013-09-02 | 2016-04-06 | 索尼公司 | 信息处理装置、信息处理方法及程序 |
| CN103499886A (zh) * | 2013-09-30 | 2014-01-08 | 北京智谷睿拓技术服务有限公司 | 成像装置和方法 |
| US20150102995A1 (en) * | 2013-10-15 | 2015-04-16 | Microsoft Corporation | Automatic view adjustment |
| CN104581350A (zh) * | 2015-02-04 | 2015-04-29 | 京东方科技集团股份有限公司 | 一种显示方法和显示装置 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9911216B2 (en) | System and method for enabling mirror video chat using a wearable display device | |
| US20230132407A1 (en) | Method and device of video virtual background image processing and computer apparatus | |
| US10511823B2 (en) | Video display apparatus, video display system, and video display method | |
| CN106331668B (zh) | 一种多投影的图像显示方法及其系统 | |
| CN105787884A (zh) | 一种图像处理方法及电子设备 | |
| US10567649B2 (en) | Parallax viewer system for 3D content | |
| US20170180680A1 (en) | Object following view presentation method and system | |
| WO2021092885A1 (zh) | 控制投影模块投影的方法、装置和投影系统 | |
| US8970663B2 (en) | 3D video conference | |
| US20170316582A1 (en) | Robust Head Pose Estimation with a Depth Camera | |
| CN110764613A (zh) | 基于头戴式眼动模组的眼动追踪校准方法 | |
| CN106713740B (zh) | 定位跟踪摄像方法与系统 | |
| US10764493B2 (en) | Display method and electronic device | |
| CN111144356A (zh) | 一种远程教学的教师视线跟随方法及装置 | |
| CN105721739B (zh) | 屏幕影像画面防抖系统及方法 | |
| CN113302915A (zh) | 在视频会议中共享物理书写表面 | |
| KR101148508B1 (ko) | 모바일 기기 디스플레이의 표시 장치 및 그 방법, 이를 이용하는 모바일 기기 | |
| US11218662B2 (en) | Image processing device, image processing method, and projection system | |
| CN111083368A (zh) | 一种基于云端的模拟物理云台全景视频展示系统 | |
| US11128815B2 (en) | Device, method and computer program for extracting object from video | |
| CN117714843A (zh) | 多摄像头视场切换方法及其系统 | |
| WO2020000521A1 (zh) | 全景视频的画面质量显示方法及装置 | |
| CN108012160B (zh) | 一种基于全景视频的台标插入方法 | |
| WO2018205055A1 (zh) | 一种图像处理方法和系统 | |
| CN108022204A (zh) | 一种柱面全景视频转换为球面全景视频的方法 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 17909131 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 17909131 Country of ref document: EP Kind code of ref document: A1 |