WO2015135477A1 - 一种手持终端及其屏幕防抖方法和装置 - Google Patents

一种手持终端及其屏幕防抖方法和装置 Download PDF

Info

Publication number
WO2015135477A1
WO2015135477A1 PCT/CN2015/074008 CN2015074008W WO2015135477A1 WO 2015135477 A1 WO2015135477 A1 WO 2015135477A1 CN 2015074008 W CN2015074008 W CN 2015074008W WO 2015135477 A1 WO2015135477 A1 WO 2015135477A1
Authority
WO
WIPO (PCT)
Prior art keywords
screen
displacement
face
handheld terminal
human
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2015/074008
Other languages
English (en)
French (fr)
Inventor
张辉
谭焕清
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nubia Technology Co Ltd
Original Assignee
Nubia Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nubia Technology Co Ltd filed Critical Nubia Technology Co Ltd
Publication of WO2015135477A1 publication Critical patent/WO2015135477A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/61—Control of cameras or camera modules based on recognised objects
    • H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/682—Vibration or motion blur correction
    • H04N23/683—Vibration or motion blur correction performed by a processor, e.g. controlling the readout of an image memory

Definitions

  • the present invention relates to the field of communications technologies, and in particular, to a handheld terminal and a method and apparatus for preventing image stabilization thereof.
  • the screen anti-shake method of the handheld terminal is: monitoring the movement of the handheld terminal through the motion sensor built in the handheld terminal, and performing displacement compensation on the screen display according to the jitter parameter of the mobile terminal.
  • This screen displacement compensation is only compensation for the jitter of the handheld terminal itself, and does not consider the jitter of the screen relative to the human face (human eyes). In fact, the human face (human eyes) is often also shaking, so the stability when viewing the screen. Sexual effects are not good.
  • the technical problem to be solved by the present invention is to provide a handheld terminal and a screen anti-shake method and device thereof, which can solve the screen jitter caused by the shaking of the face and further improve the stability when viewing the screen.
  • a screen anti-shake method of a handheld terminal including:
  • the motion sensor When the screen is lit, the motion sensor is turned on to monitor the motion state of the handheld terminal;
  • the handheld terminal is detected to be shaken, the camera image is started and face recognition is performed, and the displacement parameter of the face relative to the screen is calculated; the human-machine interface displayed on the screen is inversely compensated according to the displacement parameter , so that the person The machine interface is relatively stationary relative to the face.
  • the calculating the displacement parameter of the face relative to the screen further comprises: calculating a lateral displacement and a longitudinal displacement of the face relative to the display screen, and a distance between the face and the screen and a displacement acceleration.
  • compensating the human-machine interface displayed on the screen according to the jitter displacement parameter further comprises:
  • the man-machine interface displayed on the screen is reversely compensated with respect to the direction of the terminal displacement;
  • the dithering or reducing the dithering human-machine interface is performed according to the distance between the dithering face and the screen and the displacement acceleration.
  • the method further comprises: performing opposite compensation on the screen display position relative to the moving direction of the handheld terminal according to the jitter parameter of the motion sensor.
  • the jitter parameters include a jitter direction, a jitter acceleration, and a jitter displacement.
  • the inversely compensating the screen display position relative to the moving direction of the handheld terminal according to the jitter parameter of the motion sensor further comprises:
  • the method further includes:
  • the calculating the displacement parameter of the face relative to the screen further comprises:
  • the foreground image is captured by the camera, and the captured image is subjected to face recognition;
  • the motion data is corrected and adjusted by image recognition displacement to obtain a displacement parameter.
  • the photographing the foreground image by the camera further comprises: using the camera to capture the foreground image when the light is sufficient, and using the infrared light line to cooperate with the infrared camera to capture the foreground image when the light is relatively dark.
  • a screen anti-shake device for a handheld terminal includes the following modules:
  • the motion monitoring module is configured to: when the screen is lit, turn on the motion sensor to monitor the motion state of the handheld terminal;
  • the face recognition module is configured to: when detecting the jitter of the handheld terminal, start camera imaging and perform face recognition, and calculate a displacement parameter of the face relative to the screen;
  • the display processing module is configured to inversely compensate the human-machine interface displayed on the screen according to the displacement parameter, so that the human-machine interface is relatively stationary relative to the human face.
  • the face recognition module is configured to: start camera imaging and perform face recognition, calculate lateral displacement and longitudinal displacement of the face relative to the display screen, and accelerate the distance and displacement of the face and the screen degree.
  • the display processing module is configured to: inversely compensate the man-machine interface displayed on the screen relative to the direction of the terminal displacement according to the lateral displacement and the longitudinal displacement; and enlarge or reduce according to the distance between the shaking face and the screen and the displacement acceleration Jitter the human machine interface.
  • the display processing module is further configured to: inversely compensate the screen display position for the direction of movement of the handheld terminal according to the jitter parameter of the motion sensor.
  • the motion monitoring module is configured to determine that the handheld terminal has jittered when the center point of the screen is within a preset range in the horizontal or vertical direction with respect to the center point of the human machine interface.
  • the face recognition module is set to:
  • the foreground image is captured by the camera, and the captured image is subjected to face recognition;
  • the motion data is corrected and adjusted by image recognition displacement to obtain a displacement parameter.
  • the face recognition module is configured to: use the camera to capture the foreground image when the light is sufficient, and use the infrared light line to cooperate with the infrared camera to capture the foreground image when the light is relatively dark.
  • a handheld terminal comprising the above-described screen anti-shake device.
  • the handheld terminal and the screen anti-shake method and device thereof calculate a true relative displacement between a human face (human eye) and a screen by introducing a face recognition technology, and consider the true relative displacement between the face and the screen.
  • the synchronous movement displacement compensation is performed on the man-machine interface displayed on the screen, so that the human-machine interface is kept stationary relative to the human face as much as possible, thereby improving the user's viewing of the screen. Stability, which improves the user's reading experience.
  • FIG. 1 is a flowchart of a screen anti-shake method according to an embodiment of the present invention
  • FIG. 2 is a flowchart of another screen anti-shake method according to a preferred embodiment of the present invention.
  • FIG. 3 is a schematic structural diagram of a module of a screen anti-shake device according to an embodiment of the present invention.
  • FIG. 1 is a schematic diagram of a screen anti-shake method of a handheld terminal according to an embodiment of the present invention, where the method includes:
  • the motion sensor can be an acceleration sensor or a gyroscope.
  • step S102 Determine whether the handheld terminal jitter is detected. If yes, execute step S103, otherwise continue monitoring.
  • the jitter means that the displacement of the center point of the screen relative to the center point of the human-machine interface in the horizontal or vertical direction is greater than 1 mm and less than 50% of the width or length of the screen size, that is, the compensation displacement of the present invention is constant.
  • the displacement range is performed. The maximum displacement depends on the screen size (such as the size of the mobile phone and the flat screen). It is better to see half of the human-machine interface. Otherwise, the displacement is too large.
  • the synchronization point is beyond the screen range. In other words, when the displacement of the center point of the screen with respect to the center point of the human-machine interface in the horizontal or vertical direction is within a preset range, it is determined that the hand-held terminal has shaken.
  • S103 Start camera imaging and perform face recognition, and calculate displacement parameters of the face relative to the screen.
  • calculating the displacement parameter of the face relative to the screen comprises calculating a lateral displacement and a longitudinal displacement of the face relative to the display screen, and a distance between the face and the screen and a displacement acceleration.
  • the foreground image is captured by the camera, and the camera is used when the light is sufficient.
  • the infrared light is used together with the infrared camera to perform face recognition on the captured image (the face recognition technology can adopt the existing one) Technology, not described in detail here).
  • the face recognition technology can adopt the existing one
  • it is not simply relying on image recognition technology to judge displacement, but based on motion sensor data, and further combined with image recognition technology, this can make displacement judgment faster and more accurate.
  • the motion data is first obtained according to the motion sensor, and then the motion of the screen is compared by the contrast of the screen content (for example, the position change of the face in the image before and after the motion is up, down or in which direction) Based on the data, further correct and adjust by image recognition displacement, and calculate the lateral displacement and longitudinal displacement (ie, the amount of compensation data) of the output human-machine interface through the combination of two data, so that the subsequent displacement distance is within the preset range.
  • the displacement of the human-machine interface relative to the direction of the terminal displacement is reversely compensated.
  • the image display is relatively stationary with respect to the human face and the human eye.
  • the step S104 further comprises: inversely compensating the human-machine interface displayed on the screen with respect to the moving direction of the terminal according to the lateral displacement and the longitudinal displacement; and enlarging or reducing the human-machine interface according to the distance and acceleration of the human face from the screen .
  • the human-machine interface is located at the center of the display screen.
  • the human-machine interface moves to the left side of the display screen, and the specific movement amplitude is determined according to the displacement of the handheld terminal.
  • the human-machine interface moves to the right side of the display screen, and the specific movement amplitude is determined according to the displacement of the handheld terminal.
  • the human-machine interface moves to the upper side of the display screen, and the specific movement amplitude is determined according to the displacement of the handheld terminal.
  • the human-machine interface moves to the lower left side of the display screen, and the specific movement amplitude is determined according to the displacement of the handheld terminal.
  • the human-machine interface When the handheld terminal is away from or close to the human face, the human-machine interface will assume an enlarged or reduced state, and the specific enlargement or reduction ratio is proportional to the acceleration. Specifically, the variation coefficient of the output reduction or amplification is calculated according to the distance change value and the displacement acceleration change value, and the specific reduction or amplification factor (such as 10%, 15% or 20%) can be given by experiments, so that after scaling The size of the human-machine interface is always the same as the original initial state.
  • the interface and the font become smaller due to the distance from the visual angle, and a magnification factor is given according to the amount of change of 1cm backward (for example, the interface is enlarged by 10%), so that the back and forth 1cm displacement is relative to the human eye.
  • the human-machine interface does not seem to change and is still.
  • the screen anti-shake method and device of the handheld terminal calculates a true relative displacement between a human face (human eye) and a screen by introducing a face recognition technology, and takes into account the true relative displacement between the face and the screen.
  • the terminal can perform synchronous displacement compensation on the man-machine interface displayed on the screen according to the displacement parameter within a certain range of displacement, so as to keep the human-machine interface stationary relative to the human face as much as possible, thereby improving the stability of the viewing screen. Thereby improving the user's reading experience.
  • FIG. 2 is a schematic diagram of a screen anti-shake method of a handheld terminal according to a preferred embodiment of the present invention. The method includes:
  • the motion sensor may be an acceleration sensor or a gyroscope, and the motion sensor detects a jitter parameter of the handheld terminal, and the jitter parameter includes a jitter direction, a jitter acceleration, and a jitter displacement.
  • the dithering direction may be included in three dimensions of the handheld terminal screen coordinate system, and the jitter displacement and the jitter acceleration also correspond to the displacement amplitude and the jitter acceleration included in the three dimensional directions.
  • step S202 Determine whether the handheld terminal jitter is detected. If yes, execute step S203, otherwise continue monitoring.
  • the jitter parameter is transmitted to the display processor, and when no jitter is detected, the display is performed in the normal mode while continuing to monitor whether the jitter is present.
  • the jitter direction and the amplitude in three dimensions of the screen coordinate system are determined according to the accelerations in the three dimensions of the screen coordinate system; and the screen display position is displayed according to the shaking direction and the amplitude in the three dimensions of the screen coordinate system. Pan or zoom.
  • the screen display position is relative to the display screen of the mobile phone (ie, the physical part between the borders of the mobile phone), generally the default full screen display, and the human machine interface is the displayed screen relative to the screen, and generally the default is The picture is full of screens.
  • the screen display position is displacement-compensated with respect to the opposite movement direction of the handheld terminal, thereby compensating for the jitter of the handheld terminal itself, trying to keep the screen as relatively static as possible, and then further compensating in the screen. HMI.
  • S204 Start camera imaging and perform face recognition, and calculate displacement parameters of the face relative to the screen.
  • This step S204 is the same as step S103 of the first embodiment, and will not be repeated here.
  • This step S205 is the same as step S104 of the first embodiment, and will not be repeated here.
  • the screen anti-shake method of the handheld terminal introduces face recognition technology to calculate the sway displacement of the face relative to the screen, based on the displacement compensation of the display screen by the sensor in the handheld terminal.
  • the man-machine interface further compensates for the displacement and is stabilized by double compensation. Sexual effects are better.
  • the present invention compensates for the human-machine interface, and mainly includes two compensation modes: first, according to the lateral displacement and the longitudinal displacement, the human-machine interface displayed on the screen is inversely compensated with respect to the moving direction of the terminal; , enlarge or reduce the human-machine interface according to the distance and acceleration of the face from the screen. Thereby, the human-machine interface is kept as static as possible with respect to the human face, and the stability of the viewing screen is improved.
  • a screen anti-shake device of a handheld terminal includes:
  • the motion monitoring module 10 is configured to: when the handheld terminal screen is lit, turn on the motion sensor to monitor the motion state of the handheld terminal;
  • the face recognition module 20 is configured to: when detecting the jitter of the handheld terminal, start camera imaging and perform face recognition, and calculate a displacement parameter of the face relative to the screen;
  • the face recognition module 20 is specifically configured to: start camera imaging and perform face recognition, calculate lateral displacement and longitudinal displacement of the face relative to the display screen, and distance and displacement acceleration of the face from the screen.
  • the display processing module 30 is configured to compensate the human-machine interface displayed on the screen according to the displacement parameter.
  • the display processing module 30 is specifically configured to: inversely compensate the human-machine interface displayed on the screen according to the lateral displacement and the longitudinal displacement; and enlarge or reduce the human-machine interface according to the distance between the face and the screen and the displacement acceleration.
  • the display processing module 30 is further configured to: inversely compensate the screen display position relative to the direction of movement of the handheld terminal according to the jitter parameter of the motion sensor to make the display screen relatively stationary.
  • the jitter direction and the amplitude in the three dimensions of the screen coordinate system may be determined according to the accelerations in the three dimensions of the screen coordinate system; according to the jitter direction and the amplitude in the three dimensions of the screen coordinate system Display position for panning or zooming.
  • an embodiment of the present invention further provides a handheld terminal, where the handheld terminal includes the above-mentioned screen anti-shake device.
  • Handheld terminals include, but are not limited to, mobile phones, IPADs, and tablets.
  • the handheld terminal and the screen anti-shake device of the embodiment of the invention adopt the face recognition technology to consider the real displacement of the face relative to the screen in the screen compensation, so that the terminal is within a certain displacement range, according to the displacement parameter pair
  • the human-machine interface displayed on the screen performs synchronous displacement compensation to keep the human-machine interface still with respect to the human face as much as possible, thereby improving the stability of the viewing screen and thereby improving the user experience.
  • the handheld terminal and the screen anti-shake method and device thereof calculate a true relative displacement between a human face (human eye) and a screen by introducing a face recognition technology, and consider the true relative displacement between the face and the screen.
  • the terminal can perform synchronous motion displacement compensation on the man-machine interface displayed on the screen according to the displacement parameter within a certain range of displacement, and keep the human-machine interface stationary relative to the human face as much as possible, thereby improving the user's viewing screen.
  • the stability improves the user's reading experience.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

本发明公开了一种手持终端及其屏幕防抖方法和装置，属于终端技术领域。该方法包括：当屏幕点亮时，开启运动传感器监测手持终端的运动状态；如果检测到手持终端抖动，则启动摄像头摄像并进行人脸识别，计算人脸相对于屏幕的位移参数；根据所述位移参数对屏幕上显示的人机界面进行反向补偿，以使所述人机界面相对人脸相对静止。采用本发明实施例，通过引入人脸识别技术，将人脸与屏幕间的真实相对位移考虑在屏幕补偿内，以使终端在一定的位移范围内，根据位移参数对屏幕上显示的人机界面进行同步运动位移补偿，尽可能使人机界面相对于人脸保持静止，提高观看屏幕的稳定性。

Description

一种手持终端及其屏幕防抖方法和装置 技术领域
本发明涉及通信技术领域，尤其涉及一种手持终端及其屏幕防抖方法和装置。
背景技术
目前，手持终端的屏幕防抖方法是：通过手持终端内置的运动传感器监测手持终端的运动，根据手机终端的抖动参数来对屏幕显示进行位移补偿。这种屏幕位移补偿仅仅是对手持终端本身抖动的补偿，并未考虑屏幕相对人脸(人眼)的抖动，而实际上，人脸(人眼)往往也在晃动，故观看屏幕时的稳定性效果不佳。
发明内容
有鉴于此，本发明要解决的技术问题是提供一种手持终端及其屏幕防抖方法和装置，以解决人脸晃动引起的屏幕抖动，进一步提高观看屏幕时稳定性。
本发明解决上述技术问题所采用的技术方案如下：
根据本发明的一个方面，提供的一种手持终端的屏幕防抖方法包括：
当屏幕点亮时，开启运动传感器监测手持终端的运动状态；
如果检测到手持终端抖动，则启动摄像头摄像并进行人脸识别，计算人脸相对于屏幕的位移参数；根据所述位移参数对屏幕上显示的人机界面进行反向补偿，以使所述人机界面相对人脸相对静止。
优选地，抖动计算人脸相对于屏幕的位移参数进一步包括：计算人脸相对于显示屏幕的横向位移和纵向位移、以及人脸与屏幕的距离和位移加速度。
优选地，根据抖动位移参数对屏幕上显示的人机界面进行补偿进一步包括：
根据抖动横向位移和纵向位移，将屏幕上显示的人机界面相对于终端位移的方向进行反向补偿；
根据抖动人脸与屏幕的距离和位移加速度进行放大或缩小抖动人机界面。
优选地，抖动启动摄像头摄像进行人脸识别之前还包括：根据运动传感器的抖动参数对屏幕显示位置相对于手持终端运动方向进行相反补偿。
优选地，所述抖动参数包括抖动方向、抖动加速度和抖动位移。
优选地，所述根据运动传感器的抖动参数对屏幕显示位置相对于手持终端运动方向进行相反补偿进一步包括：
根据屏幕坐标系的三个维度上的加速度确定所述屏幕坐标系三个维度上的抖动方向和幅度；根据所述在屏幕坐标系三个维度上的抖动方向和幅度对屏幕显示位置进行平移或者缩放。
优选地，所述方法还包括：
当所述屏幕的中心点相对于人机界面的中心点在横向或者纵向的位移在预设范围内时，则判定手持终端发生了抖动。
优选地，所述计算人脸相对于屏幕的位移参数进一步包括：
通过运动传感器获取初步的运动数据；
通过摄像头拍摄前景图像，对拍摄的图像进行人脸识别；
通过图像识别位移对所述运动数据进行修正与调节，获取位移参数。
优选地，所述通过摄像头拍摄前景图像进一步包括：当光线充足时使用摄像头拍摄前景图像，当光线比较暗时使用红外灯光线与红外摄像头配合拍摄前景图像。
根据本发明的另一个方面，提供的一种手持终端的屏幕防抖装置包括以下模块：
运动监测模块，设置为当屏幕点亮时，开启运动传感器监测手持终端的运动状态；
人脸识别模块，设置为当检测到手持终端抖动时，启动摄像头摄像并进行人脸识别，计算人脸相对于屏幕的位移参数；
显示处理模块，设置为根据所述位移参数对屏幕上显示的人机界面进行反向补偿，以使所述人机界面相对人脸相对静止。
优选地，人脸识别模块设置为：启动摄像头摄像并进行人脸识别，计算人脸相对于显示屏幕的横向位移和纵向位移、以及人脸与屏幕的距离和位移加速 度。
优选地，显示处理模块设置为：根据横向位移和纵向位移，将屏幕上显示的人机界面相对于终端位移的方向进行反向补偿；根据抖动人脸与屏幕的距离和位移加速度进行放大或缩小抖动人机界面。
优选地，显示处理模块还设置为：根据运动传感器的抖动参数对屏幕显示位置对于手持终端运动方向进行相反补偿。
优选地，运动监测模块设置为：当所述屏幕的中心点相对于人机界面的中心点在横向或者纵向的位移在预设范围内时，则判定手持终端发生了抖动。
优选地，人脸识别模块设置为：
通过所述运动传感器获取初步的运动数据；
通过摄像头拍摄前景图像，对拍摄的图像进行人脸识别；
通过图像识别位移对所述运动数据进行修正与调节，获取位移参数。
优选地，人脸识别模块设置为：当光线充足时使用摄像头拍摄前景图像，当光线比较暗时使用红外灯光线与红外摄像头配合拍摄前景图像。
根据本发明的再一个方面，还提供了一种手持终端，该手持终端包括上述屏幕防抖装置。
本发明实施例的手持终端及其屏幕防抖方法和装置，通过引入人脸识别技术，计算人脸(人眼)与屏幕间的真实相对位移，并将人脸与屏幕间的真实相对位移考虑在屏幕补偿内，以使终端在一定的位移范围内，根据位移参数对屏幕上显示的人机界面进行同步运动位移补偿，尽可能使人机界面相对于人脸保持静止，提高用户观看屏幕的稳定性，从而提高用户阅读体验。
附图说明
图1为本发明实施例提供的一种屏幕防抖方法的流程图；
图2为本发明优选实施例提供的另一种屏幕防抖方法的流程图；
图3为本发明实施例提供的一种屏幕防抖装置的模块结构示意图。
具体实施方式
为了使本发明所要解决的技术问题、技术方案及有益效果更加清楚、明白，以下结合附图和实施例，对本发明进行进一步详细说明。应当理解，此处所描述的具体实施例仅仅用以解释本发明，并不用于限定本发明。
实施例一
如图1所示为本发明实施例提供的一种手持终端的屏幕防抖方法，该方法包括：
S101、当手持终端屏幕点亮时，开启运动传感器监测手持终端的运动状态。
其中，运动传感器可以为加速度传感器或陀螺仪。
S102、判断是否检测到手持终端抖动，如果是，则执行步骤S103，否则继续监测。
具体来说，抖动是指屏幕的中心点相对于人机界面的中心点在横向或者纵向的位移大于1毫米小于屏幕尺寸的宽或者长的50％，也就是说，本发明的补偿位移在一定位移范围内进行，最大位移取决于屏幕大小(如手机与平板屏幕大小不同)，优选于能看到人机界面的一半，否则位移太大同步点超出屏幕范围也意义不大。换句话说，当屏幕的中心点相对于人机界面的中心点在横向或者纵向的位移在预设范围内时，则判定手持终端发生了抖动。
S103、启动摄像头摄像并进行人脸识别，计算人脸相对于屏幕的位移参数。
优选地，计算人脸相对于屏幕的位移参数包括：计算人脸相对于显示屏幕的横向位移和纵向位移、以及人脸与屏幕的距离和位移加速度。
具体的，通过摄像头拍摄前景图像，当光线充足时使用摄像头拍摄，当光线比较暗时使用红外灯光线与红外摄像头配合拍摄，对拍摄的图像进行人脸识别(人脸识别技术可以采用现有的技术，这里不详细描述)。但不是单纯的靠图像识别技术来判断位移，而是以运动传感器数据为基础数据，进一步结合图像识别技术，这样可以让位移判断更快更准确。举例来说，先根据运动传感器来获取初步的运动数据，然后通过画面内容的对比(比如通过运动前后人脸在图像中的位置变化是向上，向下或哪个方向的位置变化)，以运动传感器数据为基础，进一步通过图像识别位移来修正与调节，通过两个数据的结合来计算输出最终人机界面的横向位移和纵向位移(即补偿数据量)，以便后继当位移距离在预设的范围内时，对人机界面相对于终端位移的方向进行反向位移补偿。还可 以计算人脸与屏幕的距离和位移加速度，以便后继放大或者缩小人机界面，尽可能使图像显示相对人脸与人眼处于相对静止。
S104、根据位移参数对屏幕上显示的人机界面进行补偿。
优选地，本步骤S104进一步包括：根据横向位移和纵向位移，将屏幕上显示的人机界面相对于终端的移动方向进行反向补偿；根据人脸与屏幕的距离和加速度放大或缩小人机界面。具体地，手持终端没有抖动的情况下，人机界面位于显示屏的中央。
当手持终端向右平行于人脸抖动，并产生位移时，人机界面向显示屏的左侧移动，具体移动幅度根据手持终端的位移来定。
当手持终端向左平行于人脸抖动，人机界面向显示屏的右侧移动，具体移动幅度根据手持终端的位移来定。
当手持终端向下平行于人脸抖动，并产生位移时，人机界面向显示屏的上侧移动，具体移动幅度根据手持终端的位移来定。
当手持终端向左上平行于人脸抖动，并产生位移时，人机界面向显示屏的左下侧移动，具体移动幅度根据手持终端的位移来定。
当手持终端远离或接近人脸，人机界面将呈现放大或缩小状态，具体放大或缩小比例和加速度成正比。具体来说，根据距离变化值与位移加速度变化值来计算输出缩小或放大的变化系数，具体的缩小或放大系数(如10％，15％或者20％)可以通过实验来给出，使缩放后人机界面大小与原有初始状态人机界面大小始终尽量相同。比如，后退1cm,从视觉角度因距离变远而使界面与字体变小，根据后退1cm的变化量给出一个放大系数(比如界面放大10％)，从而使退后1cm位移前后，相对人眼人机界面好像没有变化与静止的。
本发明实施例的手持终端的屏幕防抖方法和装置，通过引入人脸识别技术，计算人脸(人眼)与屏幕间的真实相对位移，并将人脸与屏幕间的真实相对位移考虑在屏幕补偿内，以使终端在一定的位移范围内，根据位移参数对屏幕上显示的人机界面进行同步位移补偿，尽可能使人机界面相对于人脸保持静止，提高观看屏幕的稳定性,从而提高用户阅读体验。
实施例二
如图2所示为本发明优选实施例提供的一种手持终端的屏幕防抖方法，该方法包括：
S201、当手持终端屏幕点亮时，开启运动传感器监测手持终端的运动状态。
其中，运动传感器可以为加速度传感器或陀螺仪，运动传感器检测手持终端的抖动参数，抖动参数包括抖动方向、抖动加速度、抖动位移。抖动方向可以包括在手持终端屏幕坐标系的三个维度，抖动位移和抖动加速度也对应包括在这三个维度方向上的位移幅度和抖动加速度。
S202、判断是否检测到手持终端抖动，如果是，则执行步骤S203，否则继续监测。
具体地，当检测到抖动时，将抖动参数发送给显示处理器，当检测到没有抖动时，按正常模式执行显示，同时继续监测是否抖动。
S203、根据运动传感器的抖动参数对屏幕显示位置相对于手持终端运动方向进行相反补偿。
优选地，根据屏幕坐标系的三个维度上的加速度确定所述屏幕坐标系三个维度上的抖动方向和幅度；根据所述在屏幕坐标系三个维度上的抖动方向和幅度对屏幕显示位置进行平移或者缩放。
具体地，屏幕显示位置是相对于手机显示屏(即手机边框之间的物理部分)而言的，一般默认全屏显示，而人机界面是显示的画面相对于屏幕而言的，一般也默认为画面充满屏幕。如果手持终端抖动时，首先根据运动传感器的抖动参数对屏幕显示位置相对于手持终端相反运动方向进行位移补偿，从而补偿手持终端本身的抖动，尽量使屏幕尽量保持相对静止，然后进一步在屏幕中补偿人机界面。
S204、启动摄像头摄像并进行人脸识别，计算人脸相对于屏幕的位移参数。
本步骤S204同上述实施例一的步骤S103，这里不再重述。
S205、根据位移参数对屏幕上显示的人机界面进行补偿。
本步骤S205同上述实施例一的步骤S104，这里不再重述。
本发明实施例的手持终端的屏幕防抖方法，在利用手持终端内传感器针对手持终端的抖动对显示屏幕进行位移补偿的基础上，引入人脸识别技术计算人脸相对屏幕的晃动位移，并对人机界面进一步补偿位移，通过双重补偿的稳定 性效果更好。
综上所述可知，现有技术中，通常是对摄录模块内部的元器件位置进行补偿。而本发明则是对人机界面进行补偿，主要包括两种补偿方式：第一，根据横向位移和纵向位移，将屏幕上显示的人机界面相对于终端的移动方向进行反向补偿；第二，根据人脸与屏幕的距离和加速度放大或缩小人机界面。从而，尽可能使人机界面相对于人脸保持静止，提高观看屏幕的稳定性。
实施例三
如图3所示为本发明实施例提供的一种手持终端的屏幕防抖装置，该装置包括：
运动监测模块10，设置为当手持终端屏幕点亮时，开启运动传感器监测手持终端的运动状态；
人脸识别模块20，设置为当检测到手持终端抖动时，启动摄像头摄像并进行人脸识别，计算人脸相对于屏幕的位移参数；
优选地，人脸识别模块20具体设置为：启动摄像头摄像并进行人脸识别，计算人脸相对于显示屏幕的横向位移和纵向位移、以及人脸与屏幕的距离和位移加速度。
显示处理模块30，设置为根据位移参数对屏幕上显示的人机界面进行补偿。
优选地，显示处理模块30具体设置为：根据横向位移和纵向位移，将屏幕上显示的人机界面进行反向补偿；根据人脸与屏幕的距离和位移加速度进行放大或缩小人机界面。
作为本实施例的另一种优选方案，显示处理模块30还设置为：根据运动传感器的抖动参数对屏幕显示位置相对于手持终端运动方向进行相反补偿以使显示屏幕相对静止。具体来说，可以根据屏幕坐标系的三个维度上的加速度确定所述屏幕坐标系三个维度上的抖动方向和幅度；根据所述在屏幕坐标系三个维度上的抖动方向和幅度对屏幕显示位置进行平移或者缩放。
需要说明的是，上述方法实施例一和实施例二中的技术特征在本装置均能对应适用，这里不再重述。
相应地，本发明实施例还提供了一种手持终端，该手持终端中包括上述屏幕防抖装置。手持终端包括但不限于手机、IPAD、平板电脑。
本发明实施例的手持终端及其屏幕防抖装置，通过引入人脸识别技术，将人脸相对于屏幕的真实位移考虑在屏幕补偿内，以使终端在一定的位移范围内，根据位移参数对屏幕上显示的人机界面进行同步位移补偿，尽可能使人机界面相对于人脸保持静止，提高观看屏幕的稳定性，从而提高用户体验。
以上参照附图说明了本发明的优选实施例，并非因此局限本发明的权利范围。本领域技术人员不脱离本发明的范围和实质内所作的任何修改、等同替换和改进，均应在本发明的权利范围之内。
工业实用性
本发明实施例的手持终端及其屏幕防抖方法和装置，通过引入人脸识别技术，计算人脸(人眼)与屏幕间的真实相对位移，并将人脸与屏幕间的真实相对位移考虑在屏幕补偿内，使得终端可以在一定的位移范围内，根据位移参数对屏幕上显示的人机界面进行同步运动位移补偿，尽可能使人机界面相对于人脸保持静止，提高了用户观看屏幕的稳定性，提高了用户的阅读体验。

Claims (20)

  1. 一种手持终端的屏幕防抖方法，包括：
    当手持终端的屏幕点亮时，开启运动传感器监测手持终端的运动状态；
    如果检测到手持终端抖动，则启动摄像头摄像并进行人脸识别，计算人脸相对于屏幕的位移参数；
    根据所述位移参数对屏幕上显示的人机界面进行反向补偿，以使所述人机界面相对人脸相对静止。
  2. 根据权利要求1所述的屏幕防抖方法，其中，所述计算人脸相对于屏幕的位移参数进一步包括：计算人脸相对于显示屏幕的横向位移和纵向位移、以及人脸与屏幕的距离和位移加速度。
  3. 根据权利要求2所述的屏幕防抖方法，其中，根据所述位移参数对屏幕上显示的人机界面进行补偿进一步包括：
    根据所述横向位移和纵向位移，将屏幕上显示的人机界面相对于终端位移的方向进行反向补偿；
    根据所述人脸与屏幕的距离和位移加速度进行放大或缩小所述人机界面。
  4. 根据权利要求1所述的屏幕防抖方法，其中，所述启动摄像头摄像进行人脸识别之前还包括：
    根据运动传感器的抖动参数对屏幕显示位置相对于手持终端运动方向进行相反补偿。
  5. 根据权利要求4所述的屏幕防抖方法，其中，所述抖动参数包括抖动方向、抖动加速度和抖动位移。
  6. 根据权利要求4所述的屏幕防抖方法，其中，所述根据运动传感器的抖动参数对屏幕显示位置相对于手持终端运动方向进行相反补偿进一步包括：
    根据屏幕坐标系的三个维度上的加速度确定所述屏幕坐标系三个维度上的抖动方向和幅度；根据所述在屏幕坐标系三个维度上的抖动方向和幅度对屏幕显示位置进行平移或者缩放。
  7. 根据权利要求1所述的屏幕防抖方法，其中，所述方法还包括：
    当所述屏幕的中心点相对于人机界面的中心点在横向或者纵向的位移在预 设范围内时，则判定手持终端发生了抖动。
  8. 根据权利要求1所述的屏幕防抖方法，其中，所述计算人脸相对于屏幕的位移参数进一步包括：
    通过运动传感器获取初步的运动数据；
    通过摄像头拍摄前景图像，对拍摄的图像进行人脸识别；
    通过图像识别位移对所述运动数据进行修正与调节，获取位移参数。
  9. 根据权利要求8所述的屏幕防抖方法，其中，所述通过摄像头拍摄前景图像进一步包括：当光线充足时使用摄像头拍摄前景图像，当光线比较暗时使用红外灯光线与红外摄像头配合拍摄前景图像。
  10. 一种手持终端的屏幕防抖装置，包括：
    运动监测模块，设置为当手持终端的屏幕点亮时，开启运动传感器监测手持终端的运动状态；
    人脸识别模块，设置为当检测到手持终端抖动时，启动摄像头摄像并进行人脸识别，计算人脸相对于屏幕的位移参数；
    显示处理模块，设置为根据所述位移参数对屏幕上显示的人机界面进行反向补偿，以使所述人机界面相对人脸相对静止。
  11. 根据权利要求10所述的屏幕防抖装置，其中，所述人脸识别模块设置为：启动摄像头摄像并进行人脸识别，计算人脸相对于显示屏幕的横向位移和纵向位移、以及人脸与屏幕的距离和位移加速度。
  12. 根据权利要求11所述的屏幕防抖装置，其中，所述显示处理模块设置为：根据横向位移和纵向位移，将屏幕上显示的人机界面相对于终端位移的方向进行反向补偿；根据所述人脸与屏幕的距离和位移加速度进行放大或缩小所述人机界面。
  13. 根据权利要求10所述的屏幕防抖装置，其中，所述显示处理模块还设置为：根据运动传感器的抖动参数对屏幕显示位置相对于手持终端运动方向进行相反补偿。
  14. 根据权利要求13所述的屏幕防抖装置，其中，所述显示处理模块设置为：
    根据屏幕坐标系的三个维度上的加速度确定所述屏幕坐标系三个维度上的 抖动方向和幅度；根据所述在屏幕坐标系三个维度上的抖动方向和幅度对屏幕显示位置进行平移或者缩放。
  15. 根据权利要求10所述的屏幕防抖装置，其中，所述运动监测模块设置为：当所述屏幕的中心点相对于人机界面的中心点在横向或者纵向的位移在预设范围内时，则判定手持终端发生了抖动。
  16. 根据权利要求10所述的屏幕防抖装置，其中，所述人脸识别模块设置为：
    通过所述运动传感器获取初步的运动数据；
    通过摄像头拍摄前景图像，对拍摄的图像进行人脸识别；
    通过图像识别位移对所述运动数据进行修正与调节，获取位移参数。
  17. 根据权利要求16所述的屏幕防抖装置，其中，所述人脸识别模块设置为：当光线充足时使用摄像头拍摄前景图像，当光线比较暗时使用红外灯光线与红外摄像头配合拍摄前景图像。
  18. 一种手持终端，包括一屏幕防抖装置，所述屏幕防抖装置包括：
    运动监测模块，设置为当手持终端的屏幕点亮时，开启运动传感器监测手持终端的运动状态；
    人脸识别模块，设置为当检测到手持终端抖动时，启动摄像头摄像并进行人脸识别，计算人脸相对于屏幕的位移参数；
    显示处理模块，设置为根据所述位移参数对屏幕上显示的人机界面进行补偿。
  19. 根据权利要求18所述的手持终端，其中，所述人脸识别模块设置为：启动摄像头摄像并进行人脸识别，计算人脸相对于显示屏幕的横向位移和纵向位移、以及人脸与屏幕的距离和位移加速度。
  20. 根据权利要求19所述的手持终端，其中，所述显示处理模块设置为：根据横向位移和纵向位移，将屏幕上显示的人机界面相对于终端位移的方向进行反向补偿；根据所述人脸与屏幕的距离和位移加速度进行放大或缩小所述人机界面。
PCT/CN2015/074008 2014-03-14 2015-03-11 一种手持终端及其屏幕防抖方法和装置 Ceased WO2015135477A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410095914.0 2014-03-14
CN201410095914.0A CN103885593B (zh) 2014-03-14 2014-03-14 一种手持终端及其屏幕防抖方法和装置

Publications (1)

Publication Number Publication Date
WO2015135477A1 true WO2015135477A1 (zh) 2015-09-17

Family

ID=50954527

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/074008 Ceased WO2015135477A1 (zh) 2014-03-14 2015-03-11 一种手持终端及其屏幕防抖方法和装置

Country Status (2)

Country Link
CN (1) CN103885593B (zh)
WO (1) WO2015135477A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112164160A (zh) * 2020-09-27 2021-01-01 重庆宇虹自动化仪表系统有限公司 唤醒式人脸识别控制器及其使用方法
CN113034069A (zh) * 2019-12-25 2021-06-25 菜鸟智能物流控股有限公司 一种物流对象的处理方法及物流管理设备

Families Citing this family (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103885593B (zh) * 2014-03-14 2016-04-06 努比亚技术有限公司 一种手持终端及其屏幕防抖方法和装置
CN105320254A (zh) * 2014-07-25 2016-02-10 腾讯科技（深圳）有限公司 移动终端显示控制方法及装置
CN104320545B (zh) * 2014-11-14 2019-03-12 陕西亚成微电子股份有限公司 一种手机屏幕防抖方法
CN104461289B (zh) * 2014-11-28 2018-09-11 广东欧珀移动通信有限公司 终端及其屏幕显示方法和装置
CN104333665A (zh) * 2014-12-02 2015-02-04 上海斐讯数据通信技术有限公司 一种移动终端及其显示调节方法
CN106293417A (zh) * 2015-06-08 2017-01-04 中兴通讯股份有限公司 屏幕画面显示方法及装置
CN106371552B (zh) * 2015-07-22 2021-04-16 腾讯科技（深圳）有限公司 一种在移动终端进行媒体展示的控制方法及装置
CN106648344B (zh) * 2015-11-02 2019-03-01 重庆邮电大学 一种屏幕内容调整方法及其设备
WO2017005070A1 (zh) 2015-07-09 2017-01-12 重庆邮电大学 显示控制方法及装置
US10503317B2 (en) * 2016-02-09 2019-12-10 The Boeing Company Turbulence resistant touch system
CN105931182B (zh) * 2016-04-15 2019-12-10 惠州Tcl移动通信有限公司 一种图像的缩放方法及系统
CN106126006A (zh) * 2016-06-14 2016-11-16 珠海市魅族科技有限公司 一种数据显示方法及装置
CN107515709B (zh) * 2016-06-16 2021-09-10 苏宁易购集团股份有限公司 一种屏幕显示方法及装置
CN106648387A (zh) * 2016-11-16 2017-05-10 深圳天珑无线科技有限公司 具有拍摄功能的终端及其防抖显示方法
US20190267145A1 (en) * 2016-11-22 2019-08-29 Mitsubishi Electric Corporation Incore neutron instrumentation system
CN107707738A (zh) 2017-09-07 2018-02-16 维沃移动通信有限公司 一种人脸识别方法及移动终端
CN108491138A (zh) * 2018-01-16 2018-09-04 华南理工大学 一种基于多传感器融合的移动屏幕自适应调整方法
CN113645502B (zh) * 2020-04-27 2022-09-16 海信视像科技股份有限公司 一种动态调整控件的方法及显示设备
CN112788233B (zh) * 2020-12-30 2023-05-23 维沃移动通信有限公司 视频拍摄处理方法和电子设备
CN113485662A (zh) * 2021-07-06 2021-10-08 维沃移动通信有限公司 防抖方法和电子设备
CN114511725B (zh) * 2022-02-11 2026-05-05 广州虎牙科技有限公司 一种人脸图像的防抖方法、装置、设备及可读存储介质
CN117041414B (zh) * 2023-08-24 2026-03-17 Tcl通讯科技（成都）有限公司 画面抖动补偿方法、装置、电子设备及计算机存储介质
CN117672110B (zh) * 2023-12-15 2024-07-09 广东省欧度利方科技有限公司 一种平板电脑显示控制系统与方法
CN117524073B (zh) * 2024-01-08 2024-04-12 深圳蓝普视讯科技有限公司 一种超高清图像显示抖动补偿方法、系统及存储介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101031033A (zh) * 2006-03-03 2007-09-05 奥林巴斯映像株式会社 摄像装置以及摄像方法
CN101212570A (zh) * 2006-12-25 2008-07-02 鸿富锦精密工业（深圳）有限公司 可拍照移动通讯终端
CN101300831A (zh) * 2005-11-04 2008-11-05 诺基亚公司 图像稳定的数码成像
CN103885593A (zh) * 2014-03-14 2014-06-25 深圳市中兴移动通信有限公司 一种手持终端及其屏幕防抖方法和装置

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101662582A (zh) * 2009-09-08 2010-03-03 长春理工大学 一种机载成像设备图像抖动补偿方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101300831A (zh) * 2005-11-04 2008-11-05 诺基亚公司 图像稳定的数码成像
CN101031033A (zh) * 2006-03-03 2007-09-05 奥林巴斯映像株式会社 摄像装置以及摄像方法
CN101212570A (zh) * 2006-12-25 2008-07-02 鸿富锦精密工业（深圳）有限公司 可拍照移动通讯终端
CN103885593A (zh) * 2014-03-14 2014-06-25 深圳市中兴移动通信有限公司 一种手持终端及其屏幕防抖方法和装置

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113034069A (zh) * 2019-12-25 2021-06-25 菜鸟智能物流控股有限公司 一种物流对象的处理方法及物流管理设备
CN112164160A (zh) * 2020-09-27 2021-01-01 重庆宇虹自动化仪表系统有限公司 唤醒式人脸识别控制器及其使用方法

Also Published As

Publication number Publication date
CN103885593B (zh) 2016-04-06
CN103885593A (zh) 2014-06-25

Similar Documents

Publication Publication Date Title
CN103885593B (zh) 一种手持终端及其屏幕防抖方法和装置
US9019387B2 (en) Imaging device and method of obtaining image
RU2624569C2 (ru) Способ и устройство для отображения изображения
CN108881703B (zh) 防抖控制方法和装置
EP3544286B1 (en) Focusing method, device and storage medium
WO2018072353A1 (zh) 获取图像的方法和终端设备
CN103763483A (zh) 一种移动终端拍照防抖方法、装置以及移动终端
CN106909221A (zh) 基于vr系统的图像处理方法及装置
CN103685956A (zh) 一种全景照片拍摄方法及装置
TW200928860A (en) Method and device for adjusting output frame
US10956733B2 (en) Image processing apparatus and image processing method
US20080174663A1 (en) Electric hand-vibration correction method, electric hand-vibration correction device, electric hand-vibration correction program, and imaging apparatus
CN113824876B (zh) 数字变焦下画面稳定性处理方法、装置、移动终端及介质
JP2011138449A (ja) 表示制御装置、表示装置、電子装置および表示制御方法
CN103152522A (zh) 调整拍摄位置的方法及其终端
CN105681626A (zh) 检测方法、控制方法、检测装置、控制装置及电子装置
CN103002244B (zh) 一种交互式视频通话的方法和通话终端
WO2016197639A1 (zh) 屏幕画面显示方法及装置
US20150288949A1 (en) Image generating apparatus, imaging apparatus, and image generating method
WO2017005070A1 (zh) 显示控制方法及装置
CN106303249A (zh) 视频防抖方法和设备
US20130050427A1 (en) Method and apparatus for capturing three-dimensional image and apparatus for displaying three-dimensional image
CN104679483A (zh) 一种界面调整方法及移动设备
CN104166500A (zh) 镜头图像中提供参考坐标系的方法、系统及终端
JP2013201688A (ja) 画像処理装置、画像処理方法および画像処理プログラム

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15762340

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 08/02/17)

122 Ep: pct application non-entry in european phase

Ref document number: 15762340

Country of ref document: EP

Kind code of ref document: A1