WO2019090592A1 - Intelligent terminal-based camera shake prevention method and system - Google Patents

Intelligent terminal-based camera shake prevention method and system Download PDF

Info

Publication number
WO2019090592A1
WO2019090592A1 PCT/CN2017/110171 CN2017110171W WO2019090592A1 WO 2019090592 A1 WO2019090592 A1 WO 2019090592A1 CN 2017110171 W CN2017110171 W CN 2017110171W WO 2019090592 A1 WO2019090592 A1 WO 2019090592A1
Authority
WO
WIPO (PCT)
Prior art keywords
displacement
smart terminal
frame rate
displacement amount
operation instruction
Prior art date
Application number
PCT/CN2017/110171
Other languages
French (fr)
Chinese (zh)
Inventor
池文羽
Original Assignee
深圳传音通讯有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳传音通讯有限公司 filed Critical 深圳传音通讯有限公司
Priority to PCT/CN2017/110171 priority Critical patent/WO2019090592A1/en
Publication of WO2019090592A1 publication Critical patent/WO2019090592A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/75Circuitry for compensating brightness variation in the scene by influencing optical camera components
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/725Cordless telephones

Abstract

An intelligent terminal-based camera shake prevention method and system, comprising the following steps: capturing an operation instruction; capturing at least one target image according to the operation instruction; monitoring the displacement direction of an intelligent terminal and the displacement amount in the displacement direction during the execution of the operation instruction; comparing the displacement amount to a displacement threshold; when the displacement amount is greater than the displacement threshold, reducing the frame rate of the intelligent terminal; and displaying a clear image in a display interface of the intelligent terminal. By means of monitoring the voltage output values of an acceleration sensor of an intelligent terminal in various directions during an image capturing process, the displacement amount of the intelligent terminal is determined, and the frame rate of the intelligent terminal is adjusted according to the displacement amount, so that the intelligent terminal may display a clear image.

Description

一种基于智能终端的相机防抖方法及相机防抖系统Camera anti-shake method based on intelligent terminal and camera anti-shake system 技术领域Technical field
本发明涉及相机防抖技术领域,尤其涉及一种基于智能终端的相机防抖方法及相机防抖系统。The present invention relates to the field of camera anti-shake technology, and in particular, to a camera anti-shake method based on a smart terminal and a camera anti-shake system.
背景技术Background technique
随着科技的发展和进步,智能终端的发展也是日新月异。当前,智能终端因其便利性和功能性,已经逐渐渗入到人们生活的方方面面,成为人们生活中不可或缺的辅助设备。特别是,智能终端照相技术的发展,使得智能终端逐渐替代传统的照相设备,成为人们出门旅游的主要照相或者摄影工具。With the development and advancement of technology, the development of intelligent terminals is also changing with each passing day. At present, because of its convenience and functionality, smart terminals have gradually penetrated into all aspects of people's lives and become an indispensable auxiliary equipment in people's lives. In particular, the development of smart terminal camera technology has enabled smart terminals to gradually replace traditional camera equipment and become the main camera or photography tool for people to travel.
但是,现有技术中,由于智能终端自身轻薄化的发展,其摄像设备仍存在部分缺陷无法克服,如抖动对拍摄图像清晰度的影响。目前,常用的图像稳定系统分为两种,纯机械式的图像稳定系统和电控图像稳定系统。纯机械的图像稳定系统,主要通过弹簧、阻尼器、万向节等机械结构配合相机支架的大惯量来实现图像稳定,这是一种比较传统的图像稳定设备,叫斯坦尼康;电控图像稳定系统,也就是我们常说的云台,原理上是利用陀螺仪和加速度计等传感器作为姿态反馈,无刷电机作为输出装置,构成闭环反馈系统来实现图像稳定的。However, in the prior art, due to the development of the smart terminal itself, the imaging device still has some defects that cannot be overcome, such as the influence of jitter on the sharpness of the captured image. At present, the commonly used image stabilization systems are divided into two types, a purely mechanical image stabilization system and an electronically controlled image stabilization system. The purely mechanical image stabilization system mainly achieves image stabilization by mechanical structures such as springs, dampers, and universal joints with the camera inertia. This is a relatively traditional image stabilization device called Steadicam; electronically controlled image stabilization The system, which is often referred to as the gimbal, is based on the use of sensors such as gyroscopes and accelerometers as attitude feedback, and the brushless motor as an output device to form a closed-loop feedback system to achieve image stabilization.
但上述防抖技术对智能终端的硬件要求较高,与智能终端轻薄化的发展背道而驰,不能根本解决智能终端的摄像防抖问题。However, the above-mentioned anti-shake technology has high requirements on the hardware of the intelligent terminal, and runs counter to the development of the slimming of the smart terminal, and cannot fundamentally solve the problem of camera anti-shake of the smart terminal.
发明内容Summary of the invention
针对上述问题,本发明提出一种基于智能终端的相机防抖方法和相机防抖系统系统。本发明通过监测智能终端在图像拍摄过程中,其加速度传感器在各方向上的电压输出值,确定智能终端的位移量,根据该位移量调节智能终端的帧率,从而,可使智能终端显示一清晰的图像。In view of the above problems, the present invention provides a camera anti-shake method and a camera anti-shake system system based on a smart terminal. The invention determines the displacement amount of the intelligent terminal by monitoring the voltage output value of the acceleration sensor in each direction during the image capturing process of the intelligent terminal, and adjusts the frame rate of the intelligent terminal according to the displacement amount, thereby enabling the smart terminal to display one Clear image.
具体地,本发明一方面在于,提供一种基于智能终端的相机防抖的方法,其包括以下步骤:捕获一操作指令,根据所述操作指令捕获至少一目标图像,监测在执行所述操 作指令期间,所述智能终端的位移方向以及在所述位移方向上的位移量,将所述位移量与一位移阈值进行比较,当所述位移量大于所述位移阈值时,降低所述智能终端的帧率,在所述智能终端的显示界面上显示一清晰图像。Specifically, an aspect of the present invention provides a method for camera anti-shake based on a smart terminal, which includes the steps of: capturing an operation instruction, capturing at least one target image according to the operation instruction, and monitoring performing the operation During the instruction, the displacement direction of the smart terminal and the displacement amount in the displacement direction compare the displacement amount with a displacement threshold, and when the displacement amount is greater than the displacement threshold, reduce the intelligence The frame rate of the terminal displays a clear image on the display interface of the smart terminal.
优选地,监测在执行所述操作指令期间,所述智能终端的位移方向以及在所述位移方向上的位移量的步骤包括,监测在执行所述操作指令期间,所述智能终端的加速度传感器x、y、z方向上分别输出的电压值,根据所述电压值计算获得所述智能终端的位移方向,以及在所述位移方向上的位移量数值。Preferably, the step of monitoring a displacement direction of the smart terminal and a displacement amount in the displacement direction during execution of the operation instruction includes monitoring an acceleration sensor x of the smart terminal during execution of the operation instruction The voltage values respectively output in the y and z directions are calculated according to the voltage values, and the displacement direction of the smart terminal and the displacement amount value in the displacement direction are obtained.
具体地,当所述位移量大于所述位移阈值时,降低所述智能终端的帧率的步骤包括,预先在所述智能终端中存储一位移量-帧率数据表,当所述位移量大于所述位移阈值时,计算所述位移量与所述位移阈值的差值,根据所述差值,在所述位移量-帧率数据表中进行检索,获得一对应所述差值的调整帧率,根据所述调整帧率,降低所述智能终端的帧率。Specifically, when the displacement amount is greater than the displacement threshold, the step of reducing a frame rate of the smart terminal includes: pre-storing a displacement amount-frame rate data table in the smart terminal, when the displacement amount is greater than And calculating, by the displacement threshold, a difference between the displacement amount and the displacement threshold, and performing a search in the displacement amount-frame rate data table according to the difference, to obtain an adjustment frame corresponding to the difference Rate, according to the adjusted frame rate, reducing the frame rate of the smart terminal.
优选地,上述方法还包括,分别监测所述智能终端获得每一帧图像期间的位移方向及在所述位移方向上的位移量,并将所述位移方向及所述位移量与所述每一帧图像相关联,缓存于所智能终端中,当所述智能终端捕获一完整图像后,比较所述每一帧图像的所述位移量,获得一最大位移量,将所述最大位移量与一位移阈值进行比较,当所述最大位移大于所述位移阈值时,降低所述智能终端的帧率,在所述智能终端的显示界面上显示一清晰图像。Preferably, the method further includes separately monitoring, by the smart terminal, a displacement direction during each frame image and a displacement amount in the displacement direction, and the displacement direction and the displacement amount are each The frame image is associated and cached in the smart terminal. After the smart terminal captures a complete image, the displacement amount of each frame image is compared to obtain a maximum displacement amount, and the maximum displacement amount is The displacement threshold is compared. When the maximum displacement is greater than the displacement threshold, the frame rate of the smart terminal is decreased, and a clear image is displayed on the display interface of the smart terminal.
优选地,在所述智能终端的显示界面上显示一清晰图像的步骤包括,所述智能终端根据降低后的所述帧率,生成一显示指令,所述智能终端根据所述显示指令调节所述智能终端的显示速率,在所述智能终端的显示界面上显示一清晰图像。Preferably, the step of displaying a clear image on the display interface of the smart terminal comprises: the smart terminal generating a display instruction according to the reduced frame rate, wherein the smart terminal adjusts the according to the display instruction The display rate of the smart terminal displays a clear image on the display interface of the smart terminal.
本发明另一方面,在于提供一种基于智能终端的相机防抖系统,其包括以下模块,第一指令模块,捕获一操作指令,摄像模块,根据所述操作指令捕获至少一目标图像,第一位移监测模块,监测在执行所述操作指令期间,所述智能终端的位移方向以及在所述位移方向上的位移量,第一阈值模块,将所述位移量与一位移阈值进行比较,当所述位移量大于所述位移阈值时,生成一第一操作指令,向外发送,调节模块,根据所述第一操作指令,降低所述智能终端的相机的帧率,显示模块,在所述智能终端的显示界面上显示一清晰图像。Another aspect of the present invention provides a camera-based image stabilization system based on a smart terminal, comprising: a first instruction module that captures an operation instruction, and a camera module that captures at least one target image according to the operation instruction, first a displacement monitoring module, configured to monitor a displacement direction of the smart terminal and a displacement amount in the displacement direction during execution of the operation instruction, and the first threshold module compares the displacement amount with a displacement threshold When the displacement amount is greater than the displacement threshold, a first operation instruction is generated, and is sent out, and the adjustment module is configured to reduce a frame rate of the camera of the smart terminal according to the first operation instruction, and the display module is in the smart A clear image is displayed on the display interface of the terminal.
优选地,所述第一位移监测模块包括,监测单元,监测在执行所述操作指令期间,所述智能终端的加速度传感器x、y、z方向上分别输出的电压值,第一数据处理单元,根据所述电压值计算获得所述智能终端的位移方向,以及在所述位移方向上的位移量数 值。Preferably, the first displacement monitoring module includes a monitoring unit that monitors voltage values respectively outputted by the acceleration sensors in the x, y, and z directions of the smart terminal during execution of the operation instruction, and the first data processing unit, Obtaining a displacement direction of the smart terminal according to the voltage value, and a displacement amount in the displacement direction value.
优选地,所述调整模块包括,第二数据处理单元,接收所述第一操作指令,计算所述位移量与所述位移阈值的差值,检索单元,根据所述差值,在所述位移量-帧率数据表中进行检索,获得一对应所述差值的调整帧率,调整单元,根据所述调整帧率,降低所述智能终端的帧率。Preferably, the adjustment module includes: a second data processing unit, receiving the first operation instruction, calculating a difference between the displacement amount and the displacement threshold, and a retrieval unit, according to the difference, in the displacement The quantity-frame rate data table performs a search to obtain an adjusted frame rate corresponding to the difference, and the adjusting unit reduces the frame rate of the smart terminal according to the adjusted frame rate.
优选地,上述相机防抖系统还包括,第二位移监测模块,分别监测所述智能终端获得每一帧图像期间的位移方向及在所述位移方向上的位移量,缓存模块,并将所述位移方向及所述位移量与所述每一帧图像相关联,缓存于所智能终端中,筛选模块,当所述智能终端捕获一完整图像后,比较所述每一帧图像的所述位移量,获得一最大位移量,第二阈值模块,将所述最大位移量与一位移阈值进行比较,当所述最大位移大于所述位移阈值时,生成一第二操作指令,所述智能终端的调整模块接收所述第二操作指令,并降低所述智能终端的相机的帧率。Preferably, the camera anti-shake system further includes a second displacement monitoring module that respectively monitors a displacement direction of the smart terminal during each frame image and a displacement amount in the displacement direction, a cache module, and the The displacement direction and the displacement amount are associated with the image of each frame, and are cached in the intelligent terminal, and the screening module compares the displacement amount of each frame image after the smart terminal captures a complete image. Obtaining a maximum displacement amount, the second threshold module, comparing the maximum displacement amount with a displacement threshold, and when the maximum displacement is greater than the displacement threshold, generating a second operation instruction, and adjusting the smart terminal The module receives the second operational command and reduces a frame rate of a camera of the smart terminal.
优选地,所述显示模块包括,指令单元,根据所述帧率,生成一显示指令,显示单元,根据所述显示指令,调节所述智能终端的显示速率,在所述智能终端的显示界面上显示一清晰图像。Preferably, the display module includes: an instruction unit, configured to generate a display instruction according to the frame rate, and the display unit adjusts a display rate of the smart terminal according to the display instruction, on a display interface of the smart terminal A clear image is displayed.
与现有技术相比较,本发明的技术优势在于:本发明提供一种基于智能终端的相机防抖系统,通过监测智能终端在图像拍摄过程中,其加速度传感器在各方向上的电压输出值,确定智能终端的位移量,根据该位移量调节智能终端的帧率,从而,可使智能终端显示一清晰的图像;另外,对于拍摄视频文件的情况,本发明可通过监测并缓存每帧图像拍摄过程中智能终端的位移情况,并根据最大位移量的情况调节智能终端的帧率,一方面减少了智能终端的工作量,同时,保证显示视频的清晰度。Compared with the prior art, the technical advantage of the present invention is that the present invention provides a camera anti-shake system based on a smart terminal, which monitors the voltage output value of the acceleration sensor in various directions during the image capturing process by the smart terminal. Determining the displacement amount of the smart terminal, adjusting the frame rate of the smart terminal according to the displacement amount, thereby enabling the smart terminal to display a clear image; and, in the case of capturing a video file, the present invention can monitor and cache each frame image. In the process, the displacement of the intelligent terminal adjusts the frame rate of the intelligent terminal according to the maximum displacement amount, thereby reducing the workload of the intelligent terminal and ensuring the clarity of the displayed video.
附图说明DRAWINGS
图1为一符合本发明一优选实施例的基于智能终端的相机防抖的方法的流程示意图;1 is a schematic flow chart of a method for camera anti-shake based on a smart terminal according to a preferred embodiment of the present invention;
图2为一符合图1中一优选地监测在执行所述操作指令期间,所述智能终端的位移方向以及在所述位移方向上的位移量的步骤的流程示意图;2 is a flow chart showing a step of preferably monitoring the displacement direction of the smart terminal and the displacement amount in the displacement direction during execution of the operation command in FIG. 1;
图3为一符合图1中一优选地当所述位移量大于所述位移阈值时,降低所述智能终端的帧率的步骤的流程示意图;3 is a flow chart showing a step of reducing the frame rate of the smart terminal when the displacement amount is greater than the displacement threshold in FIG. 1;
图4为一符合图1中一优选地在所述智能终端的显示界面上显示一清晰图像的步骤的流程示意图;4 is a schematic flow chart showing a step of displaying a clear image on the display interface of the smart terminal in accordance with FIG. 1;
图5为符合本发明另一优选实施例的基于智能终端的相机防抖的方法; 5 is a smart terminal-based camera anti-shake method in accordance with another preferred embodiment of the present invention;
图6为一符合本发明一优选实施例的基于智能终端的相机防抖系统的结构图;6 is a structural diagram of a camera-based anti-shake system based on a smart terminal in accordance with a preferred embodiment of the present invention;
图7为符合本发明另一优选实施例的基于智能终端的相机防抖系统的结构图7 is a structural diagram of a camera-based anti-shake system based on a smart terminal according to another preferred embodiment of the present invention.
具体实施方式Detailed ways
下面结合附图及具体实施例,详细阐述本发明的优势。The advantages of the present invention are explained in detail below with reference to the accompanying drawings and specific embodiments.
这里将详细地对示例性实施例进行说明,其示例表示在附图中。下面的描述涉及附图时,除非另有表示,不同附图中的相同数字表示相同或相似的要素。以下示例性实施例中所描述的实施方式并不代表与本公开相一致的所有实施方式。相反,它们仅是与如所附权利要求书中所详述的、本公开的一些方面相一致的装置和方法的例子。Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. The following description refers to the same or similar elements in the different figures unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with aspects of the present disclosure as detailed in the appended claims.
在本公开使用的术语是仅仅出于描述特定实施例的目的,而非旨在限制本公开。在本公开和所附权利要求书中所使用的单数形式的“一种”、“所述”和“该”也旨在包括多数形式,除非上下文清楚地表示其他含义。还应当理解,本文中使用的术语“和/或”是指并包含一个或多个相关联的列出项目的任何或所有可能组合。The terms used in the present disclosure are for the purpose of describing particular embodiments only, and are not intended to limit the disclosure. The singular forms "a", "the" and "the" It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.
应当理解,尽管在本公开可能采用术语第一、第二、第三等来描述各种信息,但这些信息不应限于这些术语。这些术语仅用来将同一类型的信息彼此区分开。例如,在不脱离本公开范围的情况下,第一信息也可以被称为第二信息,类似地,第二信息也可以被称为第一信息。取决于语境,如在此所使用的词语“如果”可以被解释成为“在……时”或“当……时”或“响应于确定”It should be understood that although the terms first, second, third, etc. may be used in the present disclosure to describe various information, such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, the first information may also be referred to as second information without departing from the scope of the present disclosure. Similarly, the second information may also be referred to as first information. Depending on the context, the word "if" as used herein may be interpreted as "when" or "when" or "in response to determination"
在本发明的描述中,需要理解的是,术语“纵向”、“横向”、“上”、“下”、“前”、“后”、“左”、“右”、“竖直”、“水平”、“顶”、“底”“内”、“外”等指示的方位或位置关系为基于附图所示的方位或位置关系,仅是为了便于描述本发明和简化描述,而不是指示或暗示所指的装置或元件必须具有特定的方位、以特定的方位构造和操作,因此不能理解为对本发明的限制。In the description of the present invention, it is to be understood that the terms "longitudinal", "transverse", "upper", "lower", "front", "rear", "left", "right", "vertical", The orientation or positional relationship of the indications of "horizontal", "top", "bottom", "inside", "outside", etc. is based on the orientation or positional relationship shown in the drawings, only for the convenience of describing the present invention and simplifying the description, rather than It is to be understood that the device or elements referred to have a particular orientation, are constructed and operated in a particular orientation and are therefore not to be construed as limiting.
在本发明的描述中,除非另有规定和限定,需要说明的是,术语“安装”、“相连”、“连接”应做广义理解,例如,可以是机械连接或电连接,也可以是两个元件内部的连通,可以是直接相连,也可以通过中间媒介间接相连,对于本领域的普通技术人员而言,可以根据具体情况理解上述术语的具体含义。In the description of the present invention, unless otherwise specified and limited, it should be noted that the terms "mounted", "connected", and "connected" are to be understood broadly, and may be, for example, mechanical or electrical, or both. The internal communication of the components may be directly connected or indirectly connected through an intermediate medium. For those skilled in the art, the specific meanings of the above terms may be understood according to specific circumstances.
在后续的描述中,使用用于表示元件的诸如“模块”、“部件”或“单元”的后缀仅为了有利于本发明的说明,其本身并没有特定的意义。因此,“模块”与“部件”可以混合地使用。In the following description, the use of suffixes such as "module", "component" or "unit" for indicating an element is merely an explanation for facilitating the present invention, and does not have a specific meaning per se. Therefore, "module" and "component" can be used in combination.
目前,市场上的智能终端,常采用机械运动补偿的方法,即在镜头内的陀螺仪侦测到微小的移动,并且会将信号传至微处理器立即计算需要补偿的位移量,然后通过补偿 镜片组,根据镜头的抖动方向及位移量加以补偿,从而有效的克服因相机的振动产生的影像模糊。但是,上述方法一方面对智能终端的硬件要求高,提高了智能终端的制造成本;另一方面,对智能终端的位移补偿量有限,无法克服较大的抖动引起的影像模糊。At present, smart terminals on the market often use mechanical motion compensation, that is, the gyroscope in the lens detects a small movement, and the signal is transmitted to the microprocessor to immediately calculate the amount of displacement to be compensated, and then compensated. The lens group is compensated according to the direction of the lens's shaking and the amount of displacement, so as to effectively overcome the image blur caused by the vibration of the camera. However, on the one hand, the above method has high hardware requirements for the intelligent terminal, and improves the manufacturing cost of the intelligent terminal; on the other hand, the displacement compensation amount for the intelligent terminal is limited, and the image blur caused by the large jitter cannot be overcome.
对此,本发明提出一种基于智能终端的相机防抖的方法。具体地,参阅图1,其为一符合本发明一优选实施例的基于智能终端的相机防抖的方法的流程示意图。从图中可以看出,本实施例中,所提供的基于智能终端的相机防抖的方法主要包括以下步骤:In this regard, the present invention proposes a method of camera anti-shake based on a smart terminal. Specifically, referring to FIG. 1 , which is a schematic flowchart of a method for camera anti-shake based on a smart terminal according to a preferred embodiment of the present invention. As can be seen from the figure, in the embodiment, the provided smart camera-based camera anti-shake method mainly comprises the following steps:
-捕获一操作指令;- capturing an operational command;
-根据所述操作指令捕获至少一目标图像;- capturing at least one target image in accordance with the operational command;
-监测在执行所述操作指令期间,所述智能终端的位移方向以及在所述位移方向上的位移量;Monitoring a displacement direction of the smart terminal and a displacement amount in the displacement direction during execution of the operation command;
-将所述位移量与一位移阈值进行比较;- comparing the displacement amount with a displacement threshold;
-当所述位移量大于所述位移阈值时,降低所述智能终端的帧率;- reducing a frame rate of the smart terminal when the displacement amount is greater than the displacement threshold;
-在所述智能终端的显示界面上显示一清晰图像。- displaying a clear image on the display interface of the smart terminal.
具体地,采用本实施例中的方法,当用户通过触发所述智能终端显示界面上的图标,或者智能终端本体上的快捷按钮,对所述智能终端发出一操作指令时,所述智能终端接收所述操作指令,并根据所述操作指令的具体内容,如当前界面位置,触发手势的具体位置,触发手势的压力,触发手势的方向,触发手势的速度或频率等,确定所述操作指令所述包含的具体指令内容,从而,启动所述智能终端的摄像模块;Specifically, when the user sends an operation instruction to the smart terminal by triggering an icon on the display interface of the smart terminal or a shortcut button on the smart terminal body, the smart terminal receives the operation instruction in the embodiment. And the operation instruction is determined according to the specific content of the operation instruction, such as the current interface position, the specific position of the trigger gesture, the pressure of the trigger gesture, the direction of the trigger gesture, the speed or frequency of the trigger gesture, and the like. Describe the specific instruction content, thereby starting the camera module of the smart terminal;
所述智能终端的摄像模块进而捕获一包含目标对象的目标图像;The camera module of the smart terminal further captures a target image including the target object;
同时,所述智能终端的第一位移监测模块也可接收所述第一操作指令,并在所述智能终端接收所述第一操作指令的同时开始监测所述智能终端的位移方向,及在所述位移方向上的位移量,也即监测在执行所述操作指令期间,所述智能终端的位移方向以及在所述位移方向上的位移量。At the same time, the first displacement monitoring module of the smart terminal may also receive the first operation instruction, and start monitoring the displacement direction of the smart terminal while the smart terminal receives the first operation instruction, and The amount of displacement in the direction of displacement, that is, the displacement direction of the smart terminal and the amount of displacement in the direction of displacement during execution of the operation command.
具体地,参阅图2,其为一符合图1中一优选地监测在执行所述操作指令期间,所述智能终端的位移方向以及在所述位移方向上的位移量的步骤的流程示意图。从图中可以看出,优选地,本实施例中,监测在执行所述操作指令期间,所述智能终端的位移方向以及在所述位移方向上的位移量的步骤主要包括:Specifically, referring to FIG. 2, it is a flow diagram of a step of preferably monitoring the displacement direction of the smart terminal and the displacement amount in the displacement direction during execution of the operation instruction in FIG. As can be seen from the figure, in the embodiment, the step of monitoring the displacement direction of the smart terminal and the displacement amount in the displacement direction during the execution of the operation instruction mainly includes:
-监测在执行所述操作指令期间,所述智能终端的加速度传感器X、Y、Z方向上分别输出的电压值;Monitoring a voltage value respectively outputted in the acceleration sensor X, Y, Z directions of the intelligent terminal during execution of the operation command;
-根据所述电压值计算获得所述智能终端的位移方向,以及在所述位移方向上的位移量数值。 Obtaining a displacement direction of the smart terminal and a displacement amount value in the displacement direction according to the voltage value calculation.
可见地,本实施例中,借助在所述智能终端中设置一加速度传感器,利用加速传感器检测所述智能终端的位移情况。In the embodiment, the acceleration sensor is used to detect the displacement of the smart terminal by setting an acceleration sensor in the smart terminal.
其中,加速度传感器是一种能够测量加速度的传感器。通常由质量块、阻尼器、弹性元件、敏感元件和适调电路等部分组成。传感器在加速过程中,通过对质量块所受惯性力的测量,利用牛顿第二定律获得加速度值。根据传感器敏感元件的不同,常见的加速度传感器包括电容式、电感式、应变式、压阻式、压电式等。Among them, the acceleration sensor is a sensor capable of measuring acceleration. It usually consists of mass, damper, elastic element, sensitive component and adaptive circuit. During the acceleration process, the sensor obtains the acceleration value by using Newton's second law by measuring the inertial force of the mass. Depending on the sensor's sensitive components, common accelerometers include capacitive, inductive, strain, piezoresistive, and piezoelectric.
其中,压电式加速度传感器又称压电加速度计。它也属于惯性式传感器。压电式加速度传感器的原理是利用压电陶瓷或石英晶体的压电效应,在加速度计受振时,质量块加在压电元件上的力也随之变化。当被测振动频率远低于加速度计的固有频率时,则力的变化与被测加速度成正比;基于世界领先的MEMS硅微加工技术,压阻式加速度传感器具有体积小、低功耗等特点,易于集成在各种模拟和数字电路中,广泛应用于汽车碰撞实验、测试仪器、设备振动监测等领域;电容式加速度传感器是基于电容原理的极距变化型的电容传感器。电容式加速度传感器/电容式加速度计是对比较通用的加速度传感器。在某些领域无可替代,如安全气囊,手机移动设备等。电容式加速度传感器/电容式加速度计采用了微机电系统(MEMS)工艺,在大量生产时变得经济,从而保证了较低的成本;伺服式加速度传感器是一种闭环测试系统,具有动态性能好、动态范围大和线性度好等特点。其工作原理,传感器的振动系统由“m-k”系统组成,与一般加速度计相同,但质量m上还接着一个电磁线圈,当基座上有加速度输入时,质量块偏离平衡位置,该位移大小由位移传感器检测出来,经伺服放大器放大后转换为电流输出,该电流流过电磁线圈,在永久磁铁的磁场中产生电磁恢复力,力图使质量块保持在仪表壳体中原来的平衡位置上,所以伺服加速度传感器在闭环状态下工作。Among them, the piezoelectric acceleration sensor is also called a piezoelectric accelerometer. It is also an inertial sensor. The principle of a piezoelectric accelerometer is to use the piezoelectric effect of a piezoelectric ceramic or a quartz crystal. When the accelerometer is vibrated, the force that the mass is applied to the piezoelectric element also changes. When the measured vibration frequency is much lower than the natural frequency of the accelerometer, the force change is proportional to the measured acceleration; based on the world's leading MEMS silicon micromachining technology, the piezoresistive accelerometer has small size and low power consumption. It is easy to integrate in various analog and digital circuits, and is widely used in automotive collision experiments, test instruments, equipment vibration monitoring, etc. Capacitive acceleration sensors are capacitance sensors based on the principle of capacitance. Capacitive accelerometers/capacitive accelerometers are relatively common accelerometers. There are no alternatives in some areas, such as airbags, mobile devices and so on. Capacitive accelerometer/capacitive accelerometer adopts micro-electromechanical system (MEMS) technology, which becomes economical in mass production, thus ensuring low cost; servo-type accelerometer is a closed-loop test system with good dynamic performance. , dynamic range and linearity are good. The working principle, the vibration system of the sensor consists of the “mk” system, which is the same as the general accelerometer, but the mass m is followed by an electromagnetic coil. When there is acceleration input on the base, the mass deviates from the equilibrium position. The displacement sensor detects and converts it into a current output after being amplified by the servo amplifier. The current flows through the electromagnetic coil to generate an electromagnetic restoring force in the magnetic field of the permanent magnet, so as to maintain the mass in the original equilibrium position in the instrument housing, so The servo acceleration sensor operates in a closed loop state.
具体地,本实施例中,当所述智能终端捕获用户的操作指令时,所述智能终端的第一位移监测模块中的监测单元接收所述加速度传感器x、y、z方向上分别输出的电压值;所述智能终端的第一数据处理单元则可根据所述电压值计算获得所述智能终端的位移方向,及在所述位移方向上的位移数值。本实施例中,优选地,将智能终端平放在桌面上,x轴默认为0,y轴默认0,z轴默认9.81;将智能终端朝下放在桌面上,z轴为-9.81;将智能终端向左倾斜,x轴为正值;将智能终端向右倾斜,x轴为负值;将智能终端向上倾斜,y轴为负值;将智能终端向下倾斜,y轴为正值。Specifically, in this embodiment, when the smart terminal captures an operation instruction of the user, the monitoring unit in the first displacement monitoring module of the smart terminal receives the voltage respectively outputted in the x, y, and z directions of the acceleration sensor. The first data processing unit of the smart terminal can calculate the displacement direction of the smart terminal and the displacement value in the displacement direction according to the voltage value. In this embodiment, preferably, the smart terminal is placed on the desktop, the x-axis defaults to 0, the y-axis defaults to 0, and the z-axis defaults to 9.81; the smart terminal is placed face down on the desktop, and the z-axis is -9.81; The terminal is tilted to the left, the x-axis is positive; the smart terminal is tilted to the right, the x-axis is negative; the smart terminal is tilted upward, the y-axis is negative; the smart terminal is tilted downward, and the y-axis is positive.
继续参阅图1,本实施例中,所述智能终端通过其第一位移监测模块获得所述智能终端的位移方向及其在所述位移方向上的位移量后,所述智能终端中的一第一阈值模块,可将所述位移量与一存储于所述智能终端中的位移阈值进行比较,且,当比较结果为所 述位移量大于所述位移阈值时,所述第一阈值模块可生成一第一操作指令,并向外发送。With reference to FIG. 1 , in the embodiment, after the smart terminal obtains the displacement direction of the smart terminal and the displacement amount in the displacement direction by the first displacement monitoring module, the smart terminal a threshold module, wherein the displacement amount is compared with a displacement threshold stored in the smart terminal, and when the comparison result is When the displacement amount is greater than the displacement threshold, the first threshold module may generate a first operation instruction and send it outward.
所述智能终端中一调节模块可接收所述第一操作指令,并根据所述第一操作指令,降低所述智能终端的帧率。An adjustment module of the intelligent terminal can receive the first operation instruction, and reduce a frame rate of the smart terminal according to the first operation instruction.
具体地,参与图3,其为一符合图1中一优选地当所述位移量大于所述位移阈值时,降低所述智能终端的帧率的步骤的流程示意图。从图中可以看出,本实施例中,所提供的降低所述智能终端的帧率的步骤主要包括:Specifically, FIG. 3 is a schematic flowchart of a step of lowering a frame rate of the smart terminal when the displacement amount is greater than the displacement threshold, in accordance with FIG. It can be seen from the figure that, in this embodiment, the step of reducing the frame rate of the smart terminal is mainly provided by:
-预先在所述智能终端中存储一位移量-帧率数据表;Pre-storing a displacement amount-frame rate data table in the smart terminal;
-当所述位移量大于所述位移阈值时,计算所述位移量与所述位移阈值的差值;Calculating a difference between the displacement amount and the displacement threshold when the displacement amount is greater than the displacement threshold;
-根据所述差值,在所述位移量-帧率数据表中进行检索;- performing a search in the displacement amount - frame rate data table based on the difference;
-获得一对应所述差值的调整帧率;Obtaining an adjusted frame rate corresponding to the difference;
-根据所述调整帧率,降低所述智能终端的帧率。- reducing the frame rate of the smart terminal according to the adjusted frame rate.
可见地,本实施例中,利用调整智能终端的帧率的方式,获得一显示清晰的图像。Obviously, in this embodiment, a clear-cut image is obtained by adjusting the frame rate of the smart terminal.
其中,帧率(Frame rate)是用于测量显示帧数的量度。所谓的测量单位为每秒显示帧数(Frames per Second,简称:FPS)或“赫兹”(Hz)。每秒的帧数(fps)或者说帧率表示图形处理器处理场时每秒钟能够更新的次数。高的帧率可以得到更流畅、更逼真的动画。一般来说30fps就是可以接受的,但是将性能提升至60fps则可以明显提升交互感和逼真感,但是一般来说超过75fps一般就不容易察觉到有明显的流畅度提升了。如果帧率超过屏幕刷新率只会浪费图形处理的能力,因为监视器不能以这么快的速度更新,这样超过刷新率的帧率就浪费掉了。故,本实施例中,利用一定范围内调整智能终端的帧率的方法,可以获得一显示清晰的图像。Among them, the frame rate is a measure for measuring the number of display frames. The so-called measurement unit is Frames per Second (FPS) or Hertz (Hz). The number of frames per second (fps) or frame rate represents the number of times the graphics processor can update every second while processing the field. High frame rates for smoother, more realistic animations. In general, 30fps is acceptable, but improving performance to 60fps can significantly improve the sense of interaction and realism, but in general, more than 75fps is generally not easy to notice a significant increase in fluency. If the frame rate exceeds the screen refresh rate, it only wastes the ability to process graphics, because the monitor cannot be updated at such a fast speed that the frame rate exceeding the refresh rate is wasted. Therefore, in this embodiment, a method for adjusting the frame rate of the smart terminal within a certain range can be used to obtain a clear image.
具体地,本实施例中,预先在所述智能终端中存储一位移量-帧率数据表,所述位移量-帧率数据表中一一对应地存储有位移量及该位移量下的帧率数据。优选地,本实施例中,通过若干实验获得一智能终端发生不同的位移量的情况下,调整一定量的帧率数据,可获得一清晰的显示图像,并将不同的位移量及其位移量下的调整帧率一一关联,制成一所述的位移量-帧率数据表。从而,本实施例中,当比较结果显示所述位移量大于所述位移阈值时,所述智能终端的调整模块中的一第二数据处理单元接收所述第一阈值模块发送的所述第一操作指令,并根据所述第一操作指令计算所述位移量与所述位移阈值的差值,并向外发送;从而,所述调整模块中的一检索单元,根据所述差值,在所述位移量-帧率数据表中进行检索,获得一对应所述差值的调整帧率。进一步地,所述调整模块中的调整单元可以根据所述调整帧率,降低所述智能终端的帧率。Specifically, in this embodiment, a displacement amount-frame rate data table is stored in the smart terminal, and the displacement amount and the frame rate data table respectively store the displacement amount and the frame under the displacement amount. Rate data. Preferably, in the embodiment, when a certain amount of displacement is generated by a certain intelligent terminal, a certain amount of frame rate data is adjusted to obtain a clear display image, and different displacement amounts and displacements thereof are obtained. The adjusted frame rate is associated one by one to form a displacement amount-frame rate data table as described. Therefore, in the embodiment, when the comparison result indicates that the displacement amount is greater than the displacement threshold, a second data processing unit of the adjustment module of the smart terminal receives the first one sent by the first threshold module. Manipulating an instruction, and calculating a difference between the displacement amount and the displacement threshold according to the first operation instruction, and transmitting the difference; thus, a retrieval unit in the adjustment module is based on the difference The retrieval is performed in the displacement amount-frame rate data table to obtain an adjusted frame rate corresponding to the difference. Further, the adjusting unit in the adjusting module may reduce the frame rate of the smart terminal according to the adjusted frame rate.
从而,继续参阅图1,本实施例中,所述智能终端的显示模块,可根据所述帧率,在 所智能终端的显示界面上显示一清晰图像。Therefore, with reference to FIG. 1 , in this embodiment, the display module of the smart terminal can be based on the frame rate. A clear image is displayed on the display interface of the smart terminal.
具体地,参阅图4,其为一符合图1中一优选地在所述智能终端的显示界面上显示一清晰图像的步骤的流程示意图,从图中可以看出,本实施例中,所提供的在所述智能终端的显示界面上显示一清晰图像的步骤主要包括:Specifically, referring to FIG. 4, which is a schematic flowchart of a step of displaying a clear image on the display interface of the smart terminal according to FIG. 1, as can be seen from the figure, in the embodiment, The steps of displaying a clear image on the display interface of the smart terminal mainly include:
-所述智能终端根据降低后的所述帧率,生成一显示指令;- the smart terminal generates a display instruction according to the reduced frame rate;
-所述智能终端根据所述显示指令调节所述智能终端的显示速率;The smart terminal adjusts a display rate of the smart terminal according to the display instruction;
-在所述智能终端的显示界面上显示一清晰图像。- displaying a clear image on the display interface of the smart terminal.
具体地,本实施例中,所述智能终端的显示模块包括一指令单元,所述指令单元可接收所述帧率,并根据所述帧率生成一包含所述帧率的显示指令;所述显示模块还包括一显示单元,所述显示单元接收所述显示指令,并解析,从而,调节所述智能终端的显示速率,在所述智能终端的显示界面上显示一清晰图像。Specifically, in this embodiment, the display module of the smart terminal includes an instruction unit, and the instruction unit can receive the frame rate, and generate a display instruction including the frame rate according to the frame rate; The display module further includes a display unit, the display unit receives the display instruction and parses, thereby adjusting a display rate of the smart terminal, and displaying a clear image on the display interface of the smart terminal.
另外,针对具体利用智能终端拍摄视频文件,本发明也提供一种基于智能终端的相机防抖的方法。具体地,参阅图5,其为符合本发明另一优选实施例的基于智能终端的相机防抖的方法。从图中可以看出,基于上述实施例,本实施例中,所提供的相机防抖的方法还包括:In addition, the present invention also provides a method for camera anti-shake based on a smart terminal for specifically capturing a video file by using a smart terminal. Specifically, referring to FIG. 5, it is a smart terminal-based camera anti-shake method in accordance with another preferred embodiment of the present invention. It can be seen from the figure that, according to the above embodiment, the method for providing camera anti-shake in the embodiment further includes:
-分别监测所述智能终端获得每一帧图像期间的位移方向及在所述位移方向上的位移量;- separately monitoring the direction of displacement of the smart terminal during each image of the frame and the amount of displacement in the direction of displacement;
-并将所述位移方向及所述位移量与所述每一帧图像相关联,缓存于所智能终端中;- associating the displacement direction and the displacement amount with each frame image, and buffering in the smart terminal;
-当所述智能终端捕获一完整图像后,比较所述每一帧图像的所述位移量,获得一最大位移量;- after the smart terminal captures a complete image, comparing the displacement amount of each frame image to obtain a maximum displacement amount;
-将所述最大位移量与一位移阈值进行比较;当所述最大位移大于所述位移阈值时,降低所述智能终端的帧率;- comparing the maximum displacement amount with a displacement threshold; when the maximum displacement is greater than the displacement threshold, reducing a frame rate of the intelligent terminal;
-在所述智能终端的显示界面上显示一清晰图像。- displaying a clear image on the display interface of the smart terminal.
具体地,本实施例中,考虑到视频文件是由多帧图像构成的,从而,所述智能终端中具有一第二位移监测模块,所述第二位移监测模块可在接收到用户对所述智能终端发出一操作指令,并解析后,分别监测所述智能终端获得每一帧图像期间的位移方向及在所述位移方向上的位移量;Specifically, in this embodiment, it is considered that the video file is composed of a multi-frame image, so that the smart terminal has a second displacement monitoring module, and the second displacement monitoring module can receive the user After the smart terminal sends an operation command and parses, respectively, the smart terminal obtains a displacement direction during the image of each frame and a displacement amount in the displacement direction;
同时,所述智能终端中设置有一缓存模块,可将所述位移方向及所述位移量与所述每一帧图像相关联,并缓存于所智能终端中;At the same time, a buffer module is disposed in the smart terminal, and the displacement direction and the displacement amount are associated with each frame image, and are cached in the smart terminal;
当所述智能终端捕获一完整图像后,所述智能终端中的一筛选模块可比较所述每一 帧图像的所述位移量,并获得一最大位移量,向外发送;After the smart terminal captures a complete image, a screening module in the smart terminal may compare each of the The amount of displacement of the frame image, and obtaining a maximum displacement amount, which is sent out;
所述智能终端中的一第二阈值模块,再将所述最大位移量与一位移阈值进行比较,当所述最大位移大于所述位移阈值时,所述第二阈值模块生成一第二操作指令向外发送;The second threshold module of the smart terminal compares the maximum displacement amount with a displacement threshold, and when the maximum displacement is greater than the displacement threshold, the second threshold module generates a second operation instruction. Send out
而,所述智能终端的调整模块可接收所述第二操作指令,并根据所述第二操作指令,降低所述智能终端的相机的帧率,从而,所述智能终端的显示模块根据所述帧率可在所述智能终端的显示界面上显示一清晰图像。The adjustment module of the smart terminal can receive the second operation instruction, and reduce the frame rate of the camera of the smart terminal according to the second operation instruction, so that the display module of the smart terminal is according to the The frame rate can display a clear image on the display interface of the smart terminal.
综上所述,本发明提供一种基于智能终端的相机防抖的方法,通过监测智能终端在图像拍摄过程中,其加速度传感器在各方向上的电压输出值,确定智能终端的位移量,根据该位移量调节智能终端的帧率,从而,可使智能终端显示一清晰的图像;另外,对于拍摄视频文件的情况,本发明可通过监测并缓存每帧图像拍摄过程中智能终端的位移情况,并根据最大位移量的情况调节智能终端的帧率,一方面减少了智能终端的工作量,同时,保证显示视频的清晰度。In summary, the present invention provides a method for anti-shake of a camera based on an intelligent terminal. By monitoring a voltage output value of an acceleration sensor in each direction of an intelligent terminal during image capturing, determining a displacement amount of the smart terminal, according to The displacement adjusts the frame rate of the smart terminal, so that the smart terminal can display a clear image; in addition, for the case of capturing a video file, the present invention can monitor and buffer the displacement of the smart terminal during each frame of image capturing, And adjusting the frame rate of the intelligent terminal according to the maximum displacement amount, on the one hand, reducing the workload of the intelligent terminal, and at the same time, ensuring the clarity of the displayed video.
本发明另一方面,在于提供一种基于智能终端的相机防抖系统。具体参阅图6,其为一符合本发明一优选实施例的基于智能终端的相机防抖系统的结构图,从图中可以看出,本实施所提供的相机防抖系统包括:Another aspect of the present invention is to provide a camera anti-shake system based on a smart terminal. FIG. 6 is a structural diagram of a camera-based anti-shake system based on a smart terminal according to a preferred embodiment of the present invention. As can be seen from the figure, the camera anti-shake system provided by the present embodiment includes:
-第一指令模块- first instruction module
用于捕获一操作指令,具体地,当用户通过触发所述智能终端显示界面上的图标,或者智能终端本体上的快捷按钮,对所述智能终端发出一操作指令时,所述智能终端的第一指令模块接收所述操作指令,并根据所述操作指令的具体内容,如当前界面位置,触发手势的具体位置,触发手势的压力,触发手势的方向,触发手势的速度或频率等,确定所述操作指令所述包含的具体指令内容;For capturing an operation instruction, specifically, when the user issues an operation instruction to the smart terminal by triggering an icon on the smart terminal display interface or a shortcut button on the smart terminal body, the smart terminal An instruction module receives the operation instruction, and according to the specific content of the operation instruction, such as the current interface position, triggering a specific position of the gesture, triggering the pressure of the gesture, triggering the direction of the gesture, triggering the speed or frequency of the gesture, etc., determining the location The specific instruction content included in the operation instruction;
-摄像模块- Camera module
所述摄像模块与所述第一指令模块通讯连接,接收解析后的操作指令,并根据所述操作指令捕获至少一目标图像;The camera module is communicatively coupled to the first instruction module, receives the parsed operation instruction, and captures at least one target image according to the operation instruction;
-第一位移监测模块-First displacement monitoring module
用于监测在执行所述操作指令期间,所述智能终端的位移方向以及在所述位移方向上的位移量,也即,在所述智能终端接收所述第一操作指令的同时开始监测所述智能终端的位移方向,及在所述位移方向上的位移量。Means for monitoring a displacement direction of the smart terminal and a displacement amount in the displacement direction during execution of the operation instruction, that is, starting to monitor the smart terminal while receiving the first operation instruction The displacement direction of the smart terminal and the amount of displacement in the displacement direction.
具体地,所述第一位移监测模块包括:Specifically, the first displacement monitoring module includes:
监测单元,用于监测在执行所述操作指令期间,所述智能终端的加速度传感器x、y、z方向上分别输出的电压值; a monitoring unit, configured to monitor, during the execution of the operation instruction, a voltage value respectively outputted by the acceleration sensor in the x, y, and z directions of the smart terminal;
第一数据处理单元,根据所述电压值计算获得所述智能终端的位移方向,以及在所述位移方向上的位移量数值。The first data processing unit calculates a displacement direction of the smart terminal and a displacement amount value in the displacement direction according to the voltage value.
-第一阈值模块- first threshold module
用于将所述位移量与一位移阈值进行比较,当所述位移量大于所述位移阈值时,生成一第一操作指令,向外发送。And comparing the displacement amount with a displacement threshold, and when the displacement amount is greater than the displacement threshold, generating a first operation instruction and transmitting the signal.
-调节模块- adjustment module
用于根据所述第一操作指令,降低所述智能终端的相机的帧率。And configured to reduce a frame rate of a camera of the smart terminal according to the first operation instruction.
具体地,所述调节模块包括:Specifically, the adjustment module includes:
第二数据处理单元,接收所述第一操作指令,计算所述位移量与所述位移阈值的差值;The second data processing unit receives the first operation instruction, and calculates a difference between the displacement amount and the displacement threshold;
检索单元,根据所述差值,在所述位移量-帧率数据表中进行检索,获得一对应所述差值的调整帧率,And the searching unit performs a search in the displacement amount-frame rate data table according to the difference, to obtain an adjusted frame rate corresponding to the difference,
调整单元,根据所述调整帧率,降低所述智能终端的帧率。And an adjusting unit, configured to reduce a frame rate of the smart terminal according to the adjusted frame rate.
-显示模块- display module
用于在所述智能终端的显示界面上显示一清晰图像。For displaying a clear image on the display interface of the smart terminal.
具体地,所述显示模块包括:Specifically, the display module includes:
指令单元,根据所述帧率,生成一显示指令;The instruction unit generates a display instruction according to the frame rate;
显示单元,根据所述显示指令,调节所述智能终端的显示速率,在所述智能终端的显示界面上显示一清晰图像。And a display unit, configured to adjust a display rate of the smart terminal according to the display instruction, and display a clear image on a display interface of the smart terminal.
本实施例中,考虑到视频文件是由多帧图像构成的,从而,本发明还提供另一种基于智能终端的相机防抖系统。参阅图7,其为符合本发明另一优选实施例的基于智能终端的相机防抖系统的结构图,从图中可以看出,本实施例中,基于上述实施例,还包括,In this embodiment, it is considered that the video file is composed of a plurality of frames of images, and thus the present invention also provides another camera anti-shake system based on the smart terminal. Referring to FIG. 7 , which is a structural diagram of a smart terminal-based camera anti-shake system according to another preferred embodiment of the present invention, it can be seen from the figure that, in this embodiment, based on the foregoing embodiment,
-第二位移监测模块-Second displacement monitoring module
用于分别监测所述智能终端获得每一帧图像期间的位移方向及在所述位移方向上的位移量;And a method for separately monitoring a displacement direction of the smart terminal during each frame image and a displacement amount in the displacement direction;
-缓存模块- Cache module
用于并将所述位移方向及所述位移量与所述每一帧图像相关联,缓存于所智能终端中;And configured to associate the displacement direction and the displacement amount with each frame image, and cache the same in the smart terminal;
-筛选模块- screening module
用于当所述智能终端捕获一完整图像后,比较所述每一帧图像的所述位移量,获得一最大位移量; And after the smart terminal captures a complete image, comparing the displacement amount of each frame image to obtain a maximum displacement amount;
-第二阈值模块- second threshold module
用于将所述最大位移量与一位移阈值进行比较,当所述最大位移大于所述位移阈值时,生成一第二操作指令,从而,所述智能终端的调整模块接收所述第二操作指令,并降低所述智能终端的相机的帧率。And comparing, by the maximum displacement amount, a displacement threshold, when the maximum displacement is greater than the displacement threshold, generating a second operation instruction, so that the adjustment module of the smart terminal receives the second operation instruction And reducing the frame rate of the camera of the smart terminal.
综上所述,本发明提供一种基于智能终端的相机防抖系统,通过监测智能终端在图像拍摄过程中,其加速度传感器在各方向上的电压输出值,确定智能终端的位移量,根据该位移量调节智能终端的帧率,从而,可使智能终端显示一清晰的图像;另外,对于拍摄视频文件的情况,本发明可通过监测并缓存每帧图像拍摄过程中智能终端的位移情况,并根据最大位移量的情况调节智能终端的帧率,一方面减少了智能终端的工作量,同时,保证显示视频的清晰度。In summary, the present invention provides a camera anti-shake system based on a smart terminal, which determines the displacement amount of the smart terminal by monitoring the voltage output value of the acceleration sensor in each direction during image capturing by the smart terminal, according to the The displacement amount adjusts the frame rate of the intelligent terminal, thereby enabling the smart terminal to display a clear image; in addition, for the case of capturing a video file, the present invention can monitor and buffer the displacement of the smart terminal during each frame of image capturing, and Adjusting the frame rate of the smart terminal according to the maximum displacement amount reduces the workload of the smart terminal on the one hand, and ensures the clarity of the displayed video at the same time.
应当注意的是,本发明的实施例有较佳的实施性,且并非对本发明作任何形式的限制,任何熟悉该领域的技术人员可能利用上述揭示的技术内容变更或修饰为等同的有效实施例,但凡未脱离本发明技术方案的内容,依据本发明的技术实质对以上实施例所作的任何修改或等同变化及修饰,均仍属于本发明技术方案的范围内。 It should be noted that the embodiments of the present invention are preferred embodiments, and are not intended to limit the scope of the present invention. Any one skilled in the art may use the above-disclosed technical contents to change or modify the equivalent embodiments. Any modification or equivalent changes and modifications of the above embodiments in accordance with the technical spirit of the present invention are still within the scope of the technical solutions of the present invention.

Claims (10)

  1. 一种基于智能终端的相机防抖的方法,其特征在于,包括以下步骤:A method for camera anti-shake based on a smart terminal, comprising the steps of:
    捕获一操作指令,Capture an operation command,
    根据所述操作指令捕获至少一目标图像,Capturing at least one target image according to the operation instruction,
    监测在执行所述操作指令期间,所述智能终端的位移方向以及在所述位移方向上的位移量,Monitoring a displacement direction of the smart terminal and a displacement amount in the displacement direction during execution of the operation instruction,
    将所述位移量与一位移阈值进行比较,Comparing the amount of displacement with a displacement threshold,
    当所述位移量大于所述位移阈值时,降低所述智能终端的帧率,When the displacement amount is greater than the displacement threshold, reducing a frame rate of the smart terminal,
    在所述智能终端的显示界面上显示一清晰图像。A clear image is displayed on the display interface of the smart terminal.
  2. 如权利要求1所述的方法,其特征在于,The method of claim 1 wherein
    监测在执行所述操作指令期间,所述智能终端的位移方向以及在所述位移方向上的位移量的步骤包括,Monitoring the step of the displacement direction of the smart terminal and the amount of displacement in the displacement direction during execution of the operation instruction, including,
    监测在执行所述操作指令期间,所述智能终端的加速度传感器x、y、z方向上分别输出的电压值,Monitoring, during the execution of the operation instruction, a voltage value respectively outputted by the acceleration sensor in the x, y, and z directions of the smart terminal,
    根据所述电压值计算获得所述智能终端的位移方向,以及在所述位移方向上的位移量数值。Obtaining a displacement direction of the smart terminal and a displacement amount value in the displacement direction according to the voltage value calculation.
  3. 如权利要求1所述的方法,其特征在于,The method of claim 1 wherein
    当所述位移量大于所述位移阈值时,降低所述智能终端的帧率的步骤包括,When the amount of displacement is greater than the displacement threshold, the step of reducing the frame rate of the smart terminal includes,
    预先在所述智能终端中存储一位移量-帧率数据表,Pre-storing a displacement amount-frame rate data table in the smart terminal,
    当所述位移量大于所述位移阈值时,计算所述位移量与所述位移阈值的差值,Calculating a difference between the displacement amount and the displacement threshold when the displacement amount is greater than the displacement threshold
    根据所述差值,在所述位移量-帧率数据表中进行检索,Searching in the displacement amount-frame rate data table according to the difference,
    获得一对应所述差值的调整帧率,Obtaining an adjusted frame rate corresponding to the difference,
    根据所述调整帧率,降低所述智能终端的帧率。And reducing the frame rate of the smart terminal according to the adjusted frame rate.
  4. 如权利要求1所述的方法,其特征在于,The method of claim 1 wherein
    还包括,Also includes,
    分别监测所述智能终端获得每一帧图像期间的位移方向及在所述位移方向上的位移量,Monitoring, respectively, the direction of displacement of the smart terminal during each image of the frame and the amount of displacement in the direction of the displacement,
    并将所述位移方向及所述位移量与所述每一帧图像相关联,缓存于所智能终端中,And associating the displacement direction and the displacement amount with each frame image, and buffering in the smart terminal,
    当所述智能终端捕获一完整图像后,比较所述每一帧图像的所述位移量,获得一最大位移量, After the smart terminal captures a complete image, comparing the displacement amount of each frame image to obtain a maximum displacement amount,
    将所述最大位移量与一位移阈值进行比较,Comparing the maximum displacement amount with a displacement threshold,
    当所述最大位移大于所述位移阈值时,降低所述智能终端的帧率,Decrease the frame rate of the smart terminal when the maximum displacement is greater than the displacement threshold,
    在所述智能终端的显示界面上显示一清晰图像。A clear image is displayed on the display interface of the smart terminal.
  5. 如权利要求1所述的方法,其特征在于,The method of claim 1 wherein
    在所述智能终端的显示界面上显示一清晰图像的步骤包括,The step of displaying a clear image on the display interface of the smart terminal includes,
    所述智能终端根据降低后的所述帧率,生成一显示指令,The smart terminal generates a display instruction according to the reduced frame rate.
    所述智能终端根据所述显示指令调节所述智能终端的显示速率,在所述智能终端的显示界面上显示一清晰图像。The smart terminal adjusts a display rate of the smart terminal according to the display instruction, and displays a clear image on a display interface of the smart terminal.
  6. 一种基于智能终端的相机防抖系统,其特征在于,包括以下模块,A camera anti-shake system based on a smart terminal, comprising the following modules,
    第一指令模块,捕获一操作指令,a first instruction module that captures an operation instruction,
    摄像模块,根据所述操作指令捕获至少一目标图像,a camera module that captures at least one target image according to the operation instruction,
    第一位移监测模块,监测在执行所述操作指令期间,所述智能终端的位移方向以及在所述位移方向上的位移量,a first displacement monitoring module that monitors a displacement direction of the smart terminal and a displacement amount in the displacement direction during execution of the operation instruction,
    第一阈值模块,将所述位移量与一位移阈值进行比较,当所述位移量大于所述位移阈值时,生成一第一操作指令,向外发送,The first threshold module compares the displacement amount with a displacement threshold, and when the displacement amount is greater than the displacement threshold, generates a first operation instruction and sends the first operation instruction.
    调节模块,根据所述第一操作指令,降低所述智能终端的相机的帧率,An adjustment module, according to the first operation instruction, reducing a frame rate of a camera of the smart terminal,
    显示模块,在所述智能终端的显示界面上显示一清晰图像。The display module displays a clear image on the display interface of the smart terminal.
  7. 如权利要求6所述的相机防抖系统,其特征在于,The camera anti-shake system of claim 6 wherein:
    所述第一位移监测模块包括,The first displacement monitoring module includes
    监测单元,监测在执行所述操作指令期间,所述智能终端的加速度传感器x、y、z方向上分别输出的电压值,a monitoring unit, configured to monitor, during the execution of the operation instruction, a voltage value respectively outputted by the acceleration sensor in the x, y, and z directions of the smart terminal,
    第一数据处理单元,根据所述电压值计算获得所述智能终端的位移方向,以及在所述位移方向上的位移量数值。The first data processing unit calculates a displacement direction of the smart terminal and a displacement amount value in the displacement direction according to the voltage value.
  8. 如权利要求6所述的相机防抖系统,其特征在于,The camera anti-shake system of claim 6 wherein:
    所述调整模块包括,The adjustment module includes
    第二数据处理单元,接收所述第一操作指令,计算所述位移量与所述位移阈值的差值,检索单元,根据所述差值,在所述位移量-帧率数据表中进行检索,获得一对应所述差值的调整帧率,The second data processing unit receives the first operation instruction, calculates a difference between the displacement amount and the displacement threshold, and the retrieval unit performs retrieval in the displacement amount-frame rate data table according to the difference value Obtaining an adjusted frame rate corresponding to the difference,
    调整单元,根据所述调整帧率,降低所述智能终端的帧率。And an adjusting unit, configured to reduce a frame rate of the smart terminal according to the adjusted frame rate.
  9. 如权利要求6所述的相机防抖系统,其特征在于,The camera anti-shake system of claim 6 wherein:
    还包括, Also includes,
    第二位移监测模块,分别监测所述智能终端获得每一帧图像期间的位移方向及在所述位移方向上的位移量,a second displacement monitoring module respectively monitoring a displacement direction of the smart terminal during each frame image and a displacement amount in the displacement direction,
    缓存模块,并将所述位移方向及所述位移量与所述每一帧图像相关联,缓存于所智能终端中,Cache the module, and associate the displacement direction and the displacement amount with each frame image, and cache the same in the smart terminal.
    筛选模块,当所述智能终端捕获一完整图像后,比较所述每一帧图像的所述位移量,获得一最大位移量,a screening module, after the smart terminal captures a complete image, comparing the displacement amount of each frame image to obtain a maximum displacement amount,
    第二阈值模块,将所述最大位移量与一位移阈值进行比较,当所述最大位移大于所述位移阈值时,生成一第二操作指令,a second threshold module, the maximum displacement amount is compared with a displacement threshold, and when the maximum displacement is greater than the displacement threshold, a second operation instruction is generated,
    所述智能终端的调整模块接收所述第二操作指令,并降低所述智能终端的相机的帧率。The adjustment module of the smart terminal receives the second operation instruction and reduces a frame rate of a camera of the smart terminal.
  10. 如权利要求6所述的相机防抖系统,其特征在于,The camera anti-shake system of claim 6 wherein:
    所述显示模块包括,The display module includes
    指令单元,根据所述帧率,生成一显示指令,An instruction unit generates a display instruction according to the frame rate,
    显示单元,根据所述显示指令,调节所述智能终端的显示速率,在所述智能终端的显示界面上显示一清晰图像。 And a display unit, configured to adjust a display rate of the smart terminal according to the display instruction, and display a clear image on a display interface of the smart terminal.
PCT/CN2017/110171 2017-11-09 2017-11-09 Intelligent terminal-based camera shake prevention method and system WO2019090592A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/110171 WO2019090592A1 (en) 2017-11-09 2017-11-09 Intelligent terminal-based camera shake prevention method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/110171 WO2019090592A1 (en) 2017-11-09 2017-11-09 Intelligent terminal-based camera shake prevention method and system

Publications (1)

Publication Number Publication Date
WO2019090592A1 true WO2019090592A1 (en) 2019-05-16

Family

ID=66438729

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/110171 WO2019090592A1 (en) 2017-11-09 2017-11-09 Intelligent terminal-based camera shake prevention method and system

Country Status (1)

Country Link
WO (1) WO2019090592A1 (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004289709A (en) * 2003-03-25 2004-10-14 Toshiba Corp Image pickup device, and image pickup method
CN101729777A (en) * 2009-10-22 2010-06-09 华为终端有限公司 Digital image acquisition method and equipment
CN102523380A (en) * 2011-11-10 2012-06-27 深圳市同洲电子股份有限公司 Method for preventing camera of mobile terminal from shaking, and mobile terminal
CN104601897A (en) * 2015-02-13 2015-05-06 浙江宇视科技有限公司 Anti-shake device and method of video camera
CN105681665A (en) * 2016-02-29 2016-06-15 广东欧珀移动通信有限公司 Control method, control device and electronic device
CN106657758A (en) * 2016-09-26 2017-05-10 广东欧珀移动通信有限公司 Photographing method, photographing device and terminal equipment

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004289709A (en) * 2003-03-25 2004-10-14 Toshiba Corp Image pickup device, and image pickup method
CN101729777A (en) * 2009-10-22 2010-06-09 华为终端有限公司 Digital image acquisition method and equipment
CN102523380A (en) * 2011-11-10 2012-06-27 深圳市同洲电子股份有限公司 Method for preventing camera of mobile terminal from shaking, and mobile terminal
CN104601897A (en) * 2015-02-13 2015-05-06 浙江宇视科技有限公司 Anti-shake device and method of video camera
CN105681665A (en) * 2016-02-29 2016-06-15 广东欧珀移动通信有限公司 Control method, control device and electronic device
CN106657758A (en) * 2016-09-26 2017-05-10 广东欧珀移动通信有限公司 Photographing method, photographing device and terminal equipment

Similar Documents

Publication Publication Date Title
TW501090B (en) Method and apparatus for image stabilization in display device
WO2018072353A1 (en) Image acquiring method and terminal device
US10477107B2 (en) Electronic image stabilization of a captured image
RU2758460C1 (en) Terminal apparatus and method for video image stabilisation
CN106210544B (en) Mobile terminal and anti-shake processing method and system for video shot by mobile terminal
CN103176623A (en) Reading anti-shaking method and device of mobile terminal and mobile terminal
CN103885593A (en) Handheld terminal and screen anti-shake method and device of handheld terminal
US20140063279A1 (en) Image capture device and image processor
JP5977611B2 (en) Blur amount detection device, imaging device, and blur amount detection method
US10037596B2 (en) In-vehicle optical image stabilization (OIS)
CN108777763B (en) Photographing method and terminal equipment
WO2017005070A1 (en) Display control method and device
KR101643606B1 (en) Method for providing motion guide in moving picture recording device and apparatus thereof
KR20130091897A (en) Camera apparatus
TW201804313A (en) Method for performing display stabilization control in an electronic device and associated apparatus
WO2015078189A1 (en) Interface adjustment method and mobile device
JP2012253620A (en) Image processing device
CN108196701B (en) Method and device for determining posture and VR equipment
WO2019090592A1 (en) Intelligent terminal-based camera shake prevention method and system
WO2023217198A1 (en) Method and apparatus for displaying picture on head-mounted display device, and electronic device
US20090169127A1 (en) Anti-vibration system for the display screen of an image display device
WO2019179413A1 (en) Depth-of-field image generating method and mobile terminal
WO2023005424A1 (en) Electronic device, information synchronization method, and computer readable storage medium
JP2000029617A (en) Video display device
JP2008269577A (en) Electronic apparatus, spatial displacement calculating device and spatial displacement calculating method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17931370

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17931370

Country of ref document: EP

Kind code of ref document: A1