CN106973224A - Control method and control device of auxiliary composition, and electronic device - Google Patents

Control method and control device of auxiliary composition, and electronic device Download PDF

Info

Publication number
CN106973224A
CN106973224A CN201710138849.9A CN201710138849A CN106973224A CN 106973224 A CN106973224 A CN 106973224A CN 201710138849 A CN201710138849 A CN 201710138849A CN 106973224 A CN106973224 A CN 106973224A
Authority
CN
China
Prior art keywords
depth
image
processing
buffer
data
Prior art date
Application number
CN201710138849.9A
Other languages
Chinese (zh)
Inventor
孙剑波
Original Assignee
广东欧珀移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 广东欧珀移动通信有限公司 filed Critical 广东欧珀移动通信有限公司
Priority to CN201710138849.9A priority Critical patent/CN106973224A/en
Publication of CN106973224A publication Critical patent/CN106973224A/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment ; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, TV cameras, video cameras, camcorders, webcams, camera modules for embedding in other devices, e.g. mobile phones, computers or vehicles
    • H04N5/225Television cameras ; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, camcorders, webcams, camera modules specially adapted for being embedded in other devices, e.g. mobile phones, computers or vehicles
    • H04N5/232Devices for controlling television cameras, e.g. remote control ; Control of cameras comprising an electronic image sensor
    • H04N5/23222Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image

Abstract

The invention discloses a control method of auxiliary composition. The control method comprises the following steps: processing scene data to obtain depth information of a cached main image; obtaining a foreground part of the cached main image according to the depth information; determining a current three-dimensional space structure type according to the foreground part and the orientation; and finding current composition suggestions corresponding to the current three-dimensional space structure type in a memory. In addition, the invention further discloses a control device of auxiliary composition and an electronic device. According to the control method and control device of auxiliary composition and the electronic device disclosed by the invention, the current three-dimensional space structure type is determined by using the depth information and the direction sensor information to obtain the current composition suggestions corresponding to the current three-dimensional space structure type, and then auxiliary composition can be carried out.

Description

辅助构图的控制方法、控制装置及电子装置 The method of controlling the composition of the auxiliary control device and the electronic device

技术领域 FIELD

[0001] 本发明涉及成像技术,特别涉及一种辅助构图的控制方法、控制装置及电子装置。 [0001] The present invention relates to imaging technology, and particularly relates to a method for controlling the auxiliary composition, a control device and an electronic device.

背景技术 Background technique

[0002] 摄影技术中构图属于比较专业的技能,很多普通消费者都不具备这方面的技能, 导致图像的视觉效果差。 [0002] photography in the composition belong to more professional skills, a lot of consumers do not have the skills in this area, resulting in poor image visual effect.

发明内容 SUMMARY

[0003] 本发明旨在至少解决现有技术中存在的技术问题之一。 [0003] The present invention is to solve at least one of the prior art technical problems. 为此,本发明需要提供一种辅助构图的控制方法、控制装置及电子装置。 To this end, the present invention requires the composition to provide a control method of an auxiliary control device and the electronic device.

[0004] 一种辅助构图的控制方法,用于控制电子装置,所述电子装置包括成像装置、方向传感器和存储器,所述成像装置用于采集场景数据,所述场景数据包括缓存主图像,所述方向传感器用于感测所述成像装置的朝向,所述存储器存储有多种三维空间结构类型和对应的构图建议;所述控制方法包括以下步骤: [0004] The method for controlling an auxiliary composition, for controlling the electronic device, said electronic device includes an imaging apparatus, a direction sensor and a memory, means for acquiring the imaging scene data, said main image scene data comprises a cache, the a direction toward said sensor for sensing the image forming apparatus, the memory stores a plurality of three-dimensional structure corresponding to the type and composition advice; the method comprising the steps of:

[0005] 处理所述场景数据以获取所述缓存主图像的深度信息; [0005] The processing of the scene data to obtain depth information for the main image buffer;

[0006] 根据所述深度信息获取所述缓存主图像的前景部分; [0006] The acquiring the depth information buffer of said main image foreground portion;

[0007] 根据所述前景部分和所述朝向确定当前三维空间结构类型;和 [0007] The foreground portion and determining the current orientation of the three dimensional structure in accordance with the type; and

[0008] 在所述存储器寻找与所述当前三维空间结构类型对应的当前构图建议。 [0008] Looking patterning this recommendation and the current corresponding to the type of three-dimensional structure in the memory.

[0009] 一种辅助构图的控制装置,用于控制电子装置,所述电子装置包括成像装置、方向传感器和存储器,所述成像装置用于采集场景数据,所述场景数据包括缓存主图像,所述方向传感器用于感测所述成像装置的朝向,所述存储器存储有多种三维空间结构类型和对应的构图建议;所述控制装置包括处理模块、获取模块、确定模块和寻找模块。 [0009] A patterned auxiliary control means, the main image buffer for controlling the electronic device, said electronic device includes an imaging apparatus, a direction sensor and a memory, means for acquiring the imaging scene data, said data comprising a scene, the a direction toward said sensor for sensing the image forming apparatus, the memory stores a plurality of three-dimensional structure corresponding to the type and composition advice; said control means includes a processing module, an acquisition module, a determination module, and to find modules.

[0010] 所述处理模块用于处理所述场景数据以获取所述缓存主图像的深度信息。 [0010] The processing module for processing the scene data to obtain depth information for the main image buffer.

[0011] 所述获取模块用于根据所述深度信息获取所述缓存主图像的前景部分。 [0011] The acquisition module for foreground information acquisition portion according to the depth of the main image buffer.

[0012] 所述确定模块用于根据所述前景部分和所述朝向确定当前三维空间结构类型。 [0012] The orientation determining means for determining a current according to the type of three-dimensional structure and the foreground portion.

[0013] 所述寻找模块用于在所述存储器寻找与所述当前三维空间结构类型对应的当前构图建议。 [0013] The looking means for looking for the current recommendations patterned in the memory with the current three-dimensional structure corresponding to the type.

[0014] 一种电子装置包括成像装置、方向传感器、存储器和所述控制装置。 [0014] An electronic apparatus includes an imaging apparatus, a direction sensor, and said memory control means.

[0015] 所述成像装置用于采集场景图像,所述场景图像包括缓存主图像。 [0015] The image forming apparatus for acquiring a scene image, the scene image comprising a main image buffer.

[0016] 所述方向传感器用于感测所述成像装置的朝向。 [0016] toward a direction sensor for sensing the image forming apparatus.

[0017] 所述存储器存储有多种三维空间结构类型和对应的构图建议。 The [0017] The memory stores a plurality of three-dimensional structure corresponding to the type of composition and recommendations.

[0018] 本发明实施方式的控制方法、控制装置及电子装置利用深度信息和方向传感器信息确定当前三维空间结构类型,从而获得当前三维空间结构类型对应的当前构图建议,进而可以辅助构图。 [0018] The control method according to the present embodiment of the invention, the control apparatus and the electronic apparatus using the depth information and the direction information determines the current sensor type three-dimensional structure, so as to obtain a current three-dimensional structure of this recommended composition corresponding to the type, can be further assisted composition.

[0019] 本发明的附加方面和优点将在下面的描述中部分给出,部分将从下面的描述中变得明显,或通过本发明的实践了解到。 [0019] Additional aspects and advantages of the invention will be set forth in part in the description which follows, from the following description in part be apparent from, or learned by practice of the present invention.

附图说明t〇〇20]本发明的上述和/或附加的方面和优点从结合下面附图对实施方式的描述中将变得明显和容易理解,其中: BRIEF DESCRIPTION OF t〇〇20] The above and / or additional aspects and advantages of the present invention in conjunction with the accompanying drawings made from the following description of the embodiment will be apparent and readily appreciated embodiment, wherein:

[0021] 图1是本发明实施方式的辅助构图的控制方法的流程示意图。 [0021] FIG. 1 is a flow diagram of the control method of the embodiment of the auxiliary composition embodiment of the present invention.

[0022] 图2是本发明实施方式的电子装置的功能模块示意图。 [0022] FIG. 2 is a functional module of the electronic apparatus of the embodiment schematic embodiment of the present invention.

[0023] 图3是本发明实施方式的电子装置的平面示意图。 [0023] FIG. 3 is a plan view of an electronic apparatus according to an embodiment of the present invention.

[0024] 图4是本发明某些实施方式的控制方法的流程示意图。 [0024] FIG. 4 is a control method of the present invention, certain embodiments of a schematic flow chart.

[0025] 图5是本发明某些实施方式的电子装置的控制装置的处理模块的功能模块示意图。 [0025] FIG. 5 is a processing module of the control device of the electronic device of the present invention, certain embodiments of the embodiment a schematic functional block.

[0026] 图6是本发明某些实施方式的控制方法的流程示意图。 [0026] FIG. 6 is a control method of the present invention, certain embodiments of a schematic flow chart.

[0027] 图7是本发明某些实施方式的处理模块的另一个功能模块示意图。 [0027] FIG. 7 is another functional module, the processing module of some embodiments of the present invention. FIG.

[0028] 图8是本发明某些实施方式的控制方法的流程示意图。 [0028] FIG. 8 is a control method of the present invention, certain embodiments of a schematic flow chart.

[0029] 图9是本发明某些实施方式的控制装置的获取模块的功能模块示意图。 [0029] FIG. 9 is a control apparatus of the present invention, certain embodiments acquisition module function module schematic diagram.

[0030]图10是本发明某些实施方式的控制方法的流程示意图。 [0030] FIG. 10 is a control method of the present invention, certain embodiments of a schematic flow chart.

[0031]图11是本发明某些实施方式的控制方法的流程示意图。 [0031] FIG. 11 is a schematic flow diagram of a control method of the present invention, certain embodiments of the embodiment.

[0032] 图12是本发明某些实施方式的控制装置的另一个功能模块示意图。 [0032] FIG. 12 is a functional block of another embodiment of the control apparatus of certain embodiments of the present invention. FIG.

[0033] 图13是本发明某些实施方式的缓存主图像示意图。 [0033] FIG. 13 is a schematic view of a main image buffer certain embodiments of the present invention.

[0034] 图14是本发明某些实施方式的深度图像示意图。 [0034] FIG. 14 is a schematic view of an image depth of some embodiments of the present invention.

[0035] 图15是本发明某些实施方式的三维空间系统示意图。 [0035] FIG. 15 is a three-dimensional diagram of the system of some embodiments of the present invention.

[0036]图16是本发明某些实施方式的三维空间结构示意图。 [0036] FIG. 16 is a three-dimensional schematic view of some embodiments of the present invention.

[0037] 主要元件符号说明: [0037] Description of Symbols principal elements:

[0038] 电子装置1〇〇、控制装置10、处理模块11、第一处理单元112、第二处理单元114、第三处理单元lie、第四处理单元11S、获取模块13、第五处理单元132、寻找单元134、确定模块15、寻找模块17、控制模块19、成像装置20、方向传感器30、存储器40、显示器50。 [0038] 1〇〇 electronic device, the control device 10, processing module 11, a first processing unit 112, a second processing unit 114, a third processing unit Lie, fourth processing unit 11S, the acquisition module 13, a fifth processing unit 132 , find unit 134, a determining module 15, the module 17 looking for, the control module 19, the image forming apparatus 20, a direction sensor 30, a memory 40, a display 50.

具体实施方式 Detailed ways

[0039]下面详细描述本发明的实施方式,所述实施方式的实施方式在附图中示出,其中自始至终相同或类似的标号表示相同或类似的元件或具有相同或类似功能的元件。 [0039] The following detailed description of embodiments of the invention, the manner of the embodiment illustrated embodiments in the accompanying drawings, wherein same or similar reference numerals designate the same or similar elements or elements having the same or similar functions. 下面通过参考附图描述的实施方式是示例性的,仅用于解释本发明,而不能理解为对本发明的限制。 By way of the following embodiments described with reference to the accompanying drawings are exemplary only for explaining the present invention and should not be construed as limiting the present invention.

[0040] 请一并参阅图1和图3,本发明实施方式的辅助构图的控制方法可以用于控制电子装置100。 [0040] Referring to FIG. 1 and FIG. 3, a control method for assisting patterned embodiment of the present invention may be used to control the electronic device 100. 电子装置1〇〇包括成像装置20、方向传感器30和存储器40。 1〇〇 electronic device 20 includes an imaging apparatus, a direction sensor 30, and a memory 40. 成像装置20用于采集场景数据,场景数据包括缓存主图像。 The imaging apparatus 20 for acquiring data scene, the scene data including a main image buffer. 方向传感器30用于感测成像装置20的朝向。 A sensor 30 for sensing the direction toward the image forming apparatus 20. 存储器4〇存储有多种三维空间结构类型和对应的构图建议。 4〇 memory stores a plurality of three-dimensional structure corresponding to the type of composition and recommendations. 控制方法包括以下步骤: The control method comprises the steps of:

[0041] S11:处理场景数据以获取缓存主图像的深度信息; [0041] S11: Information Processing scene depth data to obtain the primary image buffer;

[0042] S13:根据深度信息获取缓存主图像的前景部分; [0042] S13: acquiring a main image portion foreground buffer according to the depth information;

[0043] S15:根据前景部分和朝向确定当前三维空间结构类型;和 [0043] S15: three-dimensional structure of the type and orientation of the current foreground portion is determined in accordance with; and

[0044] S17:在存储器40寻找与当前三维空间结构类型对应的当前构图建议。 [0044] S17: Find the current in the memory 40 and the three-dimensional structure corresponding to the type of composition current recommendations.

[0045]具体地,成像装置20的朝向可以理解为成像装置20的拍摄方向,例如成像装置20 朝向为向下,说明成像装置20在拍摄地面的场景;成像装置20朝向为向上,说明成像装置20 在拍摄天空的场景等。 [0045] Specifically, the imaging apparatus 20 toward the imaging direction of the imaging is to be understood that the apparatus 20, for example, the imaging device 20 toward the downward, the scene image forming apparatus 20 described in the captured ground; upward toward the imaging device 20, the image forming apparatus described 20 scenes in the sky and so on.

[0046] 请一并参阅图2和图3,本发明实施方式的辅助构图的控制装置10可以用于控制电子装置100。 [0046] Referring to FIGS. 2 and 3, the auxiliary control device according to an embodiment of the composition of the present invention for controlling the electronic device 10 may be 100. 控制装置10包括处理模块11、获取模块13、确定模块15和寻找模块17。 The control device 10 includes a processing module 11, an obtaining module 13, a determining module 15 and the module 17 looking. 处理模块11用于处理场景数据以获取缓存主图像的深度信息。 The processing module 11 for processing depth information of a scene to obtain the data of the main image buffer. 获取模块13用于根据深度信息获取缓存主图像的前景部分。 Acquiring module 13 for acquiring the main part of the image foreground buffer according to the depth information. 确定模块15用于根据前景部分和朝向确定当前三维空间结构类型。 Determination module 15 for determining the three dimensional structure of this type according to the foreground portion and orientation. 寻找模块17用于在存储器40寻找与当前三维空间结构类型对应的当前构图建议。 Find module 17 in the memory 40 looking for a current with the current recommendations patterned three-dimensional structure corresponding to the type.

[0047] 也即是说,本发明实施方式的控制方法可以由本发明实施方式的控制装置10实现,其中,步骤S11可以由处理模块11实现,步骤S13可以由获取模块13实现,步骤S15可以由确定模块15实现,步骤S17可以由寻找模块17实现。 [0047] That is, a control method of the embodiment of the present invention may be implemented by a control device 10 of the embodiment of the present invention, wherein, the step S11 may be implemented by a processing module 11, the step S13 may be implemented by the acquisition module 13, the step S15 may be made determination module 15 implemented, step S17 may be implemented by module 17 to find.

[0048] 在某些实施方式中,本发明实施方式的控制装置10可以应用于本发明实施方式的电子装置100,或者说本发明实施方式的电子装置100可以包括本发明实施方式的控制装置10。 100, or the electronic apparatus of the embodiment of the present invention [0048] In certain embodiments, the control apparatus of the embodiment 10 of the present invention may be applied to embodiments of the present invention is the electronic device 100 may include a control apparatus 10 of the present embodiment of the invention, .

[0049] 本发明实施方式的控制方法、控制装置10及电子装置100利用深度信息和方向传感器30信息确定当前三维空间结构类型,从而获得当前三维空间结构类型对应的当前构图建议,进而可以辅助构图。 [0049] The control method of the embodiment of the present invention, the control device 10 and the electronic device 100 determines that the current three-dimensional structure of the type use 30 the information depth information and the direction sensor, thereby obtaining the current composition advice this three-dimensional structure corresponding to the type, and thus can be assisted composition .

[0050] 在某些实施方式中,电子装置100包括手机或平板电脑。 [0050] In certain embodiments, the electronic device 100 comprises a mobile phone or tablet. 在本发明实施方式中,电子装置100是手机。 In an embodiment of the present invention, the electronic device 100 is a mobile phone.

[0051] 在某些实施方式中,成像装置20包括前置相机和/或后置相机。 [0051] In certain embodiments, the image forming apparatus 20 includes a front camera and / or a rear camera. 在本发明实施方式中,成像装置20是前置相机。 In an embodiment of the present invention, the imaging device 20 is a front camera.

[0052] 请参阅图4,在某些实施方式中,场景数据包括与缓存主图像对应的深度图像,步骤S11包括以下步骤: [0052] Referring to FIG 4, in some embodiments, the scene data including a depth image corresponding to the main image buffer, the step S11 comprises steps of:

[0053] S112:处理深度图像以获取缓存主图像的深度数据;和[0054] S114:处理深度数据以得到深度信息。 [0053] S112: depth data processing to obtain the depth image of the main image buffer; and [0054] S114: processing data to obtain depth information depth.

[0055] 请参阅图5,在某些实施方式中,场景数据包括与缓存主图像对应的深度图像,处理模块11包括第一处理单元112和第二处理单元114。 [0055] Referring to FIG. 5, in certain embodiments, the scene data including a depth image corresponding to the main image buffer, processing module 11 comprises a first and a second processing unit 112 processing unit 114. 第一处理单元112用于处理深度图像以获取缓存主图像的深度数据。 A first processing unit 112 for processing the depth image depth data for the main image buffer. 第二处理单元114用于处理深度数据以得到深度信息。 The second processing unit 114 for processing depth information to obtain depth data.

[0056] 也即是说,步骤S112可以由第一处理单元112实现,步骤S114可以由第二处理单元114实现。 [0056] That is, step S112 may be implemented by a first processing unit 112, step S114 may be implemented by a second processing unit 114.

[0057] 如此,可以利用深度图像快速获得缓存主图像的深度信息。 [0057] Thus, using the depth information of the depth image can quickly obtain a main image buffer.

[0058]可以理解,缓存主图像为RGB彩色图像,深度图像中包含大量的深度数据,即包含了场景中各个人或物体的深度信息,深度信息包括深度的大小和/或范围。 [0058] It will be appreciated, for the main image buffer RGB color image, the depth image contains a large amount of depth data, i.e., depth information includes each individual scene or object depth information includes depth size and / or range. 由于缓存主图像的色彩信息与深度图像的深度信息是一一对应的关系,因此,可获得缓存主图像的深度信息。 Since the depth information and the color information of the main image buffer depth image is one to one relationship, therefore, a main image buffer depth information.

[0059]在某些实施方式中,与缓存主图像对应的深度图像的获取方式包括采用结构光深度测距获取深度图像及采用飞行时间(time of flight,T0F)深度摄像头获取深度图像两种方式。 [0059] In certain embodiments, the buffer with the depth image corresponding to the main image acquisition options include structured light image and a depth ranging acquired using a time of flight depth (time of flight, T0F) depth camera acquiring a depth image in two ways .

[0060] 采用结构光深度测距获取深度图像时,成像装置2〇包括摄像头和投射器。 [0060] When using the structure of light depth ranging acquiring a depth image, an imaging apparatus includes a camera and a 2〇 projector.

[0061] 可以理解,结构光深度测距是利用投射器将一定模式的光结构投射于物体表面, 在表面形成由被测物体形状所调制的光条三维图像。 [0061] It will be appreciated, the depth distance using structured light projector projects a pattern light structures projected to the object surface, the light bar is formed by a three-dimensional image of the object on the surface modulation shape. 光条三维图像由摄像头探测从而获得光条二维畸变图像。 Detecting light of the three-dimensional image by the camera so as to obtain a two-dimensional distortion of the image light bar. 光条的畸变程度取决于投射器与摄像头之间的相对位置和物体表面形廓或高度。 The degree of distortion depends on the relative position of the light bar and the surface of the object between the projector and the camera-shaped profile or height. 沿光条显示出的位移与物体表面的高度成比例,扭结表示了平面的变化,不连续显示表面的物理间隙。 Along the light bars show displacement proportional to the height of the object surface, kink shows the variations planar clearance surface discontinuities physical display. 当投射器与摄像头之间的相对位置一定时,由畸变的二维光条图像坐标便可重现物体表面的三维轮廓,从而可以获取深度信息。 When a certain relative position between camera and projector, a two-dimensional image coordinates of the light of the distortion can reproduce three-dimensional profile of the object surface, so that depth information can be acquired. 结构光深度测距具有较高的分辨率和测量精度。 Depth ranging structured light having a higher resolution and accuracy.

[0062] 采用T0F深度摄像头获取深度图像时,成像装置20包括T0F深度摄像头。 When [0062] The depth camera T0F acquiring a depth image, the image forming apparatus 20 includes a T0F depth camera.

[0063] 可以理解,T0F深度摄像头通过传感器记录从发光单元发出的调制红外光发射到物体,再从物体反射回来的相位变化,在一个波长的范围内根据光速,可以实时的获取整个场景深度距离。 [0063] It will be appreciated, modulated infrared T0F depth camera emitted from the light emitting unit by a sensor recording the light emitted to the object, the phase change and then reflected from the object back, according to the speed of light, may acquire the entire scene depth distance in real time over a range of wavelengths . T0F深度摄像头计算深度信息时不受被摄物表面的灰度和特征的影响,且可以快速地计算深度信息,具有很高的实时性。 T0F depth camera from the subject and the gradation characteristics of the impact surface of calculating the depth information, and depth information can be calculated quickly, with high real-time.

[0064] 请参阅图6,在某些实施方式中,场景数据包括与缓存主图像对应的缓存副图像, 步骤S11包括以下步骤: [0064] Referring to FIG 6, in some embodiments, the sub-scene image data includes a buffer cache corresponding to the main image, the step S11 comprises steps of:

[0065] S116:处理缓存主图像和缓存副图像以得到缓存主图像的深度数据;和 [0065] S116: the depth of the main image data processing buffer, and cache buffer to give the sub-picture main image; and

[0066] SI I8:处理深度数据以得到深度信息。 [0066] SI I8: depth data processing to obtain depth information.

[0067] 请参阅图7,在某些实施方式中,场景数据包括与缓存主图像对应的缓存副图像, 处理模块11包括第三处理单元116和第四处理单元118。 [0067] Referring to FIG. 7, in some embodiments, the sub-scene image data includes a buffer cache corresponding to the main image, the processing module 11 comprises a third and a fourth processing unit 116 processing unit 118. 第三处理单元116用于处理缓存主图像和缓存副图像以得到缓存主图像的深度数据。 The third processing unit 116 for processing the main image buffer and the depth buffer to obtain sub-picture data buffer of the main image. 第四处理单元118用于处理深度数据以得到深度信息。 A fourth processing unit 118 to obtain depth data for processing depth information.

[0068] 也即是说,步骤S116可以由第三处理单元116实现,步骤S118可以由第四处理单元118实现。 [0068] That is, step S116 may be implemented by a third processing unit 116, step S118 may be implemented by the fourth processing unit 118.

[0069] 如此,可以通过处理缓存主图像和缓存副图像获取缓存主图像的深度信息。 [0069] Thus, the depth information may be acquired by the main image buffer cache processing main image and sub-picture buffer.

[0070] 在某些实施方式中,成像装置20包括主摄像头和副摄像头。 [0070] In certain embodiments, the image forming apparatus 20 includes a main camera and the sub camera.

[0071] 可以理解,深度信息可以通过双目立体视觉测距方法进行获取,此时场景数据包括缓存主图像和缓存副图像。 [0071] It will be appreciated, the depth information may be acquired by the stereo vision ranging method, when a scene data comprises a main image buffer and the sub-picture buffer. 其中,缓存主图像由主摄像头拍摄得到,缓存副图像由副摄像头拍摄得到。 Wherein the primary cache captured by the main camera image obtained by the secondary cache sub-image pickup camera obtained. 双目立体视觉测距是运用两个相同的摄像头对同一被摄物从不同的位置成像以获得被摄物的立体图像对,再通过算法匹配出立体图像对的相应像点,从而计算出视差, 最后采用基于三角测量的方法恢复深度信息。 Binocular stereo vision distance is the use of two identical cameras on the same subject to obtain a stereoscopic image of the subject from different imaging positions, and through the matching algorithm corresponding image points on the stereoscopic image, thereby calculating the parallax Finally, the use of restorative depth information based on the triangulation method. 如此,通过对缓存主图像和缓存副图像这一立体图像对进行匹配便可获得缓存主图像的深度信息。 Thus, by caching the main image and sub image of the stereoscopic image buffer to match the depth information can be obtained main image buffer.

[0072] 请参阅图8,在某些实施方式中,步骤S13包括以下步骤: [0072] Referring to FIG. 8, in some embodiments, the step S13 comprises steps of:

[0073] S132:根据深度信息获得缓存主图像的最前点;和 [0073] S132: The depth information obtaining cache-most point of the main picture; and

[0074] S134:寻找与最前点连续连接且深度连续变化的区域作为前景部分。 [0074] S134: Looking continuously connected to the most forward point of the region and the depth changes continuously as the foreground portion.

[0075] 请参阅图9,在某些实施方式中,获取模块13包括第五处理单元132和寻找单元134。 [0075] Referring to FIG 9, in some embodiments, the obtaining module 13 includes a fifth processing unit 132 and the unit 134 to find. 第五处理单元132用于根据深度信息获得缓存主图像的最前点。 A fifth processing unit 132 for obtaining the most forward point of the depth information in accordance with the main image buffer. 寻找单元134用于寻找与最前点连续连接且深度连续变化的区域作为前景部分。 Looking unit 134 for finding a continuous connection to the front most point area and the depth changes continuously as the foreground portion.

[0076] 也即是说,步骤S132可以由第五处理单元132实现,步骤S134可以由寻找单元134 实现。 [0076] That is, step S132 may be implemented by the fifth processing unit 132, step S134 may be realized by means 134 to find.

[0077]如此,可以获得缓存主图像物理联系的前景部分,即在现实场景中,前景部分是连接在一起的。 [0077] Thus, the image can be obtained master cache foreground portion of physical contact, i.e. in a real scene, the foreground portion are connected together. 以物理联系的前景部分作为主体,可以直观地获得前景部分的关系。 Portion of the physical contact with prospects as a host, you can visually obtain the relationship between the foreground portion.

[0078]具体地,先根据深度信息获得缓存主图像中每个像素点的深度,获得深度最小的像素点作为缓存主图像的最前点,最前点相当于前景部分的开端,从最前点进行扩散,获取与最前点连续连接并且深度连续变化的区域,这些区域和最前点归并为前景区域。 [0078] Specifically, to obtain the depth information of the depth of each pixel of the cache main image, obtained minimum depth of a pixel as the most forward point of the cache of the main image, the most forward point corresponding to the beginning of the foreground portion, diffused from the most forward point of obtaining continuously connected to the foremost point and the depth of continuously varying regions which merge and the most forward point of the foreground region.

[007 9]需要说明的是,最前点指的是深度最小的物体对应的像素点,即物距最小或者离成像装置20最近的物体对应的像素点。 [0079] Incidentally, the foremost point refers to a point of minimum depth of a pixel corresponding to an object, i.e., a minimum object distance, or from the image forming apparatus 20 nearest object point corresponding to a pixel. 邻接是指两个像素点连接在一起。 It refers to two adjacent pixels are connected together. 深度连续变化时指邻接的两个像素点的深度差值小于预定差值,或者说深度之差小于预定差值的两个邻接的像素点的深度连续变化。 Refers to the difference between a depth changes continuously two adjacent pixels is less than a predetermined difference continuous variation in the depth, or the depth is less than the difference between two adjacent pixels of a predetermined difference.

[0080]请参阅图10,在某些实施方式中,步骤S13可以包括以下步骤: [0080] Referring to FIG 10, in certain embodiments, the step S13 may include the steps of:

[0081] S136:根据深度信息获得缓存主图像的最前点;和 [0081] S136: The depth information obtaining cache-most point of the main picture; and

[0082] S138:寻找与最前点的深度之差小于预定阈值的区域作为前景部分。 [0082] S138: Looking for areas with the most forward point of the difference is less than the predetermined depth threshold value as foreground portion.

[0083]如此,可以获得缓存主图像逻辑联系的前景部分,g卩在现实场景中,前景部分可能没有连接在一起,但是符合某种逻辑关系,比如老鹰俯冲下来抓小鸡的场景,老鹰和小鸡物理上可能没连接在一起,但是从逻辑上,可以判断它们是联系起来的。 [0083] Thus, it is possible to obtain the main image cache logical connections foreground portion, g Jie in the real scene, the outlook section may not be connected together, but in line with some logical relationship, such as eagles swoop down to catch the chicks scene, and the Eagles on the chick may not be connected physically, but logically, it is possible to determine if they are linked.

[0084]具体地,先根据深度信息获得缓存主图像的最前点,最前点相当于前景部分的开端,从最前点进行扩散,获取与最前点的深度之差小于预定阈值的区域,这些区域和最前占归并为前景区域。 [0084] Specifically, the first based on the depth information acquired cache main image most point, most point corresponding to the beginning of the foreground portion, diffused from the most forward point, the difference between the depth of acquiring the most forward point of the area smaller than the predetermined threshold value, these regions and before accounting for most merged into the foreground region. 1 1

[0085]在某些实施方式中,预定阈值可以是由用户设置的一个值。 [0085] In certain embodiments, the predetermined threshold may be a value set by the user. 如此,用户可根据自身的需求来确定前景部分的范围,从而获得理想的构图建议,实现理想的构图。 Thus, the user can determine the scope of the foreground portion according to their needs, in order to obtain the desired composition advice, to achieve the desired composition.

[0086]在某些实施方式中,预定阈值可以是控制装置10确定的一个值,在此不做任何限制。 [0086] In certain embodiments, the predetermined threshold may be a value determined by the control means 10, which is not any restriction. 控制装置10确定的预定阈值可以是内部存储的一个固定值,也可以是根据不同情况,例如最前点的深度,计算出来的数值。 The control device 10 determines the predetermined threshold value may be a fixed value stored internally, or may be based on different circumstances, such as deep most point of the calculated value.

[0087] 在某些实施方式中,步骤S13可以包括以下步骤: [0087] In certain embodiments, the step S13 may include the steps of:

[0088]寻找深度处于预定区间的区域作为前景部分。 [0088] Looking at a predetermined region of the depth interval as the foreground portion.

[0089]如此,可以获得深度处于合适范围的前景部分。 [0089] Thus, the depth can be obtained in a foreground portion suitable range.

[0090]可以理解,有些拍摄情况下,前景部分并不是最前面的部分,而是最前面部分稍微靠后一点的部分,例如,人坐在电脑后面,电脑比较靠前,但是人才是主体部分,所以将深度处于预定区间的区域作为前景部分,可以有效地避免主体选择不正确的问题。 [0090] It is understood that in some shooting conditions, not part of the foremost part of the prospect, but little by little the front portion of the rear section, for example, people sitting behind computers, computer quite early, but the main part of talents , the depth of the region at a predetermined interval as a foreground portion, can effectively avoid the problem of the body not selected properly.

[0091]在某些实施方式中,方向传感器30包括重力传感器,通过重力传感器可以获得成像装置20的朝向。 [0091] In certain embodiments, the direction sensor 30 includes a gravity sensor, a gravity sensor may be obtained by the imaging device 20 toward the.

[0092]在某个实施例中,根据前景部分和朝向确定当前三维空间结构类型的方法如下: 首先根据传感器得知成像装置2〇的朝向,从成像装置20的朝向可以反推图像的当前朝向,比^口^前成像装置20朝前时,可以反推出图像呈前后分布,分析前景部分的图像内容, 比如如景部分存在两个色彩特殊的物体,可以确定当前空间结构类型属于井字型。 [0092] In certain embodiments, determining the orientation in accordance with the current foreground portion and the three dimensional structure of the type as follows: First, that the orientation of the imaging apparatus according 2〇 sensor, can reverse thrust toward the image from the imaging device 20 toward the current , before the image forming apparatus 20 than toward the front, can be introduced ^ trans ^ port was distributed before and after the image, the foreground image content analysis section, there is a special part such as background colors of two objects can be determined the spatial structure of the current font type is well .

[0093]请一并参阅图3和图11,在某些实施方式中,电子装置100包括显示器50,控制方法包括以下步骤: [0093] Referring to FIGS. 3 and 11, in some embodiments, the electronic device 100 includes a display 50, the control method comprising the steps of:

[0094] S19:控制显示器50显示当前构图建议。 [0094] S19: controlling the display 50 to display the current composition suggestions.

[0095^请参阅图丨2,在某些实施方式中,控制装置10包括控制模块19。 [0095 Shu ^ Referring to FIG. 2, in some embodiments, the control device 10 includes a control module 19. 控制模块19用于控制显示器50显示当前构图建议。 The control module 19 for controlling the display 50 to display the current composition suggestions.

[0096] 也即是说,步骤S19可以由控制模块19实现。 [0096] That is, step S19 may be implemented by the control module 19.

[0097] 如此,可以告知用户当前构图建议并引导用户操作电子装置100,从而遵循当前构图建议完成构图。 [0097] Thus, the composition may inform the user of the current recommendations and guides the user operating the electronic device 100, so that the composition is recommended to follow the current complete composition.

[0098]可以理解,控制装置10在获得当前构图建议后,需要告知用户以实现当前构图,通过显示器显示当前构图建议,用户可快速地理解如何操作。 [0098] It will be appreciated, the control device 10 in obtaining this composition advice is required to inform the user in order to achieve this composition, this composition is recommended, the user can quickly understand how to operate the display by the display.

[0099] 在某些实施方式中,电子装置1〇〇包括电声器件,控制方法包括以下步骤: [0099] In certain embodiments, the electronic device comprises an electric 1〇〇 acoustic device, the control method comprising the steps of:

[0100] 控制电声器件提示当前构图建议。 [0100] control electro-acoustic devices indicating the current composition advice.

[0101]如此,可以使用语音的方式提示用户如何实现构图。 [0101] Thus, the way you can use voice prompts the user how to achieve the composition.

[0102] 请一并参阅图13-16,在一个实施例中,控制装置10控制成像装置20获得场景数据,场景数据包括如图13所示的缓存主图像和如图14所述的深度图像,根据深度图像可以获得前景部分以作为图像主体,根据前景部分和方向传感器30获得的成像装置20的朝向建立如图15所述的三维空间系统,再根据三维空间系统确定如图16所示的当前三维空间结构类型,最后从存储器40中寻找当前三维空间结构类型对应的当前构图建议,从而提示用户如何完成当前构图。 [0102] Referring to Figures 13-16, in one embodiment, the control device 10 controls the image forming apparatus 20 obtains data of a scene, the scene data including a main image buffer shown in FIG. 13 and FIG. 14, the depth image the depth image may be obtained as an image foreground portion main body, the establishment of the system of three-dimensional space as shown in FIG 15 toward the image forming apparatus and a foreground portion 20, the direction sensor 30 is obtained, and then determining the three-dimensional space shown in FIG. 16 system current type three-dimensional structure, and finally look for the current recommendations of the current three-dimensional structure is patterned corresponding to the type from the memory 40, thereby prompting the user how to complete the current composition.

[0103] 在本发明的实施方式的描述中,术语“第一”、“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。 The number of technical features [0103] In the description of embodiments of the present invention, the terms "first", "second" are for illustrative purposes only, and not intended to indicate or imply relative importance or implicitly indicated by the specified . 由此,限定有“第一”、 “第二”的特征可以明示或者隐含地包括一个或者更多个所述特征。 Thus, there is defined "first", "second" features may be explicitly or implicitly include the features of one or more. 在本发明的实施方式的描述中,“多个”的含义是两个或两个以上,除非另有明确具体的限定。 In the description of embodiments of the present invention, the meaning of "more" is two or more, unless specifically defined otherwise specifically.

[0104] 在本发明的实施方式的描述中,需要说明的是,除非另有明确的规定和限定,术语“安装”、“相连”、“连接”应做广义理解,例如,可以是固定连接,也可以是可拆卸连接,或一体地连接;可以是机械连接,也可以是电连接或可以相互通讯;可以是直接相连,也可以通过中间媒介间接相连,可以是两个元件内部的连通或两个元件的相互作用关系。 [0104] In the description of embodiments of the present invention, it should be noted that, unless otherwise expressly specified or limited, the terms "mounted," "connected to", "connected" are to be broadly understood, for example, it may be a fixed connection , may be detachably connected to, or integrally connected; may be a mechanical connection, or may be electrically connected to communicate with each other; may be directly connected, it can also be connected indirectly via an intermediate medium, which may be internal or two communication elements interaction between the two elements. 对于本领域的普通技术人员而言,可以根据具体情况理解上述术语在本发明的实施方式中的具体含义。 Those of ordinary skill in the art, to be understood that the specific meanings in the embodiment of the present invention depending on the circumstances. _5] 在本说明书的描述中,参考术语“一个实施方式”、“一些实施方式,,、“示意性实施方式”、“示例”、“具体示例”或“一些示例”等的描述意指结合所述实施方式或示例描述的具体特征、结构、材料或者特点包含于本发明的至少一个实施方式或示例中。在本说明书中, 对上述术语的示意性表述不一定指的是相同的实施方式或示例。而且,描述的具体特征、结构、材料或者特点可以在任何的一个或多个实施方式或示例中以合适的方式结合。 [5] In the description of the present specification, reference to the term "one embodiment," "some embodiments ,,," exemplary embodiments "," an example "," a specific example ", or" some examples "means that a described embodiment or a particular feature of the embodiment example described, structure, material, or characteristic is included in at least one embodiment of the present invention or embodiment examples. in the present specification, a schematic representation of the above terms are not necessarily referring to the same embodiment or example Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples.

[0106] 流程图中或在此以其他方式描述的任何过程或方法描述可以被理解为,表示包括一个或更多个用于实现特定逻辑功能或过程的步骤的可执行指令的代码的模块、片段或部分,并且本发明的优选实施方式的范围包括另外的实现,其中可以不按所示出或讨论的顺序,包括根据所涉及的功能按基本同时的方式或按相反的顺序,来执行功能,这应被本发明的实施例所属技术领域的技术人员所理解。 [0106] In the flowchart in any process or method or otherwise described in this description may be understood as representing modules comprises one or more steps for implementing specific logical functions or processes executable instructions, fragment or portion, and the scope of the preferred embodiment of the present invention includes other implementations, which may be shown or discussed in order not press, comprising a substantially simultaneous manner or in reverse order, depending upon the functionality to perform the functions involved it should be understood that embodiments skilled in the art of the present invention.

[0107] 在流程图中表示或在此以其他方式描述的逻辑和/或步骤,例如,可以被认为是用于实现逻辑功能的可执行指令的定序列表,可以具体实现在任何计算机可读介质中,以供指令执行系统、装置或设备(如基于计算机的系统、包括处理模块的系统或其他可以从指令执行系统、装置或设备取指令并执行指令的系统)使用,或结合这些指令执行系统、装置或设备而使用。 [0107] or represents a logical and / or steps described herein in other ways, for example, may be considered as a sequencing table executable instructions for implementing logical functions in the flowcharts, can be embodied in any computer-readable medium to instruction execution system, apparatus, or device (e.g., computer-based system, a system including a processing module or another to perform system from the instruction, apparatus, or device and executing the instruction systems) use, or in connection with the instruction execution system, apparatus, or device used. 就本说明书而言,〃计算机可读介质〃可以是任何可以包含、存储、通信、传播或传输程序以供指令执行系统、装置或设备或结合这些指令执行系统、装置或设备而使用的装置。 For purposes of this description, a computer-readable medium 〃 〃 may be any means that can contain, store, communicate, propagate, or transport the program for instruction execution system, apparatus, or device, or with the instruction execution system, apparatus, or device and used. 计算机可读介质的更具体的示例(非穷尽性列表)包括以下:具有一个或多个布线的电连接部(电子装置),便携式计算机盘盒(磁装置),随机存取存储器(RAM),只读存储器(ROM),可擦除可编辑只读存储器(EPROM或闪速存储器),光纤装置,以及便携式光盘只读存储器(CDR0M)。 More specific examples (a non exhaustive list) of the computer-readable medium comprising: an electrical connection (electronic device) having one or more wires, a portable computer diskette cartridge (magnetic device), a random access memory (RAM), a read only memory (ROM), erasable edit readonly memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDR0M). 另外,计算机可读介质甚至可以是可在其上打印所述程序的纸或其他合适的介质,因为可以例如通过对纸或其他介质进行光学扫描,接着进行编辑、解译或必要时以其他合适方式进行处理来以电子方式获得所述程序,然后将其存储在计算机存储器中。 Further, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as can, for example paper or other medium by optical scanning, and then edited, if necessary, interpreted, or otherwise suitable to be processed using the program obtained electronically, and then stored in a computer memory.

[0108] 应当理解,本发明的实施方式的各部分可以用硬件、软件、固件或它们的组合来实现。 [0108] It should be understood that various portions of the embodiment of the present invention may be implemented in hardware, software, firmware or a combination thereof to achieve. 在上述实施方式中,多个步骤或方法可以用存储在存储器中且由合适的指令执行系统执行的软件或固件来实现。 In the above-described embodiment, a plurality of steps or methods may be implemented in software or firmware and executed by a suitable system executing instructions stored in a memory with. 例如,如果用硬件来实现,和在另一实施方式中一样,可用本领域公知的下列技术中的任一项或他们的组合来实现:具有用于对数据信号实现逻辑功能的逻辑门电路的离散逻辑电路,具有合适的组合逻辑门电路的专用集成电路,可编程门阵列(PGA),现场可编程门阵列(FPGA)等。 For example, if implemented in hardware, as in another embodiment, the present technique may be any one of the following well-known in the art, or their combination thereof: a logic gate circuit for implementing logic functions upon data signals discrete logic circuits having appropriate combinational logic gate circuit ASIC, a programmable gate array (PGA), a field programmable gate array (FPGA) and the like.

[0109] 本技术领域的普通技术人员可以理解实现上述实施例方法携带的全部或部分步骤是可以通过程序来指令相关的硬件完成,所述的程序可以存储于一种计算机可读存储介质中,该程序在执行时,包括方法实施例的步骤之一或其组合。 [0109] skilled in the art can understand that ordinary method embodiments that all or part of the steps may be by a program instructing relevant hardware, the program may be stored in a computer-readable storage medium, one of the steps in the implementation of the embodiment of the method includes the program, or combinations thereof.

[0110] 此外,在本发明的各个实施例中的各功能单元可以集成在一个处理模块中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个模块中。 [0110] Further, various functional units in the embodiments of the present invention may be integrated in one processing module, or may be physically separate units exist, may be two or more units are integrated in one module. 上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。 The integrated module may be implemented in the form of hardware, software functional modules may also be implemented. 所述集成的模块如果以软件功能模块的形式实现并作为独立的产品销售或使用时,也可以存储在一个计算机可读取存储介质中。 If the integrated module is implemented as an independent product sold or used in the form of a software functional module, it may be stored in a computer-readable storage medium.

[0111] 上述提到的存储介质可以是只读存储器,磁盘或光盘等。 [0111] The storage medium may be a read-only memory, magnetic or optical disk.

[0112] 尽管上面已经示出和描述了本发明的实施例,可以理解的是,上述实施例是示例性的,不能理解为对本发明的限制,本领域的普通技术人员在本发明的范围内可以对上述实施方式进行变化、修改、替换和变型。 [0112] Although the above has been illustrated and described embodiments of the present invention, it is understood that the above embodiments are exemplary and are not to be construed as limiting the present invention, within the scope of the invention to those of ordinary skill in the art It may be variations of the above embodiments, modifications, alternatives, and modifications.

Claims (15)

1.一种辅助构图的控制方法,用于控制电子装置,其特征在于,所述电子装置包括成像装置、方向传感器和存储器,所述成像装置用于采集场景数据,所述场景数据包括缓存主图像,所述方向传感器用于感测所述成像装置的朝向,所述存储器存储有多种三维空间结构类型和对应的构图建议;所述控制方法包括以下步骤: 处理所述场景数据以获取所述缓存主图像的深度信息; 根据所述深度信息获取所述缓存主图像的前景部分; 根据所述前景部分和所述朝向确定当前三维空间结构类型;和在所述存储器寻找与所述当前三维空间结构类型对应的当前构图建议。 1. A method for controlling an auxiliary composition, for controlling the electronic apparatus, wherein the electronic device includes an imaging apparatus, a direction sensor and a memory, said image forming means for acquiring a scene data of the scene data comprises a main cache toward the image, the direction sensor for sensing the image forming apparatus, the memory stores a plurality of three-dimensional structure corresponding to the type and composition recommendations; the method comprising the steps of: processing the data to obtain the scene depth information buffer of said primary image; said foreground buffer acquiring main image part on the depth information; determining a current orientation according to the type of three-dimensional structure and the foreground portion; and looking in the memory with the current three-dimensional spatial structure corresponding to the type of the current composition advice.
2. 如权利要求1所述的控制方法,其特征在于,所述场景数据包括与所述缓存主图像对应的深度图像,所述处理所述场景数据以获取所述缓存主图像的深度信息的步骤包括以下步骤: 处理所述深度图像以获取所述缓存主图像的深度数据;和处理所述深度数据以得到所述深度信息。 The control method according to claim 1, wherein said scene image and the data includes a depth buffer corresponding to the main image, the processing of the scene to obtain depth information for the data of the main image buffer step comprises the step of: processing said image to obtain the depth cache to the depth data of the main image; and processing the data to obtain depth information of the depth.
3. 如权利要求1所述的控制方法,其特征在于,所述场景数据包括与所述缓存主图像对应的缓存副图像,所述处理所述场景数据以获取所述缓存主图像的深度信息的步骤包括以下步骤: 处理所述缓存主图像和所述缓存副图像以得到所述缓存主图像的深度数据;和处理所述深度数据以得到所述深度信息。 3. The control method according to claim 1, wherein said context data comprises the sub-buffer cache corresponding to the main picture, the processing of the scene data to obtain depth information for the main image buffer step comprises the steps of: processing the main image buffer and the depth buffer to obtain sub-picture data of the main image buffer; and processing the data to obtain depth information of the depth.
4. 如权利要求1所述的控制方法,其特征在于,所述根据所述深度信息获取所述缓存主图像的前景部分的步骤包括以下步骤: 根据所述深度信息获得所述缓存主图像的最前点;和寻找与所述最前点连续连接且深度连续变化的区域作为所述前景部分。 The control method according to claim 1, wherein said step of acquiring the foreground portion of the main image buffer comprises the steps according to the depth information: the main image buffer according to the depth information obtaining most point; and finding the most forward point of continuously connected continuously varying depth and area as the foreground portion.
5. 如权利要求1所述的控制方法,其特征在于,所述电子装置包括显示器,所述控制方法包括以下步骤: 控制所述显示器显示所述当前构图建议。 5. The control method according to claim 1, wherein said electronic device comprises a display, the method comprising the steps of: controlling the display to display the current recommended composition.
6. —种辅助构图的控制装置,用于控制电子装置,其特征在于,所述电子装置包括成像装置、方向传感器和存储器,所述成像装置用于采集场景数据,所述场景数据包括缓存主图像,所述方向传感器用于感测所述成像装置的朝向,所述存储器存储有多种三维空间结构类型和对应的构图建议;所述控制装置包括: 处理模块,所述处理模块用于处理所述场景数据以获取所述缓存主图像的深度信息; 获取模块,所述获取模块用于根据所述深度信息获取所述缓存主图像的前景部分; 确定模块,所述确定模块用于根据所述前景部分和所述朝向确定当前三维空间结构类型;和寻找模块,所述寻找模块用于在所述存储器寻找与所述当前三维空间结构类型对应的当前构图建议。 6. - adjuncts patterned control means for controlling the electronic apparatus, wherein the electronic device includes an imaging apparatus, a direction sensor and a memory, said image forming means for acquiring a scene data of the scene data comprises a main cache image, toward a direction sensor for sensing the image forming apparatus, the memory stores a plurality of three-dimensional structure corresponding to the type and composition advice; said control means comprises: a processing module, the processing module for processing the scene data to obtain depth information for the main image buffer; acquisition module, the acquisition module is configured to cache the foreground portion of the main image acquired according to the depth information; determining module, the determining module according to the said foreground portion and determining the current orientation of the three-dimensional structure type; and finding module, the module is to find the current recommendations for finding patterned in the memory with the current three-dimensional structure corresponding to the type.
7. 如权利要求6所述的控制装置,其特征在于,所述场景数据包括与所述缓存主图像对应的深度图像,所述处理模块包括: 第一处理单元,所述第一处理单兀用于处理所述深度图像以获取所述缓存主图像的深度数据;和第二处理单元,所述第二处理单元用于处理所述深度数据以得到所述深度信息。 7. The control apparatus according to claim 6, wherein said scene image and the data includes a depth buffer corresponding to the main image, the processing module comprises: a first processing unit, the first processing unit Wu for processing to obtain the depth image depth data of the main image buffer; and a second processing unit, the second processing unit for processing the data to obtain depth information of the depth.
8. 如权利要求6所述的控制装置,其特征在于,所述场景数据包括与所述缓存主图像对应的缓存副图像,所述处理模块包括: 第三处理单元,所述第三处理单元用于处理所述缓存主图像和所述缓存副图像以得到所述缓存主图像的深度数据;和第四处理单元,所述第四处理单元用于处理所述深度数据以得到所述深度信息。 Third processing unit to the third processing unit: 8. The control device according to claim 6, wherein the context data comprises the sub-buffer cache corresponding to the main picture, the processing module comprises for processing the main image buffer and the depth buffer to obtain sub-picture data of the main image buffer; and a fourth processing unit, the fourth processing unit for processing the data to obtain depth information of the depth .
9. 如权利要求6所述的控制装置,其特征在于,所述获取模块包括: 第五处理单元,所述第五处理单元用于根据所述深度信息获得所述缓存主图像的最前点;和寻找单元,所述寻找单元用于寻找与所述最前点连续连接且深度连续变化的区域作为所述前景部分。 The control apparatus as claimed in claim 6, wherein the obtaining module comprises: a fifth processing unit, the fifth processing unit for caching the most forward point of the main image is obtained based on the depth information; and finding means for finding a means to find a continuous connection to the front most point of the continuously varying depth and area as the foreground portion.
10. 如权利要求6所述的控制装置,其特征在于,所述电子装置包括显示器,所述控制装置包括: 控制模块,所述控制模块用于控制所述显示器显示所述当前构图建议。 10. The control apparatus according to claim 6, wherein said electronic device comprises a display, said control means comprising: a control module, the control module for controlling the display to display the current recommended composition.
11. 一种电子装置,其特征在于,包括: 成像装置,所述成像装置用于采集场景图像,所述场景图像包括缓存主图像; 方向传感器,所述方向传感器用于感测所述成像装置的朝向; 存储器,所述存储器存储有多种三维空间结构类型和对应的构图建议;和如权利要求6-10任意一项所述的控制装置。 An electronic device comprising: an imaging means, the imaging means for acquiring a scene image, the scene image comprising a main image buffer; direction sensor, a direction sensor for sensing the image forming apparatus orientation; a memory storing a plurality of three-dimensional structure corresponding to the type and composition recommendations; and control means as claimed in any of claims 6-10 said.
12.如权利要求11所述的电子装置,其特征在于,所述电子装置包括手机或平板电脑。 The electronic device according to claim 11, wherein said electronic device comprises a mobile phone or tablet.
13.如权利要求11所述的电子装置,其特征在于,所述成像装置包括主摄像头和副摄像头。 13. The electronic device according to claim 11, wherein said image forming apparatus comprises a main camera and the sub camera.
14.如权利要求11所述的电子装置,其特征在于,所述成像装置包括摄像头和投射器。 14. The electronic device of claim 11, wherein said image forming apparatus includes a camera and a projector.
15.如权利要求11所述的电子装置,其特征在于,所述成像装置包括T0F深度摄像头。 15. The electronic device according to claim 11, wherein said image forming means comprises a T0F depth camera.
CN201710138849.9A 2017-03-09 2017-03-09 Control method and control device of auxiliary composition, and electronic device CN106973224A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710138849.9A CN106973224A (en) 2017-03-09 2017-03-09 Control method and control device of auxiliary composition, and electronic device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710138849.9A CN106973224A (en) 2017-03-09 2017-03-09 Control method and control device of auxiliary composition, and electronic device

Publications (1)

Publication Number Publication Date
CN106973224A true CN106973224A (en) 2017-07-21

Family

ID=59329377

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710138849.9A CN106973224A (en) 2017-03-09 2017-03-09 Control method and control device of auxiliary composition, and electronic device

Country Status (1)

Country Link
CN (1) CN106973224A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107551551A (en) * 2017-08-09 2018-01-09 广东欧珀移动通信有限公司 Game effect construction method and device
WO2018161323A1 (en) * 2017-03-09 2018-09-13 广东欧珀移动通信有限公司 Depth-based control method and control device and electronic device

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1551616A (en) * 2003-05-15 2004-12-01 Lg电子株式会社 Portable phone with camera and customizable photographic composition guidelines
CN101540844A (en) * 2008-03-19 2009-09-23 索尼株式会社 Composition determination device, composition determination method, and program
US20110317873A1 (en) * 2000-11-06 2011-12-29 Boncyk Wayne C Image Capture and Identification System and Process
JP2012080236A (en) * 2010-09-30 2012-04-19 Hitachi Solutions Ltd Electronic device, and method and program for displaying captured image area with information
CN103634588A (en) * 2012-08-27 2014-03-12 联想(北京)有限公司 Image composition method and electronic apparatus
CN106484086A (en) * 2015-09-01 2017-03-08 北京三星通信技术研究有限公司 Method for auxiliary shooting, and shooting equipment thereof

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110317873A1 (en) * 2000-11-06 2011-12-29 Boncyk Wayne C Image Capture and Identification System and Process
CN1551616A (en) * 2003-05-15 2004-12-01 Lg电子株式会社 Portable phone with camera and customizable photographic composition guidelines
CN101540844A (en) * 2008-03-19 2009-09-23 索尼株式会社 Composition determination device, composition determination method, and program
JP2012080236A (en) * 2010-09-30 2012-04-19 Hitachi Solutions Ltd Electronic device, and method and program for displaying captured image area with information
CN103634588A (en) * 2012-08-27 2014-03-12 联想(北京)有限公司 Image composition method and electronic apparatus
CN106484086A (en) * 2015-09-01 2017-03-08 北京三星通信技术研究有限公司 Method for auxiliary shooting, and shooting equipment thereof

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018161323A1 (en) * 2017-03-09 2018-09-13 广东欧珀移动通信有限公司 Depth-based control method and control device and electronic device
CN107551551A (en) * 2017-08-09 2018-01-09 广东欧珀移动通信有限公司 Game effect construction method and device

Similar Documents

Publication Publication Date Title
JP4440681B2 (en) Method for generating a stylized image
CN101960860B (en) System and method for depth map extraction using region-based filtering
US8787656B2 (en) Method and apparatus for feature-based stereo matching
US7103227B2 (en) Enhancing low quality images of naturally illuminated scenes
US7206449B2 (en) Detecting silhouette edges in images
JP4364687B2 (en) Methods for enhancing the image quality of the low quality of the video
JP4737573B2 (en) 3-dimensional image output apparatus and method
US9898856B2 (en) Systems and methods for depth-assisted perspective distortion correction
CN101390131B (en) Rendering an output image
US7102638B2 (en) Reducing texture details in images
JP5160643B2 (en) Three-dimensional object recognition system and method from 2D images
EP2184713A1 (en) Method and device for generating a depth map
CN101305401B (en) Method for processing stereo video for gaming
JP5615552B2 (en) Generation of the depth map of the image
CN101542537B (en) Methods and systems for color correction of 3D images
CN102597693B (en) Distance measuring device, distance measuring method, distance measuring program, distance measuring system, and image capturing device
KR101121034B1 (en) System and method for obtaining camera parameters from multiple images and computer program products thereof
US8452081B2 (en) Forming 3D models using multiple images
US9237330B2 (en) Forming a stereoscopic video
JP4879326B2 (en) System and method for synthesizing 3-dimensional image
US20120242795A1 (en) Digital 3d camera using periodic illumination
US8611641B2 (en) Method and apparatus for detecting disparity
CN101432776B (en) System and method for three-dimensional object reconstruction from two-dimensional images
JP2004005596A (en) Method and system for three dimentionally recovering multiple views in varying search route and occlusion modeling
CN102056003A (en) High density multi-view image display system and method with active sub-pixel rendering

Legal Events

Date Code Title Description
SE01 Entry into force of request for substantive examination