WO2016187985A1 - Photographing device, tracking photographing method and system, and computer storage medium - Google Patents

Photographing device, tracking photographing method and system, and computer storage medium Download PDF

Info

Publication number
WO2016187985A1
WO2016187985A1 PCT/CN2015/089339 CN2015089339W WO2016187985A1 WO 2016187985 A1 WO2016187985 A1 WO 2016187985A1 CN 2015089339 W CN2015089339 W CN 2015089339W WO 2016187985 A1 WO2016187985 A1 WO 2016187985A1
Authority
WO
WIPO (PCT)
Prior art keywords
picture block
feature
feature information
target object
preset
Prior art date
Application number
PCT/CN2015/089339
Other languages
French (fr)
Chinese (zh)
Inventor
张爽
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2016187985A1 publication Critical patent/WO2016187985A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules

Definitions

  • the present invention relates to the field of photographing, and in particular to a photographing apparatus, a tracking photographing method and system, and a computer storage medium.
  • the camera terminal device includes a camera, a smartphone, and the like.
  • personal complete self-timer that is, the entire body, not just the face
  • a solution is proposed in which a camera terminal device is placed at a suitable location for image acquisition, and the collected image is sent to a monitoring terminal, and the user views the image captured by the camera terminal device through the monitoring terminal. If the image captured by the camera terminal device meets the requirements, the camera terminal inputs a camera command, and then the monitoring terminal sends the received camera input command to the camera terminal device to enable the camera terminal device to take a photo; however, the above manner is adopted. Still has the following drawbacks: When the shooting target moves, the camera terminal device cannot track the picture, and can only capture the scene in the area that can be captured during the initial shooting.
  • embodiments of the present invention provide a photographing apparatus, a tracking photographing method and system, and a computer storage medium.
  • an embodiment of the present invention provides a photographing device, which includes:
  • a camera module configured to perform image acquisition
  • a determining module configured to determine whether the feature information of the target object in the captured image in the captured image matches the preset feature information
  • a tracking control module configured to: when the feature information in the captured image does not match the preset feature information, the feature information and the pre-target in the captured image Determining the deviation of the feature information, controlling the moving direction of the camera module, and/or adjusting the shooting angle of the camera module, so that the feature information of the target object in the image captured by the camera module matches the preset feature information;
  • the shooting control module is configured to control the camera module to perform a shooting operation when receiving the shooting instruction sent by the monitoring terminal.
  • the feature information is location information
  • the preset feature information is preset location information
  • the device further includes:
  • an analysis module configured to analyze whether there is a target object matching the reference feature picture block in the acquired image.
  • the preset location information is location information of the reference feature picture block in the reference picture.
  • the analysis module includes:
  • An extracting unit configured to extract a feature picture block from the collected image, where the extracted feature picture block and the reference feature picture block have the same shape and size;
  • the analyzing unit is configured to analyze whether the similarity between the extracted feature picture block and the reference feature picture block exceeds a preset threshold, and if the similarity between the extracted feature picture block and the reference feature picture block exceeds a preset threshold, Then, it is considered that the image of the reference feature is present in the captured image.
  • the target object is matched, and the target object is a feature picture block extracted from the acquired image and whose similarity with the reference feature picture block exceeds a preset threshold.
  • an embodiment of the present invention further provides a tracking shooting method, which uses the shooting device of any of the above technical solutions, and the method includes:
  • the target object is controlled according to the deviation of the feature information of the target object in the captured image from the preset feature information. a moving direction of the camera module and/or adjusting a shooting angle of the camera module to match feature information of the target object in the image captured by the camera module with preset feature information;
  • the shooting operation is performed.
  • the feature information is location information
  • the preset feature information is preset location information
  • the method before the determining whether the feature information of the target object in the captured image matches the preset feature information, the method further includes:
  • Determining whether there is a target object matching the reference feature picture block in the captured image determining that the target object in the captured image matches the target feature picture block, determining that the target object in the captured image is in the collected image Whether the feature information in the match matches the preset feature information.
  • the preset location information is location information of the reference feature picture block in the reference picture.
  • the analyzing whether there is a target object matching the reference feature picture block in the collected image includes:
  • an embodiment of the present invention further provides a tracking and photographing system, comprising the photographing apparatus according to any one of the above, and a monitoring terminal communicably connected to the photographing apparatus, wherein the monitoring terminal includes a photographing instruction transmission. a module configured to send a shooting instruction to the photographing device.
  • an embodiment of the present invention further provides a computer storage medium, where the computer storage medium includes a set of instructions that, when executed, cause at least one processor to perform the above-described tracking shooting method.
  • the photographing apparatus, the tracking photographing method and system, and the computer storage medium of the embodiment of the present invention first perform image acquisition; and then determine whether the feature information of the target object in the acquired image matches the preset feature information; When the feature information in the captured image does not match the preset feature information, the camera module is controlled according to the deviation of the feature information of the target object in the captured image from the preset feature information. The moving direction and/or the shooting angle of the camera module is adjusted so that the feature information of the target object in the image captured by the camera module matches the preset feature information; when the shooting command sent by the monitoring terminal is received, the shooting operation is performed.
  • the moving direction of the camera module is controlled according to the deviation of the feature information of the target object in the captured image from the preset feature information. Or adjust the shooting angle of the camera module to achieve tracking and photographing of the shooting target, which can solve the defect that the shooting device cannot track the shooting target and take a photo.
  • FIG. 1 is a schematic structural diagram of a photographing apparatus according to an embodiment of the present invention.
  • FIG. 2 is a schematic flow chart of a first embodiment of a tracking shooting method according to the present invention.
  • FIG. 3 is a schematic flow chart of a second embodiment of a tracking and photographing method according to the present invention.
  • FIG. 4 is a schematic flow chart of a third embodiment of a tracking and photographing method according to the present invention.
  • FIG. 5 is a schematic structural diagram of a tracking and photographing system according to an embodiment of the present invention.
  • FIG. 1 is a schematic structural diagram of a photographing apparatus according to an embodiment of the present invention, and the photographing apparatus includes:
  • the camera module 10 is configured to perform image acquisition
  • the determining module 20 is configured to determine whether the feature information of the target object in the captured image in the captured image matches the preset feature information
  • the tracking control module 30 is configured to control the camera module according to the deviation between the feature information of the target object and the preset feature information when the feature information in the captured image does not match the preset feature information.
  • the moving direction of the camera 10 and/or the shooting angle of the camera module 10 are adjusted to match the feature information of the target object in the image captured by the camera module 10 with the preset feature information;
  • the shooting control module 40 is configured to receive the shooting instruction sent by the monitoring terminal, and control The camera module 10 performs a photographing operation.
  • the camera module 10 performs image acquisition according to a preset sampling frequency, and the preset sampling frequency may be 20 frames per second.
  • a communication connection between the photographing device and the monitoring terminal is established in advance, and the photographing device can establish a connection with the monitoring terminal through a Bluetooth communication technology.
  • the monitoring terminal When receiving the acquisition instruction input by the user, the monitoring terminal sends the input acquisition instruction to the photographing device, and when the photographing device receives the acquisition instruction sent by the monitoring terminal, the image capture module 10 performs image acquisition.
  • the acquisition command can be issued by a preset gesture action, a touch action, a function button or a voice command.
  • the photographing device can send the collected image to the monitoring terminal in real time, so that the user can view the image collected by the photographing device through the monitoring terminal.
  • the automatic tracking shooting mode is turned on in the monitoring terminal, and the image collected by the shooting device is received in real time.
  • the target object can be identified from the acquired image by an existing image recognition technology, and the target object can be a human face or a human body.
  • the determining module 20 first acquires feature information of the target object in the captured image in the captured image, where the feature information is location information, and the location information may be specific coordinate information (a coordinate system is established on a screen displaying the captured image, The lower left corner may be used as the coordinate origin; then the determining module 20 determines whether the feature information of the target object in the captured image in the captured image matches the preset feature information, specifically, the target object may be in the captured image.
  • the feature information is completely consistent with the preset feature information or when the target object's deviation between the feature information and the preset feature information in the captured image is within a preset threshold, the feature information and the pre-target of the target object in the captured image are considered Let the feature information match.
  • the preset feature information is pre-set position information, and the preset position information may be preset, and the preset position information may be set to an arbitrary position according to the user's personal preference, for example, may be set to be located in the middle of the image (reflected by coordinate values) Out of the middle of the image).
  • the feature information and the preset feature information in the acquired image of the target object in the acquired image are not When the matching is performed, the tracking control module 30 controls the moving direction of the camera module 10 and/or adjusts the shooting angle of the camera module 10 according to the deviation of the feature information of the target object in the captured image from the preset feature information, so that the camera module is used.
  • the feature information of the target object in the acquired image is matched with the preset feature information, that is, when the camera module 10 captures the subsequent image, the feature information of the target object in the captured image matches the preset feature information.
  • the camera module 10 when the deviation between the feature information of the target object and the preset feature information is leftward, the camera module 10 is controlled to move to the left and/or adjust the shooting angle of the camera module, so that the camera module 10 collects The feature information of the target object in the image is matched with the preset feature information; when the deviation of the feature information in the captured image from the preset feature information is to the right, the camera module 10 is controlled to move to the right and/or adjust The shooting angle of the camera module is such that the feature information of the target object in the image captured by the camera module 10 matches the preset feature information.
  • the monitoring terminal can be a smart phone, and the monitoring terminal can preview the image captured by the camera module 10 of the shooting device in real time.
  • the monitoring terminal inputs the image in the monitoring terminal.
  • the shooting instruction can be issued by the application, such as the "photographing" option in QQ, or by a preset gesture action, touch action, function button or voice command.
  • the photographing control module 40 of the photographing device receives the photographing instruction transmitted from the monitoring terminal, the photographing module 10 is controlled to perform a photographing operation.
  • the device further includes an analysis module respectively connected to the camera module 10 and the determination module 20, and the analysis module is configured to analyze whether there is a target object matching the reference feature picture block in the captured image.
  • the determining module 20 is further configured to: when the analysis result of the analysis module is that the target object that matches the reference feature picture block exists in the captured image, determine feature information of the target object in the acquired image in the collected image. Whether to match the preset feature information.
  • the reference feature picture block can be preset, and when the user is shooting by the shooting device, the target image that matches the reference feature picture block needs to be included in the captured image.
  • the analysis module comprises:
  • the extracting unit is configured to extract a feature picture block from the collected image, and the extracted feature picture block has the same shape and size as the reference feature picture block;
  • the analyzing unit is configured to analyze whether the similarity between the extracted feature picture block and the reference feature picture block exceeds a preset threshold, and if the similarity between the extracted feature picture block and the reference feature picture block exceeds a preset threshold, A target object matching the reference feature picture block exists in the acquired image, and the target object is a feature picture block extracted from the acquired image and whose similarity with the reference feature picture block exceeds a preset threshold.
  • the analyzing unit first extracts the feature value in the reference feature picture block as the reference feature value, and then obtains the feature value corresponding to the feature picture block from the extracted feature picture block as the extracted feature value, and then extracts the feature value according to the reference feature value and the extracted feature value.
  • the reference feature picture block is similarly matched with the feature picture block extracted from the acquired image. If the similarity between the feature picture block extracted from the acquired image and the reference feature picture block exceeds a preset threshold, the captured image is considered to be in the captured image.
  • There is a target object that matches the reference feature picture block and the target object is a feature picture block extracted from the acquired image and whose similarity with the reference feature picture block exceeds a preset threshold.
  • the reference feature value may include at least one of the following feature values:
  • Color feature values texture feature values, shape feature values, and spatial relationship feature values.
  • the reference feature value is not limited to the above feature values.
  • the step of extracting the feature picture block from the acquired image is: dividing the collected image according to a preset horizontal pixel interval and a vertical pixel interval to divide each divided picture area as an extracted image.
  • the feature picture block, each picture area of the segmentation is consistent with the shape and size of the acquired reference feature picture block.
  • the acquiring unit may acquire the reference feature picture block from the monitoring terminal.
  • the step of acquiring the reference feature picture block is: the user first adjusts the camera module 10 of the shooting device, and The camera module 10 adjusts to a suitable position and a shooting angle to enable the camera module 10 to capture an image of a suitable angle of view; the camera captures the image captured by the camera module 10 to the monitoring terminal in real time, so that the user can view the camera module 10 through the monitoring terminal.
  • the captured image is previewed by the user on the monitoring terminal.
  • the user inputs a shooting instruction in the monitoring terminal, and the monitoring terminal sends the received shooting instruction to the monitoring terminal.
  • the photographing module 10 when the photographing device receives the photographing instruction sent by the monitoring terminal, the photographing module 10 is controlled to perform a photographing operation to generate a reference image, and the generated reference image is sent to the monitoring terminal, and the monitoring terminal displays the reference image, and Prompting the user to select a reference feature picture block in the reference picture (the reference feature picture block can be framed from the reference picture by frame selection, or the face is recognized by image recognition technology, and then the user recognizes the person from the target Select one or more faces in the face as the reference feature picture block), in After the user selects the reference feature picture block, the monitoring terminal sends the reference feature picture block selected by the user to the photographing device, and the photographing device receives the reference feature picture block, that is, the acquiring unit of the photographing device acquires the reference feature from the monitoring terminal. Picture block.
  • the preset location information is location information of the reference feature picture block in the reference picture.
  • the device further includes a picture sending module connected to the camera module 10, and the picture sending module is configured to send the photo generated by the shooting operation to the monitoring terminal.
  • the picture sending module sends the photo generated by the camera module 10 to perform the shooting operation to the monitoring terminal.
  • the user can conveniently view the photographed photos through the monitoring terminal. For example, when taking a group photo, the collective photo taken by the monitoring terminal can be zoomed in to determine whether the facial expression of the participating photographer in the photo is expected. If the prediction is not reached, the monitoring terminal can send a shooting instruction to the camera module 10 to continue shooting until a photo satisfactory to the user is captured.
  • the camera module 10 can be implemented by a camera in the photographing device; the judging module 20, the tracking control module 30, the analyzing module, the obtaining unit, the extracting unit, and the analyzing unit can be set by the photographing device.
  • the imaging control module 40 and the picture sending module can be implemented by a CPU, an MCU, a DSP or an FPGA in a photographing device in combination with a communication chip.
  • FIG. 2 is a schematic flowchart of a first embodiment of a tracking and photographing method according to the present invention.
  • the photographing apparatus using any of the above technical solutions includes:
  • image acquisition is performed by the camera module according to a preset sampling frequency, and the preset sampling frequency may be 20 frames per second.
  • a communication connection between the photographing device and the monitoring terminal is established in advance, and the photographing device can establish a connection with the monitoring terminal through a Bluetooth communication technology.
  • the monitoring terminal When receiving the acquisition instruction input by the user, the monitoring terminal sends the input acquisition instruction to the photographing device, and when the photographing device receives the acquisition instruction sent by the monitoring terminal, the image capture is performed by the camera module.
  • the acquisition command can be issued by a preset gesture action, a touch action, a function button or a voice command.
  • the photographing device can send the collected image to the monitoring terminal in real time, so that the user can view the image collected by the photographing device through the monitoring terminal.
  • the automatic tracking shooting mode is turned on in the monitoring terminal, and the image collected by the shooting device is received in real time.
  • step S20 Determine whether the feature information of the target object in the captured image matches the preset feature information, and if the feature information of the target object in the captured image does not match the preset feature information, Then step S30 is performed.
  • the target object can be identified from the acquired image by an existing image recognition technology, and the target object can be a human face or a human body.
  • the feature information of the target object in the acquired image in the acquired image is acquired first, and the feature information is location information, and the location information is It can be specific coordinate information (the coordinate system is established on the screen displaying the acquired image, and the lower left corner can be used as the coordinate origin); then it is determined whether the feature information of the target object in the captured image in the captured image and the preset feature information Matching, in particular, the feature information in the captured image of the target object is completely consistent with the preset feature information or the deviation between the feature information of the target object and the preset feature information in the captured image is at a preset threshold When it is inside, it is considered that the feature information of the target object in the captured image matches the preset feature information.
  • the preset feature information is pre-set position information, and the preset position information may be preset, and the preset position information may be set to an arbitrary position according to the user's personal preference, for example, may be set to be located in the middle of the image (reflected by coordinate values) Out of the middle of the image).
  • the movement of the camera module is controlled according to the deviation of the feature information of the target object in the captured image from the preset feature information. Orienting and/or adjusting a shooting angle of the camera module, so that the feature information of the target object in the image captured by the camera module is matched with the preset feature information, that is, the target object is collected by the camera module during subsequent image acquisition.
  • the feature information in the image matches the preset feature information. Specifically, when the deviation between the feature information of the target object and the preset feature information is to the left, the camera module is controlled to move to the left and/or adjust the shooting angle of the camera module to be collected by the camera module.
  • the feature information of the target object in the image is matched with the preset feature information; when the deviation of the feature information of the target object in the captured image from the preset feature information is to the right, the camera module is controlled to move to the right and/or adjust The shooting angle of the camera module is such that the feature information of the target object in the image captured by the camera module matches the preset feature information.
  • the monitoring terminal can be a smart phone, and the monitoring terminal can preview the image captured by the shooting device through the camera module in real time.
  • the shooting instruction is input in the monitoring terminal.
  • the shooting instruction can be issued by the application, such as the "photographing" option in QQ, or by a preset gesture action, touch action, function button or voice command. In this step, when a photographing instruction transmitted from the monitoring terminal is received, a photographing operation is performed.
  • FIG. 3 is a schematic flowchart diagram of a second embodiment of a tracking shooting method according to the present invention.
  • the method further includes:
  • step S50 Analyze whether there is a target object matching the reference feature picture block in the acquired image. If there is a target object matching the reference feature picture block in the captured image, step S30 is performed.
  • the reference feature picture block can be preset, and when the user is shooting by the shooting device, the target image that matches the reference feature picture block needs to be included in the captured image.
  • the step S50 includes:
  • the reference feature picture block can be obtained from the monitoring terminal.
  • the step of acquiring the reference feature picture block is: the user first adjusts the camera module of the photographing device, adjusts the camera module to a suitable position and a photographing angle to acquire an image of a suitable angle of view; the photographing device will photograph The image collected by the module is sent to the monitoring terminal in real time, so that the user can view the image captured by the camera module through the monitoring terminal; the user previews the image captured by the camera module on the monitoring terminal, and when the user feels that the image captured by the camera module meets the requirements, The photographing instruction is input to the monitoring terminal, and the monitoring terminal sends the received photographing instruction to the photographing device.
  • the photographing device When the photographing device receives the photographing instruction sent by the monitoring terminal, the photographing device performs a photographing operation to generate a reference image, and sends the generated reference image.
  • the monitoring terminal displays the reference picture and prompts the user to select a reference feature picture block in the reference picture (
  • the reference feature picture block is framed from the reference picture by frame selection, or the face is recognized by image recognition technology, and then the user selects one or more faces from the recognized face as the reference feature picture block)
  • the monitoring terminal sends the reference feature picture block selected by the user to the photographing device, and the photographing device receives the reference feature picture block, that is, the photographing device acquires the reference feature picture block from the monitoring terminal.
  • the step of extracting the feature picture block from the acquired image is: dividing the collected image according to a preset horizontal pixel interval and a vertical pixel interval to divide each divided picture area as an extracted image.
  • the feature picture block, each picture area of the segmentation is consistent with the shape and size of the acquired reference feature picture block.
  • the feature value in the reference feature picture block is first extracted as the reference feature value, and then the feature value corresponding to the feature picture block is obtained from the extracted feature picture block as the extracted feature value, and then the reference feature value and the extracted feature value are extracted according to the reference feature value. And performing similarity matching on the reference feature picture block and the feature picture block extracted from the acquired image. If the similarity between the feature picture block extracted from the acquired image and the reference feature picture block exceeds a preset threshold, the collection is considered to be the acquisition. There is a target object in the image that matches the reference feature picture block, and the target object is a feature picture block extracted from the acquired image and whose similarity with the reference feature picture block exceeds a preset threshold.
  • the reference feature value may include at least one of the following feature values:
  • Color feature values texture feature values, shape feature values, and spatial relationship feature values.
  • the reference feature value is not limited to the above feature values.
  • the preset position information is position information of the reference feature picture block in the reference picture.
  • FIG. 4 is a schematic flowchart diagram of a third embodiment of a tracking shooting method according to the present invention.
  • step S40 the step further includes:
  • the photo generated by the shooting operation in step S40 is transmitted to the monitoring terminal.
  • the user can conveniently view the photographed photos through the monitoring terminal.
  • the collective photo taken by the monitoring terminal can be zoomed in to determine whether the facial expression of the participating photographer in the photo is expected. If the prediction is not met, the monitoring terminal can send a shooting instruction to the camera module to continue shooting until the user is satisfied with the photo.
  • FIG. 5 is a schematic structural diagram of a preferred embodiment of a tracking and photographing system according to the present invention.
  • the system includes the photographing apparatus 100 of any of the above embodiments, and a monitoring terminal 200 communicably connected to the photographing apparatus 100.
  • the monitoring terminal 200 The photographing instruction sending module 201 is configured to send a photographing instruction to the photographing device.
  • the command transmission module 201 can be implemented by a CPU, an MCU, a DSP, or an FPGA in the monitoring terminal 200 in combination with a communication chip.
  • embodiments of the present invention can be provided as a method, system, or computer program product. Accordingly, the present invention can take the form of a hardware embodiment, a software embodiment, or a combination of software and hardware. Moreover, the present invention may employ computer-usable storage media (including but not limited to disks) in one or more of the computer-usable program code embodied therein. A form of computer program product embodied on a memory and optical storage, etc.).
  • the computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device.
  • the apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.
  • These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device.
  • the instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.
  • an embodiment of the present invention further provides a computer storage medium, the computer storage medium comprising a set of instructions, when executed, causing at least one processor to execute the tracking shooting method described above.

Abstract

Disclosed is a photographing device, comprising: a camera shooting module, configured to collect an image; a judging module, configured to judge whether feature information about a target object in the collected image is matched with pre-set feature information or not; a tracking control module, configured to control a moving direction of the camera shooting module and/or adjusting a photographing viewing angle of the camera shooting module according to a deviation of the feature information about the target object in the collected image to the pre-set feature information when the feature information about the target object in the collected image is not matched with the pre-set feature information, so as to enable the feature information about the target object in the image collected by the camera shooting module to be matched with the pre-set feature information; and a photographing control module, configured to control the camera shooting module to perform photographing operation when a photographing instruction transmitted by a monitoring terminal is received. Also disclosed are a tracking photographing method and system and a computer storage medium.

Description

拍摄设备、跟踪拍摄方法和系统、以及计算机存储介质Shooting equipment, tracking shooting method and system, and computer storage medium 技术领域Technical field
本发明涉及拍照领域,尤其涉及一种拍摄设备、跟踪拍摄方法和系统、以及计算机存储介质。The present invention relates to the field of photographing, and in particular to a photographing apparatus, a tracking photographing method and system, and a computer storage medium.
背景技术Background technique
近年来,随着电子技术的迅速发展及人们生活水平的不断提高,具有拍照功能的拍照终端设备越来越普遍,人们可通过拍照终端设备拍摄生活照、旅游照等。拍照终端设备包括相机、智能手机等。人们在拍集体合照、个人完整自拍(即拍摄到整个人体,而不仅仅是脸部)时,需要找别人帮忙,此时将会出现以下问题:In recent years, with the rapid development of electronic technology and the continuous improvement of people's living standards, camera terminals with camera functions are becoming more and more popular. People can take pictures of life and travel photos through camera terminals. The camera terminal device includes a camera, a smartphone, and the like. When people take a group photo, personal complete self-timer (that is, the entire body, not just the face), you need to find someone to help, the following problems will occur:
一、可能找不到人帮忙拍照,比如周围没有人可以帮忙;First, there may be no people to help take pictures, such as no one around can help;
二、帮忙代拍的人的拍摄技术不好,无法拍摄到符合用户要求的照片。Second, the shooting technique of the person who helps the agent is not good enough to take photos that meet the user's requirements.
鉴于上述问题,现有技术中,提出了一种方案,将拍照终端设备放置在合适位置进行图像采集,并将采集的图像发送给监控终端,用户通过该监控终端查看拍照终端设备采集的图像,如果觉得拍照终端设备采集的图像符合要求,则在监控终端输入拍照指令,然后监控终端将收到的用户输入的拍照指令发送给拍照终端设备,以使拍照终端设备进行拍照;但是,采用上述方式,仍然具有以下缺陷:当拍摄目标发生移动时,拍照终端设备无法跟踪拍照,只能拍摄其在初始拍摄时能拍摄到的区域内的景象。In view of the above problems, in the prior art, a solution is proposed in which a camera terminal device is placed at a suitable location for image acquisition, and the collected image is sent to a monitoring terminal, and the user views the image captured by the camera terminal device through the monitoring terminal. If the image captured by the camera terminal device meets the requirements, the camera terminal inputs a camera command, and then the monitoring terminal sends the received camera input command to the camera terminal device to enable the camera terminal device to take a photo; however, the above manner is adopted. Still has the following drawbacks: When the shooting target moves, the camera terminal device cannot track the picture, and can only capture the scene in the area that can be captured during the initial shooting.
发明内容Summary of the invention
为解决现有存在的技术问题,本发明实施例提供一种拍摄设备、跟踪拍摄方法和系统、以及计算机存储介质。 In order to solve the existing technical problems, embodiments of the present invention provide a photographing apparatus, a tracking photographing method and system, and a computer storage medium.
为实现上述目的,本发明实施例提供一种拍摄设备,该设备包括:To achieve the above objective, an embodiment of the present invention provides a photographing device, which includes:
摄像模块,配置为进行图像采集;a camera module configured to perform image acquisition;
判断模块,配置为判断采集图像中的目标对象在所述采集图像中的特征信息是否与预设特征信息匹配;a determining module, configured to determine whether the feature information of the target object in the captured image in the captured image matches the preset feature information;
跟踪控制模块,配置为在所述采集图像中的目标对象在所述采集图像中的特征信息与预设特征信息不匹配时,根据所述目标对象在所述采集的图像中的特征信息与预设特征信息的偏差,控制摄像模块的移动方向和/或调整摄像模块的拍摄视角,以使通过所述摄像模块采集的图像中的目标对象的特征信息与预设特征信息匹配;a tracking control module, configured to: when the feature information in the captured image does not match the preset feature information, the feature information and the pre-target in the captured image Determining the deviation of the feature information, controlling the moving direction of the camera module, and/or adjusting the shooting angle of the camera module, so that the feature information of the target object in the image captured by the camera module matches the preset feature information;
拍摄控制模块,配置为在接收到监控终端发送过来的拍摄指令时,控制摄像模块执行拍摄操作。The shooting control module is configured to control the camera module to perform a shooting operation when receiving the shooting instruction sent by the monitoring terminal.
上述方案中,所述特征信息是位置信息,所述预设特征信息是预设位置信息。In the above solution, the feature information is location information, and the preset feature information is preset location information.
上述方案中,所述设备还包括:In the above solution, the device further includes:
分析模块,配置为分析所述采集图像中是否存在与基准特征图片块匹配的目标对象。And an analysis module configured to analyze whether there is a target object matching the reference feature picture block in the acquired image.
上述方案中,所述预设位置信息为基准特征图片块在基准图片中的位置信息。In the above solution, the preset location information is location information of the reference feature picture block in the reference picture.
上述方案中,所述分析模块包括:In the above solution, the analysis module includes:
获取单元,配置为获取基准特征图片块;Obtaining a unit configured to obtain a reference feature picture block;
提取单元,配置为从所述采集图像中提取特征图片块,提取的特征图片块与基准特征图片块的形状和大小一致;An extracting unit configured to extract a feature picture block from the collected image, where the extracted feature picture block and the reference feature picture block have the same shape and size;
分析单元,配置为分析所述提取的特征图片块与基准特征图片块的相似度是否超过预设阀值,若所述提取的特征图片块与基准特征图片块的相似度超过预设阀值,则认为该采集的图像中存在与所述基准特征图片块匹 配的目标对象,且该目标对象即为从该采集的图像中提取的与基准特征图片块相似度超过预设阀值的特征图片块。The analyzing unit is configured to analyze whether the similarity between the extracted feature picture block and the reference feature picture block exceeds a preset threshold, and if the similarity between the extracted feature picture block and the reference feature picture block exceeds a preset threshold, Then, it is considered that the image of the reference feature is present in the captured image. The target object is matched, and the target object is a feature picture block extracted from the acquired image and whose similarity with the reference feature picture block exceeds a preset threshold.
此外,为实现上述目的,本发明实施例还提供一种跟踪拍摄方法,使用上述任一项技术方案的拍摄设备,该方法包括:In addition, in order to achieve the above object, an embodiment of the present invention further provides a tracking shooting method, which uses the shooting device of any of the above technical solutions, and the method includes:
通过所述拍摄设备的摄像模块进行图像采集;Performing image acquisition by the camera module of the photographing device;
判断采集图像中的目标对象在所述采集图像中的特征信息是否与预设特征信息匹配;Determining whether the feature information of the target object in the acquired image in the captured image matches the preset feature information;
所述采集图像中的目标对象在所述采集的图像中的特征信息与预设特征信息不匹配时,根据所述目标对象在所述采集图像中的特征信息与预设特征信息的偏差,控制摄像模块的移动方向和/或调整摄像模块的拍摄视角,以使通过所述摄像模块采集的图像中的目标对象的特征信息与预设特征信息匹配;When the feature information in the captured image does not match the preset feature information, the target object is controlled according to the deviation of the feature information of the target object in the captured image from the preset feature information. a moving direction of the camera module and/or adjusting a shooting angle of the camera module to match feature information of the target object in the image captured by the camera module with preset feature information;
接收到监控终端发送过来的拍摄指令时,执行拍摄操作。When receiving a shooting command sent from the monitoring terminal, the shooting operation is performed.
上述方案中,所述特征信息是位置信息,所述预设特征信息是预设位置信息。In the above solution, the feature information is location information, and the preset feature information is preset location information.
上述方案中,所述判断采集图像中的目标对象在所述采集图像中的特征信息是否与预设特征信息匹配之前,该方法还包括:In the above solution, before the determining whether the feature information of the target object in the captured image matches the preset feature information, the method further includes:
分析所述采集图像中是否存在与基准特征图片块匹配的目标对象;确定所述采集图像中存在与基准特征图片块匹配的目标对象时,判断所述采集图像中的目标对象在所述采集图像中的特征信息是否与预设特征信息匹配。Determining whether there is a target object matching the reference feature picture block in the captured image; determining that the target object in the captured image matches the target feature picture block, determining that the target object in the captured image is in the collected image Whether the feature information in the match matches the preset feature information.
上述方案中,所述预设位置信息为基准特征图片块在基准图片中的位置信息。In the above solution, the preset location information is location information of the reference feature picture block in the reference picture.
上述方案中,所述分析所述采集图像中是否存在与基准特征图片块匹配的目标对象,包括: In the above solution, the analyzing whether there is a target object matching the reference feature picture block in the collected image includes:
获取基准特征图片块;Obtaining a reference feature picture block;
从所述采集图像中提取特征图片块,提取的特征图片块与基准特征图片块的形状和大小一致;Extracting a feature picture block from the acquired image, and extracting the feature picture block and the shape and size of the reference feature picture block are consistent;
分析所述提取的特征图片块与基准特征图片块的相似度是否超过预设阀值,若所述提取的特征图片块与基准特征图片块的相似度超过预设阀值,则确定所述采集图像中存在与所述基准特征图片块匹配的目标对象,且所述目标对象为从所述采集图像中提取的与基准特征图片块相似度超过预设阀值的特征图片块。And analyzing whether the similarity between the extracted feature picture block and the reference feature picture block exceeds a preset threshold, and if the similarity between the extracted feature picture block and the reference feature picture block exceeds a preset threshold, determining the collection There is a target object in the image that matches the reference feature picture block, and the target object is a feature picture block extracted from the acquired image and whose similarity with the reference feature picture block exceeds a preset threshold.
此外,为实现上述目的,本发明实施例还提供一种跟踪拍摄系统,包括上述任一项所述的拍摄设备,及与所述拍摄设备通信连接的监控终端,所述监控终端包括拍摄指令发送模块,配置为向所述拍摄设备发送拍摄指令。In addition, in order to achieve the above object, an embodiment of the present invention further provides a tracking and photographing system, comprising the photographing apparatus according to any one of the above, and a monitoring terminal communicably connected to the photographing apparatus, wherein the monitoring terminal includes a photographing instruction transmission. a module configured to send a shooting instruction to the photographing device.
此外,为实现上述目的,本发明实施例还提供一种计算机存储介质,所述计算机存储介质包括一组指令,当执行所述指令时,引起至少一个处理器执行上述的跟踪拍摄方法。In addition, in order to achieve the above object, an embodiment of the present invention further provides a computer storage medium, where the computer storage medium includes a set of instructions that, when executed, cause at least one processor to perform the above-described tracking shooting method.
本发明实施例的拍摄设备、跟踪拍摄方法和系统、以及计算机存储介质,先进行图像采集;然后判断采集图像中的目标对象在所述采集图像中的特征信息是否与预设特征信息匹配;所述采集图像中的目标对象在所述采集图像中的特征信息与预设特征信息不匹配时,根据所述目标对象在所述采集图像中的特征信息与预设特征信息的偏差,控制摄像模块的移动方向和/或调整摄像模块的拍摄视角,以使通过该摄像模块采集的图像中的目标对象的特征信息与预设特征信息匹配;接收到监控终端发送过来的拍摄指令时,执行拍摄操作;即在本发明实施例中,根据所述目标对象在所述采集图像中的特征信息与预设特征信息的偏差控制摄像模块的移动方向和/ 或调整摄像模块的拍摄视角,实现对拍摄目标的跟踪拍照,可以解决拍摄设备无法跟踪拍照目标进行拍照的缺陷。The photographing apparatus, the tracking photographing method and system, and the computer storage medium of the embodiment of the present invention first perform image acquisition; and then determine whether the feature information of the target object in the acquired image matches the preset feature information; When the feature information in the captured image does not match the preset feature information, the camera module is controlled according to the deviation of the feature information of the target object in the captured image from the preset feature information. The moving direction and/or the shooting angle of the camera module is adjusted so that the feature information of the target object in the image captured by the camera module matches the preset feature information; when the shooting command sent by the monitoring terminal is received, the shooting operation is performed. In the embodiment of the present invention, the moving direction of the camera module is controlled according to the deviation of the feature information of the target object in the captured image from the preset feature information. Or adjust the shooting angle of the camera module to achieve tracking and photographing of the shooting target, which can solve the defect that the shooting device cannot track the shooting target and take a photo.
附图说明DRAWINGS
图1为本发明实施例拍摄设备的结构示意图;1 is a schematic structural diagram of a photographing apparatus according to an embodiment of the present invention;
图2为本发明跟踪拍摄方法的第一实施例的流程示意图;2 is a schematic flow chart of a first embodiment of a tracking shooting method according to the present invention;
图3为本发明跟踪拍摄方法的第二实施例的流程示意图;3 is a schematic flow chart of a second embodiment of a tracking and photographing method according to the present invention;
图4为本发明跟踪拍摄方法的第三实施例的流程示意图;4 is a schematic flow chart of a third embodiment of a tracking and photographing method according to the present invention;
图5为本发明实施例跟踪拍摄系统的结构示意图。FIG. 5 is a schematic structural diagram of a tracking and photographing system according to an embodiment of the present invention.
本发明目的的实现、功能特点及优点将结合实施例,参照附图做进一步说明。The implementation, functional features, and advantages of the present invention will be further described in conjunction with the embodiments.
具体实施方式detailed description
应当理解,此处所描述的具体实施例仅仅用以解释本发明,并不用于限定本发明。It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
参照图1,图1为本发明实施例拍摄设备的结构示意图,该拍摄设备包括:1 is a schematic structural diagram of a photographing apparatus according to an embodiment of the present invention, and the photographing apparatus includes:
摄像模块10,配置为进行图像采集;The camera module 10 is configured to perform image acquisition;
判断模块20,配置为判断采集图像中的目标对象在采集图像中的特征信息是否与预设特征信息匹配;The determining module 20 is configured to determine whether the feature information of the target object in the captured image in the captured image matches the preset feature information;
跟踪控制模块30,配置为采集图像中的目标对象在采集图像中的特征信息与预设特征信息不匹配时,根据目标对象在采集图像中的特征信息与预设特征信息的偏差,控制摄像模块10的移动方向和/或调整摄像模块10的拍摄视角,以使摄像模块10采集的图像中的目标对象的特征信息与预设特征信息匹配;The tracking control module 30 is configured to control the camera module according to the deviation between the feature information of the target object and the preset feature information when the feature information in the captured image does not match the preset feature information. The moving direction of the camera 10 and/or the shooting angle of the camera module 10 are adjusted to match the feature information of the target object in the image captured by the camera module 10 with the preset feature information;
拍摄控制模块40,配置为接收到监控终端发送过来的拍摄指令时,控 制摄像模块10执行拍摄操作。The shooting control module 40 is configured to receive the shooting instruction sent by the monitoring terminal, and control The camera module 10 performs a photographing operation.
该摄像模块10按照预设的采样频率进行图像采集,如该预设的采样频率可以为每秒20帧图像。The camera module 10 performs image acquisition according to a preset sampling frequency, and the preset sampling frequency may be 20 frames per second.
预先建立拍摄设备与监控终端的通信连接,该拍摄设备可通过蓝牙通信技术与该监控终端建立连接。A communication connection between the photographing device and the monitoring terminal is established in advance, and the photographing device can establish a connection with the monitoring terminal through a Bluetooth communication technology.
监控终端接收到用户输入的采集指令时,将输入的采集指令发送给拍摄设备,拍摄设备接收到监控终端发送的采集指令时,通过摄像模块10进行图像采集。该采集指令可以通过预设的手势动作、触控动作、功能按键或语音命令发出。When receiving the acquisition instruction input by the user, the monitoring terminal sends the input acquisition instruction to the photographing device, and when the photographing device receives the acquisition instruction sent by the monitoring terminal, the image capture module 10 performs image acquisition. The acquisition command can be issued by a preset gesture action, a touch action, a function button or a voice command.
该拍摄设备可将采集的图像实时发送给监控终端,使得用户可通过监控终端查看到拍摄设备采集的图像。在该监控终端开启自动跟踪拍摄模式,实时接收该拍摄设备采集的图像。The photographing device can send the collected image to the monitoring terminal in real time, so that the user can view the image collected by the photographing device through the monitoring terminal. The automatic tracking shooting mode is turned on in the monitoring terminal, and the image collected by the shooting device is received in real time.
该目标对象可通过现有的图像识别技术从该采集的图像中识别出来,该目标对象是可以人脸或人体模样。该判断模块20先获取该采集图像中的目标对象在采集的图像中的特征信息,该特征信息是位置信息,该位置信息可以为具体的坐标信息(在显示采集图像的屏幕上建立坐标系,可以以左下角作为坐标原点);然后该判断模块20判断该采集图像中的目标对象在该采集图像中的特征信息是否与预设特征信息匹配,具体地,可在该目标对象在采集图像中的特征信息与预设特征信息完全一致或者在该目标对象在采集图像中的特征信息与预设特征信息的偏差在预设阀值内时,认为该目标对象在采集图像中的特征信息与预设特征信息匹配。The target object can be identified from the acquired image by an existing image recognition technology, and the target object can be a human face or a human body. The determining module 20 first acquires feature information of the target object in the captured image in the captured image, where the feature information is location information, and the location information may be specific coordinate information (a coordinate system is established on a screen displaying the captured image, The lower left corner may be used as the coordinate origin; then the determining module 20 determines whether the feature information of the target object in the captured image in the captured image matches the preset feature information, specifically, the target object may be in the captured image. The feature information is completely consistent with the preset feature information or when the target object's deviation between the feature information and the preset feature information in the captured image is within a preset threshold, the feature information and the pre-target of the target object in the captured image are considered Let the feature information match.
该预设特征信息是预设位置信息,该预设位置信息可预先设置,可根据用户的个人喜好,将预设位置信息设置为任意位置,如可设置为位于图像的中部(通过坐标值体现出位于图像的中部)。The preset feature information is pre-set position information, and the preset position information may be preset, and the preset position information may be set to an arbitrary position according to the user's personal preference, for example, may be set to be located in the middle of the image (reflected by coordinate values) Out of the middle of the image).
在采集图像中的目标对象在采集图像中的特征信息与预设特征信息不 匹配时,该跟踪控制模块30根据该目标对象在采集图像中的特征信息与预设特征信息的偏差,控制摄像模块10的移动方向和/或调整摄像模块10的拍摄视角,以使该摄像模块10采集的图像中的目标对象的特征信息与预设特征信息匹配,即使得摄像模块10在后续图像采集时,目标对象在采集图像中的特征信息与预设特征信息匹配。具体地,当该目标对象在采集图像中的特征信息与预设特征信息的偏差为偏左时,控制摄像模块10向左移动和/或调整摄像模块的拍摄视角,以使该摄像模块10采集的图像中的目标对象的特征信息与预设特征信息匹配;当该目标对象在采集图像中的特征信息与预设特征信息的偏差为偏右时,控制摄像模块10向右移动和/或调整摄像模块的拍摄视角,以使该摄像模块10采集的图像中的目标对象的特征信息与预设特征信息匹配。The feature information and the preset feature information in the acquired image of the target object in the acquired image are not When the matching is performed, the tracking control module 30 controls the moving direction of the camera module 10 and/or adjusts the shooting angle of the camera module 10 according to the deviation of the feature information of the target object in the captured image from the preset feature information, so that the camera module is used. The feature information of the target object in the acquired image is matched with the preset feature information, that is, when the camera module 10 captures the subsequent image, the feature information of the target object in the captured image matches the preset feature information. Specifically, when the deviation between the feature information of the target object and the preset feature information is leftward, the camera module 10 is controlled to move to the left and/or adjust the shooting angle of the camera module, so that the camera module 10 collects The feature information of the target object in the image is matched with the preset feature information; when the deviation of the feature information in the captured image from the preset feature information is to the right, the camera module 10 is controlled to move to the right and/or adjust The shooting angle of the camera module is such that the feature information of the target object in the image captured by the camera module 10 matches the preset feature information.
该监控终端可以为智能手机,通过该监控终端可实时预览到拍摄设备的摄像模块10采集的图像,当用户觉得拍摄设备的摄像模块10采集的图像符合要求时,则在该监控终端中输入拍摄指令,该拍摄指令可以通过应用程序发出,如QQ中的“拍照”选项,也可以通过预设的手势动作、触控动作、功能按键或语音命令发出。在该拍摄设备的拍摄控制模块40接收到监控终端发送过来的拍摄指令时,控制摄像模块10执行拍摄操作。The monitoring terminal can be a smart phone, and the monitoring terminal can preview the image captured by the camera module 10 of the shooting device in real time. When the user feels that the image captured by the camera module 10 of the shooting device meets the requirements, the monitoring terminal inputs the image in the monitoring terminal. Command, the shooting instruction can be issued by the application, such as the "photographing" option in QQ, or by a preset gesture action, touch action, function button or voice command. When the photographing control module 40 of the photographing device receives the photographing instruction transmitted from the monitoring terminal, the photographing module 10 is controlled to perform a photographing operation.
在一实施例中,该设备还包括与该摄像模块10和判断模块20分别连接的分析模块,该分析模块,配置为分析该采集图像中是否存在与基准特征图片块匹配的目标对象。In an embodiment, the device further includes an analysis module respectively connected to the camera module 10 and the determination module 20, and the analysis module is configured to analyze whether there is a target object matching the reference feature picture block in the captured image.
该判断模块20,还配置为在分析模块的分析结果为该采集的图像中存在与基准特征图片块匹配的目标对象时,判断该采集的图像中的目标对象在该采集的图像中的特征信息是否与预设特征信息匹配。The determining module 20 is further configured to: when the analysis result of the analysis module is that the target object that matches the reference feature picture block exists in the captured image, determine feature information of the target object in the acquired image in the collected image. Whether to match the preset feature information.
该基准特征图片块可预先设置,当用户在通过拍摄设备进行拍摄时,需要在采集的图像中包含有与该基准特征图片块匹配的目标对象。 The reference feature picture block can be preset, and when the user is shooting by the shooting device, the target image that matches the reference feature picture block needs to be included in the captured image.
在一实施例中,该分析模块包括:In an embodiment, the analysis module comprises:
获取单元,配置为获取基准特征图片块;Obtaining a unit configured to obtain a reference feature picture block;
提取单元,配置为从采集图像中提取特征图片块,提取的特征图片块与基准特征图片块的形状和大小一致;The extracting unit is configured to extract a feature picture block from the collected image, and the extracted feature picture block has the same shape and size as the reference feature picture block;
分析单元,配置为分析该提取的特征图片块与基准特征图片块的相似度是否超过预设阀值,若该提取的特征图片块与基准特征图片块的相似度超过预设阀值,则认为该采集的图像中存在与该基准特征图片块匹配的目标对象,且该目标对象即为从该采集的图像中提取的与基准特征图片块相似度超过预设阀值的特征图片块。The analyzing unit is configured to analyze whether the similarity between the extracted feature picture block and the reference feature picture block exceeds a preset threshold, and if the similarity between the extracted feature picture block and the reference feature picture block exceeds a preset threshold, A target object matching the reference feature picture block exists in the acquired image, and the target object is a feature picture block extracted from the acquired image and whose similarity with the reference feature picture block exceeds a preset threshold.
该分析单元先提取基准特征图片块中的特征值作为基准特征值,然后从提取的特征图片块中获取特征图片块对应的特征值作为提取特征值,再根据基准特征值与提取特征值,对该基准特征图片块与从采集图像中提取的特征图片块进行相似度匹配,若从采集图像中提取的特征图片块与基准特征图片块的相似度超过预设阀值,则认为该采集图像中存在与基准特征图片块匹配的目标对象,且该目标对象即为从该采集图像中提取的与基准特征图片块相似度超过预设阀值的特征图片块。The analyzing unit first extracts the feature value in the reference feature picture block as the reference feature value, and then obtains the feature value corresponding to the feature picture block from the extracted feature picture block as the extracted feature value, and then extracts the feature value according to the reference feature value and the extracted feature value. The reference feature picture block is similarly matched with the feature picture block extracted from the acquired image. If the similarity between the feature picture block extracted from the acquired image and the reference feature picture block exceeds a preset threshold, the captured image is considered to be in the captured image. There is a target object that matches the reference feature picture block, and the target object is a feature picture block extracted from the acquired image and whose similarity with the reference feature picture block exceeds a preset threshold.
其中,该基准特征值可以包括以下至少之一特征值:The reference feature value may include at least one of the following feature values:
颜色特征值、纹理特征值、形状特征值、空间关系特征值。Color feature values, texture feature values, shape feature values, and spatial relationship feature values.
需要说明的是:实际应用时,该基准特征值不限于上述这些特征值。It should be noted that, in actual application, the reference feature value is not limited to the above feature values.
在本实施例中,从该采集的图像中提取特征图片块的步骤为:将采集的图像按照预设的横向像素间隔及纵向像素间隔进行区域分割,以将每一个分割的图片区域作为提取的特征图片块,分割的每一个图片区域与获取的基准特征图片块的形状和大小一致。In this embodiment, the step of extracting the feature picture block from the acquired image is: dividing the collected image according to a preset horizontal pixel interval and a vertical pixel interval to divide each divided picture area as an extracted image. The feature picture block, each picture area of the segmentation is consistent with the shape and size of the acquired reference feature picture block.
该获取单元可从监控终端获取基准特征图片块,在本实施例中,获取基准特征图片块的步骤为:用户先对拍摄设备的摄像模块10进行调整,将 摄像模块10调整到合适位置和拍摄视角以使该拍摄模块10采集到合适视角的图像;该拍摄设备将拍摄模块10采集的图像实时发送给监控终端,使得用户可通过监控终端查看到摄像模块10采集的图像;用户在该监控终端上预览摄像模块10采集的图像,当用户觉得摄像模块10采集的图像符合要求时,则在该监控终端中输入拍摄指令,监控终端将接收的拍摄指令发送给拍摄设备,拍摄设备接收到监控终端发送过来的拍摄指令时,控制摄像模块10执行拍摄操作以生成基准图片,并将该生成的基准图片发送给监控终端,监控终端将该基准图片显示出来,并提示用户在该基准图片中选择出基准特征图片块(可通过框选方式从该基准图片中框出基准特征图片块,或通过图像识别技术识别出人脸,再由用户从该识别出的人脸中选择一个或多个人脸作为基准特征图片块),在用户选择出基准特征图片块后,该监控终端将用户选择出的基准特征图片块发送给拍摄设备,该拍摄设备接收该基准特征图片块,即该拍摄设备的获取单元从监控终端获取到了基准特征图片块。The acquiring unit may acquire the reference feature picture block from the monitoring terminal. In this embodiment, the step of acquiring the reference feature picture block is: the user first adjusts the camera module 10 of the shooting device, and The camera module 10 adjusts to a suitable position and a shooting angle to enable the camera module 10 to capture an image of a suitable angle of view; the camera captures the image captured by the camera module 10 to the monitoring terminal in real time, so that the user can view the camera module 10 through the monitoring terminal. The captured image is previewed by the user on the monitoring terminal. When the user feels that the image captured by the camera module 10 meets the requirements, the user inputs a shooting instruction in the monitoring terminal, and the monitoring terminal sends the received shooting instruction to the monitoring terminal. a photographing device, when the photographing device receives the photographing instruction sent by the monitoring terminal, the photographing module 10 is controlled to perform a photographing operation to generate a reference image, and the generated reference image is sent to the monitoring terminal, and the monitoring terminal displays the reference image, and Prompting the user to select a reference feature picture block in the reference picture (the reference feature picture block can be framed from the reference picture by frame selection, or the face is recognized by image recognition technology, and then the user recognizes the person from the target Select one or more faces in the face as the reference feature picture block), in After the user selects the reference feature picture block, the monitoring terminal sends the reference feature picture block selected by the user to the photographing device, and the photographing device receives the reference feature picture block, that is, the acquiring unit of the photographing device acquires the reference feature from the monitoring terminal. Picture block.
在一实施例中,该预设位置信息为基准特征图片块在基准图片中的位置信息。In an embodiment, the preset location information is location information of the reference feature picture block in the reference picture.
在一实施例中,该设备还包括与该摄像模块10连接的图片发送模块,该图片发送模块,配置为将拍摄操作生成的照片发送给监控终端。In an embodiment, the device further includes a picture sending module connected to the camera module 10, and the picture sending module is configured to send the photo generated by the shooting operation to the monitoring terminal.
该图片发送模块将摄像模块10执行拍摄操作生成的照片发送给监控终端。用户可方便地通过该监控终端即时查看拍摄的照片,如在拍摄集体照时,可在监控终端对拍摄的集体照片进行放大查看,以确定参与拍照人员在照片中的表情动作是否达到预期,如果未达到预期,可通过该监控终端向摄像模块10发送拍摄指令继续拍摄,直至拍摄到用户满意的照片。The picture sending module sends the photo generated by the camera module 10 to perform the shooting operation to the monitoring terminal. The user can conveniently view the photographed photos through the monitoring terminal. For example, when taking a group photo, the collective photo taken by the monitoring terminal can be zoomed in to determine whether the facial expression of the participating photographer in the photo is expected. If the prediction is not reached, the monitoring terminal can send a shooting instruction to the camera module 10 to continue shooting until a photo satisfactory to the user is captured.
实际应用时,摄像模块10可由拍摄设备中的相机实现;判断模块20、跟踪控制模块30、分析模块、获取单元、提取单元、分析单元可由拍摄设 备中的中央处理器(CPU,Central Processing Unit)、微处理器(MCU,Micro Control Unit)、数字信号处理器(DSP,Digital Signal Processor)或可编程逻辑阵列(FPGA,Field-Programmable Gate Array)实现;拍摄控制模块40及图片发送模块可由拍摄设备中的CPU、MCU、DSP或FPGA结合通信芯片实现。In actual application, the camera module 10 can be implemented by a camera in the photographing device; the judging module 20, the tracking control module 30, the analyzing module, the obtaining unit, the extracting unit, and the analyzing unit can be set by the photographing device. Central Processing Unit (CPU), Micro Control Unit (MCU), Digital Signal Processor (DSP), or Field-Programmable Gate Array (FPGA) The imaging control module 40 and the picture sending module can be implemented by a CPU, an MCU, a DSP or an FPGA in a photographing device in combination with a communication chip.
参照图2,图2为本发明跟踪拍摄方法的第一实施例流程示意图,使用上述任一技术方案的拍摄设备,该方法包括:Referring to FIG. 2, FIG. 2 is a schematic flowchart of a first embodiment of a tracking and photographing method according to the present invention. The photographing apparatus using any of the above technical solutions includes:
S10、通过拍摄设备的摄像模块进行图像采集。S10. Perform image acquisition by using a camera module of the photographing device.
在该步骤中,通过摄像模块按照预设的采样频率进行图像采集,如该预设的采样频率可以为每秒20帧图像。In this step, image acquisition is performed by the camera module according to a preset sampling frequency, and the preset sampling frequency may be 20 frames per second.
预先建立拍摄设备与监控终端的通信连接,该拍摄设备可通过蓝牙通信技术与该监控终端建立连接。A communication connection between the photographing device and the monitoring terminal is established in advance, and the photographing device can establish a connection with the monitoring terminal through a Bluetooth communication technology.
接收到用户输入的采集指令时,监控终端将该输入的采集指令发送给拍摄设备,该拍摄设备接收到监控终端发送的采集指令时,通过摄像模块进行图像采集。该采集指令可以通过预设的手势动作、触控动作、功能按键或语音命令发出。When receiving the acquisition instruction input by the user, the monitoring terminal sends the input acquisition instruction to the photographing device, and when the photographing device receives the acquisition instruction sent by the monitoring terminal, the image capture is performed by the camera module. The acquisition command can be issued by a preset gesture action, a touch action, a function button or a voice command.
该拍摄设备可将采集的图像实时发送给监控终端,使得用户可通过监控终端查看到拍摄设备采集的图像。在该监控终端开启自动跟踪拍摄模式,实时接收该拍摄设备采集的图像。The photographing device can send the collected image to the monitoring terminal in real time, so that the user can view the image collected by the photographing device through the monitoring terminal. The automatic tracking shooting mode is turned on in the monitoring terminal, and the image collected by the shooting device is received in real time.
S20、判断该采集图像中的目标对象在该采集图像中的特征信息是否与预设特征信息匹配,若该采集图像中的目标对象在该采集图像中的特征信息与预设特征信息不匹配,则执行步骤S30。S20. Determine whether the feature information of the target object in the captured image matches the preset feature information, and if the feature information of the target object in the captured image does not match the preset feature information, Then step S30 is performed.
该目标对象可通过现有的图像识别技术从该采集的图像中识别出来,该目标对象是可以人脸或人体模样。在该步骤中,先获取该采集图像中的目标对象在采集图像中的特征信息,该特征信息是位置信息,该位置信息 可以为具体的坐标信息(在显示采集图像的屏幕上建立坐标系,可以以左下角作为坐标原点);然后判断该采集图像中的目标对象在该采集图像中的特征信息是否与预设特征信息匹配,具体地,可在该目标对象在该采集图像中的特征信息与预设特征信息完全一致或者在该目标对象在该采集图像中的特征信息与预设特征信息的偏差在预设阀值内时,认为该目标对象在该采集图像中的特征信息与预设特征信息匹配。The target object can be identified from the acquired image by an existing image recognition technology, and the target object can be a human face or a human body. In this step, the feature information of the target object in the acquired image in the acquired image is acquired first, and the feature information is location information, and the location information is It can be specific coordinate information (the coordinate system is established on the screen displaying the acquired image, and the lower left corner can be used as the coordinate origin); then it is determined whether the feature information of the target object in the captured image in the captured image and the preset feature information Matching, in particular, the feature information in the captured image of the target object is completely consistent with the preset feature information or the deviation between the feature information of the target object and the preset feature information in the captured image is at a preset threshold When it is inside, it is considered that the feature information of the target object in the captured image matches the preset feature information.
该预设特征信息是预设位置信息,该预设位置信息可预先设置,可根据用户的个人喜好,将预设位置信息设置为任意位置,如可设置为位于图像的中部(通过坐标值体现出位于图像的中部)。The preset feature information is pre-set position information, and the preset position information may be preset, and the preset position information may be set to an arbitrary position according to the user's personal preference, for example, may be set to be located in the middle of the image (reflected by coordinate values) Out of the middle of the image).
S30、根据该目标对象在该采集图像中的特征信息与预设特征信息的偏差,控制摄像模块的移动方向和/或调整摄像模块的拍摄视角,以使通过该摄像模块采集的图像中的目标对象的特征信息与预设特征信息匹配。S30. Control a moving direction of the camera module and/or adjust a shooting angle of the camera module according to the deviation of the feature information of the target object in the captured image from the preset feature information, so as to achieve a target in the image collected by the camera module. The feature information of the object matches the preset feature information.
在该采集图像中的目标对象在该采集图像中的位置信息与预设位置信息不匹配时,根据该目标对象在该采集图像中的特征信息与预设特征信息的偏差,控制摄像模块的移动方向和/或调整摄像模块的拍摄视角,以使通过该摄像模块采集的图像中的目标对象的特征信息与预设特征信息匹配,即使得通过该摄像模块在后续图像采集时,目标对象在采集图像中的特征信息与预设特征信息匹配。具体地,当该目标对象在该采集图像中的特征信息与预设特征信息的偏差为偏左时,控制摄像模块向左移动和/或调整摄像模块的拍摄视角,以使通过该摄像模块采集的图像中的目标对象的特征信息与预设特征信息匹配;当该目标对象在该采集图像中的特征信息与预设特征信息的偏差为偏右时,控制摄像模块向右移动和/或调整摄像模块的拍摄视角,以使通过该摄像模块采集的图像中的目标对象的特征信息与预设特征信息匹配。When the position information of the target object in the captured image does not match the preset position information, the movement of the camera module is controlled according to the deviation of the feature information of the target object in the captured image from the preset feature information. Orienting and/or adjusting a shooting angle of the camera module, so that the feature information of the target object in the image captured by the camera module is matched with the preset feature information, that is, the target object is collected by the camera module during subsequent image acquisition. The feature information in the image matches the preset feature information. Specifically, when the deviation between the feature information of the target object and the preset feature information is to the left, the camera module is controlled to move to the left and/or adjust the shooting angle of the camera module to be collected by the camera module. The feature information of the target object in the image is matched with the preset feature information; when the deviation of the feature information of the target object in the captured image from the preset feature information is to the right, the camera module is controlled to move to the right and/or adjust The shooting angle of the camera module is such that the feature information of the target object in the image captured by the camera module matches the preset feature information.
S40、接收到监控终端发送过来的拍摄指令时,执行拍摄操作。 S40. Perform a shooting operation when receiving a shooting instruction sent by the monitoring terminal.
该监控终端可以为智能手机,通过该监控终端可实时预览到拍摄设备通过摄像模块采集的图像,当用户觉得拍摄设备通过摄像模块采集的图像符合要求时,则在该监控终端中输入拍摄指令,该拍摄指令可以通过应用程序发出,如QQ中的“拍照”选项,也可以通过预设的手势动作、触控动作、功能按键或语音命令发出。在该步骤中,在接收到监控终端发送过来的拍摄指令时,执行拍摄操作。The monitoring terminal can be a smart phone, and the monitoring terminal can preview the image captured by the shooting device through the camera module in real time. When the user feels that the image captured by the camera device through the camera module meets the requirements, the shooting instruction is input in the monitoring terminal. The shooting instruction can be issued by the application, such as the "photographing" option in QQ, or by a preset gesture action, touch action, function button or voice command. In this step, when a photographing instruction transmitted from the monitoring terminal is received, a photographing operation is performed.
参照图3,图3为本发明跟踪拍摄方法的第二实施例的流程示意图。Referring to FIG. 3, FIG. 3 is a schematic flowchart diagram of a second embodiment of a tracking shooting method according to the present invention.
基于上述跟踪拍摄方法的第一实施例,在步骤S20之前,该方法还包括:Based on the first embodiment of the above-described tracking and photographing method, before the step S20, the method further includes:
S50、分析该采集图像中是否存在与基准特征图片块匹配的目标对象,若该采集图像中存在与基准特征图片块匹配的目标对象,则执行步骤S30。S50. Analyze whether there is a target object matching the reference feature picture block in the acquired image. If there is a target object matching the reference feature picture block in the captured image, step S30 is performed.
该基准特征图片块可预先设置,当用户在通过拍摄设备进行拍摄时,需要在采集的图像中包含有与该基准特征图片块匹配的目标对象。The reference feature picture block can be preset, and when the user is shooting by the shooting device, the target image that matches the reference feature picture block needs to be included in the captured image.
在一实施例中,该步骤S50包括:In an embodiment, the step S50 includes:
S51、获取基准特征图片块。S51. Acquire a reference feature picture block.
该基准特征图片块可从监控终端获取。The reference feature picture block can be obtained from the monitoring terminal.
在本实施例中,该获取基准特征图片块的步骤为:用户先对拍摄设备的摄像模块进行调整,将摄像模块调整到合适位置和拍摄视角以采集到合适视角的图像;该拍摄设备将摄像模块采集的图像实时发送给监控终端,使得用户可通过监控终端查看到摄像模块采集的图像;用户在该监控终端上预览摄像模块采集的图像,当用户觉得摄像模块采集的图像符合要求时,则在该监控终端中输入拍摄指令,监控终端将接收的拍摄指令发送给拍摄设备,拍摄设备接收到监控终端发送过来的拍摄指令时,执行拍摄操作以生成基准图片,并将该生成的基准图片发送给监控终端,监控终端将该基准图片显示出来,并提示用户在该基准图片中选择出基准特征图片块(可 通过框选方式从该基准图片中框出基准特征图片块,或通过图像识别技术识别出人脸,再由用户从该识别出的人脸中选择一个或多个人脸作为基准特征图片块),在用户选择出基准特征图片块后,该监控终端将用户选择出的基准特征图片块发送给拍摄设备,该拍摄设备接收该基准特征图片块,即该拍摄设备从监控终端获取到了基准特征图片块。In this embodiment, the step of acquiring the reference feature picture block is: the user first adjusts the camera module of the photographing device, adjusts the camera module to a suitable position and a photographing angle to acquire an image of a suitable angle of view; the photographing device will photograph The image collected by the module is sent to the monitoring terminal in real time, so that the user can view the image captured by the camera module through the monitoring terminal; the user previews the image captured by the camera module on the monitoring terminal, and when the user feels that the image captured by the camera module meets the requirements, The photographing instruction is input to the monitoring terminal, and the monitoring terminal sends the received photographing instruction to the photographing device. When the photographing device receives the photographing instruction sent by the monitoring terminal, the photographing device performs a photographing operation to generate a reference image, and sends the generated reference image. To the monitoring terminal, the monitoring terminal displays the reference picture and prompts the user to select a reference feature picture block in the reference picture ( The reference feature picture block is framed from the reference picture by frame selection, or the face is recognized by image recognition technology, and then the user selects one or more faces from the recognized face as the reference feature picture block) After the user selects the reference feature picture block, the monitoring terminal sends the reference feature picture block selected by the user to the photographing device, and the photographing device receives the reference feature picture block, that is, the photographing device acquires the reference feature picture block from the monitoring terminal. .
S52、从该采集图像中提取特征图片块,提取的特征图片块与基准特征图片块的形状和大小一致。S52. Extract a feature picture block from the acquired image, and extract the feature picture block and the shape and size of the reference feature picture block.
在本实施例中,从该采集的图像中提取特征图片块的步骤为:将采集的图像按照预设的横向像素间隔及纵向像素间隔进行区域分割,以将每一个分割的图片区域作为提取的特征图片块,分割的每一个图片区域与获取的基准特征图片块的形状和大小一致。In this embodiment, the step of extracting the feature picture block from the acquired image is: dividing the collected image according to a preset horizontal pixel interval and a vertical pixel interval to divide each divided picture area as an extracted image. The feature picture block, each picture area of the segmentation is consistent with the shape and size of the acquired reference feature picture block.
S53、分析该提取的特征图片块与基准特征图片块的相似度是否超过预设阀值,若该提取的特征图片块与基准特征图片块的相似度超过预设阀值,则认为该采集的图像中存在与该基准特征图片块匹配的目标对象,且该目标对象即为从该采集的图像中提取的与基准特征图片块相似度超过预设阀值的特征图片块。S53. Analyze whether the similarity between the extracted feature picture block and the reference feature picture block exceeds a preset threshold. If the similarity between the extracted feature picture block and the reference feature picture block exceeds a preset threshold, the collected There is a target object in the image that matches the reference feature picture block, and the target object is a feature picture block extracted from the acquired image and whose similarity with the reference feature picture block exceeds a preset threshold.
在该步骤中,先提取基准特征图片块中的特征值作为基准特征值,然后从提取的特征图片块中获取特征图片块对应的特征值作为提取特征值,再根据基准特征值与提取特征值,对该基准特征图片块与从采集图像中提取的特征图片块进行相似度匹配,若从采集图像中提取的特征图片块与基准特征图片块的相似度超过预设阀值,则认为该采集图像中存在与基准特征图片块匹配的目标对象,且该目标对象即为从该采集图像中提取的与基准特征图片块相似度超过预设阀值的特征图片块。In this step, the feature value in the reference feature picture block is first extracted as the reference feature value, and then the feature value corresponding to the feature picture block is obtained from the extracted feature picture block as the extracted feature value, and then the reference feature value and the extracted feature value are extracted according to the reference feature value. And performing similarity matching on the reference feature picture block and the feature picture block extracted from the acquired image. If the similarity between the feature picture block extracted from the acquired image and the reference feature picture block exceeds a preset threshold, the collection is considered to be the acquisition. There is a target object in the image that matches the reference feature picture block, and the target object is a feature picture block extracted from the acquired image and whose similarity with the reference feature picture block exceeds a preset threshold.
其中,该基准特征值可以包括以下至少之一特征值:The reference feature value may include at least one of the following feature values:
颜色特征值、纹理特征值、形状特征值、空间关系特征值。 Color feature values, texture feature values, shape feature values, and spatial relationship feature values.
需要说明的是:实际应用时,该基准特征值不限于上述这些特征值。It should be noted that, in actual application, the reference feature value is not limited to the above feature values.
在一实施例中,在步骤S30中的,预设位置信息为基准特征图片块在基准图片中的位置信息。In an embodiment, in step S30, the preset position information is position information of the reference feature picture block in the reference picture.
参照图4,图4为本发明跟踪拍摄方法的第三实施例的流程示意图。Referring to FIG. 4, FIG. 4 is a schematic flowchart diagram of a third embodiment of a tracking shooting method according to the present invention.
基于上述跟踪拍摄方法的第一实施例,在步骤S40之后,该步骤还包括:Based on the first embodiment of the above-described tracking and photographing method, after step S40, the step further includes:
S60、将拍摄操作生成的照片发送给监控终端。S60. Send the photo generated by the shooting operation to the monitoring terminal.
在该步骤中,将步骤S40拍摄操作生成的照片发送给监控终端。用户可方便地通过该监控终端即时查看拍摄的照片,如在拍摄集体照时,可在监控终端对拍摄的集体照片进行放大查看,以确定参与拍照人员在照片中的表情动作是否达到预期,如果未达到预期,可通过该监控终端向摄像模块发送拍摄指令继续拍摄,直至拍摄到用户满意的照片。In this step, the photo generated by the shooting operation in step S40 is transmitted to the monitoring terminal. The user can conveniently view the photographed photos through the monitoring terminal. For example, when taking a group photo, the collective photo taken by the monitoring terminal can be zoomed in to determine whether the facial expression of the participating photographer in the photo is expected. If the prediction is not met, the monitoring terminal can send a shooting instruction to the camera module to continue shooting until the user is satisfied with the photo.
参照图5,图5为本发明跟踪拍摄系统的优选实施例的结构示意图,该系统包括上述任一实施例的拍摄设备100,及与该拍摄设备100通信连接的监控终端200,该监控终端200包括拍摄指令发送模块201,配置为向该拍摄设备发送拍摄指令。Referring to FIG. 5, FIG. 5 is a schematic structural diagram of a preferred embodiment of a tracking and photographing system according to the present invention. The system includes the photographing apparatus 100 of any of the above embodiments, and a monitoring terminal 200 communicably connected to the photographing apparatus 100. The monitoring terminal 200 The photographing instruction sending module 201 is configured to send a photographing instruction to the photographing device.
实际应用时,摄指令发送模块201可由监控终端200中的CPU、MCU、DSP或FPGA结合通信芯片实现。In practical applications, the command transmission module 201 can be implemented by a CPU, an MCU, a DSP, or an FPGA in the monitoring terminal 200 in combination with a communication chip.
本领域内的技术人员应明白,本发明的实施例可提供为方法、系统、或计算机程序产品。因此,本发明可采用硬件实施例、软件实施例、或结合软件和硬件方面的实施例的形式。而且,本发明可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘 存储器和光学存储器等)上实施的计算机程序产品的形式。Those skilled in the art will appreciate that embodiments of the present invention can be provided as a method, system, or computer program product. Accordingly, the present invention can take the form of a hardware embodiment, a software embodiment, or a combination of software and hardware. Moreover, the present invention may employ computer-usable storage media (including but not limited to disks) in one or more of the computer-usable program code embodied therein. A form of computer program product embodied on a memory and optical storage, etc.).
本发明是参照根据本发明实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。The present invention has been described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (system), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine for the execution of instructions for execution by a processor of a computer or other programmable data processing device. Means for implementing the functions specified in one or more of the flow or in a block or blocks of the flow chart.
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上,使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.
基于此,本发明实施例还提供了一种计算机存储介质,所述计算机存储介质包括一组指令,当执行所述指令时,引起至少一个处理器执行上述的跟踪拍摄方法。Based on this, an embodiment of the present invention further provides a computer storage medium, the computer storage medium comprising a set of instructions, when executed, causing at least one processor to execute the tracking shooting method described above.
以上仅为本发明的优选实施例,并非因此限制本发明的专利范围,凡是利用本发明说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本发明的专利保护范围内。 The above are only the preferred embodiments of the present invention, and are not intended to limit the scope of the invention, and the equivalent structure or equivalent process transformations made by the description of the present invention and the drawings are directly or indirectly applied to other related technical fields. The same is included in the scope of patent protection of the present invention.

Claims (12)

  1. 一种拍摄设备,该拍摄设备包括:A photographing apparatus, the photographing apparatus comprising:
    摄像模块,配置为进行图像采集;a camera module configured to perform image acquisition;
    判断模块,配置为判断采集图像中的目标对象在所述采集图像中的特征信息是否与预设特征信息匹配;a determining module, configured to determine whether the feature information of the target object in the captured image in the captured image matches the preset feature information;
    跟踪控制模块,配置为在所述采集图像中的目标对象在所述采集图像中的特征信息与预设特征信息不匹配时,根据所述目标对象在所述采集的图像中的特征信息与预设特征信息的偏差,控制摄像模块的移动方向和/或调整摄像模块的拍摄视角,以使通过所述摄像模块采集的图像中的目标对象的特征信息与预设特征信息匹配;a tracking control module, configured to: when the feature information in the captured image does not match the preset feature information, the feature information and the pre-target in the captured image Determining the deviation of the feature information, controlling the moving direction of the camera module, and/or adjusting the shooting angle of the camera module, so that the feature information of the target object in the image captured by the camera module matches the preset feature information;
    拍摄控制模块,配置为接收到监控终端发送过来的拍摄指令时,控制摄像模块执行拍摄操作。The shooting control module is configured to control the camera module to perform a shooting operation when receiving the shooting instruction sent by the monitoring terminal.
  2. 如权利要求1所述的拍摄设备,其中,所述特征信息是位置信息,所述预设特征信息是预设位置信息。The photographing apparatus according to claim 1, wherein the feature information is position information, and the preset feature information is preset position information.
  3. 如权利要求2所述的拍摄设备,其中,所述设备还包括:The photographing apparatus according to claim 2, wherein the apparatus further comprises:
    分析模块,配置为分析所述采集图像中是否存在与基准特征图片块匹配的目标对象。And an analysis module configured to analyze whether there is a target object matching the reference feature picture block in the acquired image.
  4. 如权利要求3所述的拍摄设备,其中,所述预设位置信息为基准特征图片块在基准图片中的位置信息。The photographing apparatus according to claim 3, wherein the preset position information is position information of a reference feature picture block in a reference picture.
  5. 如权利要求3所述的拍摄设备,其中,所述分析模块包括:The photographing apparatus of claim 3, wherein the analysis module comprises:
    获取单元,配置为获取基准特征图片块;Obtaining a unit configured to obtain a reference feature picture block;
    提取单元,配置为从所述采集图像中提取特征图片块,提取的特征图 片块与基准特征图片块的形状和大小一致;An extracting unit configured to extract a feature picture block from the captured image, and extract the feature map The slice is consistent with the shape and size of the reference feature picture block;
    分析单元,配置为分析所述提取的特征图片块与基准特征图片块的相似度是否超过预设阀值,若所述提取的特征图片块与基准特征图片块的相似度超过预设阀值,则确定所述采集图像中存在与所述基准特征图片块匹配的目标对象,且所述目标对象为从所述采集图像中提取的与基准特征图片块相似度超过预设阀值的特征图片块。The analyzing unit is configured to analyze whether the similarity between the extracted feature picture block and the reference feature picture block exceeds a preset threshold, and if the similarity between the extracted feature picture block and the reference feature picture block exceeds a preset threshold, Determining that the target object that matches the reference feature picture block exists in the captured image, and the target object is a feature picture block that is extracted from the acquired image and whose similarity with the reference feature picture block exceeds a preset threshold. .
  6. 一种跟踪拍摄方法,使用上述权利要求1-5任一项所述的拍摄设备,该方法包括:A method of tracking and photographing, using the photographing apparatus according to any one of claims 1 to 5, the method comprising:
    通过所述拍摄设备的摄像模块进行图像采集;Performing image acquisition by the camera module of the photographing device;
    判断采集图像中的目标对象在所述采集图像中的特征信息是否与预设特征信息匹配;Determining whether the feature information of the target object in the acquired image in the captured image matches the preset feature information;
    所述采集图像中的目标对象在所述采集的图像中的特征信息与预设特征信息不匹配时,根据所述目标对象在所述采集图像中的特征信息与预设特征信息的偏差,控制摄像模块的移动方向和/或调整摄像模块的拍摄视角,以使通过所述摄像模块采集的图像中的目标对象的特征信息与预设特征信息匹配;When the feature information in the captured image does not match the preset feature information, the target object is controlled according to the deviation of the feature information of the target object in the captured image from the preset feature information. a moving direction of the camera module and/or adjusting a shooting angle of the camera module to match feature information of the target object in the image captured by the camera module with preset feature information;
    接收到监控终端发送过来的拍摄指令时,执行拍摄操作。When receiving a shooting command sent from the monitoring terminal, the shooting operation is performed.
  7. 如权利要求6所述的跟踪拍摄方法,其中,所述特征信息是位置信息,所述预设特征信息是预设位置信息。The tracking photographing method according to claim 6, wherein the feature information is position information, and the preset feature information is preset position information.
  8. 如权利要求7所述的跟踪拍摄方法,其中,所述判断采集图像中的目标对象在所述采集图像中的特征信息是否与预设特征信息匹配之前,该方法还包括:The tracking and photographing method of claim 7, wherein the method further comprises: before determining whether the feature information of the target object in the captured image matches the preset feature information, the method further comprising:
    分析所述采集图像中是否存在与基准特征图片块匹配的目标对象;确 定所述采集图像中存在与基准特征图片块匹配的目标对象时,判断所述采集图像中的目标对象在所述采集图像中的特征信息是否与预设特征信息匹配。Analyzing whether there is a target object matching the reference feature picture block in the captured image; When the target object matching the reference feature picture block exists in the captured image, it is determined whether the feature information of the target object in the acquired image matches the preset feature information.
  9. 如权利要求8所述的跟踪拍摄方法,其中,所述预设位置信息为基准特征图片块在基准图片中的位置信息。The tracking photographing method according to claim 8, wherein the preset position information is position information of a reference feature picture block in a reference picture.
  10. 如权利要求8所述的跟踪拍摄方法,其中,所述分析所述采集图像中是否存在与基准特征图片块匹配的目标对象,包括:The tracking photographing method according to claim 8, wherein the analyzing whether there is a target object matching the reference feature picture block in the captured image comprises:
    获取基准特征图片块;Obtaining a reference feature picture block;
    从所述采集图像中提取特征图片块,提取的特征图片块与基准特征图片块的形状和大小一致;Extracting a feature picture block from the acquired image, and extracting the feature picture block and the shape and size of the reference feature picture block are consistent;
    分析所述提取的特征图片块与基准特征图片块的相似度是否超过预设阀值,若所述提取的特征图片块与基准特征图片块的相似度超过预设阀值,则确定所述采集图像中存在与所述基准特征图片块匹配的目标对象,且所述目标对象为从所述采集图像中提取的与基准特征图片块相似度超过预设阀值的特征图片块。And analyzing whether the similarity between the extracted feature picture block and the reference feature picture block exceeds a preset threshold, and if the similarity between the extracted feature picture block and the reference feature picture block exceeds a preset threshold, determining the collection There is a target object in the image that matches the reference feature picture block, and the target object is a feature picture block extracted from the acquired image and whose similarity with the reference feature picture block exceeds a preset threshold.
  11. 一种拍摄系统,包括如权利要求1至5任一项所述的拍摄设备,及与所述拍摄设备通信连接的监控终端,所述监控终端包括拍摄指令发送模块,配置为向所述拍摄设备发送拍摄指令。A photographing system comprising the photographing apparatus according to any one of claims 1 to 5, and a monitoring terminal communicably connected to the photographing apparatus, the monitoring terminal comprising a photographing instruction transmitting module configured to be to the photographing apparatus Send a shooting order.
  12. 一种计算机存储介质,所述计算机存储介质包括一组指令,当执行所述指令时,引起至少一个处理器执行如权利要求6至10任一项所述的跟踪拍摄方法。 A computer storage medium comprising a set of instructions that, when executed, cause at least one processor to perform the tracking and photographing method of any one of claims 6 to 10.
PCT/CN2015/089339 2015-05-28 2015-09-10 Photographing device, tracking photographing method and system, and computer storage medium WO2016187985A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510283511.3 2015-05-28
CN201510283511.3A CN106303195A (en) 2015-05-28 2015-05-28 Capture apparatus and track up method and system

Publications (1)

Publication Number Publication Date
WO2016187985A1 true WO2016187985A1 (en) 2016-12-01

Family

ID=57393625

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/089339 WO2016187985A1 (en) 2015-05-28 2015-09-10 Photographing device, tracking photographing method and system, and computer storage medium

Country Status (2)

Country Link
CN (1) CN106303195A (en)
WO (1) WO2016187985A1 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107966997A (en) * 2017-12-19 2018-04-27 广西师范大学 A kind of device automatically controlled to image capture device
CN109657576A (en) * 2018-12-06 2019-04-19 联想(北京)有限公司 Image Acquisition control method, device, storage medium and system
CN110738173A (en) * 2019-10-15 2020-01-31 安徽江淮汽车集团股份有限公司 Face recognition system and method
CN110766718A (en) * 2019-09-09 2020-02-07 北京美院帮网络科技有限公司 Method, device and system for acquiring picture
CN110785995A (en) * 2018-09-04 2020-02-11 深圳市大疆创新科技有限公司 Shooting control method, device, equipment and storage medium
CN113452926A (en) * 2018-10-26 2021-09-28 创新先进技术有限公司 Image acquisition device, system and method

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107454313A (en) * 2017-06-19 2017-12-08 中国烟草总公司广东省公司 The photographic method and camera system of agricultural intelligent device
CN109391762B (en) * 2017-08-03 2021-10-22 杭州海康威视数字技术股份有限公司 Tracking shooting method and device
CN113890996A (en) * 2017-12-29 2022-01-04 深圳市大疆创新科技有限公司 Image processing method, mobile platform, control equipment and system
CN108737717A (en) * 2018-03-21 2018-11-02 北京猎户星空科技有限公司 Image pickup method, device, smart machine and storage medium
CN113395450A (en) * 2018-05-29 2021-09-14 深圳市大疆创新科技有限公司 Tracking shooting method, device and storage medium
CN113656842B (en) * 2021-08-10 2024-02-02 支付宝(杭州)信息技术有限公司 Data verification method, device and equipment

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001359086A (en) * 2000-03-31 2001-12-26 Sogo Keibi Hosho Co Ltd Supervisory camera system
CN103377471A (en) * 2012-04-16 2013-10-30 株式会社理光 Method and device for object positioning, and method and device for determining optimal camera pair
CN103957359A (en) * 2014-05-15 2014-07-30 深圳市中兴移动通信有限公司 Camera shooting device and focusing method thereof
CN104601984A (en) * 2014-12-22 2015-05-06 小米科技有限责任公司 White balance test method and white balance test device

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004252748A (en) * 2003-02-20 2004-09-09 Toshiba Corp Image processing method and image processor
JP2007074279A (en) * 2005-09-06 2007-03-22 Canon Inc Imaging apparatus and control method thereof
JP5720275B2 (en) * 2011-02-03 2015-05-20 株式会社リコー Imaging apparatus and imaging method
CN103299613B (en) * 2011-11-17 2017-08-15 松下电器(美国)知识产权公司 Image processing apparatus, camera device and image processing method
TWI584647B (en) * 2012-07-12 2017-05-21 Chi Lin Hong A method and apparatus for preventing defocusing
CN103905733B (en) * 2014-04-02 2018-01-23 哈尔滨工业大学深圳研究生院 A kind of method and system of monocular cam to real time face tracking

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001359086A (en) * 2000-03-31 2001-12-26 Sogo Keibi Hosho Co Ltd Supervisory camera system
CN103377471A (en) * 2012-04-16 2013-10-30 株式会社理光 Method and device for object positioning, and method and device for determining optimal camera pair
CN103957359A (en) * 2014-05-15 2014-07-30 深圳市中兴移动通信有限公司 Camera shooting device and focusing method thereof
CN104601984A (en) * 2014-12-22 2015-05-06 小米科技有限责任公司 White balance test method and white balance test device

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107966997A (en) * 2017-12-19 2018-04-27 广西师范大学 A kind of device automatically controlled to image capture device
CN110785995A (en) * 2018-09-04 2020-02-11 深圳市大疆创新科技有限公司 Shooting control method, device, equipment and storage medium
CN113452926A (en) * 2018-10-26 2021-09-28 创新先进技术有限公司 Image acquisition device, system and method
CN113452926B (en) * 2018-10-26 2023-01-13 创新先进技术有限公司 Image acquisition device, system and method
CN109657576A (en) * 2018-12-06 2019-04-19 联想(北京)有限公司 Image Acquisition control method, device, storage medium and system
CN109657576B (en) * 2018-12-06 2023-10-31 联想(北京)有限公司 Image acquisition control method, device, storage medium and system
CN110766718A (en) * 2019-09-09 2020-02-07 北京美院帮网络科技有限公司 Method, device and system for acquiring picture
CN110766718B (en) * 2019-09-09 2024-04-16 北京美院帮网络科技有限公司 Picture acquisition method, device and system
CN110738173A (en) * 2019-10-15 2020-01-31 安徽江淮汽车集团股份有限公司 Face recognition system and method

Also Published As

Publication number Publication date
CN106303195A (en) 2017-01-04

Similar Documents

Publication Publication Date Title
WO2016187985A1 (en) Photographing device, tracking photographing method and system, and computer storage medium
CN108229369B (en) Image shooting method and device, storage medium and electronic equipment
US10297076B2 (en) Apparatus and method for generating 3D face model using mobile device
KR101800617B1 (en) Display apparatus and Method for video calling thereof
US20210337136A1 (en) Method and apparatus for processing video, and storage medium
WO2020094091A1 (en) Image capturing method, monitoring camera, and monitoring system
KR102407190B1 (en) Image capture apparatus and method for operating the image capture apparatus
WO2017096861A1 (en) Method and device for taking photographs
JP6443842B2 (en) Face detection device, face detection system, and face detection method
US11847770B2 (en) Automatic generation of all-in-focus images with a mobile camera
US9628700B2 (en) Imaging apparatus, imaging assist method, and non-transitory recoding medium storing an imaging assist program
WO2019213818A1 (en) Photographing control method, and electronic device
US20150379333A1 (en) Three-Dimensional Motion Analysis System
CN111654624B (en) Shooting prompting method and device and electronic equipment
WO2018121730A1 (en) Video monitoring and facial recognition method, device and system
US10009545B2 (en) Image processing apparatus and method of operating the same
JP2002366963A (en) Method and device for processing image, imaging device and computer program
JP2019186791A (en) Imaging apparatus, control method of the imaging apparatus, and control program
CN116129526A (en) Method and device for controlling photographing, electronic equipment and storage medium
WO2019213820A1 (en) Photographing control method and electronic device
CN111726531B (en) Image shooting method, processing method, device, electronic equipment and storage medium
JP2019135618A (en) Information processing apparatus, system, method of controlling information processing apparatus, and program
US20170104920A1 (en) Imaging apparatus and method for controlling the same
CN115334241B (en) Focusing control method, device, storage medium and image pickup apparatus
JP2019128791A (en) Image processing device and control method thereof

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15893066

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15893066

Country of ref document: EP

Kind code of ref document: A1