WO2016202166A1 - 一种智能家居视频监控方法和系统 - Google Patents

一种智能家居视频监控方法和系统 Download PDF

Info

Publication number
WO2016202166A1
WO2016202166A1 PCT/CN2016/083939 CN2016083939W WO2016202166A1 WO 2016202166 A1 WO2016202166 A1 WO 2016202166A1 CN 2016083939 W CN2016083939 W CN 2016083939W WO 2016202166 A1 WO2016202166 A1 WO 2016202166A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
specific
images
storage device
captured
Prior art date
Application number
PCT/CN2016/083939
Other languages
English (en)
French (fr)
Inventor
黄圣
杜安强
鲍敦桥
金升阳
蒋海青
Original Assignee
杭州萤石网络有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 杭州萤石网络有限公司 filed Critical 杭州萤石网络有限公司
Priority to US15/736,698 priority Critical patent/US20180167590A1/en
Priority to EP16810907.2A priority patent/EP3313068A4/en
Publication of WO2016202166A1 publication Critical patent/WO2016202166A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/188—Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/44—Browsing; Visualisation therefor
    • G06F16/447—Temporal browsing, e.g. timeline
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/54—Browsing; Visualisation therefor
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/55—Clustering; Classification
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/174—Facial expression recognition
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
    • H04N7/185—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source from a mobile camera, e.g. for remote control

Definitions

  • the invention belongs to the field of smart homes, and particularly relates to a smart home video monitoring method and system.
  • the existing smart home system combining camera, sensor and mobile terminal can only trigger and then capture the event image according to the event.
  • the image includes static pictures and dynamic video for the user to check the security situation at home, and its function is single.
  • the user hopes that the smart home system can differentiate and manage daily video images in addition to controlling family safety. For example, automatically generate a growing image file based on the images of the child captured by the camera, and automatically share the interesting images of the child at home with close relatives and friends, in addition to bringing the value of home security to the user, making the smart home system closer.
  • the scene of family life However, existing smart home systems do not have the above functions.
  • the object of the present invention is to provide a smart home video monitoring method and system, which can perform image capture on a trigger object and a trigger scene that meet the trigger condition, and store the image in a corresponding folder in a time axis according to the trigger condition, to the mobile terminal.
  • Different permissions are set, so that different mobile terminals can receive or access images of different scenes in the corresponding folder in real time, so that the present invention is closer to the family life scene in addition to the commonly used security functions.
  • an aspect of the present invention provides a smart home video monitoring method, including: pre-setting and saving a trigger condition of a captured image, wherein the trigger condition is in an image.
  • a specific character appears and the specific character presents a specific performance; detecting whether the current image satisfies the trigger condition in real time; if so, the current image is captured, and the captured image is classified according to different specific expressions of the specific character, and the classification is performed.
  • the image is saved in the form of a time axis; the access and transmission rights are set for the image saved in the time axis form after the classification.
  • the specific character is a preset character object
  • the specific expression is an emotional change
  • the step of classifying the captured images according to different specific representations of the specific characters is specifically: capturing images of the specific characters in different emotions, and classifying the captured images according to the corresponding emotions.
  • the step of saving the classified image in the time axis form is specifically: saving the same classified image in the same large file, and storing the same classified image in the same cycle time in the time axis form.
  • the same cycle time includes hours, days, weeks, months, and years.
  • the step of setting the access and sending rights is specifically: setting different access and sending rights for different classified images.
  • a smart home video monitoring system including: a capture device, which captures an image according to a preset trigger condition, and sends the captured image to a storage device, wherein the trigger condition is A specific person appears in the image and the specific character presents a specific performance; the storage device receives the image sent by the capture device, classifies the captured image according to different specific representations of the specific character, and saves the classified image in a time axis format; The mobile terminal or the client sets a trigger condition of the captured image, sets access and transmission rights of the image saved in the storage device, and accesses and receives an image saved in the storage device.
  • the specific character is a preset character object
  • the specific expression is an emotional change
  • the storage device saves the same classified image in the same large file, and Images of the same classification over a period of time are stored in the form of a time axis including hours, days, weeks, months, and years.
  • the storage device includes a local storage device and/or a cloud storage device.
  • the mobile terminal or the client is configured to set access and transmission rights of images saved in the storage device, and specifically set different access and transmission permission levels for images of different classifications.
  • the present invention classifies the captured images according to different emotions by image capture satisfying the trigger condition, stores the classified images in chronological order, sets different access rights and transmits the stored images.
  • the authority enables the mobile terminal or client to receive or access images of different emotions of a specific person in real time, so that the present invention is closer to family life than providing common security functions.
  • FIG. 1 is a schematic flow chart of a smart home video monitoring method of the present invention
  • FIG. 2 is a schematic structural diagram of a smart home video monitoring system of the present invention
  • Figure 3 is a system configuration diagram of a specific example of the present invention.
  • FIG. 4 is a schematic diagram of saving a captured image according to a time axis in a specific example of the present invention.
  • FIG. 5 is an interface display diagram when accessing a laughter folder according to a specific example of the present invention.
  • FIG. 1 is a schematic flow chart of a smart home video monitoring method of the present invention.
  • the user pre-sets and saves a trigger condition for performing image capture, which is a specific person appearing in the image and a specific character presents a specific performance.
  • the invention detects whether the current image captured by the capture device satisfies the trigger condition of the preset captured image by real-time. If it is satisfied, the current image is captured, and the captured image is further classified according to different specific performances of specific characters, and the classified images are saved in chronological order. Otherwise (ie, if the trigger condition of the preset captured image is not satisfied), it is continued to detect whether the next image captured by the capture device satisfies the trigger condition of the captured image.
  • the captured images include still pictures and dynamic videos.
  • the smart home video monitoring method of the present invention includes:
  • step S1 the trigger condition of the captured image is set and saved in advance.
  • the trigger condition is that a specific person appears in the image and the specific character presents a specific performance.
  • the specific person is a preset person object, and the specific expression is an emotional change.
  • the trigger condition for setting the captured image is: when the child appears laughing or crying, the image is captured.
  • the trigger condition is not limited to the trigger condition described in the present invention, and the user can customize other trigger conditions and capture the image according to other defined trigger conditions.
  • step S2 it is detected in real time whether the current image satisfies the trigger condition.
  • the image is captured by detecting whether the current image satisfies the trigger condition in real time. If yes, go to step S3, if no, go back to step S2.
  • step S3 the current image is captured, and the captured images are classified according to different specific expressions of the specific characters, and the classified images are saved in a time axis form.
  • step S2 When the detection result of step S2 is that the trigger condition is satisfied, that is, a specific person appears in the current image and the specific character presents a specific performance, the current image is captured.
  • the detection knot of step S2 If the trigger condition is not satisfied, that is, when the current image does not appear a specific character or a specific person appears but the specific character does not present a specific performance, it continues to detect whether the next image satisfies the trigger condition of the captured image. For example, once a child laughs or cries, the current image is captured.
  • the step of classifying the captured images according to the different specific expressions of the specific characters is specifically: capturing images of different emotions of a specific character, and classifying the captured images according to the corresponding emotions.
  • the step of saving the classified images in the time axis form is specifically: storing the images of the same classification in the same large file, and storing the images of the same classification in the same cycle time in the form of a time axis, the same cycle time Including hours, days, weeks, months and years.
  • the images of the crawled children are classified as one type stored in a large file (such as a laughter file), and in the laughter folder, the images of the children laughing are stored in chronological order.
  • the images of the crawling children when they are crying are grouped into one large file (such as a crying file), and the crying images are saved in chronological order, see Figure 4.
  • step S4 access and transmission rights are set for the image saved in the time axis form after the classification.
  • the step of setting the access and sending rights is specifically: setting different access rights and sending rights for different classified images. Specifically, different access rights and/or transmission rights are set for the saved image, and different classified images are accessed and/or transmitted according to the rights.
  • FIG. 2 is a schematic structural view of a smart home video monitoring system of the present invention.
  • the smart home video surveillance system of the present invention includes a capture device 1, a storage device 2, and a mobile terminal or client 3.
  • the capture device 1 captures an image according to a trigger condition set in advance, and transmits the captured image to the storage device 2.
  • the trigger condition is that a specific person appears in the image and the specific character presents a specific performance.
  • the specific character is a preset character object, such as a child, etc.
  • the specific expression is a mood change, such as laughter, crying, and the like.
  • the capture device 1 detects in real time whether the current image satisfies the trigger condition of the preset captured image.
  • the trigger condition is met, the current image is captured and the captured current image is sent to the storage device 2 for storage.
  • the trigger condition is not satisfied, it continues to detect whether the next image satisfies the trigger condition of the captured image until the trigger condition of the captured image is satisfied.
  • the storage device 2 is connected to the capture device 1 for receiving an image transmitted by the capture device 1 and classifying the captured images according to different specific representations of the specific characters, and storing the classified images in a time axis format.
  • the image that is captured according to different specific performances of the specific character is specifically configured to capture images of different characters in different emotions, and classify the captured images according to the corresponding emotions.
  • the step of saving the classified images in the time axis form is specifically: storing the images of the same classification in the same large file, and storing the images of the same classification in the same cycle time in the form of a time axis, the same cycle time Including hours, days, weeks, months, and years. For example, taking the above example, the captured images of the children are saved in a large folder, and the laughter images are stored in chronological order for the purpose of user access and viewing.
  • the storage device includes, but is not limited to, a local storage device and/or a cloud storage device.
  • the captured image may be automatically uploaded to a local storage device or a cloud storage device.
  • the local storage device refers to locally sorting images captured by the camera into different folders according to different emotions, and storing the classified images in chronological order.
  • the local device is also used to receive access from the mobile terminal.
  • the cloud storage device is configured to classify images captured by the camera into different folders according to different emotions in the cloud, and store the classified images in chronological order.
  • the cloud storage device is further configured to receive access by the mobile terminal.
  • the mobile terminal or client 3 is connected to the storage device 2, sets the trigger condition of the captured image, sets the access and transmission authority of the image saved in the storage device 2, and accesses and receives the image saved in the storage device 2. .
  • the user presets a trigger condition for capturing an image through the mobile terminal or the client 3.
  • the mobile terminal or client is further configured to set access and transmission rights of images saved in the storage device 2. Specifically, different access and transmission permission levels are set for images of different classifications. Specifically, different access rights and transmission rights are set for the image folder when the child is laughing.
  • the present invention performs image capture on a specific person and scene that meets the trigger condition, and stores the image in a corresponding folder in a time axis according to the trigger condition.
  • the terminal is provided with different rights, so that different mobile terminals can receive or access images of different scenes in the corresponding folder in real time, so that the present invention is closer to the family life scene in addition to the commonly used security functions.
  • Fig. 3 is a system configuration diagram of a specific example of the present invention.
  • the smart home video surveillance system includes a plurality of mobile terminals, a camera, a local storage device, and a cloud storage device.
  • the mobile terminal, the camera, the local storage device, and the cloud storage device are connected through a network (wired or wireless network).
  • the mobile terminal includes, but is not limited to, a terminal such as a smartphone or a computer.
  • the father A or the mother B sets the trigger condition for the captured image in advance through the mobile terminal or the client (or through the client APP or through the client webpage).
  • the trigger condition for setting the captured image is: grab the image when the child laughs or grab the image when the child is crying.
  • the specific character is the child C, and the specific expression is laughter or crying.
  • the current picture presented in the camera is captured. For example, when a child laughs while watching TV or playing with a toy or making a pet, the camera captures the image of the child C laughing. Similarly, when the child is crying, the camera captures the image of the child C crying.
  • the specific expression of the specific character can be collected and recognized by the sound collection sensor or the pickup function of the camera, and the laughter or crying of the child C and the like can be recognized.
  • the face recognition and expression recognition technology can be used to identify the laughter or crying emotion of the child C.
  • the voice recognition, face recognition and expression recognition can be implemented by using the existing solutions in the prior art, and will not be described again.
  • the camera captures and recognizes images of children C watching TV laughs through face recognition, voice recognition and expression recognition technology.
  • January 4th the same collection of images of children C playing toy laughter.
  • January 8th I collected images of children C when they were laughing.
  • the captured images of all the children C are collected into a group of laughter, and the classified laughter images are saved according to the time axis and index information as shown in FIG. 4.
  • the collected images of all the crying children C are classified into a type of crying folder, and the classified crying images are saved according to the time axis and index information shown in FIG.
  • FIG. 4 is a schematic diagram of saving a captured image according to a time axis in a specific example of the present invention.
  • the laughter image or crying is saved according to the time axis
  • the unit T of the time axis may be hours, natural days, weeks, months, and years, and the time units are flexibly set according to the user's needs.
  • the length of the time axis in this embodiment is one month, and the images of the children C laughing on different dates in January are saved in chronological order.
  • different access rights and/or transmission rights may be set to different classified images (such as laughter folders or crying folders) in the storage device by the mobile terminal and/or the client.
  • the access of the father A to set the image in the laughter folder is completely public, that is, all mobile terminals or clients can access the folder including the child C laughter image, which makes the mother B, grandparent D's mobile terminal or client
  • the laughter folder can be accessed or an image sent from the laughter folder can be received.
  • Father A sets the access or sending permission of the crying folder to be limited, that is, only the mobile terminal or client of the parent A and the mother B can access or send images from the folder, and the mobile terminal for the grandparents D Or the client hides.
  • the mobile terminal or client of the father A setting grandparents D can receive the image of the child C laughing in real time, while the image of the crying of the child C is not sent to the grandparents D, the purpose is to let the elderly feel the growth of the child. Happy, don't worry about the troubles of your child's growth.
  • FIG. 5 is an interface display diagram when a chattering folder is accessed in a specific example of the present invention.
  • the interface thereof is as shown in FIG. 5, and the image of the classified image is saved in a time axis form, so that the access of the mobile terminal or the client to the image is more intuitive.
  • the smart home video monitoring system of the present invention is described in detail.
  • the trigger condition of the captured image By setting the trigger condition of the captured image in advance, it is detected in real time whether the current image satisfies the preset trigger condition, and if so, the current image is captured and specified according to the specific
  • the performance classifies the captured images and saves the classified images in a timeline format.
  • different access rights and receiving rights are set for different mobile terminals or clients, so that different mobile terminals can receive or access images in different emotions in real time, and the present invention is more close to providing common security functions. Family life scene.
  • the smart home video monitoring method and system provided by the present invention realize automatic classification and storage management of images, and provide users with interesting value of video surveillance in addition to security value, and condense affection and better. Fit the family scene.

Abstract

本发明公开了一种智能家居视频监控方法和系统，所述方法及系统预先设置并保存抓取图像的触发条件，其中，所述触发条件为图像中出现特定人物且特定人物呈现特定表现；实时检测当前图像是否满足所述触发条件；若是，则对当前图像进行抓取，并按照所述特定人物的不同特定表现对抓取的图像分类，将分类的图像以时间轴形式保存；对所述分类后按照时间轴形式保存的图像设置访问及发送权限。本发明对满足触发条件的图像抓取，将抓取的图像按照不同情绪进行分类，将分类的图像按照时间顺序进行存储，并对所述存储后的图像设置不同的访问及发送权限，使得移动终端或客户端可以实时接收或者访问特定人物的不同情绪的图像。

Description

一种智能家居视频监控方法和系统 技术领域
本发明属于智能家居领域，特别涉及一种智能家居视频监控方法和系统。
背景技术
现有的以摄像机、传感器和移动终端组合的智能家居系统，只能单纯的根据事件触发然后抓取事件图像，图像包括静态图片和动态的视频，供用户查阅了解家中安全情况，其功能单一。
家庭作为亲人居住和生活的场所，用户希望智能家居系统除了把控家庭安全之外，还可以对日常视频图像进行差异化的分类和管理。例如，根据摄像机日常抓取的孩子的影像自动生成成长图像文件，将孩子在家中有趣的图像自动分享给亲密的亲友等，除了给用户带来家庭安防之外的价值，让智能家居系统更贴近家庭生活的场景。然而，现有的智能家居系统不具备上述功能。
发明内容
本发明的目的是提供一种智能家居视频监控方法和系统，通过对符合触发条件的触发对象和触发场景进行图像抓取，按照触发条件将图像以时间轴形式存储在对应文件夹，对移动终端设置有不同权限，使得不同的移动终端可以实时接收或者访问对应文件夹中的不同场景的图像，使得本发明除了提供常用的安防功能之外，更加贴近家庭生活场景。
为实现上述目的，本发明的一个方面提供了一种智能家居视频监控方法，包括：预先设置并保存抓取图像的触发条件，其中，所述触发条件为图像中 出现特定人物且特定人物呈现特定表现；实时检测当前图像是否满足所述触发条件；若是，则对当前图像进行抓取，并按照所述特定人物的不同特定表现对抓取的图像分类，将分类的图像以时间轴形式保存；对所述分类后按照所述时间轴形式保存的图像设置访问及发送权限。
其中，所述特定人物为预先设置的人物对象，所述特定表现为情绪变化。
其中，所述按照所述特定人物的不同特定表现对抓取的图像分类的步骤具体为，对所述特定人物不同情绪时的图像抓取，并按照对应情绪将抓取的图像分类。
其中，所述将分类的图像以时间轴形式保存的步骤具体为，将同一分类的图像保存在同一大文件中，并将同一周期时间内的同一分类的图像以所述时间轴形式保存，所述同一周期时间包括小时、天、星期、月以及年。
可选的，所述设置访问及发送权限的步骤具体为：对不同分类的图像设置不同的访问及发送权限。
根据本发明的另一方面，提供了一种智能家居视频监控系统，包括：抓拍设备，根据预先设置的触发条件抓取图像，将抓取的图像发送至存储设备，其中，所述触发条件为图像中出现特定人物且特定人物呈现特定表现；存储设备，接收所述抓拍设备发送的图像，按照所述特定人物的不同特定表现对抓取的图像分类，将分类的图像以时间轴形式保存；移动终端或客户端，设置所述抓取图像的触发条件、设置所述存储设备中保存的图像的访问及发送权限，访问及接收所述存储设备中保存的图像。
其中，所述特定人物为预先设置的人物对象，所述特定表现为情绪变化。
其中，所述存储设备，将同一分类的图像保存在同一大文件中，并将同 一周期时间内的同一分类的图像以时间轴形式保存，所述同一周期时间包括小时、天、星期、月以及年。
其中，所述存储设备包括本地存储设备和/或云存储设备。
其中，所述移动终端或客户端，用于设置所述存储设备中保存的图像的访问及发送权限，具体为对不同分类的图像设置不同的访问及发送权限等级。
如上所述，本发明通过对满足触发条件的图像抓取，将抓取的图像按照不同情绪进行分类，将分类后的图像按照时间顺序进行存储，对存储后的图像设置不同的访问权限和发送权限，使得移动终端或客户端可以实时接收或者访问特定人物的不同情绪的图像，使得本发明除了提供常用的安防功能之外，更加贴近家庭生活。
附图说明
图1是本发明的智能家庭视频监控方法的流程示意图；
图2是本发明的智能家居视频监控系统的结构示意图；
图3是本发明的一具体示例的系统结构图；
图4是本发明中一具体示例中的按照时间轴保存抓取图像的示意图；
图5是根据本发明的一具体示例的访问欢笑文件夹时的界面显示图。
具体实施方式
为使本发明的目的、技术方案和优点更加清楚明了，下面结合具体实施方式并参照附图，对本发明进一步详细说明。应该理解，这些描述只是示例性的，而并非要限制本发明的范围。此外，在以下说明中，省略了对公知结构和技术的描述，以避免不必要地混淆本发明的概念。
图1是本发明的智能家庭视频监控方法的流程示意图。
如图1所示，用户预先并保存设置进行图像抓取的触发条件，所述触发条件为图像中出现特定人物且特定人物呈现特定表现。本发明通过实时检测抓拍设备采集的当前图像是否满足预设的抓取图像的触发条件。如果满足，则抓取当前图像，进一步将抓取的图像按照特定人物的不同特定表现进行分类，并将分类后的图像按照时间顺序进行保存。否则(即如果不满足预设的抓取图像的触发条件)，则继续检测抓拍设备采集的下一图像是否满足抓取图像的触发条件。这里，抓取的图像包括静态图片和动态视频。
本发明的智能家居视频监控方法包括：
步骤S1，预先设置并保存抓取图像的触发条件。
本步骤涉及预先设置并保存抓取图像的触发条件。本发明中，触发条件为图像中出现特定人物且特定人物呈现特定表现。所述特定人物为预先设置的人物对象，所述特定表现为情绪变化。例如，设置抓取图像的触发条件为：当小朋友出现欢笑或哭闹时，对图像进行抓取。
本发明中，所述触发条件不限于本发明描述的触发条件，用户可自定义其他触发条件，并根据定义的其他触发条件对图像进行抓取。
步骤S2，实时检测当前图像是否满足所述触发条件。
本步骤中，通过实时检测当前图像是否满足所述触发条件，对图像进行抓取。若是，则执行步骤S3，若否，则返回执行步骤S2。
步骤S3，对当前图像进行抓取，并按照所述特定人物的不同特定表现对抓取的图像分类，将分类的图像以时间轴形式保存。
当步骤S2的检测结果为满足触发条件时，即当前图像中出现特定人物且特定人物呈现特定表现时，则对当前图像进行抓取。当步骤S2的检测结 果为不满足触发条件时，即当前图像没有出现特定人物或出现特定人物但特定人物未呈现特定表现时，继续检测下一图像是否满足抓取图像的触发条件。例如，一旦小朋友出现欢笑或哭闹时，就对当前图像进行抓取。
所述按照所述特定人物的不同特定表现对抓取的图像分类的步骤具体为，对特定人物的不同情绪时的图像进行抓取，并按照对应的情绪将抓取的图像进行分类。
所述将分类的图像以时间轴形式保存的步骤具体为，将同一分类的图像保存在同一大文件中，并将同一周期时间内的同一分类的图像以时间轴形式保存，所述同一周期时间包括小时、天、星期、月以及年。例如，将抓取的小朋友欢笑时的图像归为一类保存在一个大文件中(如欢笑文件)，在欢笑文件夹里，小朋友欢笑的图像按照时间顺序保存。同样的，将抓取的小朋友哭闹时的图像归为一类保存在一个大文件中(如哭闹文件)，按照时间顺序对哭闹图像进行保存，参见图4。
步骤S4，对所述分类后按照时间轴形式保存的图像设置访问及发送权限。
所述设置访问及发送权限的步骤具体为，对不同分类的图像设置不同的访问权限和发送权限。具体的，对保存后的图像设置不同的访问权限和/或发送权限，根据所述权限对不同分类的图像进行访问和/或发送。
图2是本发明的智能家居视频监控系统的结构示意图。
如图2所示，本发明的智能家居视频监控系统包括抓拍设备1、存储设备2和移动终端或客户端3。
抓拍设备1根据预先设置的触发条件抓取图像，将抓取的图像发送至存储设备2。
本发明中，所述触发条件为图像中出现特定人物且特定人物呈现特定表现。所述特定人物为预先设置的人物对象，如小朋友等等，所述特定表现为情绪变化，如欢笑、哭闹等等。
具体来说，抓拍设备1实时检测当前图像是否满足预设的抓取图像的触发条件，当满足触发条件时，抓取当前图像并将抓取到的当前图像发送给存储设备2进行保存。当不满足触发条件时，则继续检测下一图像是否满足抓取图像的触发条件，直到满足抓取图像的触发条件。
存储设备2与所述抓拍设备1连接，用于接收所述抓拍设备1发送的图像，并按照所述特定人物的不同特定表现对抓取的图像分类，将分类的图像以时间轴形式保存。其中，所述按照所述特定人物的不同特定表现对抓取的图像分类具体为，对特定人物不同情绪时的图像抓取，并按照对应情绪将抓取的图像分类。所述将分类的图像以时间轴形式保存的步骤具体为，将同一分类的图像保存在同一大文件中，并将同一周期时间内的同一分类的图像以时间轴形式保存，所述同一周期时间包括小时、天、星期、月、年。例如，承接上述例子，将抓取的小朋友欢笑时的图像保存在一大文件夹中，并将欢笑图像按照时间顺序进行存储，其目的是便于用户访问和查看。
本发明中，所述存储设备包括但不限于本地存储设备和/或云存储设备。在一实施方式中，可以将抓取的图像自动上传到本地存储设备或云存储设备。
需要说明的是，本地存储设备，是指在本地将摄像机抓取的图像按照不同情绪分类到不同文件夹中，并将分类后的图像按照时间顺序进行存储，所 述本地设备还用于接收移动终端的访问。云存储设备，是指在云端将摄像机抓取的图像按照不同情绪分类到不同文件夹中，并将分类后的图像按照时间顺序进行存储，所述云存储设备还用于接收移动终端的访问。
移动终端或客户端3与所述存储设备2连接，设置所述抓取图像的触发条件、设置所述存储设备2中保存的图像的访问及发送权限，访问及接收存储设备2中保存的图像。
具体来说，用户通过移动终端或客户端3预先设置抓取图像的触发条件。所述移动终端或客户端还用于设置所述存储设备2中保存的图像的访问及发送权限。具体为对不同分类的图像设置不同的访问及发送权限等级。具体来说，对小朋友在欢笑时的图像文件夹，设置不同的访问权限和发送权限。
如上所述，详细介绍了本发明的智能家居视频监控系统，本发明通过对符合触发条件的特定人员和场景进行图像抓取，按照触发条件将图像以时间轴形式存储在对应文件夹，对移动终端设置有不同权限，使得不同的移动终端可以实时接收或者访问对应文件夹中的不同场景的图像，使得本发明除了提供常用的安防功能之外，更加贴近家庭生活场景。
下面是本发明的一具体示例。
图3是本发明的一具体示例的系统结构图。
所述智能家居视频监控系统包括多个移动终端、摄像机、本地存储设备和云存储设备。所述移动终端、摄像机、本地存储设备和云存储设备通过网络(有线或无线网络)连接。所述移动终端包括但不限于智能手机、电脑等终端。
这里，以家庭生活场景为例对本发明的技术方案进行说明。假设家庭成 员包括父亲A，母亲B，小朋友C，异地的爷爷或奶奶D。
父亲A或母亲B通过移动终端或客户端(或通过客户端APP或通过客户端网页进行设置)预先设置抓取图像的触发条件。设置抓取图像的触发条件为：当小朋友欢笑时抓取图像或当小朋友哭闹时抓取图像。该实例中，特定人物为小朋友C，特定表现为欢笑或哭闹。
即当摄像机的画面中出现小朋友C且小朋友C出现欢笑或哭闹时，抓取摄像机中呈现的当前画面。例如，当小朋友在看电视或者玩玩具或者逗宠物时出现欢笑时，摄像机抓取小朋友C欢笑时的图像。同样的，当小朋友哭闹时，摄像机抓取小朋友C哭闹时的图像。
本发明中，特定人物的所述特定表现可以通过声音采集传感器或摄像机自带的拾音功能采集并识别小朋友C的欢笑声或哭闹声等等。可以通过人脸识别、表情识别技术对小朋友C的欢笑或哭闹情绪进行识别。声音识别、人脸识别和表情识别采用现有技术中已有的方案即可实现，不再赘述。
下面对本发明的实现过程进行详述。
举例来说，1月1日，摄像机通过人脸识别、声音识别和表情识别技术，采集并识别到多次小朋友C看电视欢笑时的图像。1月4日，同样的采集到多次小朋友C在玩玩具欢笑时的图像。1月8日，采集到多次小朋友C在逗宠物欢笑时的图像。将采集到的小朋友C所有欢笑时的图像，归为一类存入欢笑文件夹，将分类后的欢笑图像按照如图4所示的时间轴和索引信息进行保存。同样的，将采集到的小朋友C所有哭闹时的图像，归为一类存入哭闹文件夹，将分类后的哭闹图像按照图3所示的时间轴和索引信息进行保存。
图4是本发明中一具体示例中的按照时间轴保存抓取图像的示意图。
参见图4，在上述分类的基础上，按照时间轴对欢笑图像或哭闹进行保存，其时间轴的单位T可以是小时、自然天、星期、月份以及年份，时间单位根据用户的需求灵活设置。如图4所示，本实施例中的时间轴的长度为一个月，即将1月份内不同日期的小朋友C欢笑的图像按照时间顺序进行保存。
在本发明中，可以通过移动终端和/或客户端对存储设备中的不同分类的图像(如欢笑文件夹或哭闹文件夹)设置不同的访问权限和/或发送权限。
例如，父亲A设置欢笑文件夹内的图像的访问为完全公开，即所有移动终端或客户端均可访问包括小朋友C欢笑图像的文件夹，这使得母亲B、爷爷奶奶D的移动终端或客户端均可对欢笑文件夹进行访问或者接收从所述欢笑文件夹中发出的图像。父亲A设置哭闹文件夹的访问或发送权限为受限，即只有父亲A和母亲B的移动终端或客户端可以访问或从所述文件夹中发出的图像，而对爷爷奶奶D的移动终端或客户端进行隐藏。
例如，父亲A设置爷爷奶奶D的移动终端或客户端可以实时接收小朋友C欢笑时的图像，而对小朋友C哭闹时的图像，则不对爷爷奶奶D进行发送，目的是让老人感受孩子成长的欢乐，而不必担心孩子成长的烦恼。为了让母亲更好的了解孩子，可以设置母亲B的移动终端或客户端实时接收小朋友C哭闹时的图像和/或访问哭闹文件夹的权限，让母亲更了解孩子的需求，更好的关注孩子的成长。
图5是根据本发明的一具体示例中的访问欢笑文件夹时的界面显示图。
当移动终端或客户端访问小朋友C的欢笑文件夹时，其界面如图5所示，通过将分类后的图像以时间轴形式进行保存，使得移动终端或客户端对图像的访问更加直观。
如上所述，详细介绍了本发明的智能家居视频监控系统，通过预先设置抓取图像的触发条件，实时检测当前图像是否满足预设的触发条件，若满足，则抓取当前图像，并按照特定表现对抓取的图像进行分类，将分类后的图像以时间轴形式进行保存。另外，对不同的移动终端或客户端设置不同的访问权限和接收权限，使得不同的移动终端可以实时接收或者访问不同情绪下的图像，还使得本发明除了提供常用的安防功能之外，更加贴近家庭生活场景。
如上所述，通过本发明提供的智能家居视频监控方法和系统，实现了对图像的自动归类存储管理，为用户提供了视频监控在安全防范价值之外的趣味性价值，凝聚亲情，更好的贴合家庭场景。
应当理解的是，本发明的上述具体实施方式仅仅用于示例性说明或解释本发明的原理，而不构成对本发明的限制。因此，在不偏离本发明的精神和范围的情况下所做的任何修改、等同替换、改进等，均应包含在本发明的保护范围之内。此外，本发明所附权利要求旨在涵盖落入所附权利要求范围和边界、或者这种范围和边界的等同形式内的全部变化和修改例。

Claims (10)

  1. 一种智能家居视频监控方法，所述方法包括：
    预先设置并保存抓取图像的触发条件，其中，所述触发条件为图像中出现特定人物且特定人物呈现特定表现；
    实时检测当前图像是否满足所述触发条件；
    若是，则对所述当前图像进行抓取，并按照所述特定人物的不同特定表现对抓取的图像分类，将分类的图像以时间轴形式保存；
    对分类后按照所述时间轴形式保存的图像设置访问及发送权限。
  2. 如权利要求1所述的方法，所述特定人物为预先设置的人物对象，所述特定表现为情绪变化。
  3. 如权利要求1所述的方法，所述按照所述特定人物的不同特定表现对抓取的图像分类的步骤具体为，对所述特定人物不同情绪时的图像抓取，并按照对应情绪将抓取的图像分类。
  4. 如权利要求1所述的方法，所述将分类的图像以时间轴形式保存的步骤具体为，
    将同一分类的图像保存在同一大文件中，并将同一周期时间内的同一分类的图像以所述时间轴形式保存，所述同一周期时间包括小时、天、星期、月以及年。
  5. 如权利要求1所述的方法，所述设置访问及发送权限的步骤具体为：对不同分类的图像设置不同的访问及发送权限。
  6. 一种智能家居视频监控系统，包括：
    抓拍设备(1)，根据预先设置的触发条件抓取图像，将抓取的图像发 送至存储设备(2)，其中，所述触发条件为图像中出现特定人物且特定人物呈现特定表现；
    存储设备(2)，接收所述抓拍设备(1)发送的图像，按照所述特定人物的不同特定表现对抓取的图像分类，将分类的图像以时间轴形式保存；
    移动终端或客户端(3)，设置所述抓取图像的触发条件、设置所述存储设备中保存的图像的访问及发送权限，访问及接收所述存储设备(2)中保存的图像。
  7. 如权利要求6所述的系统，其中，所述特定人物为预先设置的人物对象，所述特定表现为情绪变化。
  8. 如权利要求6所述的系统，其特征在于，所述存储设备(2)，将同一分类的图像保存在同一大文件中，并将同一周期时间内的同一分类的图像以时间轴形式保存，所述同一周期时间包括小时、天、星期、月以及年。
  9. 如权利要求7或8所述的系统，其特征在于，所述存储设备(2)包括本地存储设备和/或云存储设备。
  10. 如权利要求6所述的系统，其特征在于，所述移动终端或客户端(3)，用于设置所述存储设备(2)中保存的图像的访问及发送权限，具体为对不同分类的图像设置不同的访问及发送权限等级。
PCT/CN2016/083939 2015-06-16 2016-05-30 一种智能家居视频监控方法和系统 WO2016202166A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US15/736,698 US20180167590A1 (en) 2015-06-16 2016-05-30 Video monitoring method and system based on smart home
EP16810907.2A EP3313068A4 (en) 2015-06-16 2016-05-30 INTELLIGENT DOMESTIC VIDEO SURVEILLANCE METHOD AND DEVICE

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510332615.9 2015-06-16
CN201510332615.9A CN106331586A (zh) 2015-06-16 2015-06-16 一种智能家居视频监控方法和系统

Publications (1)

Publication Number Publication Date
WO2016202166A1 true WO2016202166A1 (zh) 2016-12-22

Family

ID=57544894

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/083939 WO2016202166A1 (zh) 2015-06-16 2016-05-30 一种智能家居视频监控方法和系统

Country Status (4)

Country Link
US (1) US20180167590A1 (zh)
EP (1) EP3313068A4 (zh)
CN (1) CN106331586A (zh)
WO (1) WO2016202166A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2019185188A (ja) * 2018-04-03 2019-10-24 パナソニック インテレクチュアル プロパティ コーポレーション オブアメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ 情報処理方法、情報処理装置及び情報処理システム

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109684903A (zh) * 2017-10-19 2019-04-26 中兴通讯股份有限公司 一种家庭网关设备、图像处理方法及系统
US10547464B2 (en) * 2018-03-23 2020-01-28 Toyota Research Institute, Inc. Autonomous agent for meeting preparation assistance
CN109525791A (zh) * 2018-09-21 2019-03-26 华为技术有限公司 信息记录方法及终端
CN109241949A (zh) * 2018-10-19 2019-01-18 珠海格力电器股份有限公司 图像处理方法及空调设备、终端、存储介质、电子装置
CN112211496B (zh) * 2019-07-09 2022-11-01 杭州萤石软件有限公司 一种基于智能门锁的监控方法、系统及智能门锁
JP7437684B2 (ja) 2020-03-27 2024-02-26 パナソニックＩｐマネジメント株式会社 ライフログ提供システムおよびライフログ提供方法
CN112911154B (zh) * 2021-02-02 2022-10-18 Oppo广东移动通信有限公司 一种抓拍方法、服务器及计算机存储介质
CN117671601A (zh) * 2024-01-31 2024-03-08 四川广飞视信息技术有限公司 目标检测方法、装置、服务器及存储介质

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070069106A1 (en) * 2005-06-22 2007-03-29 Tripath Imaging, Inc. Apparatus and Method for Rapid Microscope Image Focusing
CN101621673A (zh) * 2009-07-30 2010-01-06 杭州联图科技有限公司 智能网络安防监控摄像机
CN103873914A (zh) * 2014-02-27 2014-06-18 深圳市九洲电器有限公司 一种观众生活图像拍摄方法、装置及多媒体设备

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3676969B2 (ja) * 2000-09-13 2005-07-27 株式会社エイ・ジー・アイ 感情検出方法及び感情検出装置ならびに記録媒体
US6931147B2 (en) * 2001-12-11 2005-08-16 Koninklijke Philips Electronics N.V. Mood based virtual photo album
JP4431547B2 (ja) * 2006-04-14 2010-03-17 富士フイルム株式会社 画像表示制御装置ならびにそれらの制御方法およびそれらの制御プログラム
US7817914B2 (en) * 2007-05-30 2010-10-19 Eastman Kodak Company Camera configurable for autonomous operation
GB2475706C (en) * 2009-11-26 2013-01-09 Jabbakam Ltd Surveillance system and method
KR102091848B1 (ko) * 2013-01-04 2020-03-20 삼성전자주식회사 전자 장치에서 사용자의 감정 정보를 제공하기 위한 장치 및 방법
US20150178915A1 (en) * 2013-12-19 2015-06-25 Microsoft Corporation Tagging Images With Emotional State Information
CN103945188A (zh) * 2014-04-21 2014-07-23 广州市晶华光学电子有限公司 智能亲子远程看护系统
KR102155521B1 (ko) * 2014-05-23 2020-09-14 삼성전자 주식회사 카메라를 구비하는 전자 장치의 부가 정보 획득 방법 및 장치
CN104284252A (zh) * 2014-09-10 2015-01-14 康佳集团股份有限公司 一种自动生成电子相册的方法

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070069106A1 (en) * 2005-06-22 2007-03-29 Tripath Imaging, Inc. Apparatus and Method for Rapid Microscope Image Focusing
CN101621673A (zh) * 2009-07-30 2010-01-06 杭州联图科技有限公司 智能网络安防监控摄像机
CN103873914A (zh) * 2014-02-27 2014-06-18 深圳市九洲电器有限公司 一种观众生活图像拍摄方法、装置及多媒体设备

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3313068A4 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2019185188A (ja) * 2018-04-03 2019-10-24 パナソニック インテレクチュアル プロパティ コーポレーション オブアメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ 情報処理方法、情報処理装置及び情報処理システム
JP7034808B2 (ja) 2018-04-03 2022-03-14 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ 情報処理方法、情報処理装置及び情報処理システム

Also Published As

Publication number Publication date
US20180167590A1 (en) 2018-06-14
CN106331586A (zh) 2017-01-11
EP3313068A1 (en) 2018-04-25
EP3313068A4 (en) 2019-02-20

Similar Documents

Publication Publication Date Title
WO2016202166A1 (zh) 一种智能家居视频监控方法和系统
US10299017B2 (en) Video searching for filtered and tagged motion
WO2016107006A1 (zh) 一种智能摄像头监控的方法及装置
US9805567B2 (en) Temporal video streaming and summaries
US9582709B2 (en) Privacy for camera with people recognition
US9588640B1 (en) User interface for video summaries
WO2015196584A1 (zh) 一种智能录制系统
US20110299835A1 (en) System and Method for Management of Surveillance Devices and Surveillance Footage
US20120117271A1 (en) Synchronization of Data in a Distributed Computing Environment
US20170076156A1 (en) Automatically determining camera location and determining type of scene
JP5882805B2 (ja) 情報処理装置、その処理方法及びプログラム
US11093545B2 (en) Systems and methods for an automated cloud-based video surveillance system
US10750076B2 (en) Network device, image processing method, and computer readable medium
US11011044B2 (en) Information processing system, information processing apparatus, and information processing method
CN110933478A (zh) 一种安防系统
CN108351965A (zh) 视频摘要的用户界面
JP6941950B2 (ja) 画像提供システム、画像提供方法、および画像提供プログラム
US20190082002A1 (en) Media file sharing method, media file sharing device, and terminal
CN105208262A (zh) 网络摄影数据管理系统与方法
US9270877B2 (en) Method and system for generation of images based on biorhythms
JP5989505B2 (ja) メッセージ管理装置、メッセージ提示装置、メッセージ提示システム、メッセージ管理装置およびメッセージ提示装置の制御方法、制御プログラム、および記録媒体
CN103699893A (zh) 一种人脸特征信息采集装置
TWI547173B (zh) 監視設備及監視系統
TWI566604B (zh) 影像擷取裝置、影像擷取系統及儲存媒體
US10861495B1 (en) Methods and systems for capturing and transmitting media

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16810907

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 15736698

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2016810907

Country of ref document: EP