TWI697914B - Monitoring device and method thereof - Google Patents

Monitoring device and method thereof Download PDF

Info

Publication number
TWI697914B
TWI697914B TW107142619A TW107142619A TWI697914B TW I697914 B TWI697914 B TW I697914B TW 107142619 A TW107142619 A TW 107142619A TW 107142619 A TW107142619 A TW 107142619A TW I697914 B TWI697914 B TW I697914B
Authority
TW
Taiwan
Prior art keywords
walking path
subject
walking
identifier
path
Prior art date
Application number
TW107142619A
Other languages
Chinese (zh)
Other versions
TW202020893A (en
Inventor
李建穎
楊宗翰
何亮融
林建錡
王思捷
Original Assignee
宏碁股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 宏碁股份有限公司 filed Critical 宏碁股份有限公司
Priority to TW107142619A priority Critical patent/TWI697914B/en
Publication of TW202020893A publication Critical patent/TW202020893A/en
Application granted granted Critical
Publication of TWI697914B publication Critical patent/TWI697914B/en

Links

Images

Landscapes

  • Alarm Systems (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

A monitoring system includes a camera, an identity recognition device, and a processing unit. The camera captures an image within a monitoring area. The identity identification device identifies an ID of a first tester from the image. The processing unit records a first walking path of the first tester in accordance with the image. When the processing unit detects that the first tester is masked or disappears from the image, and then detects a second tester that appears in the image, the processing unit start record a second walking path of the second tester. When the identity recognition device identifies that the second tester is the same as the first tester, the processing unit start records a third walking path. If the first, second and third walking path meet a specific criteria, the processing unit connects the first, second and third walking path.

Description

監測系統及其方法Monitoring system and method

本發明係有關於監測裝置，特別是有關於一步行路徑監測系統及其方法。The invention relates to a monitoring device, in particular to a walking path monitoring system and method.

依據研究報告，早期失智症的患者若能提早介入治療，可以延緩病程大約五年。如果置之不理，或是以消極態度應對，患者的病情極可能在未來一、二年內快速惡化。目前，極早期失智篩檢量表(AD8)是一種簡易、低成本、方便快速的篩檢方式。但若有一種方法能透過自動判斷的機制來輔助甚至取代AD8篩檢量表，例如受試者平常走路的行為模式，或許能夠進一步提升準確率，找出失智的高風險族群，並且提早治療，進一步控制患者的病情。According to research reports, if patients with early dementia can be treated with early intervention, the course of the disease can be delayed by about five years. If you ignore it or respond with a negative attitude, the patient's condition is likely to deteriorate rapidly in the next one or two years. At present, the very early dementia screening scale (AD8) is a simple, low-cost, convenient and fast screening method. However, if there is a method that can assist or replace the AD8 screening scale through an automatic judgment mechanism, such as the subjects’ usual walking behavior patterns, it may be able to further improve the accuracy, identify high-risk groups of dementia, and treat them earlier , To further control the patient's condition.

現有的個人行跡偵測裝置(例如智慧手錶、智慧手環)，雖然可以利用GPS定位而測得個人的移動路徑，但因為GPS訊號無法深入至室內，故其無法應用於室內的追蹤。Existing personal track detection devices (such as smart watches, smart bracelets) can use GPS positioning to measure a person's moving path, but because GPS signals cannot penetrate indoors, they cannot be used for indoor tracking.

依據本發明一實施例之監測系統，包括一攝影機，用以擷取一監測區域內的影像；一身分辨識裝置，用以從該影像中辨識一第一待測者的一一改這裏身分，並且依據該身分提供一第一識別符；以及一處理單元；該處理單元依據該影像，紀錄該第一待測者的一第一行走路徑，並且將該第一行走路徑與該第一識別符相關聯；當該處理單元偵測到該第一待測者在該影像中遭到遮蔽或消失時，中斷該第一行走路徑的紀錄；當該處理單元偵測到一第二待測者出現在該影像中時，開始紀錄該第二待測者的一第二行走路徑，並且該身分辨識裝置提供一第二識別符給出現的該第二待測者，該處理單元進一步將該第二行走路徑與該第二識別符相關聯；當該身分辨識裝置辨識到該第二待測者為該第一待測者時，該處理單元中斷該第二行走路徑的紀錄，開始紀錄該第一待測者的一第三行走路徑，並且將該第三行走路徑與該第一識別符相關聯；當該第一、第二及第三行走路徑符合一特定條件，該處理單元將該第二行走路徑與該第一識別符相關聯，且依時序將該第一、第二與第三行走路徑相銜接，而得到該第一待測者的一完整行走路徑。A monitoring system according to an embodiment of the present invention includes a camera for capturing an image in a monitoring area; a body recognition device for recognizing the identity of a first test subject from the image, And provide a first identifier according to the identity; and a processing unit; the processing unit records a first walking path of the first test subject according to the image, and the first walking path and the first identifier Correlation; when the processing unit detects that the first subject is occluded or disappears in the image, the recording of the first walking path is interrupted; when the processing unit detects a second subject Now in the image, start to record a second walking path of the second test subject, and the body identification device provides a second identifier to the second test subject appearing, the processing unit further performs the second test The walking path is associated with the second identifier; when the body identification device recognizes that the second subject is the first subject, the processing unit interrupts the recording of the second walking path and starts recording the first A third walking path of the test subject, and associate the third walking path with the first identifier; when the first, second, and third walking paths meet a specific condition, the processing unit applies the second The walking path is associated with the first identifier, and the first, second, and third walking paths are connected in time sequence to obtain a complete walking path of the first test subject.

如上所述之監測系統，其中，該第一、第二及第三行走路徑所符合的該特定條件，包括該第一待測者在該第一行走路徑的終點時的位置及時間，可與在該第二行走路徑的始點時的位置及時間相匹配；以及第一該待測者在該第二行走路徑的終點時的位置及時間，可與在第三行走路徑的始點時的位置及時間相匹配。The monitoring system as described above, wherein the specific conditions that the first, second and third walking paths meet, including the position and time of the first subject at the end of the first walking path, can be compared with The position and time at the starting point of the second walking path match; and the position and time of the first test subject at the end of the second walking path may be the same as at the beginning of the third walking path Match the location and time.

如上所述之監測系統，其中，當該第一待測者在該第一行走路徑的終點與該第二行走路徑的始點的位置差值小於等於一第一閾值，並且該第一行走路徑的終點與該第二行走路徑的始點的時間差值小於等於一第二閾值，則該處理單元判斷該第一待測者的該第一行走路徑，可與該第二行走路徑相匹配。The monitoring system as described above, wherein, when the position difference between the end of the first walking path and the starting point of the second walking path is less than or equal to a first threshold, and the first walking path The time difference between the end point of and the start point of the second walking path is less than or equal to a second threshold, and the processing unit determines that the first walking path of the first subject can match the second walking path.

如上所述之監測系統，其中，當該第一待測者在該第二行走路徑的終點與該第三行走路徑的始點的位置差值小於等於一第一閾值，並且該第二行走路徑的終點與該第三行走路徑的始點的時間差值小於等於一第二閾值，則該處理單元判斷該第一待測者的該第二行走路徑，可與該第三行走路徑相匹配。The monitoring system as described above, wherein, when the position difference between the end of the second walking path and the starting point of the third walking path is less than or equal to a first threshold, and the second walking path The time difference between the end point of and the start point of the third walking path is less than or equal to a second threshold, then the processing unit determines that the second walking path of the first test subject can match the third walking path.

如上所述之監測系統，其中，當該第一待測者在該第一行走路徑的終點與該第二行走路徑的始點的位置差值大於該第一閾值，或第一行走路徑的終點與該第二行走路徑的始點的時間差值大於該第二閾值，則該處理單元判斷該第一待測者的該第一行走路徑與該第二行走路徑不相匹配，而不會將該第二行走路徑與該第一識別符相關聯。The monitoring system as described above, wherein, when the position difference between the end of the first walking path and the starting point of the second walking path is greater than the first threshold, or the end of the first walking path The time difference between the start point of the second walking path and the second threshold is greater than the second threshold, the processing unit determines that the first walking path of the first subject does not match the second walking path, and will not The second walking path is associated with the first identifier.

如上所述之監測系統，其中，當該第一待測者在該第二行走路徑的終點與該第三行走路徑的始點的位置差值大於該第一閾值，或該第二行走路徑的終點與該第三行走路徑的始點的時間差值大於該第二閾值，則該處理單元判斷該第一待測者的該第二行走路徑與該第三行走路徑不相匹配，而不會將該第二行走路徑與該第一識別符相關聯。The monitoring system as described above, wherein, when the position difference between the end of the second walking path and the starting point of the third walking path of the first subject is greater than the first threshold, or the second walking path The time difference between the end point and the start point of the third walking path is greater than the second threshold, then the processing unit determines that the second walking path of the first subject does not match the third walking path, and will not The second travel path is associated with the first identifier.

依據本發明一實施例之監測方法，適用於一監測系統，該監測系統利用一攝影機擷取一監測區域內的影像；該監測系統利用一身分辨識裝置從該影像中辨識一第一待測者的一一改這裏身分，並且依據該身分提供一第一識別符；該監測方法包括：依據該影像，紀錄該第一待測者的一第一行走路徑，並且將該第一行走路徑與該第一識別符相關聯；當偵測到該第一待測者在該影像中遭到遮蔽或消失時，中斷該第一行走路徑的紀錄；當偵測到一第二待測者出現在該影像中時，開始紀錄該第二待測者的一第二行走路徑，並且該身分辨識裝置提供一第二識別符給出現的該第二待測者，進一步將該第二行走路徑與該第二識別符相關聯；當辨識到該第二待測者為該第一待測者時，中斷該第二行走路徑的紀錄，開始紀錄該第一待測者的一第三行走路徑，並且將該第三行走路徑與該第一識別符相關聯；當該第一、第二及第三行走路徑符合一特定條件，將該第二行走路徑與該第一識別符相關聯，且依時序將該第一、第二與第三行走路徑相銜接，而得到該第一待測者的一完整行走路徑。The monitoring method according to an embodiment of the present invention is suitable for a monitoring system that uses a camera to capture an image in a monitoring area; the monitoring system uses a body recognition device to identify a first person to be tested from the image The identity is changed here, and a first identifier is provided according to the identity; the monitoring method includes: recording a first walking path of the first subject according to the image, and the first walking path and the Is associated with the first identifier; when it is detected that the first person under test is obscured or disappeared in the image, the record of the first walking path is interrupted; when a second person is detected to appear in the image When the image is in the image, start to record a second walking path of the second test subject, and the body recognition device provides a second identifier to the second test subject that appears, and further the second walking path and the first test subject Two identifiers are associated; when it is recognized that the second subject is the first subject, the recording of the second walking path is interrupted, and a third walking path of the first subject is recorded, and the The third walking path is associated with the first identifier; when the first, second, and third walking paths meet a specific condition, the second walking path is associated with the first identifier, and the The first, second, and third walking paths are connected to obtain a complete walking path of the first subject.

如上所述之監測方法，其中，該第一、第二及第三行走路徑所符合的該特定條件，包括該第一待測者在該第一行走路徑的終點時的位置及時間，可與在該第二行走路徑的始點時的位置及時間相匹配；以及第一該待測者在該第二行走路徑的終點時的位置及時間，可與在第三行走路徑的始點時的位置及時間相匹配。The monitoring method as described above, wherein the specific conditions that the first, second and third walking paths meet, including the position and time of the first subject at the end of the first walking path, can be compared with The position and time at the start point of the second walking path match; and the position and time of the first test subject at the end of the second walking path may be the same as the position and time at the start point of the third walking path Match the location and time.

如上所述之監測方法，其中，當該第一待測者在該第一行走路徑的終點與該第二行走路徑的始點的位置差值小於等於一第一閾值，並且該第一行走路徑的終點與該第二行走路徑的始點的時間差值小於等於一第二閾值，則判斷該第一待測者的該第一行走路徑，可與該第二行走路徑相匹配。The monitoring method as described above, wherein, when the position difference between the end of the first walking path and the starting point of the second walking path is less than or equal to a first threshold, and the first walking path The time difference between the end point of and the start point of the second walking path is less than or equal to a second threshold, then it is determined that the first walking path of the first test subject can match the second walking path.

如上所述之監測方法，其中，當該第一待測者在該第二行走路徑的終點與該第三行走路徑的始點的位置差值小於等於一第一閾值，並且該第二行走路徑的終點與該第三行走路徑的始點的時間差值小於等於一第二閾值，則判斷該第一待測者的該第二行走路徑，可與該第三行走路徑相匹配。The monitoring method as described above, wherein, when the position difference between the end of the second walking path and the starting point of the third walking path is less than or equal to a first threshold, and the second walking path The time difference between the end point of and the start point of the third walking path is less than or equal to a second threshold, then it is determined that the second walking path of the first test subject can match the third walking path.

如上所述之監測方法，其中，當該第一待測者在該第一行走路徑的終點與該第二行走路徑的始點的位置差值大於該第一閾值，或第一行走路徑的終點與該第二行走路徑的始點的時間差值大於該第二閾值，則判斷該第一待測者的該第一行走路徑與該第二行走路徑不相匹配，而不會將該第二行走路徑與該第一識別符相關聯。The monitoring method as described above, wherein, when the position difference between the end of the first walking path and the starting point of the second walking path of the first subject is greater than the first threshold, or the end of the first walking path If the time difference between the start point of the second walking path and the second threshold is greater than the second threshold, it is determined that the first walking path of the first subject does not match the second walking path, and the second walking path will not be matched. The walking path is associated with the first identifier.

如上所述之監測方法，其中，當該第一待測者在該第二行走路徑的終點與該第三行走路徑的始點的位置差值大於該第一閾值，或該第二行走路徑的終點與該第三行走路徑的始點的時間差值大於該第二閾值，則判斷該第一待測者的該第二行走路徑與該第三行走路徑不相匹配，而不會將該第二行走路徑與該第一識別符相關聯。The monitoring method as described above, wherein, when the position difference between the end of the second walking path and the starting point of the third walking path of the first subject is greater than the first threshold, or the second walking path The time difference between the end point and the start point of the third walking path is greater than the second threshold, it is determined that the second walking path of the first subject does not match the third walking path, and the second walking path will not be matched. Two walking paths are associated with the first identifier.

第1圖為本發明實施例之監測系統方塊圖。如第1圖所示，監測系統100包括一攝影機102、身分辨識裝置104，以及一處理單元106。攝影機102用以擷取一監測區域內的影像108。舉例來說，攝影機102可為各種類型的攝影機，例如由電荷耦合元件(Charge-coupled Device：CCD)感測器或互補式金屬氧化物半導體(Complementary Metal-Oxide-Semiconductor：CMOS)感測器所構成的各式攝影機。在本實施例中，攝影機102的數量並不限定為1，基於不同的監測應用，亦可利用複數攝影機擷取該監測區域的影像，因而擴大該監測區域的範圍。Figure 1 is a block diagram of a monitoring system according to an embodiment of the present invention. As shown in FIG. 1, the monitoring system 100 includes a camera 102, a body recognition device 104, and a processing unit 106. The camera 102 is used to capture an image 108 in a monitoring area. For example, the camera 102 may be various types of cameras, such as a charge-coupled device (CCD) sensor or a complementary metal-oxide-semiconductor (Complementary Metal-Oxide-Semiconductor: CMOS) sensor. Various types of cameras. In this embodiment, the number of cameras 102 is not limited to 1. Based on different monitoring applications, multiple cameras may also be used to capture images of the monitoring area, thereby expanding the scope of the monitoring area.

身分辨識裝置104從該監測區域內的影像108中辨識一待測者的一身分，並且依據該身分提供一識別符110。身分辨識裝置104包括各式可從影像中辨識出目標人物身分的裝置，例如人臉辨識裝置、人體辨識裝置、行走姿態辨識裝置…等。處理單元106可為任何桌上型電腦、筆記型電腦、伺服器，或智慧型手機的處理器，透過執行儲存在一儲存裝置的一應用程式，進而將該待測者在該監測區內的一行走路徑，紀錄於該儲存裝置中，並且將該行走路徑與身分辨識裝置104所提供的識別符110相關聯。The identity recognition device 104 recognizes an identity of a person to be tested from the image 108 in the monitoring area, and provides an identifier 110 according to the identity. The body recognition device 104 includes various devices that can recognize the identity of the target person from the image, such as a face recognition device, a human body recognition device, a walking posture recognition device, etc. The processing unit 106 can be a processor of any desktop computer, notebook computer, server, or smart phone. By executing an application program stored in a storage device, the tester is placed in the monitoring area. A walking path is recorded in the storage device, and the walking path is associated with the identifier 110 provided by the body identification device 104.

第2圖為本發明實施例第1圖監測系統監測一待測者的行走路徑示意圖。如第2圖所示，在攝影機102所擷取的影像108中，身分辨識裝置104辨識到一第一待測者200及一第三待測者202。第一待測者200及第三待測者202分別沿著所標示箭頭的方向行走，並且在過程中，第三待測者202在影像108中遮蔽了第一待測者200，使得第一待測者200有短暫時間消失在影像108之中。首先，處理單元106依據影像108，紀錄第一待測者200的一第一行走路徑210。由於身分辨識裝置104已辨識到第一待測者200，因此提供一第一識別符A，用以標記第一待測者200；以及提供一第三識別符B，用以標記第三待測者202。接著，處理單元106係將第一行走路徑210與第一識別符A相關聯，而確認第一行走路徑210是第一待測者200的行走路徑。Figure 2 is a schematic diagram of the walking path of a person under test monitored by the monitoring system in Figure 1 of the embodiment of the present invention. As shown in FIG. 2, in the image 108 captured by the camera 102, the body recognition device 104 recognizes a first subject 200 and a third subject 202. The first test subject 200 and the third test subject 202 respectively walk along the direction of the marked arrow, and in the process, the third test subject 202 obscures the first test subject 200 in the image 108, so that the first The subject 200 disappears in the image 108 for a short time. First, the processing unit 106 records a first walking path 210 of the first subject 200 according to the image 108. Since the body identification device 104 has recognized the first test subject 200, a first identifier A is provided to mark the first test subject 200; and a third identifier B is provided to mark the third test subject 200者202. Next, the processing unit 106 associates the first walking path 210 with the first identifier A, and confirms that the first walking path 210 is the walking path of the first subject 200.

當處理單元106偵測到第一待測者200在影像108中遭到遮蔽或消失(例如遭到第三待測者202的遮蔽或者是其他障礙物而消失)，處理單元106中斷第一行走路徑210的紀錄。在另一實施例中，處理單元106可能因為第一待測者200離開該監測區域，而消失在影像108之中，因而中斷第一行走路徑210的紀錄。在第一待測者200與第三待測者202交錯而過後，第一待測者200重新出現在影像108之中。然而，此時身分辨識裝置104尚未辨識出這一新出現的待測者就是第一待測者200，因此當第一待測者200重新出現在影像108之中時，處理單元106視為偵測到一第二待測者204(不同於第一待測者200)，而開始記錄第二待測者204的一第二行走路徑212，並且身分辨識裝置104提供一第二識別符(C)給出現的第二待測者204。其中，該第二識別符(C)表示一未知識別符。處理單元106進一步將第二行走路徑212與第二識別符(C)相關聯，確認第二行走路徑212是第二待測者204的行走路徑。 When the processing unit 106 detects that the first subject 200 is hidden or disappears in the image 108 (for example, the third subject 202 is hidden or disappears due to other obstacles), the processing unit 106 interrupts the first walk Path 210 records. In another embodiment, the processing unit 106 may disappear in the image 108 because the first subject 200 has left the monitoring area, thereby interrupting the recording of the first walking path 210. After the first subject 200 and the third subject 202 are interlaced, the first subject 200 reappears in the image 108. However, at this time, the body discrimination device 104 has not recognized that the newly-appearing test subject is the first test subject 200, so when the first test subject 200 reappears in the image 108, the processing unit 106 regards it as a detective. A second test subject 204 (different from the first test subject 200) is detected, and a second walking path 212 of the second test subject 204 is recorded, and the body identification device 104 provides a second identifier (C ) To the second candidate 204 who appears. Wherein, the second identifier (C) represents an unknown identifier. The processing unit 106 further associates the second walking path 212 with the second identifier (C), and confirms that the second walking path 212 is the walking path of the second subject 204.

當身分辨識裝置104辨識到第二待測者204與第一待測者200為同一人時，處理單元106中斷第二行走路徑212的紀錄，而開始記錄第一待測者200的一第三行走路徑214，並且將第三行走路徑214與第一識別符A相關聯。接著，處理單元106開始比對第一行走路徑210、第二行走路徑212，及第三行走路徑214是否符合一特定條件，用以作為是否將第二行走路徑212與第一識別符A相關聯的依據。舉例來說，當第一待測者200在第一行走路徑210的終點時的位置及時間，可與在第二行走路徑212的始點時的位置及時間相匹配，以及第一待測者200(已知道第二待測者204與第一待測者200為同一人)在第二行走路徑的終點時的位置及時間，可與在第三行走路徑214的始點時的位置及時間相匹配，則處理單元106判斷符合該特定條件，而將第二行走路徑212與第一識別符A相關聯，確認第二行走路徑212是第一待測者200的行走路徑。 When the body identification device 104 recognizes that the second test subject 204 and the first test subject 200 are the same person, the processing unit 106 interrupts the recording of the second walking path 212 and starts to record a third test of the first test subject 200. The walking path 214 and the third walking path 214 are associated with the first identifier A. Then, the processing unit 106 starts to compare whether the first walking path 210, the second walking path 212, and the third walking path 214 meet a specific condition, which is used as whether to associate the second walking path 212 with the first identifier A Basis. For example, the position and time when the first subject 200 is at the end of the first walking path 210 can match the position and time at the beginning of the second walking path 212, and the first subject 200 200 (it is known that the second test subject 204 and the first test subject 200 are the same person) The position and time at the end of the second walking path can be the same as the position and time at the beginning of the third walking path 214 If they match, the processing unit 106 determines that the specific condition is met, and associates the second walking path 212 with the first identifier A, and confirms that the second walking path 212 is the walking path of the first subject 200.

進一步來說，當第一待測者200在第一行走路徑210的終點與第二行走路徑212的始點的位置差值小於等於一第一閾值(例如50公分或1公尺)，並且第一行走路徑210的終點與第二行走路徑212的始點的時間差值小於等於一第二閾值(例如1秒或3秒)，則處理單元106判斷第一待測者200的第一行走路徑210，可與第二行走路徑212相匹配。該第一閾值及該第二閾值可依不同的應用狀況做調整，不限於上述例示之數值。當第一待測者200在第二行走路徑212的終點與第三行走路徑214的始點的位置差值小於等於該第一閾值，並且第二行走路徑212的終點與第三行走路徑214的始點的時間差值小於等於該第二閾值，則處理單元106判斷第一待測者200的第二行走路徑212，可與第三行走路徑214相匹配。Furthermore, when the position difference between the end of the first walking path 210 and the starting point of the second walking path 212 of the first subject 200 is less than or equal to a first threshold (for example, 50 cm or 1 meter), and The time difference between the end point of a walking path 210 and the start point of the second walking path 212 is less than or equal to a second threshold (for example, 1 second or 3 seconds), the processing unit 106 determines the first walking path of the first subject 200 210, can be matched with the second walking path 212. The first threshold and the second threshold can be adjusted according to different application conditions and are not limited to the numerical values exemplified above. When the position difference between the end point of the second walking path 212 and the start point of the third walking path 214 of the first subject 200 is less than or equal to the first threshold, and the end point of the second walking path 212 and the third walking path 214 The time difference between the starting points is less than or equal to the second threshold, the processing unit 106 determines that the second walking path 212 of the first subject 200 can match the third walking path 214.

當第一待測者200的第一行走路徑210，可與第二行走路徑212相匹配，且第二行走路徑212可與第三行走路徑214相匹配，則處理單元106判斷符合該特定條件，而將第二行走路徑212與第一識別符A相關聯，確認第二行走路徑212是第一待測者200的行走路徑。接著，處理單元106依時序將第一行走路徑210、第二行走路徑212，及第三行走路徑214相銜接，而得到第一待測者200的一完整行走路徑。When the first walking path 210 of the first subject 200 can be matched with the second walking path 212, and the second walking path 212 can be matched with the third walking path 214, the processing unit 106 determines that the specific condition is met, The second walking path 212 is associated with the first identifier A, and it is confirmed that the second walking path 212 is the walking path of the first subject 200. Then, the processing unit 106 connects the first walking path 210, the second walking path 212, and the third walking path 214 in time sequence to obtain a complete walking path of the first subject 200.

相反地，當第一待測者200在第一行走路徑210的終點與第二行走路徑212的始點的位置差值大於該第一閾值，並且第一行走路徑210的終點與第二行走路徑212的始點的時間差值大於該第二閾值，則處理單元106判斷第一待測者200的第一行走路徑210，不與第二行走路徑212相匹配。當第一待測者200在第二行走路徑212的終點與第三行走路徑214的始點的位置差值大於該第一閾值，並且第二行走路徑212的終點與第三行走路徑214的始點的時間差值大於該第二閾值，則處理單元106判斷第一待測者200的第二行走路徑212，不與第三行走路徑214相匹配。因此，處理單元106不會將第二行走路徑212與第一識別符A相關聯。 Conversely, when the position difference between the end point of the first walking path 210 and the start point of the second walking path 212 of the first subject 200 is greater than the first threshold, and the end point of the first walking path 210 and the second walking path The time difference between the starting point of 212 is greater than the second threshold, the processing unit 106 determines that the first walking path 210 of the first subject 200 does not match the second walking path 212. When the position difference between the end of the second walking path 212 and the start of the third walking path 214 of the first subject 200 is greater than the first threshold, and the end of the second walking path 212 and the beginning of the third walking path 214 The time difference between the points is greater than the second threshold, the processing unit 106 determines that the second walking path 212 of the first subject 200 does not match the third walking path 214. Therefore, the processing unit 106 will not associate the second walking path 212 with the first identifier A.

第3圖為本發明實施例第1圖監測系統之監測方法流程圖。如第3圖所示，處理單元106依據影像108，紀錄第一待測者200的一第一行走路徑210，並且將第一行走路徑210與第一識別符A相關聯(S300)。接著，當處理單元106偵測到第一待測者200在影像108中遭到遮蔽或消失，則中斷第一行走路徑210的紀錄(S302)。當處理單元106偵測到一第二待測者204出現在影像108中時，開始紀錄第二待測者204的一第二行走路徑212，並且身分辨識裝置104提供一第二識別符(C)給出現的第二待測者204，處理單元106進一步將第二行走路徑212與該第二識別符(C)相關聯(S304)。當身分辨識裝置104辨識到第二待測者204為第一待測者200時，處理單元106中斷第二行走路徑212的紀錄，開始紀錄第一待測者200的一第三行走路徑214，並且將第三行走路徑214與第一識別符A相關聯(S306)。最後，當該第一行走路徑210、第二行走路徑212，及第三行走路徑214符合一特定條件，處理單元106將第二行走路徑212與第一識別符A相關聯，且依時序將該第一行走路徑210、第二行走路徑212，與第三行走路徑214相銜接，而得到第一待測者200的一完整行走路徑(S308)。其中，步驟S308的該特定條件已於本說明書第[0021]-[0022]段中敘述，故不再贅述。Figure 3 is a flowchart of the monitoring method of the monitoring system in Figure 1 according to the embodiment of the present invention. As shown in FIG. 3, the processing unit 106 records a first walking path 210 of the first subject 200 according to the image 108, and associates the first walking path 210 with the first identifier A (S300). Then, when the processing unit 106 detects that the first subject 200 is hidden or disappears in the image 108, it interrupts the recording of the first walking path 210 (S302). When the processing unit 106 detects that a second subject 204 appears in the image 108, it starts to record a second walking path 212 of the second subject 204, and the body identification device 104 provides a second identifier (C ) For the second test subject 204 that appears, the processing unit 106 further associates the second walking path 212 with the second identifier (C) (S304). When the body identification device 104 recognizes that the second test subject 204 is the first test subject 200, the processing unit 106 interrupts the recording of the second walking path 212 and starts recording a third walking path 214 of the first test subject 200. And the third traveling path 214 is associated with the first identifier A (S306). Finally, when the first walking path 210, the second walking path 212, and the third walking path 214 meet a specific condition, the processing unit 106 associates the second walking path 212 with the first identifier A, and the second walking path 212 is associated with the first identifier A according to the time sequence. The first walking path 210 and the second walking path 212 are connected with the third walking path 214 to obtain a complete walking path of the first subject 200 (S308). Among them, the specific condition of step S308 has been described in paragraphs [0021]-[0022] of this specification, so it will not be repeated.

依據本發明所述之監測裝置及監測方法，可得知一目標人物的一完整行走路徑，並判斷是否有不正常的行為模式，例如步伐搖擺、路徑迂迴不定..等。未來，該完整行走路徑可與失智症行為做進一步的關聯性分析。According to the monitoring device and the monitoring method of the present invention, a complete walking path of a target person can be known, and it can be judged whether there is an abnormal behavior pattern, such as swaying steps, winding paths, etc. In the future, this complete walking path can be further correlated with dementia behavior.

雖然本發明的實施例如上述所描述，我們應該明白上述所呈現的只是範例，而不是限制。依據本實施例上述示範實施例的許多改變是可以在沒有違反發明精神及範圍下被執行。因此，本發明的廣度及範圍不該被上述所描述的實施例所限制。更確切地說，本發明的範圍應該要以以下的申請專利範圍及其相等物來定義。Although the embodiments of the present invention are as described above, we should understand that what is presented above is only an example, not a limitation. According to this embodiment, many changes of the above exemplary embodiment can be implemented without violating the spirit and scope of the invention. Therefore, the breadth and scope of the present invention should not be limited by the embodiments described above. More precisely, the scope of the present invention should be defined by the following patented scope and its equivalents.

100 ~ 監測系統 102 ~ 攝影機 104 ~ 身分辨識裝置 106 ~ 處理單元 108 ~ 影像 110 ~ 識別符 200 ~ 第一待測者 202 ~ 第三待測者 204 ~ 第二待測者 210 ~ 第一行走路徑100 ~ Monitoring system 102 ~ Camera 104 ~ Body recognition device 106 ~ Processing unit 108 ~ Image 110 ~ Identifier 200 ~ First test subject 202 ~ Third test subject 204 ~ Second test subject 210 ~ First walking path

212:第二行走路徑 212: Second walking path

214:第三行走路徑 214: Third walking path

ID：A:第一識別符 ID: A: first identifier

ID：B:第三識別符 ID: B: third identifier

ID：C:第二識別符 ID: C: second identifier

第1圖為本發明實施例之監測系統方塊圖。 第2圖為本發明實施例第1圖監測系統監測一待測者的行走路徑示意圖。 第3圖為本發明實施例第1圖監測系統之監測方法流程圖。Figure 1 is a block diagram of a monitoring system according to an embodiment of the present invention. Figure 2 is a schematic diagram of the walking path of a person under test monitored by the monitoring system in Figure 1 of the embodiment of the present invention. Figure 3 is a flowchart of the monitoring method of the monitoring system in Figure 1 according to the embodiment of the present invention.

200:第一待測者 200: first candidate

202:第三待測者 202: The third candidate

204:第二待測者 204: The second candidate

210:第一行走路徑 210: First walking path

212:第二行走路徑 212: Second walking path

214:第三行走路徑 214: Third walking path

ID：A:第一識別符 ID: A: first identifier

ID：B:第三識別符 ID: B: third identifier

ID：C:第二識別符 ID: C: second identifier

Claims (12)

一種監測系統，包括：一攝影機，用以擷取一監測區域內的影像；一身分辨識裝置，用以從該影像中辨識一第一待測者的一身分，並且依據該身分提供一第一識別符，用以標記該第一待測者；以及一處理單元；該處理單元依據該影像，紀錄該第一待測者的一第一行走路徑，並且將該第一行走路徑與該第一識別符相關聯；當該處理單元偵測到該第一待測者在該影像中遭到遮蔽或消失時，中斷該第一行走路徑的紀錄；當該處理單元偵測到一第二待測者出現在該影像中時，開始紀錄該第二待測者的一第二行走路徑，並且該身分辨識裝置標記一第二識別符給出現的該第二待測者，該處理單元進一步將該第二行走路徑與該第二識別符相關聯；當該身分辨識裝置辨識到該第二待測者為該第一待測者時，該處理單元中斷該第二行走路徑的紀錄，開始紀錄該第一待測者的一第三行走路徑，並且將該第三行走路徑與該第一識別符相關聯；當該第一、第二及第三行走路徑符合一特定條件，該處理單元將該第二行走路徑與該第一識別符相關聯，且依時序將該第一、第二與第三行走路徑相銜接，而得到該第一待測者的一完整行走路徑。 A monitoring system includes: a camera for capturing an image in a monitoring area; a body recognition device for recognizing an identity of a first person to be tested from the image, and providing a first person according to the identity An identifier for marking the first subject; and a processing unit; the processing unit records a first walking path of the first subject according to the image, and the first walking path and the first Identifier associated; when the processing unit detects that the first test subject is occluded or disappears in the image, the recording of the first walking path is interrupted; when the processing unit detects a second test subject When the person appears in the image, a second walking path of the second testee is recorded, and the body identification device marks a second identifier for the second testee who appears, and the processing unit further The second walking path is associated with the second identifier; when the body identification device recognizes that the second subject is the first subject, the processing unit interrupts the recording of the second walking path and starts recording the A third walking path of the first test subject, and the third walking path is associated with the first identifier; when the first, second, and third walking paths meet a specific condition, the processing unit will The second walking path is associated with the first identifier, and the first, second, and third walking paths are connected in time sequence to obtain a complete walking path of the first subject. 如申請專利範圍第1項所述之監測系統，其中，該第 一、第二及第三行走路徑所符合的該特定條件，包括該第一待測者在該第一行走路徑的終點時的位置及時間，可與在該第二行走路徑的始點時的位置及時間相匹配；以及第一該待測者在該第二行走路徑的終點時的位置及時間，可與在第三行走路徑的始點時的位置及時間相匹配。 Such as the monitoring system described in item 1 of the scope of patent application, wherein the item 1. The specific conditions that the second and third walking paths meet, including the position and time of the first test subject at the end of the first walking path, can be compared with those at the beginning of the second walking path The position and time match; and the position and time of the first test subject at the end of the second walking path can match the position and time at the start point of the third walking path. 如申請專利範圍第2項所述之監測系統，其中，當該第一待測者在該第一行走路徑的終點與該第二行走路徑的始點的位置差值小於等於一第一閾值，並且該第一行走路徑的終點與該第二行走路徑的始點的時間差值小於等於一第二閾值，則該處理單元判斷該第一待測者的該第一行走路徑，可與該第二行走路徑相匹配。 The monitoring system described in item 2 of the scope of patent application, wherein, when the position difference between the end of the first walking path and the starting point of the second walking path of the first subject is less than or equal to a first threshold, And the time difference between the end point of the first walking path and the starting point of the second walking path is less than or equal to a second threshold, the processing unit determines that the first walking path of the first test subject can be compared with the first walking path Match the two walking paths. 如申請專利範圍第2項所述之監測系統，其中，當該第一待測者在該第二行走路徑的終點與該第三行走路徑的始點的位置差值小於等於一第一閾值，並且該第二行走路徑的終點與該第三行走路徑的始點的時間差值小於等於一第二閾值，則該處理單元判斷該第一待測者的該第二行走路徑，可與該第三行走路徑相匹配。 The monitoring system described in item 2 of the scope of patent application, wherein, when the position difference between the end of the second walking path and the starting point of the third walking path of the first subject is less than or equal to a first threshold, And the time difference between the end point of the second walking path and the starting point of the third walking path is less than or equal to a second threshold, then the processing unit determines that the second walking path of the first subject can be compared with the first Match the three walking paths. 如申請專利範圍第3項所述之監測系統，其中，當該第一待測者在該第一行走路徑的終點與該第二行走路徑的始點的位置差值大於該第一閾值，或第一行走路徑的終點與該第二行走路徑的始點的時間差值大於該第二閾值，則該處理單元判斷該第一待測者的該第一行走路徑與該第二行走路徑不相匹配，而不會將該第二行走路徑與該第一識別符相關聯。 The monitoring system described in item 3 of the scope of patent application, wherein when the position difference between the end of the first walking path and the starting point of the second walking path of the first subject is greater than the first threshold, or The time difference between the end point of the first walking path and the starting point of the second walking path is greater than the second threshold, the processing unit determines that the first walking path and the second walking path of the first subject do not correspond to each other Match without associating the second walking path with the first identifier. 如申請專利範圍第4項所述之監測系統，其中，當該第一待測者在該第二行走路徑的終點與該第三行走路徑的始點的位置差值大於該第一閾值，或該第二行走路徑的終點與該第三行走路徑的始點的時間差值大於該第二閾值，則該處理單元判斷該第一待測者的該第二行走路徑與該第三行走路徑不相匹配，而不會將該第二行走路徑與該第一識別符相關聯。 The monitoring system described in item 4 of the scope of patent application, wherein, when the position difference between the end of the second walking path and the starting point of the third walking path of the first subject is greater than the first threshold, or The time difference between the end point of the second walking path and the start point of the third walking path is greater than the second threshold, and the processing unit determines that the second walking path of the first subject is different from the third walking path. Match without associating the second walking path with the first identifier. 一種監測方法，適用於一監測系統，該監測系統利用一攝影機擷取一監測區域內的影像，該監測系統並利用一身分辨識裝置從該影像中辨識一第一待測者的一身分，並且依據該身分提供一第一識別符，用以標記該第一待測者；該監測方法包括：依據該影像，紀錄該第一待測者的一第一行走路徑，並且將該第一行走路徑與該第一識別符相關聯；當偵測到該第一待測者在該影像中遭到遮蔽或消失時，中斷該第一行走路徑的紀錄；當偵測到一第二待測者出現在該影像中時，開始紀錄該第二待測者的一第二行走路徑，並且標記一第二識別符給出現的該第二待測者，並進一步將該第二行走路徑與該第二識別符相關聯；當辨識到該第二待測者為該第一待測者時，中斷該第二行走路徑的紀錄，開始紀錄該第一待測者的一第三行走路徑，並且將該第三行走路徑與該第一識別符相關聯；當該第一、第二及第三行走路徑符合一特定條件，將該第二行走路徑與該第一識別符相關聯，且依時序將該第一、第二與第三行 走路徑相銜接，而得到該第一待測者的一完整行走路徑。 A monitoring method is applicable to a monitoring system that uses a camera to capture an image in a monitoring area, the monitoring system uses a body recognition device to recognize an identity of a first person to be tested from the image, and According to the identity, a first identifier is provided for marking the first test subject; the monitoring method includes: recording a first walking path of the first test subject according to the image, and the first walking path Is associated with the first identifier; when it is detected that the first person to be tested is obscured or disappeared in the image, the recording of the first walking path is interrupted; when a second person to be tested is detected Now in the image, start to record a second walking path of the second test subject, and mark a second identifier for the second test subject that appears, and further the second walking path and the second test subject Identifier associated; when the second test subject is identified as the first test subject, the recording of the second walking path is interrupted, and a third walking path of the first testee is recorded, and the The third walking path is associated with the first identifier; when the first, second and third walking paths meet a specific condition, the second walking path is associated with the first identifier, and the First, second and third lines The walking paths are connected to obtain a complete walking path of the first candidate. 如申請專利範圍第7項所述之監測方法，其中，該第一、第二及第三行走路徑所符合的該特定條件，包括該第一待測者在該第一行走路徑的終點時的位置及時間，可與在該第二行走路徑的始點時的位置及時間相匹配；以及第一該待測者在該第二行走路徑的終點時的位置及時間，可與在第三行走路徑的始點時的位置及時間相匹配。 The monitoring method according to item 7 of the scope of patent application, wherein the specific conditions that the first, second, and third walking paths meet include the first test subject at the end of the first walking path The position and time can match the position and time at the beginning of the second walking path; and the position and time of the first test subject at the end of the second walking path can be the same as those at the third walking path. The location and time of the starting point of the path match. 如申請專利範圍第8項所述之監測方法，其中，當該第一待測者在該第一行走路徑的終點與該第二行走路徑的始點的位置差值小於等於一第一閾值，並且該第一行走路徑的終點與該第二行走路徑的始點的時間差值小於等於一第二閾值，則判斷該第一待測者的該第一行走路徑，可與該第二行走路徑相匹配。 The monitoring method described in item 8 of the scope of patent application, wherein when the position difference between the end of the first walking path and the starting point of the second walking path of the first subject is less than or equal to a first threshold, And the time difference between the end point of the first walking path and the starting point of the second walking path is less than or equal to a second threshold, it is determined that the first walking path of the first subject can be compared with the second walking path Match. 如申請專利範圍第8項所述之監測方法，其中，當該第一待測者在該第二行走路徑的終點與該第三行走路徑的始點的位置差值小於等於一第一閾值，並且該第二行走路徑的終點與該第三行走路徑的始點的時間差值小於等於一第二閾值，則判斷該第一待測者的該第二行走路徑，可與該第三行走路徑相匹配。 The monitoring method described in item 8 of the scope of patent application, wherein, when the position difference between the end of the second walking path and the starting point of the third walking path of the first subject is less than or equal to a first threshold, And the time difference between the end point of the second walking path and the start point of the third walking path is less than or equal to a second threshold, it is determined that the second walking path of the first subject is comparable to the third walking path Match. 如申請專利範圍第9項所述之監測方法，其中，當該第一待測者在該第一行走路徑的終點與該第二行走路徑的始點的位置差值大於該第一閾值，或第一行走路徑的終點與該第二行走路徑的始點的時間差值大於該第二閾值，則判斷該第一待測者的該第一行走路徑與該第二行走路徑不相匹配，而不會將該第二行走路徑與 該第一識別符相關聯。 The monitoring method described in item 9 of the scope of patent application, wherein when the position difference between the end of the first walking path and the starting point of the second walking path of the first subject is greater than the first threshold, or The time difference between the end point of the first walking path and the starting point of the second walking path is greater than the second threshold, it is determined that the first walking path of the first subject does not match the second walking path, and Will not associate the second walking path with This first identifier is associated. 如申請專利範圍第10項所述之監測方法，其中，當該第一待測者在該第二行走路徑的終點與該第三行走路徑的始點的位置差值大於該第一閾值，或該第二行走路徑的終點與該第三行走路徑的始點的時間差值大於該第二閾值，則判斷該第一待測者的該第二行走路徑與該第三行走路徑不相匹配，而不會將該第二行走路徑與該第一識別符相關聯。 The monitoring method described in item 10 of the scope of patent application, wherein when the position difference between the end of the second walking path and the starting point of the third walking path of the first subject is greater than the first threshold, or The time difference between the end point of the second walking path and the starting point of the third walking path is greater than the second threshold, then it is determined that the second walking path of the first subject does not match the third walking path, It does not associate the second walking path with the first identifier.
TW107142619A 2018-11-29 2018-11-29 Monitoring device and method thereof TWI697914B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW107142619A TWI697914B (en) 2018-11-29 2018-11-29 Monitoring device and method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW107142619A TWI697914B (en) 2018-11-29 2018-11-29 Monitoring device and method thereof

Publications (2)

Publication Number Publication Date
TW202020893A TW202020893A (en) 2020-06-01
TWI697914B true TWI697914B (en) 2020-07-01

Family

ID=72175723

Family Applications (1)

Application Number Title Priority Date Filing Date
TW107142619A TWI697914B (en) 2018-11-29 2018-11-29 Monitoring device and method thereof

Country Status (1)

Country Link
TW (1) TWI697914B (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060120564A1 (en) * 2004-08-03 2006-06-08 Taro Imagawa Human identification apparatus and human searching/tracking apparatus
US20100188511A1 (en) * 2009-01-23 2010-07-29 Casio Computer Co., Ltd. Imaging apparatus, subject tracking method and storage medium
US20130314562A1 (en) * 2012-05-24 2013-11-28 Olympus Imaging Corp. Object recognition apparatus, object recognition method and object recognition program
US20150138332A1 (en) * 2004-09-17 2015-05-21 Proximex Corporation Adaptive multi-modal integrated biometric identification and surveillance systems

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060120564A1 (en) * 2004-08-03 2006-06-08 Taro Imagawa Human identification apparatus and human searching/tracking apparatus
US20150138332A1 (en) * 2004-09-17 2015-05-21 Proximex Corporation Adaptive multi-modal integrated biometric identification and surveillance systems
US20100188511A1 (en) * 2009-01-23 2010-07-29 Casio Computer Co., Ltd. Imaging apparatus, subject tracking method and storage medium
US20130314562A1 (en) * 2012-05-24 2013-11-28 Olympus Imaging Corp. Object recognition apparatus, object recognition method and object recognition program

Also Published As

Publication number Publication date
TW202020893A (en) 2020-06-01

Similar Documents

Publication Publication Date Title
Ahmed et al. Vision based hand gesture recognition using dynamic time warping for Indian sign language
JP5567853B2 (en) Image recognition apparatus and method
JP4984728B2 (en) Subject collation device and subject collation method
JP7261296B2 (en) Target object recognition system, method, apparatus, electronic device, and recording medium
JP5459674B2 (en) Moving object tracking system and moving object tracking method
CN107438173A (en) Video process apparatus, method for processing video frequency and storage medium
US10467461B2 (en) Apparatus for searching for object and control method thereof
TW201401186A (en) System and method for identifying human face
JP5754990B2 (en) Information processing apparatus, information processing method, and program
CN112131976B (en) Self-adaptive portrait temperature matching and mask recognition method and device
JP6588413B2 (en) Monitoring device and monitoring method
CN111598865B (en) Hand-foot-mouth disease detection method, device and system based on thermal infrared and RGB double-shooting
US10659680B2 (en) Method of processing object in image and apparatus for same
CN114469076B (en) Identity-feature-fused fall identification method and system for solitary old people
US20210158566A1 (en) Information processing apparatus, information processing method, and storage medium
CN112001953A (en) Temperature detection method, device, equipment and computer equipment
EP3860116A1 (en) Authentication system, authentication method, and storage medium
CN104182725A (en) Face recognizing and tracking system based on non-contact body physiological parameter measurement
TWI697914B (en) Monitoring device and method thereof
Bansal et al. Elderly people fall detection system using skeleton tracking and recognition
JP5983033B2 (en) Position relationship determination program, position relationship determination method, and position relationship determination device
JP2020095651A (en) Productivity evaluation system, productivity evaluation device, productivity evaluation method, and program
KR20140083563A (en) Multi-body Detection Method based on a NCCAH(Normalized Cross-Correlation of Average Histogram) And Electronic Device supporting the same
JP2024519620A (en) Dementia patient tracking device and method
Kong et al. Step sequence and direction detection of four square step test