JP2015191513A - notification system and notification method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a notification system and a notification method capable of suppressing further exposure when a user is exposed to an exposure object.SOLUTION: A notification system 10 includes: an imaging part 12 disposed in an umbrella device 1 for protecting a user U for capturing an imaging range including a protection range P of the umbrella device 1; a determination part 23 for determining whether or not the user U is protruding from the protection range P on the basis of an image G captured by the imaging part 12; and a notification part 24 for, when it is determined that the user U is protruding from the protection range P by the protrusion determination part 23, notifying the user U that the user U is protruding from the protection range P.

Description

  The present invention relates to a notification system and a notification method.

  For example, a device such as an umbrella that protects a user from rain, snow, or sunlight is known (see, for example, Patent Document 1).

JP 11-151109 A

  In such a conventional device such as an umbrella, when a part of the body protrudes from the umbrella (protection range), the clothes or a part of the human body may be exposed to an exposed object such as rain. In such a case, if the user is unaware that he is being exposed, he or she will be further exposed.

  The present invention has been made in view of the above problems, and provides a notification system and a notification method capable of suppressing further exposure when a user is exposed to exposure such as rain, snow, or sunlight. With the goal.

  A notification system according to an aspect of the present invention is provided in an umbrella-shaped device for protecting a user, an imaging unit that captures a predetermined range including a protection range of the umbrella-shaped device, and an image captured by the imaging unit. Based on the protrusion determination means for determining whether or not the user protrudes from the defense range, and the protrusion determination means, it is determined that the user has protruded from the protection range. Notification means for notifying.

  According to this notification system, it is determined whether or not the user protrudes from the protection range using an image obtained by capturing a predetermined range including the protection range of the umbrella-shaped device. When it is determined that the user is out of the defense range, the fact is notified to the user. Thereby, it is possible to make the user recognize that the user is out of the defense range. For example, if the user is out of the defense range when it rains, the user will get wet in the rain, so that the user can recognize that the user is out of the defense range and urge the user to fall within the defense range. And further exposure (wetting) of the user can be suppressed.

  The notification system according to another aspect of the present invention may further include a human body region detection unit that detects a human body region where the user's human body is located in the image based on an image captured by the imaging unit. May determine whether or not the user is out of the defense range based on the human body region detected by the human body region detection means. In this case, by detecting the human body region where the user's human body is located in the image, it is possible to more reliably determine whether or not the user is outside the defense range.

  The image pickup means may pick up a predetermined range at predetermined time intervals, and the protrusion determination means is based on a change in the color of the human body region detected by the human body region detection means in two or more images picked up by the image pickup means. It may be determined whether or not the user protrudes from the defense range. For example, when the user's clothes are wet due to rain, the color of the clothes changes. For this reason, in two or more images, when there is a part in which the color has changed in the human body region, it can be determined that the user is out of the defense range.

  The notification system according to still another aspect of the present invention may further include a defense area setting unit that sets a defense area corresponding to the defense range in the image captured by the imaging unit, and the protrusion determination unit is configured by the imaging unit. Even if it is determined whether or not the user protrudes from the defense range by whether or not the human body region detected by the human body region detection unit protrudes from the defense region set by the defense region setting unit in the captured image Good. In this case, when the human body region protrudes from the defense region in the image, it can be determined that the user protrudes from the defense range.

  The imaging unit may image a direction from the umbrella-shaped device toward the user. In this case, the status of the defense range of the umbrella-shaped device can be monitored from the image captured by the imaging unit, and the position of the user with respect to the umbrella-shaped device can be easily grasped.

  The notification system according to still another aspect of the present invention may further include a detection unit that detects the start and end of use of the umbrella device, and the imaging unit detects the start of use of the umbrella device by the detection unit. Until the end of use of the umbrella-shaped device is detected by the detecting means. In this case, since the image is captured only while the user is using the umbrella-shaped device, it is possible to prevent the image from being captured during an unnecessary period when the umbrella-shaped device is not used, and to prevent unnecessary notification.

  The notification means may notify advice for keeping the user in the defense range. In this case, by notifying the advice, the user can be made to recognize a specific action for staying within the defense range. As a result, the user can be prompted to stay within the defense range, and further exposure of the user can be suppressed.

  By the way, the present invention can be described as the invention of the notification system as described below, in addition to the invention of the notification system as described above. This is substantially the same invention only in different categories, and has the same operations and effects.

  That is, the notification method according to one aspect of the present invention is based on an imaging step of imaging a predetermined range including the protection range of the umbrella-shaped device for protecting the user, and the user based on the image captured in the imaging step. An overhang determination step for determining whether or not the area is out of the protection range, and a notification step for notifying the user that the user is out of the protection area in the overhang determination step when it is determined that the user is out of the protection area; .

  ADVANTAGE OF THE INVENTION According to this invention, when a user is exposed to the exposure thing, the further exposure can be suppressed.

It is a figure which shows an example in which the notification system which concerns on 1st Embodiment is used by the user. It is a block diagram which shows the function structure of the notification system of FIG. It is a hardware block diagram of the umbrella device of FIG. It is a hardware block diagram of the communication terminal of FIG. It is a figure for demonstrating an example of the human body area | region detection process performed by the notification system of FIG. It is a figure for demonstrating an example of the protrusion determination process performed by the notification system of FIG. It is a figure which shows an example of the information notified by the communication terminal of FIG. It is a flowchart which shows a series of processes performed by the notification system of FIG. It is a block diagram which shows the function structure of the notification system which concerns on 2nd Embodiment. It is a figure for demonstrating an example of the defense area | region setting process performed by the notification system of FIG. It is a figure which shows an example of a defense area | region. It is a figure for demonstrating an example of the protrusion determination process performed by the notification system of FIG. It is a figure which shows an example of the information notified by the communication terminal of FIG. It is a flowchart which shows a series of processes performed by the notification system of FIG.

  Hereinafter, an embodiment of the present invention will be described in detail with reference to the accompanying drawings. In the description of the drawings, the same reference numerals are used for the same or equivalent elements, and redundant descriptions are omitted.

[First Embodiment]
FIG. 1 is a diagram illustrating an example in which a notification system according to the first embodiment is used by a user. FIG. 2 is a block diagram illustrating a functional configuration of the notification system. As shown in FIG. 1 and FIG. 2, the notification system 10 includes an umbrella device 1 (umbrella device) and a communication terminal 2. This is a system for notifying the user U of the fact when it protrudes. Here, the protection range P is a range in which an exposed object can be protected by the umbrella device 1. For example, when the umbrella device 1 is a rain umbrella, it is a range in which rain can be protected by the umbrella device 1. Note that the exposed material is one that is prevented by the umbrella device 1 such as rain, snow, sunlight, or flame. In addition, the exposure of the user U to the exposed material is referred to as “exposure”, “exposure”, or the like.

  The umbrella device 1 is a device for defending the user U, and can capture an imaging range including the defense range P and has a function capable of transmitting image information of the captured image G to the communication terminal 2. It is an umbrella. Umbrella device 1 should just be an apparatus which can protect user U from an exposure thing, and is explained as a parasol in 1st Embodiment.

  The umbrella device 1 functionally includes an open / close detection unit 11 (detection unit), an imaging unit 12 (imaging unit), and a communication unit 13. The umbrella device 1 has, for example, a general umbrella shape having an umbrella cover 111, a shaft 112, and a handle 113, and is configured by hardware shown in FIG.

  FIG. 3 is a hardware configuration diagram of the umbrella device 1. As shown in FIG. 3, the umbrella device 1 physically includes a CPU (Central Processing Unit) 101, a RAM (Random Access Memory) 102 and a ROM 103 (Read Only Memory), a semiconductor memory, etc. It includes hardware such as an auxiliary storage device 104, a communication module 105 that is a data transmission / reception device such as Bluetooth, a sensor 106 that detects opening / closing of an umbrella, and a camera 107 that is an imaging device. When these components operate, each function of the umbrella device 1 shown in FIG. 2 is exhibited.

  The sensor 106 may detect the opening / closing of the umbrella by the operation of a framework moving mechanism for opening / closing the umbrella, or the operation of a switch for opening / closing the umbrella provided on the shaft 112 portion of the umbrella. Opening / closing may be detected. The camera 107 is provided, for example, in the vicinity of the apex inside the umbrella cover 111 so that the situation under the umbrella can be constantly monitored, and is arranged so as to be able to image the direction in which the shaft 112 extends from the umbrella cover 111. The camera 107 is fixed to, for example, a framework at the top of the umbrella. The camera 107 may include a lens that can capture a wide-angle range, such as a fisheye lens.

  Next, a functional configuration of the umbrella device 1 will be described with reference to FIG. The open / close detection unit 11 functions as a detection unit that detects the start and end of use of the umbrella device 1. That is, the open / close detection unit 11 detects that the umbrella device 1 is opened by the sensor 106 and detects that the umbrella device 1 is closed by the sensor 106. The open / close detection unit 11 transmits start information indicating the start of use of the umbrella device 1 and end information indicating the end of use of the umbrella device 1 to the imaging unit 12 and the communication unit 13.

  The imaging unit 12 is provided in the umbrella device 1 and functions as an imaging unit that captures a predetermined imaging range including the defense range P of the umbrella device 1 with the camera 107. The imaging unit 12 images the imaging range in a direction from the umbrella device 1 toward the user U, that is, in a direction along the shaft 112 from the vicinity of the inner center of the umbrella cover 111 of the umbrella device 1. The imaging unit 12 images the imaging range every predetermined time (for example, 10 seconds). This time may be preset in the imaging unit 12 or may be arbitrarily set by the communication terminal 2. The imaging unit 12 turns on the camera 107 in response to receiving start information from the open / close detection unit 11 and turns off the camera 107 in response to receiving end information from the open / close detection unit 11. To do.

  As described above, the imaging unit 12 captures an imaging range from when the opening / closing detection unit 11 detects the start of use of the umbrella device 1 to when the opening / closing detection unit 11 detects the end of use of the umbrella device 1. . That is, the imaging unit 12 captures the imaging range at predetermined time intervals during the period of use of the umbrella device 1 from the reception of the start information from the opening / closing detection unit 11 to the reception of the end information from the opening / closing detection unit 11. To do. Then, the imaging unit 12 transmits image information indicating the captured image G to the communication terminal 2 via the communication unit 13.

  The communication unit 13 functions as a communication unit that performs communication with the communication terminal 2. The communication unit 13 communicates with the communication terminal 2 by proximity communication such as Bluetooth. The communication unit 13 connects to the communication terminal 2 in response to receiving the start information from the open / close detection unit 11 and starts communication with the communication terminal 2. In addition, the communication unit 13 ends the communication with the communication terminal 2 in response to receiving the end information from the open / close detection unit 11. For example, the communication unit 13 transmits image information of the image G captured by the imaging unit 12 to the communication terminal 2.

  The communication terminal 2 is a device that can notify the user U of information, and is, for example, a mobile phone such as a smartphone, a tablet terminal, or a notebook PC. Functionally, the communication terminal 2 includes a communication unit 21, a human body region detection unit 22 (human body region detection unit), a protrusion determination unit 23 (protrusion determination unit), and a notification unit 24 (notification unit). ing. Note that the communication terminal 2 may have a function included in a device such as a normal mobile phone or a tablet terminal in addition to the above function. The communication terminal 2 is configured by hardware shown in FIG.

  FIG. 4 is a hardware configuration diagram of the communication terminal 2. As shown in FIG. 4, the communication terminal 2 physically includes a CPU 201, a RAM 202 and a ROM 203 which are main storage devices, an auxiliary storage device 204 such as a semiconductor memory, a communication module 205 which is a data transmission / reception device such as Bluetooth, The hardware includes an input device 206 that is an input device, a display 207 for displaying information, a speaker 208 for outputting sound, and a vibrator 209 for vibrating the communication terminal 2. When these components operate, each function of the communication terminal 2 shown in FIG. 2 is exhibited.

  Next, the functional configuration of the communication terminal 2 will be described with reference to FIG. The communication unit 21 functions as a communication unit that performs communication with the umbrella device 1. The communication unit 21 starts communication with the umbrella device 1 in response to a request from the communication unit 13 and ends communication with the umbrella device 1 in response to a request from the communication unit 13. The communication unit 21 receives the image information transmitted from the umbrella device 1 and transmits the image information to the human body region detection unit 22 and the protrusion determination unit 23.

  The human body region detection unit 22 functions as a human body region detection unit that detects the human body region Rh where the human body of the user U in the image G is located based on the image G captured by the imaging unit 12. That is, the user U always moves within the imaging range, and the brightness and RGB information in the image G always change according to the color change of the background and the weather, so the color change on the human body of the user U or the color on the background It is necessary to determine whether it is a change. For this reason, the human body region detection unit 22 detects the human body region Rh by a known method, and identifies which region of the human body each region of the human body region Rh corresponds to.

  FIG. 5 is a diagram for explaining an example of the human body region detection process executed by the notification system 10. As shown in FIG. 5, the human body region detection unit 22 detects, for example, a human body region Rh, and detects a joint point J of the human body. Then, the human body region detection unit 22 detects the posture of the human body by tracking the joint point J over a plurality of images G. Note that the human body region detection unit 22 may distinguish between the human body region Rh in the image G and the background region such as the ground by using a device capable of distance measurement such as infrared rays.

  The protrusion determination unit 23 functions as an protrusion determination unit that determines whether or not the user U protrudes from the defense range P of the umbrella device 1 based on the image G captured by the imaging unit 12. The protrusion determination unit 23 determines, for example, whether or not the user U protrudes from the defense range P of the umbrella device 1 based on the human body region Rh detected by the human body region detection unit 22. Specifically, the protrusion determination unit 23 causes the user U to protrude from the defense range P due to a change in the color of the human body region Rh detected by the human body region detection unit 22 in two or more images G captured by the imaging unit 12. It is determined whether or not. The protrusion determination unit 23 uses, for example, two or more images G that are continuous when the images G are arranged in the order of the time taken, and compares the brightness of each region of the human body region Rh and the differences in RGB information in the two or more images G. Thus, it is determined whether or not the user U protrudes from the defense range P. The color change may be recognized by other known techniques.

  FIG. 6 is a diagram for explaining an example of the protrusion determination process executed by the notification system 10. For example, when a human body, clothes, bags, etc. are wetted by rain, the color changes (for example, black). Thereby, the protrusion determination part 23 specifies the wet part in the human body area | region Rh. For example, in the plurality of images G including (a) and (b) of FIG. 6, the protrusion determination unit 23 performs brightness and RGB for each region corresponding to each part of the human body region Rh detected by the human body region detection unit 22. The average value of information is calculated.

  And the protrusion determination part 23 compares each image G, and when the change of the brightness value of a certain area | region and the average value of RGB information differs from the change of the brightness value of another area | region and the average value of RGB information, it will be to the area | region. It is determined that the corresponding human body part is wet. Since clothes generally change to black when wet, the protrusion determination unit 23 may determine that the clothes are wet when the lightness reduction amount and the RGB information change amount threshold are exceeded. Although the threshold value for the lightness reduction amount and the threshold value for the change amount of the RGB information are set in advance in the protrusion determination unit 23, the threshold value may be arbitrarily set by the communication terminal 2. Thus, the protrusion determination part 23 detects the part determined to be wet among the human body area | region Rh as the protrusion area | region Rw.

  The notification unit 24 functions as a notification unit that notifies the user U that the user U protrudes from the defense range P when the protrusion determination unit 23 determines that the user U protrudes from the defense range P of the umbrella device 1. . For example, when the overhang determination unit 23 determines that the user U protrudes from the defense range P of the umbrella device 1, the notification unit 24 notifies the user U using a function such as voice or vibration. carry out. This notification is for notifying the user U that the user U is out of the defense range P.

  Further, the notification unit 24 may notify advice for keeping the user U within the defense range P of the umbrella device 1. FIG. 7 is a diagram illustrating an example of information notified by the communication terminal 2. As shown in FIG. 7, the notification unit 24 notifies the advice together with a wet location under the umbrella device 1 in bad weather, for example. Specifically, the notification unit 24 displays advice on the movement of the umbrella device 1 or the operation of the user U on the display 207 together with the image in which the protruding region Rw in which wetting has been detected is attached to the image G, thereby the user U The user is advised about the movement of the umbrella device 1 or the operation of the user U. This notification may be performed through software such as an application or a website.

  In addition, a sign such as a line serving as a mark is provided in advance on the umbrella cover 111 or the camera 107 of the umbrella device 1 so that the sign is parallel to the traveling direction of the user U during use of the umbrella device 1. The user U may hold the umbrella device 1. In this case, since the direction of the umbrella device 1 with respect to the user U is determined by the sign, the notification unit 24 can recognize the left and right direction of the user U in the image G and can give advice using the left and right direction.

  Next, a notification method that is a process executed by the notification system 10 will be described with reference to FIG. FIG. 8 is a flowchart showing a series of processes executed by the notification system 10. The process shown in FIG. 8 is periodically started in the umbrella device 1.

  First, the open / close detection unit 11 determines whether or not the umbrella device 1 has been opened by the user U (step S11). In Step S11, when it is determined that the umbrella device 1 is not opened (Step S11; No), Step S11 is repeated.

  On the other hand, when the user U opens the umbrella device 1 outdoors during bad weather or the like and it is determined in step S11 that the umbrella device 1 is opened (step S11; Yes), the imaging unit 12 sets the imaging range. Imaging is started (step S12: imaging step). At this time, communication between the umbrella device 1 and the communication terminal 2 is started by the communication unit 13 and the communication unit 21. That is, at the same time that the umbrella device 1 is opened, the camera 107 provided in the umbrella device 1 is activated and imaging by the imaging unit 12 is started, and the communication terminal 2 and the umbrella device 1 are connected by, for example, proximity communication. The Thereafter, starting from the time when the umbrella device 1 is opened, the imaging unit 12 captures an imaging range (here, the user U under the umbrella device 1) at regular intervals, and the image of the captured image G Information is transmitted from the umbrella device 1 to the communication terminal 2.

  Subsequently, the human body region detection unit 22 detects the human body region Rh from the image G, and specifies which region of the human body each region of the human body region Rh corresponds to (step S13: human body region detection step). ). Then, the open / close detection unit 11 determines whether or not the umbrella device 1 is closed by the user U (step S14).

  If it is determined in step S14 that the umbrella device 1 is not closed, the protrusion determination unit 23 determines whether the user U is wet (step S15: protrusion determination step). This determination is performed by, for example, a change in the color of the human body region Rh in two or more images G. If it is determined in step S15 that the user U is not wet (step S15; No), the determination in step S14 is performed again.

  On the other hand, when it determines with the user U getting wet in step S15 (step S15; Yes), notification is implemented by the notification part 24 (step S16: notification step). This notification is performed by voice or vibration. Subsequently, the notification unit 24 displays advice for keeping the user U within the defense range P of the umbrella device 1 on the display 207 of the communication terminal 2 (step S17: notification step). Then, after it is determined by the protrusion determination unit 23 that the user U has fallen within the defense range P, for example, by moving the umbrella device 1, the determination in step S14 is performed again.

  On the other hand, when it is determined in step S14 that the umbrella device 1 is closed (step S14; Yes), the imaging unit 12 stops imaging of the imaging range, and the communication unit 13 and the communication unit 21 communicate with the umbrella device 1 and the communication terminal. 2 is terminated, and a series of processing of the notification system 10 is terminated.

  Next, the effect of the notification system 10 will be described. According to the notification system 10, it is determined whether or not the user U protrudes from the defense range P using the image G obtained by imaging the imaging range including the defense range P of the umbrella device 1. Then, when it is determined that the user U protrudes from the defense range P, the user U is notified to that effect. Thereby, the user U can recognize that the user U protrudes from the defense range P. For example, when the user U protrudes from the defense range P when it rains, the user U gets wet in the rain, so that the user U recognizes that the user U protrudes from the defense range P. U can be urged to fall within the defense range P, and further exposure (wetting) of the user U can be suppressed. That is, since notification regarding wetness of clothes is performed during rain, it is possible to suppress the spread of wetness due to a part of the body of the user U protruding from the protection range P of the umbrella device 1. Become.

  Further, the notification system 10 can more reliably determine whether or not the user U protrudes from the defense range P by detecting the human body region Rh where the human body of the user U is located in the image G.

  For example, when the clothes and heels of the user U get wet due to rain, the colors of the clothes and heels change. For this reason, the notification system 10 can determine that the user U protrudes from the defense range P when there are portions of the human body region Rh whose color has changed in two or more images G.

  The imaging unit 12 images the direction from the umbrella device 1 toward the user U. For this reason, the situation of the defense range P of the umbrella device 1 can be monitored from the image G imaged by the imaging unit 12, and the position of the user U with respect to the umbrella device 1 can be easily grasped.

  In the notification system 10, the imaging range is imaged after the opening / closing detection unit 11 detects the start of use of the umbrella device 1 until the opening / closing detection unit 11 detects the end of use of the umbrella device 1. . For this reason, since imaging is performed only while the user U is using the umbrella device 1, imaging can be prevented during an unnecessary period when the umbrella device 1 is not used, and unnecessary notification can be prevented.

  Further, in the notification system 10, advice for keeping the user U within the defense range P is notified, so that the user U can recognize specific actions for staying within the defense range P. Thereby, it is possible to prompt the user U to be within the defense range P, and it is possible to suppress further exposure of the user U. For example, since the positional relationship between the umbrella device 1 and the user U is visually displayed on the display 207, the position of the umbrella device 1 can be accurately moved to the user U.

[Second Embodiment]
FIG. 9 is a block diagram illustrating a functional configuration of the notification system according to the second embodiment. As shown in FIG. 9, the notification system 10 </ b> A is different from the notification system 10 in that a communication terminal 2 </ b> A is provided instead of the communication terminal 2. Compared with the communication terminal 2, the communication terminal 2 </ b> A includes a protrusion determination unit 23 </ b> A (a protrusion determination unit) instead of the protrusion determination unit 23, and a notification unit 24 </ b> A (a notification unit) instead of the notification unit 24. And it is different by the point further provided with the defense area | region setting part 25 (defense area | region setting means).

The defense region setting unit 25 functions as a defense region setting unit that sets a defense region Rp corresponding to the defense range P in the image G captured by the imaging unit 12. The defense area setting unit 25 sets and registers the defense area Rp when the umbrella device 1 is used for the first time. For example, as shown in FIG. 10, a seal-like marker M is provided at the intersection of a plane including the periphery of the umbrella cover 111 of the umbrella device 1 and the shaft 112. The angle α formed by the shaft 112 and the line from the camera 107 toward the periphery of the umbrella cover 111 is determined by the angle of view of the camera 107. The length L1 of the line segment from the camera 107 to the marker M is obtained from the marker M. For this reason, the length L2 of the line segment from the periphery of the umbrella cover 111 to the marker M, which is the radius of the defense range P of the umbrella device 1, is obtained by the following equation (1).
L2 = L1 × tanα… (1)

  As shown in FIG. 11, the defense region setting unit 25 sets a region obtained by projecting a circle having the radius of the length L2 on the ground as a defense region Rp (a non-wetting range). For this reason, the imaging unit 12 captures an image so that the protection region Rp is included in the image G. Note that the height from the periphery of the umbrella cover 111 to the ground necessary for projection onto the ground may be calculated based on the height of the user U registered in advance, or may be set in advance based on the average height Good. Further, the distance from the periphery of the umbrella cover 111 to the ground may be measured using infrared rays or the like.

  In addition, the defense area setting unit 25 acquires identification information for identifying the umbrella device 1 from the umbrella device 1 and registers it together with the defense area Rp. If there is a history of using the umbrella device 1 in the past, the defense area setting unit 25 does not need to set the defense area Rp in advance because the defense area Rp is already registered.

  For example, the protection area setting unit 25 may set the protection area Rp by discriminating water droplets dripping from the periphery of the umbrella cover 111 of the umbrella device 1 in the image G. Moreover, although the defense area | region setting part 25 sets the defense area | region Rp flexibly according to the umbrella device 1, it is not restricted to this. A defense area Rp corresponding to the radius of the umbrella cover 111 of the umbrella device 1 is set in the defense area setting unit 25 in advance, and the radius of the umbrella cover 111 of the umbrella device 1 is previously set in the communication terminal 2 when the umbrella device 1 is used for the first time. The defense area Rp for the umbrella device 1 may be set.

  The protrusion determination unit 23A determines whether or not the human body region Rh detected by the human body region detection unit 22 protrudes from the defense region Rp set by the defense region setting unit 25 in the image G captured by the imaging unit 12. It is determined whether or not the user U protrudes from the defense range P. FIG. 12 is a diagram for explaining an example of the protrusion determination process executed by the notification system of FIG. As illustrated in FIG. 12, the protrusion determination unit 23 </ b> A determines whether or not the human body region Rh of the user U protrudes from the defense region Rp in the image G.

  When the protrusion determination unit 23A determines that the human body region Rh protrudes from the protection region Rp in the image G, the protrusion determination unit 23A determines that the user U protrudes from the protection range P. In the image G, the human body region Rh extends from the protection region Rp. When it is determined that it does not protrude, it is determined that the user U does not protrude from the defense range P. In this way, the protrusion determination unit 23A detects a part of the human body region Rh that is determined to protrude from the defense region Rp as the protrusion region Rw.

  Compared with the notification unit 24, the notification unit 24 </ b> A displays on the display 207 advice regarding movement of the umbrella device 1 or the operation of the user U, together with an image with the defense region Rp and the overhang region Rw attached to the image G. The point is different. FIG. 13 is a diagram illustrating an example of information notified by the communication terminal 2A. As shown in FIG. 13, the notification unit 24A notifies, for example, advice on how to move the umbrella device 1 in order to prevent the user U from getting wet, along with a portion that protrudes from the defense region Rp. To do. This notification may be performed through software such as an application or a website.

  Next, a notification method that is a process executed by the notification system 10A will be described with reference to FIG. FIG. 14 is a flowchart showing a series of processes executed by the notification system 10A. The process illustrated in FIG. 14 is periodically started in the umbrella device 1. Steps S21 and S22 are the same as steps S11 and S12 in FIG.

  Subsequent to step S22, the defense region setting unit 25 sets a defense region Rp corresponding to the defense range P in the image G (step S23: defense region setting step). Then, the human body region detection unit 22 detects the human body region Rh from the image G, and specifies which part of the human body each region of the human body region Rh corresponds to (step S24: human body region detection step). . Subsequently, the open / close detection unit 11 determines whether or not the umbrella device 1 is closed by the user U (step S25).

  When it is determined in step S25 that the umbrella device 1 is not closed, the protrusion determination unit 23A determines whether or not the user U protrudes from the defense range P of the umbrella device 1 (step S26: protrusion determination). Step). This determination is made based on whether or not the human body region Rh protrudes from the defense region Rp in the image G. In step S26, when it is determined that the user U does not protrude from the defense range P (step S26; No), the determination in step S25 is performed again.

  On the other hand, when it is determined in step S26 that the user U protrudes from the defense range P (step S26; Yes), notification is performed by the notification unit 24A (step S27: notification step). This notification is performed by voice or vibration. Subsequently, advice for putting the user U in the defense range P of the umbrella device 1 is displayed on the display 207 of the communication terminal 2 by the notification unit 24A (step S28: notification step). And after it determines with the protrusion determination part 23A having settled in the defense range P, for example by the user U moving the umbrella device 1, determination of step S25 is performed again.

  On the other hand, when it is determined in step S25 that the umbrella device 1 is closed (step S25; Yes), the imaging unit 12 stops imaging, and the communication unit 13 and the communication unit 21 communicate with the umbrella device 1 and the communication terminal. 2 is terminated, and a series of processes of the notification system 10A is terminated.

  Also in this notification system 10A, the same effects as in the first embodiment are exhibited. In the notification system 10 </ b> A, the defense region setting unit 25 sets the defense region Rp corresponding to the defense range P in the image G. Then, when the human body region Rh protrudes from the defense region Rp in the image G, it can be determined that the user U protrudes from the defense range P. In the notification system 10A, for example, when the user U protrudes from the defense range P at the time of rain, notification regarding the protrusion from the defense range P of the umbrella device 1 is performed, so that part of the body of the user U However, it is possible to suppress the spread of wetting due to the protrusion of the umbrella device 1 from the protection range P of the umbrella device 1. Further, since the positional relationship between the umbrella device 1 and the user U is visually displayed on the display 207 of the communication terminal 2, the position of the umbrella device 1 can be accurately moved to the user U.

  In addition, this invention is not limited to embodiment mentioned above. For example, in the above embodiment, the umbrella device 1 is described as a rain umbrella, but may be a parasol. In this case, the protrusion determination units 23 and 23A determine whether or not the user U is exposed to sunlight. The presence / absence of sunlight irradiation can be determined by the brightness and RGB information, or whether or not the human body region Rh protrudes from the defense region Rp, as in the above embodiment. Also, the presence / absence of sunlight irradiation can be determined based on a temperature difference.

  Moreover, the umbrella device 1 may be a wide variety of devices for protecting the user U, such as a tool used by the riot police, a tool for preventing flame radiation such as fire.

  Further, the camera 107 may have the function of the umbrella device 1 in the above-described embodiment. In this case, the camera 107 may be installed on the umbrella body before starting to use the normal umbrella. That is, the camera 107 is an independent type that can be attached to and detached from the umbrella body. If the camera 107 is installed in the umbrella body, the function of the umbrella device 1 can be implemented in a normal umbrella. Further, by making the camera 107 sufficiently small, the camera 107 can be always installed regardless of whether the umbrella device 1 is opened or closed.

  DESCRIPTION OF SYMBOLS 1 ... Umbrella device (umbrella-shaped apparatus) 2, 2A ... Communication terminal 10, 10A ... Notification system, 11 ... Opening / closing detection part (detection means), 12 ... Imaging part (imaging means), 22 ... Human body area | region detection part ( Human body region detection means), 23, 23A..., Protrusion determination unit (protrusion determination means), 24, 24A... Notification portion (notification means), 25... Defense area setting portion (defense area setting means), G. Range, Rh ... human body region, Rp ... defense region, U ... user.

Claims (8)

An imaging unit provided in an umbrella-shaped device for protecting a user, and imaging a predetermined range including a defense range of the umbrella-shaped device;
Based on the image picked up by the image pickup means, the protrusion determination means for determining whether or not the user protrudes from the defense range;
A notification means for notifying the user that the user is out of the defense range, if the user determines that the user is out of the defense range;
A notification system comprising: Further comprising a human body region detecting means for detecting a human body region where the human body of the user in the image is located based on an image picked up by the image pickup means;
The notification system according to claim 1, wherein the protrusion determination unit determines whether or not the user protrudes from the defense range based on the human body region detected by the human body region detection unit. The imaging means images the predetermined range every predetermined time;
The protrusion determination unit determines whether or not the user protrudes from the defense range based on a change in color of the human body region detected by the human body region detection unit in two or more images captured by the imaging unit. The notification system according to claim 2. A defense area setting means for setting a defense area corresponding to the defense range in the image captured by the imaging means;
The protrusion determination unit is configured to determine whether the human body region detected by the human body region detection unit protrudes from the defense region set by the defense region setting unit in the image captured by the imaging unit. The notification system according to claim 2, wherein it is determined whether or not a user is out of the defense range.   The notification system according to any one of claims 1 to 4, wherein the imaging unit images a direction from the umbrella-shaped device toward the user. It further comprises detection means for detecting the start and end of use of the umbrella device,
The imaging unit images the predetermined range from when the detection unit detects the start of use of the umbrella-shaped device to when the detection unit detects the end of use of the umbrella-shaped device. The notification system according to any one of claims 1 to 5.   The notification system according to any one of claims 1 to 6, wherein the notification unit notifies an advice for keeping the user in the defense range. An imaging step of imaging a predetermined range including a protection range of an umbrella-shaped device for protecting a user;
A protrusion determination step for determining whether or not the user protrudes from the defense range based on the image captured in the imaging step;
A notification step of notifying the user that the user is out of the defense range when it is determined that the user is out of the defense range,
A notification method comprising:

Images