JP2021135795A - Portable terminal for person to be watched and watching system - Google Patents

Abstract

To determine that some abnormality may occur if a person to be watched is apart from an area at which he/she resides and to make a watching person exactly grasp a situation of the person to be watched.SOLUTION: A portable terminal for a person to be watched determines that some abnormality may occur at a person to be watched if a time ΔT at which present position information DL showing a present position of a person to be watched is determined to be out of a registration area, is in excess of a predetermined threshold time Tt, and notifies the person to be watched and surrounding persons of warning, generates warning information Da including the present position information DL of the person to be watched and surrounding image information DG and transmits the warning information to a watching server 14 through a network 18.SELECTED DRAWING: Figure 1

Description

The present invention relates to a mobile terminal for a person to be watched over and a watching system.

A technology has been proposed in which the position information of a person to be watched over, such as a child, is grasped by GPS, and when the person to be watched away from the area where the person to be watched is normally located, it is determined that some abnormality has occurred and a warning is issued. There is.
For example, Patent Document 1 states that there is a possibility of abnormality when the position information of the GPS terminal carried by the person to be watched does not satisfy the determination condition consisting of the logical condition consisting of a plurality of preset areas and time zones. A monitoring system has been proposed that determines and issues a warning.

Japanese Unexamined Patent Publication No. 2015-114863

However, in the above-mentioned prior art, although it is possible to determine an abnormality based on the position information of the person to be watched and the judgment conditions, there is no particular consideration for grasping the situation around the person to be watched, and some improvement is required. There is.
The present invention has been made in view of such circumstances, and an object of the present invention is to determine that there is a high possibility that some abnormality has occurred when the person to be watched away from the area where the person to be watched is normally located, and the watcher It is an object of the present invention to provide an advantageous mobile terminal for a person to be watched and a watching system for accurately grasping the situation of the person to be watched.

In order to achieve the above-mentioned object, the present invention is a mobile terminal possessed by a person to be watched over, a positioning unit that acquires current position information based on a positioning signal from a positioning satellite, and a vicinity of the person to be watched. An imaging unit that captures images and generates peripheral image information, a map database that stores map information, and a registration area registered in advance on the map information, and the current position information acquired by the positioning unit. When the position determination unit for determining whether or not is within the registration area and the time when the current position information is determined to be outside the registration area by the position determination unit exceeds a predetermined threshold time. The abnormality determination unit that determines that there is a high possibility that some abnormality has occurred in the monitoring target person, and the monitoring target person and the surroundings when the abnormality determination unit determines that there is a high possibility that an abnormality has occurred. The mobile phone when it is determined by the warning notification unit that notifies the warning, the communication unit on the mobile terminal side that is configured to be able to communicate with the server via the network, and the abnormality determination unit that there is a high possibility that an abnormality has occurred. The mobile terminal identification information of the terminal, the current position information acquired by the positioning unit, and the peripheral image information are associated with each other to generate warning information, and the warning information is transmitted by the mobile terminal side communication unit via the network. It is characterized by including a warning information generation unit to be transmitted to the server.
Further, the present invention is a monitoring system including a monitoring target person mobile terminal possessed by the monitoring target person and a monitoring server configured to be able to communicate with the monitoring target person mobile terminal, wherein the monitoring target person mobile terminal is , A positioning unit that acquires the current position information based on the positioning signal from the positioning satellite, an imaging unit that images the surroundings of the person to be watched and generates peripheral image information, and stores the map information and the map information. The map database in which the registration area predetermined above is registered, the position determination unit for determining whether or not the current position information acquired by the positioning unit is within the registration area, and the position determination unit When the time when the current position information is out of the registration area exceeds a predetermined threshold time, an abnormality determination unit that determines that there is a high possibility that some abnormality has occurred in the monitoring target person, and an abnormality determination unit. It is configured to be able to communicate with the monitoring server via a network and a warning notification unit that notifies the monitoring target person and the surroundings of a warning when the abnormality determination unit determines that an abnormality is likely to have occurred. When it is determined by the communication unit on the mobile terminal side and the abnormality determination unit that there is a high possibility that an abnormality has occurred, the mobile terminal identification information of the mobile terminal, the current position information acquired by the positioning unit, and the current position information. The monitoring server includes a warning information generation unit that generates warning information associated with the peripheral image information and transmits the warning information to the watching server via the network by the mobile terminal side communication unit. An identification information recording unit that records the mobile terminal identification information in association with the watcher's mobile terminal identification information, which is the identification information of the watcher's mobile terminal, and the watch server-side communication that communicates via the network. The mobile terminal side communication unit, the browsing information generation unit that generates browsing information based on the warning information transmitted from the mobile terminal side communication unit to the watching server side communication unit, and the URL information necessary for browsing the browsing information. The URL information generation unit to be generated and the alert information including the URL information generated by the URL information generation unit are generated, and the watcher mobile terminal associated with the mobile terminal identification information included in the warning information. The identification information is specified from the identification information recording unit, and the alert information is transmitted to the watcher terminal corresponding to the specified watcher mobile terminal identification information via the network by the watch server side communication unit. It is characterized by having an alert information generation unit. ..

According to the mobile terminal of the present invention, when the current position information indicating the current position of the person to be watched exceeds the predetermined threshold time when the time determined to be outside the registration area is exceeded, some abnormality is found in the person to be watched. It is determined that there is a high possibility that this has occurred, a warning is sent to the person being watched over and the surrounding area, and warning information including the current position information of the person being watched over and surrounding image information is generated and sent to the server via the network. I tried to send it.
Therefore, when the person to be watched has moved away from the registered area, a warning can be sent to alert the person to be watched and those who are present in the vicinity. Therefore, the person being watched over can take measures such as returning to the registered area by himself / herself, asking for help from a person present in the vicinity, or having the person being watched over protect the person being watched over. It is advantageous in protecting the target person. Alternatively, even if the person to be watched is about to be taken away by the suspicious person, it can be expected that the suspicious person will notice the warning notification and leave from the vicinity of the person to be watched by himself / herself.
In addition, the watcher who watches over the person to be watched can grasp the current position information and the surrounding image information of the person to be watched by obtaining the warning information from the server using a general-purpose terminal such as a smartphone, so that the person to be watched can be watched at an early stage. It is advantageous in taking actions to protect the.
Further, the watching system of the present invention includes a watching target person's mobile terminal and a watching server, and the watching server generates browsing information based on the warning information transmitted from the watching target person's mobile terminal and browses the browsing information. Generates the URL information necessary for the purpose, identifies the watcher mobile terminal identification information associated with the mobile terminal identification information included in the warning information, and sends the URL to the watcher terminal corresponding to the specified watcher mobile terminal identification information. The alert information including the URL information generated by the information generation unit is transmitted via the network.
Therefore, when it is determined that there is a high possibility that an abnormality has occurred in the person to be watched, the watcher can access the watch server using the watcher's mobile terminal and check the browsing information. It is advantageous to accurately grasp the situation of the person and take appropriate actions to protect the person being watched over.

It is a block diagram which shows the structure of the monitoring target person mobile terminal and the monitoring system which concerns on 1st Embodiment. It is explanatory drawing of the registration area set on the map information. It is explanatory drawing which shows the data structure of warning information. It is explanatory drawing of the mobile terminal identification information and the watcher mobile terminal identification information recorded in the identification information recording part of the watching server. It is explanatory drawing which shows the data structure of browsing information. It is explanatory drawing which shows an example of the position identification map information included in browsing information. It is a flowchart explaining the operation of the monitoring target person mobile terminal and the monitoring system. It is explanatory drawing which shows the structure of the monitoring target person mobile terminal which concerns on 2nd Embodiment.

(First Embodiment)
Next, the mobile terminal and the watching system according to the embodiment of the present invention will be described.
First, the person to be watched over and the person to be watched over will be explained.
The person to be watched over is, for example, a person to be watched over, such as an infant or a child.
A watcher is a guardian who should watch over the person to be watched and take actions to protect the watcher when a suspicious person approaches the person to be watched, for example, a parent, a nursery teacher, or a teacher. , The person in charge of the facility, etc.
It should be noted that the persons to be watched over are not limited to infants and children, and it goes without saying that they include various conventionally known people who need to be watched over, such as elderly people and sick people who are admitted to facilities such as long-term care facilities and hospitals. ..

As shown in FIG. 1, the watching system 10 includes a watching target person's mobile terminal 12 and a watching server 14.
The watch target person mobile terminal 12 is a terminal owned by the watch target person, and is configured to be able to communicate with the watch server 14 via the network 18. Further, the terminal possessed by the watcher is referred to as a watcher mobile terminal 16.
The watching server 14 is configured to be able to communicate with the watching target person's mobile terminal 12 and the watching person's mobile terminal 16 via the network 18.
Here, the watcher mobile terminal 16 may be a general-purpose mobile terminal, for example, a terminal capable of communicating via a network 18 such as a mobile phone, a smartphone, a tablet terminal, or a personal computer, and may include character information, a moving image, a still image, and the like. It is equipped with a display that displays image information including, a speaker that generates sound, and operation units such as a keyboard and a touch panel.

First, the mobile terminal 12 for the person to be watched over will be described.
The monitoring target person mobile terminal 12 includes a positioning unit 20, an imaging unit 22, a voice acquisition unit 24, a mobile terminal side communication unit 26, a computer 28, a speaker 30, a vibrator 32, a lamp 34, and an operation unit. 36, a display unit 38, and the like are included, and each of these units is incorporated in a single housing 12A.
In the mobile terminal 12 of the person to be watched, for example, the person to be watched can hang the housing 12A from the neck via a neck strap, or the person to be watched can store the housing 12A in the pocket of the clothes of the person to be watched. I have a cell phone.

The positioning unit 20 acquires the current position information of the watch target person mobile terminal 12, that is, the current position information including the latitude and longitude, based on the positioning signal from the positioning satellite.
As the positioning satellite, various conventionally known positioning satellites such as GPS satellites can be used.

The imaging unit (camera) 22 captures the periphery of the person to be watched, generates peripheral image information, and supplies the peripheral image information to the computer 28.
The peripheral image information may be a moving image or a plurality of still images taken at predetermined time intervals along a time series, but the situation around the person to be watched can be accurately grasped. Above, it is preferable that the peripheral image information is a moving image.
From the viewpoint of acquiring peripheral image information in a wide range around the person to be watched, the imaging unit 22 preferably includes an imaging optical system having a wide angle of view, such as a wide-angle lens or a fisheye lens.

The voice acquisition unit (microphone) 24 detects the voice around the person to be watched, generates voice information, and supplies the voice information to the computer 28.
The mobile terminal side communication unit 26 is configured to be able to communicate with the monitoring server 14 described later via various conventionally known networks 18 such as a public line and the Internet.
The display unit 38 includes a display screen for displaying images, characters, and the like, and is composed of a conventionally known display device such as a liquid crystal display or an EL display.
Further, the display unit 38 is configured to be able to display map information stored in the map database 28A, which will be described later.
The operation unit 36 gives an instruction to the computer 28 by accepting a manual operation.
In the present embodiment, the operation unit 36 is configured to include a touch panel provided on the display surface of the display unit 38, and therefore the display unit 38 is configured as a touch panel display.
The operation unit 36 may include a push button switch or the like provided separately from the touch panel.
Further, as will be described later, the operation unit 36 accepts an operation of setting a registration area on the map information displayed on the display unit 38.

The computer 28 includes a CPU, a ROM that stores and stores a control program, a RAM as an operating area of the control program, an interface unit that interfaces with peripheral circuits, and the like.
When the CPU executes the control program, the computer 28 includes a map database 28A, a registration unit 28B, a position determination unit 28C, an abnormality determination unit 28D, a peripheral image information recording unit 28E, a voice information recording unit 28F, and a warning notification unit 28G. It functions as a warning information generation unit 28H.

The map database 28A stores map information and registers a predetermined registration area on the map information.
The registered area usually indicates an area where the person to be watched is likely to be located. For example, if the person to be watched is a child who goes to kindergarten or school, the child goes to kindergarten, goes to school, or goes home. It includes roads (school roads) that pass through, railroad tracks that are used, roads that buses are used for, and commercial facilities such as parks, friends' houses, and stores where children are likely to stop by. Includes facilities, public facilities such as children's halls, etc.
The map information includes a registered area and a wide range surrounding the registered area.

The registration unit 28B registers the registration area set by the operation unit 36 in the map database 28A.
Specifically, in a state where the map information is displayed on the display unit 38, for example, the watcher who is the parent of the watch target person operates the touch panel and touches the part corresponding to the registration area with his / her finger. The registration unit 28B registers the registration area set by tracing the outline of the area in the map database 28A.
Such an operation on the operation unit 36 is performed in the same manner as the operation of a touch panel of a conventionally known smartphone or tablet terminal, for example.
That is, as shown in FIG. 2, by operating the operation unit 36, the display screen 3802 of the display unit 38 includes, for example, the home P1 of the person being watched over and the school P0 attending school by the person being watched over. Display map information Dm.
When registering the registration area Ar in this state, as shown by the alternate long and short dash line in the figure, the registration area Ar may be input by performing an operation of tracing the outline of the area with a finger on the touch panel.
The registration area Ar to be actually registered may be a wide range including the home P1, the school P0, and the school route L in consideration of the action range of the person to be watched over. It may include a friend's house, commercial facilities such as stores, and public facilities such as children's halls.
Further, the registration area Ar is not limited to one, and a plurality of registration areas Ar can be registered.
For example, in order to move between home P1 and school P0 on weekdays, the registration area including the school route L and school P0 is registered as a registration area for weekdays, and on holidays, the home P1, friend's house, and park In order to move between them, the registration area including the home P1, the friend's house, the park, and the road between them is registered as the registration area for holidays, and the registration area is set corresponding to each of weekdays and holidays. You may register.
Alternatively, when going on a trip or the like, a registration area may be appropriately set and registered at the travel destination.

The position determination unit 28C determines whether or not the current position information DL acquired by the positioning unit 20 is in the registration area Ar.
That is, the position determination unit 28C constantly compares the current position information DL acquired by the positioning unit 20 with the registration area Ar registered in the map database 28A, and the current position information DL is in the registration area Ar. Whether or not it is always judged.
Therefore, the watch target person who possesses the watch target person mobile terminal 12 gets lost and moves to a place outside the registration area Ar, or is taken away by a suspicious person and moves to a place outside the registration area Ar. If this happens, the position determination unit 28C determines that the current position information DL is out of the registration area Ar.

When the time ΔT at which the current position information DL is determined to be outside the registration area Ar by the position determination unit 28C exceeds the predetermined threshold time Tt, the abnormality determination unit 28D causes some abnormality in the watch target person. It is judged that there is a high possibility that it has been done.
If the time ΔT at which the current position information DL is determined to be outside the registered area Ar is equal to or less than the threshold time Tt, even if the person to be watched loses his / her way, he / she immediately returns to the registered area Ar. It is unlikely that an abnormality has occurred.
On the other hand, when the time ΔT determined that the current position information DL is outside the registered area Ar exceeds the predetermined threshold time Tt, the person to be watched cannot return to the registered area Ar for some reason, or It is highly probable that an abnormality has occurred because it is assumed that the person was taken away by a suspicious person.
The threshold time Tt may be set to a fixed value in advance, but if the operation unit 36 can arbitrarily input and set the threshold time Tt, the action range according to the age of the person to be watched is taken into consideration. It is preferable that the threshold time Tt can be set.
For example, if you are an age such as a kindergarten child or a lower grade of elementary school, the range of action is narrow, so if you are away from the registered area Ar even for a short time, it is important to judge early that there is a possibility of abnormality. It is advantageous in surely determining the possibility of occurrence of an abnormality related to the subject. Therefore, in this case, it is preferable to set the threshold time Tt to a short time.
On the other hand, if you are in the upper grades of elementary school or above, the range of action is wide, so it is important not to judge that there is a possibility of abnormality even if you are away from the registered area Ar for a certain amount of time. It is advantageous in preventing the judgment of. Therefore, in this case, it is preferable to set the threshold time Tt to a long time.

The peripheral image information recording unit 28E records the peripheral image information captured by the imaging unit 22, and the peripheral image information recording unit 28E defines the peripheral image information recorded in the peripheral image information recording unit 28E in advance. When the first upper limit recording capacity ST1 is reached, the peripheral image information recorded in the peripheral image information recording unit 28E is overwritten and recorded.
Therefore, the peripheral image information recording unit 28E always holds the peripheral image information of T1 corresponding to the first upper limit recording capacity ST1 for a certain period of time.
Further, the peripheral image information recording unit 28E records from the first time point when the abnormality determination unit 28D determines that the abnormality is likely to have occurred to the second time point which goes back to the first predetermined time T1. Overwriting of the peripheral image information may be prohibited, and the peripheral image information may be recorded from the first time point onward until the third time point when the remaining recording capacity is exhausted.
This is similar to the event recording of the so-called drive recorder, and records the peripheral image information for a predetermined time before and after the event (determination by the abnormality determination unit 28D that there is a possibility of abnormality), as if the event were recorded. The function is as if the peripheral image information is recorded retroactively to the time before the event occurred.
In this way, while suppressing the recording capacity of the peripheral image information recording unit 28E, the time before and after the first time point when the abnormality determination unit 28D determines that there is a possibility of abnormality (first predetermined time T1 + second predetermined time). This is advantageous in reliably recording the peripheral image information of T2).

The voice information recording unit 28F records the voice information generated by the voice acquisition unit 24, and the voice information recording unit 28F has a second voice information recording unit 28F in which the voice information recorded in the voice information recording unit 28F is predetermined. When the upper limit recording capacity ST2 is reached, the voice information recorded in the voice information recording unit 28F is overwritten and recorded.
Therefore, the voice information recording unit 28F always holds the voice information of T2 for a certain period of time corresponding to the second upper limit recording capacity ST2.
In the present embodiment, the peripheral image information recorded in the peripheral image information recording unit 28E for a certain period of time T1 and the audio information recorded in the audio information recording unit 28F for a certain period of time T2 are the same.
The voice information recording unit 28F is the voice recorded from the first time point to the fourth time point which goes back to the third predetermined time T3 at the first time point when the abnormality determination unit 28D determines that the abnormality is likely to occur. Overwriting of the information may be prohibited, and the voice information may be recorded from the first time point onward until the fifth time point when the remaining recording capacity is exhausted.
This records audio information for a predetermined time before and after an event (determination by the abnormality determination unit 28D that there is a possibility of abnormality), as in the case of the peripheral image information recording unit 28E described above. The function is as if the voice information is recorded retroactively to the time before the event occurred.
In this way, while suppressing the recording capacity of the voice information recording unit 28F, the voice information of the time before and after the first time point (third predetermined time T3 + fourth predetermined time T4) when the mismatch of the face image information is determined is obtained. It is advantageous for reliable recording.
In order to synchronize the recording time of the audio information with the recording time of the peripheral image information, the first predetermined time T1 = the third predetermined time T3 and the second predetermined time T2 = the fourth predetermined time T4 may be set.

The warning notification unit 28G notifies the monitoring target person and the surroundings of a warning when it is determined by the abnormality determination unit 28D that there is a high possibility that an abnormality has occurred.
In the present embodiment, the warning notification by the warning notification unit 28G is performed in the following three types.
1) The warning notification unit 28G drives the vibrator 32, and the vibration generated causes the warning to be watched and notified to the target person.
2) The warning notification unit 28G drives the speaker 30 to generate a warning sound to notify the warning target person, a person located around the watching target person, and a suspicious person.
The warning sound is preferably a buzzer sound similar to a commercially available security buzzer, a siren sound, or the like, and a volume and tone that can be clearly heard by the person to be watched over, the person located around the person to be watched over, or a suspicious person.
In addition, as a warning sound, a warning sound that utters in a language a content that calls attention to the target person and a person located in the vicinity of the watching target person may be used. In this case, it is preferable that the warning voice has a content and volume that can be clearly heard by the person to be watched, a person located around the person to be watched, or a suspicious person.
3) The warning notification unit 28G turns on or blinks the lamp 34 to notify the person who is watching the warning, the person who is in the vicinity of the person who is watching, or the suspicious person.
The emission color of the lamp 34 is preferably a color and an amount of light such as red or orange so that the warning can be clearly visually recognized.
The vibrator 32, the speaker 30, and the lamp 34 may be used at the same time to notify the warning, or any one of the three or two of the three may be used to leave the warning unattended. Of course, the good thing is.

When it is determined by the abnormality determination unit 28D that there is a high possibility that an abnormality has occurred, the warning information generation unit 28H has the mobile terminal identification information IDa of the monitoring target person mobile terminal 12 and the positioning unit, as shown in FIG. A warning information Da that associates the current position information DL, the peripheral image information DG, and the voice information DS acquired in 20 is generated, and the generated warning information Da is monitored by the mobile terminal side communication unit 26 via the network 18. It is to be transmitted to 14.
The mobile terminal identification information IDa is information for uniquely identifying the mobile terminal 12 of the person to be watched over.
Further, the peripheral image information DG included in the warning information Da is a part or all of the peripheral image information DG recorded in the peripheral image information recording unit 28E.
Further, the voice information DS included in the warning information Da is a part or all of the voice information DS recorded in the voice information recording unit 28F.
Further, the warning information generation unit 28H may generate the warning information Da including the registration area Ar registered on the map information of the map database 28A, and send the generated warning information Da to the server 14 by watching over it. good.

Next, the watching server 14 will be described.
As shown in FIG. 1, the monitoring server 14 includes an identification information recording unit 40, a monitoring server-side communication unit 42, a browsing information generation unit 44, a URL information generation unit 46, and a warning information generation unit 48. It is composed of.
As shown in FIG. 4, the identification information recording unit 40 records the mobile terminal identification information IDa of the watch target person mobile terminal 12 and the watcher mobile terminal identification information IDb, which is the identification information of the watcher mobile terminal 16, in association with each other. Is what you do.
The watcher mobile terminal identification information IDb is information for uniquely identifying the watcher mobile terminal 16.
As illustrated in FIG. 4, the identification information recording unit 40 is associated with the mobile terminal identification information IDa1, IDa2, IDa3, IDa4 ... And the watcher mobile terminal identification information IDb1, IDb2, IDb3, IDb4 ... It has been recorded.

The watching server side communication unit 42 communicates with the watching target person's mobile terminal 12 and the watching person's mobile terminal 16 via the network 18.

The browsing information generation unit 44 generates a web page as browsing information based on the warning information Da transmitted from the mobile terminal side communication unit 26 to the monitoring server side communication unit 42 via the network 18.
Here, as described in FIG. 3, the warning information Da associates the monitoring target person mobile terminal identification information IDa, the current position information DL acquired by the positioning unit 20, the peripheral image information DG, and the voice information DS. Information.
As shown in FIG. 5, in the present embodiment, the browsing information Dw generated by the browsing information generation unit 44 includes the following information.
(1) Mobile terminal identification information IDa of the mobile terminal 12 of the person to be watched over
(2) Location-specific map information DP that displays the position specified by the current location information DL on the map.
(3) Peripheral image information DG
(4) Voice information DS
Of the browsing information Dw, the mobile terminal identification information IDa, the position identification map information DP, and the peripheral image information DG are generated in a form that can be displayed on the display 1602 (FIG. 6) of the watcher mobile terminal 16. The mobile terminal identification information IDa of the watch target person mobile terminal 12 may be omitted from the browsing information Dw, but if the browsing information Dw includes the mobile terminal identification information IDa, the watch target person mobile terminal 12 There is an advantage that it is possible to clearly see that the warning information Da has been transmitted.
Further, among the browsing information Dw, the voice information DS is generated in a form that can be reproduced by the speaker of the watcher mobile terminal 16.
As shown in FIG. 6, the position-specific map information DP displayed on the display screen of the display 1602 of the watcher mobile terminal 16 is the position specified by the icon IC on the map (the position specified by the current position information DL). It is composed of the image information showing.
In addition, as described above, when the registration area Ar is included in the warning information Da, the registration area Ar may be included in the browsing information Dw generated by the browsing information generation unit 44. In that case, it is shown in FIG. As described above, the registered area Ar can be displayed on the position-specific map information DP. Therefore, it is advantageous for confirming the position-specific map information DP while visually recognizing the registered area Ar.

The URL information generation unit 46 generates URL information necessary for browsing the browsing information Dw (web page).
The alert information generation unit 48 generates the alert information including the URL information generated by the URL information generation unit 46, and the watcher mobile terminal identification information associated with the mobile terminal identification information IDa included in the alert information Da. The IDb is specified from the identification information recording unit 40, and the alert information is transmitted to the watcher mobile terminal 16 corresponding to the specified watcher mobile terminal identification information IDb via the network 18 by the watching server side communication unit 42. Is.
The URL information is composed of a character string such as "http://abc.def.jp/xyz".
In addition to the URL information, the alert information may include warning comment information indicating that the person to be watched is away from the registration area Ar and that some abnormality may have occurred.
In this way, the watcher visually recognizes the warning comment information displayed on the watcher mobile terminal 16, which is advantageous for the watcher to browse the browsing information Dw without overlooking it.

Next, the operation of the watching system 10 and the watching target person's mobile terminal 12 will be described with reference to the flowchart of FIG.
Explaining by diverting FIG. 2, the registration area Ar is registered on the map information Dm stored in the database.
Further, as shown in FIG. 4, the identification information recording unit 40 of the monitoring server 14 identifies the mobile terminal identification information IDa: IDa1, IDa2, IDa3, IDa4, etc. of the mobile terminal 12 of the monitoring target person. Information IDb: IDb1, IDb2, IDb3, IDb4 ... Are registered in association with each other.
Further, the watching target person possesses the watching target person mobile terminal 12, and the watching target person mobile terminal 12 is in a state where the imaging unit 22 can generate the peripheral image information DG and the voice acquisition unit 24 can acquire the voice information DS. It has become.
As shown in FIG. 2, in the following example, the person to be watched is a child, and the park P2 exists on the school route L indicated by the broken line connecting the school P0 and the home P1, and the person to be watched is the school route. The case where the watcher is moving along the L on foot, while the watcher is waiting for the watcher to return home at his / her home P1 will be described.

The person to be watched starts moving from the school P0 to the home P1 while carrying the mobile terminal 12 of the person to be watched (step S10).
In the monitoring target person mobile terminal 12, the peripheral image information DG of the monitoring target person generated by the imaging unit 22 is recorded while being overwritten by the peripheral image information recording unit 28E, and the time corresponding to the first upper limit recording capacity ST1. Peripheral image information DG is recorded in the peripheral image information recording unit 28E (step S12).
Further, in the watch target person mobile terminal 12, the voice information DS around the watch target person acquired by the voice acquisition unit 24 is recorded while being overwritten by the voice information recording unit 28F, and the second upper limit recording capacity ST2. The voice information DS of the time corresponding to the above is recorded in the voice information recording unit 28F (step S14).
Further, the position determination unit 28C compares the current position information DL acquired by the positioning unit 20 with the registration area Ar registered in the map database 28A, and determines whether or not the current position information DL is in the registration area Ar. Is always determined (step S16).
If step S16 is affirmative, the person to be watched is located in the registered area Ar (moving in the registered area Ar), so the process returns to step S16.
If step S16 is negative, the abnormality determination unit 28D determines whether or not the time ΔT determined by the position determination unit 28C that the current position information DL is outside the registration area Ar exceeds the predetermined threshold time Tt. (Step S18).
If the determination result in step S18 is negative, the process returns to step S16. At this time, the person to be watched returns from outside the registered area Ar to inside the registered area Ar.
If the determination result in step S18 is affirmative, the abnormality determination unit 28D determines that there is a high possibility that some abnormality has occurred in the watching target person (step S20).
Therefore, the warning notification unit 28G notifies the person to be watched and the person present in the vicinity of the warning (step S22). The warning is notified by the vibration of the vibrator 32, the generation of the warning sound from the speaker 30, the lighting of the lamp 34, the extinguishing of the lamp, and the like.

Here, if the person to be watched makes a mistake, the warning notification of the warning notification unit 28G causes the person to be watched to notice that he / she has left the registered area Ar, so that the correct commuting route L can be obtained. You can go back. Alternatively, the person being watched over can seek help from someone who is around him.
Alternatively, when a suspicious person is trying to take away the person to be watched, the person who is present in the vicinity of the person to be watched visually sees that the warning is notified from the mobile terminal 12 of the person to be watched carried by the person to be watched. Since it can be grasped objectively or audibly, it is necessary to pay attention to the person to be watched and the suspicious person on the side of the person to be watched, so that the person who is present in the vicinity of the person to be watched can protect the person to be watched. It is advantageous in encouraging action. Alternatively, it can be expected that the suspicious person will notice the warning notification and will watch over himself and leave the vicinity of the target person.

Further, when the warning information generation unit 28H determines that the abnormality determination unit 28D has a high possibility that some abnormality has occurred in the monitoring target person, as shown in FIG. 3, the monitoring target person's mobile terminal 12 is carried. The terminal identification information IDa, the current position information DL acquired by the positioning unit 20, the peripheral image information DG, and the voice information DS are associated with each other to generate the warning information Da, and the warning information Da is transmitted to the network 18 by the mobile terminal side communication unit 26. It is transmitted to the watching server 14 via the above (step S24).

The browsing information generation unit 44 of the watching server 14 generates a web page as browsing information Dw based on the warning information Da transmitted from the mobile terminal side communication unit 26 to the watching server side communication unit 42 (step S26).
Next, the URL information generation unit 46 generates URL information necessary for browsing the browsing information Dw (web page) (step S28).
The alert information generation unit 48 generates the alert information including the URL information generated by the URL information generation unit 46, and the watcher mobile terminal identification information associated with the mobile terminal identification information IDa included in the alert information Da. The IDb is specified from the identification information recording unit 40, and the alert information is transmitted to the watcher mobile terminal 16 corresponding to the specified watcher mobile terminal identification information IDb via the network 18 by the watching server side communication unit 42 ( Step S30).

When the watcher mobile terminal 16 receives the alert information (step S32), the watcher operates the watcher mobile terminal 16 to access the watch server 14 based on the URL information included in the alert information (step S34). ), Acquire the browsing information Dw (step S36).
As shown in FIG. 6, the browsing information Dw includes the position-specific map information DP displayed on the map, the peripheral image information DG, and the voice information DS so that the position specified by the current position information DL is indicated by the icon IC. Includes. As described above, the browsing information Dw may include the mobile terminal identification information IDa.
The position-specific map information DP and the peripheral image information DG are displayed on the display 1602 of the watcher mobile terminal 16, and the audio information DS is reproduced from the speaker of the watcher mobile terminal 16 (step S38).
As a result, the watcher knows that the watch target person is located outside the registered area Ar and some abnormality has occurred, and at the same time, the watcher is aware of the location of the watch target person, the peripheral image of the watch target person, and the sound. It is possible to specifically grasp the situation in which the watch target person is placed, and depending on the situation, the watcher takes an action to protect the watch target person (step S40).
Specifically, they take actions such as rushing to the scene or calling the police.
By doing this, it is possible to prevent the watcher or the police from rushing to the watcher and the watcher being taken away by a suspicious person or causing some harm, and to protect the watcher. can.

As described above, according to the monitoring target person mobile terminal 12 of the present embodiment, the time ΔT at which the current position information DL indicating the current position of the monitoring target person is determined to be outside the registration area Ar is set in advance. When the value time Tt is exceeded, it is determined that there is a high possibility that some abnormality has occurred in the watching target person, a warning is sent to the watching target person and the surroundings, and the current position information DL of the watching target person and the surroundings are notified. The warning information Da including the image information DG is generated and transmitted to the monitoring server 14 via the network 18.
Therefore, when the person to be watched away from the registered area Ar, a warning can be sent to alert the person to be watched and those who are present in the vicinity. Therefore, the person to be watched can take measures such as returning to the registered area Ar by himself / herself, asking for help from a person present in the vicinity, or having the person who is present protect the person to be watched. It is advantageous in protecting the person to be watched over. Alternatively, even if the person to be watched is about to be taken away by the suspicious person, it can be expected that the suspicious person will notice the warning notification and leave from the vicinity of the person to be watched by himself / herself.
In addition, the watcher who watches over the person to be watched can grasp the current position information DL and the surrounding image information DG of the person to be watched by obtaining the warning information Da from the watching server 14 using a general-purpose terminal such as a smartphone. It is advantageous for taking actions to protect the target person at an early stage.

Further, in the monitoring target person mobile terminal 12 of the present embodiment, the operation unit 36 is used to perform an operation of setting the registration area Ar on the map information Dm displayed on the display unit 38, and the operation unit 36 sets the registration area Ar. Since the registered area Ar is registered in the map database 28A, the registered area Ar can be easily set, which is advantageous in improving the operability.

Further, the monitoring target person mobile terminal 12 of the present embodiment includes a peripheral image information recording unit 28E that records the peripheral image information DG imaged by the imaging unit 22, and the peripheral image recorded by the peripheral image information recording unit 28E. When the information DG reaches the predetermined first upper limit recording capacity ST1, the peripheral image information DG recorded in the peripheral image information recording unit 28E is overwritten and recorded, and the peripheral image information DG included in the warning information Da is recorded. Was composed of a part or all of the peripheral image information DG recorded in the peripheral image information recording unit 28E.
Therefore, since the peripheral image information DG for the first upper limit recording capacity ST1 can be obtained, for example, it is possible to grasp the situation before and after it is determined that there is a high possibility that an abnormality has occurred, and the person to be watched over. It is advantageous for accurately confirming the situation around.

Further, the monitoring target person mobile terminal 12 of the present embodiment includes a voice acquisition unit 24 that detects the voice around the monitoring target person and generates a voice information DS, and the person determination unit 28B determines that the face image information does not match. When the determination is made, the warning information generation unit 28H adds the voice information DS to the warning information Da and transmits it to the monitoring server 14.
Therefore, it is advantageous for the voice information DS to more accurately grasp the situation of the person to be watched over.

Further, the monitoring target person mobile terminal 12 of the present embodiment includes a voice information recording unit 28F for recording the voice information DS generated by the voice acquisition unit 24, and the voice information DS recorded in the voice information recording unit 28F is provided. When the predetermined second upper limit recording capacity ST2 is reached, the voice information DS recorded in the voice information recording unit 28F is overwritten and recorded, and the voice information DS included in the warning information Da is the voice information recording unit 28F. It consisted of a part or all of the voice information DS recorded in.
Therefore, since the voice information DS for the second upper limit recording capacity ST2 can be obtained, for example, it is possible to grasp the situation before and after it is determined that there is a high possibility that an abnormality has occurred, and it is possible to grasp the situation of the person to be watched over. It is advantageous for accurately checking the surrounding conditions.

Further, in the monitoring target mobile terminal 12 of the present embodiment, the warning notification by the warning notification unit 28G is at least the generation of vibration by the vibrator 32, the generation of the warning sound by the speaker 30, and the lighting or blinking of the light by the lamp 34. Made by one.
Therefore, it is possible to reliably notify the person to be watched and those who are present in the vicinity of the person to be watched, and to encourage the person to be watched and those in the vicinity to take necessary actions to protect the person to be watched. It will be advantageous. Alternatively, it can be expected that the suspicious person will be more likely to notice the warning notification and will go away from the vicinity of the person to be watched over by himself / herself.

Further, in the monitoring system of the present embodiment, the monitoring target person mobile terminal 12 and the monitoring server 14 are provided, and the monitoring server 14 obtains the browsing information Dw based on the warning information Da transmitted from the monitoring target person mobile terminal 12. Generates and generates URL information necessary for browsing the browsing information Dw, identifies the watcher mobile terminal identification information IDb associated with the mobile terminal identification information IDa included in the warning information Da, and identifies the specified watcher mobile phone. Attention information including the URL information generated by the URL information generation unit 46 is transmitted to the watcher terminal corresponding to the terminal identification information IDb via the network 18.
Therefore, when it is determined that there is a high possibility that an abnormality has occurred in the watch target person, the watcher can access the watch server 14 using the watcher mobile terminal 16 and check the browsing information Dw. It is advantageous to accurately grasp the situation of the person being watched over and to take appropriate actions to protect the person being watched over.
Further, if the alert information includes, in addition to the URL information, warning comment information indicating that it is highly likely that an abnormality has occurred in the person to be watched over, the watcher is displayed on the watcher's mobile terminal 16. By visually recognizing the warning comment information, it is advantageous for the watcher to reliably browse the browsing information Dw without overlooking it.

Further, in the watching system 10 of the present embodiment, the browsing information Dw includes the position-specific map information DP in which the position specified by the current position information DL is displayed on the map and the peripheral image information DG, so that the watcher Is advantageous in taking appropriate actions to protect the watching target person because the location of the watching target person can be accurately grasped when it is determined that there is a high possibility that an abnormality has occurred.

Further, in the watching system of the present embodiment, since the browsing information Dw includes the voice information DS generated by the voice acquisition unit 24, the watching person is determined to have a high possibility that an abnormality has occurred. Since the situation of the person to be watched can be accurately grasped by the voice information DS, it is advantageous to take appropriate actions to protect the person to be watched.

(Second Embodiment)
Next, a second embodiment will be described with reference to FIG.
In the following embodiments, the same parts and members as those in the first embodiment are designated by the same reference numerals as those in the first embodiment, and the description thereof will be omitted.
The second embodiment is a modification of the first embodiment, the configuration of the watch target person mobile terminal 12'is different from that of the first embodiment, and the watch server 14 is the first embodiment. Similar to form.

The watch target person's mobile terminal 12'includes two housings, a slave unit side housing 50 and a master unit side housing 52, which are separated from each other.
The slave unit side housing 50 houses the image pickup unit 22, the voice acquisition unit 24, and the slave unit side communication unit 54.
The slave unit side communication unit 54 is connected to the image pickup unit 22 and the voice acquisition unit 24 and communicates via the wireless line N.
As such a wireless line N, various conventionally known short-range wireless devices such as Bluetooth (registered trademark) can be adopted.
The master unit side housing 52 is configured separately from the slave unit side housing 50, and is the rest of the watch target person's mobile terminal 12 excluding the image pickup unit 22 and the voice acquisition unit 24, and the master unit side communication unit 56. And is housed.
The master unit side communication unit 56 is connected to the computer 28 and communicates with the slave unit side communication unit 54 via the wireless line N.
The imaging unit 22 and the peripheral image information recording unit 28E are configured to communicate the peripheral image information DG via the slave unit side communication unit 54, the wireless line N, and the master unit side communication unit 56.
Further, the voice acquisition unit 24 and the voice information recording unit 28F are configured to communicate the voice information DS via the slave unit side communication unit 54, the wireless line N, and the master unit side communication unit 56.

According to the second embodiment, since it is sufficient for the slave unit side housing 50 to accommodate the image pickup unit 22, the voice acquisition unit 24, and the slave unit side communication unit 54, the slave unit side housing 50 is the first embodiment. Compared to the housing 12A of the mobile terminal 12 of the person to be watched over, the slave unit side housing 50 can be made smaller and lighter.
Therefore, the slave unit side housing 50 is placed in an appropriate place such as clothes, a hat, or a bag of the person to be watched over via various conventionally known removable attachments such as clips, safety pins, and hook-and-loop fasteners. It can be freely attached, and the master unit side housing 52 can be housed in a place different from the slave unit side housing 50 such as a pocket of clothes or a bag.
By doing so, the position and posture of the image pickup unit 22 are less likely to be restricted, and it is advantageous in attaching the slave unit side housing 50 so that the image pickup unit 22 can easily take an image of the surroundings of the person to be watched over. It is advantageous in surely generating the peripheral image information DG according to 22.
In addition, the position and posture of the voice acquisition unit 24 are less likely to be restricted, which is advantageous in attaching the slave unit side housing 50 so that the voice acquisition unit 24 can easily acquire the voice around the person to be watched over. It is advantageous in surely acquiring the voice information DS by 24.
Further, in the second embodiment, the voice acquisition unit 24 is housed in the slave unit side housing 50, but the voice acquisition unit 24 may be housed in the master unit side housing 52. In that case, it is even more advantageous in reducing the size and weight of the slave unit side housing 50.

In the first and second embodiments, the case where the imaging unit 22 is single has been described, but a plurality of imaging units 22 may be provided, and in that case, the person to be watched by the plurality of imaging units 22. A wide range of peripheral image information can be generated by watching over the housing 12A or the slave unit side housing 50 and attaching it to the clothes of the target person or the like so that the surroundings of the above can be evenly imaged.
Therefore, it is advantageous in reducing the blind spot and securing the amount of peripheral image information as compared with the case where the imaging unit 22 is single.

10 Watching system 12, 12'Watching target person Mobile terminal 12A Housing 14 Watching server 16 Watching person mobile terminal 1602 Display 18 Network 20 Positioning unit 22 Imaging unit 24 Voice acquisition unit 26 Mobile terminal side communication unit 28 Computer 28A Map database 28B registration Unit 28C Position determination unit 28D Abnormality determination unit 28E Peripheral image information recording unit 28F Voice information recording unit 28G Warning notification unit 28H Warning information generation unit 30 Speaker 32 Vibrator 34 Lamp 36 Operation unit 38 Display unit 3802 Display screen 40 Identification information recording unit 42 Monitoring server side communication unit 44 Browsing information generation unit 46 URL information generation unit 48 Attention information generation unit 50 Slave unit side chassis 52 Master unit side chassis 54 Slave unit side communication unit 56 Master unit side communication unit Dm Map information Ar registration Area DL Current position information Da Warning information IDa Mobile terminal identification information of the person to be watched DL Current position information DG Peripheral image information DS Voice information IDb Watcher mobile terminal identification information Dw Browsing information DP Position identification map information ST1 1st upper limit recording capacity ST2 2nd upper limit recording capacity

Claims (10)

It is a mobile terminal owned by the person to be watched over,
A positioning unit that acquires current position information based on positioning signals from positioning satellites, and
An imaging unit that captures the surroundings of the person to be watched and generates peripheral image information,
A map database in which map information is stored and a predetermined registration area is registered on the map information, and
A position determination unit that determines whether or not the current position information acquired by the positioning unit is within the registration area, and
When the time when the current position information is determined to be outside the registration area by the position determination unit exceeds a predetermined threshold time, it is determined that there is a high possibility that some abnormality has occurred in the monitoring target person. Abnormality judgment unit and
When the abnormality determination unit determines that there is a high possibility that an abnormality has occurred, the warning notification unit that notifies the monitoring target person and the surroundings of a warning, and the warning notification unit.
The communication unit on the mobile terminal side, which is configured to be able to communicate with the server via the network,
When it is determined by the abnormality determination unit that there is a high possibility that an abnormality has occurred, the mobile terminal identification information of the mobile terminal, the current position information acquired by the positioning unit, and the peripheral image information are associated with each other. A warning information generation unit that generates warning information and transmits the warning information to the server via the network by the communication unit on the mobile terminal side.
A mobile terminal characterized by being equipped with. A display unit that displays the map information and
An operation unit that accepts an operation of setting the registration area on the map information displayed on the display unit, and an operation unit that accepts the operation.
A registration unit that registers the registration area set by the operation unit in the map database, and a registration unit.
The mobile terminal according to claim 1, wherein the mobile terminal is provided with. A peripheral image information recording unit for recording the peripheral image information captured by the imaging unit is provided.
When the peripheral image information recorded in the peripheral image information recording unit reaches a predetermined first upper limit recording capacity, the peripheral image information recording unit records the peripheral image in the peripheral image information recording unit. Record while overwriting the image information,
The peripheral image information included in the warning information is a part or all of the peripheral image information recorded in the peripheral image information recording unit.
The mobile terminal according to claim 1 or 2, wherein the mobile terminal is characterized in that. The peripheral image information recording unit records the peripheral area recorded from the first time point to the second time point retroactive to the first predetermined time T1 at the first time point when it is determined by the abnormality determination unit that an abnormality is likely to occur. Overwriting of the image information is prohibited, and the peripheral image information is recorded from the first time point onward until the third time point when the remaining recording capacity is exhausted.
The mobile terminal of the person subject to monitoring according to claim 3. It is further provided with a voice acquisition unit that detects the voice around the person to be watched and generates voice information.
When the abnormality determination unit determines that an abnormality is likely to occur, the warning information generation unit adds the voice information generated by the voice acquisition unit to the warning information to the mobile terminal side. Send to the server via the communication unit,
The mobile terminal according to any one of claims 1 to 4, wherein the mobile terminal is characterized by the above. A voice information recording unit for recording the voice information generated by the voice acquisition unit is provided.
When the voice information recorded in the voice information recording unit reaches a predetermined second upper limit recording capacity, the voice information recording unit overwrites the voice information recorded in the voice information recording unit. Record while
The voice information included in the warning information is a part or all of the voice information recorded in the voice information recording unit.
The mobile terminal according to claim 5, wherein the mobile terminal is characterized in that. The voice information recording unit records the voice information recorded from the first time point to the fourth time point retroactive to the third predetermined time T3 at the first time point when it is determined by the abnormality determination part that an abnormality is likely to occur. Overwriting of the recording unit is prohibited, and the voice information is recorded from the first time point onward until the fifth time point when the remaining recording capacity is exhausted.
The mobile terminal of the person to be watched over according to claim 6. A slave unit-side housing that houses the imaging unit and a slave unit-side communication unit that communicates via a wireless line.
A parent that is configured separately from the slave unit side housing and accommodates the remaining portion of the monitoring target person's mobile terminal excluding the image pickup unit and the master unit side communication unit that communicates via the wireless line. Equipped with a machine-side housing
The imaging unit and the peripheral image information recording unit are configured to communicate the peripheral image information via the slave unit side communication unit, the wireless line, and the master unit side communication unit.
The mobile terminal of the person to be watched according to any one of claims 1 to 7, characterized in that. The master unit side housing accommodates the remaining parts excluding the image pickup unit and the sound acquisition unit.
The slave unit side housing accommodates the voice acquisition unit.
The voice acquisition unit and the voice information recording unit are configured to communicate the voice information via the slave unit side communication unit, the wireless line, and the master unit side communication unit.
The mobile terminal for a person to be watched according to any one of claims 6 to 8, which cites claim 5. A monitoring system including a monitoring target mobile terminal possessed by the monitoring target and a monitoring server configured to be able to communicate with the monitoring target mobile terminal.
The mobile terminal of the person to be watched over is
A positioning unit that acquires current position information based on positioning signals from positioning satellites, and
An imaging unit that captures the surroundings of the person to be watched and generates peripheral image information,
A map database in which map information is stored and a predetermined registration area is registered on the map information, and
A position determination unit that determines whether or not the current position information acquired by the positioning unit is within the registration area, and a position determination unit.
When the time when the current position information is out of the registration area exceeds a predetermined threshold time, the position determination unit determines that there is a high possibility that some abnormality has occurred in the monitoring target person. Abnormality judgment part and
When the abnormality determination unit determines that there is a high possibility that an abnormality has occurred, the warning notification unit that notifies the monitoring target person and the surroundings of a warning, and the warning notification unit.
A mobile terminal-side communication unit configured to be able to communicate with the monitoring server via a network,
When it is determined by the abnormality determination unit that there is a high possibility that an abnormality has occurred, the mobile terminal identification information of the mobile terminal, the current position information acquired by the positioning unit, and the peripheral image information are associated with each other. It is provided with a warning information generation unit that generates warning information and transmits the warning information to the watching server via the network by the communication unit on the mobile terminal side.
The watching server is
An identification information recording unit that records the mobile terminal identification information in association with the watcher's mobile terminal identification information, which is the identification information of the watcher's mobile terminal possessed by the watcher.
The monitoring server-side communication unit that communicates via the network,
A browsing information generation unit that generates browsing information based on the warning information transmitted from the mobile terminal side communication unit to the watching server side communication unit, and
A URL information generation unit that generates URL information necessary for viewing the browsing information, and
In addition to generating alert information including the URL information generated by the URL information generation unit, the identification information recording unit records the watcher mobile terminal identification information associated with the mobile terminal identification information included in the warning information. The watcher terminal corresponding to the identified watcher mobile terminal identification information is provided with a warning information generation unit which is specified from the above and is transmitted via the network by the watching server side communication unit. ,
A watching system that features that.

Images