JP2007114940A - Visitor reporting/warning system, method, portable terminal, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an expensive visitor reporting/warning system that uses mobile terminals. <P>SOLUTION: A door opening/closing sensor 10 detects the opening or closing of a door and transmits opening/closing detection information to a mobile terminal 20. On receiving the opening/closing detection information, the mobile terminal 20 photographs the visitor and records the content of a conversation. The mobile terminal 20 then sends mail with an image file and a conversation content voice file attached thereto to a predetermined device 30 to be informed. The mobile terminal 20 performs collation to see if the content of the conversation contains any words for warning. If it contains any word for warning or if a return email is received from the device 30, a warning sound is output from the mobile terminal 20. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a visitor notification / warning system, method, portable terminal, and program, and more particularly to a visitor notification / warning system, method, portable terminal, and program using a portable terminal.

  In recent years, with the increase in the number of elderly people and people with dementia (dementia), unscrupulous commercial law that requires unnecessary contracts for construction and sales of goods by visiting the homes of elderly people and people with dementia who have lost their judgment. Has become a social problem. Therefore, there is a need for a system that allows family members, guardians, security service providers, and the like to easily check visitors to the homes of elderly people and people with dementia from a remote location, and to fight off unscrupulous contractors.

A conventional example of this visitor confirmation system is disclosed in, for example, Japanese Patent Laid-Open No. 10-51762 (Patent Document 1). In this Patent Document 1,
・ If the visitor presses the intercom button and the housekeeper does not respond within the specified time, or if the phone is set to the absence mode, the visitor is photographed by the camera installed in the interphone and image information is obtained. Accumulate
Provided a system for confirming a visitor's video at a remote place by transmitting image information accumulated in response to a request from an external mobile terminal and displaying the image information on the external mobile terminal.

JP-A-10-51762 (paragraphs “0016”, “0020”, “0024”, FIG. 1)

  In the above-described Patent Document 1, since shooting of a visitor, transmission of a visitor image, and the like are performed by an interphone incorporating a camera, a communication function, etc., it is necessary to install a dedicated interphone having the above function, and installation costs and There is a problem that maintenance costs etc. occur.

  Further, the invention described in Patent Document 1 described above is an invention based on the premise of absence (absence) of a householder that transmits visitor image information to an external mobile terminal when the family member is absent. Therefore, when an elderly person or a person with dementia is at home and a visitor is put in his / her home, the method of confirming whether or not the visitor is an unscrupulous trader is not considered at all.

  An object of the present invention is to provide a visitor notification / warning system, method, portable terminal, and program that solve the above problems.

The first visitor notification / warning system of the present invention is a visitor notification / warning system comprising a door opening / closing sensor and a portable terminal,
The door opening / closing sensor has means for detecting opening / closing of a door and transmitting opening / closing detection information to the portable terminal,
The portable terminal receives opening / closing detection information and records a visitor's shooting and conversation content; a means for sending an email attached with a captured image file and a conversation content audio file to a predetermined report destination; A means for collating whether or not a warning target word is included in the conversation content; and a means for outputting a warning sound when a warning target word is included or when a reply mail is received from the report destination.

The second visitor notification / warning system of the present invention is a visitor notification / warning system comprising a door opening / closing sensor and a portable terminal,
The door opening / closing sensor has means for detecting opening / closing of a door and transmitting opening / closing detection information to the portable terminal,
The portable terminal includes a means for receiving opening / closing detection information to capture a visitor and recording a conversation content, a means for collating whether the conversation content includes a warning target word, and a warning target word. In this case, a means for transmitting an email attached with a photographed image file and a voice file of conversation contents to a predetermined report destination and outputting a warning sound, and outputting a warning sound when a reply mail is received from the report destination Means.

A third visitor notification / warning system of the present invention is a visitor notification / warning system comprising a door opening / closing sensor, a portable terminal, and a predetermined report destination device.
The door opening / closing sensor has means for detecting opening / closing of a door and transmitting opening / closing detection information to the portable terminal,
The portable terminal receives opening / closing detection information and records a visitor's shooting and conversation content; a means for sending a mail with a captured image file and a conversation content audio file attached to the report destination device; Means for outputting a warning sound when a reply mail is received from the report destination device,
The report destination device includes means for collating whether or not a warning target word is included in the voice file attached to the received mail, and means for returning the received mail when the warning target word is included.

  According to a fourth visitor notification / warning system of the present invention, in the first, second or third visitor notification / warning system of the present invention, the portable terminal stores valid / invalid setting of the opening / closing detection information. And a storage means for referring to the storage means when receiving the opening / closing detection information, and determining whether it is set to valid or invalid, and only when the valid is set, the visitor It is characterized by recording and recording conversation contents.

  A fifth visitor notification / warning system according to the present invention is the first, second, third or fourth visitor notification / warning system according to the present invention, wherein the portable terminal converts recorded information of conversation contents into text. The voice file is voice text information.

  A sixth visitor notification / warning system of the present invention is the visitor notification / warning system according to any one of the first to fifth of the present invention, wherein the data transmission / reception between the door opening / closing sensor and the portable terminal is performed by Bluetooth communication. It is characterized by performing short-range wireless communication including wired communication including USB cable.

A first portable terminal of the present invention is a portable terminal connected to a door opening / closing sensor,
Means for receiving opening / closing detection information from the door opening / closing sensor to record a visitor's shooting and conversation content; means for sending a mail with a captured image file and a voice file of the conversation content to a predetermined report destination; A means for collating whether or not a warning target word is included in the conversation content; and a means for outputting a warning sound when a warning target word is included or when a reply mail is received from the report destination.

A second portable terminal of the present invention is a portable terminal connected to a door opening / closing sensor,
Means for receiving opening / closing detection information from the door opening / closing sensor to capture a visitor's image and recording conversation content; means for checking whether the conversation content includes a warning target word; and a warning target word In this case, a means for transmitting an email attached with a photographed image file and a voice file of conversation contents to a predetermined report destination and outputting a warning sound, and outputting a warning sound when a reply mail is received from the report destination Means.

A third portable terminal of the present invention is a portable terminal connected to a door opening / closing sensor,
Means for receiving opening / closing detection information from the door opening / closing sensor to record a visitor's shooting and conversation content; means for sending a mail with a captured image file and a voice file of the conversation content to a predetermined report destination; Means for outputting a warning sound when a reply mail is received from the report destination.

  According to the fourth portable terminal of the present invention, when the first, second or third portable terminal of the present invention receives the opening / closing detection information and the storage means for storing the valid / invalid setting of the opening / closing detection information. And means for referring to the storage means to determine whether it is set to valid or invalid, and only when it is set valid, the visitor's photographing and conversation contents are recorded. To do.

  According to a fifth portable terminal of the present invention, in the first, second, third, or fourth portable terminal of the present invention, the fifth portable terminal further includes means for converting recorded information of conversation contents into text, and the voice file is a voice. It is characterized by text information.

  The sixth portable terminal of the present invention is the portable terminal of any one of the first to fifth aspects of the present invention, wherein data transmission / reception with the door opening / closing sensor is short-range wireless communication including Bluetooth communication or wired communication including a USB cable. It is characterized by performing by.

  According to a first visitor notification / warning method of the present invention, a door opening / closing sensor detects opening / closing of a door and transmits opening / closing detection information to a portable terminal, and the portable terminal receives opening / closing detection information. A second step of shooting the visitor and recording the conversation content, a third step in which the mobile terminal transmits an email attached with a captured image file and a voice file of the conversation content to a predetermined report destination, When the mobile terminal includes a fourth step for checking whether the conversation target word contains a warning target word and the warning target word is included, or when a reply mail is received from the report destination, the mobile terminal And a fifth step of outputting a warning sound.

  According to a second visitor notification / warning method of the present invention, a door opening / closing sensor detects opening / closing of a door and transmits opening / closing detection information to a portable terminal, and the portable terminal receives opening / closing detection information. The second step of shooting the visitor and recording the conversation content, the third step of the portable terminal collating whether the conversation target word contains the warning target word, and the warning target word were included In the case where the portable terminal transmits a mail attached with a photographed image file and a voice file of conversation contents to a predetermined report destination and outputs a warning sound, and a reply mail is received from the report destination And a fifth step in which the portable terminal outputs a warning sound.

  According to a third visitor notification / warning method of the present invention, the door opening / closing sensor detects opening / closing of the door and transmits opening / closing detection information to the portable terminal, and the portable terminal receives the opening / closing detection information. A second step of shooting the visitor and recording the conversation content, a third step in which the mobile terminal transmits an email attached with a captured image file and a voice file of the conversation content to a predetermined report destination, And a fourth step in which the portable terminal outputs a warning sound when a reply mail is received from the report destination.

  The first program of the present invention receives a function for receiving opening / closing detection information from an external device and recording a visitor's photographing and conversation contents, and a mail attached with a photographed image file and a voice file of the conversation contents. A function to send a warning sound, a function to check whether or not a warning target word is included in the conversation content, a function to output a warning sound when a warning target word is included or a reply mail is received from the report destination Is realized on a computer.

  The second program of the present invention has a function of receiving opening / closing detection information from an external device and capturing a visitor and recording a conversation content, a function of checking whether a conversation target word contains a warning target word, a warning target A function that sends a mail with a captured image file and a voice file of the conversation contents attached to a predetermined report destination and outputs a warning sound when a word is included, and warns when a reply mail is received from the report destination A computer that realizes a sound output function.

  A third program according to the present invention receives a function of recording open / closed detection information from an external device and records a visitor's shooting and conversation content, and sends a mail with a captured image file and a voice file of the conversation content as a predetermined report destination. And a function for outputting a warning sound when a reply mail is received from the report destination.

  According to the present invention, when an elderly person or a person with dementia stays at home and receives a visitor at home, the photographed image and the conversation content are notified to a predetermined report destination. For this reason, at the report destination, it is possible to confirm whether the visitor is an unscrupulous trader based on the photographed image and the content of the conversation, and an effect that an appropriate and quick response can be obtained is obtained.

  In addition, since the present invention constitutes a system by including a door opening / closing sensor and a portable terminal at home, there is an effect that the system can be constructed at a lower cost than equipment such as an interphone equipped with a camera and a communication function. can get.

  Further, the present invention determines that a warning object is output when a predetermined word is included in the conversation contents of a visitor or when a reply mail is received from a report destination device, and the mobile terminal outputs a warning sound. I have to. In this way, by outputting a warning sound from a mobile terminal, an effect can be obtained that an alarm can be issued to the elderly person, a person with dementia or the surroundings, or a visitor can be informed of being a bad guy. It is done.

  Embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a diagram showing a configuration of a first exemplary embodiment of the present invention, in which a door opening / closing sensor 10, a portable terminal 20, a report destination device 30, a portable terminal 20, and a report destination device 30 are mutually connected. Network 100 such as the Internet.

  The door opening / closing sensor 10 is, for example, a vibration sensor, and has a function of detecting opening / closing of a door installed on a front door and a function of transmitting opening / closing detection information by short-range wireless communication such as Bluetooth when opening / closing is detected. ing.

The mobile terminal 20 is a mobile information terminal such as a mobile phone, a PHS (Personal Handyphone System), or a PDA (Personal Digital Assistance). The portable terminal 20 is located in a location facing the entrance where a built-in camera unit 23 can capture a visitor who has entered the entrance of the house, and within a communication distance of the door opening / closing sensor 10 of the entrance door. It is installed in the place of. The mobile terminal 20 includes a radio unit 21, an antenna 21A, a short-range radio communication unit 22, a short-range radio antenna 22A, a camera unit 23, a microphone 24, a voice recognition / conversion unit 25, A warning sound sending unit 26, a storage unit 27, and a control unit 28 are provided.

The wireless unit 21 is a wireless device that transmits and receives wireless signals to and from a base station (not shown) via an antenna 21A. The short-range wireless communication unit 22 connects the short-range wireless antenna 22A to the door opening / closing sensor 10. Via a short-range wireless communication such as Bluetooth. The camera unit 23 is an imaging device such as a CCD (Charge Coupled Device). Speech recognition / conversion unit 2
Reference numeral 5 denotes, for example, a DSP (Digital Signal Processor), which has a function of recognizing sound collected by the microphone 24 and a function of converting the recognized sound into text. The warning sound sending unit 26 includes a speaker and a speaker driving unit, and outputs a warning sound from the speaker according to an instruction from the control unit 28. The storage unit 27 is a readable / writable storage device. The storage unit 27 includes an opening / closing detection information valid / invalid storage unit 271, an image data storage unit 272, a voice text data storage unit 273, a warning target word storage unit 274, a report destination mail address storage unit 275, a warning And a sound data storage unit 276. In the opening / closing detection information valid / invalid storage unit 271, valid / invalid information for determining whether to enable or disable the opening / closing detection information when receiving the opening / closing detection information from the door opening / closing sensor 10 is registered in advance. . For example, when the answering machine is used only by a person with dementia or an elderly person with poor judgment, the registration is made valid, and otherwise the registration is made invalid. Note that, when valid, shooting by the camera unit 23 and notification to the report destination device 30 are performed by receiving the opening / closing detection information, and when invalid, these operations are not performed and the processing is terminated. The image data storage unit 272 stores visitor image data captured by the camera unit 23, and the voice text data storage unit 273 stores voice text converted to text by the voice recognition / conversion unit 25. In the warning target word storage unit 274, words to be warned (for example, names of unscrupulous traders, reforms, termites, fire extinguishers, etc.) are registered in advance. The mail address of the report destination device 30 is registered in advance in the report destination mail address storage unit 275, and the warning sound data output from the warning sound transmission unit 26 is registered in advance in the warning sound data storage unit 276. The warning sound data is, for example, a buzzer sound or voice data having an arbitrary content (for example, “I am a bad guy. Please be careful.”).

The control unit 28 is a control device such as a CPU (Central Processing Unit), and its operation is controlled by a program. The control unit 28
-A function for receiving open / close detection information from the door open / close sensor 10 to determine validity / invalidity;
A function for instructing the camera unit 23 to perform shooting and voice recognition / conversion unit 25 to perform voice text conversion and storing the captured image data and voice text data in the storage unit 27;
A function of sending an email with the captured image data and voice text data as an attachment to the report destination device 30;
A function of collating the speech text stored in the storage unit 27 with the words registered in the warning target word storage unit 274;
When a reply mail is received from the report destination device 30 within a certain time or when a word registered in the warning target word storage unit 274 is included in the voice text, a warning is sent via the warning sound sending unit 26 And a function to output sound.

  The report destination device 30 is an information processing device such as a server, a personal computer, or a portable information terminal, and is a device that is installed or carried by a family member, guardian, security service provider, or the like of an elderly person at home.

  Next, the operation of the first embodiment of the present invention will be described with reference to FIG. 1, FIG. 2, and FIG. FIG. 2 is a diagram showing a short-range wireless communication state between the door opening / closing sensor 10 and the portable terminal 20 when the front door is opened and closed, and FIG. 3 is a flowchart showing the operation of the first embodiment of the present invention. .

  When the housekeeper goes out leaving only elderly people or people with dementia at home, the housekeeper starts an application program on the mobile terminal 20. Then, the opening / closing detection information valid is input or selected by an operation unit (not shown), and the control unit 28 registers the valid information in the opening / closing detection information valid / invalid storage unit 271. In addition, when an elderly person or a person with dementia is not living with a family member, the opening / closing detection information validity is registered in advance in the opening / closing detection information valid / invalid storage unit 271 and the application program is always activated. .

  Thereafter, when the visitor visits and the entrance door is opened and closed by an elderly person at home or a person with dementia (step A1 in FIG. 3), the door opening / closing sensor 10 detects the opening / closing of the door and transmits the opening / closing detection information to the short-range wireless communication. Is transmitted to the portable terminal 20 (see FIG. 2) (step A2).

  When the control unit 28 of the portable terminal 20 receives the open / close detection information via the short-range wireless communication unit 22 (step A3), is the open / close detection information valid with reference to the open / close detection information valid / invalid storage unit 271? It is determined whether it is invalid (step A4). If it is registered as valid, the control unit 28 instructs the camera unit 23 to shoot and also instructs the voice recognition / conversion unit 25 to record the voice. The camera unit 23 captures a visitor every predetermined time (for example, every 30 seconds), and the control unit 28 stores the captured image data in the image data storage unit 272. The voice recognition / conversion unit 25 recognizes voice data collected through the microphone 24 and converted into a digital signal by an analog / digital conversion unit (not shown), and converts it into text data. The control unit 28 stores the converted voice text in the voice text data storage unit 273 (step A5).

  After instructing the camera unit 23 and the voice recognition / conversion unit 25 to perform shooting and voice recording, the control unit 28 refers to a clock unit or a timer (not shown) and monitors the passage of a predetermined time (for example, 5 minutes) (step). A6). When the predetermined time has elapsed, the control unit 28 instructs the camera unit 23 and the voice recognition / conversion unit 25 to stop the operation. As a result, shooting and audio recording are stopped. In addition, during the predetermined time (5 minutes), conversation contents including the name of the visitor such as “XX Construction” or “Reform” and the purpose of the visit can be recorded in the conversation between the visitor and the elderly or demented person. (Step A7).

  Thereafter, the control unit 28 generates image data and voice text data files stored in the image data storage unit 272 and the voice text data storage unit 273, respectively, and sends an e-mail with these files as an attached file to the report destination device 30. Send to. At this time, the e-mail body should contain a standard sentence such as “Visitor report mail. Please reply if there is a problem”. Further, the control unit 28 acquires the email address of the report destination device 30 from the report destination email address storage unit 275 (step A8).

  The report destination device 30 receives and stores the visitor report mail (step A9). The user of the report destination device 30 refers to the image file or the voice text file attached to the visitor report mail to determine whether there is a problem (it seems to be an unscrupulous trader) (step A10). Reply mail. At the time of this reply, the user only needs to perform a reply operation (step A11). Thereafter, the user who has received the visitor report mail dispatches people as necessary, contacts the neighbors to request a response, or reports to the police station or the like (step A12).

  The control unit 28 of the portable terminal 20 that has transmitted the visitor report mail to the report destination device 30 in step A8, the voice text data stored in the voice text data storage unit 273 and the warning target stored in the warning target word storage unit 274 Match words. Then, when the warning target word is included in the voice text data, the control unit 28 acquires the warning sound data from the warning sound data storage unit 276 and instructs the warning sound transmission unit 26 to output the acquired warning sound data. To do. At this time, the control unit 28 instructs the warning sound sending unit 26 to output at a large volume level so that it can be heard from the surroundings, and the designated warning sound sending unit 26 outputs the warning sound data at a large volume for a predetermined time. (Step A13 → Step A15).

  In addition, the control unit 28 of the mobile terminal 20 that has transmitted the visitor report mail to the report destination device 30 in step A8 refers to a clock unit or timer (not shown) and starts to monitor the progress of a predetermined time (for example, 30 minutes). . Then, when receiving the reply mail from the report destination device 30, the control unit 28 checks whether or not a certain time has passed. When the reply mail is received before the predetermined time has elapsed, the control unit 28 outputs the warning sound data acquired from the warning sound data storage unit 276 from the warning sound transmission unit 26 at a high volume for a predetermined time (step A14 → step A15).

  As described above, in the present embodiment, when an elderly person or a person with dementia staying at home responding with a visitor at home, the photographed image or the conversation content is notified to a predetermined report destination. I made it. For this reason, at the report destination, it is possible to confirm whether the visitor is an unscrupulous trader based on the photographed image and the content of the conversation, and an effect that an appropriate and quick response can be obtained is obtained.

  In the present embodiment, since visitor history information (image data, audio data) is stored in the portable terminal 20 or the report destination device 30, it contributes to an early solution even in the case of damages caused by unscrupulous commercial law. The effect that it can be obtained.

  In addition, in this embodiment, since it is sufficient that each home has the door opening / closing sensor 10 and the portable terminal 20, an effect that a system can be constructed at a lower cost than equipment such as an interphone provided with a camera, a communication function, and the like. can get.

  Further, in the present embodiment, when a predetermined word is included in the conversation contents of the visitor or when a reply mail is received from the report destination device 30, it is determined as a warning target and the mobile terminal 20 warns. I make a sound. In this way, by issuing a warning sound from the mobile terminal 20, an effect can be obtained that an alarm can be issued to an elderly person, a person with dementia or the surroundings, or a visitor can be informed of being a bad guy. It is done.

  Next, a second embodiment of the present invention will be described.

  In the first embodiment described above, a visitor report mail attached with a visitor's image file and a speech text file of conversation contents is unconditionally transmitted from the portable terminal 20 to the report destination apparatus 30. On the other hand, the present embodiment is different in that it is transmitted to the report destination apparatus 30 only when the transmission condition of the visitor report mail is satisfied. Here, the transmission condition is that the warning target word is included in the voice text data. The configuration of the present embodiment is the same as that of the first embodiment shown in FIG.

  Next, the operation of the second embodiment of the present invention will be described with reference to FIG. 3 and FIG. FIG. 4 is a flowchart showing the operation of the second embodiment of the present invention.

  Referring to FIG. 4, Step B1 to Step B7 and Step B10 to Step B15 are the same as Step A1 to Step A7, Step A9 to Step A12, A14, and A15 of FIG. 3 (first embodiment), respectively. Therefore, the description is omitted. 3 differs from the operation of the first embodiment in that step A8 in FIG. 3 is replaced with steps B8 and B9 in FIG. 4, and step A13 in FIG. This is a point replaced with Step B8. In the following, the operation of the present embodiment in the part replaced with the first embodiment will be described. Following step B7 in FIG. 4 (step A7 in FIG. 3), the control unit 28 of the mobile terminal 20 uses the voice text data stored in the voice text data storage unit 273 and the warning target stored in the warning target word storage unit 274. Match words. Then, when the warning target word is not included in the voice text data, the control unit 28 ends the process. When the warning text is included in the voice text data, the control unit 28 generates image data and voice text data files stored in the image data storage unit 272 and the voice text data storage unit 273, respectively. And the control part 28 produces | generates the electronic mail which makes those files an attachment file, and transmits to the report destination apparatus 30 (step B8-> step B9). In addition, when the warning text is included in the voice text data, the control unit 28 acquires the warning sound data from the warning sound data storage unit 276 and outputs the acquired warning sound data to the warning sound transmission unit 26. Instruct. At this time, the control unit 28 instructs the warning sound sending unit 26 to output at a large volume level so that it can be heard from the surroundings, and the designated warning sound sending unit 26 outputs the warning sound data at a large volume for a predetermined time. (Step B8 → Step B15).

  As described above, in the present embodiment, a report is made to the report destination device 30 only when a warning target word is included in the conversation contents of the visitor, that is, when the possibility of a bad dealer is high. Therefore, it is possible to obtain a further effect that efficient reporting is possible.

  Next, a third embodiment of the present invention will be described.

  In the first embodiment described above, the warning target word is registered in the warning target word storage unit 274 of the mobile terminal 20, and the warning target word is included in the voice text data that is the conversation content with the visitor. The portable terminal 20 was checking whether there was any. On the other hand, in the present embodiment, a warning target word is registered in advance in the report destination device 30 so that the report destination device 30 performs collation as to whether or not the warning target word is included in the voice text data. Different points. The configuration of the present embodiment is different in that the warning target word storage unit 274 in the configuration of the first embodiment shown in FIG. 1 is moved from the portable terminal 20 to the report destination device 30 side.

  Next, the operation of the third embodiment of the present invention will be described with reference to FIG. 3 and FIG. FIG. 5 is a flowchart showing the operation of the third embodiment of the present invention.

  Referring to FIG. 5, Step C1 to Step C9 and Step C12 to Step C14 are the same as Step A1 to Step A9, Step A12, Step A14, and A15 of FIG. 3 (first embodiment) respectively. Description is omitted. The difference between the operation of the present embodiment and the operation of the first embodiment is that steps A10 and A11 in FIG. 3 are replaced with steps C10 and C11 in FIG. 4 and step A13 in FIG. 3 is deleted. This is the point. In the following, the operation of the present embodiment in the part replaced with the first embodiment will be described. Subsequent to step C9 in FIG. 5 (step A9 in FIG. 3), the report destination apparatus 30 collates the voice text data attached to the received visitor report mail with the warning target word stored in the internal database. Then, when the warning target word is not included in the voice text data, the report destination device 30 ends the process. When the warning target word is included in the voice text data, the report destination device 30 returns the received visitor report mail (step C10 → step C11).

  As described above, in the present embodiment, the warning target word is registered in the report destination device 30, and the report destination device 30 collates the conversation contents of the visitor with the warning target word. For this reason, when the report destination device 30 is a device of a security service provider, registration, collation, and management of warning target words can be performed collectively by the report destination device 30, and warning target words in each home mobile terminal 20 The effect that registration and verification are unnecessary is obtained.

  Next, application examples and modification examples of the present invention will be described.

  -In 1st-3rd embodiment mentioned above, when the portable terminal 20 received the opening / closing detection information from the door opening / closing sensor 10 which detects opening / closing of a front door, it demonstrated as image | photographing and audio | voice recording. This opening / closing detection information is transmitted only by opening / closing the entrance door. However, by linking the door opening / closing sensor 10 with an interphone provided separately, only when the entrance door is opened / closed after the visitor sounds the interphone, shooting and sound are recorded. You may make it record. In this case, the door opening / closing sensor 10 and the intercom are connected by wired or short-range wireless communication. When the visitor presses a button on the intercom, a button pressing signal is transmitted to the door opening / closing sensor 10, and the door opening / closing sensor 10 receives the button pressing signal and detects the opening / closing of the door. The opening / closing detection information is transmitted to. Alternatively, when a visitor presses a button on the intercom, a button press signal is transmitted to the mobile terminal 20 by wired or short-range wireless communication, and the mobile terminal 20 detects the button press signal from the intercom and the open / close detection from the door open / close sensor 10. It is also possible to perform shooting and audio recording when both information are received. According to this application example, even when the entrance door is opened and closed, when the user goes out of the house by going out or the like, the opening / closing detection information is not transmitted to the mobile terminal 20, and it is possible to prevent shooting and audio recording. Further effects can be obtained.

  In the first to third embodiments described above, it has been described that the conversation content between the elderly at home or the person with dementia and the visitor is converted into text and transmitted to the report destination device 30. The recording information itself may be transmitted. In this case, the recording information is stored in the storage unit 27 of the portable terminal 20 including the recording information storage unit. Thereby, since a visitor's voice can be confirmed, the further effect that it can be made into an evidence by performing voiceprint analysis etc. later is acquired.

  In the first to third embodiments described above, the connection between the door opening / closing sensor 10 and the portable terminal 20 has been described as being performed by short-range wireless communication, but may be performed by wired communication including a USB cable.

  The portable terminal 20 in the first to third embodiments described above may be a fixed terminal such as a personal computer.

  In the first to third embodiments described above, valid / invalid of the open / close detection information is set in the open / close detection information valid / invalid storage unit 271 of the mobile terminal 20 and the open / close detection information is received from the door open / close sensor 10. It has been described that the portable terminal 20 sometimes determines whether the opening / closing detection information is valid or invalid. Validity / invalidity of the opening / closing detection information may be set in the door opening / closing sensor 10, and the opening / closing detection information may be transmitted to the mobile terminal 20 only when it is set to be valid.

It is a figure which shows the structure of the 1st Embodiment of this invention. It is a figure which shows the near field communication state between the door opening / closing sensor 10 at the time of opening / closing of a front door, and the portable terminal 20. FIG. It is a flowchart which shows the operation | movement of the 1st Embodiment of this invention. It is a flowchart which shows the operation | movement of the 2nd Embodiment of this invention. It is a flowchart which shows the operation | movement of the 3rd Embodiment of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Door open / close sensor 20 Portable terminal 21 Radio | wireless part 21A Antenna 22 Short-range wireless communication part 22A Short-range wireless antenna 23 Camera part 24 Microphone 25 Voice recognition / conversion part 26 Warning sound transmission part 27 Storage part 271 Open / close detection information valid / invalid Storage unit 272 Image data storage unit 273 Audio text data storage unit 274 Warning target word storage unit 275 Report destination mail address storage unit 276 Warning sound data storage unit 28 Control unit 30 Report destination device 100 Network

Claims (18)

A visitor notification / warning system equipped with a door opening / closing sensor and a portable terminal,
The door opening / closing sensor has means for detecting opening / closing of a door and transmitting opening / closing detection information to the portable terminal,
The portable terminal receives opening / closing detection information and records a visitor's shooting and conversation content; a means for sending an email attached with a captured image file and a conversation content audio file to a predetermined report destination; A means for collating whether or not a warning target word is included in the conversation content; and a means for outputting a warning sound when a warning target word is included or when a reply mail is received from the report destination Visitor notification / warning system. A visitor notification / warning system equipped with a door opening / closing sensor and a portable terminal,
The door opening / closing sensor has means for detecting opening / closing of a door and transmitting opening / closing detection information to the portable terminal,
The portable terminal includes a means for receiving opening / closing detection information to capture a visitor and recording a conversation content, a means for collating whether the conversation content includes a warning target word, and a warning target word. In this case, a means for transmitting an email attached with a photographed image file and a voice file of conversation contents to a predetermined report destination and outputting a warning sound, and outputting a warning sound when a reply mail is received from the report destination And a visitor notification / warning system. A visitor notification / warning system comprising a door opening / closing sensor, a portable terminal, and a predetermined report destination device,
The door opening / closing sensor has means for detecting opening / closing of a door and transmitting opening / closing detection information to the portable terminal,
The portable terminal receives opening / closing detection information and records a visitor's shooting and conversation content; a means for sending a mail with a captured image file and a conversation content audio file attached to the report destination device; Means for outputting a warning sound when a reply mail is received from the report destination device,
The report destination device has means for collating whether a warning target word is included in an audio file attached to the received mail, and means for returning the received mail when the warning target word is included. Visitor notification / warning system. The mobile terminal stores a valid / invalid setting of the open / close detection information, and a means for determining whether the open / closed detection information is set to valid or invalid with reference to the storage means when the open / close detection information is received. 4. The visitor notification / warning system according to claim 1, wherein the visitor photographing and the conversation contents are recorded only when it is set to be valid. 5. The visitor notification / warning according to claim 1, 2, 3 or 4, wherein said portable terminal further has means for converting recorded information of conversation contents into text, and said voice file is voice text information. system. The visitor notification according to any one of claims 1 to 5, wherein data transmission / reception between the door opening / closing sensor and the mobile terminal is performed by short-range wireless communication including Bluetooth communication or wired communication including a USB cable. -Warning system. A portable terminal connected to a door opening / closing sensor,
Means for receiving opening / closing detection information from the door opening / closing sensor to record a visitor's shooting and conversation content; means for sending a mail with a captured image file and a voice file of the conversation content to a predetermined report destination; A means for collating whether or not a warning target word is included in the conversation content; and a means for outputting a warning sound when a warning target word is included or when a reply mail is received from the report destination A mobile terminal characterized by. A portable terminal connected to a door opening / closing sensor,
Means for receiving opening / closing detection information from the door opening / closing sensor to capture a visitor's image and recording conversation content; means for checking whether the conversation content includes a warning target word; and a warning target word In this case, a means for transmitting an email attached with a photographed image file and a voice file of conversation contents to a predetermined report destination and outputting a warning sound, and outputting a warning sound when a reply mail is received from the report destination And a mobile terminal. A portable terminal connected to a door opening / closing sensor,
Means for receiving opening / closing detection information from the door opening / closing sensor to record a visitor's shooting and conversation content; means for sending a mail with a captured image file and a voice file of the conversation content to a predetermined report destination; And a means for outputting a warning sound when a reply mail is received from the report destination. Storage means for storing the valid / invalid setting of the opening / closing detection information, and means for determining whether the setting is valid or invalid with reference to the storage means when the opening / closing detection information is received, 10. The portable terminal according to claim 7, 8 or 9, wherein a visitor's photographing and conversation contents are recorded only when it is set to be valid. 11. The portable terminal according to claim 7, further comprising means for converting recorded information of conversation contents into text, wherein the voice file is voice text information. The mobile terminal according to any one of claims 7 to 11, wherein data transmission / reception with the door opening / closing sensor is performed by short-range wireless communication including Bluetooth communication or wired communication including a USB cable. A first step in which the door opening / closing sensor detects opening / closing of the door and transmits opening / closing detection information to the portable terminal; and a second step in which the portable terminal receives the opening / closing detection information to capture a visitor and record conversation contents. A third step in which the portable terminal transmits an email attached with a photographed image file and a voice file of the conversation content to a predetermined report destination, and whether the warning content includes the warning target word in the conversation content And a fifth step in which the portable terminal outputs a warning sound when a warning target word is included or when a reply mail is received from the report destination. A unique visitor notification / warning method. A first step in which the door opening / closing sensor detects opening / closing of the door and transmits opening / closing detection information to the portable terminal; and a second step in which the portable terminal receives the opening / closing detection information to capture a visitor and record conversation contents. , A third step in which the mobile terminal collates whether a warning target word is included in the conversation content, and if the warning target word is included, the mobile terminal A fourth step of sending a mail with an attached audio file to a predetermined report destination and outputting a warning sound; and a fifth step of outputting a warning sound by the portable terminal when a reply mail is received from the report destination A visitor notification / warning method characterized by comprising: A first step in which the door opening / closing sensor detects opening / closing of the door and transmits opening / closing detection information to the portable terminal; and a second step in which the portable terminal receives the opening / closing detection information to capture a visitor and record conversation contents. A third step in which the portable terminal transmits a mail with a captured image file and an audio file of conversation content attached thereto to a predetermined report destination, and when the portable terminal receives a reply mail from the report destination, And a fourth step of outputting a warning sound. A function that receives open / close detection information from an external device and records the visitor's shooting and conversation content, a function that sends a mail with a captured image file and a voice file of the conversation content to a predetermined report destination, and alerts the conversation content A program for causing a computer to realize a function of checking whether a target word is included, a function of outputting a warning sound when a warning target word is included, or when a reply mail is received from the report destination . A function that receives open / close detection information from an external device and captures the visitor's shooting and conversation content, a function that checks whether the conversation content contains a warning target word, or a warning target word A function for sending a mail with a photographed image file and a voice file with a conversation content attached to a predetermined report destination and outputting a warning sound, and a function for outputting a warning sound when a reply mail is received from the report destination. A program to make it happen. A function for receiving opening / closing detection information from an external device and recording a visitor's photographing and conversation contents, a function for sending a mail with a photographed image file and a conversation contents voice file attached to a predetermined report destination, from the report destination A program that enables a computer to output a warning sound when a reply mail is received.

Images