JP2016158171A - Notification device and intercom system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a technique of rapidly notifying visit of a visitor to a resident.SOLUTION: A first acquiring part 70 acquires image data obtained by imaging a visitor. A fourth acquiring part 94 acquires information which the visitor is made to input and which is associated with an attribute containing the visitor. An instruction part 98 transmits a message containing the content of information acquired by the fourth acquiring part 94 to a resident when the visitor picked up in the image data acquired by the first acquiring part 70 is an attribute which needs transmission of a message to the resident through communication.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an interphone, and more particularly to a notification device and an interphone system for an interphone installed in an apartment or a detached house.

  The intercom device responds automatically or manually to visitors to the apartment or detached house. The intercom outdoor unit in the intercom apparatus is equipped with a camera, and visitors are classified into categories such as a carrier by analyzing images captured by the camera. Further, the intercom apparatus selects and outputs response information to the visitor according to the classification result and the resident's state (for example, see Patent Document 1).

JP 2012-10200 A

  If the carrier visits when the resident is absent, the resident cannot receive the package. At that time, the absentee slip is put in a post box or a delivery box is used. However, even if the absentee slip is put in the post box, the response cannot be started until the resident returns home. In addition, the delivery box cannot be used if there is no space in the delivery box or the package is a refrigerated product. For this reason, it is desirable to promptly notify the absent resident of the delivery.

  The present invention has been made in view of such circumstances, and an object of the present invention is to provide a technique for promptly transmitting a visit of a visitor to a resident.

  In order to solve the above problems, a notification device according to an aspect of the present invention includes an image data acquisition unit that acquires image data captured by a visitor, information that is input to the visitor, and the visitor A related information acquisition unit that acquires information related to an attribute that includes a visitor captured by the image data acquired by the image data acquisition unit is an attribute that requires transmission of a message to a resident by communication In some cases, an instruction unit that transmits a message including the content of the information acquired in the related information acquisition unit to the resident is provided.

  Another aspect of the present invention is an intercom system. The interphone system includes an interphone outdoor device, a control device connected to the interphone outdoor device, and an interphone indoor device connected to the control device. An image data acquisition unit that acquires image data captured by a visitor by one or more of an intercom outdoor device, a control device, and an intercom indoor device, and information that is input to the visitor and that visitor A related information acquisition unit that acquires information related to an attribute that includes a visitor captured by the image data acquired by the image data acquisition unit is an attribute that requires transmission of a message to a resident by communication In some cases, an instruction unit that transmits a message including the contents of the information acquired in the related information acquisition unit to the resident is provided.

  It should be noted that any combination of the above-described constituent elements and a representation of the present invention converted between a method, an apparatus, a system, and the like are also effective as an aspect of the present invention.

  According to the present invention, a visit of a visitor can be immediately communicated to a resident.

It is a figure which shows the structure of the intercom system which concerns on Example 1 of this invention. FIGS. 2A and 2B are diagrams illustrating the data structure of the table held in the classification unit of FIG. It is a figure which shows the data structure of the database of FIG. 4A and 4B are diagrams showing images displayed on the display unit of FIG. FIGS. 5A and 5B are diagrams showing the contents of a message transmitted in response to an instruction from the instruction unit in FIG. It is a flowchart which shows the classification | category procedure by the production | generation part of FIG. It is a flowchart which shows the memory | storage procedure by the production | generation part of FIG. It is a flowchart which shows another memory | storage procedure by the production | generation part of FIG. It is a flowchart which shows the process sequence by the intercom indoor apparatus of FIG. It is a flowchart which shows the transmission procedure of the message by the notification part of FIG. FIGS. 11A to 11B are diagrams illustrating the contents of a message transmitted in response to an instruction from the instruction unit according to the second embodiment of the present invention. It is a figure which shows the structure of the notification part which concerns on Example 3 of this invention. It is a flowchart which shows the transmission procedure of the message by the notification part of FIG. It is a figure which shows the structure of the intercom system which concerns on Example 4 of this invention. It is a figure which shows the structure of the intercom system which concerns on Example 5 of this invention.

Example 1
Before describing the present invention in detail, an outline will be described. Embodiment 1 of the present invention relates to an intercom system installed in an apartment or a detached house. In the intercom system, an intercom indoor device is installed in a dwelling unit, and an intercom outdoor device is installed in a lobby of a condominium or a detached entrance, and these are connected by a signal line or the like. When the visitor presses the button on the intercom outdoor device, the intercom indoor device outputs a ringing tone, so that the intercom system informs the resident of the visit of the visitor. This visitor includes a family member, a friend, a carrier, a salesman, etc., and the content of the resident's reception varies depending on the type of visitor. In particular, when the visitor is a carrier, if the resident is absent, as described above, it is necessary to promptly notify the visitor of the visitor to the resident.

  Here, for all visitors, it is conceivable that message reception and mail transfer are performed on the assumption that the user is away, but this is not preferable in consideration of safety and the trouble of the resident. In addition, a major shipping company provides a service that informs the delivery status by e-mail. In order to use this service, advance registration is required for each shipping company. Under such circumstances, when the visitor's attribute is specified as a carrier, this embodiment transmits the information to the resident by e-mail or the like. At that time, the visitor is instructed by an automatic response to hold the delivery slip over the imaging device, and image information obtained by capturing the delivery slip is attached to the mail. In addition, a character recognition process may be performed with respect to image information, and a shipping company name discrimination | determination result may be described in mail.

  In order to specify the attributes of visitors, a database showing the correspondence between the visitor's image data and attributes is provided, and the image data and database of the newly visited visitors are stored. To be compared. A highly accurate database generally needs to be generated by a resident, and the operation input of the resident is a prerequisite. In order to reduce the burden on the resident due to this, in this embodiment, the attributes of the visitors are automatically classified from the past response results, and the classification results are stored in the database together with the visitor image data. For example, if the response result is “a resident comes in front of the intercom indoor device but does not respond” when the ringing tone is heard, the attribute of the visitor is a person who does not need to respond. Further, if the response result is “the resident responded but did not unlock”, the attribute of this visitor is also a person who does not need to respond. Further, if the response result is “the resident responded and there was a keyword such as“ Ima ”” from the visitor and was unlocked ”, the attribute of the visitor is a family. In addition, if the response result is that the resident responds and there are keywords such as “delivery” and “XX transportation” from the visitor, then the visitor attribute is the carrier. is there.

  FIG. 1 shows a configuration of an intercom system 100 according to Embodiment 1 of the present invention. The intercom system 100 includes an intercom outdoor device 10, a control device 12, an intercom indoor device 14, and a mail server 16. The intercom outdoor device 10 includes a call operation unit 20, a microphone 22, a speaker 24, an outdoor sound processing unit 26, an imaging device 30, an image processing unit 32, an identification processing unit 34, a database 36, an unlocking processing unit 38, and an outdoor use. IF42 is included. The intercom outdoor device 10 is connected to the door 40. The intercom indoor device 14 includes an indoor IF 50, an indoor audio processing unit 52, a microphone 54, a speaker 56, a display unit 58, a generation unit 60, a notification unit 62, and an unlocking operation unit 64. The generation unit 60 includes a first acquisition unit 70, an extraction unit 72, a second acquisition unit 74, a classification unit 76, a sensor 78, a third acquisition unit 80, and a storage execution unit 82. The storage execution unit 82 is a confirmation unit 84. including. The notification unit 62 includes a first acquisition unit 70, a specification unit 90, and a processing unit 92, the processing unit 92 includes a fourth acquisition unit 94 and an instruction unit 98, and the fourth acquisition unit 94 includes a request unit 96. .

  The intercom system 100 is installed in an apartment as an example. The intercom outdoor device 10 is installed in a lobby of an apartment and is also called a lobby intercom. The intercom outdoor device 10 may be a door intercom installed at the entrance of the dwelling unit, but the description of the case where it is a door intercom will be omitted below. The intercom indoor device 14 is installed in a dwelling unit and is also called a dwelling unit. The control device 12 is installed in a common space such as a machine room or an administrator room, and relays a signal between the intercom outdoor device 10 and the intercom indoor device 14.

  In FIG. 1, only one intercom indoor unit 14 installed in one dwelling unit is shown to simplify the description. However, there are many dwelling units in the apartment, and the intercom indoor unit 14 is installed in each dwelling unit. Each of the plurality of intercom indoor devices 14 is connected to the control device 12 and is connected to the intercom outdoor device 10 via the control device 12. Therefore, the control device 12 relays between the plurality of intercom indoor devices 14 and the intercom outdoor device 10. In such a configuration, the visitor inputs a room number to the intercom outdoor device 10 and makes a call to the visited intercom indoor device 14.

  In the following, for clarity of explanation, the configuration of the intercom system 100 is (1) basic processing between the intercom outdoor device 10 and the intercom indoor device 14, (2) generation processing for generating a database, (3 ) The explanation will be divided into response processing for responding to visitors using a database. Actually, when a new visitor visits, both the generation process and the response process are executed.

(1) Basic Processing The call operation unit 20 of the intercom outdoor device 10 is a user interface for receiving visitor operations. Specifically, a numeric keypad button for entering a room number and a call button are included. The call operation unit 20 outputs a call signal corresponding to the received operation to the outdoor IF 42. Note that at the timing when the call operation unit 20 outputs a call signal, a microphone 22, a speaker 24, an outdoor sound processing unit 26, an imaging device 30, an image processing unit 32, and the like, which will be described later, start processing. Therefore, the visitor operating the call operation unit 20 serves as a start trigger for a series of processes described below.

  The microphone 22 and the speaker 24 are user interfaces for a visitor to talk with a resident. The microphone 22 collects the voice of the visitor, converts it into an electrical signal, and outputs it to the outdoor audio processing unit 26. The speaker 24 reproduces the electrical signal from the outdoor sound processing unit 26 and outputs the sound. The outdoor audio processing unit 26 receives an electrical signal from the microphone 22 and converts it into a signal in a format for transmission to the intercom indoor device 14 (hereinafter referred to as “audio signal”). The outdoor audio processing unit 26 outputs an audio signal to the outdoor IF 42. On the other hand, the outdoor audio processing unit 26 receives an audio signal generated in the intercom indoor device 14 from the outdoor IF 42 and converts it into an electric signal. The outdoor sound processing unit 26 outputs an electrical signal to the speaker 24.

  The imaging device 30 is for photographing a visitor, and includes a solid-state imaging device such as a complementary metal oxide semiconductor (CMOS) image sensor or a charge coupled device (CCD) image sensor. The solid-state imaging device outputs a video signal obtained by photoelectric conversion to the image processing unit 32. The image processing unit 32 has a frame memory for storing a video signal from the imaging device 30. The image processing unit 32 executes various signal processes on the video signal stored in the frame memory. The various signal processes include, for example, an exposure control process for controlling the exposure of the video signal, a color balance control process for controlling the color balance of the video signal, a gradation characteristic control process for controlling the gradation characteristic of the video signal, Contour emphasis control processing for controlling the contour emphasis degree is included. The image processing unit 32 outputs a video signal (hereinafter referred to as “image data”) on which the signal processing has been performed to the identification processing unit 34 and the outdoor IF 42.

  The door 40 is provided in the lobby, and a key part (not shown) is provided. The key part can be locked / unlocked electronically, and the key part is usually locked. The unlocking processing unit 38 unlocks the key part of the door 40 when receiving the unlocking signal generated in the intercom indoor device 14 from the outdoor IF 42. The unlocked key part is locked after a certain period. Further, when the key part of the door 40 is unlocked by the visitor, the door 40 notifies the unlocking processing part 38 that the door is unlocked. When unlocking is notified, the unlocking processing unit 38 outputs an unlock signal to the outdoor IF 42. The outdoor IF 42 is a communication interface for communicating the call signal, voice signal, image data, and unlock signal with the control device 12. The call signal and image data are one-way communication from the outdoor IF 42 to the control device 12, and the voice signal and the unlock signal are two-way communication between the outdoor IF 42 and the control device 12.

  The indoor IF 50 of the intercom indoor device 14 is a communication interface for communicating with the control device 12. The indoor IF 50 executes processing corresponding to the outdoor IF 42. Therefore, the call signal and the image data are one-way communication from the control device 12 to the indoor IF 50, and the voice signal and the unlock signal are two-way communication between the indoor IF 50 and the control device 12. The display unit 58 receives the image data from the indoor IF 50 and reproduces the image data to display an image, particularly an image taken by a visitor.

  The microphone 54 and the speaker 56 are user interfaces for a resident to talk with a visitor. The microphone 54 and the speaker 56 execute the same processing as the microphone 22 and the speaker 24. The indoor audio processing unit 52 performs processing corresponding to the outdoor audio processing unit 26, converts the electrical signal received from the microphone 54 into an audio signal, outputs the audio signal to the indoor IF 50, and from the indoor IF 50. The received audio signal is converted into an electric signal and output to the speaker 56. The unlocking operation unit 64 is a user interface for receiving a resident's operation. Specifically, an unlock button and a call button are included.

  With such a configuration, the resident hears the ringing sound output from the speaker 56 of the intercom indoor device 14, sees the image of the visitor displayed on the display unit 58, and determines whether to respond. Here, the resident may make a call with the visitor while using the microphone 54 and the speaker 56 of the intercom indoor device 14. When inviting a visitor to the dwelling unit as a reception, the resident pushes the unlocking operation unit 64 to unlock the key part of the door 40. The (2) generation process and (3) reception process at that time will be described next.

(2) Generation Processing The identification processing unit 34 receives image data from the image processing unit 32. The identification processing unit 34 extracts a face image (face region) of a person from the image data, and features of the face of the person from the extracted face image (for example, facial organs such as eyes, nose, mouth) A feature amount extraction process for extracting information corresponding to the feature of the shape is executed. The identification processing unit 34 outputs the image data (hereinafter also referred to as “image data”) on which these processes have been performed to the outdoor IF 42. This image data is input to the first acquisition unit 70 via the control device 12 and the indoor IF 50.

  The first acquisition unit 70 acquires image data obtained by capturing an image of a visitor and from the identification processing unit 34. The first acquisition unit 70 outputs the image data to the extraction unit 72, the classification unit 76, and the specifying unit 90. The second acquisition unit 74 acquires a resident's response result for a visitor captured in the image data acquired by the first acquisition unit 70. The response result is information relating to (1) the response indicated in the basic process, and (3) the result indicated by the resident who is indicated in the response process. The response result is output from the unlocking operation unit 64 and the room audio processing unit 52. More specifically, the response result from the unlocking operation unit 64 indicates whether the unlocking operation has been performed or whether the unlocking operation has not been performed. On the other hand, the response result from the room audio processing unit 52 indicates whether the call operation with the visitor has been executed or the call operation with the visitor has not been executed. If the call operation has been executed, the voice signal of the call content is included in the response result. The second acquisition unit 74 outputs the response result to the extraction unit 72 and the classification unit 76.

  The extraction unit 72 inputs the image data acquired by the first acquisition unit 70 and the reception result acquired by the second acquisition unit 74. The extraction unit 72 extracts a keyword related to a visitor from at least one of the image data and the response result. More specifically, the extraction unit 72 extracts a part suitable for identifying a trader as a partial image from the image area of the person included in the image data. Locations suitable for identifying traders include emblems that display the trader's company name and logo, etc. affixed to the chest, arms, and hats of visitors, luggage that visitors bring, and visitors The face etc. In addition, the extraction unit 72 classifies and stores in advance data for identifying which trader the visitor is (hereinafter referred to as “identification data”). For example, the identification data is classified according to the type of business such as a newspaper or a carrier. For the sake of clarity, it is assumed that the identification data is an image of an emblem for identifying the carrier. The extraction unit 72 compares the partial image with the identification data to determine whether or not the visitor is a carrier. If it is a carrier, the extraction unit 72 outputs the carrier as a keyword to the classification unit 76.

  In parallel with such processing, the extraction unit 72 converts the voice signal into character information by executing voice recognition processing on the voice signal of the call content. In addition, the extraction unit 72 holds in advance a character string (hereinafter referred to as “identification character string”) for identifying a trader, family, and the like. For example, identification strings for identifying family members are “Now”, “Return”, etc., and identification strings for identifying carriers, especially carriers, are “delivery” and “XX transportation”. Etc. Note that the identification character string may be used to identify persons other than the trader and the family. The extraction unit 72 refers to the character information and the identification character string to determine whether the visitor is a family or a carrier. The extraction unit 72 outputs the family as a keyword to the classification unit 76 when it is a family, and outputs the carrier as a keyword to the classification unit 76 when it is a carrier.

  The sensor 78 is a human sensor for detecting whether a resident is present in front of the intercom indoor device 14 after a call signal from the call operation unit 20 is output. A known technique may be used for the sensor 78, but the sensing area is set so that a resident present in front of the intercom indoor device 14 can be detected. Note that an imaging device is provided instead of the sensor 78, and whether or not the resident is present in front of the intercom indoor device 14 depending on whether or not the resident is included in the image data captured by the imaging device. May be detected. Here, the case where the resident is present in front of the intercom indoor device 14 corresponds to the case where the resident is available, and the case where the resident is not present in front of the interphone indoor device 14 is that the resident is not acceptable. This corresponds to the case where it is possible. The sensor 78 outputs information regarding whether or not the resident is available (hereinafter referred to as “possible information”) to the third acquisition unit 80.

  The third acquisition unit 80 acquires possible information from the sensor 78. The third acquisition unit 80 outputs the possible information to the classification unit 76. Note that when the home mode and the absence mode can be set for the intercom indoor device 14, the third acquisition unit 80 may acquire the setting information for the home mode or the absence mode. Here, the home mode is a processing mode of the intercom indoor device 14 on the assumption that there is a resident in the dwelling unit, and the absence mode is an interphone indoor device on the assumption that there is no resident in the dwelling unit. 14 processing modes. In that case, the third acquisition unit 80 outputs the setting information and the possible information to the classification unit 76 in the home mode. On the other hand, in the absence mode, the third acquisition unit 80 outputs only the setting information to the classification unit 76.

  When the indoor IF 50 receives the unlock signal from the control device 12, the indoor IF 50 outputs the unlock signal to the classification unit 76. This corresponds to a case where the visitor himself unlocks, and the occurrence of such a situation is notified to the classification unit 76.

  The classification unit 76 receives the reception result from the second acquisition unit 74, the image data from the first acquisition unit 70, the keyword from the extraction unit 72, the possible information from the third acquisition unit 80, and the unlock signal from the indoor IF 50. Accept. Based on these, the classification unit 76 classifies the visitors imaged in the image data acquired by the first acquisition unit 70 into any of a plurality of attributes defined according to the reliability of the visitors. . Visitor reliability refers to visitor reliability for residents. For example, when the reliability is defined in three stages of high, medium, and low, the reliability of the family / friend is “high”, the reliability of the carrier is “medium”, and the trust of the person who does not need to be answered Sex is “low”. The reliability may be defined in more stages than three stages, for example, four stages, and the reliability of family and friends may be separated. In that case, family reliability is defined to be higher than friend reliability. Further, reliability may be defined for a person other than a family member, a friend, a carrier, or an unneeded person. Here, a plurality of attributes are defined according to the reliability. Further, reliability may be defined in two stages. When the reliability is defined in three stages, an attribute corresponding to high reliability, an attribute corresponding to medium reliability, and an attribute corresponding to low reliability are defined. An attribute corresponding to high reliability may be simply referred to as “high reliability”. The same applies to attributes corresponding to medium reliability and attributes corresponding to low reliability.

  2A and 2B show the data structure of the table held in the classification unit 76. FIG. In FIG. 2A, “unlocking operation present / not” and “call operation present / not” as correspondence information, keyword, resident status as possible information, “self-unlocking / unlocking” as unlocking signal. The attribute to be selected in accordance with “unlocked” is shown. The classification unit 76 selects any attribute based on the received information while referring to this table.

  First, the case where the unlocking operation is not executed in the response result will be described. It is assumed that there is no unlocking. Under such circumstances, when the response result also indicates that the call operation with the visitor has not been executed, the classification unit 76 determines the classification according to the possible information. That is, if the unlocking operation has not been performed and the call operation has not been performed, the classifying unit 76 classifies the visitor according to the attribute corresponding to low reliability if the resident can respond. On the other hand, if the unlocking operation is not executed and the call operation is not executed, the classification unit 76 holds the visitor classification if the resident is not available. At that time, if a transportation-related keyword is acquired, the classification unit 76 may classify the visitor into an attribute corresponding to medium reliability. Whether it is classified as an attribute corresponding to medium reliability or is suspended depends on the resident's pre-setting or post-confirmation.

  Further, under the above-described situation, if the response result also indicates that the call operation with the visitor has been executed, the classification unit 76 classifies the visitor into an attribute corresponding to low reliability. At that time, if a transportation-related keyword is acquired, the classification unit 76 may classify the visitor into an attribute corresponding to medium reliability. This corresponds to the case where the keyword includes “delivery box”, “shipping company name”, “delivery thing”, etc., or the delivery box is used immediately after. On the other hand, even if a transportation-related keyword is acquired, if classification into attributes corresponding to low reliability is performed, the classification unit 76 considers that a transportation-related keyword has been erroneously recognized.

  On the other hand, even if the response result indicates that the unlocking operation has not been performed, the classification unit 76 visits an attribute (family) corresponding to high reliability if the unlocking operation is performed by itself. Classify people. This is because, as described above, self-unlocking is generally feasible only for the family.

  Next, the case where the unlocking operation has been executed in the response result will be described. Under such circumstances, if the response result also indicates that the call operation with the visitor has not been executed, the classification unit 76 classifies the visitor into an attribute corresponding to high reliability. As described above, family members and friends are included in the high reliability. If registered as a family, the classification unit 76 classifies the visitor toward the family among the attributes corresponding to the high reliability. To do. If the unlocking operation has been executed and the call operation with the visitor has not been executed, the keyword cannot be extracted. On the other hand, the keyword related to transportation is acquired. If this is the case, the classification unit 76 regards the transportation-related keyword as being erroneously recognized.

  In addition, under the above-described situation, if the reception result also indicates that the call operation with the visitor has been executed, the classification unit 76 determines the classification according to the keyword. When the keyword is a family greeting, the classification unit 76 classifies the visitor into an attribute (family) corresponding to high reliability, and when the keyword is related to transportation, the classification unit 76 visits the attribute corresponding to medium reliability. Classify people. On the other hand, when the keyword is not one of these, the classification unit 76 classifies the visitor into an attribute (friend) corresponding to high reliability.

  In FIG.2 (b), the state of an indoor apparatus is shown instead of the state of the resident in Fig.2 (a). The state of the indoor device is specified by “absence mode / home mode” as setting information and “no access / present” as possible information. Since the classification process in the classification unit 76 is the same as before, description thereof is omitted here. Returning to FIG.

  The storage execution unit 82 receives the classification result in the classification unit 76. The classification result includes, for example, image data and attribute information. The storage execution unit 82 stores the classification result in the database 36 via the indoor IF 50, the control device 12, and the outdoor IF 42. FIG. 3 shows the data structure of the database 36. As shown, an image data column 200, a name column 202, and an attribute column 204 are included. The image data column 200 shows image data. Since the image data is subjected to predetermined processing in the identification processing unit 34, the image data column 200 may include a result of the predetermined processing. The attribute column 204 includes attribute information. The attribute information is shown in the same manner as in FIGS. The name column 202 shows the name of the visitor. The name may be registered by ex-post confirmation or may be omitted. Returning to FIG.

  Among the information stored in the database 36, visitors included in attributes (family) and (friends) corresponding to high reliability are different for each unit. On the other hand, visitors included in attributes corresponding to medium reliability and attributes corresponding to low reliability are common to all dwelling units. Therefore, at least one of the attribute corresponding to the medium reliability and the attribute information corresponding to the low reliability in the database 36 is shared among the residents living in each of the plurality of dwelling units.

  As described above, the storage execution unit 82 automatically stores the classification result in the classification unit 76 in the database 36. In order to further improve the classification accuracy of the information stored in the database 36, the following manual processing is performed. May additionally be performed. Here, two additional processes will be described. In the first additional process, when the storage execution unit 82 receives the classification result in the classification unit 76, the storage execution unit 82 confirms whether the classified visitor is already stored in the database 36. If stored, the same processing as before is executed. In this case, since it is not necessary to change the name and attributes stored in the database 36, new image data is added and stored, or new image data is stored so that it can be replaced with already stored image data. Or On the other hand, when it is unstored, the confirmation unit 84 confirms the classification result with the resident. More specifically, the confirmation unit 84 causes the display unit 58 to display the classification result via a signal line (not shown).

  FIGS. 4A and 4B show images displayed on the display unit 58. FIG. FIG. 4A shows an image displayed when the classified visitor is not stored in the database 36. As shown, the image data, name, and attribute of the visitor are shown. The display unit 58 displays a yes button 110 and a correction button 112. When the display unit 58 is configured by a touch panel, when the resident presses the yes button 110, the storage execution unit 82 stores the classification result in the database 36. On the other hand, when the resident presses the correction button 112, the classification result can be corrected. At that time, a name may be input. When the correction is completed, the storage execution unit 82 stores the classification result in the database 36. In this manner, the storage execution unit 82 stores the classification result confirmed by the confirmation unit 84 in the database 36. Returning to FIG.

  In the second additional process, when the storage execution unit 82 receives the classification result in the classification unit 76, the storage execution unit 82 displays the classification result stored in the database 36 and the classification result for the same visitor. Check. If the two match, the same processing as before is executed. On the other hand, if different, the confirmation unit 84 confirms with the resident whether to select any of the classification results. More specifically, the confirmation unit 84 causes the display unit 58 to display the classification result via a signal line (not shown).

  FIG. 4B is an image that is displayed when the classification results do not match. As shown in the figure, together with the image data, the newly accepted classification result is indicated as “A”. Further, the classification result stored in the database 36 is indicated as “B”. Further, an A selection button 114 and a B selection button 116 are displayed on the display unit 58. When the display unit 58 is configured by a touch panel, when the resident presses the A selection button 114, the storage execution unit 82 stores the newly accepted classification result in the database 36. On the other hand, when the resident presses the B selection button 116, the storage execution unit 82 does not store the newly received classification result in the database 36, but maintains the classification result stored in the database 36 as it is. Thus, the storage execution unit 82 stores the classification result selected by the confirmation in the confirmation unit 84 in the database 36. Returning to FIG.

(3) Response processing The identification unit 90 receives the image data acquired by the first acquisition unit 70. The specifying unit 90 refers to the database 36 via the indoor IF 50, the control device 12, and the outdoor IF 42. The specifying unit 90 compares the plurality of image data included in the database 36 with the image data received from the first acquisition unit 70. Since a known technique may be used for the image data comparison process, description thereof is omitted here. The specifying unit 90 is image data in which the difference in the comparison result is included in a predetermined range, and the image data included in the database 36 is image data that matches the image data received from the first acquisition unit 70. select. The specifying unit 90 extracts the visitor attributes corresponding to the selected image data from the database 36. This is equivalent to specifying the attributes of the visitors imaged in the image data acquired by the first acquisition unit 70. On the other hand, when there is no image data to be selected, the specifying unit 90 specifies that there is no attribute that includes a visitor. The identifying unit 90 outputs the identified attribute to the processing unit 92.

  The processing unit 92 receives attribute information from the specifying unit 90. The processing unit 92 executes processing for the resident in accordance with the received attribute. For example, the processing unit 92 changes the type of ringing sound output from the speaker 56 of the intercom indoor device 14 according to the attribute. Note that the attribute here includes a case where there is no attribute that includes a visitor. Further, when the attribute corresponds to the low reliability, the processing unit 92 does not need to output a ringing sound from the speaker 56 of the intercom indoor device 14. The processing unit 92 may display attribute information on the display unit 58 together with the image data. In addition, when the attribute corresponds to the low reliability, the processing unit 92 rejects a visit such as “It cannot be relayed for convenience. The manager in case of use…” from the speaker 24 of the intercom outdoor device 10. The message may be output by voice. In addition, when the attribute corresponds to the medium reliability, the processing unit 92 may output a message indicating that the use of the delivery box is permitted from the speaker 24 of the intercom outdoor device 10.

  In the following, processing when the attribute information received from the specifying unit 90 is an attribute corresponding to medium reliability, that is, when the visitor is a carrier will be described. In that case, the request unit 96 outputs a signal (hereinafter referred to as “request signal”) for requesting the visitor to hold the object held by the visitor in front of the imaging device 30 to the indoor IF 50. . Here, the objects possessed by visitors are delivery slips affixed to packages delivered by carriers, delivery slips owned separately from packages delivered by carriers, etc. Yes, it is a document that contains information to inform the residents of the contents of the package. The request signal is input from the indoor IF 50 to the outdoor audio processing unit 26 via the control device 12 and the outdoor IF 42. When the outdoor audio processing unit 26 receives the request signal, the speaker 24 outputs a message “Please hold the delivery slip in front of the camera” from the speaker 24.

  When the visitor hears this message, the visitor holds the delivery slip in front of the imaging device 30. The imaging device 30 images the delivery slip, and the image processing unit 32 outputs image data (hereinafter referred to as “image information”) obtained by capturing the delivery slip to the outdoor IF 42. Note that the image information may be output from the identification processing unit 34. The outdoor IF 42 outputs image information to the fourth acquisition unit 94 via the control device 12 and the indoor IF 50.

  The fourth acquisition unit 94 receives image information from the indoor IF 50. That is, the fourth acquisition unit 94 acquires image information that is image information in response to a request from the request unit 96 and is captured by the imaging device 30. The image information is information input by the visitor. Since the delivery slip is imaged in the image information, it can be said that the image information is information related to the attribute including the visitor. The fourth acquisition unit 94 outputs the image information to the instruction unit 98.

  When the attribute information received from the specifying unit 90 is an attribute corresponding to medium reliability, the instruction unit 98 generates a message including the content of the image information acquired by the fourth acquisition unit 94. Here, since the attribute corresponding to medium reliability includes a carrier, it can be said that this is an attribute that requires transmission of a message to a resident by communication. The message is, for example, an e-mail message. Furthermore, in order to generate a message including the contents of the image information, the instruction unit 98 attaches the image information acquired by the fourth acquisition unit 94 to the message. 5A to 5B show the contents of a message transmitted in accordance with an instruction from the instruction unit 98. FIG. In FIG. 5A, the message states that “A transportation has arrived at X hours and Y minutes”. Also, image information is attached. FIG. 5B will be described later, and the processing returns to FIG.

  The instruction unit 98 may extract character information from the image information by performing character recognition processing on the image information instead of attaching the image information to the message. Since a known technique may be used for the character recognition process, the description is omitted here. The instruction unit 98 includes the extracted character information in the message. Also in FIG. 5B, the message states that “A transportation has arrived at X hours and Y minutes”. Further, “slip number: ZZZZZZ, sender: G, contents: frozen food, telephone number: HHHH-HHH-HHH”, which is extracted character information, is also described. Returning to FIG. The instruction unit 98 causes the generated message to be transmitted to the mail server 16 via the indoor IF 50, the control device 12, and the outdoor IF 42. The address at that time is a resident.

  This configuration can be realized in terms of hardware by a CPU, memory, or other LSI of any computer, and in terms of software, it can be realized by a program loaded in the memory, but here it is realized by their cooperation. Draw functional blocks. Accordingly, those skilled in the art will understand that these functional blocks can be realized in various forms only by hardware, or by a combination of hardware and software.

  Note that the program may be stored in advance in a memory of a computer, or may be provided through a telecommunication line (not shown) or recorded in a removable recording medium.

  The operation of the intercom system 100 configured as above will be described. FIG. 6 is a flowchart showing a classification procedure by the generation unit 60. The first acquisition unit 70 acquires image data (S10). The second acquisition unit 74 acquires a response result (S12). If there is no unlocking operation (Y in S14) and self-unlocking is performed (Y in S16), the classifying unit 76 classifies visitors into attributes corresponding to high reliability (S18). If self-unlocking is not performed (N in S16), there is no call operation (Y in S20), and if it is available (Y in S22), the classification unit 76 assigns a visitor to an attribute corresponding to low reliability. Are classified (S24). If the response is not possible (N in S22), the classification unit 76 holds the classification (S26). If there is a call operation (N in S20), the classifying unit 76 classifies the visitor into an attribute corresponding to low reliability (S28).

  If there is an unlocking operation (N in S14) and there is no call operation (Y in S30), the classifying unit 76 classifies visitors into attributes corresponding to high reliability (S32). If there is a call operation (N in S30) and the keyword is related to transportation (Y in S34), the classifying unit 76 classifies visitors into attributes corresponding to medium reliability (S36). If the keyword is not transport related (N in S34), the classification unit 76 classifies the visitor into an attribute corresponding to high reliability (S38).

  FIG. 7 is a flowchart showing a storage procedure by the generation unit 60. If the visitor is not stored in the database 36 (Y in S50), the confirmation unit 84 displays a confirmation screen on the display unit 58 (S52). If the resident selects “Yes” (Y in S54), the storage execution unit 82 stores the classification result in the database 36 (S56). If the resident does not select “Yes” (N in S54), the storage execution unit 82 stores the corrected classification result in the database 36 (S58). If the visitor has been stored in the database 36 (N in S50), step 52 and step 54 are skipped, and the storage execution unit 82 stores the classification result in the database 36 (S56).

  FIG. 8 is a flowchart showing another storage procedure by the generation unit 60. The storage execution unit 82 compares the new classification result with the past classification result (S70). If they match (Y in S72), the storage execution unit 82 stores the classification result (S74). If they do not match (N in S72), the confirmation unit 84 displays a selection screen on the display unit 58 (S76). The storage execution unit 82 stores the one selected by the resident in the database 36 (S78).

  FIG. 9 is a flowchart illustrating a processing procedure performed by the intercom indoor device 14. The first acquisition unit 70 acquires image data (S90). The specifying unit 90 specifies an attribute based on the image data while referring to the database 36 (S92). The processing unit 92 executes a process according to the specified attribute (S94).

  FIG. 10 is a flowchart showing a message transmission procedure by the notification unit 62. When the attribute specified by the specifying unit 90 is an attribute corresponding to medium reliability (Y in S100), the request unit 96 outputs a request signal (S102). The fourth acquisition unit 94 acquires image information (S104). The instruction unit 98 transmits a message with image information attached (S106). If the attribute identified by the identifying unit 90 is not an attribute corresponding to medium reliability (N in S100), Steps 102 to 106 are skipped.

  According to the embodiment of the present invention, when the visitor is included in the attribute of the carrier, the information related to the attribute including the visitor is input to the visitor, and the information related to the attribute including the visitor is input. Since the message including the contents is transmitted to the resident, the visit of the visitor can be immediately transmitted to the resident. Further, since the content of information related to the attribute including the visitor is included in the message, the resident can be informed of the requirement. Further, since the visitor is requested to hold the delivery slip possessed by the visitor in front of the imaging device and the image information of the delivery slip imaged by the imaging device is acquired, detailed information can be acquired. Further, since the image information of the acquired delivery slip is attached to the message, the processing can be simplified. Further, since the character information extracted from the image information of the acquired delivery slip is included in the message, it is not necessary to attach the image information, and an increase in the capacity of the message to be transmitted can be suppressed.

  Since visitors are automatically classified into one of a plurality of attributes based on the response results of the residents, it is possible to improve the classification accuracy of the visitor attributes while suppressing processing complexity. Moreover, since the resident's reception result is used as a classification standard, the resident's intention can be reflected in the classification. In addition, when the unlocking operation is not executed, the visitors are classified into attributes corresponding to low reliability, so that the resident is alerted when a visitor who has not unlocked visits next time. Can do. Further, if the unlocking operation and the call operation are not executed even though the resident can respond, the visitors are classified into attributes corresponding to low reliability, so that the classification accuracy can be improved. In addition, if the unlocking operation and the call operation are not performed when the resident is not available, the classification is suspended, so that it is possible to avoid the execution of inaccurate processing. In addition, if the unlocking operation is not executed even though the call operation has been executed, the visitors are classified into attributes corresponding to low reliability, so that visitors who did not need to unlock can be accurately identified. Can be classified.

  In addition, if the unlocking operation is executed even though the call operation has not been executed, the visitors are classified into attributes corresponding to high reliability, so the reliability is high enough to unlock even without a call. Visitors with characteristics can be classified with high accuracy. Further, if a call operation and an unlocking operation are performed, the classification is performed according to the keyword, so that the classification accuracy can be improved. Moreover, since the attribute corresponding to medium reliability and the attribute corresponding to low reliability are shared among a plurality of residents in the database, the classification result can be used effectively.

  In addition, when the classification result is not stored in the database, the classification result is stored in the database after having the resident confirm the classification result, so that the accuracy of the information stored in the database can be improved. In addition, when the result of the new classification is different from the result of the classification already stored in the database, the result of the classification is selected by the resident, and the data is stored in the database. Can improve the accuracy of the information. In addition, it is possible to classify the attributes of visitors without any special operations, and the ringing and display of the main unit and the automatic response to visitors are optimized according to the attributes, improving convenience and safety. it can.

  The outline of one embodiment of the present invention is as follows. The notification unit 62 according to an aspect of the present invention is related to the first acquisition unit 70 that acquires image data captured by a visitor and information that is input to the visitor and includes the visitor. If the visitor imaged in the image data acquired by the fourth acquisition unit 94 and the first acquisition unit 70 that acquires the information is an attribute that requires transmission of a message to the resident by communication, And an instruction unit 98 that transmits a message including the contents of the information acquired by the 4 acquisition unit 94 to the resident.

  You may further provide the request | requirement part 96 which requests | requires a visitor to hold the object which the visitor has in front of an imaging device. The fourth acquisition unit 94 may acquire image information of the object imaged by the imaging device in response to a request from the request unit 96.

  The instruction unit 98 may include the image information of the object acquired by the fourth acquisition unit 94 in the message.

  The instruction unit 98 may include character information extracted from the image information of the object acquired by the fourth acquisition unit 94 in the message.

  Another aspect of the present invention is an intercom system 100. The intercom system 100 includes an interphone outdoor device 10, a control device 12 connected to the interphone outdoor device 10, and an interphone indoor device 14 connected to the control device 12. A first acquisition unit 70 for acquiring image data of a visitor captured by one or more of the intercom outdoor device 10, the control device 12, and the intercom indoor device 14, and information input to the visitor, And the 4th acquisition part 94 which acquires the information relevant to the attribute in which the said visitor is included, and the visitor currently imaged by the image data acquired in the 1st acquisition part 70 transmits the message to the resident by communication And an instruction unit 98 that transmits a message including the contents of the information acquired by the fourth acquisition unit 94 to the resident.

(Example 2)
Next, Example 2 will be described. The second embodiment also relates to the intercom system, similar to the first embodiment. In the first embodiment, when a visitor is classified into an attribute corresponding to medium reliability, image information obtained by capturing a delivery slip is acquired as information related to the attribute including the visitor. On the other hand, in the second embodiment, the voice information that the visitor talks about the requirements is acquired as the information related to the attribute including the visitor. The intercom system 100 according to the second embodiment is the same type as that shown in FIG. Here, it demonstrates centering on the difference with Example 1. FIG.

  The request unit 96 outputs a signal (hereinafter also referred to as “request signal”) for requesting the visitor to speak the requirements for the resident toward the microphone 22 to the indoor IF 50. Here, the request | requirement with respect to a resident is the content described in the delivery slip. The request signal is input from the indoor IF 50 to the outdoor audio processing unit 26 via the control device 12 and the outdoor IF 42. Upon receipt of the request signal, the outdoor audio processing unit 26 outputs a message “Please speak the contents of the delivery slip into the microphone” from the speaker 24.

  When the visitor hears this message, the visitor speaks the contents of the delivery slip toward the microphone 22. The outdoor audio processing unit 26 outputs an audio signal including the contents of the delivery slip (hereinafter referred to as “audio information”) to the outdoor IF 42. The outdoor IF 42 outputs audio information to the fourth acquisition unit 94 via the control device 12 and the indoor IF 50. The fourth acquisition unit 94 receives audio information from the indoor IF 50. That is, the fourth acquisition unit 94 acquires audio information according to the request from the request unit 96. The audio information is information on requirements detected by the microphone 22. The fourth acquisition unit 94 outputs the audio information to the instruction unit 98.

  When the attribute information received from the specifying unit 90 is an attribute corresponding to medium reliability, the instruction unit 98 generates a message including the content of the audio information acquired by the fourth acquisition unit 94. Further, in order to generate a message including the contents of the voice information, the instruction unit 98 attaches the voice information acquired by the fourth acquisition unit 94 to the message. FIGS. 11A and 11B show the contents of a message transmitted in response to an instruction from the instruction unit 98 according to the second embodiment of the present invention. In FIG. 11A, the message states that “A transportation has arrived at X hours and Y minutes”. Audio information is also attached. FIG. 11B will be described later, and the processing returns to FIG.

  The instruction unit 98 may extract character information from the voice information by performing a character recognition process on the voice information instead of attaching the voice information to the message. The instruction unit 98 includes the extracted character information in the message. FIG. 11B, which is a message at this time, is shown in the same manner as FIG.

  According to the embodiment of the present invention, since the request is made to the visitor to speak the requirement for the resident toward the microphone and the voice information of the requirement detected by the microphone is acquired, detailed information can be acquired. In addition, since the acquired voice information of the requirement is attached to the message, the processing can be simplified. Further, since the character information extracted from the acquired voice information of the requirement is included in the message, it is not necessary to attach the voice information, and an increase in the capacity of the message to be transmitted can be suppressed.

  The outline of one embodiment of the present invention is as follows. You may further provide the request | requirement part 96 which requests | requires a visitor to speak the requirements for a resident into a microphone. The fourth acquisition unit 94 may acquire the audio information of the requirements detected by the microphone in response to the request from the request unit 96.

  The instruction unit 98 may include the required audio information acquired by the fourth acquisition unit 94 in the message.

  The instruction unit 98 may include character information extracted from the required speech information acquired by the fourth acquisition unit 94 in the message.

(Example 3)
Next, Example 3 will be described. The third embodiment also relates to the intercom system as before. Until now, the attribute which includes a visitor is specified based on the image data which the visitor was imaged, and the information memorize | stored in the database. Further, when the specified attribute is an attribute corresponding to medium reliability, information related to the attribute including the visitor is added and acquired. On the other hand, in Example 3, when information related to an attribute including a visitor is acquired, an attribute including the visitor is specified based on the information. The intercom system 100 according to the third embodiment is the same type as that shown in FIG. The intercom indoor device 14 in the intercom system 100 according to the third embodiment does not include the generation unit 60, and (2) generation processing is not executed. Further, the configuration of the notification unit 62 is different. Here, it demonstrates centering on the difference from before.

  FIG. 12 shows the configuration of the notification unit 62 according to the third embodiment of the present invention. The notification unit 62 includes a first acquisition unit 70, a fourth acquisition unit 94, a specification unit 90, and a processing unit 92. Further, the fourth acquisition unit 94 includes a request unit 96, and the processing unit 92 includes an instruction unit 98. The 1st acquisition part 70 acquires the image data by which the visitor was imaged like before. The first acquisition unit 70 outputs the image data to the fourth acquisition unit 94. Following this, the request unit 96 outputs a request signal to the indoor IF 50. The request signal may be a signal for requesting the visitor to hold an object possessed by the visitor in front of the imaging device 30, and he / she talks to the microphone 22 about the requirements for the resident. It may be a signal for requesting a person.

  The fourth acquisition unit 94 receives image information or audio information from the indoor IF 50. The fourth acquisition unit 94 outputs the received image information or audio information to the specifying unit 90. The specifying unit 90 receives image information or audio information from the fourth acquisition unit 94. The specifying unit 90 extracts a keyword from the image information or the sound information by executing the same processing as the extraction unit 72 on the image information or the sound information. When the keyword is a carrier, the specifying unit 90 specifies that the visitor is included in the attribute corresponding to the medium reliability. When the keyword is other than the carrier, the specifying unit 90 specifies that the visitor is included in an attribute corresponding to other than medium reliability. The identifying unit 90 outputs the identified attribute to the processing unit 92.

  When receiving the attribute from the specifying unit 90, the processing unit 92 executes the same processing as before. In particular, when the attribute is an attribute corresponding to medium reliability, the instruction unit 98 transmits a message including the contents of the image information or the voice information acquired by the fourth acquisition unit 94 to the resident.

  FIG. 13 is a flowchart showing a message transmission procedure by the notification unit 62. When the first acquisition unit 70 acquires image data (Y in S120), the request unit 96 outputs a request signal (S122). The fourth acquisition unit 94 acquires image information (S124). When the attribute specified by the specifying unit 90 is an attribute corresponding to medium reliability (Y in S126), the instruction unit 98 transmits a message with image information attached (S128). If the attribute specified by the specifying unit 90 is not an attribute corresponding to medium reliability (N in S126), step 128 is skipped. When the first acquisition unit 70 does not acquire image data (N in S120), Steps 122 to 128 are skipped.

  According to the embodiment of the present invention, the attribute related to the attribute including the visitor is input to the visitor, and the attribute specified based on the information is an attribute that requires transmission of the message to the resident by communication. In this case, since the message is sent to the resident, the visit of the visitor can be immediately transmitted to the resident. Moreover, since the content of the acquired information is included in the message, the details of the content can be notified to the resident. Moreover, since the attribute is specified based on the information input by the visitor and the information is included in the message, the information can be used effectively. Moreover, since the attribute is specified based on the information input by the visitor, it is not necessary to generate a database.

Example 4
Until now, the intercom system 100 has been installed in an apartment house such as a condominium, and the generation unit 60 and the notification unit 62 are included in the intercom indoor device 14. By including the generation unit 60 and the notification unit 62 in the intercom indoor device 14, it becomes unnecessary to transmit resident approach information by the sensor 78. On the other hand, the generation unit 60 and the notification unit 62 may be included in the intercom outdoor device 10, the control device 12, and the cloud. Here, an example in which the generation unit 60 and the notification unit 62 are included in the intercom outdoor device 10 will be described.

  FIG. 14 shows a configuration of the intercom system 100 according to the fourth embodiment of the present invention. The intercom outdoor device 10 includes a call operation unit 20, a microphone 22, a speaker 24, an outdoor sound processing unit 26, an imaging device 30, an image processing unit 32, an identification processing unit 34, a database 36, an unlocking processing unit 38, and an image compression unit. Unit 150, audio compression / decompression unit 152, generation / notification unit 154, and display unit 156. The control device 12 includes an indoor IF 50, an indoor audio processing unit 52, a microphone 54, a speaker 56, a display unit 58, an unlocking operation unit 64, a sensor 78, an image expansion unit 160, an audio compression / expansion unit 162, and a call operation unit. 164. The intercom outdoor device 10 is connected to the mail server 16 and the door 40. The components indicated by the same reference numerals as those used so far execute the same processing as before. Here, it demonstrates centering on the difference from before.

  The image compression unit 150 receives the image data from the image processing unit 32 and executes image compression processing on the image data. Since a known technique may be used for the image compression processing, the description is omitted here. The image compression unit 150 outputs the image data (hereinafter also referred to as “image data”) on which the image compression processing has been performed to the outdoor IF 42.

  The audio compression / decompression unit 152 receives the audio signal from the outdoor audio processing unit 26 and executes an audio compression process on the audio signal. Since a known technique may be used for the audio compression processing, the description is omitted here. The audio compression / decompression unit 152 outputs an audio signal (hereinafter also referred to as “audio signal”) subjected to the audio compression process to the outdoor IF 42. The audio compression / decompression unit 152 receives the audio signal from the outdoor IF 42 and executes an audio expansion process on the audio signal. Since a known technique may be used for the voice decompression process, the description is omitted here. The audio compression / decompression unit 152 outputs an audio signal (hereinafter also referred to as “audio signal”) subjected to the audio expansion process to the outdoor audio processing unit 26. The generation / notification unit 154 corresponds to a configuration in which the generation unit 60 and the notification unit 62 are combined. Here, the generation / notification unit 154 receives an uncompressed audio signal from the outdoor audio processing unit 26, receives a call signal from the call operation unit 20, and receives an unlock signal from the unlock processing unit 38. The generation / notification unit 154 does not include the sensor 78. The display unit 156 displays the information generated by the generation / notification unit 154.

  The image decompression unit 160 inputs image data from the indoor IF 50 and executes image decompression processing on the image data. Since a known technique may be used for the image expansion process, the description is omitted here. The image decompression unit 160 outputs the image data (hereinafter also referred to as “image data”) subjected to the image decompression process to the display unit 58. The audio compression / decompression unit 162 executes the same processing as the audio compression / decompression unit 152, and thus the description thereof is omitted here. The call operation unit 164 is a button or the like that is used when a resident makes a call with a visitor. Until now, it was included in the unlocking operation unit 64, but here it is shown separately.

  According to the present embodiment, the generation / notification unit is a high-cost component, and since this is included in the interphone outdoor device, the number of interphone outdoor devices is smaller than that of the interphone outdoor device, so that the total system cost can be reduced. In addition, since the intercom outdoor device is in a shared part, operations such as database maintenance and operation software update can be facilitated. In addition, since the number is small, labor can be reduced. In addition, an image without deterioration before compression for transmission, or a large size image before reduction can be used when the captured image size and the transmission image size are different.

  Further, when the generation unit 60 and the notification unit 62 are included in the control device 12, only one control device 12 is normally provided in the property. Therefore, in the property including the plurality of interphone outdoor devices 10, the interphone outdoor device 10 Total system cost can be reduced compared to processing. Moreover, when the production | generation part 60 and the notification part 62 are contained in a cloud, the highly accurate process using a large-scale calculation can be performed. In addition, it is possible to refer to the database among a plurality of properties.

(Example 5)
Until now, the intercom system 100 has been installed in apartment houses such as apartments. The intercom system 100 may be installed in a detached house. In a detached house, the intercom outdoor device 10 and the intercom indoor device 14 are directly connected without the control device 12 being installed. In this case, the generation unit 60 and the notification unit 62 are included in the intercom indoor device 14 and the cloud. Here, an example in which the generation unit 60 and the notification unit 62 are included in the intercom indoor device 14 will be described.

  FIG. 15 shows the configuration of the intercom system 100 according to the fifth embodiment of the present invention. The intercom outdoor device 10 includes a call operation unit 20, a microphone 22, a speaker 24, an outdoor sound processing unit 26, an imaging device 30, an image processing unit 32, and an outdoor IF 42. The intercom indoor device 14 includes an indoor IF 50, an indoor audio processing unit 52, a microphone 54, a speaker 56, a display unit 58, a generation / notification unit 154, a call operation unit 164, and a database 36. The components indicated by the same reference numerals as those used so far execute the same processing as before. Here, the intercom outdoor device 10 corresponds to an interphone slave device, and the interphone indoor device 14 corresponds to an interphone master device. As illustrated, since the generation / notification unit 154 is included in the intercom indoor device 14, the database 36 is also included in the intercom indoor device 14.

  According to the present embodiment, since the generation / notification unit is included in the intercom indoor device, the processing can be completed within one device.

  Moreover, when the production | generation part 60 and the notification part 62 are contained in a cloud, the highly accurate process using a large-scale calculation can be performed. In addition, it is possible to refer to the database among a plurality of properties.

  In the above, this invention was demonstrated based on the Example. This embodiment is an exemplification, and it will be understood by those skilled in the art that various modifications can be made to each of those constituent elements or combinations of processing processes, and such modifications are also within the scope of the present invention. .

  In the first to fifth embodiments, the intercom system 100 is installed in an apartment or a detached house. However, the present invention is not limited to this. For example, the intercom system 100 may be installed in an office, a factory, or the like. In this case, the resident in the embodiment is an employee, or the family is an employee of the office or factory. According to this modification, the application range of the present embodiment can be expanded.

  In the first to fifth embodiments, the notification unit 62 is integrally included in the intercom outdoor device 10, the control device 12, the intercom indoor device 14, and the cloud. However, the present invention is not limited thereto, and for example, each configuration included in the notification unit 62 may be distributed and provided in two or more of the intercom outdoor device 10, the control device 12, the interphone indoor device 14, and the cloud. Moreover, the notification part 62 may be comprised separately from the intercom outdoor apparatus 10, the control apparatus 12, the intercom indoor apparatus 14, and a cloud as a notification apparatus. According to this modification, the degree of freedom of configuration can be improved.

  In the first to fifth embodiments, when the visitor operates the call operation unit 20, both the generation process and the reception process are executed. However, the present invention is not limited to this. For example, when a visitor operates the call operation unit 20, there may be a period in which only the reception process is executed and the generation process is not executed. According to this modification, the processing amount can be reduced.

  DESCRIPTION OF SYMBOLS 10 Intercom outdoor apparatus, 12 Control apparatus, 14 Interphone indoor apparatus, 16 Mail server, 20 Call operation part, 22 Microphone, 24 Speaker, 26 Outdoor sound processing part, 30 Imaging apparatus, 32 Image processing part, 34 Identification processing part , 36 database, 38 unlocking processing unit, 40 door, 42 outdoor IF, 50 indoor IF, 52 indoor audio processing unit, 54 microphone, 56 speaker, 58 display unit, 60 generation unit, 62 notification unit, 64 unlocking Lock operation unit, 70 first acquisition unit (image data acquisition unit), 72 extraction unit, 74 second acquisition unit, 76 classification unit, 78 sensor, 80 third acquisition unit, 82 storage execution unit, 84 confirmation unit, 90 identification Part, 92 processing part, 94 fourth acquisition part (related information acquisition part), 96 request part, 98 Instruction unit, 100 Intercom system.

Claims (8)

An image data acquisition unit for acquiring image data of a visitor imaged;
A related information acquisition unit that acquires information related to an attribute that is input to a visitor and includes the visitor;
When the visitor imaged in the image data acquired in the image data acquisition unit is an attribute that requires transmission of a message to a resident by communication, the content of the information acquired in the related information acquisition unit is included An instruction unit for sending the received message to the resident,
A notification device comprising: A request unit for requesting the visitor to hold the object held by the visitor in front of the imaging device;
The notification device according to claim 1, wherein the related information acquisition unit acquires image information of an object imaged by the imaging device in response to a request from the requesting unit.   The notification device according to claim 2, wherein the instruction unit includes image information of the object acquired by the related information acquisition unit in a message.   The notification device according to claim 2, wherein the instruction unit includes character information extracted from the image information of the object acquired by the related information acquisition unit in a message. And a request section that requires visitors to speak to the microphone about the requirements for the resident,
The notification apparatus according to claim 1, wherein the related information acquisition unit acquires audio information of a requirement detected by the microphone in response to a request from the request unit.   The notification device according to claim 5, wherein the instruction unit includes voice information of requirements acquired by the related information acquisition unit in a message.   The notification device according to claim 5, wherein the instruction unit includes, in a message, character information extracted from the required voice information acquired by the related information acquisition unit. Intercom outdoor equipment,
A control device connected to the intercom outdoor device;
An intercom indoor device connected to the control device,
By one or more of the intercom outdoor device, the control device, and the intercom indoor device,
An image data acquisition unit for acquiring image data of a visitor imaged;
A related information acquisition unit that acquires information related to an attribute that is input to a visitor and includes the visitor;
When the visitor imaged in the image data acquired in the image data acquisition unit is an attribute that requires transmission of a message to a resident by communication, the content of the information acquired in the related information acquisition unit is included An instruction unit for sending the received message to the resident,
An intercom system characterized by that.

Images