JP7176297B2 - Information processing device, information processing method, program and dwelling unit terminal - Google Patents

Description

The present invention relates to an information processing device, an information processing method, a program, and a dwelling unit terminal.

2. Description of the Related Art In recent years, a technique related to an intercom system for a resident to respond to a visitor is known. Here, the visitor is not necessarily someone familiar to the resident. As an example, a visitor may be a suspicious person. As an example of countermeasures against such a case, an interphone system that detects a suspicious person from an image and notifies the person has been disclosed (see, for example, Patent Document 1). In addition, an intercom system is disclosed that reports when a video of a suspicious person in the past matches (see, for example, Patent Document 2).

JP 2014-187560 A JP 2006-155273 A

However, it is not always possible for the resident to instantly grasp whether the visitor is important from the visitor's voice or video heard through the intercom. As such, residents may end up serving visitors who are not really important to them. In such a case, it takes unnecessary time and effort for the resident to respond to the visitor. In addition, there is a possibility that the resident may feel uneasy about receiving some kind of disadvantage from the visitor by responding to the visitor.

Therefore, it is possible to reduce the unnecessary time and effort of the resident to respond to the visitor, and reduce the possibility that the resident will suffer some disadvantage from the visitor by responding to the visitor. It is desired to provide a technology capable of grasping visits by visitors who are important to residents while allowing residents to keep track of their visits.

In order to solve the above problem, according to one aspect of the present invention, an acquisition unit that acquires a captured image of a visitor, a determination unit that analyzes the captured image and determines a visitor type, and Used by the visitor when the visitor type is the first type and when there is no registered feature data of a past visitor that matches or is similar to the feature data extracted from the captured image. An information processing apparatus is provided that includes an output control unit that controls connection between a device and an operator's terminal having a predetermined attribute of a contact center.

The output control unit may perform control such that the device used by the visitor and the dwelling unit terminal are connected when the visitor type is not the first type.

After the device used by the visitor and the terminal for the dwelling unit are connected, the output control unit, when a transfer operation from the resident is input to the terminal for the dwelling unit, You may control so that the terminal different from the said dwelling unit terminal may be connected.

The output control unit is used by the visitor when predetermined text data is recognized from the voice input by the visitor after the device used by the visitor and the terminal for the dwelling unit are connected. The device may be controlled so that a terminal different from the dwelling unit terminal is connected to the device in the dwelling unit.

The first type may include a type of male gender, and the predetermined attribute may include an attribute of male gender.

When the device used by the visitor is connected to the operator's terminal having the predetermined attribute, the output control unit outputs the voice received from the operator's terminal having the predetermined attribute to the visitor. You may transmit to the apparatus utilized.

When the device used by the visitor is connected to the operator's terminal having the predetermined attribute, the output control unit transmits the voice received from the operator's terminal having the predetermined attribute to the dwelling unit terminal. You may

After the device used by the visitor and the operator's terminal having the predetermined attribute are connected, the output control unit, when a response operation from the resident is input to the dwelling unit terminal, from the dwelling unit terminal The received audio may be transmitted to equipment utilized by the visitor.

The first type may be information set in advance by a resident.

When the visitor type is not the first type, the output control unit registers the past behavior information for the same type as the visitor type or for feature data that matches or is similar to the visitor's feature data. If so, it may operate based on the past behavior information.
The past behavior information may be information indicating that the resident did not perform a response operation or an unlocking operation, and if the visitor type is not the first type, and the response operation or If information indicating that the unlocking operation has not been performed is registered, control may be performed so that the device used by the visitor is connected to the operator's terminal having the predetermined attribute.

When the visitor type is the first type, and when feature data of past visitors that match or are similar to the feature data extracted from the captured image are not registered, Control may be performed so that the device used by the visitor and the operator's terminal having the predetermined attribute are connected.

When the visitor type is the first type and the transfer setting is made in advance by the resident, the output control unit selects the device used by the visitor and the predetermined attribute. You may control so that the terminal of the operator who has is connected.

The determination unit determines a resident type, and the output control unit, when the visitor type is the first type and when the resident type is the second type, the Control may be performed so that the device used by the visitor and the operator's terminal having the predetermined attribute are connected.

The second type may include a type that the gender is female.

According to another aspect of the present invention, a photographed image of a visitor is acquired, the photographed image is analyzed to determine a visitor type, and the visitor type is a first visitor type. type , and if there is no registered feature data of past visitors that matches or is similar to the feature data extracted from the captured image, the device used by the visitor and the predetermined contact center and controlling to be connected to an operator's terminal having an attribute.

According to another aspect of the present invention, a computer comprises an acquisition unit that acquires a captured image of a visitor, a determination unit that analyzes the captured image to determine a type of visitor, and the visitor If the type is the first type and if there is no registered feature data of a past visitor that matches or is similar to the feature data extracted from the captured image, the device used by the visitor and A program for functioning as an information processing apparatus is provided, which includes an output control unit for controlling connection with a terminal of an operator having a predetermined attribute of a contact center.

Further, according to another aspect of the present invention, in a dwelling unit terminal used by a resident, the visitor type determined based on the analysis of the captured image of the visitor is the first type. is controlled so that the device used by the visitor and the terminal of an operator having a predetermined attribute of the contact center are connected to each other, and the type of the visitor is not the first type; When there is no registered feature data of a past visitor that matches or is similar to the feature data extracted from the image, the device used by the visitor and the dwelling unit terminal are controlled to be connected, When the device used by the visitor and the operator's terminal having the predetermined attribute are connected, a communication unit for receiving voice from the operator's terminal having the predetermined attribute, and presenting the voice to the resident. A dwelling unit terminal is provided, comprising:

As described above, according to the present invention, residents can reduce the unnecessary trouble of responding to visitors, and it is expected that residents will receive some disadvantages from visitors by responding to visitors. It is possible to grasp visits by visitors who are important to residents while reducing the possibility of having anxiety.

1 is an explanatory diagram showing a configuration example of an information processing system according to an embodiment of the present invention; FIG. It is a block diagram which shows the functional structural example of the housing complex server which concerns on the same embodiment. It is a block diagram showing an example of the functional configuration of the entrance machine according to the same embodiment. It is a block diagram which shows the functional structural example of the dwelling unit terminal which concerns on the same embodiment. It is a block diagram showing an example of the functional configuration of a contact center server according to the same embodiment. It is a block diagram which shows the functional structural example of the operator terminal which concerns on the same embodiment. 2 is a block diagram showing an example functional configuration of a mobile terminal according to the same embodiment; FIG. It is a flowchart which shows the operation example of the information processing system which concerns on the same embodiment. It is a flowchart which shows the operation example of the information processing system which concerns on the same embodiment. It is a flowchart which shows the operation example of the information processing system which concerns on the same embodiment. It is a flowchart which shows the operation example of the information processing system which concerns on the same embodiment. It is a flowchart which shows the operation example of the information processing system which concerns on the same embodiment. It is a flowchart which shows the operation example of the information processing system which concerns on the same embodiment. It is a figure which shows the hardware constitutions of the information processing apparatus which concerns on the same embodiment.

Preferred embodiments of the present invention will be described in detail below with reference to the accompanying drawings. In the present specification and drawings, constituent elements having substantially the same functional configuration are denoted by the same reference numerals, thereby omitting redundant description.

In addition, in this specification and drawings, a plurality of components having substantially the same or similar functional configurations are distinguished by attaching different numerals after the same reference numerals. In addition, similar components in different embodiments are distinguished from each other by using the same reference numerals followed by different alphabets. However, when there is no particular need to distinguish between a plurality of constituent elements having substantially the same functional configuration, only the same reference numerals are used.

(1. Details of embodiment)
First, the details of the embodiment of the present invention will be described.

(1-1. Configuration of information processing system)
A configuration example of an information processing system according to an embodiment of the present invention will be described with reference to FIG. FIG. 1 is an explanatory diagram showing a configuration example of an information processing system according to an embodiment of the present invention. As shown in FIG. 1, an information processing system 1 according to the embodiment of the present invention includes a collective housing server 10, an entrance machine 20, a dwelling unit terminal 30, a communication device 40, a network 50, and a contact center server 60. , an operator terminal 70 , a portable terminal 80 , and a communication device 90 .

The communication device 40 is connected to the network 50 and relays communication via the network 50 by the collective housing server 10 . The communication device 90 is connected to the network 50 and relays communication via the network 50 by the contact center server 60 . In the following description, for the sake of simplicity, relaying of communication by the housing complex server 10 by the network 50 and the communication device 40 will be omitted as appropriate. Similarly, the relaying of communications by contact center server 60 by network 50 and communication device 90 is omitted as appropriate.

The entrance machine 20 is installed at the entrance of the collective housing, and is used by a person (hereinafter also referred to as a "visitor") who visits a person (hereinafter also referred to as a "resident") who lives in a dwelling unit within the collective housing. It is a device that is However, the position where the entrance machine 20 is installed may not be the entrance of the collective housing. For example, the entrance machine 20 may be installed at the entrance of some building (for example, an office building, etc.). That is, an apartment complex may be replaced by a building, a dwelling unit may be replaced by a room in the building, a resident may be replaced by a person present in a room in the building, and a visitor may be replaced by a person in the building. The person present in the room may be replaced by a person visiting. The entrance machine 20 is connected to the collective housing server 10 .

The dwelling unit terminal 30 is installed in the dwelling unit and used by the residents. The dwelling unit terminal 30 is connected to the collective housing server 10 . In addition, in the example shown in FIG. 1, one dwelling unit terminal 30 is connected to the collective housing server 10 for the sake of simplification of the drawing. However, the number of dwelling unit terminals 30 connected to the collective housing server 10 is not limited. For example, a plurality of dwelling unit terminals 30 may be connected to the collective housing server 10 .

The collective housing server 10 is configured by a computer and can function as an information processing device that performs various types of information processing. The collective housing server 10 is installed in the collective housing. However, the location where the collective housing server 10 is installed is not limited. For example, some or all of the functions of the collective housing server 10 may be possessed by a computer (for example, a server) outside the collective housing instead of the collective housing server 10 .

The operator terminal 70 is a terminal (operator's terminal) installed in the contact center and used by an operator present in the contact center. An operator terminal 70 is connected to the contact center server 60 . In the example shown in FIG. 1, one operator terminal 70 is connected to the contact center server 60 for simplicity of illustration. However, the number of operator terminals 70 connected to the contact center server 60 is not limited. For example, multiple operator terminals 70 may be connected to the contact center server 60 .

The contact center server 60 is configured by a computer. The contact center server 60 is installed in the contact center. However, the location where the contact center server 60 is installed is not limited. For example, some or all of the functions of the contact center server 60 may be provided by a computer (eg, server) outside the contact center instead of the contact center server 60 .

The mobile terminal 80 is a terminal used by a person associated with the resident. For example, the type of mobile terminal 80 is not limited. For example, the mobile terminal 80 may be a smart phone, a mobile phone, a tablet terminal, or a personal computer (for example, a notebook personal computer). . A person associated with a resident may be a person who does not actually live in the dwelling unit but has some relationship with the resident, such as the resident's father or the resident's mother. may be the resident's older brother or younger brother or the resident's older sister or younger sister.

The configuration example of the information processing system 1 according to the embodiment of the present invention has been described above.

(1-2. Functional configuration of collective housing server)
Next, a functional configuration example of the collective housing server 10 according to the embodiment of the present invention will be described. FIG. 2 is a block diagram showing a functional configuration example of the collective housing server 10 according to the embodiment of the present invention. As shown in FIG. 2, the collective housing server 10 according to the embodiment of the present invention includes a control section 110, a storage section 120 and a communication section .

The control unit 110 has a function of controlling the entire operation of the collective housing server 10 . The control unit 110 may be configured by dedicated hardware, or a CPU (Central Processing Unit) built into the collective housing server 10 stores a program stored in a ROM (Read Only Memory) in a RAM (Random Access Memory). It may be implemented by deploying to and executing. In addition to providing such a program, a storage medium storing such a program may also be provided. Control unit 110 has acquisition unit 112 , determination unit 113 and output control unit 114 . Details of the functions of these blocks will be described later.

The storage unit 120 can store programs and data for operating the control unit 110 . In addition, the storage unit 120 can also temporarily store various data necessary during the operation of the control unit 110 . For example, the storage unit 120 stores information set in advance by the resident as the preset information 121 . The storage unit 120 also stores, as action history information 122, information in which the visitor type and the past action information of the resident are associated with each other.

The communication unit 130 is a communication interface for transmitting and receiving various information to and from various devices connected to the network 50 . For example, the communication unit 130 can function as a transmission unit that transmits information to various devices connected to the network. Also, the communication unit 130 can function as a receiving unit that receives information transmitted from various devices connected to the network. In addition, the communication unit 130 has a function of communicating with the entrance machine 20 and a function of communicating with the dwelling unit terminal 30 .

The functional configuration example of the collective housing server 10 according to the embodiment of the present invention has been described above.

(1-3. Functional configuration of entrance machine)
Next, a functional configuration example of the entrance machine 20 according to the embodiment of the present invention will be described. FIG. 3 is a block diagram showing a functional configuration example of the entrance machine 20 according to the embodiment of the present invention. As shown in FIG. 3, the entrance machine 20 according to the embodiment of the present invention includes a control section 210, a sensor section 220, an operation section 230, a storage section 240, a communication section 250 and a presentation section 260.

The control unit 210 has a function of controlling the entire operation of the entrance machine 20 . The control unit 210 may be configured by dedicated hardware, or a CPU (Central Processing Unit) built in the entrance machine 20 stores a program stored in a ROM (Read Only Memory) in a RAM (Random Access Memory). It may be implemented by deploying and executing. In addition to providing such a program, a storage medium storing such a program may also be provided.

The sensor unit 220 includes various sensors and detects sensing data regarding the visitor. In this embodiment, it is assumed that the sensor unit 220 includes a microphone and a camera. The microphone is capable of detecting speech uttered by the visitor and providing the detected speech of the visitor to the control unit 210 . The camera can capture an image of the visitor and provide the image of the captured visitor to the control unit 210 . However, sensor unit 220 may include sensing devices other than microphones and cameras.

Operation unit 230 accepts an operation input by a visitor. The operation unit 230 can also provide the control unit 210 with operations received from the visitor. In this embodiment, it is mainly assumed that the operation unit 230 includes buttons, but the operation unit 230 may include input devices other than buttons. For example, the operation unit 230 may include switches or a touch panel.

The storage unit 240 can store programs and data for operating the control unit 210 . The storage unit 240 can also temporarily store various data necessary during the operation of the control unit 210 .

The communication unit 250 is a communication interface for transmitting and receiving various information to and from the housing complex server 10 . For example, the communication unit 250 can function as a transmission unit that transmits information to the collective housing server 10 . Also, the communication unit 250 can function as a receiving unit that receives information transmitted from the collective housing server 10 .

The presentation unit 260 has a function of presenting various types of information to the visitor under the control of the control unit 210 . In this embodiment, the presentation unit 260 includes a speaker, and the speaker can output the voice of the person who responds to the call from the visitor under the control of the control unit 210. . For example, a resident, a person using the mobile terminal 80, and a contact center operator can respond to a call from a visitor.

The functional configuration example of the entrance machine 20 according to the embodiment of the present invention has been described above.

(1-4. Functional configuration of dwelling unit terminal)
Next, a functional configuration example of the dwelling unit terminal 30 according to the embodiment of the present invention will be described. FIG. 4 is a block diagram showing a functional configuration example of the dwelling unit terminal 30 according to the embodiment of the present invention. As shown in FIG. 4, the dwelling unit terminal 30 according to the embodiment of the present invention includes a control section 310, a sensor section 320, an operation section 330, a storage section 340, a communication section 350 and a presentation section 360.

The control unit 310 has a function of controlling the entire operation of the dwelling unit terminal 30 . The control unit 310 may be configured by dedicated hardware, or a CPU (Central Processing Unit) built in the dwelling unit terminal 30 stores a program stored in a ROM (Read Only Memory) in a RAM (Random Access Memory). It may be implemented by deploying and executing. In addition to providing such a program, a storage medium storing such a program may also be provided.

The sensor unit 320 includes various sensors and detects sensing data regarding the resident. In this embodiment, it is assumed that the sensor unit 320 includes a microphone and a camera. The microphone can detect voices uttered by the resident and provide the detected voices of the resident to the controller 310 . The camera can take an image of the resident and provide the control unit 310 with the image of the resident. The sensor unit 320 may include sensing devices other than microphones and cameras. In addition, the camera may be installed outside the dwelling unit terminal 30 (for example, at any position within the dwelling unit), or may not be particularly installed.

Operation unit 330 receives an operation input by a resident. Further, the operation unit 330 can provide the control unit 310 with operations received from the resident. In this embodiment, it is mainly assumed that the operation unit 330 includes buttons, but the operation unit 330 may include input devices other than buttons. For example, the operation unit 330 may include switches or a touch panel.

Storage unit 340 can store programs and data for operating control unit 310 . In addition, the storage unit 340 can also temporarily store various data necessary during the operation of the control unit 310 .

The communication unit 350 is a communication interface for transmitting and receiving various information to and from the housing complex server 10 . For example, the communication unit 350 can function as a transmission unit that transmits information to the collective housing server 10 . Also, the communication unit 350 can function as a receiving unit that receives information transmitted from the collective housing server 10 .

The presentation unit 360 has a function of presenting various information to the resident under the control of the control unit 310 . In this embodiment, the presentation unit 360 includes a speaker, and the speaker can output the voice of at least one of the visitor, the operator, and the person using the mobile terminal 80 under the control of the control unit 310. is. The presentation unit 360 also includes a display, and the display can display an image of the visitor under the control of the control unit 310 .

The functional configuration example of the dwelling unit terminal 30 according to the embodiment of the present invention has been described above.

(1-5. Functional Configuration of Contact Center Server)
Next, a functional configuration example of the contact center server 60 according to the embodiment of the present invention will be described. FIG. 5 is a block diagram showing a functional configuration example of the contact center server 60 according to the embodiment of the present invention. As shown in FIG. 5, the contact center server 60 according to the embodiment of the present invention comprises a control section 610, a storage section 620 and a communication section 630. FIG.

Control unit 610 has a function of controlling the overall operation of contact center server 60 . The control unit 610 may be configured by dedicated hardware, or a CPU (Central Processing Unit) incorporated in the contact center server 60 may store a program stored in a ROM (Read Only Memory) in a RAM (Random Access Memory). It may be implemented by deploying to and executing. In addition to providing such a program, a storage medium storing such a program may also be provided.

Storage unit 620 can store programs and data for operating control unit 610 . In addition, the storage unit 620 can also temporarily store various data necessary during the operation of the control unit 610 . For example, the storage unit 620 stores information about the resident (for example, resident type, etc.) as the resident information 621 . The resident type may be the sex of the resident. The storage unit 620 also stores information about operators (for example, attributes of operators who use operator terminals) as operator information 622 . The operator attribute may be the operator's gender or the like. In addition, the storage unit 620 stores video and audio of the visitor as video audio 623 .

The communication unit 630 is a communication interface for transmitting and receiving various information to and from various devices connected to the network 50 . For example, the communication unit 630 can function as a transmission unit that transmits information to various devices connected to the network. Also, the communication unit 630 can function as a receiving unit that receives information transmitted from various devices connected to the network. In addition, the communication unit 630 has a function of communicating with the operator terminal 70 .

The functional configuration example of the contact center server 60 according to the embodiment of the present invention has been described above.

(1-6. Functional Configuration of Operator Terminal)
Next, a functional configuration example of the operator terminal 70 according to the embodiment of the present invention will be described. FIG. 6 is a block diagram showing a functional configuration example of the operator terminal 70 according to the embodiment of the present invention. As shown in FIG. 6, the operator terminal 70 according to the embodiment of the present invention includes a control section 710, a voice input section 720, an operation input section 730, a storage section 740, a communication section 750 and a presentation section 760.

The control unit 710 has a function of controlling the overall operation of the operator terminal 70 . The control unit 710 may be configured by dedicated hardware, or a CPU (Central Processing Unit) built into the operator terminal 70 stores a program stored in a ROM (Read Only Memory) in a RAM (Random Access Memory). It may be implemented by deploying and executing. In addition to providing such a program, a storage medium storing such a program may also be provided.

Voice input unit 720 includes a microphone. The microphone can detect speech uttered by the operator and provide the detected operator speech to the controller 710 .

Operation input unit 730 receives an operation input by an operator. Further, the operation input unit 730 can provide the control unit 710 with operations received from the operator. In this embodiment, it is mainly assumed that the operation input unit 730 includes buttons, but the operation input unit 730 may include input devices other than buttons. For example, the operation input unit 730 may include switches or a touch panel.

Storage unit 740 can store programs and data for operating control unit 710 . The storage unit 740 can also temporarily store various data required during the operation of the control unit 710 .

The communication unit 750 is a communication interface for transmitting and receiving various information to and from the contact center server 60 . For example, the communication section 750 can function as a transmission section that transmits information to the contact center server 60 . Also, the communication unit 750 can function as a receiving unit that receives information transmitted from the contact center server 60 .

The presentation unit 760 has a function of presenting various types of information to the operator under the control of the control unit 710 . In this embodiment, the presentation unit 760 includes a speaker, and the speaker can output the visitor's voice under the control of the control unit 710 . The presentation unit 760 also includes a display, and the display can display various information under the control of the control unit 710 . For example, the display can show a video of the visitor.

The functional configuration example of the operator terminal 70 according to the embodiment of the present invention has been described above.

(1-7. Functional Configuration of Mobile Terminal)
Next, a functional configuration example of the mobile terminal 80 according to the embodiment of the present invention will be described. FIG. 7 is a block diagram showing a functional configuration example of the mobile terminal 80 according to the embodiment of the present invention. As shown in FIG. 7, the mobile terminal 80 according to the embodiment of the present invention includes a control section 810, a voice input section 820, an operation input section 830, a storage section 840, a communication section 850 and a presentation section 860.

Control unit 810 has a function of controlling the overall operation of mobile terminal 80 . The control unit 810 may be configured by dedicated hardware, or a CPU (Central Processing Unit) built in the mobile terminal 80 may store a program stored in a ROM (Read Only Memory) in a RAM (Random Access Memory). It may be implemented by deploying and executing. In addition to providing such a program, a storage medium storing such a program may also be provided.

Voice input unit 820 includes a microphone. The microphone is capable of detecting sounds uttered by persons associated with the occupants and providing the detected sounds of the persons associated with the occupants to the controller 810 .

Operation input unit 830 receives an operation input by a person associated with the resident. Further, the operation input unit 830 can provide the control unit 810 with an operation received from a person related to the resident. In this embodiment, it is mainly assumed that the operation input unit 830 includes buttons, but the operation input unit 830 may include input devices other than buttons. For example, the operation input unit 830 may include switches or a touch panel.

Storage unit 840 can store programs and data for operating control unit 810 . The storage unit 840 can also temporarily store various data required during the operation of the control unit 810 .

The communication unit 850 is a communication interface for transmitting and receiving various information to and from various devices connected to the network 50 . For example, the communication section 850 can function as a transmission section that transmits information to various devices connected to the network 50 . Also, the communication unit 850 can function as a receiving unit that receives information transmitted from various devices connected to the network 50 .

The presentation unit 860 has a function of presenting various information to a person related to the resident under the control of the control unit 810 . In this embodiment, the presentation unit 860 includes a speaker, and the speaker can output the voice of a person related to the resident under the control of the control unit 810. FIG. Presentation unit 860 also includes a display, and the display can display various types of information under the control of control unit 810 . For example, the display can show a video of the visitor.

The functional configuration example of the mobile terminal 80 according to the embodiment of the present invention has been described above.

(1-8. Operation example of information processing system)
Next, an operation example of the information processing system 1 according to the embodiment of the present invention will be described with reference to FIGS. 8 to 13 (also referring to FIGS. 1 to 7 as appropriate). 8 to 13 are flow charts showing operation examples of the information processing system 1 according to the embodiment of the present invention. 8 to 13 merely show an example of the operation of the information processing system 1 according to the embodiment of the present invention. Therefore, all of the operation examples shown in FIGS. 8 to 13 may be executed by the information processing system 1, or only a part of the operation examples shown in FIGS. 8 to 13 may be executed by the information processing system 1. good too.

First, preset information 121 is stored in the storage unit 120 of the collective housing server 10 . The preset information 121 is information set by the resident in advance, and is information in which the visitor type and the operation information of the collective housing server 10 are associated. For example, the operation information of the collective housing server 10 includes the unlocking control of the entrance, the connection control between the entrance machine 20 and the dwelling unit terminal 30, the connection control between the entrance machine 20 and an arbitrary operator's terminal, the entrance machine 20 and a predetermined attribute , connection control between the entrance machine 20 and the portable terminal 80, notification to a security company, and the like.

In addition, action history information 122 is stored in the storage unit 120 of the collective housing server 10 . The action history information 122 is information in which visitor types, visitor feature data, and past action information by residents are associated with each other. For example, the past action information by the resident includes information indicating that a response operation was performed on the dwelling unit terminal 30, information indicating that an operation to unlock the entrance was performed on the dwelling unit terminal 30, It may be information indicating that the response operation and the unlocking operation were not performed.

When the visitor arrives at the entrance of the collective housing, the visitor inputs an operation to specify the dwelling unit terminal 30 to the operation unit 230 of the entrance machine 20 . The communication unit 250 of the entrance machine 20 transmits a call to the designated dwelling unit terminal 30 when the operation unit 230 accepts an operation to designate the dwelling unit terminal 30 (S11). The communication unit 130 of the collective housing server 10 receives the call sent by the communication unit 250 of the entrance machine 20 (S12).

When the call is received by the communication unit 130 , the acquisition unit 112 of the collective housing server 10 acquires a video (captured image) of the visitor captured by the camera of the entrance machine 20 via the communication unit 130 . Here, it is assumed that the video of the visitor is a moving image. However, the video of the visitor may be a still image. The determination unit 113 analyzes the video and determines the type of visitor visitor. Specifically, the determination unit 113 extracts the visitor's feature data (video recognition result) from the video (S13), and determines the visitor type based on the visitor's extracted data (video recognition result) (S14). ).

Here, the type of visitor is not particularly limited. For example, the visitor type may include the occupation of the visitor (courier, delivery agent, collection agent, salesman, etc.), the type indicating the resident himself, or the type of other dwelling units in the collective housing. may include a type that indicates a resident of a resident, a type that indicates a resident's close relatives (e.g., relatives of a resident), a type that indicates a suspicious person, or a gender. Alternatively, an age group (eg, 30's, etc.) may be included.

Here, it is assumed that the determination unit 113 analyzes the video and determines the visitor type. However, the determination of the visitor type by the determination unit 113 may be performed in any way. For example, the determination unit 113 may determine the visitor type by analyzing the voice uttered by the visitor detected by the microphone of the entrance device 20 instead of analyzing the video. Specifically, the determination unit 113 may extract the visitor's feature data (speech recognition result) from the voice and determine the visitor type based on the visitor's extracted data (speech recognition result). Alternatively, the determination unit 113 may determine the type of visitor by analyzing both video and audio. Also in the following description, it is mainly assumed that feature data includes both speech recognition results and video recognition results. However, the feature data may include at least one of speech recognition results and video recognition results.

Also, the determination of the visitor type by the determination unit 113 may be performed based on the association between the feature data and the visitor type. For example, the association between such feature data and visitor types may be fixed in advance. Alternatively, if a plurality of combinations of feature data and visitor types can be prepared as training data, the association between the feature data and visitor types is a module (AI ( (Artificial Intelligence) function).

The determination unit 113 determines the operation of the collective housing server 10 based on the preset information and the action history information in addition to the visitor type (S16). Various determination methods are conceivable as methods for determining the operation of the collective housing server 10 .

For example, when the first type is set in advance in association with the operation "connection control between the entrance machine 20 and an operator's terminal having a predetermined attribute" and the visitor type is the first type is assumed. In such a case, the determination unit 113 may determine the operation “connection control between the entrance machine 20 and the terminal of the operator having the predetermined attribute” as the operation of the collective housing server 10 . As a result, the resident can reduce the unnecessary trouble of responding to the visitor, and the possibility that the resident will suffer some disadvantage from the visitor by responding to the visitor. While reducing it, it is possible to grasp visits by important visitors for residents.

Here, the first type and the predetermined attribute are not limited. For example, if the visitor is male, it is possible that the resident, in particular, may have a greater fear of being disadvantaged by the visitor by attending to the visitor. Therefore, the first type may include a type of male gender, and the predetermined attribute may include an attribute of male gender. As a result, when the visitor type is male, the male operator responds to the visitor instead of the resident, so it is possible to reduce the anxiety of the resident.

The determination unit 113 may determine not only the visitor type but also the resident type. At this time, when the visitor type is the first type and the resident type is the second type, the determination unit 113 operates as the operation of the collective housing server 10 "entrance machine 20 and predetermined "connection control with terminals of operators having attributes" may be determined. For example, the determination unit 113 may determine the resident type by analyzing an image captured by the camera of the dwelling unit terminal 30 .

Here, the second type is not limited. For example, if the resident is a woman, it is possible that the resident may have a greater fear of being disadvantaged by the visitor, especially by responding to the visitor. Therefore, the second type may include a type that the gender is female. As a result, when the visitor type is male and the resident type is female, the male operator responds to the visitor instead of the resident, thereby further reducing the anxiety of the resident. It becomes possible to reduce strongly.

On the other hand, it is assumed that a type other than the first type is set in advance in association with the operation "connection control between the entrance machine 20 and the dwelling unit terminal 30" and the visitor type is other than the first type. be. In such a case, the determination unit 113 may determine the operation “connection control between the entrance machine 20 and the dwelling unit terminal 30 ” as the operation of the collective housing server 10 . As a result, when the visitor type is the first type, the resident himself/herself responds to the visitor, so it is possible for the resident to directly respond to the visitor during the visit.

Alternatively, it is conceivable that the third type is set in advance in association with the operation "connection control between entrance machine 20 and portable terminal 80" and the visitor type is the first type. In such a case, the determination unit 113 may determine the operation “connection control between the entrance machine 20 and the mobile terminal 80 ” as the operation of the collective housing server 10 . As a result, when the visitor type is the third type, the person using the mobile terminal 80 (for example, the guardian of a child) responds to the visitor instead of the resident. For example, it is possible to reduce the possibility that a child) will be disadvantaged by a visitor.

Alternatively, it is conceivable that the fourth type is set in advance in association with the action "connection control between entrance machine 20 and arbitrary operator's terminal" and the visitor type is the fourth type. be. In such a case, the determination unit 113 may determine the operation “connection control between the entrance machine 20 and an arbitrary operator's terminal” as the operation of the collective housing server 10 . As a result, when the visitor type is the fourth type, an arbitrary operator responds to the visitor instead of the resident, so it is possible to reduce the anxiety of the resident.

The determination unit 113 may refer to the action history information to determine the operation of the collective housing server 10 . For example, if the visitor type is the first type, and if the characteristic data of past visitors that match or are similar to the characteristic data is not registered in the action history information, the first visit to the apartment complex It is considered that the person performed the calling operation with the entrance machine 20. Therefore, in such a case, since it is considered that the residents are more anxious, the judgment unit 113 operates as the operation of the collective housing server 10 to "control the connection between the entrance machine 20 and the operator's terminal having a predetermined attribute". should be determined.

On the other hand, if the visitor type is the first type, and if feature data of past visitors that match or are similar to the feature data is registered in the action history information, the visitor has visited the collective housing in the past. It is considered that a certain visitor performed a calling operation on the entrance machine 20 . Therefore, in such a case, it is considered that the resident's anxiety is not so strong. good.

Further, when the visitor type is not the first type, it is assumed that past action information by the resident for the same type as the visitor type is registered in the action history information. In such a case, the determination unit 113 may determine an operation corresponding to the past behavior information as the operation of the collective housing server 10 . Alternatively, when the visitor type is not the first type, it is assumed that past action information for the visitor whose feature data matches or is similar to the visitor's feature data is registered in the action history information. In such a case, the determination unit 113 may determine an operation corresponding to the past behavior information as the operation of the collective housing server 10 .

For example, past action information "information indicating that a response operation was performed on the dwelling unit terminal 30" may correspond to the action "connection control between the entrance device 20 and the dwelling unit terminal 30". In addition, the action "unlocking control of the entrance" may correspond to the past action information "information indicating that the entrance unlocking operation was performed on the dwelling unit terminal 30". In addition, the past action information "information indicating that no response operation and unlocking operation were performed on the dwelling unit terminal 30" includes an action "connection control between the entrance machine 20 and an arbitrary operator's terminal" or an action " connection control between the entrance machine 20 and an operator's terminal having a predetermined attribute".

Note that connection control to terminals other than the entrance machine 20 and the dwelling unit terminal 30 may be performed unconditionally. Alternatively, connection control to a terminal other than the entrance machine 20 and the dwelling unit terminal 30 may be performed when transfer setting is made via the dwelling unit terminal 30 by the resident. That is, when the visitor type is the first type, and when the forwarding setting is made by the resident in advance, as the operation of the collective housing server 10, the operation "entrance machine 20 and an operator having a predetermined attribute "connection control with the terminal" may be determined. On the other hand, if the transfer setting is not made by the resident via the dwelling unit terminal 30, connection control between the entrance machine 20 and the dwelling unit terminal 30 may be performed.

When the determination unit 113 determines the operation “connection control between the entrance device 20 and the dwelling unit terminal 30”, the output control unit 114 performs control so that the entrance unit 20 and the dwelling unit terminal 30 are connected. That is, when the determination unit 113 determines to transfer the call to the dwelling unit terminal 30 ("YES" in S16), the output control unit 114 transfers the call to the dwelling unit terminal 30 via the communication unit 130 (S17). , to S19. In the dwelling unit terminal 30, the communication unit 350 receives the call (S18). On the other hand, if the determination unit 113 does not determine the operation "connection control between the entrance machine 20 and the dwelling unit terminal 30", the output control unit 114 proceeds to S19.

When the determination unit 113 determines the operation “connection control between the entrance machine 20 and the portable terminal 80”, the output control unit 114 controls so that the entrance machine 20 and the portable terminal 80 are connected. That is, when determination unit 113 determines to transfer the call to portable terminal 80 ("YES" in S19), output control unit 114 transfers the call to portable terminal 80 via communication unit 130 (S20). , S31. In mobile terminal 80, communication unit 850 receives the call (S21). On the other hand, if the determination unit 113 does not determine the operation "connection control between the entrance machine 20 and the portable terminal 80", the output control unit 114 proceeds to S31.

When the determination unit 113 determines the operation "connection control between the entrance machine 20 and an arbitrary operator's terminal", the output control unit 114 performs control so that the entrance machine 20 and an arbitrary operator's terminal are connected. . That is, when determination unit 113 determines to transfer the call to a terminal of any operator ("YES" in S31), output control unit 114 transfers the call to contact center server 60 via communication unit 130. (S32), go to S36.

In the contact center server 60, the communication unit 630 receives the call (S33), the control unit 610 determines an arbitrary operator's terminal based on the operator information, and the communication unit 630 selects an arbitrary operator's terminal ( The call is transferred to the operator terminal 70) (S34). In the operator terminal 70, the communication section 750 receives the call (S35). On the other hand, if the determination unit 113 does not determine the operation "connection control between the entrance machine 20 and the portable terminal 80", the output control unit 114 proceeds to S31.

When the determination unit 113 determines the operation “connection control between the entrance machine 20 and the operator's terminal having the predetermined attribute,” the output control unit 114 controls the connection between the entrance unit 20 and the operator's terminal having the predetermined attribute. control so that That is, when determination unit 113 determines to transfer the call to the terminal of the operator having the predetermined attribute ("YES" in S36), output control unit 114 transfers the call through communication unit 130 to contact center server 60. (S37) and proceeds to S41.

In the contact center server 60, the communication unit 630 receives the call (S38), the control unit 610 determines an operator's terminal having a predetermined attribute based on the operator information, and the communication unit 630 receives the predetermined attribute. (S39) to the operator's terminal (operator terminal 70). In operator terminal 70, communication unit 750 receives the call (S40). On the other hand, if the determination unit 113 does not determine the operation "connection control between the entrance machine 20 and the operator's terminal having the predetermined attribute", the output control unit 114 proceeds to S41.

The output control unit 114 registers the visitor's feature data and visitor type in the action history information (S41).

In the dwelling unit terminal 30, when the resident inputs a refusal operation to the operation unit 330 while the call is being received by the communication unit 350 ("YES" in S51), the communication unit 350 issues a call end instruction. It is transmitted to the entrance machine 20 (S52) and proceeds to S54. On the other hand, in the dwelling unit terminal 30, if the resident does not input a rejection operation to the operation unit 330 while the call is being received by the communication unit 350 ("NO" in S51), the process proceeds to S54. In the entrance machine 20, when the communication section 250 receives the call end instruction, the control section 210 ends the call (S53).

In the dwelling unit terminal 30, when the resident inputs an unlock operation to the operation unit 330 while the call is being received by the communication unit 350 ("YES" in S54), the communication unit 350 issues an unlock request. is transmitted to the entrance machine 20 (S55), and the process proceeds to S57. In the entrance machine 20, when the communication section 250 receives the unlocking request, the control section 210 performs an unlocking operation (S56).

In the dwelling unit terminal 30, when the resident inputs a response operation to the operation unit 330 while the call is being received by the communication unit 350 ("YES" in S57), the entrance device 20 and the dwelling unit terminal 30 are connected. Once connected, the communication unit 350 starts transmitting the voice of the resident detected by the microphone (S55), and proceeds to S71. The communication unit 130 of the collective housing server 10 , upon receiving the voice of the resident, transmits the voice of the resident to the entrance machine 20 . In the entrance machine 20, when the communication unit 250 starts receiving the voice of the resident (S59), the speaker starts outputting the voice of the resident.

In entrance machine 20, when the visitor inputs an end operation to operation unit 230 while communication unit 250 is calling ("YES" in S61), communication unit 250 terminates the call. The outgoing call is terminated (S62). On the other hand, in the entrance machine 20, if the visitor does not input the end operation to the operation unit 230 while the communication unit 250 is transmitting a call ("NO" in S61), the control unit 210 proceeds to S80. proceed to

It is assumed that after the entrance machine 20 and the dwelling unit terminal 30 are connected, a transfer operation from the resident is input to the operation unit 330 of the dwelling unit terminal 30 . In such a case, the output control unit 114 may perform control so that the "entrance machine 20" and the "terminal different from the dwelling unit terminal 30" are connected. Here, it is mainly assumed that the “terminal different from the dwelling unit terminal 30 ” is the operator terminal 70 . That is, it is mainly assumed that a call is transferred to the operator terminal 70 when a transfer operation is performed by the resident while voice is being transmitted from the dwelling unit terminal 30 to the entrance machine 20 . However, the “terminal different from the dwelling unit terminal 30 ” may be the mobile terminal 80 .

In the dwelling unit terminal 30, the communication unit 350, when there is a transfer operation from the resident while voice is being transmitted from the own terminal (dwelling unit terminal 30) to the entrance device 20 ("YES" in S71), A transfer request is sent to the server 10 (S72). In collective housing server 10, communication unit 130, upon receiving the transfer request (S73), sends a call to contact center server 60 (S74). In the contact center server 60, when the communication section 630 receives the call (S75), it transfers the call to the operator terminal 70 (S76).

In the operator terminal 70, the call is received by the communication section 750 (S77). Then, when a response operation from the operator is input to the operation input unit 730 of the operator terminal 70 while the call is being received by the communication unit 750 ("YES" in S78), the entrance machine 20 and the operator terminal 70 are connected, and the communication unit 750 starts transmitting the voice of the operator detected by the microphone (S79). This allows a resident to start serving a visitor, but wants to switch to another person in the middle of the service (for example, a child starts serving a visitor but is protected in the middle). (for example, when it is determined that a person needs to respond), the other person can change the response to the visitor.

The visitor's video and audio (and text data recognized from the visitor's voice) and the operator's voice (and text data recognized from the operator's voice) are memorized one by one by the storage unit 620 of the contact center server 60. you can Then, when the resident's reproduction operation is input to the operation unit 330 of the dwelling unit terminal 30, the control unit 310 outputs the visitor's video and audio (and the visitor's audio) from the storage unit 620 of the contact center server 60. The text data recognized from the operator) and the operator's voice (and the text data recognized from the operator's voice) can be obtained and played back. This allows the resident to later see if the visitor was important.

When the communication unit 130 of the collective housing server 10 receives the operator's voice, it transmits the operator's voice to the entrance machine 20. In the entrance machine 20, when the communication unit 250 starts receiving the operator's voice (S80), the speaker starts outputting the operator's voice.

In portable terminal 80, when a response operation from the person using portable terminal 80 is input to operation input unit 830 of portable terminal 80 while the call is being received by communication unit 850 ("YES" in S81) ), the entrance machine 20 and the mobile terminal 80 are connected, and the communication unit 850 starts transmitting the voice of the person using the mobile terminal 80 detected by the microphone (S82). When receiving the voice of the person using the mobile terminal 80, the communication unit 130 of the collective housing server 10 transmits the voice of the person using the mobile terminal 80 to the entrance machine 20. In the entrance machine 20, the communication unit 250 When reception of the voice of the person using the mobile terminal 80 is started (S83), the speaker starts outputting the voice of the person using the mobile terminal 80. FIG.

The video and audio of the visitor (and the text data recognized from the visitor's voice) and the operator's voice (and the text data recognized from the operator's voice) are memorized one by one by the storage unit 840 of the mobile terminal 80. good. Then, when the resident's reproduction operation is input to the operation unit 330 of the dwelling unit terminal 30, the control unit 310 outputs the video and audio of the visitor from the storage unit 840 of the portable terminal 80 (and from the visitor's audio). recognized text data) and the operator's voice (and text data recognized from the operator's voice) can be acquired and played back. This allows the resident to later see if the visitor was important.

Here, it is mainly assumed that the call is forwarded to a terminal different from the dwelling unit terminal 30 when there is an explicit forwarding operation by the resident while the resident is answering the visitor. . However, when a predetermined situation is detected while the resident is responding to the visitor (for example, an act by the visitor that may give a disadvantage to the resident), the dwelling unit terminal 30 automatically The call may be forwarded to a different terminal than the This reduces the likelihood that residents will be disadvantaged by visitors.

That is, after the entrance machine 20 and the dwelling unit terminal 30 are connected, the output control unit 114 analyzes the visitor's voice input to the microphone of the entrance machine 20 and extracts predetermined text data (for example, , predetermined utterance content that may give a disadvantage to the resident) is recognized, control is performed so that the "entrance machine 20" and the "terminal different from the dwelling unit terminal 30" are connected. You may "A terminal different from the dwelling unit terminal 30" is as described above. As a result, for example, even if a child begins to respond to a visitor who was not recognized as a suspicious person at first, if the visitor is later recognized as a suspicious person from the contents of the speech, the child can reduce the possibility of unlocking by mistake.

Since the voice of the operator who is answering the visitor is output by the speaker of the entrance machine 20, the visitor can hear it. On the other hand, the voice of the operator who is answering the visitor does not have to be audible to the residents, but it is preferable that the voice be heard by the residents as well. That is, in the collective housing server 10 , the output control unit 114 preferably transmits the operator's voice received from the operator terminal 70 to the dwelling unit terminal 30 when the entrance machine 20 and the operator terminal 70 are connected. Residents can then see in real time if a visitor is important.

More specifically, when voice transmission is started in another terminal (“a terminal different from the dwelling unit terminal 30” described above), the communication unit 130 in the collective housing server 10 starts voice reception from the other terminal. Then, transfer of the received voice to the dwelling unit terminal 30 is started (S85). In the dwelling unit terminal 30, the communication unit 350 starts receiving the voice transferred by the communication unit 130 (S86), and the speaker starts outputting the voice received by the communication unit 350 (S87).

Assume that after the entrance machine 20 is connected to “a terminal different from the dwelling unit terminal 30 ”, a response operation from the resident is input to the operation unit 330 of the dwelling unit terminal 30 . In such a case, the output control unit 114 may control the entrance machine 20 and the dwelling unit terminal 30 to be connected. Here, it is mainly assumed that the “terminal different from the dwelling unit terminal 30 ” is the operator terminal 70 . That is, it is mainly assumed that the connection between the entrance machine 20 and the dwelling unit terminal 30 is controlled when the resident performs a response operation while voice is being transmitted from the operator terminal 70 to the entrance machine 20 . However, the “terminal different from the dwelling unit terminal 30 ” may be the mobile terminal 80 .

In the dwelling unit terminal 30, the communication unit 350, when there is a response operation from the resident while voice is being transmitted from the other terminal (operator terminal 70) to the entrance machine 20 ("YES" in S91), the operator terminal A response request is sent to 70 (S93). In the operator terminal 70, the communication section 750 receives the response request (S93), and the presentation section 760 displays the reception of the response request. The display indicating the reception of the response request may be a display such as "Response operation has been input by the resident. Please immediately change the response to the visitor to the resident."

The operator confirms the display indicating the reception of the response request, and inputs a switching operation to the operation input unit 730 when determining that the response to the visitor should be changed to that of the resident. When the resident inputs a switching operation to the operation input unit 730 ("YES" in S95), the communication unit 750 of the operator terminal 70 transmits a switching request (S96). In the collective housing server 10, when the communication unit 130 receives the switching request (S97), the output control unit 114 controls switching of the response to the visitor (S98). That is, the entrance unit 20 and the dwelling unit terminal 30 are connected, and the output control unit 114 controls so that the voice of the resident detected by the microphone of the dwelling unit terminal 30 is transmitted to the entrance unit 20 .

In the dwelling unit terminal 30, the communication unit 350 starts transmitting the voice of the resident detected by the microphone (S99). When the communication unit 130 of the collective housing server 10 receives the voice of the resident, it transmits the voice of the resident to the entrance device 20. In the entrance device 20, the communication unit 250 starts receiving the voice of the resident (S100 ), the speaker starts outputting the resident's voice.

Note that the connection between the entrance machine 20 and the operator terminal 70 may be disconnected or maintained at the same time as the voice transmission from the dwelling unit terminal 30 to the entrance machine 20 is started. When the connection between the entrance machine 20 and the operator terminal 70 is cut off, the video and audio of the visitor are no longer transmitted to the operator terminal 70, and the operator cannot confirm the video and audio of the visitor. On the other hand, when the connection between the entrance machine 20 and the operator terminal 70 is maintained, the visitor's video/audio and the resident's voice are transmitted to the operator terminal 70, so the operator can You can check the voice.

In the dwelling unit terminal 30, the communication unit 350 transmits resident behavior information to the visitor (S101). In the collective housing server 10, the communication unit 130 receives the behavior information of the residents (S102), and performs a process of associating the behavior information with the visitor feature data and the visitor type (S103).

The operation example of the information processing system 1 according to the embodiment of the present invention has been described above.

(2. Hardware configuration example)
Next, the hardware configuration of the information processing apparatus according to the embodiment of the invention will be described. Here, the hardware configuration of the information processing apparatus described above will be described. It can be realized in the same way as the hardware configuration. That is, the hardware configuration of various devices according to embodiments of the present invention can be realized by the hardware configuration of the information processing device 900 as described below.

FIG. 14 is a diagram showing the hardware configuration of the information processing device 900 according to the embodiment of the present invention. The information processing device 900 includes a CPU (Central Processing Unit) 901, a ROM (Read Only Memory) 902, a RAM (Random Access Memory) 903, a host bus 904, a bridge 905, an external bus 906, and an interface 907. , an input device 908 , an output device 909 , a storage device 910 and a communication device 911 .

The CPU 901 functions as an arithmetic processing device and a control device, and controls general operations within the information processing device 900 according to various programs. Alternatively, the CPU 901 may be a microprocessor. A ROM 902 stores programs, calculation parameters, and the like used by the CPU 901 . A RAM 903 temporarily stores programs used in the execution of the CPU 901, parameters that change as appropriate during the execution, and the like. These are interconnected by a host bus 904 comprising a CPU bus or the like.

The host bus 904 is connected via a bridge 905 to an external bus 906 such as a PCI (Peripheral Component Interconnect/Interface) bus. Note that the host bus 904, the bridge 905 and the external bus 906 do not necessarily have to be configured separately, and these functions may be implemented in one bus.

The input device 908 includes input means for the user to input information, such as a mouse, keyboard, touch panel, button, microphone, switch, and lever, and an input control circuit that generates an input signal based on the user's input and outputs it to the CPU 901 . etc. A user who operates the information processing apparatus 900 can input various data to the information processing apparatus 900 and instruct processing operations by operating the input device 908 .

The output device 909 includes, for example, a CRT (Cathode Ray Tube) display device, a liquid crystal display (LCD) device, an OLED (Organic Light Emitting Diode) device, a display device such as a lamp, and an audio output device such as a speaker.

The storage device 910 is a device for data storage. The storage device 910 may include a storage medium, a recording device that records data on the storage medium, a reading device that reads data from the storage medium, a deletion device that deletes data recorded on the storage medium, and the like. The storage device 910 is configured by, for example, an HDD (Hard Disk Drive). The storage device 910 drives a hard disk and stores programs executed by the CPU 901 and various data.

The communication device 911 is, for example, a communication interface configured with a communication device or the like for connecting to a network. Also, the communication device 911 may support either wireless communication or wired communication.

The hardware configuration of the information processing apparatus according to the embodiment of the present invention has been described above.

(3. Summary)
Although the preferred embodiments of the present invention have been described in detail above with reference to the accompanying drawings, the present invention is not limited to such examples. It is obvious that a person having ordinary knowledge in the technical field to which the present invention belongs can conceive of various modifications or modifications within the scope of the technical idea described in the claims. It is understood that these also naturally belong to the technical scope of the present invention.

In the above, it is mainly assumed that the output control unit 114 performs control so that the entrance machine 20 and the operator terminal 70 of the contact center are connected when the visitor type is the first type. However, the conditions for controlling the connection between the entrance machine 20 and the operator terminal 70 of the contact center are not limited. For example, the output control unit 114 unconditionally controls the entrance machine 20 and the dwelling unit terminal 30 to be connected, and if there is no response operation by the resident within a predetermined time, the entrance machine 20 and the operator terminal 70 of the contact center.

Moreover, in the above description, it is mainly assumed that which terminal is to be connected to the entrance machine 20 is set in advance for each type of visitor. However, which terminals are to be connected to the entrance machine 20 may be set in advance for each time period. If so, for example, when the guardian of the child is not in the house during the daytime and the child often stays at home in the house, calls during the daytime are always protected. can be transferred to the mobile terminal of the person.

Also, in the above description, as a condition for connecting the entrance machine 20 and the operator terminal 70, the condition that the visitor type is the first type (for example, gender is male) is set in advance. However, the conditions for connecting the entrance machine 20 and the operator terminal 70 are not limited to this example. For example, the condition for connecting the entrance machine 20 and the operator terminal 70 may be a condition that the occupation of the visitor is a specific occupation (for example, a salesman). Alternatively, a condition that the visitor is a suspicious person may be set as a condition for connecting the entrance machine 20 and the terminal of the security company.

Alternatively, conditions for connecting the entrance machine 20 and the dwelling unit terminal 30 may be set in advance. For example, the condition for connecting the entrance machine 20 and the dwelling unit terminal 30 may be a condition that the visitor type is a specific type (for example, a close relative, a resident of another dwelling unit in the collective housing, etc.). . For such visitors, it is considered unlikely that the child will be disadvantaged by the visitor even if the child is answering in the dwelling unit or is called into the dwelling unit. is.

1 information processing system 10 collective housing server 110 control unit 120 storage unit 130 communication unit 112 acquisition unit 113 determination unit 114 output control unit 121 preset information 122 action history information 20 entrance machine 210 control unit 220 sensor unit 230 operation unit 240 storage unit 250 communication unit 260 presentation unit 30 dwelling unit terminal 310 control unit 320 sensor unit 330 operation unit 340 storage unit 350 communication unit 360 presentation unit 40 communication device 50 network 60 contact center server 610 control unit 620 storage unit 630 communication unit 621 resident information 622 Operator information 623 Audio/video 70 Operator terminal 710 Control unit 720 Audio input unit 730 Operation input unit 740 Storage unit 750 Communication unit 760 Presentation unit 80 Portable terminal 810 Control unit 820 Audio input unit 830 Operation input unit 840 Storage unit 850 Communication unit 860 Presentation Part 90 communication device

Claims (17)

an acquisition unit that acquires a captured image of a visitor;
a determination unit that analyzes the captured image and determines a visitor type;
Used by the visitor when the visitor type is the first type and when feature data of past visitors that match or are similar to the feature data extracted from the captured image are not registered an output control unit that controls so that the device and the terminal of the operator having a predetermined attribute of the contact center are connected;
An information processing device. When the visitor type is not the first type, the output control unit registers the past behavior information for the same type as the visitor type or for feature data that matches or is similar to the visitor's feature data. If so, operate based on the past behavior information,
The information processing device according to claim 1 . The past behavior information is information indicating that the resident did not perform a response operation or an unlocking operation,
When the visitor type is not the first type and when information indicating that the response operation and the unlocking operation are not performed is registered, the device used by the visitor and the predetermined Control to be connected with the terminal of the operator having the attribute,
The information processing apparatus according to claim 2 . When the visitor type is not the first type, the output control unit controls so that the device used by the visitor and the dwelling unit terminal are connected.
The information processing device according to claim 1 . After the device used by the visitor and the terminal for the dwelling unit are connected, the output control unit, when a transfer operation from the resident is input to the terminal for the dwelling unit, Control so that a terminal different from the dwelling unit terminal is connected,
The information processing apparatus according to claim 4 . The output control unit is used by the visitor when predetermined text data is recognized from the voice input by the visitor after the device used by the visitor and the terminal for the dwelling unit are connected. control so that the device connected to the housing unit and a terminal different from the dwelling unit terminal are connected,
The information processing apparatus according to claim 4 . The first type includes a type that the gender is male,
The predetermined attribute includes an attribute that gender is male,
The information processing device according to claim 1 . When the device used by the visitor is connected to the operator's terminal having the predetermined attribute, the output control unit outputs the voice received from the operator's terminal having the predetermined attribute to the visitor. send to the device used,
The information processing device according to claim 1 . When the device used by the visitor is connected to the operator's terminal having the predetermined attribute, the output control unit transmits the voice received from the operator's terminal having the predetermined attribute to the dwelling unit terminal. do,
The information processing apparatus according to claim 8 . After the device used by the visitor and the operator's terminal having the predetermined attribute are connected, the output control unit, when a response operation from the resident is input to the dwelling unit terminal, from the dwelling unit terminal transmitting the received audio to a device utilized by said visitor;
The information processing device according to claim 1 . The first type is information set by a resident in advance,
The information processing device according to claim 1 . When the visitor type is the first type and the transfer setting is made in advance by the resident, the output control unit selects the device used by the visitor and the predetermined attribute. control to be connected with the terminal of the operator who has
The information processing device according to claim 1 . The determination unit determines the type of resident,
The output control unit, when the visitor type is the first type and when the resident type is the second type, determines the device used by the visitor and the predetermined attribute. control to be connected with the terminal of the operator who has
The information processing device according to claim 1 . The second type includes a type that the gender is female,
The information processing apparatus according to claim 13. Acquiring a captured image of the visitor;
analyzing the captured image to determine a visitor type;
Used by the visitor when the visitor type is the first type and when feature data of past visitors that match or are similar to the feature data extracted from the captured image are not registered controlling so that the device connected to the contact center and the terminal of the operator having a predetermined attribute of the contact center are connected;
A method of processing information, comprising: the computer,
an acquisition unit that acquires a captured image of a visitor;
a determination unit that analyzes the captured image and determines a visitor type;
Used by the visitor when the visitor type is the first type and when feature data of past visitors that match or are similar to the feature data extracted from the captured image are not registered an output control unit that controls so that the device and the terminal of the operator having a predetermined attribute of the contact center are connected;
A program for functioning as an information processing device comprising A dwelling unit terminal used by a resident,
When the visitor type determined based on the analysis of the captured image of the visitor is the first type, the equipment used by the visitor and the terminal of the operator having the predetermined attribute of the contact center controlled to be connected,
Used by the visitor when the visitor type is not the first type and when feature data of past visitors that match or are similar to the feature data extracted from the captured image are not registered is controlled so that the device to be connected and the dwelling unit terminal are connected,
a communication unit that receives voice from the operator's terminal having the predetermined attribute when the device used by the visitor is connected to the operator's terminal having the predetermined attribute;
a presentation unit that presents the voice to the resident;
Dwelling unit terminal.

Images