JP7390634B2 - Lobby intercom, intercom system, image information output method and program - Google Patents

Description

The present disclosure generally relates to a lobby intercom, an intercom system , an image information output method, and a program, and more particularly relates to a lobby intercom, an intercom system , an image information output method, and a program for using images for multiple purposes.

Conventionally, intercom systems have been known that include an intercom handset equipped with an imaging means such as a camera, and an intercom base unit that displays an image (still image, moving image) taken by the imaging means at the time of a call (for example, patented (See Reference 1).

By using the intercom system of Patent Document 1, residents can recognize the behavior of visitors.

Japanese Patent Application Publication No. 2015-111935

In recent years, images taken by an imaging means (imaging unit) can be used not only for calling residents, but also for other purposes, but in this case, it is necessary to generate an optimal image according to the purpose. .

The present disclosure has been made in view of the above-mentioned problems, and provides a lobby intercom, an intercom system, and an image that can provide an optimal image for each application even when an image captured by an imaging unit is used for multiple applications. The purpose is to provide information output methods and programs.

A lobby intercom according to one aspect of the present disclosure includes an imaging section, an image acquisition section, a first processing section, a second processing section, a first output section, and a second output section. The image acquisition section acquires an image captured by the imaging section of an intercom device having an imaging section. The first processing unit generates first image information to be used for a first purpose based on the image. The second processing unit generates second image information to be used for a second purpose based on the image. The first output unit outputs the first image information. The second output unit outputs the second image information. The second use includes display on an information terminal that is a communication destination. The first processing unit does not accept an instruction to change the content of processing based on the operation of the information terminal. The second processing unit receives an instruction to change the content of processing based on the operation of the information terminal.
An intercom system according to an aspect of the present disclosure includes the lobby intercom and an information terminal that communicates with the lobby intercom.

An image information output method according to one aspect of the present disclosure is an image information output method of a lobby intercom having an imaging unit. The image information output method includes an image acquisition step, a first processing step, a second processing step, a first output step, and a second output step. The image acquisition step acquires an image captured by the imaging unit of an intercom device having an imaging unit. The first processing step generates first image information to be used for a first purpose based on the image. The second processing step generates second image information to be used for a second purpose based on the image. The first output step outputs the first image information. The second output step outputs the second image information. The second use includes display on an information terminal that is a communication destination. In the first processing step, an instruction to change the content of processing based on the operation of the information terminal is not accepted. In the second processing step, an instruction to change the content of processing based on the operation of the information terminal is received.

A program according to one aspect of the present disclosure is a program for causing a computer to execute the image information output method.

According to the present disclosure, even when an image captured by the imaging unit is used for multiple purposes, it is possible to provide an optimal image for each purpose.

FIG. 1 is a diagram illustrating the configuration of a lobby intercom as an intercom device according to an embodiment. FIG. 2 is a diagram illustrating the configuration of an intercom system including the lobby intercom same as above. FIG. 3A is a diagram showing an image captured by the imaging unit of the lobby intercom same as above. FIG. 3B is a diagram showing a state when the image shown in FIG. 3A is corrected to an image for authentication. FIG. 4 is a diagram illustrating the operation of the lobby intercom same as above. FIG. 5 is a diagram illustrating the operation at the time of authentication in the above intercom system. FIG. 6 is a diagram illustrating the operation at the time of display in the above intercom system.

The embodiments and modified examples described below are merely examples of the present disclosure, and the present disclosure is not limited to the embodiments and modified examples. Even other than the following embodiments and modifications, various changes can be made according to the design etc. as long as they do not deviate from the technical idea of the present disclosure.

(Embodiment)
The intercom system 1 and image information output system 2 according to this embodiment will be described below with reference to FIGS. 1 to 6.

(1) Overview As shown in FIG. 2, the intercom system 1 of the present embodiment includes a lobby intercom 10 as an intercom device, a plurality (two in the illustrated example) of intercom base units 20, and a plurality (two in the illustrated example) of intercom base units 20. (1) entrance slave unit 30 and a control device 40. In this embodiment, a case where the intercom system 1 is used in an apartment complex as the facility 5 will be described as an example. Further, each of the plurality of intercom base units corresponds to an information terminal of the present disclosure.

The lobby intercom 10 is installed, for example, in a common area such as a lobby of an apartment complex. A housing complex has multiple private areas (dwelling units) in addition to a common area. The intercom base unit 20 is installed in each exclusive section. The entrance slave unit 30 is installed, for example, at the outer entrance of the dwelling unit for each exclusive area.

The lobby intercom 10 includes an imaging unit 11 and an image processing device 100 as an image information output system 2. The lobby intercom 10 performs processing regarding the image captured by the imaging unit 11.

The lobby intercom 10 and the intercom base unit 20 are configured to be able to communicate with each other via the control device 40. Thereby, in the intercom system 1 according to the present embodiment, it becomes possible to communicate between the lobby intercom 10 and the intercom base unit 20. Furthermore, the intercom base unit 20 and the entrance slave unit 30 are configured to be able to communicate with each other.

Further, the lobby intercom 10 and the control device 40 can be connected to a network NT1 such as the Internet via a gateway (not shown). Thereby, lobby intercom 10 and control device 40 can communicate with server 50 via network NT1.

When the lobby intercom 10 detects a person (for example, a visitor) in a common area, it starts capturing an image of the person. When the lobby intercom 10 receives a call operation from a visitor, it transmits a control signal (call signal) for calling a resident in the exclusive area to the intercom base unit 20 via the control device 40. Lobby intercom 10 transmits data of the visitor's voice to intercom base unit 20 via control device 40 when communication with intercom base unit 20 becomes possible through an operation on intercom base unit 20 . When the lobby intercom 10 receives voice data of the operator of the intercom base unit 20 via the control device 40, it outputs voice (operator's voice) based on the received data.

The image processing device 100 performs image processing on the image captured by the imaging unit 11 (captured image) depending on the purpose of using the image. In this embodiment, the first use includes image authentication, and the second use includes display on the intercom base unit 20.

While the intercom base unit 20 is receiving a control signal (calling signal) from the lobby intercom 10 (that is, when a visitor is calling via the lobby intercom 10), a resident in the private space may call the lobby intercom 10. make calls or unlock the lobby door.

When the control device 40 receives a control signal (calling signal) from the lobby intercom 10, it transmits the received control signal to the intercom base unit 20 receiving the call. When the lobby intercom 10 and the intercom base unit 20 are in a state where a call is possible, the control device 40 transmits and receives the visitor's voice data and the operator's voice data. Further, the control device 40 locks and unlocks, for example, a door provided in the lobby in accordance with the operation of the intercom base unit 20.

After the lobby intercom 10 starts taking an image of a person, if it does not accept a call operation from the visitor, it sends the taken image to the server 50 (see FIG. 2). The lobby intercom 10 performs processing related to unlocking the lobby door according to the result of the authentication processing by the server 50.

Upon receiving a call operation from a visitor, the entrance handset 30 transmits a control signal (calling signal) to the intercom base unit 20 to call the resident in the private area. Entrance handset 30 transmits data of the visitor's voice to intercom base unit 20 when it becomes possible to communicate with intercom base unit 20 by operating intercom base unit 20. When the entrance handset 30 receives the voice data of the operator of the intercom base unit 20, it outputs voice (operator's voice) based on the received data.

The server 50 uses the image captured by the lobby intercom 10 to authenticate the captured person (for example, a visitor, a resident returning home from outside). Server 50 transmits the authentication result to lobby intercom 10 via network NT1. Note that in this embodiment, the server 50 performs face authentication as an example of authentication using images (image authentication).

(2) Configuration (2-1) Lobby Intercom As shown in FIG. 1, the lobby intercom 10 includes an image processing device 100 as an image information output system 2, an imaging section 11, a sensor section 12, and a first communication section. 13, a second communication section 14, an operation section 15, a communication section 16, and a control section 17.

The lobby intercom 10 includes, for example, a microcomputer having a processor and a memory. The microcomputer functions as the control unit 17 by the processor executing the program stored in the memory. Although the program executed by the processor is pre-recorded in the memory of the microcomputer here, it may also be provided recorded on a non-temporary recording medium such as a memory card, or provided via a telecommunications line such as the Internet. may be done.

The imaging unit 11 has an imaging element such as a two-dimensional image sensor such as a CCD (Charge Coupled Devices) image sensor or a CMOS (Complementary Metal-Oxide Semiconductor) image sensor, and is used to photograph a subject (visitor, etc.). It's a camera. The lens used by the imaging unit 11 for imaging is, for example, a fisheye lens. In this embodiment, the imaging area (field of view) of the imaging unit 11 is set in front of the lobby intercom 10 so that at least the visitor's face can be photographed. Further, in this embodiment, the imaging unit 11 is a camera that takes videos, but it may also be a camera that takes still images. Further, in this embodiment, the imaging unit 11 is a camera that takes color images, but may be a camera that takes monochrome images.

The sensor unit 12 is, for example, a human sensor that detects the approach of a person.

The first communication unit 13 also includes a communication interface for communicating with the server 50 via the network NT1. The first communication unit 13 communicates with the server 50 so that at least an image captured by the lobby intercom 10, information related to the image, and information related to authentication can be transmitted between the lobby intercom 10 and the server 50. It is configured to allow bidirectional communication.

The second communication unit 14 includes a communication interface for communicating with the intercom base unit 20 via the control device 40. The second communication unit 14 is configured to be able to communicate bidirectionally with the intercom base unit 20 so that audio signals and control signals can be transmitted bidirectionally between the lobby intercom 10 and the intercom base unit 20. has been done.

The operation unit 15 receives an operation for calling from a visitor. When a predetermined operation (for example, a push operation) is performed on the operation unit 15, a control signal (calling signal) for calling a resident in the exclusive area (dwelling unit) is sent to the second communication unit 14 and the control device 40. It is transmitted to the intercom base unit 20 via the intercom base unit 20.

The communication unit 16 includes a speaker and a microphone, and is configured to be able to communicate with the intercom base unit 20.

The control unit 17 receives detection results from the sensor unit 12. The control unit 17 receives from the operation unit 15 information related to the operation received by the operation unit 15 .

When the detection result of the sensor unit 12 indicates that a person has been detected, the control unit 17 activates the imaging unit 11 to start imaging. In other words, the control unit 17 starts supplying power to the imaging unit 11.

The control unit 17 determines whether to cause the server 50 to perform authentication based on the captured image or to display an image based on the captured image on the intercom base unit 20. Specifically, if a calling operation is received within a predetermined time after the imaging unit 11 starts imaging, the control unit 17 determines that an image based on the captured image is to be displayed on the intercom base unit 20. The control unit 17 determines that if the calling operation is not received within a predetermined time after the imaging unit 11 starts capturing images, the server 50 should display authentication based on the captured image.

When displaying an image based on the captured image on the intercom base unit 20, the control unit 17 transmits a control signal (calling signal) to the intercom base unit 20 via the second communication unit 14 and the control device 40. do. When the control unit 17 receives the visitor's voice data (audio signal) from the microphone of the communication unit 16 when a call is possible with the intercom base unit 20, the control unit 17 transmits the received voice signal to the intercom base unit 20. 20. When the control unit 17 receives an operator's voice signal from the intercom base unit 20 when a call is possible with the intercom base unit 20, the control unit 17 outputs the received voice signal to the speaker of the communication unit 16. . At this time, the speaker outputs audio based on the received audio signal.

The control unit 17 receives the authentication result from the server 50 via the first communication unit 13. The control unit 17 controls the opening/closing operation of the door of the common area according to the authentication result. Specifically, if the authentication is successful, the control unit 17 transmits to the control device 40 an unlock signal for opening the door of the common area. On the other hand, if the authentication fails, the control unit 17 does not transmit an unlock signal for opening the door of the common area to the control device 40. In other words, the control unit 17 maintains the door of the common area in a closed state.

The image processing device 100 performs image processing on the image captured by the imaging unit 11 (captured image) depending on the purpose of using the image. Specifically, when the image processing device 100 causes the server 50 to perform authentication, the image processing device 100 generates an authentication image as first image information based on the image captured by the imaging unit 11, and uses the generated authentication image. Send the image to the server 50. When displaying the image on the intercom base unit 20, the image processing device 100 generates a display image as second image information based on the image captured by the imaging unit 11, and displays the generated display image on the intercom base unit. Send to 20.

(2-2) Image processing device As shown in FIG. 1, the image processing device 100 as the image information output system 2 includes an image acquisition section 101, a first processing section 102, a second processing section 103, and a It includes an output section 104 and a second output section 105.

The image acquisition unit 101 receives an image captured by the imaging unit 11 (captured image) from the imaging unit 11 . The image acquisition unit 101 performs a commonly performed process (common process) among the process related to the generation of the image for authentication and the process related to the process related to the generation of the image for display, on the received captured image. For example, the image acquisition unit 101 performs processing such as RGB Bayer and two-stage exposure on the received captured image.

The first processing unit 102 is realized by one integrated circuit, and generates an image for authentication (first image information) based on a captured image. Specifically, the first processing unit 102 performs processing related to at least one of distortion correction and color tone correction on the captured image. Distortion correction includes lens distortion correction and viewpoint conversion distortion correction. The color tone correction includes correction of the color, brightness, shading, etc. of the captured image.

The first processing unit 102 extracts a human face area included in the captured image.

When performing distortion correction, the first processing unit 102 determines parameters to be used for distortion correction according to the extracted facial area. Specifically, the first processing unit 102 determines parameters used for distortion correction so that the human face included in the captured image becomes clear. For example, when the lobby intercom 10 is attached to a tilted table, that is, when the imaging section 11 is installed diagonally with respect to the vertical direction, when a person is bent forward and an image is taken, the imaging section 11, the area of the face to be imaged becomes larger. In this case, the imaging unit 11 and the person's face face each other directly, and when the face is in the center of the captured image, distortion is small in the face area. Therefore, the first processing unit 102 determines parameters to perform lens distortion correction that corrects distortion around the captured image. The first processing unit 102 performs distortion correction on the captured image based on the determined parameters.

In addition, when the lobby intercom 10 is attached to a slope and a person is imaged in an upright position, the visitor U1 becomes tapered (the tip (head) becomes thinner) as shown in FIG. 3A. )appear. Therefore, the face area becomes small, making it unsuitable for authentication. Therefore, the first processing unit 102 corrects the distortion (tapering) shown in FIG. 3A by, for example, performing viewpoint conversion distortion correction on the captured image (the image in which the visitor is tapered) (see FIG. 3B). . In FIG. 3B, the tapering is suppressed for the visitor U1, and the area of the face of the visitor U1 becomes larger than before the correction. Therefore, by using the corrected image as the image for authentication, it is possible to improve the accuracy of authentication.

Note that when the imaging unit 11 is installed diagonally with respect to the vertical direction, the first processing unit 102 may perform viewpoint conversion correction when an image is captured of a person bending forward. . Furthermore, when the lobby intercom 10 is attached to a tilt table and an image of a person is taken in an upright position, the first processing unit 102 may perform lens distortion correction.

When performing color tone correction, the first processing unit 102 adjusts the color, brightness and A parameter for at least one of the shades is determined. The first processing unit 102 performs color tone correction on the captured image based on the determined parameters.

The first processing unit 102 generates an image for authentication by performing at least one of the above-described distortion correction and color tone correction on the captured image. The first processing unit 102 transmits the generated authentication image to the server 50 via the first output unit 104 and the first communication unit 13.

The first output unit 104 transmits the authentication image generated by the first processing unit 102 to the server 50 via the first communication unit 13. Specifically, it is an output port provided in an integrated circuit that implements the first processing unit 102. The first output unit 104 outputs the authentication image received from the first processing unit 102 to the first communication unit 13 connected to the first output unit 104 .

The second processing unit 103 is realized by an integrated circuit different from the integrated circuit that realizes the first processing unit 102, and generates a display image (second image information) based on the captured image. Specifically, the second processing unit 103 performs processing related to at least one of distortion correction and color tone correction on the captured image. As in the case of the first processing unit 102, the distortion correction includes lens distortion correction and viewpoint conversion distortion correction. Similar to the case of the first processing unit 102, the color tone correction includes correction of the color, brightness, shading, etc. of the captured image.

The second processing unit 103 extracts a human face area included in the captured image.

When performing distortion correction, the second processing unit 103 determines parameters to be used for distortion correction according to the extracted facial area. Specifically, the second processing unit 103 determines parameters to be used for distortion correction so that the captured image is easy to see as a whole. For example, when the lobby intercom 10 is attached to a tilt table, when a person is imaged while bending forward, the area of the face imaged becomes larger because the person is approaching the imaging unit 11. In this case, the person's face is large and the overall visibility including the background is poor. Therefore, the second processing unit 103 determines parameters to perform viewpoint conversion distortion correction, which is distortion correction for projecting the captured image in the vertical direction. The second processing unit 103 performs distortion correction on the captured image based on the determined parameters. Note that when the lobby intercom 10 is attached to a tilt table and a person is imaged in a bent forward state, the second processing unit 103 may perform lens distortion correction.

Note that when the image capturing unit 11 is installed diagonally with respect to the vertical direction and a person is imaged in an upright state, the second processing unit 103 may perform viewpoint conversion correction, Lens distortion correction may also be performed.

When performing color tone correction, the second processing unit 103 determines a parameter regarding at least one of the color, brightness, and shading of the captured image so that both the face area and the background area are clear. do. The second processing unit 103 performs color tone correction on the captured image based on the determined parameters.

The second processing unit 103 generates an image for display by performing at least one of the above-described distortion correction and color tone correction on the captured image. The second processing unit 103 transmits the generated display image to the intercom base unit 20 to be called via the second output unit 105 and the second communication unit 14.

The second output unit 105 transmits the display image generated by the second processing unit 103 to the intercom base unit 20 via the second communication unit 14 and the control device 40. Specifically, it is an output port provided in an integrated circuit that realizes the second processing section 103. The second output unit 105 outputs the display image received from the second processing unit 103 to the second communication unit 14 connected to the second output unit 105 .

In this embodiment, the first processing unit 102 may perform distortion correction on the captured image, and the second processing unit 103 may perform color tone correction, which are different from each other.

Furthermore, the same processing (distortion correction) may be performed using different parameters for the captured image, such as the first processing unit 102 performing lens distortion correction as distortion correction, and the second processing unit 103 performing viewpoint conversion distortion correction as distortion correction. You can go there. Alternatively, the same process (tone correction) may be performed using different parameters for the captured image, such as the first processing unit 102 correcting brightness as color correction and the second processing unit 103 correcting shading as color tone correction. You can go there.

Further, the first processing unit 102 may perform at least one of distortion correction and color tone correction only on the extracted facial region. When the first processing unit 102 extracts a plurality of face regions, the first processing unit 102 may perform correction on each of the plurality of face regions according to the face region. For example, the first processing unit 102 performs lens distortion correction on a face region located at an end of a captured image among a plurality of face regions. The first processing unit 102 performs color tone correction on a face region located in the center of the captured image among the plurality of face regions.

Similarly, the second processing unit 103 may perform at least one of distortion correction and color tone correction only on the extracted facial region. When the second processing unit 103 extracts a plurality of face regions, the second processing unit 103 may perform correction on each of the plurality of face regions according to the face region. For example, the second processing unit 103 performs lens distortion correction on a face region located at an end of the captured image among the plurality of face regions. The second processing unit 103 performs color tone correction on a face region located in the center of the captured image among the plurality of face regions.

(2-3) Intercom base unit As shown in FIG. 2, the intercom base unit 20 includes a first communication unit 21, a second communication unit 22, an operation unit 23, a communication unit 24, a display unit 25, A control section 26 is provided.

The intercom base unit 20 includes, for example, a microcomputer having a processor and a memory. The microcomputer functions as the control unit 26 by the processor executing the program stored in the memory. Although the program executed by the processor is pre-recorded in the memory of the microcomputer here, it may also be provided recorded on a non-temporary recording medium such as a memory card, or provided via a telecommunications line such as the Internet. may be done.

The first communication unit 21 is a communication interface for communicating with the control device 40. The first communication unit 21 is connected to the lobby intercom 10 via the control device 40. For example, the first communication unit 21 receives an image transmitted from the lobby intercom 10. Furthermore, the first communication unit 21 is configured to be able to communicate bidirectionally with the lobby intercom 10 so that audio signals and control signals can be bidirectionally transmitted between the lobby intercom 10 and the lobby intercom 10 .

The second communication unit 22 is a communication interface for communicating with the entrance slave unit 30. The second communication unit 22 is electrically connected to the entrance slave device 30 via a two-wire transmission path made of, for example, twisted pair wires.

The operation unit 23 accepts operations by a resident in the exclusive area. When a predetermined operation is performed on the operation unit 23 while the first communication unit 21 is receiving a control signal (calling signal) for calling a resident from the lobby intercom 10, the intercom base unit 20 and the lobby It becomes possible to communicate with the intercom 10. Here, the predetermined operation is, for example, a push operation. When the first communication unit 21 is receiving a call signal from the lobby intercom 10 or is able to talk to the lobby intercom 10 and the door provided in the common area is unlocked, an unlocking signal is sent. is transmitted to the control device 40.

Further, while the second communication unit 22 is receiving a control signal (calling signal) for calling the resident from the entrance handset 30, a predetermined operation (for example, a push operation) is performed on the operation unit 23. Then, the intercom base unit 20 and the entrance slave unit 30 become able to talk.

The communication unit 24 includes a speaker and a microphone, and is configured to be able to communicate with the lobby intercom 10 and the entrance handset 30.

The display unit 25 displays an image transmitted from the lobby intercom 10.

When the control unit 26 receives a control signal (calling signal) from the lobby intercom 10 and an image (here, a display image) captured by the imaging unit 11 via the first communication unit 21, the control unit 26 outputs the sound data of the ringing tone. is output to the speaker of the communication unit 24, and the received display image is output to the display unit 25. Thereby, the control unit 26 causes the speaker of the communication unit 24 to output a ring tone, and causes the display unit 25 to display a display image.

When the control unit 26 receives a control signal (call signal) from the entrance handset 30 via the second communication unit 22, it causes the speaker of the communication unit 24 to output a ring tone.

As described above, the intercom base unit 20 is an information terminal that communicates with the lobby intercom 10 and displays images for display.

(2-4) Entrance slave unit The entrance slave unit 30 includes, for example, a microcomputer having a processor and a memory. The microcomputer functions as the entrance slave unit 30 by the processor executing the program stored in the memory. Although the program executed by the processor is pre-recorded in the memory of the microcomputer here, it may also be provided recorded on a non-temporary recording medium such as a memory card, or provided via a telecommunications line such as the Internet. may be done.

Upon receiving a call operation from a visitor, the entrance handset 30 transmits a control signal (calling signal) to the intercom base unit 20 for calling a resident in the private area.

The entrance handset 30 includes a speaker and a microphone, and is configured to be able to communicate with the intercom base unit 20.

Note that the entrance slave unit 30 may include an imaging unit. In this case, the entrance slave unit 30 transmits the image captured by the imaging unit to the intercom base unit 20. The intercom base unit 20 displays the image received from the entrance slave unit 30 on the display unit 25.

(2-5) Server The server 50 includes a communication section 51, a storage section 52, and an authentication section 53.

The server 50 includes, for example, a microcomputer having a processor and memory. The microcomputer functions as the server 50 by the processor executing the program stored in the memory. Although the program executed by the processor is pre-recorded in the memory of the microcomputer here, it may also be provided recorded on a non-temporary recording medium such as a memory card, or provided via a telecommunications line such as the Internet. may be done.

The communication unit 51 is a communication interface for communicating with the lobby intercom 10 via the network NT1.

The storage unit 52 is configured of a device selected from ROM (Read Only Memory), RAM (Random Access Memory), EEPROM (Electrically Erasable Programmable Read Only Memory), and the like.

The storage unit 52 stores images of faces of residents in each exclusive area and images of faces of visitors registered in advance by the residents.

The authentication unit 53 receives the authentication image transmitted by the image processing device 100 from the lobby intercom 10 via the communication unit 51 .

The authentication unit 53 performs face authentication processing to compare the received image and each image stored in the storage unit 52.

The authentication unit 53 determines that the authentication has been successful if an image that matches the received image is stored in the storage unit 52. The authentication unit 53 determines that the authentication has failed if an image that matches the received image is not stored in the storage unit 52. Here, "matching" includes not only complete matching but also cases where the matching degree is within an allowable error range.

When the authentication image received from the image processing device 100 includes multiple faces, the authentication unit 53 selects a matching image for each of the multiple faces included in the authentication image. is stored in the storage unit 52, it is determined that the authentication was successful. The authentication unit 53 determines that the authentication has failed if the storage unit 52 does not store an image that matches at least one of the faces of the plurality of people.

The authentication section 53 transmits the authentication result to the lobby intercom 10 via the communication section 51.

(2-6) Control device The control device 40 will be explained. The control device 40 has a communication interface for communicating with the lobby intercom 10 and the intercom base unit 20.

When the control device 40 receives the calling signal, the display image, and the audio signal of the visitor's voice from the lobby intercom 10, the control device 40 transmits the signals to the intercom base unit 20. When the control device 40 receives the audio signal of the audio received by the intercom base unit 20, it transmits it to the lobby intercom 10.

The control device 40 further controls locking and unlocking of the door of the common area. For example, upon receiving an unlock signal from the intercom base unit 20, the control device 40 unlocks the door of the common area, and after a certain period of time has elapsed, locks the door. Further, upon receiving an unlocking signal from the lobby intercom 10, the control device 40 unlocks the door of the common area, and after a certain period of time has elapsed, locks the door. Note that the lobby intercom 10 may control the locking and unlocking of the doors of the common area.

(3) Operation (3-1) Operation of lobby intercom Here, the operation of lobby intercom 10 will be explained using FIG. 4.

The imaging unit 11 of the lobby intercom 10 starts imaging when the sensor unit 12 detects a person (step S1).

The control unit 17 determines whether the operation unit 15 has received a calling operation within a predetermined time after the imaging unit 11 starts capturing an image (step S2).

When determining that the operation unit 15 has received the calling operation within the predetermined time ("Yes" in step S2), the lobby intercom 10 performs a calling process (step S3). Specifically, the lobby intercom 10 transmits a control signal (calling signal) and a display image to the intercom base unit 20. Thereafter, when the control unit 17 receives the visitor's voice data (audio signal) from the microphone of the communication unit 16 when the communication with the intercom base unit 20 is possible, the control unit 17 transmits the received voice signal. It is transmitted to the intercom base unit 20. When the control unit 17 receives an operator's voice signal from the intercom base unit 20 when a call is possible with the intercom base unit 20, the control unit 17 outputs the received voice signal to the speaker of the communication unit 16. . At this time, the speaker outputs audio based on the received audio signal.

When determining that the operation unit 15 has not yet accepted the calling operation (“No” in step S2), the control unit 17 determines whether a predetermined time has elapsed (step S4).

If it is determined that the predetermined time has not elapsed (“No” in step S4), the process waits for an operation on the operation unit 15 to be accepted.

If the control unit 17 determines that the predetermined time has elapsed (“Yes” in step S4), the image processing device 100 transmits an image for authentication to the server 50 (step S5).

After transmitting the image, the control unit 17 receives the authentication result of the authentication performed by the server 50 (step S6).

After the calling process in step S3, the control device 40 of the intercom system 1 performs an opening/closing process in response to the operation of the intercom base unit 20 (step S7). Specifically, when the control device 40 receives an unlock signal from the intercom base device 20, it unlocks the door of the common area, and after a certain period of time has elapsed, locks the door. Furthermore, even after receiving the authentication result in step S6, the control device 40 performs the opening/closing process in step S7 in response to instructions from the lobby intercom 10. Specifically, upon receiving an unlock signal from the lobby intercom 10, the control device 40 unlocks the door of the common area, and after a certain period of time has elapsed, locks the door.

(3-2) Operation example 1
Here, an example of the operation when performing authentication will be described using FIG. 5.

The imaging unit 11 of the lobby intercom 10 starts imaging when the sensor unit 12 detects a person (step S11).

The imaging unit 11 outputs the captured image (captured image) to the image processing device 100 (step S12).

The image acquisition unit 101 of the image processing device 100 receives the captured image and performs common processing (step S13). The image acquisition unit 101 performs processing such as RGB Bayer and two-stage exposure on the received captured image.

The image acquisition unit 101 outputs the image subjected to the common processing to the first processing unit 102 (step S14).

The first processing unit 102 performs first image processing on the image that has been subjected to the common processing (step S15). Specifically, the first processing unit 102 extracts a human face area included in the captured image. The first processing unit 102 performs at least one of distortion correction and color tone correction according to the extracted facial area, and generates an image for authentication. Note that when a plurality of face regions are extracted, the first processing unit 102 performs at least one of distortion correction and color tone correction for each extracted face region, and performs at least one of distortion correction and color tone correction for each extracted face region. Generate an image of

The first output unit 104 transmits the authentication image generated by the first processing unit 102 to the server 50 via the network NT1 (step S16).

The server 50 performs authentication processing using the authentication image received from the lobby intercom 10 (step S17).

After the authentication process is performed, the server 50 transmits the authentication result to the lobby intercom 10. The control unit 17 of the lobby intercom 10 controls opening and closing of the door of the common area according to the authentication result (see steps S6 and 7 in FIG. 4).

(3-3) Operation example 2
Here, an example of the operation when the intercom base unit 20 displays an image will be described using FIG. 6.

The imaging unit 11 of the lobby intercom 10 starts imaging when the sensor unit 12 detects a person (step S21).

The imaging unit 11 outputs the captured image (captured image) to the image processing device 100 (step S22).

The image acquisition unit 101 of the image processing device 100 receives the captured image and performs common processing (step S23). The image acquisition unit 101 performs processing such as RGB Bayer and two-stage exposure on the received captured image.

The image acquisition unit 101 outputs the image subjected to the common processing to the second processing unit 103 (step S24).

The second processing unit 103 performs second image processing on the image that has been subjected to the common processing (step S25). Specifically, the second processing unit 103 extracts a human face area included in the captured image. The second processing unit 103 performs at least one of distortion correction and color tone correction according to the extracted face area and the number thereof, and generates an image for display. Note that when a plurality of face regions are extracted, the second processing unit 103 performs at least one of distortion correction and color tone correction for each extracted face region, and performs correction for display. Generate an image of

The second output unit 105 transmits the display image generated by the second processing unit 103 to the intercom base unit 20 via the control device 40 (step S26).

The intercom base unit 20 performs display processing (step S27). Specifically, the intercom base unit 20 causes the display unit 25 to display the display image received from the lobby intercom 10, and performs the calling process (see step S6 in FIG. 4). When the control device 40 receives the unlock signal from the intercom base device 20, it unlocks the door of the common area, and after a certain period of time has elapsed, locks the door (see step S7 in FIG. 4).

(4) Advantages As explained above, the image processing device 100 includes the first processing unit 102 and the second processing unit 103, and based on the captured image captured by the imaging unit 11, an image (authentication and display images).

With this configuration, even if the image captured by the imaging unit is used for multiple purposes, it is possible to provide the optimal image for each purpose.

Further, each of the first processing section 102 and the second processing section 103 is realized by a different integrated circuit. Therefore, not only can images depending on the purpose be generated at different timings, but also parallel processing can be easily realized even at the same timing.

Furthermore, each of the first processing section 102 and the second processing section 103 sets different parameters for the same processing in order to generate images according to their respective purposes. Further, each of the first processing unit 102 and the second processing unit 103 executes different processing in order to generate an image according to each purpose. Therefore, each of the first processing unit 102 and the second processing unit 103 can generate an image appropriate for each purpose.

(5) Modification Examples Modification examples will be explained below. Note that the modified examples described below can be applied in combination with the above embodiment as appropriate.

(5-1) Modification example 1
In the embodiment, the intercom base unit 20 has been described as an example of the information terminal of the present disclosure. However, the information terminal is not limited to the intercom base unit 20. The information terminal may be a terminal capable of communicating with the lobby intercom 10 (intercom device), such as a smartphone, a tablet terminal, etc. used by a manager in the manager's room, a resident, or the like.

An information terminal such as a smartphone or a tablet terminal may be configured to be able to communicate with the lobby intercom 10 via the intercom base unit 20. Alternatively, information terminals such as smartphones and tablet terminals may be configured to be able to communicate via the control device 40 and the network NT1.

(5-2) Modification example 2
In the embodiment, the second processing unit 103 of the image processing device 100 may be configured to receive instructions for processing related to the generation of images for display based on the operation of the intercom base unit 20 as an information terminal. Alternatively, the second processing unit 103 may be configured to receive a change in the content of processing related to generation of a display image from the intercom base unit 20. For example, the second processing unit 103 receives an instruction from the intercom base device 20 to change to brightness correction as the color tone correction when performing shade correction as the color tone correction in the process related to the generation of a display image.

Further, the second processing unit 103 may receive an instruction to change the process from, for example, an information terminal such as a smartphone used by a resident.

The first processing unit 102 may be configured not to accept changes in the content of processing related to the generation of images for display from the intercom base unit 20 and a terminal such as a smartphone. Thereby, it is possible to maintain generation of a highly accurate image for authentication.

(5-3) Modification example 3
In the embodiment, the use of the image captured by the imaging unit 11 has been described using examples of use for authentication and use for display, but the use is not limited to these.

The image captured by the imaging unit 11 may be used for other purposes. For example, the image captured by the imaging unit 11 may be used for monitoring. When using the image for monitoring, the image processing device 100 applies at least one of distortion correction and color tone correction to the image captured by the imaging unit 11 so that the human face becomes clear, as in the case for authentication. Do it against.

Furthermore, the destination of the image processed by the image processing device 100 is not limited to either the server 50 or the intercom base unit 20. The destination of the image may be changed depending on the purpose. For example, when the image captured by the imaging unit 11 is used for monitoring, the image processed by the image processing device 100 may be obtained from a control room base unit provided in the manager's room.

(5-4) Modification example 4
In the embodiment, the image processing device 100 has a configuration including two processing units (the first processing unit 102 and the second processing unit 103) configured with different integrated circuits, but the configuration is not limited to this.

The image processing device 100 may include three or more processing units configured with different integrated circuits. For example, when the image processing device 100 includes three processing units configured with different integrated circuits, the first processing unit 102 generates an image for authentication, and the second processing unit 103 freezes an image for display. However, the third processing section generates an image for object detection. Here, object detection means, for example, detecting when a person enters or leaves a room. The third processing section performs at least one of distortion correction and color tone correction on the image captured by the imaging section 11 so that the shape of the person becomes clear.

Further, the third processing unit may generate an image for use in recording, crime prevention, etc. in addition to object detection.

(5-5) Modification example 5
In the embodiment, the lobby intercom 10 has a configuration including two communication units (the first communication unit 13 and the second communication unit 14), but is not limited to this configuration.

The lobby intercom 10 may have a configuration including one communication section. In this case, the first processing unit 102 transmits the generated authentication image to the server 50 via the one communication unit and the control device 40 . The second processing unit 103 transmits the generated display image to the intercom base unit 20 via the one communication unit and the control device 40.

(5-6) Modification example 6
In the embodiment, it is assumed that image display and authentication are performed at separate timings, but image display and authentication may be performed at the same timing. That is, the first processing section 102 and the second processing section 103 may operate in parallel. Since the first processing unit 102 and the second processing unit 103 are configured with different integrated circuits, they can easily operate in parallel.

(5-7) Modification example 7
In the embodiment, face authentication has been described as an example of image authentication. Image authentication is not limited to face authentication. For example, image authentication may be contour authentication of a person's face or iris authentication of eyes. For example, when performing contour authentication, the image processing device 100 performs at least one of distortion correction and color tone correction on the image captured by the imaging unit 11 so that the contour of the face becomes clear.

(5-8) Modification example 8
Other modifications will be listed below.

In the embodiment, the configuration is such that the image acquisition unit 101 performs common processing related to image processing, but the configuration is not limited to this. Each of the first processing unit 102 and the second processing unit 103 may individually perform common processing.

Further, in the embodiment, the first processing unit 102 and the second processing unit 103 are configured with different integrated circuits, but they may also be configured with dual cores having a plurality of arithmetic processing circuits in one integrated circuit. good.

Furthermore, in the embodiment, the lobby intercom 10 is configured to include the image processing device 100, but the present invention is not limited to this configuration. The image processing device 100 may be provided in a separate housing from the lobby intercom 10. That is, the image processing device 100 may be provided in the intercom system 1 as a separate device from the lobby intercom 10. When the image processing device 100 is provided in the intercom system 1 as a separate device from the lobby intercom 10, the image processing device 100 may acquire images from the entrance slave unit 30 having an imaging unit. In this case, the entrance handset 30 having the imaging unit corresponds to the intercom device of the present disclosure.

Further, the image processing device 100 may be provided in the entrance slave unit 30 having an imaging unit. In this case, the entrance slave device 30 generates an image according to the purpose based on the image captured by the imaging unit of the own device. Thereby, the image processing device 100 can also be applied to an intercom system installed in a detached house. In this case, the entrance handset 30 having the imaging unit corresponds to the intercom device of the present disclosure.

Furthermore, the image processing device 100 may be applied to systems other than the intercom system 1. For example, the image processing device 100 can be applied to any system that performs authentication and image display.

Further, the intercom base unit 20 may display the authentication image when the authentication image is generated.

Further, the lobby intercom 10 and the server 50 may communicate with each other via the network NT1 and the control device 40.

(Other variations)
The above embodiment is only one of various embodiments of the present disclosure. The embodiments described above can be modified in various ways depending on the design, etc., as long as the objective of the present disclosure can be achieved. Further, functions similar to those of the image information output system 2 may be realized by an image information output method, a computer program, a non-temporary recording medium on which the program is recorded, or the like. An image information output method according to one embodiment includes an image acquisition step, a first processing step, a second processing step, a first output step, and a second output step. The image acquisition step acquires an image captured by the imaging unit 11 of the intercom device (lobby intercom 10) having the imaging unit 11. The first processing step generates first image information to be used for a first purpose based on the image. The second processing step generates second image information to be used for a second purpose based on the image. The first output step outputs first image information. The second output step outputs second image information. A program according to one aspect is a program for causing a computer system to function as the image information output method described above.

The main body that executes the image information output system 2 or the image information output method in the present disclosure includes a computer system. A computer system has a processor and memory as hardware. When a processor executes a program recorded in the memory of a computer system, the function as an execution entity of the image information output system 2 or the image information output method according to the present disclosure is realized. The program may be pre-recorded in the memory of the computer system, or may be provided over a telecommunications line. Further, the program may be provided by being recorded on a non-transitory recording medium such as a memory card, an optical disk, or a hard disk drive that can be read by a computer system. A processor in a computer system is comprised of one or more electronic circuits including semiconductor integrated circuits (ICs) or large scale integrated circuits (LSIs). The plurality of electronic circuits may be integrated into one chip, or may be provided in a distributed manner over a plurality of chips. A plurality of chips may be integrated into one device, or may be distributed and provided in a plurality of devices.

The image information output system 2, which is a computer system, may be a system composed of one or more computers. For example, at least some of the functions of the image information output system 2 may be realized by cloud (cloud computing).

(summary)
As explained above, the image information output system (2) of the first aspect includes an image acquisition section (101), a first processing section (102), a second processing section (103), and a first output section. (104) and a second output section (105). An image acquisition unit (101) acquires an image captured by an imaging unit (11) of an intercom device (eg, lobby intercom 10) having an imaging unit (11). The first processing unit (102) generates first image information (for example, an image for authentication) to be used for a first purpose based on the image. The second processing unit (103) generates second image information (for example, a display image) to be used for a second purpose based on the image. The first output unit (104) outputs first image information. The second output unit (105) outputs second image information.

According to this configuration, the first processing section (102) generates first image information to be used for a first purpose, and the second processing section (103) generates second image information to be used for a second purpose. Therefore, even if the image captured by the imaging unit (11) is used for multiple purposes, it is possible to provide the optimal image for each purpose.

In the image information output system (2) of the second aspect, the first processing section (102) and the second processing section (103) perform different processes in the first embodiment. According to this configuration, it is possible to perform appropriate processing according to the purpose of use.

In the image information output system (2) of the third aspect, in the first aspect, the first processing section (102) and the second processing section (103) perform the same processing using different parameters. According to this configuration, it is possible to perform appropriate processing according to the purpose of use.

In the image information output system (2) of the fourth aspect, in any one of the first to third aspects, the processing performed by each of the first processing section (102) and the second processing section (103) is distortion correction. including. According to this configuration, it is possible to perform appropriate correction according to the purpose of use.

In the image information output system (2) of the fifth aspect, in any one of the first to fourth aspects, the processing performed by each of the first processing section (102) and the second processing section (103) is color tone correction. including. According to this configuration, it is possible to perform appropriate correction according to the purpose of use.

In the image information output system (2) of the sixth aspect, in any one of the first to fifth aspects, the processing performed by each of the first processing section (102) and the second processing section (103) is This is done for some areas. According to this configuration, appropriate processing can be performed on the area necessary when using the image according to the purpose of use.

In the image information output system (2) of the seventh aspect, in the sixth aspect, when a plurality of areas exist in the image as part of the area, the first processing unit (102) and the second processing unit (103) Each of these performs processing according to its respective area. According to this configuration, appropriate processing can be performed on each of a plurality of areas required when using an image, depending on the purpose of use.

In the image information output system (2) of the eighth aspect, in any one of the first to seventh aspects, the first application includes image authentication using the first image information. According to this configuration, the first processing unit (102) generates the first image information by performing processing suitable for image authentication on the image captured by the imaging unit (11), so that the accuracy of image authentication can be improved. can be increased.

In the image information output system (2) of the ninth aspect, in the eighth aspect, image authentication includes face authentication. According to this configuration, the accuracy of face authentication can be improved.

In the image information output system (2) of the tenth aspect, in the first to ninth aspects, the second use includes display on an information terminal (eg, intercom base unit 20) that communicates with the intercom device. According to this configuration, the second processing unit (103) generates the second image information by performing processing suitable for displaying the image on the image captured by the imaging unit (11), so that the second image information can be easily viewed by the viewer. Images can be displayed on information terminals.

In the image information output system (2) of the eleventh aspect, in the tenth aspect, the first application includes image authentication using the first image information. The first processing unit (102) does not accept an instruction to change the content of processing based on the operation of the information terminal (for example, intercom base unit 20). The second processing unit (103) receives an instruction to change the content of processing based on the operation of the information terminal. According to this configuration, the second image information generated by the second processing unit (103) can be changed to make it easier for the viewer to view according to the viewer's instructions. Furthermore, since the first image information used for image authentication cannot be changed, highly accurate authentication can be maintained.

In the image information output system (2) of the twelfth aspect, in any one of the first to eleventh aspects, the first processing section (102) and the second processing section (103) are configured with different integrated circuits. ing. According to this configuration, even if the image captured by the imaging unit (11) is used for multiple purposes, it is possible to provide the optimal image for each purpose.

The image information output method of the thirteenth aspect includes an image acquisition step, a first processing step, a second processing step, a first output step, and a second output step. The image acquisition step acquires an image captured by an imaging unit (11) of an intercom device (for example, lobby intercom 10) having an imaging unit (11). The first processing step generates first image information to be used for a first purpose based on the image. The second processing step generates second image information to be used for a second purpose based on the image. The first output step outputs first image information. The second output step outputs second image information.

According to the image information output method, even if the image captured by the imaging unit (11) is used for multiple purposes, it is possible to provide the optimal image for each purpose.

The program according to the fourteenth aspect is a program for causing a computer to execute the image information output method according to the thirteenth aspect.

According to this program, even if the image captured by the imaging unit (11) is used for multiple purposes, it is possible to provide the optimal image for each purpose.

The image information output system (2) of the fifteenth aspect includes an image acquisition section (101), a first processing section (102), a second processing section (103), a first output section (104), and a second processing section (103). 2 output section (105). An image acquisition unit (101) acquires an image. The first processing unit (102) generates first image information for face authentication based on the image. The second processing unit (103) generates second image information for viewing and display based on the image. The first output unit (104) outputs first image information. The second output unit (105) outputs second image information.

According to this configuration, even if the image captured by the imaging unit (11) is used for multiple purposes, it is possible to provide the optimal image for each purpose.

2 Image information output system 10 Lobby intercom (intercom device)
11 Imaging unit 20 Intercom base unit (information terminal)
30 Entrance handset (intercom device)
100 Image processing device 101 Image acquisition section 102 First processing section 103 Second processing section 104 First output section 105 Second output section

Claims (13)

an imaging unit;
an image acquisition unit that acquires an image captured by the imaging unit;
a first processing unit that generates first image information to be used for a first purpose based on the image;
a second processing unit that generates second image information to be used for a second purpose based on the image;
a first output unit that outputs the first image information;
a second output unit that outputs the second image information ,
The second use includes display on an information terminal that is a communication destination,
The first processing unit does not receive an instruction to change the content of processing based on the operation of the information terminal,
The second processing unit receives an instruction to change the content of processing based on the operation of the information terminal.
Lobby intercom. The first processing unit and the second processing unit perform different processing,
The lobby intercom according to claim 1. The first processing unit and the second processing unit perform the same type of processing using different parameters,
The lobby intercom according to claim 1. The processing performed by each of the first processing unit and the second processing unit includes distortion correction,
The lobby intercom according to any one of claims 1 to 3. The processing performed by each of the first processing unit and the second processing unit includes color tone correction,
A lobby intercom according to any one of claims 1 to 4. The processing performed by each of the first processing unit and the second processing unit is performed on a partial area of the image,
A lobby intercom according to any one of claims 1 to 5. When a plurality of regions exist in the image as the partial region, each of the first processing section and the second processing section performs processing according to each region.
The lobby intercom according to claim 6. The first use includes image authentication using the first image information,
Lobby intercom according to any one of claims 1 to 7. The image authentication includes face authentication,
The lobby intercom according to claim 8. The first processing section and the second processing section are configured with different integrated circuits,
Lobby intercom according to any one of claims 1 to 9. A lobby intercom according to any one of claims 1 to 10,
an information terminal that communicates with the lobby intercom;
intercom system. A method for outputting image information of a lobby intercom having an imaging unit, the method comprising:
an image acquisition step of acquiring an image captured by the imaging unit;
a first processing step of generating first image information to be used for a first purpose based on the image;
a second processing step of generating second image information to be used for a second purpose based on the image;
a first output step of outputting the first image information;
a second output step of outputting the second image information,
The second use includes display on an information terminal that is a communication destination,
In the first processing step, an instruction to change the content of processing based on the operation of the information terminal is not accepted;
In the second processing step, receiving an instruction to change the content of processing based on the operation of the information terminal;
Image information output method. A program for causing a computer to execute the image information output method according to claim 12.

Images