TW202105980A - Image processing system, image processing method and program - Google Patents

Abstract

This invention provides an image processing system, an image processing method and a program capable of easily changing a captured image according to a display destination device or a display mode. An image processing system (2) includes an acquisition unit (101) and an image processing unit (102). The acquisition unit (101) acquires an image captured by an image pickup unit (11). The image processing unit (102) changes the captured image into a plurality of display ranges based on a predetermined reference. As a result, the captured image captured by the image pickup unit (11) can be easily changed according to a display destination device or a display mode.

Description

Image processing system, image processing method and program

The present disclosure generally relates to an image processing system, an image processing method, and a program, and more specifically, relates to an image processing system, an image processing method, and a program that generate an image corresponding to a display device.

Previously, in the walkie-talkie system, there has been known a technology for displaying images taken by visitors (for example, refer to Document 1 "Japanese Patent Publication No. 2017-147646").

The walkie-talkie system described in Document 1 has: a hall sub-machine, which has a camera capable of shooting a plurality of wide images with different viewing angles; and a main room machine, which can receive and display the wide images taken by the camera. The foyer slave machine determines the angle of view of the wide image taken by the camera based on the setting information set by the master machine in the room.

However, there are cases in which images (camera images) shot in the walkie-talkie system are displayed in multiple devices or in a case in which one device is displayed in multiple display modes. In this case, it is necessary to set the information used to process the captured images individually according to the device or display mode of the display terminal.

The present disclosure has been completed in view of the above-mentioned problems, and its purpose is to provide an image processing system, an image processing method, and a program that can easily change the captured image according to the device or display mode of the display end.

An image processing system of one aspect of the present disclosure includes an acquisition unit and an image processing unit. The acquisition unit described above acquires the captured image captured by the imaging unit. The image processing unit changes the captured image to images of a plurality of display ranges based on a specific reference.

An image processing method of one aspect of the present disclosure includes an obtaining step and an image processing step. The above-mentioned obtaining step obtains the camera image captured by the camera unit. The image processing step changes the captured image to images in a plurality of display ranges based on a specific reference.

The program of one aspect of the present disclosure is a program used to make a computer execute the above-mentioned image processing method.

The embodiments and modified examples described below are only examples of the present disclosure, and the present disclosure is not limited to the embodiments and modified examples. Even if it is a thing other than the following embodiment and modification, as long as it does not deviate from the range of the technical idea of this indication, you can make various changes based on a design etc..

(Implementation form) Hereinafter, the walkie-talkie system 1 and the image processing system 2 of this embodiment will be described with reference to Figs. 1 to 7.

(1) Summary The walkie-talkie system 1 of this embodiment is shown in Figure 2. It is equipped with hall walkie-talkies 10 as walkie-talkie devices, plural (two in the example of the figure) walkie-talkie master units 20, and plural (two in the example of the figure) foyer机30, and control device 40. In this embodiment, a case where the walkie-talkie system 1 is used in a multi-unit housing as the facility 5 will be described as an example. In addition, each of the plurality of walkie-talkie base units is equivalent to the information terminal of the present disclosure.

The hall intercom 10 is installed in a shared part such as a hall of a multi-unit housing. In addition to the shared department, collective housing also has multiple exclusive departments (households). The walkie-talkie parent machine 20 is arranged in the exclusive parts according to the exclusive parts. The hall sub-machine 30 is installed in the hall outside the residence, for example, according to each exclusive part.

The hall intercom 10 includes an imaging unit 11 and an image processing device 100 as an image processing system 2. The hall intercom 10 performs processing related to the image taken by the camera unit 11.

The hall walkie-talkie 10 and the walkie-talkie main unit 20 are configured to be able to communicate with each other via the control device 40. Thereby, in the walkie-talkie system 1 of the present embodiment, it is possible to talk between the hall walkie-talkie 10 and the walkie-talkie base unit 20. Furthermore, the main intercom unit 20 and the hall slave unit 30 are configured to be able to communicate with each other.

In addition, the hall intercom 10 is configured to be able to communicate with the control device 40 via the management room parent machine 50 installed in the management room of the facility 5. Thereby, in the walkie-talkie system 1 of the present embodiment, it is possible to talk between the hall walkie-talkie 10 and the control room parent machine 50.

When the hall intercom 10 detects a person (for example, a visitor) in the sharing unit, it starts to take a video of the person. When the hall walkie-talkie 10 receives an operation for calling from a visitor, it sends a control signal (call signal) for calling the resident in the exclusive section to the walkie-talkie main unit 20 via the control device 40. When the hall walkie-talkie 10 can communicate with the walkie-talkie base unit 20 by operating the walkie-talkie base unit 20, the voice data of the visitor is sent to the walkie-talkie base unit 20 via the control device 40. When the hall walkie-talkie 10 receives the operator's voice data of the walkie-talkie parent machine 20 via the control device 40, it outputs a voice (operator's voice) based on the received data. In addition, when the hall intercom 10 receives a call operation for the manager from a visitor, it transmits a control signal (call signal) for calling the manager to the control room main unit 50 via the control device 40. When the lobby walkie-talkie 10 can communicate with the control room parent machine 50 by operating the control room parent machine 50, the voice data of the visitor is sent to the control room parent machine 50 via the control device 40. When the hall intercom 10 receives the voice data of the operator (manager) of the parent machine 50 of the management room via the control device 40, it outputs a voice (manager's voice) based on the received data.

The image processing device 100 performs a process of changing the captured image into a plurality of display ranges based on a specific reference on the image (captured image) captured by the imaging unit 11.

In the state where the main interphone 20 receives the control signal (call signal) from the hall intercom 10 (that is, the state where the visitor calls via the hall intercom 10), the occupants in the exclusive department talk with the hall intercom 10 or unlock the hall door. operating.

When the control device 40 receives a control signal (call signal) from the hall intercom 10, it sends the received control signal to the called intercom master unit 20. The control device 40 receives and transmits the voice data of the visitor and the voice data of the operator when the communication between the hall intercom 10 and the main intercom 20 is in a state of being able to talk. Furthermore, the control device 40 performs, for example, locking and unlocking of a door installed in a hall according to the operation of the main interphone 20.

When the hall slave 30 receives an operation for calling from a visitor, it sends a control signal (call signal) for calling the resident in the exclusive department to the intercom master 20. When the hall sub-machine 30 can communicate with the intercom main unit 20 through the operation of the intercom main unit 20, the voice data of the visitor is sent to the intercom main unit 20. When the hall sub-machine 30 receives the voice data of the operator of the walkie-talkie parent machine 20, it outputs a voice (operator's voice) based on the received data.

(2) Composition (2-1) Hall intercom The hall intercom 10 is shown in FIG. 1 and includes an image processing device 100 as an image processing system 2, an imaging unit 11, a sensor unit 12, a communication unit 13, an operation unit 14, a communication unit 15, a memory unit 16, and a display unit 17. , And control unit 18.

The hall intercom 10 has, for example, a microcomputer including a processor and a memory. In addition, the microcomputer functions as the control unit 18 by executing the program stored in the memory by the processor. The program executed by the processor is here pre-recorded in the memory of the microcomputer, but it can also be provided by recording on a non-temporary recording medium such as a memory card, or provided via electrical communication lines such as the Internet.

The imaging unit 11 has imaging elements such as a CCD (Charge Coupled Devices) image sensor, or a CMOS (Complementary Metal-Oxide Semiconductor) image sensor, and other two-dimensional image sensors. And it is a camera used to shoot subjects (visitors, etc.) from a specific angle of view. The lens used in the imaging section 11 for imaging is, for example, a fisheye lens. In this embodiment, the imaging area (field of view) of the imaging unit 11 is set in front of the hall intercom 10 so that at least the face of the visitor can be photographed. In addition, in this embodiment, the imaging unit 11 is a camera that shoots moving images, and may also be a camera that shoots still images. Furthermore, in this embodiment, the imaging unit 11 is a camera that captures color images, but it may also be a camera that captures black and white images. Furthermore, in this embodiment, the direction of the lens of the imaging unit 11 can be moved in the left-right direction and the up-down direction as viewed from the imaging unit 11 by an electrical operation.

The sensor unit 12 is, for example, a human body sensor that detects the proximity of a person.

The communication unit 13 includes a communication interface for communicating with the walkie-talkie base unit 20 and the management room base unit 50 via the control device 40. The communication unit 13 is configured to be capable of two-way transmission of voice signals and control signals between the hall walkie-talkie 10 and the walkie-talkie base unit 20, and is configured to be capable of two-way communication with the walkie-talkie base unit 20. Furthermore, the communication unit 13 is configured to be capable of two-way communication between the hall intercom 10 and the management room main unit 50 in a manner capable of two-way transmission of sound signals and control signals.

The operation unit 14 accepts operations for the call from the visitor. If a specific operation (such as a key operation) is performed on the operating unit 14 in order to call the occupants of the exclusive section (household), the control signal (call signal) used to call the occupants of the exclusive section (household) is passed through The communication unit 13 and the control device 40 send to the walkie-talkie main unit 20. Furthermore, if a specific operation (such as a key operation) is performed on the operation unit 14 to call the manager, the operation unit 14 sends a control signal (call signal) for calling the manager to the management room via the communication unit 13 and the control device 40 Mother machine 50.

The communication unit 15 includes a speaker and a microphone, and is configured to be able to communicate with the intercom base unit 20 and the management room base unit 50.

The memory unit 16 is selected from ROM (Read Only Memory), RAM (Random Access Memory), or EEPROM (Electrically Erasable Programmable Read Only Memory: Electronically Erasable Programmable Read Only Memory). Memory) and other devices. The storage unit 16 stores the image processed by the image processing device 100 based on the camera image taken by the camera unit 11.

The display unit 17 is, for example, a liquid crystal display. In addition, when the hall intercom 10 is equipped with a touch panel display, the touch panel display may also serve as a part of the display unit 17 and the operation unit 14.

The control unit 18 receives the detection result from the sensor unit 12. The control unit 18 receives the information of the operation accepted by the operation unit 14 from the operation unit 14.

When the detection result of the sensor unit 12 indicates that a person is detected, the control unit 18 activates the imaging unit 11 to start shooting. That is, the control unit 18 starts to supply power to the imaging unit 11.

The control unit 18 transmits a control signal (call signal) to the intercom base unit 20 via the communication unit 13 and the control device 40 when performing a call operation to the intercom base unit 20. At this time, the control unit 18 cuts out a part or all of the image taken from the imaging unit 11, and sends it to the intercom base unit 20 via the communication unit 13 and the control device 40 for display. When the control unit 18 and the intercom base unit 20 are in a state of being able to talk, if the voice data (sound signal) of the visitor is received from the microphone of the communication unit 15, it will send the received sound signal to the intercom base unit 20. When the control unit 18 and the intercom base unit 20 are in a state of being able to talk, if the operator's voice signal is received from the intercom base unit 20, the received sound signal is output to the speaker of the communication unit 15. At this time, the speaker outputs sound based on the received sound signal.

The control unit 18 transmits a control signal (call signal) to the control room parent machine 50 via the communication unit 13 and the control device 40 when performing a call operation to the control room parent machine 50. At this time, the control unit 18 cuts out a part of the image taken from the imaging unit 11, and sends it to the management room main computer 50 via the communication unit 13 and the control device 40, and displays it. When the control unit 18 is in a state of being able to communicate with the control room base machine 50, if the microphone of the communication unit 15 receives the visitor's voice data (sound signal), it will send the received sound signal to the management room Mother machine 50. When the control unit 18 is in a state of being able to communicate with the control room base machine 50, if it receives the operator (manager) voice signal from the control room base machine 50, it outputs the received voice signal to the communication unit 15 speaker. At this time, the speaker outputs sound based on the received sound signal.

The image processing device 100 performs image processing on the captured image according to the display state of the display end that displays the image (camera image) captured by the camera unit 11. The image processing device 100 changes the image captured by the camera unit 11 (camera image) based on a specific reference, and changes the captured image to an image of a plurality of display ranges according to the display state of the display end. The detailed structure of the image processing device 100 will be described later.

(2-2) Walkie-talkie parent machine As shown in FIG. 2, the main interphone 20 includes a first communication unit 21, a second communication unit 22, an operation unit 23, a communication unit 24, a display unit 25, and a control unit 26.

The main walkie-talkie 20 has, for example, a microcomputer including a processor and a memory. In addition, the microcomputer functions as the control unit 26 by executing the program stored in the memory by the processor. The program executed by the processor is pre-recorded in the memory of the microcomputer here, and can also be provided by recording on a non-temporary recording medium such as a memory card, or provided via an electrical communication line such as the Internet.

The first communication unit 21 is a communication interface for communicating with the control device 40. The first communication unit 21 is connected to the hall intercom 10 via the control device 40. For example, the first communication unit 21 receives the video transmitted from the hall intercom 10. Furthermore, in order to allow two-way transmission of voice signals and control signals with the hall intercom 10, the first communication unit 21 is configured to be capable of two-way communication with the hall intercom 10.

The second communication unit 22 is a communication interface for communicating with the hall slave machine 30. The second communication unit 22 is electrically connected to the hall slave 30 via, for example, a two-wire transmission path including a twisted pair cable or the like.

The operation part 23 accepts the operations of the occupants in the exclusive part. When the first communication unit 21 receives the control signal (call signal) for calling the occupant from the hall intercom 10, and performs a specific operation on the operation unit 23, the main unit of the intercom 20 and the hall intercom 10 can be talked. status. Here, the specific operation is, for example, a key operation. If the first communication unit 21 receives a call signal from the hall intercom 10 or can communicate with the hall intercom 10 and performs an unlock operation of the door provided in the common unit, the unlock signal is sent to the control device 40.

Furthermore, when the second communication unit 22 receives the control signal (call signal) for calling the occupant from the hall slave unit 30, and performs a specific operation (such as key operation) on the operation unit 23, the intercom base unit 20 and The slave phones 30 in the hall are in a state of being able to talk.

The communication unit 24 includes a speaker and a microphone, and is configured to be able to talk between the hall intercom 10 and the hall phone 30.

The display unit 25 is, for example, a liquid crystal display, and displays images sent from the hall intercom 10. The display unit 25 selects one display mode among the two display modes by the operation of the occupant, and displays the image in the selected display mode. Specifically, by the operation of the occupant, one display mode is selected from the first display mode in which only one screen is displayed and the second display mode in which a plurality of screens (for example, two screens) are displayed.

When the first display mode is selected, the display unit 25 displays the image with the aspect ratio of the rectangular screen of 3:5 (9:15) (refer to FIG. 3A). When the second display mode is selected, the display unit 25 displays two images with the aspect ratio of each of the two rectangular screens of 9:10 and 9:5 (refer to FIG. 3B). When the display part 25 selects the second aspect, the real-time image is displayed on the screen with the aspect ratio of 9:10, and the past image (the image shot several seconds earlier than the current time) is displayed on the screen with the aspect ratio of 9:5.

When the control unit 26 receives the control signal (call signal) and video from the hall intercom 10 via the first communication unit 21, it outputs the sound data of the call sound to the speaker of the communication unit 24, and outputs the received video to the display unit 25 . Thereby, the control unit 26 causes the speaker of the communication unit 24 to output a calling sound, and causes the display unit 25 to display the first video.

When the control unit 26 receives a control signal (call signal) from the hall slave 30 via the second communication unit 22, it causes the speaker of the communication unit 24 to output a call sound.

(2-3) Foyer handset The hall slave machine 30 has, for example, a microcomputer including a processor and a memory. In addition, the processor executes the program stored in the memory, so that the microcomputer functions as the hall slave 30. The program executed by the processor is pre-recorded in the memory of the microcomputer here, but it can also be recorded on a non-temporary recording medium such as a memory card and provided, or it can be provided through an electrical communication line such as the Internet.

When the hall slave 30 receives an operation for calling from a visitor, it sends a control signal (call signal) for calling the resident in the exclusive department to the intercom master 20.

The hall sub-machine 30 includes a speaker and a microphone, and is configured to be able to communicate with the intercom main machine 20.

In addition, the hall sub-machine 30 may have a camera unit. In this case, the hall sub-machine 30 sends the image taken by the camera unit to the intercom main machine 20. The main interphone 20 uses the display part 25 to display the image received from the slave 30 in the hall.

(2-4) Control room main machine As shown in FIG. 2, the host computer 50 of the management room includes a communication unit 51, an operation unit 52, a communication unit 53, a display unit 54, and a control unit 55.

The host computer 50 of the management room has, for example, a microcomputer including a processor and a memory. In addition, the microcomputer functions as the control unit 55 by executing the program stored in the memory by the processor. The program executed by the processor is pre-recorded in the memory of the microcomputer here, but it can also be recorded on a non-temporary recording medium such as a memory card and provided, or it can be provided through an electrical communication line such as the Internet.

The communication unit 51 is a communication interface for communicating with the control device 40. The communication unit 51 is connected to the hall intercom 10 via the control device 40. For example, the communication unit 51 receives the video sent from the hall intercom 10. Furthermore, in order to allow two-way transmission of voice signals and control signals with the hall intercom 10, the communication unit 51 is configured to be capable of two-way communication with the hall intercom 10.

The operation part 52 accepts the operation of the manager. When the communication unit 51 receives the control signal (call signal) for calling the occupant from the hall intercom 10, if the operation unit 52 is specifically operated, the control room main unit 50 and the hall intercom 10 can be communicated with each other. status. Here, the specific operation is, for example, a key operation.

The communication unit 53 includes a speaker and a microphone, and is configured to be able to communicate between the management room base machine 50 and the management room base machine 50.

The display unit 54 is, for example, a liquid crystal display, and displays images sent from the hall intercom 10. The display unit 54 displays the image with the aspect ratio of the rectangular screen of 3:4 (9:12) (refer to FIG. 4).

When the control unit 55 receives the control signal (call signal) and video from the hall intercom 10 via the communication unit 51, it outputs the sound data of the call sound to the speaker of the communication unit 24, and outputs the received video to the display unit 54. Thereby, the control unit 55 causes the speaker of the communication unit 53 to output a calling sound, and causes the display unit 54 to display an image.

(2-5) Image processing device As shown in FIG. 1, the image processing device 100 as the image processing system 2 includes an acquisition unit 101, an image processing unit 102, a reference setting unit 103, a position setting unit 104, and a changing unit 105. In addition, in the following description, an image with an aspect ratio of 3:5 (9:15) is sometimes referred to as the first image, and an image with an aspect ratio of 3:4 (9:12) is sometimes referred to as the second image. , The image with the aspect ratio of 9:10 is called the third image, and the image with the aspect ratio of 9:5 is called the fourth image.

The acquisition unit 101 receives the image (camera image) captured by the imaging unit 11 from the imaging unit 11.

The image processing unit 102 changes the captured image to images of a plurality of display ranges based on a specific reference. As the specific reference used when changing the captured image to images of multiple display ranges, during the construction of the hall intercom 10, select at least one of the specific reference point, reference line, and reference plane as the specific reference and memorize it in the first Memory area. That is, the specific reference includes at least one of a specific reference point, a reference line, and a reference plane in the image.

The image processing unit 102 will be based on the reference selected during construction (any one of the specific reference point, reference line, and reference surface), and the image to be displayed on the display portion of the sending end will be cut from the captured image to become the reference position (Reference position), stored in the second memory area.

Furthermore, the image processing unit 102 stores the respective aspect ratios of the first image to the fourth image in the third memory area.

If the reference line is selected, and the lens direction of the imaging unit 11 is at the center, that is, the center of the moving range of the lens in the left and right directions and the center of the work area in the up and down direction, the image processing unit 102 passes through the center of the captured image. The straight line is the reference position. If the reference line is selected and the lens direction of the imaging unit 11 is regarded as left (or right) from the imaging unit 11, the image processing unit 102 will pass the straight line in the up and down direction at the left end of the captured image (or through the captured image The straight line in the up and down direction at the right end is used as the reference position. In addition, if the reference point is selected and the lens direction of the imaging unit 11 is the center, the image processing unit 102 uses the center point of the captured image as the reference position. If the reference point is selected, and the lens direction of the imaging unit 11 is regarded as left (or right) from the imaging unit 11, the image processing unit 102 sets the left midpoint of the captured image (or the midpoint of the right end of the captured image). ) As the reference position. In the case of selecting the reference surface, the face area of the person included in the captured image is used as the reference position. In addition, if the captured image contains the faces of multiple individuals, the image processing unit 102 uses the largest face area as the reference position.

Based on the determined reference position and the image size to be displayed on the display portion of the call end, the image processing unit 102 changes the captured image to an image corresponding to the display range of the display portion of the call end of the hall intercom 10.

The image processing unit 102 changes the camera image when it passes through the straight line in the upper and lower direction of the left end (or right end) of the camera image as the reference position, and the calling end, ie, the display unit 25 of the intercom base 20, displays the image in the first display mode. It is an image that includes the reference position (reference line) as one side and the display range with an aspect ratio of 9:15. Specifically, the image processing unit 102 cuts the first image including the reference position (reference line) as one side from the captured image and the aspect ratio is 9:15.

When the image processing unit 102 passes through the straight line in the upper and lower direction of the left end (or right end) of the captured image as the reference position, and the calling end, that is, the display part 25 of the walkie-talkie base unit 20 displays the image in the second display mode, it will be captured in real time. The camera image (real-time image) is changed to an image that includes the reference position (reference line) as one side and the aspect ratio of the display range is 9:10. Specifically, the image processing unit 102 cuts a third image that includes a reference position (reference line) as one side and an aspect ratio of 9:10 from the real-time image. Furthermore, the image processing unit 102 changes the captured image taken in the past (past image) to an image including a reference position (reference line) as one side and a display range with an aspect ratio of 9:5. Specifically, the image processing unit 102 crops the fourth image including the reference position (reference line) as one side and the aspect ratio of 9:5 from the past image.

The image processing unit 102 changes the captured image to include the reference position (reference line) as one side when the straight line passing through the left end (or right end) of the captured image in the upper and lower direction is the reference position, and the calling end is the parent machine 50 of the management room And the aspect ratio is the image of the display range of 9:12. Specifically, the image processing unit 102 cuts out the second image that includes the reference position (reference line) as one side from the captured image and has an aspect ratio of 9:12.

When the image processing unit 102 sets the reference plane as the reference in the direction of the lens of the imaging unit 11, and the call end, the display unit 25 of the intercom base unit 20 displays the image in the first display mode, the captured image is changed to The reference position (face area) is an image with an aspect ratio of 9:15 at the center of the display range. Specifically, the image processing unit 102 cuts the first image with an aspect ratio of 9:15 centered on the reference position (face region) from the captured image.

When the image processing unit 102 is in the center of the lens direction of the imaging unit 11, and the reference plane is set as the reference, and the calling end, ie, the display unit 25 of the intercom base 20 displays images in the second display mode, the real-time image is changed to the reference The position (face area) is the center of the image with an aspect ratio of 9:10. Specifically, the image processing unit 102 cuts the third image with an aspect ratio of 9:10 centered on the reference position (face area) from the real-time image. Furthermore, the image processing unit 102 changes the past image to an image with an aspect ratio of 9:10 centered at the reference position (face area). Specifically, the image processing unit 102 crops the fourth image with an aspect ratio of 9:10 centered on the reference position (face region) from the past image.

When the image processing unit 102 sets the reference plane as the reference in the lens direction of the imaging unit 11 at the center, and the call-out end is the control room parent machine 50, the captured image is changed to the aspect ratio centered on the reference position (face area) It is the image of the display range of 9:12. Specifically, the image processing unit 102 cuts the second image with an aspect ratio of 9:12 centered on the reference position (face region) from the captured image.

In this embodiment, the standard used when changing the image to the image of a plurality of display ranges is used as the common standard. Therefore, it can be said that when the image processing unit 102 determines one of the plurality of display ranges, since the reference is common, the other display ranges are determined in conjunction with the determination of the one display range.

In addition, when the straight line passing through the left end (or right end) of the captured image in the upper and lower direction is the reference position, that is, when the reference line passes through the left end (or right end) of the captured image, the reference line includes 1 of each display range side.

Moreover, when the specific reference is the reference plane, that is, when the lens direction of the imaging unit 11 is at the center, the reference plane (human face region) includes the center of the image.

The image processing unit 102 sends the image cropped from the camera image to the device of the calling end via the control unit 18.

The reference setting unit 103 sets a reference for changing images of a plurality of display ranges in a specific reference point, reference line, and reference surface. Specifically, during the construction of the hall intercom 10, an operator or the like performs a specific operation on the operation unit 14 to select one of a specific reference point, a reference line, and a reference plane as a reference. The reference setting unit 103 stores the selected one reference in the first storage area.

The position setting unit 104 sets a reference position used when changing the captured image to an image of a plurality of display ranges.

When a reference point or a reference line is stored as a specific reference in the first storage area, the position setting unit 104 sets the reference position by adjusting the lens direction of the imaging unit 11. As described above, the lens direction of the imaging unit 11 can be moved in the left-right direction and the up-down direction from the imaging unit 11 by an electrical operation. For example, by operating (key operation) four keys 141 to 144 provided on the operation part 14 of the hall intercom 10, the lens direction of the imaging part 11 is adjusted. When the button 141 is operated by pressing the key, the lens of the imaging unit 11 moves in the right direction from the imaging unit 11. When the button 142 is pressed, the lens of the imaging unit 11 moves in the left direction from the imaging unit 11. When the button 143 is pressed, the lens of the imaging unit 11 moves in the upward direction. When the button 144 is pressed, the lens of the imaging unit 11 moves in the downward direction. The position setting unit 104 sets the reference position in accordance with the key operation of any one of the keys 141 and 142. For example, if the button 141 is pressed, when the reference line is stored in the first memory area, the straight line passing through the right end of the captured image is set as the reference position in the second memory area, and when the reference point is stored in the memory area , Set the middle point of the right end of the captured image as the reference position in the second memory area. If the button 142 is pressed, when the reference line is stored in the first memory area, the straight line passing through the left end of the captured image is set as the reference position in the second memory area. When the reference point is stored, the The middle point of the left end of the captured image is set in the second memory area as the reference position.

When the reference plane is stored as a specific reference in the first storage area, the position setting unit 104 sets the subject information based on the human face area as the reference in the second storage area.

The changing unit 105 and the changing unit 105 change the display range of at least one of the first to fourth images. Specifically, the changing unit 105 changes the aspect ratio of at least one of the first to fourth images. For example, when the changing unit 105 accepts the aspect ratio change from the operation unit 14 during the construction of the walkie-talkie system 1, it changes the aspect ratio of the change target among the aspect ratios of the first image to the fourth image stored in the third memory area to The aspect ratio received.

For example, if the aspect ratio of the first image is changed, the image processing unit 102 crops the first image from the captured image based on the reference position so that the aspect ratio becomes the ratio to be changed.

(3) Specific examples Here, a specific example will be used to explain how to change the captured image to an image of a plurality of display ranges.

FIG. 6A is a specific example when the specific reference is the reference point or reference line, and the reference position is the center of the captured image.

When cutting the first image, the image processing unit 102 uses the reference line L1 or the reference point O1 as a reference and the aspect ratio is 9:15 to determine the length in the left-right direction, thereby determining the display range R1. The image processing unit 102 uses the image in the determined display range R1 as the first image, and cuts it out from the captured image G1.

When cutting the second image, the image processing unit 102 uses the reference line L1 or the reference point O1 as a reference and the aspect ratio is 9:12 to determine the length in the left-right direction, thereby determining the display range R2. The image processing unit 102 uses the image of the determined display range R2 as the second image, and crops it from the captured image G1.

When cutting the third image, the image processing unit 102 uses the reference line L1 or the reference point O1 as a reference and the aspect ratio is 9:10 to determine the length in the left-right direction, thereby determining the display range R3. The image processing unit 102 uses the image of the determined display range R3 as the third image, and crops it from the captured image G1.

When cutting the fourth image, the image processing unit 102 uses the reference line L1 or the reference point O1 as a reference and the aspect ratio is 9:5 to determine the length in the left-right direction, thereby determining the display range R4. The image processing unit 102 uses the image in the determined display range R4 as the fourth image, and cuts it out from the captured image G1.

FIG. 6B is a specific example when the specific reference is the reference point or reference line, and the reference position is the left end of the captured image.

When cutting the first image, the image processing unit 102 uses the reference line L2 or the reference point O2 as a reference and the aspect ratio is 9:15 to determine the length in the right direction, thereby determining the display range R11. The image processing unit 102 uses the image of the determined display range R11 as the first image, and cuts it out from the captured image G11.

When cutting the second image, the image processing unit 102 uses the reference line L2 or the reference point O2 as a reference, and the aspect ratio is 9:12 to determine the length in the right direction, thereby determining the display range R12. The image processing unit 102 uses the image in the determined display range R12 as the second image, and cuts it out from the captured image G11.

When cutting the third image, the image processing unit 102 uses the reference line L2 or the reference point O2 as a reference and the aspect ratio is 9:10 to determine the length in the right direction, thereby determining the display range R13. The image processing unit 102 uses the image in the determined display range R13 as the third image, and cuts it out from the captured image G11.

When cutting the fourth image, the image processing unit 102 uses the reference line L2 or the reference point O2 as a reference and the aspect ratio is 9:5 to determine the length in the right direction, thereby determining the display range R14. The image processing unit 102 uses the image in the determined display range R14 as the fourth image, and cuts it out from the captured image G11.

As shown in FIG. 6A, at least a part of each of the display ranges R1 to R4 overlaps. Similarly, at least a part of each of the display ranges R1 to R14 overlaps.

In addition, when the captured image G1 is changed to the first image in the display range (for example, the display range R1) of one of the display ranges R1 to R4, the display range R1 changes the display range in the left-right direction. Then, according to the change direction (left-right direction), the captured image G1 is changed to the images (the second image to the fourth image) in the other display ranges R2 to R4. Similarly, when the captured image G11 is changed to the first image in one of the display ranges R11 to R14 (for example, the display range R11), the display range R11 changes the display range in the right direction. Then, according to the change direction (right direction), the captured image G11 is changed to the images (the second image to the fourth image) in the other display ranges R12 to R14. That is, when the image processing unit 102 sets a reference point or a reference line as a reference to determine a reference position, based on the reference position, the same direction is used as the change direction, and the captured image is changed to a plurality of display ranges.

In addition, here, the captured images G1 and G11 are set to be larger than the size of the display ranges R1 and R11 of the first image, but the captured images G1 and G11 may have the same size as the display ranges R1 and R11 of the first image. In short, the image processing unit 102 only needs to have the function of cutting at least a part of the captured image and changing it into images of a plurality of display ranges.

In addition, it is configured that the display sizes of the display ranges R1 to R4 are different from each other, but at least a part may be the same size. For example, the display range R1 of the first image and the display range R2 of the second image may be the same size. Similarly, it is configured that the display sizes of the display ranges R11 to R14 are different from each other, but at least a part may be the same size. That is, the display sizes of at least a part of the plurality of display ranges may be different. In addition, the plurality of display ranges only need to include display ranges with different aspect ratios with respect to the image size.

(4) Advantages As described above, the image processing device 100 (image processing system 2) of this embodiment uses a common reference position for any image when cutting the first image to the fourth image from the camera device, and the image is captured from Crop each image (the first image to the fourth image). Therefore, the image processing device 100 does not need to set the information used to process the captured image individually according to the device or display mode of the display terminal. Therefore, the image processing device 100 can easily change the captured image according to the device or display mode of the display terminal.

In addition, since the image processing device 100 changes the reference position according to the lens direction of the imaging unit 11, it is possible to increase the possibility that a person is included in the first image to the fourth image obtained from the captured image.

(5) Variation example Hereinafter, a modification example will be described. In addition, the modified examples described below can be applied in appropriate combination with the above-mentioned embodiments.

(5-1) Variation example 1 In the embodiment, when the captured image is changed to an image of a plurality of display ranges, the reference position is common, but it is not limited to this configuration.

When changing the camera image to images of multiple display ranges, the reference position of at least one display range can be different from the reference positions of other display ranges. The reference position when cutting the fourth image can be different from the reference position when cutting the first to third images.

For example, as shown in FIG. 6B, the reference position when cutting the first to third images, that is, the reference line L2, is the left end of the captured image. The reference position when cutting the fourth image, that is, the reference line L3 can be located closer to the center by a specific length than the reference line L2. In this case, when cutting the fourth image, the image processing unit 102 determines the length in the right direction using the reference line L3 as a reference and an aspect ratio of 9:5, thereby determining the display range R24 (refer to FIG. 7 ). The image processing unit 102 cuts the image of the determined display range R24 as the fourth image from the captured image G11.

By making the reference position of at least one display range differ from the reference positions of other display ranges by a certain length, the accuracy of including people in the cropped image (for example, the fourth image) can be improved.

(5-2) Variation 2 In this embodiment, the main interphone 20 and the main control room 50 may be provided with the image processing device 100. In this case, during the construction of the walkie-talkie system 1, the main interphone 20 and the main control room 50 receive lens information indicating the lens direction of the camera unit 11 of the hall intercom 10 from the hall intercom 10. Based on the received lens information, the intercom base unit 20 and the management room base unit 50 determine the reference position when cutting the first image to the fourth image.

Alternatively, the control device 40 may be provided with the image processing device 100. In this case, the control device 40 receives lens information from the hall intercom 10 during the construction of the intercom system 1. The control device 40 determines the reference position when cutting the first image to the fourth image based on the received lens information.

In addition, when the hall slave machine 30 includes an imaging unit, the hall slave machine 30 may also include the image processing device 100.

(5-3) Variation 3 In the above-mentioned embodiment, it is configured to adjust the lens direction of the imaging unit 11 by an electrical operation, but it is not limited to this configuration.

It may also be a configuration in which the lens direction of the imaging unit 11 is adjusted by physical operation. For example, when the walkie-talkie system 1 is being constructed, a constructor or the like can touch the lens of the imaging unit 11 to change its direction.

(5-4) Variation 4 In the above-mentioned embodiment, the main interphone 20 and the main control room 50 are configured to be the display ends of the captured image, but the configuration is not limited to this configuration.

The display terminal of the camera image can also be an information terminal such as a smart phone or a tablet terminal. In this case, the image processing device 100 changes the captured image to a display range corresponding to the aspect ratio displayed on the display portion of the information terminal based on the reference position.

Other changes The above-mentioned embodiment is only one of various embodiments of the present disclosure. As long as the purpose of cost disclosure can be achieved, the above-mentioned embodiment can be changed in various ways according to the design. In addition, the same functions as the image processing system 2 can also be embodied by an image processing method, a computer program, or a non-temporary recording medium on which the program is recorded. One aspect of the image processing method includes an acquisition step of acquiring an image captured by the imaging unit, and an image processing step of changing the image to images of a plurality of display ranges based on a specific reference. One aspect of the program is a program used to make the computer system function as the above-mentioned image processing method.

The execution body of the image processing system 2 or the image processing method in the present disclosure includes a computer system. The computer system has a processor and memory as hardware. The processor executes the program recorded in the memory of the computer system to realize the function as the execution subject of the image processing system 2 or the image processing method in the present disclosure. The program can be pre-recorded in the memory of the computer system, but it can also be provided through an electrical communication line. In addition, the program can also be recorded on non-temporary recording media such as memory cards, optical discs, and hard disk drives that can be read by a computer system. The processor of a computer system is composed of one or more electronic circuits including a semiconductor integrated circuit (IC: Integrated Circuit) or a large scale integrated circuit (LSI: Large Scale Integrated Circuit). Multiple electronic circuits can be concentrated on one chip, or distributed on multiple chips. Multiple chips can be concentrated in one device or distributed in multiple devices.

The computer system, that is, the image processing system 2 may also be a system composed of one or more computers. For example, at least a part of the functions of the image processing system 2 can also be implemented by the cloud (cloud computing).

(to sum up) As described above, the image processing system (2) of the first aspect includes an acquisition unit (101) and an image processing unit (102). The obtaining unit (101) obtains the captured image captured by the imaging unit (11). The image processing unit (102) changes the captured image to images (for example, the first image to the fourth image) of a plurality of display ranges (for example, display ranges R1 to R4, R11 to R14) based on a specific reference.

According to this configuration, the captured image is changed to images of a plurality of display ranges based on a specific reference, so there is no need to set the individual processing of the captured image captured by the camera unit (11) according to the display device or display mode. News. Therefore, the image processing system (2) can easily change the captured image captured by the camera unit (11) according to the device or display mode of the display end.

The image processing system (2) of the second aspect is the same as the first aspect, wherein when the image processing unit (102) determines one display range of a plurality of display ranges based on a specific criterion, it determines the other display range in conjunction with the determination of the one display range Display range.

According to this configuration, when one display range is determined based on a specific criterion, other display ranges are determined in conjunction with the determination of the one display range. Therefore, the image processing system (2) does not need to set the information used for individual processing of the camera image captured by the camera unit (11) according to the device or display state of the display end.

The image processing system (2) of the third aspect is the same as the first or second aspect, wherein the specific reference includes specific reference points (for example, reference points O1, O2) and reference lines (for example, reference line L1) in the captured image , L2, L3), and at least one of the reference planes.

According to this configuration, it is possible to use any one of a specific reference point, a reference line, and a reference surface to change the captured image into a plurality of display ranges.

The image processing system (2) of the fourth aspect is the same as the third aspect, and further includes a reference setting unit (103). The reference setting unit (103) sets a specific reference point, reference line, and reference surface included in the specific reference to be used when changing to images of a plurality of display ranges.

According to this configuration, it is possible to set a specific reference when changing the captured image to an image of a plurality of display ranges.

The image processing system (2) of the fifth aspect is the same as the third or fourth aspect, wherein the specific reference includes a reference line. The reference line includes one side of at least one of the plurality of display ranges.

According to this configuration, it is possible to change other display ranges based on one side of at least one display range among a plurality of display ranges.

The image processing system (2) of the sixth aspect is the same as any one of the third to fifth aspects, wherein the specific reference includes a reference plane. The reference plane contains the center of the camera image.

According to this configuration, the center of the captured image can be used as a reference, and the captured image captured by the imaging unit (11) can be changed to a plurality of display ranges.

The image processing system (2) of the seventh aspect is the same as any one of the aspects of the first to the sixth, wherein at least a part of each of the plurality of display ranges overlaps.

According to this configuration, since at least a part of each of the plurality of display ranges overlaps, for example, a human face area can be included in each display range as an overlapping portion.

The image processing system (2) of the eighth aspect is the aspect of any one of the first to the seventh, wherein the image processing unit (102) changes the captured image to an image of one of the plurality of display ranges according to When changing the direction of the 1 display range, change the camera image to the image of the other display range.

According to this structure, since the camera image is changed to the image of another display range based on the change direction when the camera image is changed to the image of 1 display range of the plurality of display ranges, there is no need to depend on the device or display mode of the display end. The setting is used to individually process the information of the camera image taken by the camera unit (11).

The image processing system (2) of the ninth aspect is the aspect of any one of the first to the eighth, wherein the image processing unit (102) cuts at least a part of the camera image taken by the camera unit (11) at a specific angle of view And change it to images of multiple display ranges.

According to this configuration, by cutting, the captured image can be changed to the captured image captured by the imaging section (11) according to the device or display mode of the display end.

The image processing system (2) of the tenth aspect is the aspect of any one of the first to the ninth aspect, wherein the display sizes of at least a part of the plurality of display ranges are different.

According to this structure, the image processing system (2) can easily change the captured image according to the device or display mode of the display side.

The image processing system (2) of the eleventh aspect is the aspect of any one of the first to the tenth aspect, wherein the display range is rectangular, and the images of the plurality of display ranges include display ranges with different aspect ratios.

According to this structure, the image processing system (2) can easily change the captured image according to the device or display mode of the display side.

The image processing system (2) of the twelfth aspect is the same as any one of the first to eleventh aspects, and further includes a position setting unit (104) for setting a specific reference position.

According to this structure, since a specific reference position is set, it is not necessary to set the information used to individually process the camera image taken by the camera unit (11) according to the device or display mode of the display end.

The image processing system (2) of the thirteenth aspect is the aspect of any one of the first to the twelfth aspect, and further includes: a changing section (105) that changes at least one display range among the plurality of display ranges The display range.

According to this configuration, it is possible to change at least one display range among a plurality of display ranges.

The image processing system (2) of the fourteenth aspect is the same as the aspect of any one of the first to the thirteenth aspect, wherein the camera unit (11) is provided in an intercom device (for example, a hall intercom 10).

According to this structure, it can be applied to walkie-talkie systems.

The image processing method of the fifteenth aspect includes: an obtaining step and an image processing step. The obtaining step obtains the camera image captured by the camera unit (11). The image processing step changes the captured image to images (for example, the first image to the fourth image) in a plurality of display ranges (for example, the display ranges R1 to R4, and R11 to R14) based on a specific reference.

According to the image processing method, the image captured by the image capturing section (11) can be easily changed according to the device or display mode of the display end.

The program of the 16th aspect is a program for the computer to execute the image processing method of the 15th aspect.

According to the program, the device or display mode of the visual display terminal can be easily changed to the camera image taken by the camera unit (11).

1: Walkie-talkie system 2: Image processing system 5: Facilities 10: Hall intercom 11: Camera Department 12: Sensor section 13: Ministry of Communications 14: Operation Department 15: Communication Department 16: Memory Department 17: Display 18: Control Department 20: Walkie-talkie parent machine 21: Section 1 Communications 22: Section 2 Communications Department 23: Operation Department 24: Communication Department 25: Display 26: Control Department 30: Foyer machine 40: control device 50: Management room master machine 51: Ministry of Communications 52: Operation Department 53: Call Department 54: Display 55: Control Department 100: Image processing device 101: Acquisition Department 102: Image Processing Department 103: Reference setting section 104: Position setting section 105: Change Department 141～144: Button G1, G11: camera image L1, L2, L3: baseline O1, O2: reference point R1～R4, R11～R14, R24: display range

Fig. 1 is a diagram illustrating the structure of a hall intercom equipped with an image processing device of an embodiment. Figure 2 is a diagram illustrating the structure of the walkie-talkie system including the hall walkie-talkie. FIG. 3A is a diagram illustrating the aspect ratio of the screen displayed when the first display mode is selected in the intercom parent machine provided in the intercom system. FIG. 3B is a diagram illustrating the aspect ratio of each screen displayed when the second display mode is selected in the above-mentioned main radio of the walkie-talkie. FIG. 4 is a diagram illustrating the aspect ratio of the image displayed by the parent machine of the management room provided in the above-mentioned walkie-talkie system. Fig. 5 is a diagram for explaining the adjustment of the lens direction of the camera unit in the hall intercom. FIG. 6A is a diagram illustrating that the first image to the fourth image are cropped from the captured image when the lens direction of the above-mentioned imaging unit is the center. FIG. 6B is a diagram illustrating that the first image to the fourth image are cropped from the captured image when the lens direction of the above-mentioned imaging section is regarded as the left end from the imaging section. Fig. 7 is a diagram illustrating Modification Example 1.

2: Image processing system

10: Hall intercom

11: Camera Department

12: Sensor section

13: Ministry of Communications

14: Operation Department

15: Communication Department

16: Memory Department

17: Display

18: Control Department

100: Image processing device

101: Acquisition Department

102: Image Processing Department

103: Reference setting section

104: Position setting section

105: Change Department

Claims (16)

An image processing system including: The acquisition department, which acquires the camera images taken by the camera department; and The image processing unit changes the above-mentioned captured image to images of a plurality of display ranges based on a specific criterion. Such as the image processing system of claim 1, where When the image processing unit determines one of the plurality of display ranges based on the specific criterion, it determines the other display ranges in conjunction with the determination of the one display range. Such as the image processing system of claim 1 or 2, where The specific reference includes at least one of a reference point, a reference line, and a reference plane specified in the captured image. Such as the image processing system of claim 3, which further has: The reference setting unit sets a reference point, reference line, and reference surface included in the specific reference to be used when changing to the image of the plurality of display ranges. Such as the image processing system of claim 3, where The above-mentioned specific reference includes the above-mentioned reference line, and The reference line includes one side of at least one display range among the plurality of display ranges. Such as the image processing system of claim 3, where The above-mentioned specific datum includes the above-mentioned datum surface, and The reference plane includes the center of the captured image. Such as the image processing system of claim 1 or 2, where At least a part of each of the plurality of display ranges overlap. Such as the image processing system of claim 1 or 2, where The image processing unit changes the captured image to an image of another display range according to the direction of change of the image of one display range when the captured image is changed to the image of one of the plurality of display ranges. Such as the image processing system of any one of claims 1 to 8, wherein The image processing unit cuts at least a part of the captured image captured by the imaging unit at a specific angle of view and changes it into images of the plurality of display ranges. Such as the image processing system of claim 1 or 2, where The display sizes of at least a part of the images in the plurality of display ranges are different. Such as the image processing system of claim 1 or 2, where The above display range is rectangular, and The images in the plurality of display ranges include display ranges with different aspect ratios. For example, the image processing system of claim 1 or 2, which further has: The position setting part that sets the above-mentioned specific reference position. For example, the image processing system of claim 1 or 2, which further has: The changing unit changes the display range for at least one display range among the plurality of display ranges. Such as the image processing system of claim 1 or 2, where The above-mentioned imaging unit is provided in the intercom device. An image processing method, which includes: The obtaining step, which obtains the camera image taken by the camera section; and The image processing step is to change the above-mentioned captured image into images of a plurality of display ranges based on a specific reference. A program used to make a computer execute the image processing method of claim 15.

Images