JP2021072486A - Imaging system - Google Patents

Abstract

To provide an imaging system capable of reducing the load at initial setting.SOLUTION: An imaging system 20 includes: a camera 36 for picking up images of the target space; an actuator 34 for changing the shooting range of the camera 36; a camera control unit 32 that controls the actuator 34; and a communication unit 38 that communicates with the outside. The communication unit receives a piece of condition information for identifying a specific stationary object that should be in the shooting range out of the stationary objects existing in the target space, which is the information to be input from the outside. The camera control unit 32 controls the actuator 34 to set the shooting range of the camera 36 so that the specific stationary object identified by the received condition information is picked up.SELECTED DRAWING: Figure 2

Description

The present disclosure relates to a shooting system, particularly to determine a shooting range (angle of view) of a camera that shoots a target space.

In recent years, with the spread of AI and IoT, it has become possible to control various devices using big data. For example, IoT devices and the like have come to detect events with cameras, sensors, etc., and are automatically controlled according to situations.

It has been proposed to control the lighting of stores and the like according to the situation. For example, Patent Document 1 discloses that a lighting space such as a store is directed and illuminated only at a desired timing. It is also shown that for this control, a camera is provided to detect the number of people present in the store, and the effect lighting is controlled according to the number of people.

JP-A-2018-56009

Here, as the control of lighting becomes more sophisticated, the initial setting for achieving the purpose of control becomes complicated. For example, when detecting an object such as a person using a camera, detailed initial setting (calibration) is required in advance so that the detection can be performed according to the purpose. Therefore, it is desired that the initial setting can be performed with less burden.

The present disclosure is an imaging system, which includes a camera that photographs an object space, an actuator that changes the imaging range of the camera, a control unit that controls the actuator, and a communication unit that communicates with the outside. The communication unit receives the information input from the communication unit to specify the specific stationary object that should exist in the shooting range among the stationary objects existing in the target space, and the control unit uses the actuator. It controls and sets the shooting range of the camera so that a specific stationary object specified by the received condition information is shot.

The condition information may include individual numbers of a plurality of types of specific stationary objects.

It is preferable to have a storage unit for storing a list of a plurality of types of stationary objects in the target space, and to set the number of stationary objects of each type specified by the user as the specific stationary object.

The stationary object may be a fixture, and the list may be a list by type of fixture.

It is preferable to perform shooting while changing the shooting range of the camera by the actuator, recognize a specific stationary object from the shot image, recognize the specific stationary object, and then determine the shooting range.

Further, it is preferable to control the illumination of the target space by the lighting equipment based on the image obtained by the photographing system including the lighting equipment.

According to the present disclosure, the shooting range (angle of view) of the camera can be easily set.

It is a top view which shows typically the store which concerns on embodiment. It is a block diagram which shows the structure of a photographing system. It is a block diagram which shows the structure of an operation terminal. It is a flowchart explaining the operation about the angle of view setting. In the display example on the operation terminal, (a) shows a menu of stationary objects, and (b) shows a number input screen. It is a figure explaining the range in which three shelves are reflected in an image, a) is a left-pointing end, and (b) is a right-pointing end. It is a figure which shows the case where the angle of view is determined at the center point of the most appropriate angle of view range stored. It is a figure which shows the state which there is a person in a store, (a) is the case where the number of people is small, (b) is the case where the number of people is large.

Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. The present disclosure is not limited to the embodiments described herein.

FIG. 1 is a plan view schematically showing a store according to the embodiment. This example assumes a convenience store, a clothing store, a general store, and the like, and a plurality of shelves 12, a plurality of desks 14, a cash register 16 and the like on which products and the like are placed are arranged in the store.

Further, the lighting device 10 has a plurality of light emitting units normally installed on the ceiling and illuminates the inside of the store. In the figure, the lighting device 10 is schematically shown by an alternate long and short dash line.

Further, a photographing device 30 is arranged on one side of the ceiling. It has a predetermined shooting range (angle of view) and shoots the inside of the store. The operation terminal 40 controls the lighting device 10 and is also used for the initial setting of the photographing device 30.

"Shooting system"
FIG. 2 is a block diagram showing a configuration of a photographing system 20 including a lighting device 10. The lighting device 10 includes a light emitting unit 22 and a light emitting control unit 24. The light emitting unit 22 is composed of, for example, LEDs, and is provided as individual lighting fixtures in various places on the ceiling to illuminate the entire store. The light emission control unit 24 controls on / off, dimming, toning, and the like of the light emitting unit 22. A plurality of lighting fixtures in the light emitting unit 22 may be individually controlled to independently adjust the lighting in various places in the store.

An edge computing unit 26 is connected to the light emission control unit 24. The edge computing unit 26 has a storage unit 26a and a calculation unit 26b, performs various calculations, creates a control command for light emission of the light emitting unit 22, and supplies the control command to the light emission control unit 24. Further, a display unit 28 is connected to the edge computing unit 26 to display the operating state of the photographing system 20 and the like. Further, the image obtained by the photographing device 30 may be displayed on the display unit 28.

Further, a photographing device 30 is connected to the edge computing unit 26, and the edge computing unit 26 controls the photographing device 30. The photographing device 30 includes a camera control unit 32, an actuator 34, and a camera 36. The camera 36 is attached to the ceiling or the like in the store, and obtains an image (including a moving image) of the inside of the store by photographing the inside of the store with a predetermined angle of view (a predetermined range of angles of view up, down, left, and right). The camera 36 is moved up, down, left and right to change its angle of view. The camera control unit 32 controls the actuator 34 to control the angle of view of the camera 36. The camera control unit 32 controls the camera 36. You can also control the exposure, definition, color balance, etc. of the camera.

A communication unit 38 is connected to the edge computing unit 26. The communication unit 38 performs wireless communication with the outside, and it is preferable to use Bluetooth (registered trademark) or the like as the communication method, but an ultrasonic type or an infrared type may be used. In particular, in the present embodiment, the communication unit 38 communicates with the operation terminal 40, and the edge computing unit 26 controls the light emission of the light emitting unit 22 and the angle of view of the camera 36 by a command from the operation terminal 40. To do.

Further, in the present embodiment, the edge computing unit 26 has an image processing function, and can recognize a predetermined target object from the image obtained by the camera 36. That is, by comparing with the image of the target object stored in advance, a stationary object such as a shelf can be recognized, and a moving object such as a person can also be recognized.

"Operation terminal"
FIG. 3 is a block diagram showing the configuration of the operation terminal 40. The operation terminal 40 has a communication unit 60, which communicates with the communication unit 38 of the photographing system 20. A processing unit 52 is connected to the communication unit 60. The processing unit 62 is formed by, for example, a microcomputer and performs various data processing. A storage unit 64 is connected to the processing unit 62, and necessary data is appropriately stored here. Further, a display unit 66 and an operation unit 68 are connected to the processing unit 62. The display unit 66 is a display such as an LCD or an OLED, and displays a square type. Further, the operation unit 68 is a means for inputting data and commands, and can be configured as, for example, a touch panel provided with a capacitance type detection unit on the front surface of the display unit 66.

For example, the processing unit 62 displays the menu screen on the display unit 66 according to the data stored in the storage unit 64, and the operation unit 68 detects the operation by the user's finger or the like, so that the user selects and selects an item. It can be recognized by the processing unit 62. Then, the user can control the photographing system 20 by using the operation terminal 40 by transmitting the corresponding command from the communication unit 60 to the photographing system 20 based on the recognized matter.

"Determining the angle of view"
When a camera is installed and lighting or the like is controlled based on the image, the problem is which direction the camera acquires the image. Normally, the user (for example, the installer) sets the shooting range (angle of view) while looking at the image at the time of installation, but this setting is troublesome.

In the present embodiment, the shooting range (angle of view) of the photographing device 30 is determined by using the operation terminal 40 after the photographing device 30 is installed.

FIG. 4 is a flowchart illustrating an operation for setting the angle of view. First, the photographing device 30 is already installed, and an image of the angle of view in the installed state is obtained. Here, in the present embodiment, the angle of view of the photographing device 30 can be automatically set by the operation terminal.

That is, when the photographing system 20 is installed, the user inputs the type and number (condition information) of the stationary objects to be included in the image on the operation terminal 40 (S11). That is, after installing the photographing system 20 including the camera 36, the user inputs the condition information (type and number of stationary objects) of the stationary objects in the range (target space) to be monitored by the operation terminal 40.

5A and 5B are display examples of the display unit 66 on the operation terminal 40, in which FIG. 5A shows a menu consisting of a list of stationary objects, and FIG. 5B shows a number input screen. From the menu display shown in FIG. 5A, the corresponding menu is selected and changed to a highlight display or the like by touching with a finger of the user. Then, by pressing the input button 68a below the display unit 66, the selected menu is taken in, and the display changes to the number input display shown in FIG. 5 (b). On this screen, by touching the name of each stationary object, the arrow of increment and decrement of the number is displayed, and the number is input by operating this. Then, by pressing the input button 68a, the number of each stationary object can be input. In FIG. 5B, "OK" is displayed by pressing the input button 68a. Various known methods can be used for inputting the type and number of stationary objects.

As described above, the display unit 66 of the operation terminal 40 displays a menu of stationary objects in the store. This example is an example in a convenience store, and it is preferable to prepare in advance according to the store. It is also preferable to allow the user to arrange the menu. In particular, cameras obtained after that by investigating the stationary objects to be installed in various stores, naming the identified stationary objects, and storing them as specific stationary objects in association with their characteristic data. A specific stationary object can be recognized from the image.

Further, the specific stationary object may be added by learning about the stationary object recognized from the camera image. That is, when a specific stationary object corresponding to the recognized stationary object is not found by recognizing the stationary object from the edge recognition of the camera image or the like, the user can define the stationary object and learn about the stationary object. It is also preferable that the user obtains confirmation even when the recognized stationary object matches the stored specific stationary object.

Here, when determining the actual angle of view, the photographing device 30 first scans the entire angle of view to obtain an image, recognizes a stationary object from the obtained image, and stores the specific stationary object. It is also preferable to recognize a stationary object in the target space and create a menu by recognizing it as an object or naming it as a new stationary object.

Here, examples of the specific stationary object include the following.
(In the store)
・ Shelves, ・ Cash registers, ・ Desks, ・ Plants, ・ Lighting, ・ Chairs, ・ Mannequins, ・ Clothes, ・ Ventilation fans, etc. (outdoors)
・ Utility poles, ・ Fences, ・ Handrails, ・ Guardrails, ・ Street lights, ・ Waterworks, ・ Gates, ・ Trees, ・ Flower beds, etc. It recognizes a moving object such as a person, and controls the light emission of the light emitting unit 22 according to the recognition result.

Returning to FIG. 4, when the input of S11 is completed, the operation terminal 40 transmits the input condition information to the photographing system 20.

The photographing system 20 receives the transmitted condition information of the stationary object (S13). The condition information is received by the edge computing unit 26 via the communication unit 38 and stored in the storage unit 26a. Then, the angle of view is moved up, down, left and right (S14). Then, the image obtained while moving the angle of view is subjected to image recognition processing in the edge computing unit 26 to identify a stationary object (S15). A known method is appropriately used for identifying the stationary object. The storage unit 26a holds learned data obtained by learning a series of characteristic stationary objects that can be reflected in the angle of view by the camera 36.

During such stationary object identification, a range matching the input condition information (specific stationary object type, number) is detected and stored (S16). That is, the position within the angle of view that satisfies the condition information and the position that does not satisfy this are detected.

For example, when the angle of view is moved clockwise, there are only two shelves within the angle of view shown by the alternate long and short dash line in FIG. 6A, but if it is rotated to the right from here, three shelves will be included in the image. This is the boundary point on one side. Then, at the position shown in FIG. 6B, there are two shelves in the image. Therefore, the range from the angle of view of FIG. 6 (a) to the angle of view of FIG. 6 (b) is the range of three shelves. Therefore, the storage unit 26a stores the information (position information) of the position where there is a change in the state of the stationary object and the state information of three shelves, one cash register, and two desks. The position information includes angle information (X, Y, Z axes) of the actuator 34.

In this way, while identifying the object, the name and number of the stationary objects identified in the image are compared with the input condition information, and the state information of the angle of view closest to the condition information and the angle information of the actuator are obtained. obtain. Here, although FIGS. 6A and 6B are planar views, it is considered that an angle of view that matches the condition information can be obtained even when the angle of view in the vertical direction of the camera 36 is changed. Be done. In such a case, it is preferable to determine a more appropriate angle of view range (two position information) and store it by adopting one having a wider angle of view range to be satisfied. For example, the angle of view range may be updated when a more appropriate angle of view range is detected as compared with the already saved angle of view range. In this way, one angle of view range that best matches the condition information is stored in the storage unit 26a.

Then, it is determined whether or not all the angles of view have been changed (S17), and if the determination is NO, the process returns to S14, an image for another angle of view is acquired, and an appropriate angle of view range is updated.

If the determination in S17 is YES, the angle of view is determined (S18). That is, the angle of view is determined at the center point of the most suitable angle of view range that is stored as shown in FIG. 7. By determining the central angle of view in this way, the most appropriate angle of view can be selected from the selected angle of view range. In the figure, only the left-right direction is shown, but the angle of view is determined in the same manner in the vertical direction so that the center of the angle of view coincides with the center of the angle-of-view range. Then, the actuator 34 is controlled so that the angle of view is determined, and the angle of view of the camera 36 is adjusted.

As described above, according to the present embodiment, the angle of view of the camera 36 is automatically adjusted according to the information input to the operation terminal 40, so that the work of initial setting of the camera 36 becomes easy. In particular, in the operation terminal 40, since it is sufficient to input the number of stationary objects such as fixtures for each type, the burden on the user is greatly reduced, and an appropriate angle of view can be set.

"Lighting control"
Here, in the photographing system 20 of one embodiment, in a state where the angle of view of the camera 36 is determined, the edge computing unit 26 detects the number of people and controls the lighting based on the image obtained by the camera 36. That is, the dimming and toning of the lighting are controlled according to the number of people existing in the target space. 8A and 8B are diagrams showing a state in which there are people in the store. FIG. 8A is a case where the number of people is small, and FIG. 8B is a case where the number of people is large. For example, when the number of people is small as shown in FIG. 8 (a), dark blue is used for a large amount of calm lighting, and when the number of people is large as shown in FIG. 8 (b), the lighting is bright and relatively large in red. Use lively lighting. The edge computing unit 26 controls the light emission of the light emitting unit 22 via the light emitting control unit 24 according to the conditions stored in the storage unit 26a.

Therefore, it is possible to verify whether an appropriate angle of view is set by verifying whether or not the above-mentioned control is performed when the number of people is small or large in the target space.

"Effect of embodiment"
Although the detection accuracy of moving objects such as people changes by controlling the brightness and darkness of lighting, it is important to appropriately set the angle of view of the camera 36. In the photographing system according to the present embodiment, since the angle of view is set to an appropriate one, it is possible to anticipate the acquisition of appropriate data for acquisition such as age group and behavioral lead, and the data is accumulated, analyzed, and serviced. And product display can be optimized to improve store sales.

Further, the accuracy of detecting a moving object can be improved by automatically controlling the lighting when the exposure of the camera 36 and the like are initially set (calibrated). Also in this case, it is important to appropriately set the angle of view of the camera 36.

As described above, in operating the photographing system 20, when detecting a person or the like using the camera 36, detailed settings are required in advance in order to correctly detect the detection target. This pre-setting and calibration can be very burdensome for the user. In particular, when the camera 36 is attached and the lighting is attached, it is necessary to consider the direction of the camera when attaching the lighting. In addition, fine adjustment by human power is required to show the place to be detected even after installation.

According to this embodiment, since calibration can be performed automatically, it is not necessary to set it manually, and it is not necessary to strictly consider the installation direction of the lighting. Even when AI or the like is used, it is difficult to accurately grasp the range to be monitored because the shape of the store differs depending on the store, but according to the present embodiment, the setting in the store can be easily performed. In particular, by using furniture and the like that are commonly installed in any store as a mark, it is possible to grasp the monitoring range of the store without omission.

10 Lighting device, 12 shelves, 14 desks, 16 cash register, 20 shooting system, 22 light emitting unit, 24 light emitting control unit, 26 edge computing unit, 26a, 64 storage unit, 26b arithmetic unit, 28, 66 display unit, 30 shooting Device, 32 camera control unit, 34 actuator, 36 camera, 36 camera control unit, 38, 60 communication unit, 40 operation terminal, 52 processing unit 62 processing unit, 68 operation unit, 68a input button.

Claims (6)

It ’s a shooting system,
A camera that shoots the target space and
An actuator that changes the shooting range of the camera and
A control unit that controls the actuator and
With the communication unit that communicates with the outside
Have,
The communication unit receives condition information that is input from the outside and specifies a specific stationary object that should exist in the shooting range among the stationary objects existing in the target space, and the control unit receives the actuator. To set the shooting range of the camera so that a specific stationary object specified by the received condition information is shot.
Shooting system. The photographing system according to claim 1.
The condition information includes individual numbers of a plurality of types of specific stationary objects.
Shooting system. The photographing system according to claim 1 or 2.
It has a storage unit that stores a list of multiple types of stationary objects in the target space.
Let the number of stationary objects of each type specified by the user be the specified stationary objects,
Shooting system. The photographing system according to claim 3.
The stationary object is a fixture, and the list is a list by type of fixture.
Shooting system. The photographing system according to claim 1.
Shooting is performed while changing the shooting range of the camera by the actuator, a specific stationary object is recognized from the shot image, the specific stationary object is recognized, and then the shooting range is determined.
Shooting system. The photographing system according to any one of claims 1 to 5.
Including lighting equipment,
Control the lighting of the target space by the lighting equipment based on the image obtained by the shooting system.
Shooting system.

Images