JP5016533B2 - Human detection device and load control system using the same - Google Patents

Description

  The present invention relates to a human detection device for measuring a human distribution in a measurement target region and a load control system using the human detection device.

  Conventionally, in a store such as a supermarket, for example, the distribution of people in each area is measured in order to control the operation state of environmental control devices (lighting, air conditioning, etc.) installed in the store according to the number of visitors. A human detection device is provided.

In this type of human detection device, an image in the store is captured by a camera installed in the store, and the distribution of people in the store is detected by performing image processing on the image captured by the camera (for example, Patent Document 1).
JP 2001-175868 A

  In the above-described human detection device, a person who is in each area is detected by comparing a captured image captured by a camera installed in the store with a human shape model. There is a problem that it takes a long time to detect visitors and measure the distribution of visitors.

  The present invention has been made in view of the above problems, and its purpose is to simplify the detection process for the number of visitors in the measurement target area and reduce the time required for detecting the number of visitors. The object is to provide a device and a load control system using the same.

The invention of claim 1 is an invention of a load control system, an imaging unit that captures an image of a measurement target region, a storage unit that stores comparison data for determining the number of persons, and information obtained from the captured image of the imaging unit in the storage unit A human detection device including a human detection unit that detects a person staying in the measurement target region by comparing with the stored comparison data, and one or more installed in the measurement target region to control the environment of the measurement target region An environmental control device and a control device that controls the operation of the environmental control device based on the detection result of the human detection device. The human detection device measures the number of persons in each of a plurality of areas based on the captured image of the imaging unit. The environmental control equipment includes general lighting equipment that generally illuminates each of a plurality of areas, and a wall / weighted lighting equipment that illuminates a wall surface or important lighting location in each of the plurality of areas. One with less The general lighting fixtures in the area are darker than the general lighting fixtures in the region with the larger number of people, and the walls / important lighting fixtures in the region with the smaller number of people are the walls in the region with the larger number of people. -It is characterized by having the same brightness as the priority lighting fixtures, or brighter than the walls and priority lighting fixtures in the area where the number of people is larger.
Invention of Claim 2 is invention of the human body detection apparatus used for said load control system, The imaging part which images the image of a measurement object area | region, The memory | storage part which memorize | stores the comparison data for number determination, characterized by comprising a human detection unit for detecting a person to stay in constant target area measured by comparing it to a comparison data stored the information obtained from the captured image to the serial憶部.

The invention of claim 3 is the invention of claim 2, the measurement object region is divided into a plurality of divided regions, an imaging unit provided for each each of the divided regions, the human detecting unit, for each each of the divided regions and obtaining the number of people staying in each of the divided regions by comparing information obtained from the captured image of the imaging unit and the comparison data.

According to a fourth aspect of the present invention, in the second or third aspect of the present invention, the colored surface that appears in the picked-up image of the image pickup unit that is picked up in a state where no person is present is given to the floor surface of the measurement target region. The area is stored as comparison data in the storage unit, and the human detection unit compares the detection result of the colored part detection unit with the colored part detection unit that obtains the area of the colored part from the captured image of the imaging unit and the comparison data. And a number detection means for obtaining the number of persons in the measurement target area from the area of the colored portion that could not be detected.

According to a fifth aspect of the present invention, in the second or third aspect of the invention, a plurality of markers are distributed on the floor surface of the measurement target area, and the markers appearing in the captured image of the imaging unit captured in the absence of a person. The number is stored in the storage unit as comparison data, and the human detection unit detects the number of markers from the captured image of the imaging unit, and compares the detection result of the marker detection unit with the comparison data, It is comprised with the number-of-people detection means which detects the number of persons in a measurement object area | region from the number of markers which could not be detected.

According to the invention of claim 1, by using a human detection device that simplifies the detection process and shortens the time required for measurement, the operation state of the environmental control device can be quickly changed according to the change in the number of people staying in the measurement target region. There is an effect that a load control system capable of following can be realized.
According to the invention of claim 2, the human detection unit compares the information obtained from the captured image of the imaging unit with the comparison data registered in advance in the storage unit, so that the visitor staying in the measurement target region Compared to the case where the number of people is calculated and the captured image of the imaging unit is compared with the human shape model, the visitor in the measurement target area can be detected by simple processing, and the time required for detection of the visitor There is an effect that it is possible to realize a human detection device capable of shortening.

According to the invention of claim 3 , the distribution of people can be obtained by obtaining the number of people staying in each divided area.

In addition, when a predetermined color is applied to the floor surface of the measurement target area, if a person stays in the measurement target area, a part of the floor surface is hidden by the staying person, and the area of the colored portion appearing in the captured image of the imaging unit is reduced. However, according to the invention of claim 4 , the number detection means compares the area of the colored portion detected by the colored portion detection means with the comparison data, and the area of the measurement target region is determined from the area of the colored portion that could not be detected. Since the number of persons is detected, a complicated process of comparing the captured image of the image capturing unit with the human shape model in order to extract a person is unnecessary, and the time required for measurement can be shortened.

In addition, when a plurality of markers are distributed on the floor of the measurement target area, when a person stays in the measurement target area, some markers are hidden by the staying person, and the number of markers appearing in the captured image of the imaging unit decreases. However, according to the invention of claim 5 , the number detection means compares the number of markers detected by the marker detection means with the comparison data, and detects the number of persons in the measurement target region from the number of colored portions that could not be detected. Therefore, a complicated process of comparing the captured image of the image capturing unit with the human shape model in order to extract a person becomes unnecessary, and the time required for measurement can be shortened.

  In the following, for example, in a store such as a supermarket, implementation of a load control system that detects the number and distribution of users staying in the store and controls the operation of lighting equipment installed in the store based on the detection result A form is demonstrated based on drawing. The predetermined area to which the present system is applied is not limited to a store such as a supermarket, and may be a tenant building or a school facility. The environmental control device to be controlled is not limited to the lighting device, and may be an environmental control device such as an air conditioner that is installed in a predetermined area and controls the environment in the predetermined area.

(Embodiment 1)
A first embodiment of the present invention will be described with reference to FIGS.

  2A and 2B show an example of a store 100 such as a supermarket to which the load control system A according to the present invention is applied. The store 100 is largely divided into a cash register zone 101, a sales zone 102, and a workplace / backyard 103. An entrance 100A is provided at a position leading to the sales zone 102 and an exit 100B is provided at a position leading to the cash register zone 101 on the outer wall of the building. Here, in the present embodiment, the number and distribution of users staying in the cashier zone 101 and the sales floor zone 102 are obtained, and the operation of the lighting fixtures installed in the cashier zone 101 and the sales floor zone 102 is controlled based on the results. It has become. The cash register zone 101 is provided near the exit 100B of the store 100, and a payment processing device (register) 104 that performs purchase payment processing of the merchandise selected by the user is disposed in the central portion of the cash register zone 101, and purchase payment processing. The desk 105 which performs the operation | work which packs the goods which the customer who complete | finished purchasing is arrange | positioned adjacent to the wall near exit 100B. The sales zone 102 is partitioned from the work place / back yard 103 by a partition wall 106, and an access port 107 for entering and exiting the work place / back yard 103 is provided at a main point. Further, in the sales zone 102, a refrigeration / freezing showcase 108 is disposed on the wall side and the center, and a display shelf 109 for merchandise is disposed in the vicinity of the boundary with the register zone 101.

  A plurality of (for example, six in this embodiment) cameras 1 </ b> A to 1 </ b> F (imaging units) that capture images of the registration zone 101 and the sales floor zone 102 that are measurement target areas are provided on the ceiling of the registration zone 101 and the sales floor zone 102. is set up. In the center of the sales zone 102, a refrigeration / frozen showcase 108 is arranged in parallel with the left and right walls, and the sales zone 102 is divided into left and right areas by the showcase 108. Of the 1F, two cameras 1A and 1B capture the right area of the sales zone 102 (consisting of an imaging area R1 of the camera 1A and an imaging area R2 of the camera 1B), respectively, and the other two cameras 1C and 1D The left region of the zone 102 (consisting of the imaging region R3 of the camera 1C and the imaging region R4 of the camera 1D) is imaged, and the remaining two cameras 1E and 1F are registered in the registration zone 101 (the imaging region R5 of the camera 1E and the camera 1F). An image of the imaging region R6) is taken. Here, the imaging regions R1 to R6 of the cameras 1A to 1F are shown by broken lines in FIG. The imaging areas R1 to R6 of the cameras 1A to 1F are set according to the layout in the store 100, and the optical systems of the cameras 1A to 1F are designed so that the imaging areas R1 to R6 do not overlap each other. is there. Further, it is assumed that the floor surfaces of the cashier zone 101 and the sales floor zone 102 are given a predetermined coloring.

  A plurality of general lighting fixtures 4 that generally illuminate the inside of the zone are installed on the ceiling of the sales floor zone 102, and a cash register lighting fixture 6 that illuminates the vicinity of the settlement processing device 104 is installed on the ceiling of the cash register zone 101. Has been. In addition, the cash register zone 101 and the sales floor zone 102 are provided with a plurality of walls and priority lighting fixtures 5 that illuminate wall surfaces and important lighting locations, and these lighting fixtures 4 to 6 constitute an environmental control device. In addition, environmental control devices such as the circulator 41 and the indoor unit 42 are also installed on the ceiling of each zone, but the operation of the environmental control devices other than the lighting fixtures is controlled by other control systems. Omitted.

  FIG. 1 is a block diagram showing the overall configuration of the load control system A. This system includes cameras 1A to 1F, a controller 2, a transmission unit 3, a general lighting fixture 4, a wall / weighted lighting fixture 5, A cash register lighting fixture 6, a control terminal 7, and a central controller 60 are provided as main components.

  The general lighting device 4 includes, for example, a fluorescent lamp lighting device 4a and an HID lighting device 4b, and is used as base lighting for generally lighting the inside of the sales zone 102. The wall / weighted lighting fixture 5 includes, for example, a fluorescent wall lighting fixture 5a, a halogen spotlight 5b, a compact fluorescent spotlight 5c, and an HID spotlight 5d. A part of the walls and the important lighting fixtures 5 are embedded in the ceilings of the registration zone 101 and the sales zone 102, or are suspended and supported by wiring ducts provided on the ceiling, and are used to illuminate the wall surfaces. Further, another part of the wall / important lighting fixture 5 is installed in the showcase 108 or the display shelf 109 in the sales area zone 102 to illuminate the important illumination location (for example, the sales location of the special sale product) with emphasis. Used. The cash register lighting fixture 6 includes, for example, a fluorescent lamp lighting fixture 6a, and is used to illuminate the vicinity of the settlement processing apparatus 104.

  A control terminal 7 with a dimming function is provided corresponding to each of the lighting fixtures 4 to 6, and a transmission signal is transmitted from the transmission unit 3 to be described later to the corresponding control terminal 7 to control the operation of the control terminal 7. By controlling, the lighting state of the lighting fixtures 4 to 6 connected to the control terminal 7 is controlled.

  The transmission unit 3 includes a transmission communication unit 31, an arithmetic processing unit 32, and a storage unit 33 that exchange multiplex transmission signals with the controller 2 and the control terminal 7 via a transmission line. In the storage unit 33, group control information for collectively turning on / off the plurality of control terminals 7 and pattern control information for collectively operating the plurality of control terminals 7 in a preset pattern Is preset. When the transmission communication unit 31 receives the control signal transmitted from the controller 2, the arithmetic processing unit 32 individually turns on or off the designated control terminal 7 according to the control content of the control signal ( (Individual control), whether a plurality of control terminals 7 are collectively turned on or off according to designated group control information (group control), or a plurality of control terminals 7 are preset according to designated pattern control information The pattern is operated in a batch (pattern control).

  The controller 2 includes an arithmetic processing unit 20, communication units 21 to 23, a timer 24, and a storage unit 25 as main components. The arithmetic processing unit 20 includes an image processing unit 26, a number / distribution detection unit 27 (number of people detection means), a lighting mode selection unit 28, and a lighting mode management unit 29. The detection unit 27, the lighting mode selection unit 28, and the lighting mode management unit 29 are realized by the calculation function of the calculation processing unit 20. Here, a human detection unit is configured by the image processing unit 26 and the number / distribution detection unit 27 of the arithmetic processing unit 20, and a human detection device is configured by the human detection unit, the storage unit 25, and the cameras 1A to 1F. . Further, the lighting mode selection unit 27 and the transmission unit 3 of the controller 2 constitute a control device that controls the operation of the environmental control device.

  The communication unit 21 is connected to the central control device 60 via a network whose physical layer protocol supports the Ethernet (registered trademark) standard, and a higher layer protocol (for example, TCP / IP, FTP, HTTP / HTTPS). Accordingly, data communication is performed with the central controller 60.

  The communication unit 22 processes a protocol (for example, MEWTOCOL (registered trademark), Modbus (registered trademark), etc.) for exchanging signals with the cameras 1A to 1F and sensors installed in the store. When the payment completion signal transmitted from the payment processing device 104 via the communication I / F unit 10 is received, the received signal is output to the arithmetic processing unit 20. Note that the physical layer of the communication unit 22 supports the RS-485 standard.

  The communication unit 23 is for exchanging time-division multiplexed transmission signals (so-called full two-wire signals) with the transmission unit 3 via a two-wire transmission line.

  The timer 24 gives the current date and time information to the arithmetic processing unit 20.

  The storage unit 25 is a screen (e.g., HTML file, Java (registered trademark) Script, image, etc.) viewed with a Web browser installed in a computer, an operation schedule of each lighting apparatus 4-6, and a local network (multiplex transmission network). The connection state of the terminal connected to) and various collected data are stored. Further, in the storage unit 25, information on the area of the colored portion appearing in the captured image in a state where no person exists is registered as comparison data for the imaging regions R1 to R6 of the cameras 1A to 1F. The storage unit 25 includes a semiconductor memory such as a RAM or a ROM, or an external storage device such as a hard disk.

  The image processing unit 26 performs image processing on the video signals input from the cameras 1A to 1F to the communication unit 22, thereby obtaining the areas of the colored portions that appear in the captured images of the cameras 1A to 1F. Here, the image processing unit 26 constitutes a colored portion detecting means.

  The number / distribution detection unit 27 calculates the area of the colored portion obtained by the image processing unit 26 for the captured images of the cameras 1 </ b> A to 1 </ b> F in comparison data registered in the storage unit 25 (in an image captured in the absence of a person). Compared to the area of the colored portion). Here, when a person exists in the cashier zone 101 or the sales floor zone 102, a part of the floor is hidden by the person, so that the area of the colored portion appearing in the captured images of the cameras 1A to 1F decreases. Therefore, the number of persons / distribution detection unit 27 obtains an area difference between the comparison data stored in the storage unit 25 and the colored portion obtained by the image processing unit 26 for each of the images captured by the cameras 1A to 1F. The number of people in the imaging regions R1 to R6 of each camera 1A to 1F is obtained from the difference, and the number of people for each of the imaging regions R1 to R6 is obtained. As described above, the number / distribution detection unit 27 captures information (colored area) obtained from the captured images of the cameras 1 </ b> A to 1 </ b> F in comparison data registered in advance in the storage unit 25 (without a person). The area of the colored portion in the imaging screen) is compared with the number of visitors staying in the measurement target region. For example, compared with the case where the captured images of the cameras 1A to 1F are compared with the human shape model, A visitor in the measurement target area can be detected by a simple process, and a time required for detection of the visitor can be shortened. Therefore, it is possible to realize a load control system that can quickly follow the operating state of the environmental control device in accordance with a change in the number of people staying in the measurement target area.

  The lighting mode management unit 29 creates lighting pattern information for setting the light output of each of the lighting fixtures 4 to 6 for each zone based on the setting signal received by the communication unit 21 from the central control device 60, and stores it in the storage unit 25. Remember.

  The lighting mode selection unit 28 selects an illumination pattern from a plurality of illumination patterns registered in the storage unit 25 based on the evaluation result by the number / distribution detection unit 27 and the current time input from the timer 24. .

  Here, in the storage unit 25, as an illumination pattern in the daytime (for example, from the start time to dusk or sunset), the illumination pattern A1 when the number of visitors is smaller than the threshold (when the number of people is small) and the number of visitors are stored. A lighting pattern A2 when the threshold value is exceeded (when many people are present) is registered (see Table 1). In the table, “◎” means that each lighting fixture is lit brightly, “○” means that it is lit slightly brightly, “△” means that it is lit slightly dark, and the light output is △ It becomes brighter in the order of <○ <◎.

そして、照明パターンＡ１では、全般照明器具４をやや明るめに、壁・重点照明器具５と屋外から見えるレジ用照明器具６をより明るめに制御する。また照明パターンＡ２では、全般照明器具４およびレジ用照明器具６をやや明るめに、壁・重点照明器具５をより明るめに制御する。このように点灯モード選択部２８では多人数時と少人数時とで照明パターンを変化させており、少人数時には壁・重点照明器具５およびレジ用照明器具６をより明るく点灯させることで、引きつけ効果を高めることができ、また多人数時にはレジ用照明器具６を「明るい」状態から「やや明るい」状態へと暗くしているので、レジ用照明器具６の消費電力を低減して、省エネを図ることができる。

In the lighting pattern A1, the general lighting fixture 4 is controlled to be slightly brighter, and the wall / priority lighting fixture 5 and the cash register lighting fixture 6 seen from the outside are controlled to be brighter. In the lighting pattern A2, the general lighting fixture 4 and the cash register lighting fixture 6 are controlled to be slightly brighter, and the wall / priority lighting fixture 5 is controlled to be brighter. In this way, the lighting mode selection unit 28 changes the illumination pattern between a large number of people and a small number of people. The effect can be enhanced, and when the number of people is large, the lighting fixture 6 is darkened from the “bright” state to the “slightly bright” state, thereby reducing the power consumption of the lighting fixture 6 and saving energy. Can be planned.

  The storage unit 25 also has a lighting pattern B1 when the number of visitors is smaller than a threshold (when there are a small number of people) as a lighting pattern at night (for example, from dusk to sunset) and the number of visitors is a threshold. The illumination pattern B2 for the above time (when many people are present) is registered (see Table 2). In the lighting pattern B1 for a small number of people, the general lighting device 4 is slightly darkened, the cash register lighting device 6 is slightly brightened, and the wall / weighted lighting device 5 is controlled to be brighter. In the lighting pattern B2 for a large number of people, the general lighting device 4 is slightly darkened, and the cash register lighting device 6 and the wall / weighted lighting device 5 are controlled to be slightly brighter. In this way, the lighting mode selection unit 28 changes the illumination pattern between a large number of people and a small number of people, and when the number of people is small, the wall / important lighting device 5 and the cash register lighting device 6 are lighted more brightly, The attractive effect can be enhanced, and the wall / important lighting fixture 5 is changed from a “bright” state to a “slightly bright” state for a large number of people. Energy saving can be achieved. Also, since the surroundings are dark at night, the user may feel uncomfortable even if the light output of the general lighting fixtures 4 and the cash register lighting fixture 6 is slightly darkened if the minimum illumination on the work surface is secured. Therefore, in the nighttime illumination patterns B1 and B2, energy is saved by changing the general lighting fixture 4 from a slightly brighter lighting state to a slightly darker lighting state than in the daytime lighting patterns A1 and A2. In the nighttime illumination pattern B1, the cashier lighting fixture 6 is changed from a bright state to a slightly brighter state than the daytime illumination pattern A1, thereby saving energy.

次に、本実施形態の負荷制御システムＡの動作について図３〜図５に基づいて説明する。コントローラ２が起動されると、演算処理部２０は初回起動時か２回目以降の起動時かを判断し（図３のステップＳ１）、初回起動時であればコントローラ２に接続されているカメラ１Ａ〜１Ｆ毎に撮像領域を設定する等の初期設定を行った後（ステップＳ２）、画像処理部２６が、人のいない状態で各カメラ１Ａ〜１Ｆより画像を収集するとともに、各カメラ１Ａ〜１Ｆの撮像画像に現れる着色部分の面積を求め（ステップＳ３）、各撮像領域Ｒ１〜Ｒ６毎に求めた着色部分の面積を比較データとして記憶部２５に記憶させる（ステップＳ４）。ここで、ステップＳ３，Ｓ４の処理が毎回起動時に行われるので、例えば店内のレイアウト変更や、商品を展示するワゴンを配置するなどして、人がいない状態で現れる着色部分の面積が変化した場合でも、毎回起動時に比較データを更新することで、撮像領域内の人数を正確に検出することができる。

Next, operation | movement of the load control system A of this embodiment is demonstrated based on FIGS. When the controller 2 is activated, the arithmetic processing unit 20 determines whether it is the first activation or the second activation or later (step S1 in FIG. 3). If it is the first activation, the camera 1A connected to the controller 2 is determined. After performing an initial setting such as setting an imaging area for each 1F (step S2), the image processing unit 26 collects images from the cameras 1A to 1F in the absence of a person, and each camera 1A to 1F. The area of the colored portion appearing in the captured image is obtained (step S3), and the area of the colored portion obtained for each of the imaging regions R1 to R6 is stored in the storage unit 25 as comparison data (step S4). Here, since the processing of steps S3 and S4 is performed every time when starting up, for example, when the area of the colored portion that appears in the absence of people changes due to, for example, changing the layout of the store or arranging a wagon that displays products However, it is possible to accurately detect the number of people in the imaging area by updating the comparison data at each activation.

  Thereafter, every time a predetermined control cycle elapses, the arithmetic processing unit 20 acquires captured images from the cameras 1A to 1F via the communication unit 22 (step S5), and the image processing unit 26 The areas of the colored portions appearing in the captured images of the received cameras 1A to 1F are obtained, and each imaging is performed from the area difference between the comparison data of the imaging regions R1 to R6 stored in the storage unit 25 and the area data obtained this time. The number of people staying in the regions R1 to R6 is obtained, and the number of people distribution for each of the imaging regions R1 to R6 is obtained (step S6). And the arithmetic processing part 20 determines the lighting state of the lighting fixtures 4-6 respectively installed in each imaging region R1-R6 according to the number of people staying in each imaging region R1-R6, and from communication part 23. The control signal of each lighting fixture 4-6 is transmitted to the transmission unit 3 (step S7). At this time, the transmission unit 3 transmits a control signal to the corresponding control terminal 7 based on the illumination pattern designated by the controller 2, and changes the lighting state of each of the lighting fixtures 4 to 6 to a desired lighting state. Control. Thereafter, the arithmetic processing unit 20 performs the wait process for the control cycle (step S8), returns to step S5, and repeats the processes of steps S5 to S7 described above. In the process of step S8 described above, when the control signal is transmitted from the transmission unit 3 to each control terminal 7, the control signal may be transmitted only to the control terminal 7 corresponding to the lighting fixture whose control state changes. Good communication traffic can be reduced.

  Here, the control content of the customer number interlocking control in step S7 will be described in more detail based on the flowchart of FIG. First, the lighting mode selection unit 28 switches the illumination pattern of each of the lighting fixtures 4 to 6 to either the day mode or the night mode based on the current time acquired from the timer 24 (step S11 in FIG. 4). In this embodiment, the day mode and the night mode are switched based on the current time. Based on the detection result of an illuminance sensor (not shown), if the ambient illuminance is brighter than the threshold, the mode is switched to the day mode. If it is darker, it may be switched to the night mode.

  When the lighting pattern is switched to the daytime mode as a result of the determination in step S11, the lighting mode selection unit 28 reads and sets the threshold value N1 of the number of visitors used in the daytime mode from the storage unit 25 (step S12). Then, the control contents of the illumination patterns A1, A2 used in the daytime mode are read from the storage unit 25 and set (step S13). Next, the lighting mode selection unit 28 performs a process of determining an illumination pattern for the i-th imaging region Ri (i is an integer from 1 to 6 (the number of imaging regions)) (step S14). The number of visitors in the imaging region R1 obtained by the number of persons / distribution detection unit 27 with i = 1 is compared with a threshold value N1 (step S15). If the threshold value is equal to or greater than the threshold value N1, the illumination pattern is set to A2 (step S16), and less than the threshold value N1. Then, after setting the illumination pattern to A1 (step S17), 1 is added to the argument i (step S18), the process returns to step S14, and the processes from step S15 to S18 are performed until the argument i exceeds the number of areas. Repeat. In the lighting mode selection unit 28, the illumination pattern is determined by comparing the number of persons in each imaging region and the threshold value N1, but a hysteresis may be provided for the threshold value N1, or the illumination pattern may be provided by providing hysteresis. Can be prevented from switching frequently.

  On the other hand, when the lighting pattern is switched to the night mode as a result of the determination in step S11, the lighting mode selection unit 28 reads and sets the threshold value N2 of the number of visitors used in the night mode from the storage unit 25 (step S11). S19), the control contents of the illumination patterns B1 and B2 used in the night mode are read from the storage unit 25 and set (step S20). Next, the lighting mode selection unit 28 performs a process of determining an illumination pattern for the i-th imaging region Ri (i is an integer from 1 to 6 (the number of imaging regions)) (step S21). The number of visitors in the imaging region R1 obtained by the number / distribution detection unit 27 with i = 1 is compared with a threshold value N2 (step S22). If the threshold value is N2 or more, the illumination pattern is set to B2 (step S23), and less than the threshold value N2 Then, after setting the illumination pattern to B1 (step S24), 1 is added to the argument i (step S25), the process returns to step S21, and the processes from step S22 to S25 are performed until the argument i exceeds the number of areas. Repeat. In the lighting mode selection unit 28, the illumination pattern is determined by comparing the number of persons in each imaging region and the threshold value N2. However, a hysteresis may be provided for the threshold value N2, and the illumination pattern may be provided by providing the hysteresis. Can be prevented from switching frequently.

  And if the lighting mode selection part 28 performs the above-mentioned process and determines the control pattern of each lighting fixture 4-6, the arithmetic processing part 20 will send the control signal of each lighting fixture 4-6 from the communication part 23 to the transmission unit 3. FIG. Send it. At this time, the transmission unit 3 transmits a control signal to the corresponding control terminal 7 based on the illumination pattern designated by the controller 2, and changes the lighting state of each of the lighting fixtures 4 to 6 to a desired lighting state. Control. Thereafter, the arithmetic processing unit 20 performs the weighting process for the sampling time (step S8 in FIG. 3), and then returns to step S5 to repeat the processes in steps S5 to S7 described above.

  Thus, in the present system, when the number of staying people in each of the imaging regions R1 to R6 is smaller than the threshold during daytime and nighttime, the light output of some of the lighting fixtures 4 to 6 is brighter than when there are many people. Therefore, the effect of attracting customers to the sales zone 102 can be enhanced. When the number of users staying in the sales zone 102 is larger than the threshold, it is determined that the effect of attracting users to the sales zone 102 is sufficiently obtained, and the light output of some of the lighting fixtures 4 to 6 Since it is controlled slightly darker, the user's attractive effect is somewhat reduced, but energy saving can be achieved.

  By the way, in the control method described in the flowchart of FIG. 4, the number of staying people and the threshold value are compared for each of the imaging regions R1 to R6, and the lighting pattern for the large number of people or the lighting pattern for the small number of people is determined. However, for example, the lighting pattern of the lighting fixture may be controlled in order to attract the customer from the imaging region with a large number of customers to the imaging region with the smaller number of customers in the two imaging regions R1 and R2. Here, as shown in FIG. 5, when the general lighting device 4 and the wall / weighted lighting device 5 are installed in the imaging regions R1 to R6 of the cameras 1A to 1F, respectively, they are installed in the two imaging regions R1 and R2. The case where the illumination pattern of the lighting fixtures 4 and 5 is changed according to each number of visitors is demonstrated. FIG. 6A shows the result of obtaining the relationship between the horizontal illuminance of the general lighting fixture 4 and the impression given by the wall / important lighting fixture 5, and the vertical surface illumination of the wall / important lighting fixture 5 is constant. In this case, the darker the illuminance of the general lighting device 4, the stronger the impression given by the wall / weighted lighting device 5, and the greater the attractive effect of the wall / weighted lighting device 5. FIG. 6B also shows the relationship between the horizontal illuminance Eh of the general lighting fixture 4 and the attractive effect of the wall / priority lighting fixture 5 when the vertical plane illuminance Ev of the wall / priority lighting fixture 5 is changed to a plurality. (A) in the figure is when the vertical plane illuminance Ev is 2000 [lx], (a) in the figure is when the vertical plane illuminance Ev is 3000 [lx], and (c) in the figure is the vertical plane illuminance Ev. Is 4000 [lx], D in the figure indicates the result when the vertical plane illuminance Ev is 8000 [lx]. From the result of FIG. 6B, it can be seen that if the illuminance of the wall / priority lighting fixture 5 is increased, the impression is increased and the customer's attractive effect is increased. Further, from the result of FIG. 6B, the vertical plane illuminance Ev of the wall / weighted lighting fixture 5 necessary for obtaining an impression of size d by the wall / weighted lighting fixture 5 is the horizontal plane illuminance of the general lighting fixture 4 being a. In the case of (= 750 [lx]), it is 4000 [lx], but in the case where the horizontal illuminance of the wall / weighted luminaire 5 is b (= 500 [lx]), it may be 3000 [lx]. Clearly, energy saving of about 22% can be realized. If the vertical plane illuminance Ev is kept at 4000 [lx], the attracting effect can be improved by one rank from “slightly noticeable” to “pretty noticeable”.

When the number of visitors in the two imaging regions R1, R2 changes as shown in Table 3 and FIG. 7A, the number of people in the imaging region R2 is larger than the number of people in the imaging region R1 at time t1, As shown in FIGS. 7B and 7C, the lighting mode selection unit 28 does not change the illuminance of the luminaires 4 and 5 in the imaging region R2 from the reference illuminances L1 and L2, respectively, and the general illumination in the imaging region R1. The illuminance of the fixture 4 is lowered from the reference illuminance L2, and the illuminance of the wall / weighted illumination fixture 5 is made brighter than the reference illuminance L1. As a result, the illuminance of the general lighting device 4 is dark better imaging region R1 than the imaging region R2, the illuminance of the wall-priority lighting apparatus 5 is an imaging area R1 becomes brighter than the imaging region R2, walls, in the imaging area R1 By increasing the impression of the priority lighting fixture 5, customers are attracted to the imaging region R1.

また時刻ｔ２では撮像領域Ｒ１，Ｒ２の滞在者数は略同じなので、点灯モード選択部２８は、各領域Ｒ１，Ｒ２の照明器具４，５の照度をそれぞれ基準照度Ｌ１，Ｌ２に制御している。

At time t2, since the number of visitors in the imaging regions R1 and R2 is substantially the same, the lighting mode selection unit 28 controls the illuminances of the luminaires 4 and 5 in the regions R1 and R2 to the reference illuminances L1 and L2, respectively. .

  On the other hand, at time t3, since the number of people in the imaging region R1 is larger than the number of people in the imaging region R2, the lighting mode selection unit 28 determines that the illuminance of the luminaires 4 and 5 in the imaging region R1 is the reference illuminances L1 and L2, respectively. The illuminance of the general lighting fixture 4 in the imaging region R2 is lowered from the reference illuminance L2, and the illuminance of the wall / priority lighting fixture 5 is made brighter than the reference illuminance L1. As a result, the illuminance of the general lighting device 4 is darker in the imaging region R2 than the imaging region R1, and the illuminance of the wall / weighted lighting device 5 is brighter in the imaging region R2 than the imaging region R1. By increasing the impression of the priority lighting fixture 5, customers are attracted to the imaging region R2.

  In the operation example of FIG. 7, the illuminance of both the general lighting device 4 and the wall / weighted lighting device 5 is changed. However, as shown in FIGS. By making only the general lighting fixture 4 in a small imaging area darker than the reference illuminance L2, the impression of partial illumination by the wall / weighted lighting fixture 5 may be strengthened to attract customers to the imaging area with a small number of people. Further, as shown in FIGS. 9A to 9C, at the times t1 and t3, only the wall / important illumination device 5 in the imaging region with a small number of people is made brighter than the reference illuminance L1, so that the portion by the wall / important illumination device 5 is obtained. The impression of lighting may be strengthened to attract customers to an imaging area with a small number of people.

(Embodiment 2)
A second embodiment of the present invention will be described with reference to FIG. In the load control system of the first embodiment, the illuminance of the lighting fixture is controlled for each of the imaging regions R1 to R6 in accordance with the number of visitors in each of the imaging regions R1 to R6. The illuminance of the lighting fixtures in the store is controlled according to the total number of visitors in the regions R1 to R6 (that is, the number of visitors in the store 100). In addition, since the structure of a load control system is the same as that of Embodiment 1, the same code | symbol is attached | subjected to a common component and the description is abbreviate | omitted.

  Since the operation of the present embodiment is different from the operation of the load control system described in the first embodiment only in the control content of the customer number interlocking control (step S7 in FIG. 4), only the control content of the customer number interlocking control will be described. Description of other parts is omitted.

  In the state where the number of visitors in each of the imaging regions R1 to R6 has been measured by performing the processing from steps S1 to S4 in FIG. 4, the lighting mode selection unit 28 uses the current time acquired from the timer 24 to The illumination patterns of the lighting fixtures 4 to 6 are switched to either the day mode or the night mode (step S30 in FIG. 10).

  When the lighting pattern is switched to the daytime mode as a result of the determination in step S30, the lighting mode selection unit 28 reads and sets the threshold value N1 of the number of users used in the daytime mode from the storage unit 25 (step S31). Then, the control contents of the illumination patterns A1, A2 used in the daytime mode are read from the storage unit 25 and set (step S32). Next, the lighting mode selection unit 28 compares the total number of visitors in each of the imaging regions R1 to R6 with the threshold value N1 (step S33). If the total number of visitors is equal to or greater than the threshold value N1, illumination is performed. The pattern is determined as A2 (step S34), and if the total number of visitors is less than the threshold value N1, the illumination pattern is determined as A1 (step S35). In the lighting mode selection unit 28, the lighting pattern is determined to be A1 or A2 by comparing the total value of the number of visitors in each of the imaging regions R1 to R6 and the threshold value N1, but hysteresis is applied to the threshold value N1. It may be provided, and by providing hysteresis, it is possible to prevent a hunting operation in which the illumination pattern is frequently switched.

  When the lighting pattern is switched to the night mode as a result of the determination in step S30, the lighting mode selection unit 28 reads and sets the threshold value N2 of the number of users used in the night mode from the storage unit 25 (step S36). ) The control contents of the illumination patterns B1 and B2 used in the night mode are read from the storage unit 25 and set (step S37). Next, the lighting mode selection unit 28 compares the total number of visitors in each of the imaging regions R1 to R6 with the threshold value N2 (step S38). If the total number of visitors is equal to or greater than the threshold value N2, illumination is performed. The pattern is determined to be B2 (step S39), and if the total number of visitors is less than the threshold value N2, the illumination pattern is determined to be B1 (step S40). In the lighting mode selection unit 28, the illumination pattern is determined to be B1 or B2 by comparing the total value of the number of visitors in each of the imaging regions R1 to R6 and the threshold value N2, but hysteresis is applied to the threshold value N2. It may be provided, and by providing hysteresis, it is possible to prevent a hunting operation in which the illumination pattern is frequently switched.

  And if the lighting mode selection part 28 performs the above-mentioned process and determines the control pattern of each lighting fixture 4-6, the arithmetic processing part 20 will transmit a control signal from the communication part 23 to the transmission unit 3. FIG. At this time, the transmission unit 3 transmits a control signal to the corresponding control terminal 7 based on the illumination pattern designated by the controller 2, and changes the lighting state of each of the lighting fixtures 4 to 6 to a desired lighting state. Control. After that, the arithmetic processing unit 20 performs the sampling time wait process (step S5 in FIG. 4), and then returns to step S2 to repeat the above-described steps S2 to S5.

  Thus, in this system, when the number of users staying in the store 100 in the daytime and nighttime hours is less than the threshold, the light output of some of the lighting fixtures 4 to 6 is higher than that in the case where the number is large. Since it is bright, the effect of attracting customers to the store 100 can be enhanced. Further, when the number of users staying in the store 100 is larger than the threshold, it is determined that the effect of attracting users to the store 100 is sufficiently obtained, and the light output of some of the lighting fixtures 4 to 6 Since it is controlled slightly darker, the user's attractive effect is somewhat reduced, but energy saving can be achieved.

(Embodiment 3)
In the load control system of the first and second embodiments described above, the floor surface of the measurement target region is colored with a predetermined color, and the number of visitors is obtained from the area of the portion hidden by the person staying in the measurement target region. On the other hand, in this embodiment, as shown in FIG. 11A, a plurality of circular markers M are arranged in a matrix on the floor surface of the measurement target region and are hidden by a person staying in the measurement target region. The number of visitors is obtained from the number of markers M. Although the circular marker M is illustrated in the present embodiment, the shape of the marker M is not limited to a circular shape, and may be other shapes such as a quadrangle. Since the configuration and operation of the load control system are the same as those in the first or second embodiment except for the part for counting the number of people, the same components are denoted by the same reference numerals and the description thereof is omitted.

  In the example shown in FIG. 11, the measurement target area is divided into three imaging areas R1 to R3, and cameras 1A to 1C that capture images of the respective imaging areas R1 to R3 are attached to the ceiling of the measurement target area. Further, the number of markers M arranged on the floor surface of each imaging region R1 to R3 is registered in the storage unit 25 of the arithmetic processing unit 20 as comparison data.

  And the image imaged with the cameras 1A-1C is input into the arithmetic process part 20 via the communication part 22, and the image process part 26 (marker detection means) of the arithmetic process part 20 is taken image of each camera 1A-1C. The number of markers M appearing in the image is detected by image processing.

  On the other hand, the number / distribution detection unit 27 (number detection means) of the arithmetic processing unit 20 registers the number of markers M obtained by the image processing unit 26 from the captured images of the cameras 1A to 1F in the storage unit 25. Comparison data (the number of markers M in the image taken in the absence of a person) is compared. Here, when a person exists in the cashier zone 101 or the sales floor zone 102, a part of the floor is hidden by the person, so the number of markers M appearing in the captured images of the cameras 1A to 1F decreases. Therefore, the number / distribution detection unit 27 compares the number of markers M obtained from the captured images of the cameras 1A to 1C with the comparison data stored in the storage unit 25 for each of the imaging regions R1 to R3. The number n1 of markers M hidden by a visitor is obtained, and the number of visitors in each area is obtained from the number n1 of hidden markers M. If the number of markers hidden by one person is n2, the number / distribution detection unit 27 obtains the number Nm of visitors in the imaging area using the following equation (1).

Nm = n1 / n2 (1)
Here, the operation of the load control system A of the present embodiment will be described with reference to the flowchart of FIG. When the controller 2 is activated, the arithmetic processing unit 20 determines whether it is the first activation or the second activation or later (step S41 in FIG. 12). If it is the first activation, the camera 1A connected to the controller 2 is determined. After performing an initial setting such as setting an imaging area for each 1F (step S42), the image processing unit 26 collects images from the cameras 1A to 1F in the absence of a person, and each camera 1A to 1F. The number of markers M appearing in the captured image is obtained (step S43), and the number of markers M obtained for each of the imaging regions R1 to R6 is stored in the storage unit 25 as comparison data (step S44). Here, since the processing of steps S43 and S44 is performed every time when it is activated, for example, when the number of markers M that appear in the absence of a person changes due to, for example, changing the layout in the store or arranging a wagon that displays products However, it is possible to accurately detect the number of people in the imaging area by updating the comparison data at each activation.

  Thereafter, every time a predetermined control cycle elapses, the arithmetic processing unit 20 acquires captured images from the cameras 1A to 1F via the communication unit 22 (step S45), and the image processing unit 26 The number of markers M appearing in the captured images of the received cameras 1A to 1F is obtained, and the above equation (1) is calculated from the comparison data of the imaging regions R1 to R6 stored in the storage unit 25 and the number of markers M obtained this time. ) Is used to determine the number of people staying in each of the imaging regions R1 to R6, and the distribution of the number of people for each of the imaging regions R1 to R6 is determined (step S46). And the arithmetic processing part 20 determines the lighting state of the lighting fixtures 4-6 respectively installed in each imaging region R1-R6 according to the number of people staying in each imaging region R1-R6, and from communication part 23. The control signal of each lighting fixture 4-6 is transmitted to the transmission unit 3 (step S47). At this time, the transmission unit 3 transmits a control signal to the corresponding control terminal 7 based on the illumination pattern designated by the controller 2, and changes the lighting state of each of the lighting fixtures 4 to 6 to a desired lighting state. Control. Thereafter, the arithmetic processing unit 20 performs the weighting process of the control cycle (step S48), returns to step S45, and repeats the processes of steps S45 to S47 described above. Since the control content of the customer number interlocking control in step S47 is the same as that described in the first or second embodiment, the description thereof is omitted.

  As described above, the number of persons / distribution detection unit 27 captures the information (number of markers M) obtained from the captured images of the cameras 1A to 1F in comparison data registered in advance in the storage unit 25 (without a person). The number of visitors staying in the measurement target area is obtained by comparing with the number of markers M in the imaging screen), for example, compared with the case where the captured images of the cameras 1A to 1F are compared with the human shape model, A visitor in the measurement target area can be detected by a simple process, and a time required for detection of the visitor can be shortened. Therefore, it is possible to realize a load control system that can quickly follow the operating state of the environmental control device in accordance with a change in the number of people staying in the measurement target area.

  By the way, the load control system A of each embodiment mentioned above is comprised as a subsystem of the whole system shown in FIG. In the system of FIG. 13, the transmission unit 3 includes a control terminal 45 that controls the circulator 41 and the packaged air conditioner 44 (consisting of the indoor unit 42 and the outdoor unit 43), and a control terminal with an HA terminal that controls the packaged air conditioner 44. 46 is connected, and pattern information and group information for controlling the control terminals 45 and 46 are registered in the transmission unit 3. The transmission unit 3 is also connected with a monitoring terminal 40 having an operation switch for operating the lighting fixture. The communication unit 22 of the controller 2 is connected via a signal line to a power meter 51 that monitors the amount of power used and a multi-circuit checker 52 that monitors the amount of power used by multiple circuits. Then, by incorporating a demand control program into the controller 2, the control pattern of the air conditioner is determined based on the measured value of the power consumption from the power meter 51 and the multi-circuit checker 52, and is output to the transmission unit 3. Demand control and the like can be performed by controlling the operation of the air conditioner by the transmission unit 3. Further, reference numeral 60 in FIG. 13 denotes a management PC in which a browser is incorporated. The management PC 61 requests the controller 2 for a Web page indicating the operating state of the environmental control device, and displays the Web page on the display of the management PC 61. This makes it possible to check the operating state of the load device.

It is a block diagram which shows the load control system of Embodiment 1. The embodiment which applied the same to the supermarket is shown, (a) is explanatory drawing which looked at the inside of a store from the side, (b) is a top view in a store. It is a flowchart explaining the whole operation | movement same as the above. It is a flowchart explaining the control operation of customer number interlocking control same as the above. It is arrangement | positioning explanatory drawing of a general lighting fixture same as the above, and a wall and a priority lighting fixture. (A) (b) is explanatory drawing which shows the relationship between the horizontal surface illumination intensity of a general lighting fixture, and the impression which a wall and a priority lighting fixture give. (A)-(c) is a time chart explaining the operation | movement same as the above. (A)-(c) is a time chart explaining another operation | movement same as the above. (A)-(c) is a time chart explaining another operation | movement same as the above. It is a flowchart which shows the load control system of Embodiment 2, and demonstrates control operation of customer number interlocking | linkage control. (A) (b) is explanatory drawing of the number-of-people detection method by the load control system of Embodiment 3. FIG. It is a flowchart explaining operation | movement same as the above. It is a system configuration figure of the whole system using each embodiment same as the above.

Explanation of symbols

1A to 1F camera (imaging unit)
2 Controller (person detection device)
20 arithmetic processing unit 22 communication unit 25 storage unit 27 number / distribution detection unit (person detection unit)
28 Lighting mode selector

Claims (5)

Imaging unit for capturing an image of the measurement target area, the storage unit for storing comparison data for number determination, by the information obtained from the captured image of the imaging unit to be compared with comparison data stored in the Symbol憶部a human detection device provided with the person detecting unit for detecting a person to stay measurement target region Te,
One or more environment control devices installed in the measurement target area and controlling the environment of the measurement target area;
A control device for controlling the operation of the environmental control device based on the detection result of the human detection device,
The human detection device measures the number of persons in each of a plurality of regions based on the captured image of the imaging unit,
As the environmental control device, there are a general lighting device that generally illuminates each of the plurality of regions, and a wall / weighted lighting device that illuminates a wall surface or a priority lighting location in each of the plurality of regions,
In the control device, the general lighting fixtures in the region with the smaller number of people are darker than the general lighting fixtures in the region with the larger number of people, and the wall / weighted lighting fixtures in the region with the smaller number of people are The load control system is characterized in that the brightness is the same as that of the wall / important lighting apparatus in the area with the larger number of people, or brighter than the wall / important lighting apparatus in the area with the larger number of persons. The human detection device used in the load control system according to claim 1, wherein the imaging unit that captures an image of the measurement target region, the storage unit that stores comparison data for determining the number of persons, and the imaging unit human detection device you comprising the said person detecting portion for detecting a person to stay in the measurement target region by comparing the comparison data with information obtained from the captured image stored in the storage unit. The measurement target region is divided into a plurality of divided regions, the imaging unit is provided for each of the divided regions, and the human detection unit obtains information obtained from the captured image of the imaging unit for each of the divided regions. 3. The human detection apparatus according to claim 2 , wherein the number of persons staying in each of the divided areas is obtained by comparing with the comparison data . A predetermined coloring is applied to the floor surface of the measurement target area, and an area of a colored portion that appears in a captured image of the imaging unit that is captured in the absence of a person is stored in the storage unit as the comparison data. The colored part detection unit that obtains the area of the colored part from the captured image of the imaging unit, and the colored part that could not be detected by comparing the detection result of the colored part detection unit with the comparison data The human detection apparatus according to claim 2, further comprising a human number detection unit that obtains the number of persons in the measurement target region from the area . A plurality of markers are dispersedly arranged on the floor surface of the measurement target area, and the number of markers appearing in the captured image of the imaging unit captured without a person is stored in the storage unit as the comparison data. The human detection unit detects the number of markers from the captured image of the imaging unit, and compares the detection result of the marker detection unit with the comparison data, thereby detecting the number of markers that could not be detected. 4. The human detection apparatus according to claim 2, further comprising a human number detection unit that detects the number of persons in the measurement target area.

Images