KR101512141B1 - Smart lighting control device and method based direction of human motion - Google Patents

Abstract

According to an aspect of the present invention,
A lighting control method considering a human motion direction, comprising: an image acquiring step of acquiring a depth image by an image acquiring unit of an illumination control apparatus; A human region detection step of detecting a human image region from the acquired depth image by human position detection means of the illumination control apparatus; A human position extraction step of the human position detection means generating a map image space in proportion to the actual space size of the coordinates of the rectangle corner of the human image region and extracting the center coordinates of the human image region in the map image space; A lighting position setting step of the lighting control device setting a position of the lighting device in the map image space; An illumination distance calculation step of the illumination control device calculating the illumination distance based on the center coordinates of the human image area and the position coordinates of the illumination device; A moving direction detection step of detecting a moving direction by subtracting a center coordinate of a current human image area from a center coordinate of a previous person image area; The moving direction detecting means detects a shoulder line based on a center coordinate of the human image region and detects a direction in which the line of sight is viewed based on the moving direction; An illumination control signal generation step of generating an illumination illumination control range and an illumination illumination control signal in accordance with an illumination illumination pattern including a direction in which the illumination control signal generation means of the illumination control device looks at the illumination distance; And a lighting device controlling step of generating a signal for controlling the lighting device by receiving the lighting direction control signal from the lighting control device of the lighting control device. / RTI >

Description

TECHNICAL FIELD [0001] The present invention relates to a smart lighting control apparatus and a smart lighting control apparatus,

The present invention relates to a smart lighting control apparatus and method for controlling lighting in consideration of a moving direction of a person.

Unlike conventional lighting, LEDs have low power consumption and are easy to control.

An illumination device is an apparatus for converting electricity into light by a power source supplied from the outside, and generally means a device installed at a certain position in the room or outdoor to illuminate a dark area.

In recent years, due to the development of the industrial society and the improvement of income, such a lighting apparatus is used not only as a simple function of illuminating a dark area but also as a device for decorating a specific area.

 2. Description of the Related Art [0002] In recent years, a lighting apparatus control system has been popular in which a plurality of lighting apparatuses are turned on and off according to a certain rule, and illuminance or color can be changed according to human emotion or surrounding atmosphere.

However, in the case of a general lighting device control system, the illuminance of a lighting device installed in a high-illuminated window area due to a large amount of sunlight in a specific space and the illumination device installed in a low- There is a problem that unnecessary power consumption may occur as well as the illuminance of the space in which the lighting device is installed may be uneven as a whole.

In Korean Patent Laid-Open Publication No. 10-2013-0045069, as a means for solving the above-mentioned problem, a two-dimensional lattice model is constructed using each boundary line of a specific space in which a plurality of illuminating devices are installed, ; And illuminance values of respective illumination devices mapped to a plurality of grid points existing on the grid model are set differently according to illumination values at the respective boundary lines to uniformly control the illuminance of the space in which the illumination devices are installed A control system and method for a lighting device having a plurality of light sources are disclosed.

In the control system, the illuminance uniformity of the corresponding space can be improved by adaptively controlling the illumination distribution of the illumination devices installed in the space in accordance with the change of the external brightness in the space where the illumination device is installed.

However, it is necessary to set the control pattern and the control range in various ways according to the direction in which the person looks, and it is necessary to efficiently set the control range range based on the position of the illumination and the illumination distance A controllable lighting control method is needed.

Korean Patent Laid-Open Publication No. 10-2013-0045069 (Lighting system control system and method)

SUMMARY OF THE INVENTION It is an object of the present invention to provide a smart lighting control apparatus and method for controlling a lighting based on a position and an illumination distance of a lighting apparatus by setting a control range according to a control pattern in consideration of a movement direction of a person.

According to an aspect of the present invention,

An image acquiring unit capable of acquiring a depth image; A human position detector for detecting a human region and a position from the depth image; An illumination position setting unit for setting the position of the illumination device by inputting the position of the illumination device on the map image; An illumination distance calculation unit for calculating an illumination distance based on the human position detected by the human position detection unit and the position of the illumination device; A movement direction detection unit for detecting a movement direction on the basis of coordinates of a person position detected by the human position detection unit and a previous coordinate, detecting a shoulder line from the human region, and detecting a direction in which the shoulder line is considered in consideration of the movement direction; An illumination control signal generating unit for generating an illumination directing control signal according to an illumination directing pattern on the basis of a distance and an angle between each of the illumination devices detected by the illumination distance calculating unit and the moving direction detecting unit; And an illumination control unit receiving the illumination direction control signal and generating a signal for controlling illumination of the illumination device; The smart lighting control device considers the human movement direction.

According to another aspect of the present invention, there is provided an illumination control method considering a human motion direction, comprising: an image acquiring step of acquiring a depth image by an image acquiring unit of the illumination control apparatus; A human region detection step of detecting a human image region from the acquired depth image by human position detection means of the illumination control apparatus; Wherein the human position detection means generates a map image space in proportion to the actual space size of the coordinates of the rectangle corner of the human image region and extracts the center coordinates of the human image region on the map image space; A lighting position setting step of the lighting control device setting a position of the lighting device in the map image space; An illumination distance calculation step of the illumination control device calculating the illumination distance based on the center coordinates of the human image area and the position coordinates of the illumination device; A moving direction detection step of detecting a moving direction by subtracting a center coordinate of a current human image area from a center coordinate of a previous person image area; The moving direction detecting means detects a shoulder line based on a center coordinate of the human image region and detects a direction in which the line of sight is viewed based on the moving direction; An illumination control signal generation step of generating an illumination illumination control range and an illumination illumination control signal in accordance with an illumination illumination pattern including a direction in which the illumination control signal generation means of the illumination control device looks at the illumination distance; And a lighting device controlling step of generating a signal for controlling the lighting device by receiving the lighting direction control signal from the lighting control device of the lighting control device. / RTI >

According to an embodiment of the present invention, various lighting control patterns such as a circular pattern and an elliptical pattern can be set in accordance with the direction of the viewer, and an appropriate lighting environment can be provided according to the distance of the illumination.

According to another aspect of the present invention, there is provided an effect of reducing unnecessary light while saving energy because the local illumination is appropriately performed according to the viewing direction and the moving direction of a person, thereby providing pleasant lighting automatically.

FIG. 1 is a block diagram of a smart lighting control apparatus considering a movement direction of a person according to an embodiment of the present invention.
FIG. 2 shows a histogram of image depth values for a human candidate region according to an embodiment of the present invention.
FIG. 3 is a view for explaining that a position of an illumination is set on a map image space in a position setting unit according to an embodiment of the present invention.
FIG. 4 illustrates a method of obtaining an angle according to a person's movement in a map image according to an embodiment of the present invention.
5 is a diagram for explaining a method for estimating a shoulder line from a region of a person to detect a shoulder line according to an embodiment of the present invention.
6 illustrates a shoulder line detected on a map image according to an embodiment of the present invention.
7 is a view for explaining an angle with respect to a detected shoulder line according to an embodiment of the present invention.
8 is a diagram for explaining a method for detecting a viewing direction according to an embodiment of the present invention.
9 is a view for explaining a light control area according to an embodiment of the present invention.

While the present invention has been described in connection with certain exemplary embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, is intended to cover various modifications and similarities. It should be understood, however, that there is no intention to limit the invention to the particular embodiments described, and that all changes, equivalents, and alternatives falling within the spirit and scope of the invention

.

Further, in this specification, when an element is referred to as transmitting a signal to another element, the one element may be directly connected to the other element to transmit a signal, but in the absence of a specially contradictory description It should be understood that the signal may be transmitted through another component in the middle.

According to an embodiment of the present invention, an apparatus and method for efficiently controlling illumination based on the position and illumination distance of an illumination are set up in a circular or elliptical shape in consideration of a movement direction of a person.

That is, according to an embodiment of the present invention, a direction of a person's gaze is detected, and a control range region of an illumination including an area of illumination is centered on a direction in which a person looks, So that it is possible to reduce the unnecessary light and save energy while providing a pleasant lighting environment.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

FIG. 1 is a block diagram of a smart lighting control apparatus considering a moving direction of a person according to an embodiment of the present invention.

Referring to FIG. 1, the smart lighting control apparatus according to an exemplary embodiment of the present invention includes an image acquisition unit 100 including a camera capable of obtaining a constant image regardless of a change in illumination, such as a depth image or a thermal image, A human position detecting unit 200 for estimating the position of a person based on the image acquired by the imaging unit 100, an illumination position setting unit 300 for setting the illumination position, A moving direction detecting unit 500 capable of detecting a direction of looking at a moving direction and a shoulder line through a previous position and a current position of a person, an illumination distance calculating unit 400, (600) for generating an illumination signal on the basis of the distance calculated in the movement direction detecting unit (500) and the movement direction detected by the movement direction detecting unit (500) It comprises a light controller 700 that controls the lighting device.

First, a method of controlling a lighting device based on a human motion direction based on a lighting control device performs a step of acquiring a depth image.

In the above-described embodiment, the image acquisition unit 100 may acquire a disparity image using a stereo camera as a device capable of acquiring a distance, a depth, a thermal image, or a device that acquires a disparity image using a stereo camera or a time difference And a device for acquiring a depth image by calculating a distorted light pattern by radiating a specific light pattern. Such a depth measuring camera may be a developed Kinect, bumblebee, or the like. As a device for obtaining a thermal image, a thermopile, which can be used for temperature measurement at a remote place, is used as an array and a thermal image is acquired using a thermopile array which can operate similar to a CMOS sensor of a camera May be included.

In the present invention, the terms for disparity image, depth image, distance image, and depth image are defined as unified depth images. Also, a device for acquiring a thermal image is defined as a thermal imaging camera.

According to an embodiment of the present invention, the image acquisition unit 100 acquires a depth image through a depth image camera or a thermal image camera and transmits the depth image to the human position detector 200.

A method of controlling a lighting device according to an embodiment of the present invention includes a step of detecting a human image region from a depth image obtained after acquiring a depth image.

The above-described human-position detecting unit 200 detects a human's region and a person's position from the depth image transmitted from the image obtaining unit 100.

According to an embodiment of the present invention, the depth image value may be represented by a distance value (mm) or a gray pixel value.

Here, the gray value may be calculated as 255 based on the minimum value and the maximum value that can be measured by the depth image camera, or the range to be measured by the user may be specified to have the range within the 255 range. For example, if the distance that the depth camera can measure is 1mm ~ 5000mm and one point in the image is 500mm, the gray value of this point can be obtained as follows.

Here, the gray value may be rounded up or rounded up or down depending on the setting.

In another embodiment, the maximum depth value may be set as the bottom surface and the remaining range may be normalized to be used as a gray value based on the depth image acquired from the depth image camera installed on the ceiling in order to specify the range to be measured by the user.

Based on the depth image, we first remove the background area to detect the human position.

In an exemplary embodiment of the present invention, a background area is removed from an input depth image by setting a range up to a certain range based on a maximum depth value and a maximum depth value.

  According to an embodiment of the present invention, the human position detection unit 200 sets a background from a maximum depth value to a certain range value from the maximum depth value to detect a person from a depth image, And if the size of the remaining area from the removed background area is equal to or larger than a predetermined size, the object area is set as the object area, and information of the human area is detected based on at least one of the center coordinates, the boundary, and the depth of the object area, As shown in FIG.

In one embodiment of the present invention, assuming that a depth image camera with a field of view (FOV) of 50 ° is installed parallel to the floor at a height of 3000 mm and observes the floor vertically, The maximum distance corresponds to the hypotenuse of two right triangles with an apex angle of 25 °. (Since FOV is the angle when the camera is viewed from the front, only θ / 2 is actually applied in one plane), and the maximum distance x can be obtained by cosθ.

 Therefore, the maximum measuring distance of the camera reaching along the hypotenuse can be obtained as follows.

,

,

와 같은 범위를 가져야한다. 일반적으로 (유아가 아닌) 사람은 카메라의 수직 아래에서 1000mm 이상의 키를 가지므로 2000mm에 해당하는 픽셀 값을 기준으로 문턱치(thresholding)를 주어 배경을 제거할 수 있으며, FOV를 고려하여 2,200mm을 최종 Ｉ _th로 설정할 수 있다. If the threshold for removing the background is I _th , then the threshold is

Should be in the same range. Generally, a person (not an infant) has a key of more than 1000mm below the vertical of the camera. Therefore, the background can be removed by thresholding based on the pixel value of 2000mm, and the background can be removed by considering the FOV. I _th .

In another embodiment, the pixel values of the thermal imaging camera are represented by temperature values and can be measured only for a specific temperature range by camera setup. For example, a person usually has a body temperature of 36 degrees, but only the heat reduced by clothes and hair can be measured. Therefore, if the measurement range is set to a range of 27 ° to 35 °, a human thermal image can be obtained. Since the thermal image actually has a temperature value, it is converted into a gray value and used. Actually, since the thermal image acquires the image including the noise, not the image for the accurate person due to the noise, noise can be removed by setting the threshold value based on the pixel value corresponding to 30 ° in order to remove the noise.

After removing the background region from the depth image or the thermal image, an image having a size larger than a predetermined size is extracted for the detected region, and the extracted image is judged to be a human candidate region. Here, the detected region of a certain size or less is regarded as a noise component so as to be removed.

According to an embodiment of the present invention, it is found that the number of pixels of an image possessed by each object is mostly a noise component for an image having a pixel resolution of less than 0.5% of the camera resolution by various experimental values.

Therefore, in an embodiment of the present invention, the number of pixels of each image has an image number less than 0.5% of the camera resolution, which is considered as a noise component, and is removed.

For example, when the resolution of the camera is 640x480, the size corresponding to 0.5% is 640x480x0.005 = 1536, and the area having a smaller size is regarded as noise in the human-position detecting unit 200 .

In one embodiment of the present invention, the human candidate region is determined based on the pixel coordinates of the upper left corner and the pixel coordinates of the lower right corner of the region, and the center of the boundary is used as the center point.

In another embodiment, when a depth image camera is used, the center of a human candidate region may be detected as a head region and the center point of the head region may be used.

FIG. 2 illustrates an image depth value histogram of a human candidate region according to an exemplary embodiment of the present invention. Referring to FIG.

According to one embodiment of the present invention, it is found that a value corresponding to the lower 10% region of the histogram CDF (Cumulative Distribution Function) of the image depth value of the human candidate region corresponds to the head region.

In the depth image, the nearest candidate candidate region has the lowest value (excluding 0). Therefore, the smallest pixel value among the candidate regions means the closest point between the camera and the head. However, since the head is round, the entire head area does not have the same value.

Experimental results show that the head region occupies the lower 10% of the CDF of the histogram.

Therefore, to specify the head region, you can use the lower 10% region of the CDF of the stream to obtain the head region. This value can vary depending on the application system. If this value becomes smaller, errors due to noise increase, and if this value becomes too large, accuracy is lowered because it includes not only the head but also other areas of the body.

Referring to FIG. 2, when using a depth camera, the head region estimates a value (90) corresponding to the lower 10% region of the histogram CDF of the image depth value of the human candidate region as the pixel value of the head region do.

According to an embodiment of the present invention, in the human region setting step, when the cumulative amount of movement during a certain frame is equal to or greater than a predetermined value THacc with respect to the center coordinates of the object corresponding to the human candidate region, .

=7)초과인 사람 후보 영역은 위치 검출부에서 사람 영역으로 판단할 수 있다.For example, in a map image, a motion with a motion of 5 or less for x, y pixels can be regarded as noise. If the cumulative moving distance between 5 frames is 7 (

= 7) can be judged as a human region in the position detecting section.

The cumulative movement amount is expressed by the following equation (1).

Where i is the ith candidate region, t is the current frame, n is the maximum number of frames to be measured, x is the x coordinate of the ith candidate region, y is the y coordinate of the ith candidate region, it means.)

이면 사람 후보 영역은 사람 영역으로 판단하게 된다.
≪ EMI ID = 1.0 >

The person candidate region is judged to be a human region.

The illumination directing control method according to an embodiment of the present invention includes the steps of generating a map image space in proportion to the actual space size of the coordinates of the rectangle corner of the detected human image area and setting the center coordinates of the human image area on the map image space .

In an embodiment of the present invention, a coordinate image of a square vertex of a depth image input from a fixed camera is generated in proportion to an actual spatial size.

In the center coordinate extraction step, the center of the image of the human image is extracted as the coordinates of the map image space.

In an embodiment of the present invention, the actual space is projected to the image space through perspectvie transformation into the map image space, and the input image coordinates are compared with the virtual coordinates of the actual position according to the installation position of the camera, . The center coordinate extraction and the coordinate correction step are performed to convert the coordinates into the spatial coordinates at which the actual object is located.

The illumination position setting unit 300 includes means for providing an interface for setting an illumination position based on a position to be set for an image map for a given space. That is, the illumination position setting unit 300 can preset the illumination position on the image space through the user interface or the like.

An illumination directing control method according to an embodiment of the present invention includes a step of setting a position of a lighting apparatus in a map image space.

FIG. 3 is an example of setting a position of an illumination on a map image space in a position setting unit according to an embodiment of the present invention.

According to an embodiment of the present invention, the map image 30 is displayed in a plane in proportion to the size of the actual space, and is set by inputting the position of the illumination as an initial value. Further, IDs 1 to 12 are assigned from the controller for lighting control of each illumination, and the same position as the IDs 1 to 12 of the illumination is set when setting the position of the illumination.

In an embodiment of the present invention, a space having an actual space of 300 × 500 cm 2 is represented by a 1: 2 ratio with a map image of 600 × 1000 pixels, 12 lights are evenly arranged, Respectively. In addition, each of the illuminations can be individually controlled by assigning IDs 1 to 12 as shown in FIG.

The illumination distance calculation unit 400 calculates the distance between each person and the illuminant based on the human position detected by the human position detection unit 200 and the position of the illumination set by the illumination position setting unit.

The distance between the person and the illumination is obtained from the following equation (2).

는 I번 째 검출된 사람의 지도 이미지상에서 위치를 의미하며

는 지도 이미지상에서의 j번 째 조명의 위치,

는 i번 째 사람과 j번 째 조명과의 거리를 의미한다.
Where j is each illumination,

Indicates the position on the map image of the I-th detected person

The position of the j-th light on the map image,

Is the distance between the i-th person and the j-th light.

The illumination directing control method according to an embodiment of the present invention includes a step of subtracting a center coordinate of a current human image area from a center coordinate of a previous human image area to obtain a moving direction.

FIG. 4 illustrates a method of obtaining an angle according to a person's movement in a map image according to an embodiment of the present invention.

According to an embodiment of the present invention, the moving direction detecting unit 500 detects a shoulder line based on a region of a person detected by the human position detecting unit, and detects a moving direction from a previous human position and a current position.

In addition, the direction of sight is detected based on the detected shoulder line and the direction of movement.

In one embodiment of the present invention, the moving direction can be detected through the following equation to detect the moving direction from the previous person position and the current position.

Referring to FIG. 4, when a person moves from t-1 to t, the coordinates 31 represent the coordinates of a person at t, and the coordinates 32 represent the coordinates of a person at t-1.

At this time, the angle with respect to the moving direction is obtained by the following equation (3).

,

는 지도 이미지상에서 x - y 좌표 위치, t는 현재 관측된 시점, t-1은 이전 관측된 시점, θ는 x축을 기준으로 이동 방향에 대한 각도이다.
here

,

Is an x-y coordinate position on the map image, t is the current observed time, t-1 is the previous observed time, and? Is the angle with respect to the moving direction with respect to the x axis.

An illumination directing control method according to an embodiment of the present invention includes detecting a shoulder line based on a center coordinate of a human image area and detecting a direction of looking based on a moving direction.

5 illustrates a method for estimating a shoulder line from a region of a person to detect a shoulder line according to an embodiment of the present invention.

5 (a) shows a line 41 connecting a pixel at the smallest x-coordinate and a point at the outermost position of the pixel at the largest x-coordinate using the first order least squares method.

FIG. 5B shows a line 51 connecting the two points using the first-order least squares method from the outermost point of the pixel at the smallest y-coordinate and the pixel at the largest y-coordinate.

5, in order to detect the shoulder line, a pixel at the smallest x coordinate and a pixel at the largest x coordinate in the area of the person detected by the human position detecting part 200, a pixel at the smallest y coordinate, Find the four outermost points from the position of the pixel in the y coordinate, and find a line connecting the two points using the least-squares problems based on the coordinates of the left and right and top and bottom points.

6 illustrates a shoulder line detected on a map image according to an embodiment of the present invention.

According to one embodiment of the present invention, a pixel at the smallest x coordinate and a pixel at the largest x coordinate in the region of the person detected by the method of Fig. 5, a pixel at the smallest y coordinate, And the line connecting the two points is obtained by using the first-order least squares method based on the coordinates of the left and right and upper and lower points. Then, each of the pixels of the pixels passing through these two lines Counts the number of non-zero pixels and selects the more predominant direction.

It can be seen that the line selected in the predominant direction coincides with the shoulder line direction in many experimental values.

Referring to FIG. 6, the number of pixels whose values are not 0 among the pixels passing through the two lines is counted, and the shoulder line 61 detected on the map image is selected in a predominant direction in FIG. 5 (a) Respectively.

The middle image represents the head portion 60.

Figure 7 illustrates the angle to the detected shoulder line according to one embodiment of the present invention.

According to an embodiment of the present invention, the angle of the shoulder line, that is, the angle? _P with which the shoulder line is directed is calculated by using the following equation (4) using both ends of the shoulder line 71 selected in the predominant direction.

(Where x ₁ and y ₁ are the left or top coordinates, x ₂ and y ₂ are the right or bottom coordinates, and θ _p is the angle of the shoulder line).

7, the direction the viewer is looking at that is the direction of movement of the person to be a line perpendicular to the shoulder line 71, the perpendicular line is shown in two different directions (θ _p, θ _p +180).

Therefore, it can be seen that the viewing direction is θ _p (73) or θ _p +180 (72).

In one embodiment of the present invention, estimation is made in a direction in which a person is moving forward, and the user can select one of θ _p (73) and θ _p +180 (72) using the movement direction θ _m .

That is, the moving direction detecting unit 500 adopts a method of estimating the direction through the detection of the shoulder line of the human area and distinguishing the forward and backward directions based on the information on the previous moving route.

In another embodiment of the present invention, to effectively detect the shoulder line without disturbance due to the head, the head region is removed and a bounding box is formed to estimate the direction of the shoulder through the two contact points with the boundary box Method can be provided.

8 is a diagram for explaining a method for detecting a viewing direction according to an embodiment of the present invention.

Referring to FIG. 8, a movement angle? _M (angle with the horizontal plane) is obtained from the previous position and the current position.

As described above, θ _p and θ _p +180 are calculated from the shoulder line detection using Equation (4).

after the segment (r) and the line perpendicular (b) according to θ _m green, when referred to as angle θ _S viewer is looking, line (r) is the θ _S + 90 when said watching angle segment (b ) Becomes &thetas; _S- 90.

Therefore, the range of the angle θ _{S that} can be seen at the angle of the shoulder line is as shown in the following equation (5).

에 만족할 경우에는 θ_p로 판단하게 되며 그렇지 않은 경우에는 θ_p+180을 바라보는 방향(θ_S)으로 판단하게 된다.
Therefore, the process of detecting the direction (θ _S) viewed from the moving direction detection unit 500 is a condition θ _p

, It is judged to be θ _p , otherwise it is judged to be the direction (θ _S ) to see θ _p +180.

An illumination directing control method according to an embodiment of the present invention includes generating an illumination directing control signal according to an illumination directing pattern based on a viewing direction and a distance between the illuminating device.

According to an embodiment of the present invention, the lighting control signal generator 600 may include a lighting control signal generator 600, which is included in the lighting directing control range based on the position and viewing direction of a person, And generates a signal for controlling the illumination presentation.

That is, the illumination control signal generator 600 generates an illumination directing control signal based on the distance between the illumination calculated by the illumination distance calculating unit and the direction of each person calculated by the movement direction detecting unit.

According to an embodiment of the present invention, the generation of the illumination directing control signal is performed by calculating the distance of the illumination directing control based on the position and direction of the person, such as circular or oval, And when dimming is applied to the illumination directing control range, it is possible to dimming or generate a switching (on / off) signal depending on the distance to the illumination.

In addition, when determining the range of illumination directing control, an offset can be given based on the viewing direction.

According to one embodiment of the invention, in the form of a circular director has the following formula 6 can be determined that the illumination device exists within a radius of the light directing control range by which, light directing control is less than d ² equal to or It can be judged that it belongs to the range.

(Where a and b correspond to the x and y coordinates of the center coordinates of the human region on the map image, respectively, C _x and C _y are the given offset values for x and y, d is the radius corresponding to the control range, y is the position of each light, and i is the i-th light.)

9 is a diagram for explaining an illumination directing control range according to an embodiment of the present invention.

As shown in Fig. 9 (a), if the position of a person is located at the center of the original area to be controlled, c corresponds to 0 in Equation [6].

As shown in FIG. 9 (b), if the position of the person is below the center of the circle, the value c has a negative value.

For example, suppose d is 50 and the person's position (a, b) = (100, 100) and the two lights are (x ₁ , y ₁ ) = 75, if said _{75), (x 2, y} 2) = (50, 75), a distance 55.90 in the distance _{35.36, (x 2, y 2} ) of the (x _1, y ₁₎ in accordance with equation 6] The first illumination is within the illumination directing control range, and the second illumination is not present.

According to another embodiment of the present invention, if it is an elliptical shape as shown in FIG. 9 (c), it can be determined whether it is located in the control range of the illumination production using the following formula (7).

Where a is 1/2 of the short axis of the ellipse, b is 1/2 of the long axis of the ellipse, x and y are the positions of the illumination, and i means the i th illumination device. A and b are the size of the region to be controlled,? And? Are the position of the center coordinates of the human region, C _x , C _y means offset (deviation value) for x, y.

The offset value can be set based on the viewing direction.

For example, Figure 9 (b) when this value (c) to be shifted to one side, rather than in person at the center of the range to be controlled, as can be determined by looking at the direction angle θ _s is determined by the offset.

,

In other words,

,

(Where e is a constant value for the distance from the preset center)

Also, generating a simple on / off signal to generate an illumination directing control signal may give an on signal to an illumination device corresponding to an illumination directing control range, and an off signal to an illumination device that does not.

In another embodiment, a dimming control signal along the distance is proposed.

 For example, a dimming signal can be generated in percent of distance based on the maximum distance calculated for each illumination, as shown in Equation [8].

expression

Where PWM is the PWM value when dimming control is performed by PWM (Pulse Width Modulation), t is the value of Equations 6 and 7 (calculated in the left side term), d is the radius when the control rendering pattern is a circle, It is 1 when the control rendering pattern is an elliptic equation.

For example, when d is 50, the maximum distance is 50, and the value calculated in the left side of Equation (6) is t. If t is less than 50, it can be set to a normalized value in the range of 1 to 0 if 1- (t ÷ 50).

This normalized value can be used as a percentage of the 8-bit PWM to generate the signal. For example, an 8-bit PWM can have a total of 256 values from 0 to 255. If the normalized value is 0.15, 256 × 0.15 = 38.4 is obtained and the value of 38 is used as a PWM value, A control signal can be generated.

In an embodiment of the present invention, an RS485-based DMX 512 is used to generate an illumination control signal, and a signal for controlling the DMX 512 control device is generated according to a given protocol. However, it includes the use of other communication methods and protocols such as Zigbee and Bluetooth, wireless LAN in addition to DMX512.

An illumination directing control method according to an embodiment of the present invention includes a step of generating a signal for controlling illumination to the illumination device by the illumination directing control signal.

The illumination control unit 700 controls the illumination device based on the illumination signal transmitted from the illumination generation unit, and controls the color temperature, illumination, color, and the like using PWM, a variable resistor, and the like.

Accordingly, in the lighting control method according to an embodiment of the present invention, the lighting control apparatus automatically distinguishes the area of the person, calculates the direction of movement of the person and the direction of the person, generates the lighting control signal, can do.

The lighting control method according to an embodiment of the present invention proposes a configuration and a method for determining a viewing direction of a person by distinguishing a moving direction of a person from a shoulder line of a person so as to automatically calculate a viewing direction of a person It is possible to provide a lighting control apparatus capable of controlling the lighting apparatus.

In addition, it is possible to automatically produce various local lighting by setting various offset conditions according to the viewing direction of a person.

According to an embodiment of the present invention, various light control patterns such as a circular pattern and an elliptical pattern can be set by adjusting the offset size in accordance with the direction of the viewer, and it is possible to provide a suitable illumination environment It is effective.

In addition, by offsetting only in the direction of the viewer, it is possible to automatically provide pleasant lighting while reducing unnecessary lighting, thereby reducing energy consumption.

The foregoing description is merely illustrative of the technical idea of the present invention and various changes and modifications may be made by those skilled in the art without departing from the essential characteristics of the present invention. Therefore, the embodiments disclosed in the present invention are intended to illustrate rather than limit the scope of the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments.

1 to 12: ID of lighting device
20: Lighting device
100:
200: human position detector
300: illumination position setting unit
400: Illumination distance calculation unit
500: moving direction detecting section
600: an illumination signal generating unit
700:

Claims (11)

delete delete A lighting control method in which a human movement direction is considered,
An image acquiring step of acquiring a depth image by an image acquiring unit of the illumination control apparatus;
A human region detection step of detecting a human image region from the acquired depth image by human position detection means of the illumination control apparatus;
A human position extraction step of the human position detection means generating a map image space in proportion to the actual space size of the coordinates of the rectangle corner of the human image region and extracting the center coordinates of the human image region in the map image space;
A lighting position setting step of the lighting control device setting a position of the lighting device in the map image space;
An illumination distance calculation step of the illumination control device calculating the illumination distance based on the center coordinates of the human image area and the position coordinates of the illumination device;
A moving direction detection step of detecting a moving direction by subtracting a center coordinate of a current human image area from a center coordinate of a previous person image area;
The moving direction detecting means detects a shoulder line based on a center coordinate of the human image region and detects a direction in which the line of sight is viewed based on the moving direction;
An illumination control signal generation step of generating an illumination illumination control range and an illumination illumination control signal in accordance with an illumination illumination pattern including a direction in which the illumination control signal generation means of the illumination control device looks at the illumination distance; And
And a lighting device controlling step of receiving a lighting direction control signal from the lighting control device of the lighting control device and generating a signal for controlling the lighting device to the lighting device.
The method of claim 3, wherein
The detection of the human image region in the human region detection step may include detecting a human image region when the cumulative amount of movement (acc _i ) during a certain frame is equal to or greater than a predetermined value with respect to the obtained depth image, A Smart Lighting Control Method Considering Human Movement Direction
[Formula 1]

(Where acc _i denotes an accumulated value, i denotes an ith person candidate region, t denotes a current frame, n denotes a maximum number of frames to be measured, x denotes an x coordinate of an ith candidate region, y denotes a y coordinate .)
The method of claim 3,
Extracting the center coordinates of the human image region in the human position extraction step further comprises detecting a head region in the human image region and extracting a center point of the head region in the center coordinates,
Wherein the head region estimates a value corresponding to a lower 10% region of a histogram CDF of the depth image value of the human image region as a pixel value of the head region. Control method
The method of claim 3,
Further comprising calculating an angle (?) With respect to the moving direction by the following formula (2) in the moving direction detecting step:
[Formula 2]

(here

,

Is an angle with respect to the moving direction with respect to the x-axis as a reference,
The method of claim 6, wherein
The detecting of the shoulder line in the looking direction detecting step may include detecting pixels in the smallest x coordinate and the largest x coordinate in the area of the person detected in the human position extracting step, And the outermost four points from the position of the pixel at the largest y coordinate, and based on the coordinates of the left and right and upper and lower points, a line connecting the two points is obtained using the first least squares method, Counting the number of non-zero pixels among the passing pixels and detecting more of the pixels as a shoulder line. The smart lighting control method according to claim 1,
The method of claim 7, wherein
Wherein the detected shoulder line further includes an angle? _P at which the shoulder line is directed by the following formula (3): " (6 _{) "}
[Formula 3]

(Where x ₁ and y ₁ are the left or top coordinates of the shoulder line detected on the map image, x ₂ and y ₂ are the coordinates of the right or bottom coordinates, and θ _p is the angle at which the shoulder line faces the x axis)
The method of claim 8, wherein
The view from the direction detection step facing direction (θ _S) is the heading angle θ _p the condition the shoulder line

, And if it is not satisfied, it is determined as &thetas; _p , otherwise, it is detected as a direction &thetas; _{S in which} &thetas; _p +180 is viewed.
The method of claim 3,
If the lighting directing control range according to the illumination directing pattern in the generating step the illumination control signal Round directed pattern, in each illumination device, the following [Equation 4] one trillion people directing control range of the left term value is less than or equal to d ² obtained by The method further comprising: determining a position of the person to be moved
[Formula 4]

(Where a and b correspond to the x, y coordinates of the center coordinates of the human region on the map image, C _x and C _y are the offset values (deviation values) given for x and y, Radius, x, y is the position of each light, i is the i-th illumination). The method of claim 3,
When the illumination control range according to the illumination pattern is the elliptical pattern, the illumination device generates the illumination control signal in the illumination control range if the value of the left term calculated by the following formula (5) The method according to claim 1, further comprising:
[Formula 5]

(Where a is 1/2 of the short axis of the ellipse, b is 1/2 of the long axis of the ellipse, x and y are the positions of the illumination, and i is the i th illumination device) The position of the center coordinates of the human region, C _x , C _y means the offset given for x, y.)

Images