WO2016125849A1

WO2016125849A1 - Illuminant aggregation device and illuminant aggregation method

Info

Publication number: WO2016125849A1
Application number: PCT/JP2016/053332
Authority: WO
Inventors: 茂樹都
Original assignee: 株式会社ルイファン・ジャパン
Priority date: 2015-02-06
Filing date: 2016-02-04
Publication date: 2016-08-11
Also published as: JP2016146069A; JP6494310B2

Abstract

The present invention provides a technique for quickly aggregating the luminous state of lights even in a wide space such as a concert hall. A light control unit remotely operates the luminous state of each of a plurality of lights, each of which is capable of emitting light in one or more colors as selected by a user. A video acquisition unit acquires a video including the plurality of lights in synchronization with the control of the plurality of lights by the light control unit. A light classification unit specifies the currently luminous light that is seen in the video acquired by the video acquisition unit, and classifies the specified luminous light for each color of light. An aggregation unit aggregates, for each color of light, the number of lights classified by the light classification unit. The light control unit remotely operates the luminous state of each of the plurality of lights.

Description

Luminescent body counting device and luminous body counting method

The present invention relates to an illuminator counting apparatus and an illuminator counting method, and more particularly to an apparatus and method for counting the number of lights used in events, concerts, festival events, and the like.

In events, concerts, and festival events, there are many light sources that use penlights, lighting, etc. to enhance the production effect, and lights that attract light. In particular, bar-shaped lights are often used to raise the venue by shaking them up in the event of nighttime events such as concerts. Some of these lights have been proposed that can be turned on or blinked with light of a plurality of colors.

In recent years, for example, the functions of many lights held by spectators in concerts and other events have been used for communication between the event organizers and spectators, for example, to answer questionnaires. It is becoming.

JP2014-0199772A

The inventor of the present application can promote communication between the organizer and the audience by photographing and counting the light emission state used by the audience at a place where a large number of audiences gather such as a concert venue or a baseball field. I came to recognize the possibility.

The present invention has been made in view of the above circumstances, and an object thereof is to provide a technique for quickly counting the light emission state even in a wide space such as a concert venue.

In order to solve the above problems, a light emitter aggregation device according to an aspect of the present invention includes a plurality of lights, each light including an image including a light that a user can selectively emit light of one or more colors. The image acquisition unit to be acquired, the light emitting light that is reflected in the image acquired by the image acquisition unit, the light classification unit that classifies each light color, and the number of lights classified by the light classification unit And a totaling unit that counts for each color.

A light control unit for remotely operating the light emission state of each of the plurality of lights may be further provided. The video acquisition unit may acquire the video in synchronization with the control of the plurality of lights by the light control unit.

The light control unit can execute a reset control that sets a plurality of lights in the same light emission state, and the video acquisition unit resets the first video in a state where the light control unit turns on the reset control, and the light control unit resets You may acquire control and the 2nd image | video of the state made into OFF.

A difference image generation unit that generates a difference image between the first video and the second video may be further provided. The light classification unit may specify a light in the difference image generated by the difference image generation unit.

The video acquisition unit may acquire two or more sets of the first video and the second video.

The plurality of lights blink with different blink patterns depending on the color of light, the video acquisition unit acquires a moving image including the plurality of lights, and the light classification unit flashes in the moving image acquired by the video acquisition unit. The light emitters to be identified may be identified, and the light being emitted may be classified for each light color based on the blinking pattern of the identified light emitters.

The light classifying unit also identifies whether or not a light existing at a specific position determined in advance from the video acquired by the video acquisition is turned on. When it is determined that is turned on, the number of lights classified by the light classification unit may be totaled for each color of light.

Another aspect of the present invention is a luminous body counting method. This method includes a video acquisition step of acquiring a video including a plurality of lights, each of which allows a user to selectively emit light of one or more colors, and a light emission being reflected in the acquired video The processor executes a specifying step for specifying the light, a light classification step for classifying the specified light for each light color, and a counting step for totalizing the number of classified lights for each light color.

According to the present invention, it is possible to quickly count the light emission state of light even in a large space such as a concert hall or a large space such as a concert hall.

It is a schematic diagram which shows the outline | summary of the light-emitting body totaling system which concerns on embodiment. It is a figure which shows typically the function structure of the light-emitting body totaling device which concerns on embodiment. FIGS. 3A to 3C are schematic diagrams for explaining the difference image generated by the video acquisition unit according to the embodiment. It is a flowchart explaining the flow of a process of the light-emitting body totaling method which the light-emitting body totaling apparatus which concerns on embodiment performs. It is a figure which shows typically the blink pattern of the light which concerns on a 2nd modification. It is a figure which shows typically the function structure of the light-emitting body totalization apparatus which concerns on a 2nd modification.

FIG. 1 is a schematic diagram showing an outline of a luminous body aggregation system 1 according to an embodiment. With reference to FIG. 1, the outline | summary of the light-emitting body totaling system which concerns on embodiment is described.

The illuminator counting system 1 according to the embodiment is configured such that when a plurality of users 400 who are spectators each have a light 500 in an event venue such as a concert hall, the light 500 is captured using the photographing device 100. Take a picture that is lit. These lights 500 can emit light of one or more different colors, and light of any one color can be selectively emitted by an operation of the user 400. In FIG. 1, only one light is denoted by reference numeral 500 in order to prevent complication.

Suppose, for example, that an event organizer takes a selective questionnaire to the audience. At this time, it is assumed that the user answers the questionnaire with the color of light emitted from the light 500 held by the user. The image capturing apparatus 100 captures an image including the light, and the illuminator totalizing apparatus 200 analyzes the image so that the number of light of which color is lit and the number of lights are counted for each color of light. The light emitter totalization apparatus 200 displays the totalization result on the display apparatus 300. The organizer can confirm the result of aggregation with the relationship by confirming the result displayed on the display device 300. In addition, when the color of light that the light 500 can emit is one color, the user has two choices of turning on or off the light 500. In this case, the light emitter totalization apparatus 200 totalizes the number of lights that are lit. When the number of spectators is known, the illuminator counting apparatus 200 can also calculate the number of lights that are turned off from the difference between the number of spectators and the number of lights that are turned on.

As described above, the luminous body counting system 1 according to the embodiment can quickly count the questionnaires conducted by the sponsors at an event venue such as a concert hall. As a result, it contributes to the promotion of communication between the organizer of the event and the audience.

Note that the illuminator totaling apparatus 200 can individually transmit a control signal to the lights 500 possessed by a plurality of users 400, and a light emission control function for controlling the light emission state of each light 500 by this control signal. Have By utilizing this light emission control function, the light emitter aggregation system 1 can increase the accuracy of the light emitter aggregation. Details of the light emission control function will be described later.

FIG. 2 is a diagram schematically illustrating a functional configuration of the light emitter aggregation apparatus 200 according to the embodiment. The luminous body totalization apparatus 200 according to the embodiment includes a video acquisition unit 210, a light control unit 220, a difference image generation unit 230, a light classification unit 240, and a totalization unit 250.

FIG. 2 shows a functional configuration for realizing the luminous body aggregation device 200 according to the embodiment, and other configurations are omitted. In FIG. 2, each element described as a functional block for performing various processes can be configured by a CPU (Central Processing Unit), a main memory, and other LSI (Large Scale Integration) in hardware. In terms of software, it is realized by a program loaded in the main memory. Note that this program may be stored in a computer-readable recording medium or downloaded from a network via a communication line. Therefore, it is understood by those skilled in the art that these functional blocks can be realized in various forms by hardware only, software only, or a combination thereof, and is not limited to any one.

2, when each functional unit of the light emitter totalization apparatus 200 shown in FIG. 2 is realized by software, the light emitter totalization apparatus 200 is realized by executing an instruction of a program that is software that realizes each function. As a recording medium for storing this program, a “non-temporary tangible medium”, for example, a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like can be used. The search program may be supplied to the computer via any transmission medium (such as a communication network or a broadcast wave) that can transmit the search program. The present invention can also be realized in the form of a data signal embedded in a carrier wave, in which the search program is embodied by electronic transmission.

The search program uses, for example, a script language such as ActionScript or JavaScript (registered trademark), an object-oriented programming language such as C ++, Objective-C, Java (registered trademark), or Ruby, or a markup language such as HTML5. Can be implemented.

The luminous body aggregation device 200 can be realized using, for example, a PC (Personal Computer), a mainframe, cloud computing, or the like.

The video acquisition unit 210 acquires video captured by the imaging device 100. The photographing apparatus 100 is installed so as to photograph a spectator at a place where an event such as a concert hall, a live venue, or a baseball field is held. A spectator of such an event has a light 500 for enhancing a production effect using light such as pen light or illumination.

In the luminous body aggregation system 1 according to the embodiment, it is assumed that the audience has a light 500 that can selectively emit light of one or more colors. Therefore, an image captured by the image capturing apparatus 100 is a plurality of lights 500, and each light 500 is an image including a light 500 that allows a user to selectively emit one or more colors of light. In the present invention, the shape of the light 500 may be any shape as long as the user can selectively turn it on and off, or change the emission color. For example, a rod-shaped light, And a wristband type light or the like.

The light control unit 220 can wirelessly communicate with each of the plurality of lights 500. For this reason, the light control unit 220 can remotely control the light emission state of the light 500 by transmitting a control signal to each light 500. Here, the “light emission state” of the light 500 includes not only a state where the light 500 is lit with light of any color but also a state where the light 500 is turned off.

Each light 500 is given identification information that can uniquely identify the light 500. The luminous body totaling apparatus 200 includes a storage unit (not shown), and identification information of each light 500 is stored in the storage unit. The light control unit 220 can individually control the light emission state of each light 500 by referring to the light identification information and unicasting a control signal to the specific light 500. The light control unit 220 can also control the light emission states of all the lights 500 simultaneously by broadcasting a control signal to all the lights 500.

In general, when the photographing apparatus 100 captures an image including a light emitter, it is considered that the luminance value of the pixels constituting the light emitter in the image increases. Therefore, the pixel value in the video is a useful clue for specifying the light 500 that is emitting light. Here, when the number of the light 500 that is emitted in the image captured by the image capturing apparatus 100 is counted, whether the high-luminance pixel value in the image is caused by the light 500 or another subject (for example, mobile phone) If it is possible to identify whether the light is from the telephone screen or the reflected light from the glasses, the accuracy of counting can be improved.

Therefore, the video acquisition unit 210 does not control the video when the light control unit 220 controls the light emission state of each light to the same state, and the light control unit 220 does not control the light emission state of each light to the same state. Get two videos with the case video. By comparing the two images, the light source that can be controlled by the light control unit 220, that is, the light 500 can be easily identified.

Hereinafter, in the present specification, a state in which the light control unit 220 sets the light emission state of each light 500 to the same state is a “state in which reset control is turned on”, and a state in which the light control unit 220 is not in the same state as a state in which reset control is turned off It describes. In addition, a video captured when the light control unit 220 is in the reset control is “first video”, and a video captured when the light control unit 220 is in the reset control and off is the “second video”. Describe.

The video acquisition unit 210 acquires video captured by the imaging device 100 in synchronization with the control of the plurality of lights 500 by the light control unit 220. More specifically, the video acquisition unit 210 includes at least two of a first video in a state where the light control unit 220 turns on reset control and a second video in a state where the light control unit 220 turns off reset control. Get two videos. In addition, it is preferable that the video acquisition unit 210 acquires the second video immediately before or after acquiring the first video.

The difference image generation unit 230 generates a difference image between the first video and the second video acquired by the video acquisition unit 210. FIGS. 3A to 3C are schematic diagrams for explaining the difference image generated by the video acquisition unit 210 according to the embodiment. More specifically, FIG. 3A is a schematic diagram showing a state in which each light 500 is lit for counting the questionnaire, that is, the second video. In FIG. 3A, for convenience of explanation, only the light 500 is shown, and other subjects such as the user 400 are not shown. The same applies to FIGS. 3B and 3C.

For example, it is assumed that the reset control by the light control unit 220 is control to turn off all the lights 500. In this case, in the first video acquired by the video acquisition unit 210, light caused by the light 500 is not captured. FIG. 3B is a schematic diagram showing a state in which the light control unit 220 turns on reset control, and more specifically, a state in which all the lights 500 are turned off.

FIG. 3C is a schematic diagram showing a difference image between the second video shown in FIG. 3A and the first video shown in FIG. 3B. As shown in FIG. 3C, light mainly due to the light 500 appears in the difference image between the first video and the second video generated by the difference image generation unit 230. Thereby, the influence of subjects other than the light 500 in the aggregation can be reduced.

The light classification unit 240 identifies the light 500 in the difference image generated by the difference image generation unit 230 and classifies it for each color of light. The totaling unit 250 totalizes the number of lights 500 classified by the light classification unit 240 for each color of light. The totaling result for each light color by the totaling unit 250 is output to the display device 300. Thereby, the organizer or the like of the event can check the total of the color selection results of each user 400.

For example, in a venue such as a large concert hall, the number of spectators who are users 400 may exceed 1,000. In such a case, if the organizer takes a questionnaire to the audience using the light 500, the visual confirmation takes too much time and is not realistic.

In recent years, a technique has also been proposed in which information is transmitted from the light 500 to the server by wirelessly communicating with the server installed at the venue and the light 500. Here, it is said that the communication between the server and one light 500 may take about 0.1 seconds to 1.0 seconds. Even if communication between the server and one light 500 is completed in 0.1 seconds, it takes 100 seconds to complete communication with 1000 lights 500. In the event of an event such as a concert or live performance, it may not be preferable for the operation of the event to make many users 400 wait for 100 seconds just for counting.

In the luminous body totalization apparatus 200 according to the embodiment, the questionnaire using the light 500 can be totaled only by photographing two images of the first image and the second image. For this reason, there is almost no time for the user 400 to wait for counting, and the event can be quickly managed. Further, since the questionnaire total using the light 500 is realized by image processing of the video, it is possible to realize a quick total compared with the total by visual observation or the total by wireless communication.

FIG. 4 is a flowchart for explaining the processing flow of the luminous body aggregation method executed by the luminous body aggregation apparatus 200 according to the embodiment. The process in this flowchart is started when the light emitter aggregation device 200 is activated, for example.

The light control unit 220 performs reset control by broadcasting a control signal to the plurality of lights 500 (S2). The video acquisition unit 210 acquires, as a first video, a video including a plurality of lights 500 on a subject taken by the imaging device 100 (S4).

The light control unit 220 releases the reset control for the plurality of lights 500 (S6). The video acquisition unit 210 acquires, as a second video, a video including a plurality of lights 500 on the subject, which is captured by the imaging device 100 (S8).

The difference image generation unit 230 generates a difference image between the first video and the second video acquired by the video acquisition unit 210 (S10). The light classification unit 240 identifies the light 500 that is emitting light from the difference image generated by the difference image generation unit 230 (S12). The counting unit 250 counts the number of lights 500 that are emitting light for each light color of the lights 500 (S14). The tabulation unit 250 outputs and presents the tabulation result to the display device 300 (S16).

The operations of the illuminator totaling apparatus 200 and the photographing apparatus 100 configured as above are as follows. An organizer of an event that is a user of the luminous body aggregation system 1 distributes the light 500 to the audience. The organizer conducts a questionnaire for the audience during the event, and makes the audience answer by selecting the light emission color of the light 500. The light control unit 220 performs reset control on the light 500 and photographs the first image, which is an image in which all the lights are in the same light emission state, with the photographing apparatus 100. Immediately before or after that, the second image, which is an image in which the reset control by the light control unit 220 is not performed, is imaged by the imaging device 100.

The difference image generation unit 230 generates a difference image between the first video and the second video. The light classification unit 240 and the totaling unit 250 analyze the difference image to total the questionnaire results.

As described above, according to the luminous body aggregation system according to the embodiment, the light emission state of the light can be quickly changed regardless of whether it is in a large space such as a concert hall or a large space such as a concert hall. Can be aggregated.

The present invention has been described based on the embodiments. The embodiments are exemplifications, and it will be understood by those skilled in the art that various modifications can be made to combinations of the respective constituent elements and processing processes, and such modifications are within the scope of the present invention. .

(First modification)
In the above description, the case where the video acquisition unit 210 acquires a set of the first video and the second video has been described. The set of the first video and the second video acquired by the video acquisition unit 210 is not limited to one set, and two or more sets may be acquired.

When many spectators are gathering in a narrow venue, the light 500 may be blocked by other lights 500, spectators, etc., and may not be photographed by the photographing apparatus 100. Such shields are generally considered to move with time. For this reason, if a plurality of sets of the first video and the second video are acquired, the time at which they were shot will also shift. If the light 500 that was shielded and not photographed in one group is photographed in another group, the information can be used for more accurate tabulation.

(Second modification)
In the above description, the case has been described in which the light control unit 220 suppresses the influence of bright spots caused by subjects other than the light 500 at the time of counting by executing reset control on and off. The method for suppressing the influence of the bright spot caused by the subject other than the light 500 is not limited to the above.

The light 500 according to the second modified example is configured to blink with a different blinking pattern according to the color of light selected by the user 400. FIG. 5 is a diagram schematically showing a blinking pattern of the light 500 according to the second modification. In the example shown in FIG. 5, the light 500 can light red, white, blue, or green light. In the example shown in FIG. 5, when the user 400 turns on the light 500 in red, the light is always turned on. On the other hand, when the user 400 turns on the light 500 in white, the light 500 is periodically turned on (on) and turned off (off).

When the user 400 turns on the light 500 in blue, the light is periodically turned on and off. However, compared with the case where the user 400 turns on the light 500 in white, the cycle of turning on and off is shorter. Further, when the user 400 turns on the light 500 in green, the light 500 is turned on and off repeatedly in a pattern in which the light 500 is lit longer, turned off shorter, turned on shorter, and turned off longer for one cycle.

FIG. 6 is a diagram schematically illustrating a functional configuration of the luminous body aggregation device 201 according to the second modification. The luminous body totalization apparatus 201 according to the second modification includes a video acquisition unit 210, a light control unit 220, a light classification unit 241, and a totalization unit 251. Hereinafter, portions common to the luminous body aggregation device 200 according to the embodiment will be described by omitting or simplifying them as appropriate.

The photographing apparatus 100 according to the second modification can photograph a moving image. The video acquisition unit 210 acquires a moving image including a plurality of lights 500 captured by the imaging apparatus 100. The light classifying unit 241 identifies flashing light emitters that appear in the moving image acquired by the video acquisition unit 210, and classifies the light 500 that is emitting light for each color of light based on the flashing pattern of the specified light emitters. . Thereby, the light control unit 220 can count the light emitters without performing reset control. In addition to the color of light, information on the blinking cycle can be used, so that the accuracy of aggregation can be improved.

(Third Modification)
In the above description, a case has been described in which the imaging apparatus 100 captures an image and counts the light emitters on condition that the light control unit 220 executes reset control. The condition for starting counting is not limited to this.

When a spectator sits down and participates in an event like a concert hall or a movie theater, the spectator's position is inevitably fixed. In such a case, for example, a related party of the organizer of the event may be arranged at a predetermined position of the auditorium, and the aggregation of the light emitters may be started on condition that the related party causes the light 500 to emit light. .

More specifically, the light classification unit 240 specifies whether or not the light 500 existing at a specific position determined in advance from the video acquired by the video acquisition unit 210 is lit. When the light classification unit 240 determines that the light 500 existing at a specific position is turned on, the totaling unit 250 totalizes the number of lights classified by the light classification unit 240 for each color of light.

When the photographing apparatus 100 is a video camera and the video acquisition unit 210 acquires a moving image, the light classification unit 240 analyzes the moving image acquired by the video acquisition unit 210. The counting unit 250 may start counting when the light classification unit 240 specifies that the light 500 existing at a specific position is turned on. Thereby, the aggregation of the light emitters can be started at an appropriate timing according to instructions from the organizers.

1 luminous body counting system, 100 photographing device, 200, 201 luminous body counting device, 210 video acquisition unit, 220 light control unit, 230 differential image generation unit, 240, 241 light classification unit, 250, 251 totaling unit, 300 display device , 400 users, 500 lights.

Claims

A video acquisition unit that acquires a video including a light that is a plurality of lights, and each user can selectively emit light of one or more colors;
A light classifying unit that identifies the light being emitted in the video acquired by the video acquisition unit and classifies the light according to the color of the light;
A light emitter totalization apparatus comprising: a totalization unit that totalizes the number of lights classified by the light classification unit for each color of light.
A light control unit for remotely operating the light emission state of each of the plurality of lights;
The illuminator counting apparatus according to claim 1, wherein the video acquisition unit acquires video in synchronization with control of the plurality of lights by the light control unit.
The light control unit is capable of executing a reset control for setting the plurality of lights to the same light emission state,
The said image acquisition part acquires the 1st image | video in the state in which the said light control part has turned on reset control, and the 2nd image | video in the state in which the said light control part has turned off reset control. Luminescent totalizer.
A differential image generation unit that generates a differential image between the first video and the second video;
The illuminator totaling apparatus according to claim 3, wherein the light classification unit specifies a light in the difference image generated by the difference image generation unit.
The illuminator counting apparatus according to claim 3 or 4, wherein the video acquisition unit acquires two or more sets of the first video and the second video.
The plurality of lights flash with different flash patterns depending on the color of the light,
The video acquisition unit acquires a moving image including the plurality of lights,
The light classifying unit identifies a flashing light-emitting body that appears in the moving image acquired by the video acquisition unit, and classifies the light being emitted for each color of light based on the specified flashing pattern of the light-emitting body. Item 4. The light emitter aggregation device according to Item 1.
The light classification unit also specifies whether or not a light that exists at a specific position determined in advance among the videos acquired by the video acquisition unit,
The said totaling part totalizes the number of the lights classified by the said light classification | category for every light color, when the light which exists in the said specific position is lit by the said light classification | category part. The light emitter aggregation device according to any one of 1 to 6.
A video acquisition step of acquiring a video including a plurality of lights, each of which can selectively emit light of one or more colors;
A specific step of identifying the light being emitted in the acquired video;
A light classification step for classifying the identified lights by light color;
A luminous body counting method in which a processor executes a counting step of counting the number of classified lights for each color of light.