WO2017212551A1

WO2017212551A1 - Lighting effect device, lighting system, lighting effect method, and lighting effect program

Info

Publication number: WO2017212551A1
Application number: PCT/JP2016/066937
Authority: WO
Inventors: 弘勝川野; 敏貴中井; 井上　純一郎
Original assignee: ＰｉｏｎｅｅｒＤＪ株式会社
Priority date: 2016-06-07
Filing date: 2016-06-07
Publication date: 2017-12-14
Also published as: JPWO2017212551A1

Abstract

This lighting effect device (30) includes: a music information acquisition unit (31) for acquiring music information (SSD) including beat location information (BSD) and a music characteristic value (FSD) from music data (SD); a segment establishment unit (321) for establishing a lighting effect segment in the music data on the basis of the beat location information; a lighting effect presentation unit (324) for presenting lighting effect candidates for the lighting effect segment on the basis of the music characteristic value of the lighting effect segment; and a lighting effect selection unit (325) for selecting any one of the lighting effect candidates via an external operation.

Description

Illumination effect device, illumination system, illumination effect method, and illumination effect program

The present invention relates to an illumination effect device, an illumination system, an illumination effect method, and an illumination effect program.

In concerts and club scenes, lighting corresponding to music or changing lighting in synchronization with music is an important element in production.
In order to obtain a precise effect using lighting corresponding to the music, it is desirable that a dedicated lighting staff who understands the music operate. However, in small concerts, clubs, events, etc., it is difficult to have a dedicated staff stationed due to cost reasons.

On the other hand, automation of lighting corresponding to music has been attempted. For example, in the technique of Patent Document 1 or Patent Document 2, the lighting control data related to the lighting content corresponding to the music is created in advance, and the lighting is controlled based on the lighting control data in synchronization with the music at the time of performance. The desired illumination corresponding to is realized.
In creating the lighting control data, music analysis is performed on the target music data in advance, and it is divided into music blocks (music structure feature sections such as A melody, B melody, rust, etc.), and an image of each block. For example, an illumination pattern suitable for the user is designated.
Furthermore, in patent document 3, the illumination effect is advanced according to the progress degree of a performance with reference to the musical score information of the music performed by the illumination device.

Japanese Patent Laid-Open No. 10-1224078 JP 2010-192155 A JP 2001-195061 A

As described above, by setting the illumination control data in advance, an illumination effect suitable for each block of music can be performed.
However, when playing music for which lighting control data has not been set in advance, or music for which the DJ itself has not grasped the development, lighting effects suitable for each block of the music could not be performed.
On the other hand, if the DJ can set the lighting effect while playing the DJ at the performance site, the lighting effect as intended by the DJ is possible. However, it was difficult for DJs to set lighting effects suitable for music at performance sites where there were many time constraints.
For this reason, it is possible to reduce the burden of prior settings of lighting effects and settings during performances, and even if the person in charge of lighting effects such as DJ does not know the music, it is possible to produce appropriate lighting effects. Technology development was desired.

An object of the present invention is to provide an illumination effect device, an illumination system, an illumination effect method, and an illumination effect program that can easily set an illumination effect suitable for music.

The lighting effect device of the present invention includes a music information acquisition unit that acquires music information including beat position information and music feature amounts from music data, and a section setting for setting an lighting effect section in the music data based on the beat position information. A lighting effect presentation unit that presents a lighting effect candidate for the lighting effect section based on the music feature amount of the lighting effect section, and an illumination effect selection unit that selects one of the lighting effect candidates by an external operation And.

The lighting system of the present invention includes a lighting device and a lighting control device that controls the lighting device, and the lighting control device acquires music information including beat position information and music feature amounts from music data. An acquisition unit, a section setting unit that sets an illumination effect section in the music data based on the beat position information, and an illumination that presents a lighting effect candidate of the illumination effect section based on the music feature amount of the illumination effect section An effect presentation unit and an illumination effect selection unit that selects any one of the illumination effect candidates by an external operation are provided.

In the lighting effect method of the present invention, the computer system acquires music information including beat position information and music feature amount from music data, sets an lighting effect section in the music data based on the beat position information, and the lighting A lighting effect candidate of the lighting effect section is presented based on the music feature amount of the effect section, and one of the lighting effect candidates is selected by an external operation.

The illumination effect program of the present invention is characterized by causing a computer system to function as the above-described illumination effect device of the present invention.

The block diagram which shows one Embodiment of this invention. The schematic diagram which shows the music data and illumination control data of the said embodiment. The schematic diagram which shows the setting of the illumination production area of the said embodiment. The schematic diagram which shows presentation of the illumination effect candidate of the said embodiment.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
FIG. 1 shows an acoustic lighting system 1 for a live space such as a club.
The acoustic lighting system 1 includes a music playback device 10 that performs music playback, a lighting device 20 that performs lighting in a live space, and a lighting control device 30 that controls the lighting device 20.
Among these, the illumination device 20 and the illumination control device 30 correspond to the illumination system of the present invention.

The music playback device 10 includes a general-purpose PC (personal computer) in which music playback software is incorporated, and an acoustic system connected to the PC. In the PC, a playback control unit is configured by music playback software, and music based on the music data SD can be played back in the live space by sending the music data SD stored in the PC as an audio signal to the acoustic system.
The music data SD is supplied to the music playback device 10 via a network communication as well as being supplied to the music playback device 10 by a disk medium or the like.
The music reproducing device 10 is not limited to the PC audio system using the general-purpose PC as described above, but may be a dedicated disk reproducing device or a music data reproducing device.

A user 9 such as a DJ (disc jockey) can be connected to the music playback device 10 with a DJ controller for special playback such as scratching or effect operation. The DJ controller is not limited to an externally connected one, and may be installed in the music playback device 10.

The lighting device 20 performs lighting in a live space or event space, and includes various lighting fixtures that are frequently used as live equipment.
Lighting fixtures are often used for stage lighting, for example, perlite, strobe light, moving head, and the like. In these lighting fixtures, parameters such as irradiation direction and operation speed can be designated by the fixtures in addition to intermittent light projection and brightness.
The content of the lighting operation or lighting state for each lighting fixture specified by these parameters corresponds to the lighting effect of the present invention.

The lighting fixtures of the lighting device 20 are each connected to each other based on the DMX512 standard and based on the standard. Therefore, by setting a desired illumination effect in the illumination control data LD conforming to the same standard and transmitting it to the illumination device 20, it is possible to cause each luminaire to perform an illumination operation with the desired illumination effect.
The DMX512 standard is a general standard in the stage lighting field, but the lighting device 20 and the lighting control device 30 described later are not limited to the same standard, and may be based on other standards.

The illumination control device 30 is configured by incorporating illumination control software into a general-purpose PC (personal computer), an embedded device, or the like.
In addition, when using PC for the illumination control apparatus 30, you may share the same thing as PC used for the music reproduction apparatus 10 mentioned above.

The illumination control device 30 includes a music information acquisition unit 31, an illumination effect unit 32, and an illumination control unit 33 by the above-described illumination control software.
The music information acquisition unit 31 extracts the music information SSD by applying the existing music analysis technology to the music data SD reproduced by the music reproducing device 10.

The music information SSD includes beat position information BSD and music feature amount FSD.
The beat position information BSD is obtained by recording the beat position in the music data SD on the time axis. For example, as shown in the middle part of FIG. Can be obtained by detecting.
The music feature amount FSD is an evaluation value extracted from the music data SD, such as the tonality of the music data SD, the band distribution of the instrument sound, and the degree of fluctuation of the instrument sound, and is a musical feature in each part of the music data SD. Is a value indicating

The following can be referred to for the handling of the music feature amount FSD.
“Estimation of music impression distribution using acoustic features (Eimoto Shiori, Itoyama Katsutoshi, Okunohiro)” (Proceedings of the 76th Annual Conference of Information Processing Society of Japan, March 11, 2014, 391-392, http : //winnie.kuis.kyoto-u.ac.jp/members/okuno/Public/IPSJ76-Emoto.pdf).
“Music Visualization Based on Chord Progression, Meta Information, and Music Feature (Misaki Uehara, Takayuki Ito)” (7th Forum on Data Engineering and Information Management (13th Annual Conference of the Database Society of Japan), March 2, 2015 Announcement, http://db-event.jpn.org/deim2015/paper/85.pdf).

The lighting production unit 32 sets lighting control data LD having a block configuration corresponding to each block (for example, A melody, B melody, rust, etc.) for the music data SD reproduced by the music reproducing device 10, and The user 9 sets a desired lighting effect for each block.

As shown in FIG. 2, in this embodiment, a plurality of blocks SB1 to SBn (music structure feature sections) corresponding to, for example, intro, A melody, B melody, rust, etc. are set in the music data SD.
Corresponding to such blocks SB1 to SBn of the music data SD, a plurality of blocks LB1 to LBn are also set in the illumination control data LD.
Accordingly, by setting an illumination instruction (illumination effect) in each of the blocks LB1 to LBn of the illumination control data LD, illumination suitable for each image is realized for each of the blocks SB1 to SBn of the music data SD. be able to.

The blocks SB1 to SBn (A melody, B melody, etc.) set in the music data SD may be set in advance in the music data SD, may be set by the user 9, or May be automatically set by analyzing the variation of the music feature amount FSD in the music data SD.

Illumination effects set for each block LB1 to LBn of the illumination control data LD include illumination effects (light quantity, color distribution, light direction, projection light shape, light emission area of the illumination device) on the live venue to be illuminated by the illumination device 20 Designation), etc.). The lighting effect can include a temporal change in the lighting effect described above, and can include, for example, a changing speed or a changing curve when a certain lighting state changes to another lighting state.
Such a lighting effect can be realized by controlling lighting operation states (intermittent light projection, brightness, irradiation direction, etc.) in various lighting fixtures equipped in the lighting device 20.

Returning to FIG. 1, the lighting effect unit 32 presents a suitable lighting effect candidate in each of the blocks LB1 to LBn of the illumination control data LD described above, and the user 9 selects one of them to select each of the blocks. Make lighting production easy.
For this purpose, the illumination effect unit 32 includes a section setting unit 321, an illumination effect database 322, an illumination effect candidate setting unit 323, an illumination effect presenting unit 324, an illumination effect selecting unit 325, a display unit 326, and an operation unit 327. .
The display unit 326 can be a PC display device used for the lighting control device 30, and the operation unit 327 can be a pointing device such as a PC mouse or a keyboard used for the lighting control device 30. .

The section setting unit 321 refers to the beat position information BSD acquired by the music information acquisition unit 31, and uses the blocks LB1 to LBn corresponding to the blocks SB1 to SBn of the music data SD as the lighting effect section as the lighting control data LD. Assign to.
As shown in FIG. 3, if the music data SD includes a block SB2 (A melody) and a block SB3 (B melody), the section setting unit 321 refers to the beat position information BSD and the block SB2 (A melody). The time axis position of the joint SP3 with the block SB3 (B melody) is determined. Then, the block LB2 (A melody lighting effect section 2) and the block SB3 (B melody lighting effect section 3) connected by the joint LP3 are allocated to the lighting control data LD.
In this way, by assigning the illumination effect section to the illumination control data LD with reference to the beat position information BSD, the music data SD and the illumination control data LD can be synchronized with high accuracy.

The illumination effect database 322 records preset patterns of illumination effects that can be used in the illumination effect sections (blocks LB1 to LBn) of the illumination control data LD for each pattern of the music feature amount FSD.
For example, based on the music feature amount FSD, if it is “dark music tone, BPM (beats per minute) is slow, A melody part of music”, “background is dark blue, ceiling is off” or “early” In the case of “bright rust”, many lighting effects such as “maximum ceiling brightness” are recorded.

The music feature quantity FSD that is a key for the lighting effect includes the tempo, tonality, color listening of the music in the lighting effect section, the function of the lighting effect section in the music data (A melody or rust, 4 degree chord continuous part, etc.) ) Is available.
Of these, for example, “Ryu Takahashi, Takashi Fujisawa, Noriko Nagata, Takeshi Sugio, Seiji Iguchi (2006). Measurement of synesthesia with fMRI-Brain activity of color listeners when listening to music-. Information Processing Society of Japan Research Report 2006-MUS-66, 2006 (90), 105-108. ", Http://ist.ksc.kwansei.ac.jp/~nagata/synesthesia/research/SIGMUS_66_17.pdf.

The setting of the pattern in the lighting effect database 322 largely depends on the personal subjectivity, and may be set according to a specific personal preference.
For example, the DJ as the user 9 may load a file in which his / her favorite lighting effect pattern is recorded into the lighting effect unit 32 as the lighting effect database 322.
Moreover, you may distribute the illumination production pattern file by a well-known lighting designer on a package or a network.

The illumination effect candidate setting unit 323 selects a pattern suitable as an illumination effect as one or a plurality of candidates for each of the illumination effect sections (blocks LB1 to LBn) of the illumination control data LD. As a suitable pattern, the lighting effect candidate setting unit 323 searches for the lighting effect pattern recorded in the lighting effect database 322 based on the music feature value FSD acquired by the music information acquisition unit 31, and the music feature value FSD is applicable. Select one or more to do.

The illumination effect presentation unit 324 displays the illumination effect pattern candidate (illumination effect candidate) selected by the illumination effect candidate setting unit 323 on the display unit 326 and presents it to the user 9.
The presentation of illumination effect pattern candidates is performed individually in each of the illumination effect sections (blocks LB1 to LBn) of the illumination control data LD.
The lighting effect selection unit 325 designates one of the lighting effect candidates when the user 9 operates the operation unit 327 with respect to the lighting effect candidate displayed on the display unit 326 by the lighting effect presentation unit 324.

The operations of the illumination effect candidate setting unit 323, the illumination effect presenting unit 324, and the illumination effect selecting unit 325 are as follows.
As shown in FIG. 4, the block SB2 (A melody) and the block SB3 (B melody) of the music data SD are displayed on the display screen of the display unit 326, and the illumination effect section 2 of the illumination control data LD is below it. It is assumed that the block LB2 (A melody illumination) and the block LB3 (B melody illumination) that is the illumination effect section 3 are displayed.

When the user 9 selects the block LB2 (A melody lighting) that is the lighting effect section 2 (for example, by the pointer Pt), the lighting effect candidate setting unit 323 selects the music feature amount FSD2 of the block SB2 corresponding to the block LB2. By searching the lighting effect database 322, a plurality of lighting effect candidates CLD2 (for example, lighting effect 2-1, lighting effect 2-2, and lighting effect 2-3) are set.
The illumination effect candidate list CLD2 displays the illumination effect candidate list LLD2 of the illumination effect section 2 in the form of a window that is zoomed up from the block LB2 (A melody illumination), for example, by the illumination effect presentation unit 324.

When the user 9 moves the pointer Pt and designates one of the lighting effect candidates CLD2 (for example, lighting effect 2-2), the lighting effect selection unit 325 causes the lighting effect of “illumination effect 2-2” to be block LB2. (A melody illumination) is set.
Thus, the user 9 sets the lighting effect of the block LB2 (A melody lighting) only by a simple operation of designating one of the plurality of lighting effect candidates CLD2 presented in the lighting effect candidate list LLD2. be able to.
At this time, the plurality of lighting effect candidates CLD2 presented in the lighting effect candidate list LLD2 are selected in advance based on the music feature amount FSD2 of the block SB2 (A melody) corresponding to the block LB2 (A melody lighting). . For this reason, even if any candidate is designated, it can be set as the illumination effect of block LB2 (A melody lighting) suitable for block SB2 (A melody).

In order to assist the selection of the user 9, the plurality of illumination effect candidates CLD2 presented in the illumination effect candidate list LLD2 display the illumination state inside the box-shaped display block, or illuminate with another window. The state may be reproduced on the screen.

Similarly, for the block LB3 (B melody lighting) which is the lighting effect section 3, the user 9 has a plurality of lighting effect candidates CLD3 (for example, lighting effect 3-1 and lighting effect 3) presented in the lighting effect candidate list LLD3. -2 and the lighting effect 3-3) can be selected and specified to set in the block LB3.

If the lighting effects can be set in all the lighting effects sections (blocks LB1 to LBn) of the lighting control data LD by presenting and specifying such lighting effects candidates, the creation of the lighting control data LD is thereby completed. .
A specific lighting effect is set in advance in all lighting effect sections (blocks LB1 to LBn) of the lighting control data LD (default setting), and the user 9 selects only an arbitrary lighting effect section from candidates. You may make it replace.

The illumination control unit 33 controls the illumination device 20 based on the illumination control data LD created by the illumination effect unit 32, and realizes the illumination effect set in the illumination control data LD.
Among the illumination control devices 30 described above, the illumination effect unit 32 corresponds to the illumination effect device of the present invention. In order to configure the illumination effect unit 32, the illumination control software includes the illumination effect program of the present invention.

As described above, according to the present embodiment, the following effects can be obtained.
In the lighting effect unit 32, the blocks LB1 to LBn corresponding to the blocks SB1 to SBn of the music data SD can be assigned to the lighting control data LD as lighting effect sections.
When assigning each block LB1 to LBn to the illumination control data LD, the section setting unit 321 refers to the beat position information BSD acquired by the music information acquisition unit 31, and therefore, accurate illumination corresponding to the beat position of the music data SD A production section can be set.

In each of the blocks LB1 to LBn, which are illumination effect sections, an appropriate illumination effect can be set with a simple operation by the illumination effect candidate setting unit 323, the illumination effect presenting unit 324, and the illumination effect selecting unit 325.
In particular, the lighting effect candidate setting unit 323 can set an appropriate lighting effect and select a candidate in order to select an illumination effect candidate only for the lighting effect according to the music feature amount FSD acquired by the music information acquisition unit 31. Can be easily.

Since the lighting effect candidates are recorded in advance in the lighting effect database 322 with a large number of lighting effect patterns using the music feature amount FSD as a key, an appropriate lighting effect candidate can be easily set by designating the music feature amount FSD. can do.
In particular, since the music tempo, tonality, color listening, and the function of the lighting effect section in the music data are used as the music feature amount FSD, the lighting effect corresponding to the corresponding section of the music is selected with high accuracy. Can do.

By using such an illumination production unit 32, according to the present embodiment, when the DJ who is the user 9 plays a music that has not been set in advance, the illumination suitable for the music is being played. An effect can be obtained. Further, when the DJ processes the music, it is possible to obtain an illumination effect suitable for the effect intended for the processing.
In addition, since the setting of the lighting effect for the lighting effect section may be an operation of presenting the lighting effect candidate or designation by the user 9, the DJ sets the lighting effect suitable for the music even in a performance site where there are many time restrictions. Can be easily done.

The present invention is not limited to the above-described embodiment, and modifications and the like within a scope in which the object of the present invention can be achieved are included in the present invention.
For example, the music feature amount may be any one of the function of the lighting effect section in the lighting effect section in the lighting effect section, or any other music feature value of the item described above. May be added.
In addition, the recording format of the lighting effect database 322 can be selected as appropriate. In addition to the set of the music feature quantity and the lighting effect pattern as search conditions, other narrowing conditions such as “brightening effect” and “quiet effect” May be added, and lighting effects including emphasis such as “Osaka style” or “Anime character style” may be selected.
Furthermore, the lighting effects may include lighting effects such as light and darkness, color, and blinking by the lighting device, effects that can be regarded as video effects, and projected images (still images and moving images).

DESCRIPTION OF SYMBOLS 1 ... Acoustic illumination system, 10 ... Music reproduction apparatus, 2 ... Illumination production area, 20 ... Illumination apparatus, 3 ... Illumination production area, 30 ... Illumination control apparatus, 31 ... Music information acquisition part, 32 ... Illumination production part, 321 ... Section setting unit, 322 ... Illumination effect database, 323 ... Illumination effect candidate setting unit, 324 ... Illumination effect presentation unit, 325 ... Illumination effect selection unit, 326 ... Display unit, 327 ... Operation unit, 33 ... Illumination control unit, 9 ... User, BSD ... Beat position information, CLD2 ... Lighting effect candidate, FSD, FSD2 ... Music feature amount, LB1, LB2, LB3, LBn ... Block that is a lighting effect section, LD ... Lighting control data, LLD2, LLD3 ... Lighting effect candidate List, LP3 ... Seam, Pt ... Pointer, SB1, SB2, SB3, SBn ... Block that is a music structure feature section, SD ... Music data, SP3 ... Join , SSD ... music information.

Claims

A music information acquisition unit that acquires music information including beat position information and music features from music data;
A section setting unit that sets an illumination effect section in the music data based on the beat position information;
An illumination effect presentation unit for presenting illumination effect candidates for the illumination effect section based on the music feature amount of the illumination effect section;
An illumination production apparatus comprising: an illumination production selection unit that selects any one of the illumination production candidates by an external operation.
In the lighting effect device according to claim 1,
The lighting effect candidate is set as the music feature amount with reference to any of the tempo, tonality, color listening, and function of the lighting effect section in the music data as the lighting effect section. Production device.
In the lighting effect device according to claim 1 or 2,
A display unit for displaying the lighting effect candidates;
And an operation unit capable of designating any one of the illumination effect candidates displayed on the display unit.
A lighting device and a lighting control device for controlling the lighting device;
The lighting control device is
A music information acquisition unit that acquires music information including beat position information and music features from music data;
A section setting unit that sets an illumination effect section in the music data based on the beat position information;
An illumination effect presentation unit for presenting illumination effect candidates for the illumination effect section based on the music feature amount of the illumination effect section;
An illumination system comprising: an illumination effect selection unit that selects any one of the illumination effect candidates by an external operation.
The computer system acquires music information including beat position information and music features from the music data,
Based on the beat position information, set the lighting effect section in the music data,
Presenting the lighting effect candidate of the lighting effect section based on the music feature amount of the lighting effect section,
One of the lighting effects candidates is selected by an external operation.
An illumination effect program for causing a computer system to function as the illumination effect device according to any one of claims 1 to 3.