WO2022054618A1

WO2022054618A1 - Illumination control system, illumination control method, and program

Info

Publication number: WO2022054618A1
Application number: PCT/JP2021/031658
Authority: WO
Inventors: 笑竹本; 容子松林; 万里川村
Original assignee: パナソニックＩｐマネジメント株式会社
Priority date: 2020-09-11
Filing date: 2021-08-30
Publication date: 2022-03-17
Also published as: CN115956399A; JP7482442B2; JP2022046959A

Abstract

This illumination control system (200) is for controlling a light source, and is provided with: a musical composition acquisition unit (92) which acquires a musical composition; a musical composition analysis unit (93) which analyzes the acquired musical composition and extracts volume variations and pitch variations in the musical composition in chronological order; and an illumination control unit (94) which controls the light emitting mode of the light source in such a manner as to cause the brightness to vary in accordance with the extracted volume variations and to cause the excitation purity to vary in accordance with the extracted pitch variations.

Description

Lighting control system, lighting control method, and program

The present disclosure relates to a lighting control system for operating a lighting device and a lighting control method.

A light source (or light source module) capable of dimming and toning is known. For example, Patent Document 1 discloses a lighting system that emits light for producing a space by using a light source as described above.

Japanese Unexamined Patent Publication No. 2020-64743

By the way, the reproduction of music may be combined with the production of space, and it is desired that the music to be reproduced and the lighting production by the lighting device are appropriately linked.

Therefore, an object of the present disclosure is to provide a lighting control system or the like capable of producing a lighting effect that is appropriately linked to the music to be played.

In order to achieve the above object, the lighting control system according to one aspect of the present disclosure is a lighting control system that controls a light source, and is a music acquisition unit that acquires music and analyzes the acquired music in a time series. The music analysis unit that extracts the volume change and the pitch change of the music in the above, the brightness changes according to the extracted volume change, and the stimulus purity changes according to the extracted sound pitch change. As described above, the lighting control unit for controlling the light emission mode of the light source is provided.

Further, the lighting control method according to one aspect of the present disclosure includes an acquisition step of acquiring a musical piece and an analysis step of analyzing the acquired musical piece and extracting a volume change and a pitch change of the musical piece in a time series. A control step of controlling the light emission mode of the light source so that the brightness changes according to the extracted volume change and the stimulus purity changes according to the extracted pitch change.

Further, one aspect of the present disclosure can also be realized as a program for causing a computer to execute the lighting control method described above.

According to this disclosure, it is possible to produce lighting that is appropriately linked to the music to be played.

FIG. 1 is an overview view showing a usage example of the lighting control system according to the embodiment. FIG. 2 is a block diagram showing a functional configuration of the lighting control system according to the embodiment. FIG. 3 is a flowchart showing the operation of the lighting control system according to the embodiment. FIG. 4 is a diagram illustrating the adjustment of brightness in the lighting control system according to the embodiment. FIG. 5 is a graph showing the optimum control beat number for the genre of the music based on the user's subjectivity. FIG. 6 is a diagram illustrating a hue angle controlled by the illumination control unit according to the embodiment. FIG. 7 is a diagram illustrating a pitch change extracted by the music analysis unit according to the embodiment. FIG. 8 is a diagram illustrating the stimulus purity controlled by the lighting control unit according to the embodiment.

(Embodiment)
Hereinafter, the lighting control system and the like according to the embodiment of the present disclosure will be described in detail with reference to the drawings. It should be noted that all of the embodiments described below show a specific example of the present disclosure. Therefore, the numerical values, shapes, materials, components, arrangement and connection forms of components, steps, order of steps, etc. shown in the following embodiments are examples, and are not intended to limit the present disclosure. Therefore, among the components according to the following embodiments, the components not described in the independent claims are described as arbitrary components.

Also, each figure is a schematic diagram and is not necessarily exactly illustrated. Therefore, for example, the scales and the like do not always match in each figure. Further, in each figure, substantially the same configuration is designated by the same reference numeral, and duplicate description will be omitted or simplified.

[Overview]
First, an outline of the lighting control system according to the present embodiment will be described with reference to FIG. FIG. 1 is an overview view showing a usage example of the lighting control system according to the embodiment. The lighting control system 200 according to the present embodiment controls the first lighting device 110a to the fourth lighting device 110d installed in a predetermined space such as the home of the user 99. At this time, the lighting control system 200 adjusts the light emitted from the first lighting device 110a to the fourth lighting device 110d according to the music played by the user 99 in the space. As a result, the sound and the light are appropriately harmonized to produce a space, so that the user 99 can spend comfortably without having a negative sensation such as discomfort and discomfort.

In the lighting control system 200 according to the present embodiment, first, the user 99 operates the terminal device 98 to select a musical piece to be played in the space. The terminal device 98 is an information processing device such as a smartphone, a tablet terminal, and a computer owned by the user 99. In the terminal device 98, a control signal indicating how to adjust the light emitted from the first lighting device 110a to the fourth lighting device 110d or the like according to the music selected by the user 99 is generated, and the first Output to each of the 1 lighting device 110a to the 4th lighting device 110d. Further, the terminal device 98 generates a playback control signal for playing the selected music and outputs the playback control signal to the playback device 120 such as an audio system.

The playback device 120 acquires the playback control signal and starts playing the music. Further, each of the first lighting device 110a to the fourth lighting device 110d adjusts the emitted light together with the reproduction of the music. In this way, the reproduction of the music and the adjustment of the light are linked to produce a space.

The reproduction device 120 here has a functional unit that processes a reproduction control signal, a functional unit that amplifies the processed reproduction control signal to generate a sufficient output signal, and a diaphragm vibrates according to the output signal. This is an audio component system in which the functional unit that generates sound waves is configured as a separate component. Further, as the reproduction device 120, the above-mentioned functional units provided in the terminal device 98 may be used, that is, the reproduction device 120 may be integrally configured with the terminal device 98.

Further, the lighting device here may include a downlight that irradiates light having directivity downward from the ceiling portion, for example, such as the first lighting device 110a. Further, the lighting device may include a wall surface lighting device such as the second lighting device 110b, which indirectly irradiates the space with light by using the wall surface. Further, the lighting device may include a ceiling light that irradiates light diffused from the ceiling portion toward the entire space, for example, as in the third lighting device 110c. Further, the lighting device may include, for example, a pendant light suspended from a ceiling or the like at a predetermined height to locally illuminate the space, such as the fourth lighting device 110d. As described above, as the lighting device, for example, all types of lighting devices including the above four types are used in combination. The number of lighting devices to be installed is not particularly limited, and the contents of the present disclosure can be implemented even if the configuration includes only one third lighting device 110c, for example. Hereinafter, when it is not necessary to use the plurality of lighting devices properly, the lighting device 110 (for example, see FIG. 2) may be simply referred to.

Next, with reference to FIG. 2, each function of the lighting control system 200 will be described in more detail. FIG. 2 is a block diagram showing a functional configuration of the lighting control system according to the embodiment. As shown in FIG. 2, the lighting control system 200 according to the present embodiment includes a terminal device 98, a reproduction device 120, a controller 112, and a lighting device 110.

As described above, the terminal device 98 is an information processing device such as a smartphone owned by the user 99, and includes a processor, a memory, an interface module, and a communication module (not shown). Further, the terminal device 98 includes a reception unit 91, a music acquisition unit 92, a music analysis unit 93, a lighting control unit 94, and a reproduction control unit 95.

The reception unit 91 is a functional unit that receives an input to the terminal device 98 by the user 99, that is, an input to the lighting control system 200. The reception unit 91 is realized by using a processor and a memory. Specifically, the reception unit 91 transmits an operation for input by the user 99 signalized by the interface module to each of the other functional units by executing a predetermined program using the processor and the memory. .. Inputs to the lighting control system 200 by the user 99 include, for example, setting parameters related to the operation of the lighting control system 200, adding and deleting the lighting device 110 or the playback device 120 to the lighting control system 200, and selecting music to be played. Etc. are included.

The music acquisition unit 92 is a functional unit that acquires music to be played in space. The music acquisition unit 92 is realized by using a processor and a memory. Specifically, the music acquisition unit 92 reads out the electronic file of the music stored in the memory or an external storage device and converts it into a playable format by executing a predetermined program using the processor and the memory. Perform processing, etc. Further, the music acquisition unit 92 may acquire an electronic file of music distributed via a wide area communication network such as the Internet by using a communication module. As the music, in addition to using the above electronic file, music recorded as analog information by magnetism or uneven surface may be used.

The music analysis unit 93 is a functional unit that analyzes the acquired music. The music analysis unit 93 is realized by using a processor and a memory. Specifically, the music analysis unit 93 extracts a time-series volume change (or sound pressure change) and pitch change from the music by executing a predetermined program using the processor and the memory. Further, the music analysis unit 93 extracts a plurality of beat positions arranged in a time series in the music by executing the analysis program using the processor and the memory. Although the details will be described later, the volume change, the pitch change, and the plurality of beat positions extracted by the music analysis unit 93 are used for adjusting the light emitted from the lighting device 110.

The lighting control unit 94 is a functional unit for controlling the light emission mode of the light source included in each lighting device 110 so that the reproduced music and the emitted light are appropriately harmonized. The lighting control unit 94 is realized by using a processor and a memory. Specifically, the lighting control unit 94 executes a predetermined program using the processor and the memory, so that the brightness changes according to the extracted volume change and the extracted pitch change. A control signal for controlling the lighting device 110 so that the stimulus purity changes is generated. The lighting control unit 94 transmits a control signal generated via a communication module or the like to the lighting device 110, so that the brightness changes from the lighting device 110 according to the volume change, and the stimulation purity changes according to the pitch change. Can emit light that changes. The stimulus purity is a value defined by JIS Z 8113 No. 03073.

The reproduction control unit 95 is a functional unit that reproduces the acquired music in synchronization with the adjustment of the light emitted from the lighting device 110. The reproduction control unit 95 is realized by using a processor and a memory. Specifically, the reproduction control unit 95 executes a predetermined program using a processor and a memory to transmit the reproduction control signal of the acquired music to the reproduction device 120 with a delay or the like, and to the reproduction device 120. Play the song. For example, it is based on the timing at which the control signal is output from the lighting control unit 94 and the actual output depending on the communication time between the lighting device 110 and the terminal device 98 and the processing time required for the internal processing of the lighting device 110. There may be an error with the timing at which the light is emitted. On the other hand, since the same error may occur in the reproduction device 120, the reproduction control unit 95 adjusts these errors to synchronize the sound output by the reproduction device 120 with the light emission by the lighting device 110. ..

The terminal device 98 may be equipped with a microphone and an image pickup device. In this case, even if the reproduction control unit 95 updates the set delay time by collecting the sound output by the reproduction device 120 by the microphone and receiving the light emitted by the lighting device 110 by the image pickup device. good. As a result, the sound output by the reproduction device 120 and the light emission by the lighting device 110 can be more precisely synchronized.

The playback device 120 is an audio component system as described above. The reproduction device 120 receives the reproduction control signal from the reproduction control unit 95, and reproduces the music based on the reproduction control signal.

The controller 112 is a device that collectively controls a plurality of lighting devices when the lighting device 110 is composed of a plurality of lighting devices as in this example. As shown in the figure, since the plurality of lighting devices 110 are connected to the controller 112, the terminal device 98 can be connected to the plurality of lighting devices 110 via the controller 112. Further, the controller 112 may be connected to yet another controller. In this way, by connecting the lighting device 110 via one or more controllers 112, the degree of freedom in the configuration of the lighting device 110 is improved. The controller 112 is not an essential configuration. For example, the terminal device 98 may be directly connected to each of the plurality of lighting devices 110.

In this example, the lighting device 110 is composed of a plurality of lighting devices including the first lighting device 110a and the second lighting device 110b. The first lighting device 110a has a first light source 111a (or a first light source module). When the first lighting device 110a receives a control signal from the lighting control unit 94 via the controller 112, the first light source 111a emits light in a light emitting mode according to the received control signal and emits light. The second lighting device 110b has a second light source 111b (or a second light source module). When the second lighting device 110b receives a control signal from the lighting control unit 94 via the controller 112, the second light source 111b emits light in a light emitting mode according to the received control signal and emits light. The light source including the first light source 111a and the second light source 111b according to the present embodiment is configured to be capable of dimming and toning.

[motion]
Hereinafter, the operation of the lighting control system 200 having the configuration described above will be described with reference to FIG. FIG. 3 is a flowchart showing the operation of the lighting control system according to the embodiment. As shown in FIG. 3, in the lighting control system 200 of the present embodiment, the music acquisition unit 92 first acquires the music (acquisition step S101). The acquired music is subjected to necessary processing (for example, decoding of an encoded file) in the music acquisition unit 92 and output to the music analysis unit 93.

In parallel with the above, the music to which the necessary processing has been performed is output to the playback control unit 95. When the reproduction control unit 95 outputs the music to the reproduction apparatus 120 in an analog manner, the reproduction control unit 95 performs a process of converting the music into an analog signal, and outputs the converted signal as the reproduction control signal. Further, when the reproduction control unit 95 outputs the music to the reproduction device 120 in a wireless manner, the reproduction control unit 95 performs a process of encoding the music into a format for wireless communication, and outputs the encoded signal as the reproduction control signal. ..

The music output to the music analysis unit 93 is analyzed (analysis step S102), and various feature quantities are extracted by this analysis. The feature amount means a change in volume, a change in pitch, a plurality of beat positions, and the like of the music described above. Further, the feature amount may include other feature amounts. Other feature quantities will be described later together with a more detailed description of the operations of the music analysis unit 93 and the lighting control unit 94.

The feature amount of the music extracted by the analysis is output to the lighting control unit 94. The lighting control unit 94 acquires the feature amount of the music and generates a lighting control signal based on the feature amount (step S103). The lighting control unit 94 outputs the generated control signal to the lighting device 110. As a result, the lighting device 110 acquires a control signal, changes the light emission mode of the light source according to the control signal, and emits light. In this way, it is possible to control the lighting device 110 according to the feature amount of the music (step S104), that is, to produce lighting appropriately linked to the music to be reproduced. In addition, step S103 and step S104 may be collectively referred to as a control step.

Next, the details of the control steps in the lighting control system of the present embodiment will be described with reference to FIGS. 4 to 8. FIG. 4 is a diagram illustrating the adjustment of brightness in the lighting control system according to the embodiment. In FIG. 4, a graph showing the volume of the music changing along the time series is shown on the upper side, and a graph showing the brightness of the lighting device 110 changing along the corresponding time series is shown on the lower side.

As shown in FIG. 4, in the present embodiment, the brightness of the light emitted from the lighting device 110 changes according to the change in the volume of the music. More specifically, in the lighting control system 200, the lighting device 110 is controlled so that the louder the volume of the music, the higher the brightness of the light source (that is, the brightness of the light emitted from the lighting device 110). Similarly, in the lighting control system 200, the lighting device 110 is controlled so that the lower the volume of the music, the lower the brightness of the light source.

Further, as shown in FIG. 4, the change in the brightness of the light source is performed based on the beat position of the music indicated by the white arrow in the figure. For example, the lighting control unit 94 calculates the first brightness according to the average value (first average value) of the volume from the first beat position, which is the earliest beat position in the time series, to the next second beat position. , This first brightness is set to the brightness of the light source at the time corresponding to the first beat position. Similarly, the lighting control unit 94 calculates the second brightness according to the average value (second average value) of the volume from the second beat position to the next third beat position, and uses this second average value as the second average value. Set the brightness of the light source at the time corresponding to the 2-beat position. Here, the illumination control unit 94 changes the brightness of the period between the first beat position and the second beat position so as to connect the first brightness and the second brightness in a curved line. More specifically, the illumination control unit 94 exponentially converts the brightness of the period between the first beat position and the second beat position into the virtual brightness that linearly connects the first brightness and the second brightness. The emission mode of the light source is controlled as the obtained brightness.

At this time, the conversion is performed as an exponential function that increases from one side to the other side of the lower brightness of the first brightness and the second brightness. This is based on Weber-Fechner's law that the amount of human perception is logarithmically proportional to the amount of stimulus. Therefore, by this conversion process, the user 99 who sees the light source can perceive it as if it changes linearly between the first luminance and the second luminance.

By sequentially performing the above processing for each of a plurality of consecutive beat positions and for each period between the beat positions, the volume of the music and the light emitted from the lighting device 110 are linked without any discomfort. Will change.

Here, in the period between the last beat position and the previous beat position shown in the figure, the period is divided into three, and each divided small period (that is, the position between the beat position and the beat position due to the division) is divided into three. The brightness corresponding to the calculated average value is used for (between the consecutive positions). In this way, by further subdividing the period between the beat positions according to the number of divisions (here, 3), while maintaining a natural interlocking between the volume of the music and the light emitted from the lighting device 110, It is possible to produce a more dynamic feeling for the user 99. On the other hand, when a gentler effect is desired, the average value of the period from the beat position to the beat position after the next beat position is calculated, and the brightness corresponding to the calculated average value is used. It is also possible to emit light that changes gently. This is a number of divisions smaller than 1 when considered as the number of divisions described above.

In this way, the number of divisions of the beat position (hereinafter, also referred to as the control beat number) that determines the average value calculation period when controlling the brightness of the light source may be determined by, for example, the attributes of the music classified by genre or the like. good.

FIG. 5 is a graph showing the optimum control beat number for the genre of the music based on the user's subjectivity. FIG. 5 shows a graph averaging the control beats that the subject appropriately feels when playing music classified into five genres for a plurality of subjects. As shown in the figure, relatively high control beats are suitable for songs in the rock and pop genres. On the other hand, relatively low control beats are suitable for classical and relaxation genres of music.

As described above, when the lighting control unit 94 has an optimum control beat for each attribute of the music such as the genre of the music, the lighting control unit 94 controls the lighting device 110 so that the brightness of the light source changes according to the control beat. May be good. The attributes of the music may be acquired, for example, by referring to the information attached to the electronic data of the music, or by the analysis of the music, for example, the BPM, the amount of change in the volume per minute time, and the like. It may be estimated based on.

Further, the range of change in the brightness of the light may be expanded by the attributes of such a musical piece. That is, a numerical value obtained by setting a reference value for brightness, multiplying the difference from the reference value by a predetermined coefficient, and adding the reference value again may be used as the brightness of the light emitted from the lighting device 110. Here, the lighting control unit 94 determines the above-mentioned predetermined coefficient to a value larger than 1 in the case of a music classified into, for example, a rock or pop genre, according to the attributes of the music, and is used for classic or relaxation. If the music is classified into a genre, the above coefficient is determined to be less than 1. In this way, the lighting control unit 94 determines the change width indicating the change range of the brightness based on the attribute of the music, and emits light from the light source so that the brightness changes within the change range according to the volume change. The aspect may be controlled.

Similarly, the range of change in the hue of light may be determined by the attributes of such a musical piece. That is, the lighting control unit 94 determines the hue angle indicating the range in which the hue can be changed based on the attributes of the music, and for example, the hue is within the range indicated by the hue angle with reference to a predetermined reference color. The light emission mode of the light source is controlled so as to change. FIG. 6 is a diagram illustrating a hue angle controlled by the illumination control unit according to the embodiment. In FIG. 6, the range of the change width on the u'v'chromaticity coordinates is indicated by the area with dot hatching. Further, the broken line shown by the white arrow in the figure indicates the hue of the above-mentioned reference color.

Here, when the origin is the equal energy white point (u'= 0.2104, v'= 0.4735), the angle passing through the origin and forming with the hue of the above reference color is within a predetermined angle range. The region is shown as the range of variation. This predetermined angle corresponds to the above-mentioned hue angle. Here, for one hue angle, there is a change between a region where the angle formed in the positive direction with respect to the reference color satisfies the range of the hue angle and the region where the angle formed in the negative direction with respect to the reference color satisfies the range of the hue angle. It is in the range of width. In this way, the illumination control unit 94 changes the hue within the range of the region having a spread at an angle of 2 × hue angle. Here, the change in hue may be changed to a random hue within the range of the change width, or may be continuously changed from one end to the other end.

Further, similarly to the above, the change width of this hue may be determined depending on the attribute of the music. That is, the lighting control unit 94 may determine the hue angle based on the attribute of the music, and control the light emission mode of the light source so that the hue formed by the angle with the reference color changes within the range of the hue angle. .. For example, in the case of music classified into the rock and pop genres, the hue angle is set to 180 degrees, and light of any hue is emitted from the lighting device 110. On the other hand, for example, in the case of music classified into the genres of classical music and relaxation, the hue angle is set to 25 degrees. This 25 degree numerical value is based on Moon & Spencer's theory of color harmony, that is, the hue in the range of the hue angle of 25 degrees or less is perceived by the user 99 as the same color or a similar color. As a result, even if the hue of the emitted light changes, the change is less likely to be perceived by the user 99, and a gentle effect can be achieved.

The reference color may be determined in advance by the lighting control unit 94, or may be accepted by the input of the user 99. In the latter case, the user 99 receives the reference color determined by the input of the user 99 by inputting the reception unit 91 to specify the reference color in advance when operating the lighting control system 200. In the lighting control system 200, the lighting control unit 94 changes the hue based on the received reference color.

The input to the reception unit 91 by the user 99 is configured such that the user 99 selects an arbitrary reference color on the chromaticity coordinates as shown in FIG. 6 displayed on the display or the like of the terminal device 98, for example. Further, the user 99 may accept the reference color by designating the situation in which the lighting control system 200 wants to produce the space. For example, the situation is stored in a storage unit or the like as situation information in a one-to-one correspondence with the hue. As a combination of situations and hues, for example, a combination of a natural landscape such as forest and green, a sea and blue, a sunset and vermilion and the image color of the natural landscape, or an event such as a home party and orange and the image color of the event. Combinations and the like are prepared. By selecting one of such situation information, the user 99 receives the hue associated with the situation information as a reference color in the reception unit 91. The situation information may be created by the user 99.

Further, the playlist of the music may be associated with such situation information. As a result, the user 99 only selects one situation information, starts playing the music according to the playlist shown in the situation information, and emits light controlled using the hue shown in the situation information as a reference color. It can be emitted.

Further, in the present embodiment, a plurality of lighting devices 110 are controlled at the same time. Here, the music to be played is composed of, for example, playing the sounds of the parts assigned to each of a plurality of types of musical instruments. In this case, the lighting control unit 94 may assign a performance part by a plurality of types of musical instruments to each of the plurality of lighting devices 110, and individually control the emitted light. That is, the first light source 111a of the first lighting device 110a emits light so as to be linked to the sound of the instrument playing the first part of the music, and the second light source 111b of the second lighting device 110b is the second part of the music. Lights up in conjunction with the sound of the playing instrument.

Further, when a plurality of lighting devices 110 are to be controlled in this way, further, a plurality of types of musical instruments are assigned to each of the plurality of lighting devices 110, and the emitted light is individually controlled. May be good. Further, any existing technique may be used for the identification of such a plurality of types of musical instruments. For example, when the electronic data of a musical piece is composed of a set of sound sources divided into a plurality of types of musical instruments, the sounds of the individual musical instruments may be extracted by decomposing these sets. In addition, after obtaining the volume change for each frequency along the time series by Fourier transforming the sound of the music by analyzing the music, the volume change is analyzed by the trained machine learning model to obtain the sound of each instrument. It may be extracted. Further, a multidimensional normal distribution may be applied to the volume change for each frequency to identify and extract the sound of each musical instrument.

Also, by applying a median filter to the volume change for each frequency in the time domain, a percussive sound (that is, the sound of a percussion instrument) is extracted, and by applying a median filter to the volume change for each frequency in the frequency domain, a harmonic sound is produced. (That is, the sound of a harmonic instrument) may be extracted. When one lighting device 110 is a type of lighting device having a plurality of light source units (that is, a first light source 111a and a second light source 111b), one lighting device can control the emitted light for each of the above light sources. Is.

Further, according to the frequency analysis as described above, it is possible to obtain a change in the pitch of the music. FIG. 7 is a diagram illustrating a pitch change extracted by the music analysis unit according to the embodiment. FIG. 7A is a diagram showing a volume change for each frequency as a result of Fourier transforming the music. Further, FIG. 7B is a diagram in which the volume change for each frequency is distributed to each pitch class based on the conversion result shown in FIG. 7A. In addition, in FIG. 7A and FIG. 7B, it is shown that the darker the color, the louder the sound.

The pitch class here corresponds to each note name of the scale that composes the music. The note name is defined by the stepwise pitch height of multiple types of note names that make up a scale of one octave or more, and each note name corresponds to a stimulus purity value whose size is stepwise different. ..

Therefore, the lighting control unit 94 changes the stimulation purity value of the light emitted from the lighting device 110 according to the change of the note name along the time series of the music. As shown in FIG. 7 (b), sounds with a plurality of note names are sounding at each time point in the time series. At this time, at that time point, the sound with the most major note name is adopted, and at each time point, the sound with one note name corresponds to one value of stimulus purity. As described above, in the present embodiment, the pitch change is made by a discrete change in which the note name changes along the time series. Each note name is assigned a stepwise different stimulus purity value. Therefore, the lighting control unit 94 controls the lighting device 110 so as to have a corresponding stimulus purity value according to the note name that changes with time series.

Here, the range of the stimulus purity value assigned to each note name will be described. FIG. 8 is a diagram illustrating the stimulus purity controlled by the lighting control unit according to the embodiment. In FIG. 8, the xy chromaticity coordinates are shown, and a white light color region such as white defined by JIS Z8110 is shown by dot hatching. For example, when the light in this white region is emitted while the stimulus purity is changed by the illumination control unit 94, the opposite color of the light emitted immediately before may be visually recognized by the user 99. The sudden appearance of the opposite color may cause a sense of discomfort for the user 99, for example, when performing a gentle effect, which is not preferable. Therefore, in the present embodiment, the stimulus purity is changed within the range excluding the above white region.

For example, the lighting control unit 94 controls so that only the stimulus purity outside the white region indicated by the white double-headed arrow in the figure is emitted from the lighting device 110. As a result, the appearance of the opposite color as described above does not occur, so that an appropriate effect can be produced without giving a sense of discomfort to the user 99. The range of change in stimulus purity can be arbitrarily set as long as it is outside the white region. That is, as illustrated in the figure, the change width may be a change width that covers the entire area outside the white region, or may be a change width that covers only a part outside the white region. Since this white region is a region visually recognized by the user 99 as the same color as the equal energy white point, it can be specified by calculating the MacAdam ellipse with the equal energy white point as a reference.

The various operations related to the control of the lighting device 110 described above may be performed by only one of these, or may be performed as a combination of a plurality of them. Further, in order to emit light more suitable for the user 99 from the illuminating device 110, the number of divisions for time-dividing between the set of the two beat positions described above, the change width regarding the change range of the brightness, and the hue. It may be possible to input to the illumination control system 200 about the hue angle regarding the change range and the change width regarding the change range of the stimulus purity. At this time, only one of the above may be inputtable, or may be input as a plurality of combinations.

[Effects, etc.]
As described above, the lighting control system 200 according to the present embodiment is a lighting control system 200 that controls a light source, and is a music acquisition unit 92 that acquires music and analyzes the acquired music in a time series. The music analysis unit 93 that extracts the volume change and the pitch change of the music in the above, and the brightness changes according to the extracted volume change, and the stimulus purity changes according to the extracted sound pitch change. A lighting control unit 94 for controlling the light emitting mode of the light source is provided.

Such a lighting control system 200 can acquire a musical piece to be played and analyze the musical piece to extract a volume change and a pitch change in the time series of the musical piece. The lighting control unit 94 changes the brightness of the light emitted from the lighting device 110 according to the change in volume, and changes the stimulation purity of the light emitted from the lighting device 110 according to the change in sound pitch. The music to be played and the light emitted from the lighting device 110 are appropriately interlocked and changed. Therefore, it is possible to produce lighting that is appropriately linked to the music to be played.

Further, for example, the lighting control system 200 may further include a reproduction control unit 95 that reproduces the acquired music in synchronization with the control of the light source.

According to this, the lighting control system 200 can control the timing of sound output from the playback device 120, the amount of output, and the like, which enables lighting effects that are appropriately linked to the music to be played. Become. For example, in the case where the music already played in the space is picked up by using a microphone or the like and the lighting device 110 is controlled according to the sound, the light emitted from the lighting device 110 with respect to the playback of the music is used. Control delay is an issue. Therefore, in order to minimize the delay, it is necessary to simplify the control of the light emitted from the lighting device 110. That is, since the control that involves complicated processing cannot be performed, the variation of the emitted light may be limited. According to this aspect, it is not necessary to consider such a delay in processing, so that a wider variety of light can be emitted. Therefore, it is possible to produce lighting that is more appropriately linked to the reproduced music.

Further, for example, the lighting control unit 94 makes the pitch of the music correspond to the stimulus purity within a range not corresponding to the white light color, and the stimulus corresponding to the extracted pitch change in chronological order. The light emission mode of the light source may be controlled by changing the purity.

According to this, since the possibility that the opposite color is visually recognized by the user 99 is reduced, it is possible to produce a lighting effect that is appropriately linked to the music to be played without giving the user a sense of discomfort due to the sudden appearance of the opposite color. It becomes.

Further, for example, the pitch of a musical piece is defined by the pitch of a stepwise pitch by a plurality of pitch names constituting at least one octave, and the lighting control unit 94 is stepwise for each of the plurality of pitch names. The value of the stimulus purity may be made to correspond, and the light emission mode of the light source may be controlled by the change of the stimulus purity corresponding to the extracted pitch change in a time series.

According to this, the stimulus purity can be changed as a plurality of discrete numerical values corresponding to the scale of the musical piece, corresponding to the transition of the note name of the musical piece in time series. For example, if the lighting device 110 is controlled so that the stimulus purity increases as the note name becomes higher, it is possible to produce lighting with an image of freshness, dynamism, etc. in the music that frequently uses high-pitched sounds. .. As in this example, it is possible to produce lighting that is appropriately linked to a specific song with a specific image.

Further, for example, the light source includes the first light source 111a and the second light source 111b, the music includes the first part and the second part which are different from each other in the frequency region, and the music analysis unit 93 is the first by the lighting control unit 94. The volume change and pitch change of the first part used for controlling the light source 111a are extracted, and the volume change and pitch change of the second part used for controlling the second light source 111b by the lighting control unit 94 are extracted. You may.

According to this, when controlling a plurality of light sources at the same time, it is possible to assign each of a plurality of parts constituting the music to each light source and control the light emission mode of each light source in conjunction with each part. For example, when a characteristic sound is reproduced for each part, the emitted light also reflects this characteristic, so that it is possible to produce lighting that is appropriately linked to the music. For example, when a plurality of parts of a musical piece are macroscopically processed as one part, the characteristic sounds of each part may be averaged and smoothed by other parts and may not be properly linked with the music. In the above aspect, since such a problem can be solved, it is possible to produce a lighting effect that is more appropriately linked to the music to be reproduced.

Further, for example, the first part may correspond to the sound played by the first type musical instrument, and the second part may correspond to the sound played by the second type musical instrument.

According to this, as a plurality of parts, a part corresponding to the sound played by one of the musical instruments of a plurality of types can be applied to produce a lighting effect that is appropriately linked to the music. Therefore, it is possible to produce lighting that is more appropriately linked to the reproduced music.

Further, for example, the music analysis unit 93 further analyzes the acquired music and extracts a plurality of beat positions in the music, and the illumination control unit 94 is the first beat of the extracted plurality of beat positions. The first average value of the volume of the music from the position to the next second beat position is calculated, and the volume of the music from the second beat position to the next third beat position among the extracted multiple beat positions. The second average value of is calculated, the brightness of the first time point corresponding to the first beat position is set to the first brightness corresponding to the first average value, and the brightness of the second time point corresponding to the second beat position is set to the second. 2 Luminance of the light source is defined as the second brightness according to the average value, the brightness of the period between the first time point and the second time point is the brightness obtained by exponentially converting the virtual brightness connecting the first brightness and the second brightness linearly. The aspect may be controlled.

According to this, the first brightness and the second brightness determined based on the volume change between the beat position of the music and the next beat position and the first brightness and the second brightness are linearly connected. Light with an exponentially converted brightness is emitted to make the user perceive as if light of varying virtual brightness is being emitted. Since the brightness of the emitted light always changes from the beat position of the music, it is possible to produce lighting that is appropriately linked to the music. Further, since the user 99 can perceive the change in brightness between the first brightness and the second brightness as a linear change without abrupt fluctuations in brightness, such control is possible. For example, it is suitable for lighting production for music that requires gentle production. Therefore, it is possible to perform lighting production that is more appropriately linked to music or the like that requires gentle production.

Further, for example, the music analysis unit 93 further analyzes the acquired music to extract a plurality of beat positions in the music, and the lighting control unit 94 acquires the attribute information indicating the attribute of the music and the music. Based on the attribute of, the number of divisions for time-dividing between a set of consecutive beat positions among a plurality of extracted beat positions is determined, and the positions between the beat positions according to the number of divisions and the beats. Calculate the third average value of the volume of the music from the first position to the next second position among the plurality of positions corresponding to each of the positions, and from the second position to the next third position among the multiple positions. The fourth average value of the volume of the music is calculated, the brightness of the third time point corresponding to the first position is set to the third brightness corresponding to the third average value, and the brightness of the fourth time point corresponding to the second position is set. The light emission mode of the light source may be controlled as the fourth luminance according to the fourth average value.

According to this, by using the attribute information of the music and time-dividing between the beat position and the next beat position by the number of divisions according to the attribute information, a plurality of positions including the original beat position can be obtained. Be done. The brightness changes from these multiple positions as the starting point. Since the brightness changes at least at the beat position, it is properly linked to the rhythm of the music, and since the brightness changes more finely at a cycle suitable for the attributes of the music, it is more appropriately linked to the music to be played. Lighting production is possible.

Further, for example, the lighting control unit 94 acquires the attribute information indicating the attribute of the music, determines the change width indicating the change range of the brightness based on the attribute of the music, and adjusts to the extracted volume change. The light emission mode of the light source may be controlled so that the brightness changes within the range of the change width.

According to this, using the attribute information of the music, the light emission mode of the light source is controlled so that the brightness changes with the change width according to the attribute information. Therefore, since the brightness changes with a change width suitable for the attribute of the music, it is possible to produce a lighting effect that is more appropriately linked to the music to be played.

Further, for example, the lighting control unit 94 acquires attribute information indicating the attributes of the music, determines the hue angle indicating the range in which the hue can be changed based on the attributes of the music, and determines a predetermined reference color. As a reference, the light emission mode of the light source may be controlled so that the hue changes within the range indicated by the hue angle.

According to this, using the attribute information of the music, the light emission mode of the light source is controlled so that the hue changes within the range indicated by the hue angle according to the attribute information. Therefore, since the hue changes with a change width suitable for the attribute of the music, it is possible to produce a lighting effect that is more appropriately linked to the music to be played.

Further, for example, the lighting control system 200 may further include a reception unit 91 that accepts the input of the user 99, and the reference color may be determined based on the input of the user 99.

According to this, the user 99 can specify a reference color as a reference for a change in hue according to his / her own preference. Therefore, it is possible to produce lighting effects that match the preferences of the user 99 and are appropriately linked.

Further, for example, the reception unit 91 accepts the selection of one situation information by the user 99 from one or more situation information associated with any one of one or more hues, and the lighting control unit 94 is accepted. The reference color may be determined by the hue associated with one situation information.

According to this, the reference color, which is the reference for the change in hue, can be specified by the user 99 by selecting the situation information according to his / her preference. Therefore, with a simple selection, it is possible to produce lighting effects that match the preferences of the user 99 and the like and are appropriately linked.

Further, for example, the music analysis unit 93 further analyzes the acquired music to extract a plurality of beat positions in the music, and the lighting control unit 94 further includes a reception unit 91 that accepts the input of the user 99. , Specify at least one of the number of divisions for time-dividing between a set of consecutive beat positions among a plurality of beat positions, the change width indicating the change range of brightness, and the hue angle indicating the change range of hue. The light emission mode of the light source may be controlled based on the input of the user 99.

According to this, at least the number of divisions for time-dividing between a set of consecutive beat positions among a plurality of beat positions, the change width indicating the change range of luminance, and the hue angle indicating the change range of hue. One can be specified by the user 99 according to his or her own preference. Therefore, it is possible to produce lighting effects that match the preferences of the user 99 and are appropriately linked.

Further, in the lighting control method according to the present embodiment, the acquisition step S101 for acquiring the music, the analysis step S102 for analyzing the acquired music and extracting the volume change and the pitch change of the music on the time series, It includes a control step of controlling the light emission mode of the light source so that the brightness changes according to the extracted volume change and the stimulus purity changes according to the extracted pitch change.

According to this, the same effect as the above-mentioned lighting control system 200 can be obtained.

Further, the present embodiment can also be realized as a program for causing a computer to execute the lighting control method described above.

According to this, the same effect as the above-mentioned lighting control method can be obtained by using a computer.

(Other embodiments)
Although the present disclosure has been described above based on the embodiments, the present disclosure is not limited to the above-described embodiments.

For example, the terminal device according to the above embodiment may be realized as a dedicated device, or may be realized by being incorporated in a lighting device or a reproduction device.

Further, in the lighting control system according to the above embodiment, the configuration in which the music acquisition unit acquires the music to be played as electronic data has been described, but the music acquisition unit is input with the analog signal of the music. You may get the music with. In this case, in the lighting control system, the signal input as an analog signal may be digitized and the above-mentioned music analysis may be performed, or the above-mentioned music analysis may be performed by a dedicated circuit.

In addition, the input of the analog signal of the music includes the case where the music already played in the space is picked up by a microphone or the like and input. Even in such a case, by speeding up the signal processing by simplifying the music analysis processing or the like, it is possible to generate a control signal for controlling the lighting device with a delay time that is almost imperceptible. That is, it is possible to obtain the same effect as the description in the above embodiment.

Further, communication between various devices constituting the lighting control system according to the above embodiment is performed by wire or wireless, and the communication method is not particularly limited, and any communication method is adopted.

Further, each processing unit included in the lighting control system according to the above embodiment is typically realized as an LSI which is an integrated circuit. These LSIs may be individually integrated into one chip for each processing unit, or may be integrated into one chip so as to include a part or all of them.

Further, the integrated circuit is not limited to the LSI, and may be realized by a dedicated circuit or a general-purpose processor. An FPGA (Field Programmable Gate Array) that can be programmed after the LSI is manufactured, or a reconfigurable processor that can reconfigure the connection and settings of the circuit cells inside the LSI may be used.

In the above embodiment, each component may be configured by dedicated hardware or may be realized by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU or a processor reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory.

Further, the numerical values and the like used above are all examples for concretely explaining the present disclosure, and the embodiments of the present disclosure are not limited to the exemplified numerical values.

Further, the division of the functional block in the block diagram is an example, and a plurality of functions can be realized as one functional block, one function can be divided into a plurality of functional blocks, and some functions can be divided into other functional blocks. You may move it. Further, the functions of a plurality of functional blocks having similar functions may be processed by a single hardware or software in parallel or in a time division manner.

Further, the order in which each step in the flowchart is executed is for illustration purposes in order to specifically explain the present disclosure, and may be an order other than the above. Further, a part of the above steps may be executed simultaneously with other steps (parallel).

In addition, by arbitrarily combining the components and functions in the above-described embodiment to the form obtained by applying various modifications to the above-mentioned embodiment and the purpose of the present disclosure. The realized forms are also included in the present disclosure.

91 Reception unit 92 Music acquisition unit 93 Music analysis unit 94 Lighting control unit 95 Playback control unit 99 User 110 Lighting device 111a 1st light source (1st light source unit)
111b 2nd light source (2nd light source unit)
200 Lighting control system

Claims

A lighting control system that controls the light source
The music acquisition department that acquires music, and
A music analysis unit that analyzes the acquired music and extracts volume changes and pitch changes of the music in time series.
Lighting control including a lighting control unit that controls the light emission mode of the light source so that the brightness changes according to the extracted volume change and the stimulus purity changes according to the extracted pitch change. system.
The lighting control system according to claim 1, further comprising a reproduction control unit that reproduces the acquired music in synchronization with the control of the light source.
The lighting control unit
The stimulus purity is made to correspond to the pitch of the music within the range that does not correspond to the white light color.
The lighting control system according to claim 1 or 2, wherein the light emission mode of the light source is controlled by a change in stimulus purity corresponding to the extracted pitch change.
The pitch of the music is defined by the stepwise pitch of the pitch by a plurality of note names constituting at least one octave.
The lighting control unit
By associating each of the above-mentioned multiple types of note names with a stepwise stimulus purity value,
The lighting control system according to any one of claims 1 to 3, wherein the light emission mode of the light source is controlled by a change in stimulus purity corresponding to the extracted change in pitch in chronological order.
The light source includes a first light source unit and a second light source unit.
The music contains first and second parts that differ from each other in the frequency domain.
The music analysis unit
The volume change and the pitch change of the first part used for controlling the first light source unit by the lighting control unit are extracted.
The lighting control system according to any one of claims 1 to 4, which is used for controlling the second light source unit by the lighting control unit and extracts the volume change and the pitch change of the second part.
The first part corresponds to the sound played by the first type of musical instrument.
The lighting control system according to claim 5, wherein the second part corresponds to a sound played by a second type musical instrument.
The music analysis unit further analyzes the acquired music and extracts a plurality of beat positions in the music.
The lighting control unit
The first average value of the volume of the music from the first beat position to the next second beat position among the extracted plurality of beat positions was calculated.
The second average value of the volume of the music from the second beat position to the next third beat position among the extracted plurality of beat positions was calculated.
The brightness at the first time point corresponding to the first beat position is defined as the first brightness corresponding to the first average value.
The brightness at the second time point corresponding to the second beat position is defined as the second brightness corresponding to the second average value.
A claim for controlling the light emission mode of the light source as the luminance in the period between the first time point and the second time point as the brightness obtained by exponentially converting the virtual brightness linearly connecting the first brightness and the second brightness. The lighting control system according to any one of 1 to 6.
The music analysis unit further analyzes the acquired music and extracts a plurality of beat positions in the music.
The lighting control unit
The attribute information indicating the attribute of the music is acquired, and the number of divisions for time-dividing between the set of consecutive beat positions among the extracted plurality of beat positions is determined based on the attribute of the music. ,
Calculates the third average value of the volume of the music from the first position to the next second position among the positions between the beat positions according to the number of divisions and the plurality of positions corresponding to each of the beat positions. death,
The fourth average value of the volume of the music from the second position to the next third position among the plurality of positions is calculated.
The brightness at the third time point corresponding to the first position is defined as the third brightness corresponding to the third average value.
The lighting control system according to any one of claims 1 to 6, wherein the brightness at the fourth time point corresponding to the second position is defined as the fourth brightness corresponding to the fourth average value, and the light emission mode of the light source is controlled.
The lighting control unit
The attribute information indicating the attribute of the music is acquired, and the change width indicating the change range of the brightness is determined based on the attribute of the music.
The lighting control system according to any one of claims 1 to 8, wherein the light emitting mode of the light source is controlled so that the brightness changes within the range of the change width according to the extracted volume change.
The lighting control unit
The attribute information indicating the attribute of the music is acquired, and the hue angle indicating the range in which the hue can be changed is determined based on the attribute of the music.
The lighting control system according to any one of claims 1 to 9, wherein the light emission mode of the light source is controlled so that the hue changes within the range indicated by the hue angle with reference to a predetermined reference color.
In addition, it has a reception unit that accepts user input.
The lighting control system according to claim 10, wherein the reference color is determined based on the input of the user.
The reception unit accepts the selection of one situation information by the user from one or more situation information associated with any one or more hues, respectively.
The lighting control system according to claim 11, wherein the lighting control unit determines the reference color by the hue associated with the received situation information.
In addition, it has a reception unit that accepts user input.
The music analysis unit further analyzes the acquired music and extracts a plurality of beat positions in the music.
The illumination control unit has a number of divisions for time-dividing between a set of consecutive beat positions among the plurality of beat positions, a change width indicating a change range of luminance, and a hue angle indicating a change range of hue. The lighting control system according to any one of claims 1 to 10, wherein the light emitting mode of the light source is controlled based on the input of the user who specifies at least one of the above.
The acquisition step to acquire the music and
An analysis step of analyzing the acquired music piece and extracting the volume change and pitch change of the music piece in time series, and
A lighting control method comprising a control step of controlling a light emission mode of a light source so that the brightness changes according to the extracted volume change and the stimulus purity changes according to the extracted pitch change.
A program for causing a computer to execute the lighting control method according to claim 14.