NL2026884B1 - Optimization system and method for automatically optimizing a sound system for a venue. - Google Patents

Abstract

The present invention is related to a system for automatically optimizing a sound system for a venue, comprising a plurality of controllable speakers, wherein at least one sound property, such as a direction of the emitted sound, of each speaker is controllable, at least one sensor, for measuring at least one physical property of at least a portion of the venue, such as a lay-out of seats, a processor, configured for, computing and communicating an optimal speaker configuration based on essentially solely data from the at least one sensor, a controller, configured for receiving the optimal speaker configuration from the processor, adjusting the plurality of controllable speakers in correspondence with the received configuration. The invention is further related to a method for automatically optimizing a sound system for a venue.

Description

Optimization system and method for automatically optimizing a sound system for a venue.

The present invention is related to a system for automatically optimizing a sound system for a venue.

The invention is further related to a method for the same.

Systems and methods for controlling a large scale sound system is known in the art.

Such a system is described in US2019045305A1, wherein it is described that a parameter engine of an adjustment computing device is configured for determining a set of acoustic parameters, the set of acoustic parameters is transmitted towards an adaptive loudspeaker system.

The loudspeaker system is configured to adjust cells to use the initial set of acoustic parameters.

A user interface engine presents an indication of the performance using the initial set of acoustic parameters.

The user inputs a selection of a target area, based upon which the parameter engine computes the smallest affected area, which includes the selected target area.

Said smallest affected area is presented to the user interface engine, wherein the user inputs a set of equalization targets for the target area.

The parameter engine determines a set of modified acoustic parameters to implement the equalization targets inside the target area.

Based on the modified set of acoustic parameters the user interface engine displays an indication of predicted performance.

If accepted, the adjustment computing device transmits the modified parameters to the loudspeaker system, which configures its cells according to the modified acoustic parameters.

In order to be able to execute the aforementioned sequence of events, a user should provide to the system a virtual model of a venue configuration.

Even though said virtual model is often present, the model might however not be entirely accurate, or even entirely missing.

Without the venue model the system lacks substantial information for determining an initial set of acoustic parameters.

Also, the venue model is solely used to provide a starting point, but not explicitly for calculating the actual angles or orientations of the speakers for the day of the show.

In order to fine-tune the system, a sound engineer is required for fine-tuning.

The sound engineer performs measurements regarding the measurements of the room, to verify the suspension locations and trim the high limitations.

The configuration will be manually modified in modelling software, and the array angles and trim heights of the speakers are chosen.

This manual labor has to be done before the show, and more in particular before flying the speakers into the venue, that is installing them in the venue.

Although the method and system according to this application are very much able to configure a set of speakers, the system and method still lack in efficiency due to the mentioned downsides.

Itis therefore a goal of the present invention to configure speaker settings on a more autonomous way, or at least provide an alternative to the prior art.

The present invention achieves this goal by providing a system for automatically optimizing a sound system for a venue, comprising a plurality of controllable speakers, wherein at least one sound property, such as a direction of the emitted sound, of each speaker is controllable, at least one sensor, for measuring at least one physical property of at least a portion of the venue, such as a lay-out of seats, a processor, configured for computing and communicating an optimal speaker configuration based on essentially solely data from the at least one sensor, a controller, configured for receiving the optimal speaker configuration from the processor, adjusting the plurality of controllable speakers in correspondence with the received configuration.

The controllable speakers should in this application be understood as a controllable speaker system, said speaker system comprising a plurality of speakers, wherein at least mutual positions of the speakers are controllable.

By adjusting mutual positions, the direction of the sound emitted by said speaker is adjusted.

In the case of a speaker array, the mutual angles, preferably in each direction, between the speakers in the array are controllable.

It is important to note that the speakers are controllable both before being flown into position and after being flown in position.

At least one sensor is present for measuring at least one physical property of at least a portion of the venue, preferably the entire venue.

This allows the system to acquire the necessary date based on which the system can control.

To this end, the sensor data of the at least one physical property is provided to a processor.

Such data might comprise for example dimensions of the venue, or locations of the seating’s, or data regarding the various planes in the venue, such as a plane in front of the podium, a balcony comprising seating positions, a tribune location and the like.

The processor is configured for computing, based on the aforementioned data acquired by the sensor, an optimal configuration for the speakers.

That is, the processor determines mutual positions of the plurality of speakers of the controllable speaker system.

The system in particular only requires the data of the at least one sensor for constructing said optimal configuration.

Subsequently the controller is configured for positioning the speaker system into the computed optimal configuration.

Which preferably means, adjusting the mutual angles between speakers in the speaker system.

To this end the speaker system comprises speakers that are remotely movable, by means of for example actuators to rotate speaker cabinets, however it could be understood that a skilled person might use other techniques known for remotely adjusting speaker positions.

It should furthermore be understood that not only the direction of the sound emitted is controllable, but this could also be the volume, the angles of each speaker, per driver and the direction of the flown speaker array or the sound spectrum.

In an alternative embodiment the processor is further configured for receiving a forecast of at least one physical property, such as the humidity in or around the venue, and wherein computing and communicating the optimal speaker configuration is in particular based on data from the at least one sensor and the forecast of the at least one physical property.

Using a forecast of at least one physical property is useful for determining the optimal setting.

Physical properties such as the humidity significantly influence the sound propagation in for example festival venues.

By taking into account a forecast of such a parameter the system can anticipate on changing conditions.

This is in particular useful since these systems are not configured to move quick due to the mass of the speakers.

Also moving the speakers quickly tends to disturb the sound propagation in a negative way.

Therefore, anticipating to upcoming conditions yields a big benefit over the prior art.

The system can, upon detecting an upcoming change in a physical parameter, start adjusting the speakers according to a future optimum configuration, such that the audience does not notice any changes in the sound.

In yet another embodiment the processor is configured for constructing a virtual venue model based on essentially solely data from the at least one sensor.

A virtual venue model is beneficial for determining an optimal configuration.

Instead of continuously analyzing all sensor data, the system can at the start, or prior to the start of the event, use the data acquired by the sensor to construct a virtual venue model.

This virtual model, which is drawn up by the processor of the system using essentially solely sensor data, could reduce the computational demand during the event. However, constructing said virtual model could also be done during the event. It is furthermore possible to continuously adapt and optimize the virtual model based on the data received by the at least one sensor.

In again a different embodiment at least one forecast is chosen from the group consisting of; wind speed, wind direction, wind magnitude, cloud coverage, chance of precipitation, humidity, air pressure, temperature, dew point. These physical parameters turned out to have a significant influence on the coverage of the sound emitted by the speakers. Using these parameters would increase the accuracy of the system and yield a better distribution of the sound over the venue. It should be understood that although it is stated that these parameters are related to the forecast, the at least one sensor could also provide instantaneous levels of said parameters in addition to the forecasts.

In yet again a different embodiment at least one sensor is chosen from the group consisting of; LIDAR, RADAR, camera, heat camera, laser, ultrasonic, odometry, GPS, microphone. These sensors have turned out to provide the most usable data for computing the optimal configuration and/or for constructing a virtual model of the venue. Preferably the LIDAR, RADAR, camera, and heat camera are movably attached, such that they may for example rotate, preferably 360 degrees rotatable. This allows the at least one sensor to acquire data of the entire venue. This increases the quality of the virtual venue model and enhances the computational time required for determining the optimal configuration of the speakers.

In a different embodiment the controller is further configured for ignoring a difference between the actual speaker configuration and the computed optimal speaker configuration based on a forecast. The forecast will provide information that can be taken into account when determining the optimum configuration. It is conceivable that the forecast predicts a cloud coming over the venue, a cloud could influence the dispersion of the sound over the venue, due to a different reflection of the sound in air versus in the cloud. However, adapting the entire speaker system is a complex procedure and takes some time before completion. If the forecast indicates said cloud will be hovering over the venue for only a small amount of time, it is not worth the effort of adapting the entire system, only to undo said adaptation when the cloud is gone. Therefore the controller should be configured to ignore differences between actual configurations of the speaker system and the actual optimal setting computed. Ignoring such a difference should in particular be done in relation to a forecast of a parameter.

5 In yet again a different embodiment the at least one sensor is located in an/or on a speaker. Since the speakers are commonly transported and used in various locations, providing the speakers with the at least one sensor is beneficial since the system will be more easily installed. That is, upon installing the speakers, which has to be done anyway, the sensors are directly places as well. This prevents any additional manual labor to be performed during installation of speakers in venues. In another embodiment the system is in particular configured for autonomously moving to the optimal speaker configuration, that is, free of manual adjustment after the speakers are placed in the venue. As such the speakers of the system only require to be attached to either the ceiling and/or walls and/or floors, further manual actions are not required. The system is fully capable of adjusting itself autonomously. To this end the system uses the data and/or forecasts of the parameters in and around the venue. This may in particular work well together with forming a virtual venue model. After the speakers are flown into position, the sensors can provide data based on which the system can construct the virtual venue model. Using said module the optimal configuration can easily be determined, and possible small adjustments afterwards can be made to the speakers. That is, the speakers adjust themselves using the actuators that are controlled by the controller based on the optimal configuration. It is very beneficial to make the system as autonomous as possible, since this will require less manual interaction with the system which saves dramatically on the installation costs. Also this allows the system to continuously adjust according to the present situation.

In a further embodiment the processor comprises artificial intelligence or is coupled to an artificial intelligence network. The artificial intelligence network makes it possible to provide an optimal configuration and/or virtual venue model quicker since it can take into account previous and/or similar encounters.

In a further embodiment the artificial intelligence network is configured to compute the optimal speaker configuration based on historic event data. Historic event data could significantly speed up the computation since basic settings could be retrieved and only marginally adjusted according to the actual parameters.

In yet a further embodiment the historic data are in particular show performance indicators, such as crowd behavior in previous shows from the same artist and/or songs, previous shows and/or songs, similar conditions on a different location on the planet.

These data allow the system to make better predictions, and adjust the system according to previous encounters.

A certain artist can for example be known for a particular song, in which song the crowd tends to move as close to the podium as possible for the entire song.

This could lead to a sub-optimal setting for the crowd.

Therefore, if the artist arrives and is about to play the particular song, the speakers can, in advance, be moved into such a configuration that upon the crowd moving towards the podium the configuration is optimal.

Furthermore, near the end of events itis a tendency that a part of the crowd leaves early, which can also influence the sound configuration.

Therefore, the show performance indicators of historic data such as crowd behavior during specific songs and/or artists can be very useful in making predictions for the optimum speaker configuration.

Also the songs and/or artists themselves may be used as an indicator.

The data is analyzed by the artificial intelligence network, which retrieves leaning parameters from these invents to use in future events.

This furthermore increases the accuracy of the optimum setting during the entire event.

Also this allows to counteract sudden changes which can be foreseen using the artificial intelligence network.

It is furthermore conceivable that there is no active internet connection at a venue location.

In such a case the artificial intelligence network might be constituted by a local machine learning network, which network is configured for using the same data as the artificial intelligence network, the local machine learning network is also able to provide the same functionalities and advantages as the artificial intelligence network.

The present invention is further related to a method for automatically optimizing a sound system for a venue, comprising the steps of a) Installing a controllable speaker system in the venue, wherein said system comprises a plurality of speakers. wherein at least a mutual position between the speaker is controllable, b) measuring at least one physical property of at least a portion of the venue, such as a lay-out of seats, c) digitally constructing a 3D model of the venue using essentially solely the measurements of step b), d) calculating, based on the constructed 3D model, an optimal initial configuration of mutual positions between speakers of the sound system, e) orienting, in particular remotely orienting, the sound system into the calculated optimal initial configuration of mutual positions between the speakers. The method according to the present invention has the same advantages as explained with regards to the system according to the invention.

In a different embodiment the method further comprising the steps of f) monitoring the actual setting of the sound system, g) acquiring a forecasts of at least one physical property which could influence the optimal configuration in the venue, such as the humidity in or around the venue, h) calculating, based on the at least one measured physical property in step b), and the at least one forecast, the optimal configuration of the sound system in the 3D model, i) determining a difference between the calculated optimal configuration and the actual configuration of the sound system, |) selectively adjusting the sound system according to the determined difference. Based on a difference the controller can determine whether or not to adjust the speakers. This can be determined based on for example a forecast of a parameter. If said forecast predicts only a temporal fluctuation of the parameter it can be ignored by the controller. In again a different embodiment the steps h) - |) are repeated on predetermined intervals. This interval has turned out to be a trade of between the accuracy and the power consumption. If the intervals are very small, or even there is a continuous system, this might yield a very high power consumption which is not necessary at all times. Therefore the interval can be chosen such that no fluctuations in the parameters that influence the dispersion of the sound emitted by the speakers are missed, but also keep the power consumption at a reasonable level. In a different embodiment of the method use is made of the system according to any of the embodiments in particular. Yet in a different embodiment all calculation steps according to the method of this invention are performed by an artificial intelligence network. This allows to utilize historic data in order to quickly determine the most ideal setting, which reduces computation times and increases accuracy and audio performance. The present invention will hereinafter be furthermore elucidated based on the following drawings, wherein;

- figure 1 shows a schematic overview of the system according to an embodiment of the invention; - figure 2 illustrates a flowchart that indicates an exemplary embodiment of the method according to the invention.

Figure 1 gives a schematic overview of the relation between all components according to the system 1 of the present invention. First of all, the speakers 2 should be of the controllable type, wherein at least a mutual orientation of the speakers, or direction of the sound emitted is controllable by a controller 5. The controller receives information from the sensors 3, which sensors 3 could also be positioned on or in the speakers 2 themselves. However, for illustrative purposes it is chosen to visualize the sensors 3 separate. The sensors 3 send their data towards the controller 5. The controller 5 on its turn forwards said data to the processor 4. The processor 4 computes and/or creates a virtual venue model based on the data. Albeit it is visualized that the sensors 3 send the sensor data to the processor 4 through the controller 5, it is very much conceivable that the sensors 3 are directly coupled to the processor 4. According to this embodiment the controller 5 receives furthermore a forecast of at least one parameter 6. Additionally this figure shows a local machine learning network 7 which might be used in case there is no internet connection present at the venue location. That is beneficial in the case the processor 4 is in fact an artificial intelligence network 4 that communicates with the controller 5. Figure 2 indicates a flowchart 8 according to an embodiment of the method of the present invention. The flowchart 8 starts by providing and/or installing 9 a controllable speaker system. That is, the system should be flown into place, regardless of the mutual positions between the speakers of the speaker system. The second step 10 is to measure at least one physical property of the venue, which is executed using the sensor of the system, preferably a plurality of sensors. Once the data of the at least one physical parameter is acquired a virtual venue model is constructed 11. This is done by the processor 4 based on the sensor data solely. This increases the ease of use compared to the systems known in the art. Especially since it is only required to install the speakers in the venue, where it is not even required to pre-install the speakers in a configuration. In fact any initial configuration will satisfy. Based on the virtual model a optimal speaker configuration is computed 12, wherein especially use can be made of the virtual model and the sensor data.

After the optimum configuration, which primarily consists of mutual positions of the speakers, the speakers are positioned is said configuration.

Normally, this will satisfy for the entire event, however the present invention yields some further possibilities to enhance the audio quality experienced in the audience.

Using the measurements 10 provided by the sensors, the system monitors 14 the actual configuration of the speakers.

Additionally the system acquires 15 a forecast of at least one physical parameter that influences the sound in the venue.

Such a forecast might be the forecast of humidity in or around the venue, however any parameter influencing the distribution of the sound emitted by the speakers could be used by the skilled person.

Based on the forecast and the measured data an updated optimal setting is calculated 16 by the system, in particular by the processor.

The system subsequently compares 17 the actual setting with the updated optimum configuration.

If a difference is detected the system checks whether or not to change the actual configuration.

This decision is based on the measured data and the forecast.

The forecast might for example require or predict a change in the speaker configuration, however if this is only a temporal change such as a sudden but temporal drop of humidity, this may be ignored.

If however a change is necessary, the system can selectively adjust 18 the speakers of the system such that the speakers are again in optimal configuration.

After this last step the system starts over again from step 14, which occurs preferably on a predetermined interval.

Claims (15)

Conclusions A system for automatically optimizing a sound system for a location, comprising; - several adjustable speakers, where; - at least one sound property, such as a direction of the emitted sound, of each speaker is controllable, - at least one sensor, for measuring at least one physical property of at least part of the location, such as a layout of chairs. - a processor configured for; - calculating and communicating an optimal speaker configuration based essentially solely on the data from the at least one sensor, - a controller configured for; - receiving the optimal speaker configuration from the processor, - adjusting the multiple controllable speakers in accordance with the received configuration. An optimization system according to claim 1, wherein the processor is further configured for; - receiving a prediction of at least one physical property, such as the humidity in or around the location, and wherein calculating and communicating the optimal speaker configuration is based in particular on the data from the at least one sensor and the prediction of at least one physical property. An optimization system according to any preceding claim, wherein the processor is configured to form a virtual location model based substantially solely on the data from the at least one sensor. An optimization system according to claim 2, wherein at least one prediction is selected from the group consisting of; wind speed, wind direction, wind size, cloud cover, chance of precipitation, humidity, air pressure, temperature, dew point. An optimization system according to any one of the preceding claims, wherein at least one sensor is selected from the group consisting of; LIDAR, RADAR, camera, thermal camera, laser, ultrasonic, odometry, GPS, microphone. An optimization system according to any preceding claim, wherein the controller is further configured for; - ignoring a difference between the actual speaker configuration and the calculated optimal speaker configuration based on a prediction. An optimization system according to any preceding claim, wherein the at least one sensor is located in and/or on a speaker. An optimization system according to any preceding claim, wherein the system is configured in particular for; - moving autonomously to the optimal speaker configuration, that is, essentially free of manual adjustments after the speakers have been placed in the location. An optimization system according to any preceding claim, wherein the processor comprises artificial intelligence, or is coupled to an artificial intelligence network. An optimization system according to claim 9, wherein the artificial intelligence network is configured to calculate the optimal speaker configuration based on historical event data. 11. Optimization system according to conclusive 10, wherein the historical data is in particular show performance indicators, such as audience behavior in previous shows by the same artist and/or songs, previous shows and/or songs, similar conditions in a different location on the world. A method of automatically optimizing a sound system in a location, comprising the steps of; a) installing an adjustable sound system in the location, wherein the sound system comprises several speakers, wherein at least one mutual position of the speakers is adjustable, b) measuring at least one physical property of at least part of the location, such as a layout of seats, c) digitally constructing a 3D model of the site using substantially only the measurements from step b), d) calculating, based on the constructed 3D model, an optimal initial speaker configuration of mutual orientations between the speakers of the sound system, e) orienting, in particular orienting remotely, the sound system in the calculated optimal initial speaker configuration of mutual orientations between the speakers. The method of automatically optimizing a sound system according to claim 12, further comprising the steps of; f) monitoring the current setting of the sound system, g) providing a prediction of at least one physical property, which may influence the optimal configuration in the site, such as the humidity in or around the site, h) the calculate, based on the at least one measured physical property from step b), and the at least one prediction, the optimal configuration of the sound system in the 3D model. i) determining a difference between the calculated optimal configuration and the actual configuration of the sound system, i) selectively adjusting the sound system according to the determined difference. The method of automatically optimizing a sound system for a location according to claim 13, wherein steps h) - j) are repeated at predetermined intervals. A method for automatically optimizing a sound system for a location according to any one of claims 12-14, in particular using the system according to any one of claims 1-11.