JP2017102863A - Music reproduction device and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To achieve both entertainment property and safety.SOLUTION: The risk of driving is determined by a risk determination unit 42 on the basis of a signal from a speed sensor 18. When it is determined that there is a risk of driving when generating a music, at least one of the scale of sound in generated music, a chord sounded in music, timing with which the sound of an instrument is sounded in music, and the playing speed of an instrument in music is changed by a signal processing unit 44.SELECTED DRAWING: Figure 5

Description

  The present invention relates to a music playback apparatus and program for playing back music.

  2. Description of the Related Art Conventionally, a vehicular music generator that generates music using music data and vehicle state detection results is known (Patent Document 1).

  There is also known a signal performance music performance device that reflects the monitoring work to the auditory sense by converting the change of the monitoring target into the change of music based on the external signal input from the monitoring target displayed on the monitor. (Patent Document 2).

  In addition, there is known a smartphone application that performs an automatic music composition from vehicle information of vehicle running speed, rotation speed, acceleration, and GPS (Non-Patent Document 1).

  In addition, there is known an acoustic composing device that performs automatic composition using external environment and human ecological information (Patent Document 3).

Japanese Patent No. 4984861 Japanese Patent No. 4458581 Japanese Patent No. 3381074

Internet <URL: http://www.volkswagen.co.uk/playtheroad>

  When playing music on a vehicle, it is necessary to achieve both entertainment and safety. At this time, even if it tries to inform the surrounding environment by changing the tune, it does not know whether the tune has been changed as a musical performance or because the car is approaching. In order not to get bored, the more the various tunes can be changed, the more difficult it becomes to distinguish. Cars are also required to be alerted and guided when they are not driving properly.

  Thus, in the case of a car, two elements of entertainment and safety are required.

  The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a music playback apparatus and program capable of achieving both entertainment and safety.

  In order to achieve the above object, a music playback device according to the present invention determines a risk of collision or approach, or a risk of driving based on a state of a vehicle or a situation of an external environment of the vehicle. And when the music determining unit determines that there is a risk of collision or approach or a driving risk when the music is played, the sound scale in the music to be played back, And changing means for changing at least one of the timing of the sound of the instrument in the music and the performance speed of the instrument in the music.

  The program according to the present invention reproduces music by a computer, a risk determination means for determining the risk of collision or approach, or the risk of driving based on the state of the vehicle or the external environment of the vehicle. When the risk determination means determines that there is a risk of collision or approach or a risk of driving, the scale of the sound in the music to be played, the chords to be played in the music, It is a program for functioning as a changing means for changing at least one of the timing of sounding a musical instrument and the performance speed of the musical instrument in the music.

  According to the present invention, the risk determination means determines the risk of collision or approach or the risk of driving based on the state of the vehicle or the external environment of the vehicle. Then, when playing the music by the changing means, if the risk judging means determines that there is a risk of collision or approach or a risk of driving, the sound scale in the music to be played back, At least one of a chord to be played in the music, a timing to play a musical instrument sound in the music, and a performance speed of the musical instrument in the music is changed.

  Thus, when it is determined that there is a risk of collision or approach or driving when playing music, the sound scale in the music to be played, the chords to be played in the music, the sound of the instrument in the music It is possible to achieve both entertainment and safety by changing at least one of the timing of sounding and the performance speed of the musical instrument in order to give a sense of incongruity or discomfort.

  The music playback device according to the present invention provides an object detection device that outputs an output signal of an environment detection sensor that outputs a signal corresponding to a situation of an external environment of the vehicle or a signal that indicates that an object exists in the external environment of the vehicle. Music information generating means for generating music information based on an output signal of the sensor is further included, and the changing means plays the collision by the risk determination means when playing the music generated by the music information generating means. Alternatively, if it is determined that there is a risk of approach or a risk of driving, the sound scale in the music information generated by the music information generating means, the chords sounded in the music information, the sound of the instrument in the music information It is possible to change at least one of the timing of sounding and the performance speed of the musical instrument in the music information.

  The music playback device according to the present invention is a music information generating means for generating music information based on the situation of the external environment of the vehicle or the presence of a target in the external environment of the vehicle, which is obtained based on map information. And the change means determines that there is a risk of collision or approach or a risk of driving when the music generated by the music information generating means is reproduced. And at least one of a scale of sound in the music information generated by the music information generating means, a chord to be sounded in the music information, a timing for sounding a musical instrument in the music information, and a performance speed of the musical instrument in the music information. Can be changed.

  According to the music playback device and program of the present invention, when it is determined that there is a risk of collision or approach or a risk of driving when playing music, the sound scale in the music to be played, the sound is played in the music It is possible to achieve both entertainment and safety by changing at least one of chords, timing for playing musical instruments in music, and changing the playing speed of musical instruments in music.

It is a block diagram which shows an example of the whole structure of the music reproduction apparatus which concerns on the 1st Embodiment of this invention. It is a block diagram which shows an example of a structure of a sensor. It is a block diagram which shows an example of a structure of a music output part. It is a figure which shows an example of the hardware constitutions of a music information generation part. It is a block diagram which shows an example of a detailed structure of a music information generation part. It is a figure for demonstrating the method to produce | generate a music corresponding to a sensor signal. It is a figure which shows the example of mounting of a danger determination part, a signal processing part, and a music tone change determination part. It is a flowchart which shows an example of the procedure of "discomfort generation processing." It is a flowchart which shows another example of the procedure of a "music production | generation process." It is a block diagram which shows an example of the whole structure of the music reproduction apparatus which concerns on the 2nd Embodiment of this invention. It is a flowchart which shows another example of the procedure of a "music production | generation process." It is a block diagram which shows an example of the whole structure of the music reproduction apparatus which concerns on the 3rd Embodiment of this invention. It is a block diagram which shows an example of a detailed structure of a music information processing part. It is a flowchart which shows another example of the procedure of a "music production | generation process."

  Hereinafter, an example of an embodiment of the present invention will be described in detail with reference to the drawings.

<First Embodiment>
<Music player>
(overall structure)
First, the overall configuration of the music playback device according to the first embodiment of the present invention will be described.

FIG. 1 is a block diagram showing an example of the overall configuration of a music playback device 10 according to an embodiment of the present invention. The music playback device 10 according to the present embodiment is a music playback device that generates and plays back music according to the external environment of the vehicle. As shown in FIG. 1, the music playback device 10 includes a speed sensor 18, an environment detection sensor 20 ₁ , a target detection sensor 20 ₂ , a music information generation unit 30, and a music output unit 60. Speed sensor 18, each of the environment detection sensor 20 _1, and the object detection sensor 20 _2, music information generating unit 30 is electrically connected to output an output signal to the music information generating unit 30. The music information generation unit 30 is electrically connected to the music output unit 60 and outputs the music information to the music output unit 60.

  The speed sensor 18 is a sensor that outputs a signal corresponding to the speed of the vehicle.

Environment detection sensor 20 ₁ is a sensor that outputs a signal corresponding to the status of the external environment of the vehicle. In contrast, the object detecting sensor 20 ₂ is a sensor which outputs a signal indicating that the subject to the external environment of the vehicle (an oncoming vehicle, a person, a building obstacles) are present, there is interest in the external environment Only when the signal is acquired. Music information generating unit 30, the output signal of the speed sensor 18, the output signal of the environment detection sensor 20 _1, to generate the music information on the basis of the output signal of the object detection sensor 20 _2, and outputs the music output unit 60. The music output unit 60 plays music based on the input music information. The detailed configuration of the music information generation unit 30 will be described later.

  Music has three elements: melody (melody), harmony (harmonic), and rhythm (rhythm). In addition, sound has three elements: height (frequency), magnitude (sound pressure level), and timbre (frequency component). “Song” in the present embodiment refers to a melody in which the pitch of “sound” changes with time, and a rhythm in which the time length of “sound” changes with a certain discipline, among the three elements of music. At least.

In the example shown in FIG. 1, an example has been described with a single environment detection sensor 20 ₁ and the one object detection sensor 20 _2, the number of each sensor is limited to one by one is Absent. A plurality of environment detection sensors may be provided. A plurality of target detection sensors may be provided. Incidentally, when there is no need to distinguish between environmental detection sensor 20 ₁ and the object detecting sensor 20 ₂ are collectively referred to as the sensor 20.

(Sensor)
Next, a schematic configuration of the sensor will be described.

FIG. 2 is a block diagram showing an example of the configuration of the sensor. As shown in FIG. 2, the sensor 20 includes a detection unit 22, an A / D conversion unit 24, a processing unit 26, and a transmission unit 28. The A / D conversion unit 24, the processing unit 26, and the transmission unit 28 are electrically connected in the order described from the detection unit 22 side. Detector 22 of the environment detection sensor 20 ₁ outputs an analog signal such as an image signal representing the anterior image of the captured forward direction to the A / D converter 24. Detector 22 of the object detecting sensor 20 ₂ detects the specific physical quantity such as an electromagnetic wave, and outputs an analog signal corresponding to the detected physical quantity to the A / D converter 24.

  The A / D converter 24 converts the input analog signal into a digital signal and outputs the digital signal to the processing unit 26. The processing unit 26 performs amplification processing, filtering processing, and the like on the input digital signal, and outputs the waveform-shaped digital signal to the transmission unit 28. The transmission unit 28 transmits the input digital signal to the music information generation unit 30. That is, the waveform-shaped digital signal is output to the music information generation unit 30 as an output signal of the sensor 20.

(Music output part)
Next, the configuration of the music output unit will be described.

  FIG. 3 is a block diagram showing an example of the configuration of the music output unit. As shown in FIG. 3, the music output unit 60 includes a D / A conversion unit 62, an amplification unit 64, and a speaker 66. The D / A converter 62, the amplifier 64, and the speaker 66 are electrically connected in the order described from the music information input side.

  The music information generation unit 30 outputs music information representing the generated music to the music output unit 60 as a digital signal. The input digital signal is converted into an analog signal by the D / A converter 62, amplified by the amplifier 64, and output to the speaker 66. The speaker 66 generates sound according to the input analog signal. Thereby, in the music output part 60, the music according to the external environment of a vehicle is played based on the input music information.

(Music information generator)
Next, the music information generation unit will be described.

  FIG. 4 is a diagram illustrating an example of a hardware configuration of the music information generation unit. As shown in FIG. 4, the music information generation unit 30 is configured as a computer that performs various controls and various calculations. That is, the music information generation unit 30 includes a CPU 30A, a ROM 30B, a RAM 30C, a nonvolatile memory 30D, and an input / output interface (I / O) 30E. Each of the CPU 30A, ROM 30B, RAM 30C, nonvolatile memory 30D, and I / O 30E is connected via a bus 30F.

  In the present embodiment, the ROM 30B stores a control program for executing “discomfort generation processing” and “music generation processing” to be described later. “Software for converting MIDI signals” and “software for generating music information from MIDI signals” are also stored in the ROM 30B. General-purpose software may be used as these MIDI software. The CPU 30A reads the program stored in the ROM 30B and executes the program using the RAM 30C as a work area. Here, software is synonymous with program.

  MIDI (Musical Instrument Digital Interface) is an international standard for communicating music information with digital signals. The MIDI signal is information on the MIDI standard and information on a standard MIDI file format (SMF). In “MIDI signal conversion software”, the basic frequency of sound is “note number”, sound pressure level is “velocity level”, tone is “number indicating instrument name”, time change is “note on / note off” Are respectively converted into data representing "."

  In “software for generating music information from a MIDI signal”, a sound source is assigned to the note number of the MIDI signal, and various parameters relating to expressions associated with the sound source are set and changed. For example, note numbers 0 to 87 may be assigned to the scale of an 88-key piano keyboard for MIDI signals obtained from an output signal from an image sensor that is an environment detection sensor. In addition, a loop that repeatedly reproduces a certain range of waveform data, an envelope that indicates the time change of the sound source, a volume change setting of each sound source, a filter setting that changes the definition of the sound by setting the cutoff frequency, sound image localization, Various parameters such as the velocity representing the strength of the sound and the selection of the sound source to be simultaneously sounded may be set or changed.

  In addition to the speed sensor 18, the sensor 20, and the music output unit 60, the music information generation unit 30 displays various information to the passenger, the operation unit 32 that receives operations of the passenger, and the like. The display unit 34 and the communication unit 36 that is an interface for communicating with an external device are connected via a communication line. The music information generation unit 30 receives the output signal from the sensor 20 and outputs the music information to the music output unit 60. The CPU 30 </ b> A controls the music output unit 60, the operation unit 32, the display unit 34, and the communication unit 36. Information can be exchanged via the communication unit 36.

  Note that various drives may be connected to the music information generation unit 30. Each type of drive is a device that reads data from a computer-readable portable recording medium such as a flexible disk, a magneto-optical disk, or a CD-ROM, and writes data to the recording medium. When various types of drives are provided, a control program may be recorded on a portable recording medium, and this may be read and executed by a corresponding drive.

  Next, the music information generation unit 30 will be described from the functional aspect.

  FIG. 5 is a functional block diagram illustrating an example of the configuration of the music information generation unit 30. As shown in FIG. 5, the music information generation unit 30 includes a memory 40, a risk determination unit 42, a signal processing unit 44, a music information generation unit 46, a music information synthesis unit 48, and a tune change determination unit 50. The signal processing unit 44 is an example of a changing unit.

  A digital output signal is output from the speed sensor 18 and the sensor 20. The music information generation unit 30 performs sampling at a predetermined frequency (for example, 30 Hz to 60 Hz), and acquires output signals from the speed sensor 18 and the sensor 20. The memory 40 temporarily holds the sampled output signal. The digital output signal is a digital value of the output voltage of the speed sensor 18 and the sensor 20 for each time. Hereinafter, the value represented by the output signal of the sensor 20 is referred to as “the output value of the sensor 20”. The value represented by the output signal (sensor output value) can be a representative value such as an average value or a maximum value within the sampling time.

Further, memory 40, an output signal from the speed sensor 18, and outputs the danger determination section 42, the respective output signals from the output signal and the object detection sensor 20 ₂ from the environment detection sensor 20 _1, the signal processing unit 44 And it outputs to each part of the music tone change determination part 50. The memory 40 outputs the output signals from the speed sensor 18 and the sensor 20 to each unit in the acquired order.

  The danger determination unit 42 determines the risk of driving by determining whether or not the output value of the speed sensor 18 is greater than or equal to a predetermined threshold value, and notifies the signal processing unit 44 of the determination result. As the threshold, for example, a speed that is faster than the legal speed by 20 km / hour is used. When the signal processing unit 44 receives the result that the output value of the speed sensor 18 is equal to or greater than the threshold value, the signal processing unit 44 generates a sound with a sense of incongruity and converts the sound with the sense of incongruity into a MIDI signal. The signal processing unit 44 converts the output signal from the sensor 20 into a MIDI signal. Then, the signal processing unit 44 outputs the obtained MIDI signal to the music information generation unit 46. When receiving the MIDI signal, the music information generating unit 46 generates music information from the MIDI signal.

Here, the signal processing unit 44, an output signal from the environment sensor 20 _1, and from each of the output signals from the object detecting sensor 20 ₂ to generate each MIDI signals, music information generating unit 46, the MIDI signal Music information is generated from each.

  The music information generation unit 46 outputs each piece of music information to the music information synthesis unit 48. The music information synthesizing unit 48 synthesizes each piece of music information and generates music information representing music according to the external environment of the vehicle. Then, the music information composition unit 48 outputs the obtained music information to the music output unit 60.

  The music tone change determination unit 50 determines from the output value of the sensor 20 whether or not the music tone change condition is satisfied, and notifies the signal processing unit 44 of the determination result. The music tone changing condition and the determination method will be described later.

  When the signal processing unit 44 receives the result that the music tone changing condition is satisfied, the signal processing unit 44 generates a MIDI signal from the output signal from the sensor 20 so as to change the music tone.

  For example, there are minor tones, major tones, classical style, bossa nova style, Japanese style, Ryukyu style, Arabic style, and the like. The change in tune is to change constituent elements such as assignment of musical instruments (tone colors), scale (pitch interval), chord progression (overlap of two or more sounds), rhythm, and the like. The tone changes by changing these components in the MIDI signal.

  In the present embodiment, the change in brightness obtained from the camera image is used as the music tone change condition. For example, when the brightness obtained from the camera image decreases or increases, the music tone is changed. Thereby, a change in the external environment is expressed.

  In the present embodiment, music information representing music is generated based on the output signal of the environment detection sensor, music information representing musical instrument sound is generated based on the output signal of the target detection sensor, and music information representing the music and the musical instrument are represented. Music information representing sound is synthesized to generate music information representing music according to the external environment of the vehicle. Thus, when an event such as the appearance of an object (an obstacle such as an oncoming vehicle, a person, or a building) occurs, a specific instrument sound is generated so that the passenger recognizes the occurrence of the event.

The environment detection sensor 20 _1, the image sensor such as a camera, an optical sensor, a temperature sensor such as a radiation thermometer, and the like position sensors such as a car navigation system including a GPS. The object detection sensor 20 _2, an electromagnetic wave sensor of radars, Doppler sensor for detecting the Doppler effect, there is an acceleration sensor or the like. For example, in order to generate music information representing music during MIDI signal conversion, a harp may be assigned to the image sensor, a shakuhachi may be assigned to the optical sensor, and an instrument sound source such as a piano may be assigned to the temperature sensor. Further, in order to generate music information representing musical instrument sounds, a musical instrument sound source such as a triangle may be assigned to the electromagnetic wave sensor and a timpani may be assigned to the Doppler sensor.

(Generate sound that gives a sense of incongruity)
Next, the principle of generating a sound that gives a sense of incongruity will be described.

  As shown in FIG. 6, when sensor data is reflected in sound, the sensor signal is applied to a MIDI tone number (corresponding to a piano keyboard). When playing sounds from multiple instruments, use the rhythm equivalent to a metronome to match the timing of each instrument. In general, each instrument is easy to hear when played at intervals of a fraction of an integer or multiples. If it is judged that the car is approaching from the rear and there is a danger, if the metronome corresponding to a specific instrument is made early so that it can not be done by ordinary people, the instrument is not discrete and the sound is not discrete Sounds like a change. I don't usually hear such sounds, so I feel uncomfortable. Since most musical instruments to be played do not become music when this is done, it is applied to one or two of a plurality of musical instruments.

  FIG. 7 shows an embodiment of the signal processing unit 44, the risk determination unit 42, and the music tone change determination unit 50 when a function expressing discomfort among the uncomfortable feelings is included.

FIG. 7 shows an example of converting the output signal from the Doppler sensor 10.5GHz as object detection sensor 20 ₂ and the image data from the camera as the environment detection sensor 20 _1, each MIDI signal.

  The tune change determination unit 50 detects RGB amounts in the image data from the camera and assigns them to signals for changing the tune for each sensor 20. Specifically, the music tone change determination unit 50 sets a threshold value for the brightness calculated from the RGB amount, and determines that the brightness is equal to or greater than the threshold value by mapping. The signal processing unit 44 changes the rhythm. The music tone change determination unit 50 outputs the brightness calculated from the RGB amount to the signal processing unit 44, and the signal processing unit 44 changes the velocity (sound intensity). Thus, the tone of music changes according to the brightness of the image data from the camera.

  Moreover, the danger determination part 42 sets a threshold value with respect to the speed information obtained from the speed sensor 18 at, for example, 80 km / h and 100 km / h, and there is a risk of driving when the speed becomes 80 km / h or more. Is output to the signal processing unit 44. When the signal processing unit 44 converts the sensor signal of the 10.5 GHz Doppler sensor into a MIDI signal, the C major scale is switched to the pentatonic scale.

For example, from the state where each song of all instruments is automatically tuned only by the C major scale (only with the white key of the Doremifasolaside piano), the song of at least one instrument is pentatonic scale (black key of the piano) By switching to “only”, a sense of incongruity can be given. Instead of the pentatonic scale, it may be switched to Doremisora (5 pitches without Jonah). Also, pentatonic at least one instrumental song from the state of self-composing with a combination of major scales (de, mi, mi, fa, so, la) and minor scales (de, mi, fa, so, la) You may make it switch to a scale.
Also, all the instruments that make up the melody are played on the C major scale, and for one or more of those instruments, the tone number of the C major scale is added or subtracted with one of an integer less than 127. You may make it switch a scale by setting it as the tone number to sound. For example, an integer of about 1 to 10 may be added or subtracted. Specifically, 2 is added to the tone number or 2 is subtracted. In this way, the scales may be switched by moving some of the scales in parallel.

  Further, when the speed becomes 100 km / h or more, it is further determined that there is a risk of driving, and an unnatural feeling occurrence signal is output to the signal processing unit 44. The signal processing unit 44 outputs the sensor signal of the 10.5 GHz Doppler sensor to the MIDI. When converting to a signal, a +2 degree chord is added. For example, when playing a doo, level it at the same time. This produces music that is extremely hard to hear.

  A chord of +9 degrees may be added. For example, when playing a do, when playing a do, you may make it sound one octave higher at the same time.

  As described above, in the present embodiment, the tune change determination unit 50 outputs a determination result for instructing to change the tune, and the danger determination unit 42 generates a sense of discomfort for instructing to give a sense of discomfort. Output a signal. The signal processing unit 44 receives the determination result for instructing to change the music tone or the unnatural feeling occurrence signal, and converts the output signal of each sensor 20 to the MIDI signal according to the determination result or the unnatural feeling occurrence signal. A MIDI signal is generated by applying a change.

<Discomfort generation process>
Next, “discomfort generation processing” executed by the CPU 30A of the music information generation unit 30 will be described. The “discomfort generation process” is started when a start instruction is received from the passenger via the operation unit 32 and is repeatedly executed. FIG. 8 is a flowchart showing an example of the procedure of “discomfort generation processing”.

  First, in step 100, an output signal from the speed sensor 18 is acquired (sampled). In step 102, it is determined whether or not the speed information represented by the acquired output signal is equal to or greater than a threshold value. If the speed information is greater than or equal to the threshold value, in step 104, a discomfort generation signal is output and the discomfort generation process is terminated. On the other hand, if the speed information is less than the threshold value, the discomfort generation process is terminated without outputting the discomfort generation signal.

<Music generation process>
Next, the “music generation process” executed by the CPU 30A of the music information generation unit 30 will be described. The “music generation process” is started when there is a start instruction from the passenger via the operation unit 32. FIG. 9 is a flowchart showing an example of the procedure of “music generation processing”.

  First, in step 110, it is determined whether or not the output signal from the sensor 20 has been acquired (sampled). When the output signal is acquired, the process proceeds to step 112. When the output signal is not acquired, the process returns to step 110 and the determination is repeated. Next, in step 112, it is determined whether or not the acquired signal is a camera image signal.

  If it is a camera image signal, the process proceeds to step 114. If it is not a camera image signal, the process proceeds to step 118.

  In step 114, the brightness is calculated from the RGB amounts of the camera image. In the next step 116, it is determined whether or not the calculated brightness is greater than or equal to a threshold value, and a signal for changing the tone of music according to the determination result is output.

  In step 118, signal processing according to the type of the obtained signal is performed. Specifically, it is converted into a MIDI signal according to the type of the sampled output signal. When a signal for changing the tone is output in step 116, a MIDI signal is generated so as to change the tone when converted into a MIDI signal. In addition, when a discomfort generation signal is output in the discomfort generation process described above, a MIDI signal is generated so as to give a sense of discomfort.

  Next, in step 122, music information is generated from the MIDI signal corresponding to the type of signal obtained in step 118.

  Next, in step 124, music information corresponding to the type of signal is synthesized, music information representing music corresponding to the external environment of the vehicle is generated, and output to the music output unit 60. Next, in step 126, it is determined whether or not there is a stop instruction from the passenger. If there is a stop instruction, the routine ends. If there is no stop instruction, the routine returns to step 110 and the procedure from step 110 to step 126 is repeated.

  As described above, according to the music playback device according to the first embodiment, when it is determined that there is a risk of driving when generating music information based on the sensor signal, It is possible to achieve both entertainment and safety by changing the scale of the sound or the chords played in music to give a sense of incongruity or discomfort.

  In addition, ambient environment information changes as the vehicle travels. This environmental information is detected by a sensor, and when performing an automatic song based on it, both entertainment and safety of enjoying music are made compatible. Entertainment is achieved by changing the tune, and safety is achieved by applying sounds that are not related to entertainment.

  In addition, when there is a risk of driving, a strange sound is generated to make the driver feel uncomfortable, and when there is no driving risk, the generation of a strange sound is stopped and the driver is in a safe driving state. I can let you know.

<Second Embodiment>
<Music player>
Next, a music playback device according to the second embodiment will be described. In addition, the same code | symbol is attached | subjected about the part which becomes the same structure as 1st Embodiment, and description is abbreviate | omitted.

  The second embodiment is different from the first embodiment in that music information is generated from map data.

  In 2nd Embodiment, the information of the external environment of a vehicle is acquired from the sophisticated map information (dynamic map) utilized for automatic driving | operation, and the music information according to the external environment of a vehicle is produced | generated.

FIG. 10 is a block diagram showing an example of the overall configuration of the music playback device 210 according to the second embodiment. The music playback device 210 according to the present embodiment includes a speed sensor 18, an environment detection sensor 20 ₁ , a target detection sensor 20 ₂ , a GPS sensor 220, a map information acquisition unit 222, a map database 224, a music information generation unit 30, and music. An output unit 60 is provided. Each of the speed sensor 18, the environment detection sensor 20 ₁ , the object detection sensor 20 ₂ , the GPS sensor 220, and the map database 224 is electrically connected to the music information generation unit 30.

  The GPS sensor 220 measures the position of the vehicle based on a signal received from a GPS satellite.

  The map database 224 stores static road map information for generating sophisticated map information used for automatic driving.

Based on the position of the vehicle measured by the GPS sensor 220, the map information acquisition unit 222 acquires road map information at the position from the map database 224. The map information acquiring unit 222, based on the output signal from the environment sensor 20 ₁ and the object detection sensor 20 _2, moving objects, such as dynamic information (vehicle or pedestrian, signal aspect, such as road construction Information).

  The map information acquisition unit 222 integrates the map information acquired from the map database 224 and the dynamic information to generate sophisticated map information (dynamic map) used for automatic driving.

  The map information acquisition unit 222 generates moving image data from the generated map information (dynamic map), obtains various external environment information such as RGB output and edge detection results based on the moving image data, and generates the music information generation unit 30. Output to.

  The map information acquisition unit 222 generates the map information (dynamic map) sophisticated as described above and the acquisition of various external environment information as needed, and sends the obtained various external environment information to the music information generation unit 30. Output.

  As in the first embodiment, the risk determination unit 42 of the music information generation unit 30 determines whether the output value of the speed sensor 18 is equal to or greater than a predetermined threshold value, and outputs a sense of incongruity occurrence signal as a signal processing unit. 44. When the signal processing unit 44 receives the discomfort generation signal, the signal processing unit 44 converts various external environment information from the map information acquisition unit 222 into a MIDI signal so as to generate a sound with a discomfort. Then, the signal processing unit 44 outputs a MIDI signal obtained according to various external environment information to the music information generating unit 46. When receiving the MIDI signal, the music information generating unit 46 generates music information from the MIDI signal.

  Here, the signal processing unit 44 generates a MIDI signal from various external environment information from the map information acquisition unit 222, and the music information generation unit 46 generates music from the MIDI signal generated according to the various external environment information. Each piece of information is generated.

<Discomfort generation process>
The “discomfort generation process” is started when there is a start instruction from the passenger via the operation unit 32, and the discomfort generation process shown in FIG. 8 is repeatedly executed as in the first embodiment. .

<Map information acquisition process>
The “map information acquisition process” is started when there is a start instruction from the passenger via the operation unit 32, and as described above, generation of sophisticated map information (dynamic map) and various external environment information Acquisition is repeated.

<Music generation process>
Next, the “music generation process” executed by the CPU 30A of the music information generation unit 30 will be described. The “music generation process” is started when there is a start instruction from the passenger via the operation unit 32. FIG. 11 is a flowchart showing an example of the procedure of “music generation processing”. In addition, about the process similar to 1st Embodiment, the same code | symbol is attached | subjected and description is abbreviate | omitted.

  First, in step 252, various external environment information obtained by the map information acquisition unit 222 is acquired.

  In step 114, the brightness is calculated from the RGB amounts included in the external environment information acquired in step 252. In the next step 116, it is determined whether or not the calculated brightness is greater than or equal to a threshold value, and if the brightness is greater than or equal to the threshold value, a signal for changing the tone is output.

  In step 254, signal processing according to the type of external environment information obtained is performed. Specifically, each is converted into a MIDI signal according to the type of acquired external environment information. When a signal for changing the tone is output in step 116, a MIDI signal is generated so as to change the tone when converted into a MIDI signal. In addition, when a discomfort generation signal is output in the discomfort generation process described above, a MIDI signal of a sound that gives a discomfort is generated.

  Next, in step 122, music information is generated from each of the MIDI signals obtained in step 254.

  Next, in step 124, the pieces of music information are combined to generate music information representing music according to the external environment of the vehicle, and output to the music output unit 60. Next, in step 126, it is determined whether or not there is a stop instruction from the passenger. If there is a stop instruction, the routine ends. If there is no stop instruction, the routine returns to step 252 and the procedure from step 252 to step 126 is repeated.

  Since the other configuration and operation of the music playback device according to the second embodiment are the same as those of the first embodiment, description thereof will be omitted.

  As described above, according to the music playback device according to the second embodiment, there is a risk of driving when generating music information based on sophisticated map information used for automatic driving. When the determination is made, it is possible to achieve both entertainment and safety by changing the scale of the sound in the music to be generated or the chord sounded in the music to give a sense of discomfort and discomfort.

  In the above embodiment, the case where moving image data is created from sophisticated map information and external environment information is acquired has been described as an example. However, the present invention is not limited to this. External environment information may be acquired from dynamic road map information and dynamic information.

<Third Embodiment>
<Music player>

  Next, a music playback device according to the third embodiment will be described. In addition, the same code | symbol is attached | subjected about the part which becomes the same structure as 1st Embodiment, and description is abbreviate | omitted.

  The third embodiment is different from the first embodiment in that an uncomfortable sound is generated when music information prepared in advance is reproduced.

  FIG. 12 is a block diagram showing an example of the overall configuration of the music playback device 310 according to the third embodiment. The music playback device 310 according to the present embodiment includes a speed sensor 18, a music information input unit 320, a music information processing unit 330, and a music output unit 60. Each of the speed sensor 18 and the music information input unit 320 is electrically connected to the music information processing unit 330.

  The music information input unit 320 acquires music information prepared in advance (for example, music information obtained from a CD or the like, or electronic music information) and outputs it to the music information processing unit 330.

  As illustrated in FIG. 13, the music information processing unit 330 includes a memory 40, a risk determination unit 42, a signal processing unit 344, a music information generation unit 346, and a music information synthesis unit 348. The signal processing unit 344 is an example of a changing unit.

  As in the first embodiment, the risk determination unit 42 determines whether the output value of the speed sensor 18 is equal to or greater than a predetermined threshold value, and outputs a sense of incongruity occurrence signal.

  When the unnaturalness occurrence signal is output from the danger determination unit 42, the signal processing unit 344 generates a MIDI signal of unnatural sound according to the sound in the music information input by the music information input unit 320.

  For example, by adding a chord to sound in the input music information, a sound with a sense of incongruity is generated.

  The music information generation unit 346 generates music information from the MIDI signal generated by the signal processing unit 344.

  The music information synthesis unit 348 synthesizes the music information input by the music information input unit 320 and the music information generated by the music information generation unit 346 and outputs the synthesized music information to the music output unit 60.

<Discomfort generation process>
Next, “discomfort generation processing” executed by the music information processing unit 330 will be described. The “discomfort generation process” is started when there is a start instruction from the passenger via the operation unit 32, and the discomfort generation process shown in FIG. 8 is repeatedly executed as in the first embodiment. .

<Music generation process>
Next, the “music generation process” executed by the music information processing unit 330 will be described. The “music generation process” is started when there is a start instruction from the passenger via the operation unit 32. FIG. 14 is a flowchart showing an example of the procedure of “music generation processing”.

  First, in step 350, it is determined whether or not a sense of incongruity occurrence signal is output. If the uncomfortable feeling generation signal is not output, the process proceeds to step 360, and the music information input by the music information input unit 320 is output to the music output unit 60. On the other hand, if a sense of incongruity occurrence signal is output, the process proceeds to step 352.

  In step 352, a MIDI signal having a sense of incongruity is generated according to the sound in the music information input by the music information input unit 320. In step 356, music information is generated from the MIDI signal obtained in step 352.

  Next, in step 358, the music information input by the music information input unit 320 and the music information generated in step 356 are combined and output to the music output unit 60. Next, in step 362, it is determined whether or not there is a stop instruction from the passenger. If there is a stop instruction, the routine ends. If there is no stop instruction, the routine returns to step 352 and the procedure from step 350 to step 362 is repeated.

  Since the other configuration and operation of the music playback device according to the third embodiment are the same as those of the first embodiment, the description thereof is omitted.

  As described above, according to the music playback device according to the third embodiment, when it is determined that there is a risk of driving when playing music information prepared in advance, the sound in the music to be played back It is possible to achieve both entertainment and safety by changing the scale or the chords played in music to give a sense of discomfort or discomfort.

<Modification>
It should be noted that the configuration of the music generation apparatus described in each of the above embodiments is an example, and it goes without saying that the configuration may be changed without departing from the gist of the present invention.

  For example, in the above embodiment, the case where the risk of driving is determined by determining whether or not the speed of the vehicle is equal to or higher than the threshold value and a sense of incongruity occurrence signal is output has been described as an example. It is not limited to. For example, based on the camera image, it may be determined whether or not the white line is deviated, and when the white line is deviated, a sense of incongruity occurrence signal may be output. At this time, the greater the deviation from the white line, the greater the uncomfortable feeling. Further, when the deviation from the white line is corrected, the output of the uncomfortable feeling generation signal may be stopped.

Also, when it is in the automatic driving mode on the expressway, it is determined whether or not to transition to the semi-automatic driving state when returning to the conventional driving on the general road, and when it is determined to transition to the semi-automatic driving state Alternatively, a sense of incongruity generation signal may be output to notify the user of the sense of incongruity of switching from automatic operation to manual operation. As described above, when the state is changed from the state where the hand is separated from the steering to the state where the manual driving is necessary, the uncomfortable feeling is given, and the uncomfortable feeling is increased as the point where the manual driving is switched. Then, when the driver steers the steering wheel, the output of the uncomfortable feeling generation signal may be stopped.
Further, not the driving risk but the collision or approaching risk may be determined, and if it is determined that there is a collision or approaching risk, a sense of incongruity occurrence signal may be output. For example, the approach of another vehicle or the approach of a roadside object such as a guard rail may be determined.

  Further, it is possible to detect a doze, determine whether a doze is detected, and output a sense of incongruity when a doze is detected.

  In addition, the driver may be informed of the score as a score, assuming that driving without a sense of incongruity is a good driving. For example, an ecological driving evaluation may be performed, and if the evaluation is bad, a sense of incongruity occurrence signal may be output.

  Further, as the risk increases, the sense of incongruity felt from the music increases step by step. If the risk still does not disappear, it may be determined that the driver is abnormal and the vehicle is decelerated and stopped.

  Further, in the above-described embodiment, when a sense of incongruity occurrence signal is output, the case where music that gives a sense of incongruity is generated by adding a chord or changing the scale has been described as an example, but the present invention is not limited to this. Absent. For example, when a sense of incongruity generation signal is output, the timing for sounding a specific musical instrument may be changed. For example, if a musical instrument that plays a melody is a musical instrument A, the musical instrument A produces a sound every sms. Other instruments produce the same or a fraction or multiple of this. In such a state, in the musical instrument A that plays the melody, at least one sound may be played in a state unrelated to the above timing.

  Further, the timing of the musical instrument may be shifted when a sense of incongruity generation signal is output. When playing the sound of each instrument, a delay may be inserted so that it does not sound simultaneously.

  In addition, when a sense of incongruity generation signal is output, at least one sound of the musical instrument that plays the melody may be randomly changed corresponding to the sensor signal. Thereby, music that does not become a song is generated.

  Moreover, you may make it perform the method of producing | generating the music which gives said unpleasant feeling repeatedly.

  In the above embodiment, it is determined whether or not the music tone is changed based on the RGB amount of the image of the camera that is the environment detection sensor. However, the present invention is not limited to this. You may make it determine whether a music tone is changed based on the output signal of another environment detection sensor. Moreover, you may make it determine whether a music tone is changed based on the output signal of a target detection sensor. For example, the tone of music may be changed according to an increase in the response of the target detection sensor.

10, 210, 310 Music reproduction device 18 Speed sensor 20 Sensor 20 ₁ Environment detection sensor 20 ₂ Target detection sensor 30 Music information generation unit 42 Risk determination unit 44, 344 Signal processing unit 46, 346 Music information generation unit 48, 348 Music information Composition unit 50 Musical tone change determination unit 60 Music output unit 220 GPS sensor 222 Map information acquisition unit 224 Map database 320 Music information input unit 330 Music information processing unit

Claims (4)

A risk determination means for determining the risk of collision or approach, or the risk of driving based on the state of the vehicle or the situation of the external environment of the vehicle;
When playing the music, if it is judged by the danger judging means that there is a risk of collision or approach, or a risk of driving, the scale of the sound in the music to be played, the chords to be played in the music, A changing means for changing at least one of a timing at which a musical instrument is played in the music and a performance speed of the musical instrument in the music;
A music playback device including: Music based on the output signal of the environment detection sensor that outputs a signal corresponding to the situation of the external environment of the vehicle or the output signal of the target detection sensor that outputs a signal indicating that the target exists in the external environment of the vehicle Music information generating means for generating information,
When the music is generated by the music information generating unit, the changing unit determines that the risk determining unit determines that there is a collision or approaching risk or a driving risk. The scale of the sound in the music information generated by the information generating means, the chord played in the music information, the timing of playing the sound of the instrument in the music information, and the performance speed of the instrument in the music information are changed. The music playback device according to 1. Music information generating means for generating music information based on the situation of the external environment of the vehicle obtained based on map information or the presence of an object in the external environment of the vehicle;
When the music is generated by the music information generating unit, the changing unit determines that the risk determining unit determines that there is a collision or approaching risk or a driving risk. The scale of the sound in the music information generated by the information generating means, the chord played in the music information, the timing of playing the sound of the instrument in the music information, and the performance speed of the instrument in the music information are changed. The music playback device according to 1. Computer
A risk judging means for judging the danger of a collision or approach, or the danger of driving based on the state of the vehicle or the external environment of the vehicle, and when playing music, the danger judging means If it is determined that there is a risk of collision or approach, or a risk of driving, the sound scale in the music to be played, the chords to be played in the music, the timing to play the sound of an instrument in the music, and the music A program for functioning as a changing means for changing at least one of the performance speeds of musical instruments.

Images