JP2013149133A - Notification device, notification method, and program therefor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a notification device, a notification method, and a program therefor that are capable of notifying a degree of achievement of a task using sound signals.SOLUTION: A notification device 1 comprises sound signal generation means 20, and task detection means 30. The sound signal generation means 20, in response to an execution request of a parent task, outputs a plurality of sound signals corresponding to a plurality of child tasks for realizing the parent task. The task detection means 30 detects that a child task has been executed. The sound signal generation means 20 stops a sound signal being output on the basis of the detection result of the task detection means 30.

Description

  The present invention relates to a notification device, a notification method, and a program thereof.

  There are too many items to check when checking the condition of the vehicle before starting or after driving (operating the parking brake, opening / closing the window, leaving the light on, etc.), pointing at the factory, etc. In some cases, the user is troublesome and neglects to check several items. Further, when the user operates the machine for the first time, there is a case where it is not known what to do and what to start from. As a result, a check omission occurs and a problem may occur when the vehicle is running.

  Conventionally, check items are displayed (visually displayed) on a poster or on a paper surface, and the user can check them in sequence while watching them, or operate the system according to the guidance voice. However, the visual display has a drawback that the line of sight is lost there. In the voice guidance, each guidance was long in time, and it took a considerable time to complete all the confirmations. In addition, the notification sound (operation reaction sound) is also a simple sound, and only one sound is generated each time the operation is performed. Therefore, even though the user recognizes that these checks are important, there are many omissions due to the fact that there are many simple tasks, which are bothersome and cannot be enjoyed.

  Patent Document 1 discloses a method of suggesting an action to a user only by hearing using sound localization. Further, Patent Document 2 discloses a method in which when a plurality of operations are performed toward setting a certain final target in device operation, the notification sound does not become annoying and the completion of the operation can be easily known. Yes. Furthermore, Patent Document 3 discloses a method that can properly notify the user of the state of the device by using different notification sounds according to the state of the device.

JP 2002-108602 A Japanese Patent No. 3962973 JP 2005-107425 A

  In the technique disclosed in Patent Document 1, auditory alerting is performed for one operation task (hereinafter referred to as a task), and if this is achieved, auditory alerting for the next task is continued. This auditory alert is repeated until the task is completed. It seemed that the user might continue this repetition forever, and stress was accumulated for the user.

  In the technique disclosed in Patent Document 2, it has not been known whether or not each of the plurality of tasks has been normally achieved unless the final sound of the phrase is waited. In the technique disclosed in Patent Document 3, a notification sound indicating the status of the device is output, but a notification sound indicating whether the task has been achieved by a user operation is not output.

  The present invention has been made to solve such a problem, and an object thereof is to provide a notification device, a notification method, and a program thereof that can notify the achievement level of a task using an acoustic signal.

The notification device (1) according to an aspect of the present invention includes an acoustic signal generating unit (1) that outputs a plurality of acoustic signals corresponding to a plurality of child tasks for realizing the parent task in response to a request to execute the parent task. 20) and detection means (task detection means 30) for detecting that the child task has been executed, and the acoustic signal generation means (20) is based on the detection result of the detection means (30). The acoustic signal being output is stopped.
Further, the notification device (1) according to one aspect of the present invention is based on a detection unit (30) that detects that a plurality of child tasks for realizing a parent task has been executed, and a detection result of the detection unit. And an acoustic signal generation means (20) for outputting an acoustic signal corresponding to the child task, wherein the acoustic signal generation means (20) detects the execution of the child task by the detection means (30). The acoustic signal is continuously output from when the parent task is realized, and when the parent task is realized, the output of the acoustic signal is stopped.
In the notification device (1), the acoustic signal generation means (20) may output a plurality of acoustic signals corresponding to a plurality of child tasks for realizing the parent task.
In the notification device (1), the acoustic signal generation means (20) may output a phrase sound by continuing a plurality of the acoustic signals corresponding to the plurality of child tasks.
In the notification device (1), when the child task is not executed within a predetermined time from the execution request of the parent task, the acoustic signal generating means (20) outputs the acoustic signal corresponding to the child task. You may output intermittently.
In the notification device (1), the acoustic signal generation means (20) is executed when the number of child tasks that are not executed among the plurality of child tasks for realizing the parent task is one. The acoustic signal corresponding to the child task that is not yet may be output intermittently.
In the notification device (1), an acoustic signal processing means (120) for localizing a sound image of the acoustic signal corresponding to the child task according to a position of a work object of the child task in the listening space for the acoustic signal. Further, it may be provided.
In the notification device (1), the acoustic signal processing means (120) is configured to output sound of the acoustic signal corresponding to the child task according to the position of the work object of the child task in the listening space for the acoustic signal. At least one of height, size, and rhythm may be changed.
In the notification device (1), the acoustic signal corresponding to the child task is lower in sound as the work object is located on the left side with respect to the front direction of the listening position in the listening space for the acoustic signal. Also good.
In the notification device (1), the rhythm of the acoustic signal corresponding to the child task is faster as the work object is located above the front direction of the listening position in the listening space of the acoustic signal. Also good.
In the notification device (1), the volume of the acoustic signal corresponding to the child task increases as the work object is positioned forward relative to the front direction of the listening position in the listening space for the acoustic signal. Also good.
The notification method according to an aspect of the present invention outputs a plurality of acoustic signals corresponding to a plurality of child tasks for realizing the parent task in response to a request to execute the parent task, and the child task is executed. This is detected, and the output acoustic signal is stopped based on the detection result.
The notification method according to an aspect of the present invention detects that a plurality of child tasks for realizing a parent task has been executed, and outputs the acoustic signal based on a detection result until the parent task is realized. When output is continuously performed and the parent task is realized, the output of the acoustic signal is stopped.
A program according to an aspect of the present invention includes a step of outputting a plurality of acoustic signals corresponding to a plurality of child tasks for realizing a parent task to a computer in response to a request to execute the parent task; Is executed, and the step of stopping the output acoustic signal is executed based on the detection result.
A program according to an aspect of the present invention is a method for detecting that a plurality of child tasks for realizing a parent task have been executed on a computer, and based on a detection result until the parent task is realized. The step of continuously outputting the acoustic signal and the step of stopping the output of the acoustic signal when the parent task is realized are executed.

  According to the present invention, it is possible to provide a notification device, a notification method, and a program thereof that can notify the achievement level of a task using an acoustic signal.

1 is a block diagram of a notification device according to a first exemplary embodiment. It is a figure which shows the identifier data of the parent task concerning Embodiment 1. FIG. It is a figure which shows the identifier data of the child task concerning Embodiment 1. FIG. 3 is a flowchart illustrating an operation of the notification device according to the first exemplary embodiment. It is a figure which shows the example of the alerting sound which the alerting | reporting apparatus concerning Embodiment 1 outputs. It is a figure which shows the example of the alerting | reporting sound corresponding to the child task concerning Embodiment 1. FIG. It is a figure which shows the example of the alerting sound which the alerting | reporting apparatus concerning Embodiment 1 outputs. It is a figure which shows the example of the alerting | reporting sound corresponding to the child task concerning Embodiment 2. FIG. It is a figure which shows the example of the alerting sound which the alerting | reporting apparatus concerning Embodiment 2 outputs. (A) shows the case where the child task is not executed. (B) shows a case where one child task is executed. (C) shows a case where two child tasks are executed. It is a block diagram of the alerting device concerning Embodiment 3. It is a figure which shows the example of the alerting | reporting sound and sound image position corresponding to the child task concerning Embodiment 3. It is a figure which shows the identifier data of the child task concerning Embodiment 3. FIG. 10 is a flowchart illustrating an operation of the notification device according to the third exemplary embodiment. It is a figure which shows the relationship between the position of the work target object of the child task concerning Embodiment 4, and alerting | reporting sound. It is a figure which shows the example of the alerting | reporting sound and sound image position corresponding to the child task concerning Embodiment 4. It is a figure which shows the example of the alerting sound which the alerting | reporting apparatus concerning Embodiment 4 outputs.

<Embodiment 1>
Embodiments of the present invention will be described below with reference to the drawings. A block diagram of a notification device 1 according to the present embodiment is shown in FIG. The notification device 1 includes a memory 10, an acoustic signal generation unit 20, and a task detection unit 30. In this Embodiment, the case where the alerting | reporting apparatus 1 is mounted in the vehicle is demonstrated. In addition to the notification device 1, the vehicle includes an engine 40, a parking brake 50, a gear 60, a seat belt 70, a light 80, a door mirror 90, and a speaker 100. In addition, in order for the vehicle to travel, other configurations are also necessary, and there may be other examples of configurations for performing the task detected by the task detection means, but in this embodiment, as an example While only the configuration shown in FIG. 1 will be described, a vehicle configuration not directly related to the present embodiment will be omitted.

  The memory 10 is, for example, a RAM (Random Access Memory) or a ROM (Read Only Memory), and an acoustic signal output as a notification sound, an identifier indicating a child task, an identifier indicating a notification mode (parent task), various tasks and processes. Stores a program or the like for executing. Here, the child task is a task to be executed in order to realize the parent task. A plurality of child tasks are associated with one parent task.

  FIG. 2 shows parent task identifier data. In the present embodiment, 3-bit data is used as an identifier for identifying the parent task. In FIG. 2, “before driving”, “inspection before driving”, and “end of driving” are stored as parent tasks. The identifier before starting operation (parent task number) is “000”, the identifier before “running inspection” is “011”, and the identifier of “end driving” is “111”.

  FIG. 3 shows child task identifier data. In the present embodiment, 2-byte (16 bits) data is used as the identifier of the child task. In FIG. 3, child tasks relating to the start and end of vehicle operation, such as “engine start” and “door mirror open”, are stored as child tasks. In the identifier of each child task, the upper 8 bits (b15 to b8) mean a child task number for identifying the child task. The sixth to eighth bits (b7 to b5) mean the parent task number (see FIG. 2) of the parent task corresponding to the child task. The 2nd to 5th bits (b4 to b1) are data (sound numbers) for identifying notification sounds (acoustic signals) assigned to the child tasks. That is, a corresponding notification sound is assigned to each child task. LSB (least significant bit b0) is data indicating whether the notification sound is generated or stopped. In FIG. 3, when the LSB is “1”, the notification sound is generated, and when the LSB is “0”, the notification sound is not generated. Note that the types and identification numbers of the parent task and the child task are not limited to those shown in FIGS.

  The acoustic signal generation means 20 is connected to the memory 10 and the task detection means 30 and is, for example, a CPU (Central Processing Unit). The acoustic signal generator 20 outputs an acoustic signal to the speaker 100.

  The task detection means 30 is a sensor that detects whether or not a child task has been executed by the user. Specifically, the task detection unit 30 is connected to the engine 40, the parking brake 50, the gear 60, the seat belt 70, the light 80, the door mirror 90, or a signal based on the operation thereof. It is detected whether each unit has been operated (operated) or the operation (operation) state of each unit.

  Next, the operation of the notification device 1 according to the present embodiment will be described with reference to the flowchart shown in FIG. In the following description, a case where the parent task “before starting operation” is realized will be described as an example. That is, when the driver (user) performs all operations (child tasks) that should be performed before the start of driving, the parent task is achieved.

  Specifically, in order to realize the parent task “before driving”, the child tasks “engine start”, “fasten seat belt”, “door mirror open”, “open door mirror”, “ It is necessary to execute six child tasks of “gear running mode”, “parking brake release”, and “light on (in the night)”. This is because these child tasks are necessary elements for driving the vehicle and must be executed.

  First, the driver turns on the electrical system using an engine key or the like. As a result, the vehicle is turned on, and the notification device 1 starts operating. That is, execution of the parent task “before starting operation” is requested. The acoustic signal generation means 20 sets the notification mode to the “before operation start” mode (parent task number “000”) which is an initial value (step S1).

  The acoustic signal generation means 20 reads all child tasks whose parent task number is “000” from the memory 10 (step S2). That is, the acoustic signal generation means 20 reads the above six child tasks.

  The acoustic signal generation means 20 rewrites the read LSB (ON / OFF identifier) of the child task identifier to “1” and stores it in the memory 10 (step S3).

  Next, the acoustic signal generating means 20 creates a notification sound for the child task whose LSB is “1” (step S4). Specifically, the acoustic signal generating means 20 creates a notification sound corresponding to the sound number with reference to the sound number assigned to the 2nd to 5th bits of the child task identifier.

For example, the acoustic signal generation means 20 obtains a frequency of 260 × 2 ^{(y / 12)} (Hz) and creates a sound of the obtained frequency, where Do 1 is 260 Hz and the sound number is y (decimal number). . In addition, when using any sound such as a musical instrument, the data of the arbitrary sound is stored in the memory 10 in advance, and the sound signal generating means 20 uses the sound stored in the memory 10 according to the sound number. The notification sound may be created by shifting the pitch. Of course, data in which the sound number of the child task and the notification sound are associated in advance may be stored in the memory 10, and the acoustic signal generation means 20 may read out the notification sound corresponding to the sound number.

  Then, the acoustic signal generation means 20 outputs all the notification sounds of the child tasks whose LSB is “1” to the speaker 100 (step S5). That is, the acoustic signal generator 20 outputs the notification sound corresponding to the child task in an overlapping manner. Thereby, the notification sound comprised by the chord shown in FIG. 5 sounds from the speaker 100 in the vehicle.

  At this time, the sounds constituting the chord shown in FIG. 5 (Do 1, Mi 1, So 1, Tsuyoshi 1, Re 2, So 2) correspond to child tasks, respectively. Specifically, the door 1 is “engine start”, the sound 1 is “fasten the seat belt”, the blade 1 is “door mirror open”, the lever 1 is “gear running mode”, and the lever 2 is “parking brake release”, Seo 2 corresponds to “lighting (at night)” (see FIG. 6). The number after the pitch name indicates an octave. For example, So2 means a sound one octave higher than So1.

  In a state where the chord notification sound shown in FIG. 5 is sounding, the driver starts the engine with an engine key or the like in order to start driving. Thereby, the engine 40 of the vehicle is started. When the engine 40 is started, the task detection unit 30 detects that the engine 40 has been started (step S6: Yes).

  The task detection means 30 sends the child task number (upper 8 bits of the child task identifier) where the task execution is detected to the acoustic signal generation means 20 as a detection signal (step S7). The acoustic signal generation means 20 sets the LSB of the child task corresponding to the received child task number to “0” (step S8). Thereby, the notification sound of the child task “engine start” is turned off.

  Then, the acoustic signal generating means 20 determines whether or not the LSBs of all the child tasks are set to “0” (step S9). In the above case, the child task whose LSB is set to “0” is only “engine start”, and the LSBs of the other child tasks are “1”. Therefore, the acoustic signal generation means 20 determines that the LSBs of all the child tasks are not set to “0” (step S9: No), and returns to the notification sound creation process in step S4.

  The acoustic signal generation means 20 again creates a notification sound for the child task whose LSB is set to “1” (step S4). That is, the notification sound corresponding to the child task “engine start” is not created, but only the notification sounds corresponding to the other child tasks are created. The acoustic signal generation means 20 outputs all the notification sounds of the child tasks whose LSB is “1” to the speaker 100 (step S5). In other words, the alarm sound 1 corresponding to the child task “engine start” is stopped, and a chord composed of the remaining five sounds (Mi 1, So 1, ♭ 1, Les 2, So 2) is output as the alarm sound. Is done.

  The acoustic signal generation means 20 repeats steps S4 to S9 according to the driver's operation (execution of the child task). Specifically, when the driver closes the seat belt, Mi 1 stops, when the door mirror is opened, Saw 1 stops, when the gear is set to travel mode, the lever 1 stops, and when the parking brake is released, the lever 2 stops. Stop and stop turning on the light. As described above, when each child task is achieved, the acoustic signal generating unit 20 stops the notification sounds corresponding to the child tasks one after another. When the LSBs of all the child tasks are set to “0” (step S9: Yes), the notification device 1 ends the notification process.

  Each detection method in the above-described acoustic signal generating means is not limited. Specifically, the engine start detection uses a signal output from a computer for controlling the engine of the vehicle. In addition, the detection that the seat belt is fastened uses an existing seat belt wearing detection signal that detects conduction between the seat belt and the buckle.

  The detection of opening the door mirror uses a signal from a switch for operating the door mirror, an IC for controlling the door mirror, or the like. Also, if the door mirror is already open when the engine is started, the child task detection process related to the door mirror may be skipped, and the So1 will be stopped without operating the door mirror after the child task for fastening the seat belt is completed. You may let them.

  The detection that the gear is in the traveling mode is based on the fact that the selected position of the gear is switched to a mode for traveling other than parking or neutral. Alternatively, it may be determined that the mode has been switched to the travel mode when a predetermined time has elapsed, such as 2 seconds or longer, after the mode has been switched to the travel mode.

  For detecting the release of the parking brake, an existing parking brake release detection signal such as a switch linked with the parking brake is used. In addition, regarding the child task of “lighting on”, whether or not the child task is necessary may be determined based on the time period when the parent task is executed or the illuminance by the illuminance sensor.

  As mentioned above, according to the structure of the alerting | reporting apparatus 1 concerning this Embodiment, the acoustic signal generation means 20 outputs the alerting sound corresponding to the child task which is not performed. The task detection means 30 detects the execution of the child task by the driver and notifies the acoustic signal generation means 20. And the acoustic signal generation means 20 stops the notification sound corresponding to the performed child task. That is, when all the sounds are gone, the operation before the start of driving is completed, and it can be seen that safe driving is possible. On the other hand, if at least one task has not been achieved, the task detection means 30 cannot detect the execution of the child task, and no detection signal is transmitted, so that a notification sound is emitted, and the driver can detect any task. Recognize that it has not been achieved. In other words, the driver can recognize the number of child tasks to be executed in order to realize the parent task based on the number of notification sounds that are ringing. That is, the notification device 1 can notify the driver of the achievement level of the parent task.

  The acoustic signal generation means 20 may output a chord at regular intervals. When the chord shown in FIG. 5 is repeatedly output, it actually sounds as “Jarn”, “Jarn”, or “Jarn”, but when the child task is achieved, the sound corresponding to the child task is stopped. Since the sounds that make up a chord decrease one by one, when one child task remains at the end, only one sound corresponding to that child task continues to sound. When the last child task is achieved, silence is achieved and safe operation can be started.

  At this time, if the last sound continues to sound, the last sound is steadily sounding, so it is buried in the surrounding environmental sound and is difficult for the driver to notice. In such a case, the acoustic signal generation means 20 repeats generation and stop of the last sound. Thereby, the last one sound becomes an intermittent sound. People are much more aware of changes. By making the last sound intermittent as described above, the driver can immediately notice that the child task still remains.

  In the above embodiment, the acoustic signal generating means 20 outputs a plurality of notification sounds corresponding to a plurality of child tasks simultaneously as chords, but is not limited thereto. As shown in FIG. 7, the notification sound may be output (arpeggio) by shifting at regular intervals.

  In this case, if the driver knows the correspondence between the child task and the notification sound, or remembers it as a habit, repeat the child task as soon as it sounds and stop the sound when it is achieved You can stop chasing. In this way, by shifting the notification sound and outputting the notification sound, the driver can enjoy the operation that tends to be neglected as if it were a game. In addition, since the number of sounds is reduced, the degree of achievement until the completion of the parent task can be instantly understood.

(Modification)
A modification according to the present embodiment will be described. In the above embodiment, the acoustic signal generation means 20 stops outputting the notification sound in response to the execution of the child task. However, even if the corresponding notification sound is output after the child task is executed, Good.

  For example, a case where the driver starts the engine will be described. The task detection means 30 detects that the engine has started. Then, the task detection unit 30 sends a detection signal to the acoustic signal generation unit 20. The acoustic signal generation means 20 reads the notification sound 1 corresponding to the child task “engine start” from the memory 10 and outputs it to the speaker 100. As a result, the driver can recognize that the child task has been executed.

  At this time, the acoustic signal generating means 20 continuously outputs the notification sound 1 until the six child tasks corresponding to the parent task “before driving” are realized. That is, the notification sound 1 continues to sound from the time when the execution of the child task “engine start” is detected until the parent task “before driving” is realized.

  Similarly, when the seat belt is fastened, the sound signal generating means continuously outputs the notification sound 1 (see FIG. 7). When the driver also executes other child tasks and all (six) child tasks are executed, all the sounds are arranged (becomes chords) and are stopped after a certain period of time. If at least one child task has not been achieved, the notification sound corresponding to the executed child task remains sounded and the driver tries to remember the task that has been neglected. That is, by continuously outputting the notification sound, the driver can recognize that there are remaining child tasks that are not executed.

  In addition, if the driver knows the notification sound (chord) with all the sounds, or remembers it by custom, the driver can recognize how many child tasks that are not executed remain. That is, the notification device 1 can notify the driver of the achievement level of the parent task. In addition, you can listen to a slow arpeggio if you perform a slow operation, and a fast arpeggio if you perform a quick operation.

<Embodiment 2>
A second embodiment according to the present invention will be described. Since the configuration of the notification device according to the present embodiment is the same as that of the notification device 1, the description thereof will be omitted as appropriate. In the first embodiment, the notification sound is a chord, but the present embodiment is different from the first embodiment in that the phrase is a good fit.

  As in FIG. 6, the notification sound corresponding to each child task is shown in FIG. Specifically, sound 1 is “engine start”, sound 1 is “fasten seat belt”, sound 1 is “door mirror open”, sound 1 is “gear running mode”, sound 1 is “parking brake” "Release", sound 1 corresponds to "lights on (in the night)".

  The acoustic signal generating means 20 outputs a phrase composed of six sounds shown in FIG. For example, as shown in FIG. 9A, the sound is output while being shifted by a certain time for each sound. That is, the acoustic signal generation means 20 outputs a phrase sound by making six sounds continuous. When the last sound (Do 1) is output, the phrase returns to the first sound (Mi 1) again and the phrase output is repeated. The sound signal generation means 20 sequentially stops sounds corresponding to the child tasks whose task execution has been detected by the task detection means 30.

  For example, when the driver starts the engine, the task detection unit 30 detects this and sends a detection signal to the acoustic signal generation unit 20. The acoustic signal generating means 20 stops the notification sound mi 1 corresponding to the child task “engine start”. For this reason, the phrase of the notification sound is the phrase shown in FIG. 9B, and this is repeated.

  Next, when the driver opens the door mirror, the task detection means 30 detects this and sends a detection signal to the acoustic signal generation means 20. The sound signal generation means 20 stops the notification sound 1 corresponding to the child task “open door mirror”. The phrase of the notification sound is the phrase shown in FIG. 9C, and this is repeated.

  As described above, according to the configuration of the notification device according to the present embodiment, the acoustic signal generation unit 20 outputs a plurality of sounds corresponding to a plurality of child tasks while shifting each sound by a certain time. For this reason, the notification sound output from the speaker 100 is a phrase with a good fit. Then, the task detection unit 30 detects the execution of the child task, and the acoustic signal generation unit 20 stops the notification sound corresponding to the child task. In other words, the phrase is played until all tasks are achieved by the driver, and the sound stops sounding when all tasks are achieved. Thereby, the driver can recognize that the driving can be started safely. Of course, also in this embodiment, the number of sounds of the phrase is the number of remaining child tasks to be executed. Therefore, the driver can recognize the achievement level of the parent task.

  Also, if the driver changes the order every time and executes six child tasks, a different phrase sounds each time. Therefore, the driver can enjoy working on the task without getting bored each time. Alternatively, the driver learns the correspondence between the notification sound and the child task by getting used to the execution of the child task. When the correspondence between the notification sound and the child task is acquired, the child tasks are executed in the order in which the notification sound is output in order to stop the sound stop in order from the first sound. It can also be executed in order from the child task of the notification sound. For this reason, the driver can actively tackle tasks that tend to be lazy as if they were games.

  In addition, in the case of a parent task that needs to consider the execution order of child tasks, notification sounds corresponding to the child tasks may be played in order in accordance with the order of the child tasks to be executed. Thereby, in addition to the degree of achievement until the completion of the parent task, the execution order of the child tasks can also be notified.

  The notification sound corresponding to one child task is not limited to one sound and may be two or more sounds. Since two or more sounds are associated with one child task, a more melodic phrase can be output. As a result, the driver can further enjoy the child task.

<Embodiment 3>
A third embodiment according to the present invention will be described. A notification device 3 according to the present embodiment is shown in FIG. The notification device 3 includes acoustic signal processing means 120 in addition to the configuration of the notification device 1 shown in FIG. The vehicle further includes a reflecting unit 110 and a camera 130 in addition to the configuration shown in FIG. The other configuration is the same as the configuration of FIG.

  The acoustic signal processing unit 120 performs arithmetic processing on the acoustic signal output from the acoustic signal generating unit 20 to the speaker 100 so that the position of the sound image of the notification sound designated by the acoustic signal generating unit 20 is a predetermined position. Do. Specifically, the acoustic signal processing unit 120 localizes the sound image of the notification sound corresponding to the child task according to the position of the work object of the child task in the notification sound listening space. The work object is an object that is operated or visually observed to execute a child task.

  The reflection unit 110 reflects the notification sound output from the speaker 100. That is, the notification sound output from the speaker 100 reaches the driver's ear via the reflection unit 110. In the present embodiment, reflection unit 110 is a windshield of a vehicle, but may be another glass, an interior of a vehicle body, a reflection member, an in-vehicle device, or the like.

  The camera 130 images the driver's eyes. The camera 130 recognizes and monitors the driver's line of sight based on, for example, the position of the driver's black eyes. Then, the camera 130 outputs information related to the direction of the driver's line of sight to the task detection unit 30.

  In the present embodiment, it is assumed that the parent task is “pre-travel inspection” (parent task number “011”). The child tasks are “right door mirror confirmation”, “left door mirror confirmation”, “room mirror confirmation”, and “right door mirror confirmation 2”. “Right door mirror confirmation 2” means reconfirmation of the right door mirror.

  Here, the pitch of the sound and the human perceived position will be described. Generally, a keyboard instrument such as a piano has a bass on the left side and a treble on the right side. As for the perception in the vertical direction, it has been found in the past experiment (spatial acoustics by Jens Brauert et al., P.88 to p.111) that it can be heard upward if a high frequency of 4800 Hz or higher is included. Regarding the front and rear, a low frequency (about 125 to 500 Hz) determines the front, and a high frequency (1 to 2 kHz) determines the rear direction.

  FIG. 11 shows a correspondence relationship between the notification sound and the sound image position with respect to the above four child tasks based on the human perceived position. The notification sound of the child task “confirm right door mirror” is “3” and the sound image position is “1”. That is, the notification sound for the child task located on the right side is higher than the notification sound corresponding to the child task located on the left side of the driver. The notification sound of the child task “confirm left door mirror” is de 1 and the sound image position is 3. The notification sound of the child task “room mirror confirmation” is “2”, and the sound image position is “2”. The notification sound of the child task “right door mirror confirmation 2” is “3”, and the sound image position is “1”. At this time, the sound image position is information for designating the position of the sound image of the notification sound in the vehicle. In the present embodiment, for convenience of explanation, the position of the right door mirror is 1, the position of the room mirror is 2, and the position of the left door mirror is 3. That is, the sound image of the notification sound is positioned on the work object of the child task. As a result, the driver can easily recognize the position of the work object of the child task. Of course, the notification sound listening space (inside the vehicle) may be expressed by xyz-axis coordinates, and the sound image position may be indicated by coordinates.

  FIG. 12 shows the identifier data of the child task. The upper bits (b15 to b13) of the identifier indicate the child task number. The 11th to 13th bits (b12 to b10) indicate the parent task number. In the present embodiment, the child task having the parent task number “011” corresponding to “pre-travel check” is selected. The seventh to tenth bits (b6 to b9) indicate sound image positions. The second to sixth bits (b5 to b1) indicate a sound number. LSB (b0) indicates whether the notification sound is generated or stopped.

  Next, the operation of the notification device 3 according to the present embodiment will be described with reference to the flowchart shown in FIG. Note that the driver must perform a safety check around the vehicle before traveling when the parent task “before driving” ends. Therefore, the notification mode is set to “pre-travel check” by a vehicle control means (not shown) (step S11). Specifically, the notification mode is set to “011”.

  Next, the acoustic signal generation means 20 reads information on the child task whose parent task number is “011” from the memory 10 (step S12). The acoustic signal generating means 20 rewrites the LSB of the child task identifier of the pre-travel check to “1” and stores it in the built-in memory (step S13).

  Creation of the notification sound output from the acoustic signal generating means 20 is performed by the acoustic signal processing means 120. The acoustic signal processing means 120 generates a sound image localization signal that is arithmetically processed so that it can be heard at the designated sound image position when the driver listens, and sends the acoustic signal to the acoustic signal generation means 20 (step S14). The acoustic signal generating means 20 that has received the sound image localization signal outputs the sound image localization signal to the speaker 100 one sound at a time from the sound having a small child task number (step S15). The output signal reaches the driver's ear via the reflector 110.

  Here, the arithmetic processing of the acoustic signal processing means 120 will be described in detail. The acoustic signal processing means 120 performs arithmetic processing so that the listener (driver) can hear the sound image position designated when listening to the sound. The arithmetic processing method may be so-called panning in which sound signals are allocated with a level difference to a plurality of car stereo speakers 100, or sound image localization signal processing using a head-related transfer function may be performed.

  However, the in-vehicle sound field has many reflecting surfaces, and the sound image may not be perceived at the designated position by the above method. Therefore, two speakers are set toward the windshield as the reflection unit 110, and a dedicated calculation filter is created to perform calculation. Specifically, the acoustic signal processing means 120 creates acoustic signals for the driver's right ear and left ear so that the notification sound can be heard from a predetermined sound image. Then, a crosstalk cancellation process is performed so that the acoustic signals for the right ear and the left ear are reflected on the windshield and reach the driver's ear. The sound image position identifier is the same as the filter number stored in the built-in memory of the acoustic signal processing means 120, and these filters are head-related transfer functions in the vehicle from the sound image position to the driver.

  The acoustic signal generator 20 outputs notification sounds in the order of the child task numbers. Specifically, after the driver hears a high do (do 3) at the right door mirror position, a low do (do 1) hears at the left door mirror position. Next, do (do 2) having a height in between is heard from the position of the room mirror, and finally, a high do (do 3) is heard from the position of the right door mirror. Such a phrase can be heard repeatedly by the driver. The driver performs a safety check as prompted by the sound.

  The camera 130 monitors the driver's line of sight. When the camera 130 detects that the driver's line of sight is directed to the right door mirror for the first time after the start of the “pre-run check” notification mode (step S16: Yes), the task detection means 30 sends a child task number “000” to the right door mirror. The detection signal "is sent (step S17). Then, the acoustic signal generation means 20 sets the LSB of the child task for right door mirror confirmation to “0” (step S18). If the LSBs of all child tasks are “0” (step S19: Yes), the notification is terminated. On the other hand, when the child task whose LSB is “1” remains (step S19: No), the acoustic signal generation means 20 outputs the notification sound of the child task whose LSB is “1” in the order of the child task number. .

  As described above, according to the configuration of the notification device 3 according to the present embodiment, the acoustic signal processing unit 120 performs arithmetic processing on the acoustic signal so that the sound image is positioned on the work object of the child task. Therefore, the driver can hear a notification sound from the position of the work target of the child task. As a result, the driver can easily grasp the position of the work object of the child task and can recognize what to do instantly.

  The acoustic signal generator 20 changes the pitch of the notification sound based on the pitch of the sound and the human perceived position. For this reason, the driver can grasp the position of the child task more easily. In addition, the acoustic signal generating means 20 outputs a notification sound in accordance with the execution order of the child tasks. Therefore, the driver can easily recognize the execution order of the child tasks.

<Embodiment 4>
A fourth embodiment according to the present invention will be described. Since the configuration of the notification device according to the present embodiment is the same as that of the notification device 3, the description thereof will be omitted as appropriate. In the third embodiment, the pitch of the notification sound is associated with the position of the work object of the child task. However, in this embodiment, the loudness and rhythm of the notification sound are also the work object of the child task. The point which is matched with the position of is different.

  Here, the relationship between the position of the work object of the child task and the notification sound is shown in FIG. At this time, it is assumed that the listening position 200 (for example, the center of the driver's seat or the vehicle interior space) in the listening space (dashed space) is located at the intersection (origin) of each axis in FIG. Regarding the left and right axes, the notification sound corresponding to the child task is lower as the work object is positioned on the left side with respect to the front direction of the listening position 200 (the direction of the dotted line arrow in FIG. 14). That is, the notification sound is higher in the child task in which the work object is located on the right side of the listening position 200 than in the child task in which the work object is located on the left side of the listening position 200.

  As for the upper and lower axes, the rhythm of the notification sound corresponding to the child task becomes faster as the work object is located on the upper side with respect to the front direction of the listening position 200. That is, the rhythm of the notification sound is slower in the child task in which the work object is located below the listening position 200 than in the child task in which the work object is located above the listening position 200.

  As for the front and rear axes, the volume of the notification sound corresponding to the child task increases as the work object is positioned forward relative to the front direction of the listening position 200. That is, the volume of the notification sound is lower in the child task in which the work object is located behind the listening position 200 than in the child task in which the work object is located in front of the listening position 200. Thus, the pitch, rhythm, and magnitude of the notification sound change according to the position of the work object of the child task in the listening space.

  In the present embodiment, it is assumed that the parent task is “operation completion check” (parent task number “111”). Then, the child task “apply the parking brake”, “turn off the light”, “close the left front window”, “close the right front window”, “close the right rear window” and “close the left rear window” It is assumed that it is “cut”.

  The notification sound and the sound image position corresponding to the child task are shown in FIGS. The notification sound of the child task “apply the parking brake” is the score 1, and the half note 1 is continuously output. The notification sound of the child task “turn off the light” is the score 2, and the eighth note do 2 is output continuously. The notification sound of the child task “close the left front window” is the score 3, and the quarter notes do 1 and mi 1 are output as loud sounds (forte). The notification sound of the child task “close the right front window” is the score 4, and the quarter notes do 2 and mi 2 are output with a loud sound. The notification sound of the child task “close the right rear window” is the score 5, and the quarter notes do 2 and mi 2 are output as small sounds (piano). The notification sound of the child task “close the left rear window” is the score 6, and the quarter notes do 1 and mi 1 are output with a small sound. The notification sound of the child task “turn off the engine” is the score 7, and the eighth note “1” is continuously output. Note that the sound signal generation means 20 adjusts the pitch, magnitude, and rhythm of the notification sound. Regarding the sound image position, the acoustic signal processing means 120 performs arithmetic processing so that the sound image comes to the position of the work object of each child task.

  The difference between the above scores 1, 2, and 7 will be described. In the vertical direction, the engine key and the light switch are positioned above the parking brake. Therefore, the notification sounds of the child tasks “turn off the engine” and “turn off the light” are notification sounds of a rhythm faster than the child task “apply the parking brake”. In the left-right direction, the parking brake, engine key, and light switch are arranged from the left. Therefore, the notification sounds are high in the order of “apply the parking brake”, “turn off the engine”, and “turn off the light”.

  The difference between the above scores 3-6 will be described. In the left-right direction, the left front window and the left rear window are located on the left side of the right front window and the right rear window. Therefore, the notification sounds of the child tasks “close the left front window” and “close the left rear window” are lower than the notification sounds of the child tasks “close the right front window” and “close the right rear window”. Further, in the front-rear direction, the left front window and the right front window are positioned in front of the left rear window and the right rear window. Therefore, the notification sounds of the child tasks “close the left front window” and “close the right front window” are louder than the notification sounds of the child tasks “close the left rear window” and “close the right rear window”.

  As described above, according to the configuration of the notification device according to the present embodiment, the acoustic signal generation means 20 notifies the notification according to the position of the work object (engine key, parking brake, light switch, etc.) of the child task. Change sound attributes (pitch, rhythm, loudness). Thereby, the driver can easily grasp the position of the work object of the child task.

  The present invention is not limited to the above-described embodiment, and can be appropriately changed and combined without departing from the spirit of the present invention. For example, in the above-described embodiment, the task in driving the vehicle is handled, but the present invention is not limited to this. It goes without saying that it can also be applied to tasks such as equipment guidance when driving for the first time such as a rental car, handling of machines such as factories, operation of home appliances, locking of homes and offices, etc.

  Furthermore, the above-described notification method processing (for example, the processing in FIGS. 4 and 13) is programmed in a computer including a DSP (Digital Signal Processor), MPU (Micro Processing Unit), CPU (Central Processing Unit), or a combination thereof. You may implement | achieve by performing.

  In the above-described example, for example, a program including a group of instructions for causing a computer to perform the notification method is stored using various types of non-transitory computer readable media. Can be supplied to. Non-transitory computer readable media include various types of tangible storage media. Examples of non-transitory computer-readable media include magnetic recording media (for example, flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (for example, magneto-optical disks), CD-ROMs (Read Only Memory), CD-Rs, CD-R / W, semiconductor memory (for example, mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, RAM (Random Access Memory)) are included. The program may also be supplied to the computer by various types of transitory computer readable media. Examples of transitory computer readable media include electrical signals, optical signals, and electromagnetic waves. The temporary computer-readable medium can supply the program to the computer via a wired communication path such as an electric wire and an optical fiber, or a wireless communication path.

1, 3 Notification device 10 Memory 20 Acoustic signal generating means 30 Task detecting means 40 Engine 50 Parking brake 60 Gear 70 Seat belt 80 Light 90 Door mirror 100 Speaker 110 Reflector 120 Acoustic signal processing means 130 Camera

Claims (15)

An acoustic signal generating means for outputting a plurality of acoustic signals corresponding to a plurality of child tasks for realizing the parent task in response to an execution request of the parent task;
Detecting means for detecting that the child task has been executed,
The sound signal generation means stops the sound signal being output based on a detection result of the detection means. A detecting means for detecting that a plurality of child tasks for realizing the parent task are executed;
An acoustic signal generating means for outputting an acoustic signal corresponding to the child task based on a detection result of the detecting means;
The acoustic signal generating means continuously outputs the acoustic signal from when the detection means detects the execution of the child task until the parent task is realized, and when the parent task is realized, A notification device characterized by stopping output of the acoustic signal.   The notification device according to claim 1, wherein the acoustic signal generation unit outputs a plurality of the acoustic signals corresponding to the plurality of child tasks for realizing the parent task in an overlapping manner.   The notification device according to claim 1, wherein the acoustic signal generation unit outputs a phrase sound by continuing a plurality of the acoustic signals corresponding to the plurality of child tasks.   The acoustic signal generation means intermittently outputs the acoustic signal corresponding to the child task when the child task is not executed within a predetermined time from the execution request of the parent task. The notification device according to Item 1.   When the number of child tasks that are not executed among the plurality of child tasks for realizing the parent task becomes one, the acoustic signal generation means corresponds to the acoustic signal that corresponds to the child task that is not executed. The notification apparatus according to claim 1, wherein the information is output intermittently.   The apparatus according to claim 1, further comprising: an acoustic signal processing unit that localizes a sound image of the acoustic signal corresponding to the child task according to a position of a work target of the child task in a listening space for the acoustic signal. The notification device according to claim 6.   The acoustic signal processing means is configured to at least one of a pitch, a loudness, and a rhythm of the acoustic signal corresponding to the child task according to the position of the work object of the child task in the listening space for the acoustic signal. The notification device according to any one of claims 1 to 7, wherein one of them is changed.   9. The acoustic signal corresponding to the child task is a lower sound as the work object is located on the left side with respect to the front direction of the listening position in the listening space of the acoustic signal. The notification device described.   9. The rhythm of the acoustic signal corresponding to the child task is faster as the work object is positioned above the front direction of the listening position in the listening space of the acoustic signal. 9. The notification device according to 9.   The volume of the acoustic signal corresponding to the child task is larger as the work object is located in front of the front direction of the listening position in the listening space for the acoustic signal. The notification device according to any one of 10. In response to the execution request of the parent task, output a plurality of acoustic signals corresponding to a plurality of child tasks for realizing the parent task,
Detects that the child task has been executed,
A notification method characterized by stopping the output acoustic signal based on a detection result. Detects that multiple child tasks for realizing the parent task have been executed,
Until the parent task is realized, based on the detection result, continuously output the acoustic signal,
When the parent task is realized, output of the acoustic signal is stopped. On the computer,
Outputting a plurality of acoustic signals corresponding to a plurality of child tasks for realizing the parent task in response to an execution request of the parent task;
Detecting that the child task has been executed;
Stopping the output acoustic signal based on the detection result;
A program characterized by having executed. On the computer,
Detecting the execution of a plurality of child tasks for realizing the parent task;
Continuously outputting the acoustic signal based on a detection result until the parent task is realized;
When the parent task is realized, stopping the output of the acoustic signal;
A program characterized by having executed.

Images