JPWO2007055259A1 - NAVIGATION DEVICE, NAVIGATION METHOD, NAVIGATION PROGRAM, AND ITS RECORDING MEDIUM - Google Patents

Abstract

The music tone extraction unit 112 of the control unit 110 extracts the music tone of the music that can be a factor affecting human emotion from each element of the music meta information associated with the music played by the content playback unit 111. Then, the voice guide reproducing unit 113 of the control unit 110 reads out the voice guide data corresponding to the musical tone extracted by the musical tone extracting unit 112 from the voice guide data storage area 123 of the hard disk device 120 and reproduces the corresponding voice guide. To do. As a result, voice guidance considering the emotional state of the user can be performed in a simple form.

Description

  The present invention relates to a navigation device, a navigation method, a navigation program, and a recording medium thereof.

  2. Description of the Related Art Conventionally, navigation devices that are mounted on a moving body such as a vehicle and provide navigation information such as map information about a moving route have been widely used. The evolution of such navigation device technology has been remarkable, and in recent years, for example, a technology has been proposed in which an accurate behavior pattern related to navigation operations, etc. is presented to the user in an audiovisual manner by estimating the emotional state of the user. Has been.

  As a navigation device equipped with such a function to grasp the emotional state of the user, for example, acquired by the user's “body temperature” acquired by the temperature sensor installed on the seat of the driver's seat or the pressure sensor installed on the handle Based on the user's “hand movement”, etc., a method for comprehensively determining the emotional state related to the user's emotions (see Patent Document 1; hereinafter referred to as “conventional example”) has been proposed. . By applying this conventional technique, for example, provision of a new technique such as performing voice guidance according to the estimated emotional state can be expected.

Japanese Patent Laid-Open No. 2002-73634

  However, in the technology of the conventional example, when the emotion state of the user is estimated, a contact type sensor such as a temperature sensor or a pressure sensor is used. Therefore, the user must be in contact with these sensors. For example, problems such as annoyance are felt. In addition, the use of these contact type sensors can be cited as an example of problems such as a complicated configuration of the entire apparatus.

  The present invention has been made in view of the circumstances as described above, and an object thereof is to perform voice guidance in a simple form in consideration of the emotional state of a user.

  According to a first aspect of the present invention, content reproducing means for reproducing multimedia content; and feature quantities estimated to reflect human emotions from the multimedia content reproduced by the content reproducing means Feature amount extracting means for extracting audiovisual data; audiovisual data storage means for storing audiovisual data each representing a presentation form of audiovisual information corresponding to the type of emotion of the person; and an event to present the audiovisual information to a user Audio-visual information reproducing means for reading audio-visual data corresponding to the feature quantity extracted by the feature quantity extraction means from the audio-visual data storage means and reproducing the corresponding audio-visual information when the occurrence occurs. This is a featured navigation device.

  According to a second aspect of the present invention, there is provided a feature amount extraction step for extracting a feature amount estimated to reflect a human emotion from multimedia content; an event for presenting audiovisual information to a user And an audiovisual information reproducing step of reproducing audiovisual information having a presentation form corresponding to the type of human emotion based on the feature amount extracted in the feature amount extraction step. It is a navigation method.

  According to a third aspect of the present invention, there is provided a navigation program characterized by causing a calculation means of a navigation device to execute the navigation method of the present invention described above.

  According to a fourth aspect of the present invention, there is provided a recording medium on which a navigation program is recorded, wherein the navigation program of the present invention is recorded so as to be readable by a calculation means of the navigation device.

It is a functional block diagram which shows the internal structure of the navigation apparatus which concerns on one Embodiment of this invention. It is a figure which shows an example of the music meta information element memorize | stored in the music meta information storage area of FIG. It is a figure which shows the correspondence between the extracted music tone and the word usage set to audio | voice guide data. It is a flowchart for demonstrating the audio | voice guidance process performed in the control unit of FIG. It is a figure which shows an example of the voice guide form when the extraction music tone is set to "bright" in the voice guide process of FIG. It is a figure which shows an example of the voice guide form when the extraction music tone is set to "sad" in the voice guide process of FIG.

  Hereinafter, an embodiment of the present invention will be described with reference to FIGS. In the present embodiment, a navigation device related to traveling as a movement of a vehicle or the like that is a moving body will be described as an example. In addition, it is assumed that the media data handled by the navigation device of the present embodiment is music data, the multimedia content to be played is music, and the audiovisual information presented to the user is an audio guide.

[Constitution]
FIG. 1 is a block diagram showing the configuration of the navigation device 100 according to this embodiment. As shown in FIG. 1, the navigation device 100 includes a control unit 110, a hard disk device 120, an optical disk drive device (“recording medium reading means” according to the present invention) 130, an operation input unit 140, an audio An input unit 150, an image display unit 160, an audio output unit 170, a travel sensor unit 180, a GPS (Global Positioning System) receiving unit 190, and a media broadcast receiving unit 200 are provided. Elements 120 to 200 other than the control unit 110 are connected to the control unit 110, respectively.

  The control unit 110 performs overall control of the navigation device 100 and also functions as a calculation unit to perform overall navigation processing. The control unit 110 includes a central processing unit (CPU), a read only memory (ROM), a random access memory (RAM), and the like, and executes various programs. It has come to be.

  The control unit 110 executes a program to execute (i) a content reproduction unit (“content reproduction unit” according to the present invention) 111 and (ii) a music tone extraction unit (“feature amount extraction unit” according to the present invention). 112, and (iii) a function as a voice guide reproducing unit ("audiovisual information reproducing means" according to the present invention) 113.

  The content playback unit 111 has a function of controlling playback of various multimedia contents. The content playback unit 111 can be accessed by the music data designated by the user, that is, (i) music data that is media data stored in advance in the hard disk device 120, or (ii) the optical disk drive device 130. The music data which is the media data recorded on the recording medium RM is read out. Then, the content playback unit 111 plays back the music that is the multimedia content specified by the user through the audio output unit 170 using the read music data.

  The music tone extraction unit 112 extracts the music tone of the corresponding music as a feature amount estimated to reflect human emotion from each element of the meta information associated with the music played by the content playback unit 111. It has a function. Basically, every time the content reproduction unit 111 is instructed to reproduce a new piece of music, the music piece extraction unit 112 extracts a necessary piece of music in real time from the meta information related to the piece of music and sequentially updates it. The music tone extraction unit 112 also has a function of holding the music tone extracted with respect to the music played last by the content playback unit 111 until a new music is played back or until a predetermined time elapses.

  The voice guide playback unit 113 has a function of playing back a voice guide having an utterance form corresponding to the tune of the music extracted by the tune extraction unit 112 when an event for performing a voice guide occurs for the user. As an event for which voice guidance should be performed, for example, when the user designates a change in the travel route of the vehicle, there is a pressing operation by a user of an unillustrated speech button in the operation unit 140. In addition, an escape route notice (point recognition automatically performed by the apparatus itself) before the vehicle enters a road junction such as an intersection is also an event for which voice guidance is to be performed.

  The hard disk device 120 stores a program executed by the control unit 110 and stores various data such as music data, music meta information, voice guide data, and map data, which will be described later. The control unit 110 can access the storage area of the hard disk device 120, and can write and read data to and from the storage area.

  The hard disk device 120 includes a music data storage area ("media data storage means" according to the present invention) 121, a music meta information storage area ("meta information storage means" according to the present invention) 122, and a voice guide data storage area. ("Audiovisual data storage means" according to the present invention) 123 and a map data storage area 124 are set.

  The music data storage area 121 is an area for storing music data related to a plurality of music pieces in advance. Here, the content playback unit 111 of the control unit 110 functions to read music data related to music specified by the user through the operation input unit 140 from the music data storage area 121 and to play back the corresponding music. As a file format of the music data, for example, MP3 (MPEG-1 (Moving Picture Experts Group-1) Audio Layer 3) can be applied.

  The music meta information storage area 122 is an area for storing in advance a plurality of music meta information respectively associated with a plurality of music data stored in the music data storage area 121. Here, the music tone extraction unit 112 of the control unit 110 functions to read the music meta information related to the music reproduced by the content reproduction unit 111 from the music meta information storage area 122 and extract a required music tone. As the format of the music meta information, when MP3 is applied to the file format of the music data, an ID3 (Identification 3) tag, which is meta information attached to the MP3 file, can be applied as it is (hereinafter referred to as the music meta information format). , Assuming application of MP3 files and ID3 tags).

  For example, as shown in FIG. 2, the music meta information storage area 122 includes (i) an ID3 area 122A for storing basic elements of the ID3 tag for each music, and (ii) the ID3 tag. A write-once area 122B for additionally storing other elements that are not necessary is set. Here, elements such as “song name”, “artist name”, “album name”, “genre” and the like relating to the corresponding music are stored as the ID3 area 122A, and “BPM ( An example in which elements such as “Beats Per Minute)”, “average volume”, and “tonality” are stored is shown. Each element of the additional recording area 122B contributes to optimization of music tone extraction by the music tone extraction unit 112.

  Returning to FIG. 1, the voice guide data storage area 123 is an area for storing a plurality of voice guide data each representing an utterance form corresponding to the type of human emotion.

  Here, as shown in FIG. 3, the music tone extraction unit 112 of the control unit 110 determines the music tone of the music currently being played by the content playback unit 111 based on each element of the music meta information storage area 122. It extracts whether it corresponds to “sounding tone”, “bright tone”, “healed tone”, “quiet tone”, or “sad tone”. Then, the voice guide reproduction unit 113 of the control unit 110 uses the “preferred words” (most “Positive”), “bright words”, “healed words” as voice guide data corresponding to the extracted tunes. One of “use”, “quiet use of words”, and “use of sad words (most“ Negative ”)” is read from the voice guide data storage area 123 and the corresponding voice guide is reproduced through the voice output unit 170.

  Note that if an event that requires voice guidance occurs before a predetermined time has elapsed since the music was last played by the content playback unit 111, the voice guide playback unit 113 is held by the music tone extraction unit 112 until the present time. It functions to play the corresponding voice guide corresponding to the tune to be played. Further, when an event for performing voice guidance occurs after the predetermined time has elapsed, the voice guide reproducing unit 113 reproduces a default voice guide (for example, “Normal” “healed words”). It has become.

  Returning to FIG. 1, the map data storage area 124 stores map data used in navigation processing for realizing a navigation function, which is a basic function of the navigation device 100, as a DVD-ROM (Digital Video Disk-Read Only Memory). This is an area that is introduced from a recording medium or the like and held. The voice guide data for each word usage stored in the voice guide data storage area 123 is stored in the map data storage area 124 with respect to the voice guide data for the above-mentioned exit route notice when entering the road junction. Correlation is made with point information on the map data.

  The optical disk drive device 130 can access any recording medium RM such as a CD (Compact Disc) or a DVD-ROM in which music data (MP3 file) and music meta information (ID3 tag) associated therewith are recorded. Is. Here, the optical disk drive device 130 transfers the music data read from the recording medium RM to the content reproduction unit 111 of the control unit 110 regarding the music specified by the user through the operation input unit 140. At this time, the content reproduction unit 111 performs a reproduction process of the transferred music data, and also transfers the music meta information attached to the music data to the music tone extraction unit 112, which is used in the music tone extraction unit 112. Used for music tone extraction.

  The operation input unit 140 includes a key unit provided in the main body of the navigation device 110, a remote input device including the key unit, and the like. Here, both the key units are equipped with speech buttons for causing the voice input unit 150 and the voice output unit 170 to function when the user designates a change in the travel route of the vehicle. Moreover, as a key part provided in the main body part, a touch panel provided in a display device of the image display unit 160 can be used. When the user operates the operation input unit 140, the operation content of the navigation device 100 is set. For example, in addition to destination setting, information search setting, vehicle running status display setting, and the like, music reproduction designation including designation of a reproduction target medium (hard disk device 120 or recording medium RM) corresponds to this. The above input contents are sent from the operation input unit 140 to the control unit 110.

  The voice input unit 150 includes a voice recognition device that recognizes the content of the user's utterance. The voice recognition result at this time is sent from the voice input unit 150 to the control unit 110, and the control unit 110 executes command processing related to, for example, a route change (different route search) based on the voice recognition result.

  The image display unit 160 is based on (i) a display device such as a liquid crystal display panel, an organic EL (Electro Luminescence) panel, a PDP (Plasma Display Panel), and (ii) display control data sent from the control unit 110. The image display unit 160 includes a display controller such as a graphic renderer that controls the entire image display unit 160, and (iii) a display image memory that stores display image data. This image display unit 160 displays map information, route information, operation guidance information, and the like under the control of the control unit 110, and is applicable when the multimedia content reproduced by the content reproduction unit 111 is composed of image data. The image to be displayed is also displayed.

  The voice output unit 170 is amplified through a voice synthesizer or a voice amplifier for synthesizing a response voice (voice guide) at the time of a command response by the control unit 110 (response to the pressing operation of the utterance button in the operation input unit 140). A speaker that converts the synthesized voice signal into voice and emits it outside is provided. Under the control of the control unit 110, the sound output unit 170 outputs a voice guide related to the traveling direction of the vehicle, the traveling situation, the traffic situation, the command response, etc., and outputs the music reproduced by the content reproducing unit 111. .

  The travel sensor unit 180 includes (i) a speed sensor that detects a moving speed of the vehicle, (ii) an azimuth angle sensor that detects an azimuth angle that is a vehicle traveling direction, and (iii) detects an acceleration that acts on the vehicle. An acceleration sensor. Here, the speed sensor detects, for example, a pulse signal or a voltage value output by rotation of an axle or a wheel. The azimuth angle sensor is configured as a so-called gyro sensor, for example, and detects the azimuth angle. The acceleration sensor detects, for example, gravitational acceleration. Such a detection result is sent from the traveling sensor unit 180 to the control unit 110.

  The GPS receiving unit 190 calculates a pseudo coordinate value of the current position of the vehicle based on reception results of radio waves from a plurality of GPS satellites, and reports it to the control unit 110. The GPS receiving unit 190 measures the current time based on the time transmitted from the GPS satellite and sends this to the control unit 110.

  The media broadcast receiving unit 200 includes, for example, a terrestrial digital broadcast receiver, an FM (Frequency Modulation) multiplex broadcast receiver, and the like. The media broadcast receiving unit 200 reproduces a broadcast signal from the received broadcast wave such as terrestrial digital broadcast or FM multiplex broadcast, and sends it to the control unit 110. These broadcast signals are transferred from the control unit 110 to the image display unit 160 and the audio output unit 170, and used for broadcast viewing by the user.

  The configuration of the navigation device 100 according to the embodiment has been described above, but the program elements 111 to 113 as the components thereof can be read by the control unit 110 that functions as the calculation unit. It is possible to record on a recording medium.

[Operation]
Next, an operation related to the voice guidance process of the navigation device 100 configured as described above will be described. In the following description, the user designates a change in the travel route of the vehicle in a situation where the music data (music) stored in the music data storage area 121 of the hard disk device 120 has already been reproduced while the vehicle is traveling. Therefore, an example of voice guidance processing when the utterance button of the operation input unit 140 is pressed will be described.

  As shown in FIG. 4, the voice guidance process S10 is started when the control unit 110 of the navigation device 100 determines whether or not the utterance button of the operation input unit 140 is pressed by the user in step S11. The If it is not determined that the utterance button has been pressed (step S11; N), the control unit 110 maintains the standby state for the voice guidance until it is determined that the utterance button has been pressed.

  Here, when the user presses the utterance button of the operation input unit 140 in order to specify the change of the travel route of the vehicle, and the control unit 110 determines that fact (step S11; Y), the music tone of the control unit 110 is determined. First, the extraction unit 112 reads, from the music meta information storage area 122 of the hard disk device 120, music meta information related to the music currently being played by the content playback unit 111 (music data in the music data storage area 121). Next, in step S12, the music tone extraction unit 112 extracts the music tone related to the currently played music from the read music meta information ("feature amount extraction process" according to the present invention). In step S13, the control unit 110 mutes the music currently being played by the content playback unit 111.

  Next, the voice guide reproducing unit 113 of the control unit 110 reads the voice guide data for “speech button response” corresponding to the extracted music tone from the voice guide data storage area 123 of the hard disk device 120 in step S14. . Then, in step S15, the content reproduction unit 111 of the control unit 110 reproduces the audio guide corresponding to the read audio guide data, and emits the sound to the outside through the audio output unit 170.

  At this time, for example, when the music tone extracted in step S12 is “bright music tone”, the voice guide reproducing unit 113, as shown in FIG. Plays a voice guide that expresses the word “?” In bright words. On the other hand, when the extracted music tone is “sad music tone”, the voice guide reproducing unit 113 uses the word “How do you like it?” As the voice guide corresponding to the music tone as shown in FIG. 5B. Play voice guides expressed in sad language.

  Next, when the voice guide is reproduced as described above and the user utters the phrase “change route” for changing the travel route of the vehicle (see FIGS. 5A and 5B), the control unit 110. In step S16, the user's voice is input through the voice input unit 150. At this time, the voice input unit 150 performs voice recognition related to the user's utterance and sends the voice recognition result to the control unit 110. In step S17, the control unit 110 executes a required command process from the voice recognition result.

  Here, at the time of the command processing, the control unit 110 determines whether or not a response corresponding to the user request content identified from the voice recognition result is necessary in step S18. Here, since the request content of the user is “change driving route” and it is necessary to make a response to present another driving route to the user (step S18; Y), the control unit 110 is described above. In step S14, the voice guide data for “presenting another route” corresponding to the previously extracted musical tone is read from the voice guide data storage area 123 of the hard disk device 120 (one of the “audiovisual information reproduction process” in the present invention). Part).

  At this time, for example, if the musical tone extracted in step S12 described above is “brighter musical tone”, the voice guide reproducing unit 113, as shown in FIG. Play a voice guide that expresses the words "Let's make a paid standard route." On the other hand, when the extracted tune is “sad tune”, the voice guide playback unit 113 recommends the “paid standard route as a tune-corresponding voice guide, as shown in FIG. 5B. Is reproduced with a sad wording (part of the “audiovisual information reproduction process” in the present invention).

  Next, when the voice guide is reproduced as described above and the user utters the word “pay avoidance” in order to avoid the selection of the pay standard route when the travel route of the vehicle is changed (FIG. 5A and FIG. 5A). In step S16 described above, the control unit 110 inputs the user's voice through the voice input unit 150, and in the subsequent step S17, executes the required command processing from the voice recognition result.

  Here, at the time of the above-described command processing, the control unit 110 determines whether or not a response corresponding to the user's request content identified from the voice recognition result is necessary in step S18 described above. Here, since the user's request content is “avoidance of selection of toll standard route” and it is necessary to make a response for further presenting the toll fee avoidance route to the user (step S18; Y), the control unit 110 reads out the voice guide data “for pay avoidance route presentation” corresponding to the previously extracted music tone from the voice guide data storage area 123 of the hard disk device 120 in step S14 described above.

  At this time, for example, when the tune extracted in the above-described step S12 is “bright tune”, the voice guide reproducing unit 113, as shown in FIG. 5A, displays “noisy” as the voice guide corresponding to the tune. Then, I will give priority to the paid avoidance route. ”Play a voice guide that expresses the wording in bright words. On the other hand, when the extracted tune is “sad tune”, as shown in FIG. 5B, the voice guide reproducing unit 113 “sorry. Plays a voice guide that expresses the phrase "Prefer route" in sad language.

  Next, when the voice guide is reproduced as described above, the control unit 110 actually calculates the pay avoidance route, and uses the new route indicated by the calculation result as map information on the image display unit 160. Superimposed display. By this processing, the “travel route change” which is the content requested by the user is achieved. Therefore, the control unit 110 finally determines whether or not a response corresponding to the content requested by the user is necessary in the above-described step S18 without performing the processes in subsequent steps S16 and S17. Here, since the content requested by the user has been reached and it is no longer necessary to make a response (step S18; N), the control unit 110 responds to the music being played back in step S13 described above in step S19. Cancel the mute function. Then, the control unit 110 maintains the standby state for the voice guide until the user presses the utterance button next time.

  As described above, with regard to the operation related to the voice guide processing S10 of the navigation device 100 according to the embodiment, an example of extracting the tune based on the music data stored in the music data storage area 121 of the hard disk device 120 when reproducing the voice guide is given. explained. Instead, according to the present invention, it is of course possible to extract the music tone based on the music meta information associated with the music data recorded on the recording medium RM. In this case, the object of tone extraction (step S12) in the voice guidance process S10 described above is changed to the song meta information recorded along with the song data in the recording medium RM, and the playback song mute (step) What is necessary is just to change the object of S13) and music mute cancellation | release (step S19) to the recording medium RM (optical disc drive apparatus 130).

  In the above example, the case where the required voice guide is played back in the situation where the music data (song) is already played back is shown. However, according to the present invention, the music is not played back during the voice guide playback. It is also possible to cope with cases (when played back in the past). In this case, the music tone extraction (step S12) in the voice guidance process S10 is performed in real time (i) every time music playback is designated, and the required music tone is extracted from the music meta information in real time. What is necessary is just to change into the process which hold | maintains music meta-information (related to the music reproduced | regenerated in 1) over predetermined time. Then, the audio guide reproduction according to the emotional state of the person in the audio guide reproduction output (step S15) is executed, for example, in a limited manner before the predetermined time elapses, and after that, the default audio guide is reproduced. You just have to do it.

  Further, in the above example, the case where a required voice guide is reproduced in accordance with the user's operation of pressing the utterance button has been shown. However, according to the present invention, the stage before the vehicle enters a road branch such as an intersection. It is possible to cope with the case where the voice guide is reproduced in accordance with the escape route notice at. In this case, the utterance button press determination (step S11), the user voice input (step S16), and the response necessity determination (step S17) in the voice guidance process S10 are excluded, and the navigation device 100 (control unit 110) performs automatic point recognition. What is necessary is just to make a required audio | voice guide be reproduced | regenerated automatically whenever it is performed.

[Function and effect]
As described above, in the present embodiment, the music tone extraction unit 112 of the control unit 110 reflects the human emotion from each element of the music meta information associated with the music reproduced by the content reproduction unit 111. Extract the tone of the music that is estimated to be present. Then, the voice guide reproducing unit 113 of the control unit 110 reads out the voice guide data corresponding to the musical tone extracted by the musical tone extracting unit 112 from the voice guide data storage area 123 of the hard disk device 120 and reproduces the corresponding voice guide. To do.

  For this reason, the voice guide considering the emotional state of the user uses only the music playback function mounted as standard in the navigation device 100 without using a contact type sensor such as a temperature sensor or a pressure sensor as in the prior art. This can be realized easily. As a result, it is possible to configure the navigation device 100 having a voice guide function with an excellent human interface only by changing the program configuration.

[Modification of Embodiment]
The present invention is not limited to the above-described embodiment, and various modifications are possible.

  For example, in the above embodiment, the music tone extraction unit 112 itself extracts the music tone of the music. On the other hand, the music tone determined from each element of the meta information is stored in advance in the additional recording area 122B or the like in the music meta information storage area 122, and the music extraction unit 112 is directly referred to the storage area. Also good.

  In the above-described embodiment, the music tone extraction unit 112 is referred to the music meta information storage area 122 to extract the music tone of the music. On the other hand, the music tone extraction unit 112 itself directly analyzes the waveform data of the music reproduced by the content reproduction unit 111 without referring to the music meta information storage area 122, and from the analysis result at this time, the music tone of the music is calculated. May be extracted. This analysis result can be added to the additional recording area 122B of the musical piece meta information storage area 122, and can be used as new musical piece meta information for use in appropriate extraction of musical tone.

  In the above embodiment, it is assumed that the type of multimedia content is music, but in addition to this, various images can be handled as long as meta information is attached. In this case, an image data storage area is provided in addition to the music data storage area 121 of the hard disk device 120, or the contents of the recording medium RM on which the image data is recorded are read by the optical disk drive device 130 to perform a required voice guidance process. It is sufficient to make it perform.

  Further, in the above-described embodiment, the case where multimedia content is built in the navigation device 100 in advance or is read from the recording medium RM has been described. In addition, broadcasts such as terrestrial digital broadcasts and FM multiplex broadcasts received through the media broadcast receiving unit 200 can also be used as multimedia content providing media. In this case, when the meta information is superimposed on the broadcast signal being played back, the feature amount of the multimedia content (for example, a tune in the case of a broadcast song, a program in the case of a broadcast image) using the meta information. The content) is extracted and used for selection of voice guide data.

  In the above embodiment, it is assumed that the audiovisual information is a voice guide. However, other than this, for example, when the vehicle approaches a registration point during a navigation operation, sound is emitted from the voice output unit 170. The timbre of the notification sound can also be changed according to the type of human emotion. In this case, for example, when the extracted tone is “bright tone”, the data in the hard disk device 120 relating to the tone color of the notification tone set as a chime tone or the like is set to “trumpet tone” when the extracted tone is “bright tone”. For “sad tune”, it may be set to “flute sound”.

  In addition, for example, the audio guide (see FIGS. 5A and 5B) shown in the embodiment is simultaneously displayed on the image display unit 160 in relation to the audiovisual information, and the display form of the image information to be used at this time is changed from the default value. It is also possible to change it. In this case, the data in the hard disk device 120 relating to the display form of the image information, for example, when the extracted music tone is “bright music”, the font display by “pop” is displayed in the display window with rounded corners. If it is “sad tune”, it may be set to display fonts with “Mincho” font in a display window with four right corners.

  In the above embodiment, each function in the control unit 110 is realized by executing a corresponding program. However, a part or all of the functions can be realized by hardware implemented with firmware. .

  In the above-described embodiment, the example in which the present invention is applied to an in-vehicle navigation device has been described. However, as long as it has a multimedia playback function, for example, in a navigation device mounted on an aircraft, a ship, or the like. In addition, the present invention can be applied. In addition, the present invention also applies to a navigation apparatus mounted on, for example, a PDA (Personal Digital Assistant), a mobile phone terminal, a PHS (Personal Handyphone System) terminal, a portable personal computer, or the like, which is a portable information device under similar conditions. Can be applied.

  The present invention relates to a navigation device, a navigation method, a navigation program, and a recording medium thereof.

  2. Description of the Related Art Conventionally, navigation devices that are mounted on a moving body such as a vehicle and provide navigation information such as map information about a moving route have been widely used. The evolution of such navigation device technology has been remarkable, and in recent years, for example, a technology has been proposed in which an accurate behavior pattern related to navigation operations, etc. is presented to the user in an audiovisual manner by estimating the emotional state of the user. Has been.

  As a navigation device equipped with such a function to grasp the emotional state of the user, for example, acquired by the user's “body temperature” acquired by the temperature sensor installed on the seat of the driver's seat or the pressure sensor installed on the handle Based on the user's “hand movement”, etc., a method for comprehensively determining the emotional state related to the user's emotions (see Patent Document 1; hereinafter referred to as “conventional example”) has been proposed. . By applying this conventional technique, for example, provision of a new technique such as performing voice guidance according to the estimated emotional state can be expected.

Japanese Patent Laid-Open No. 2002-73634

  However, in the technology of the conventional example, when the emotion state of the user is estimated, a contact type sensor such as a temperature sensor or a pressure sensor is used. Therefore, the user must be in contact with these sensors. For example, problems such as annoyance are felt. In addition, the use of these contact type sensors can be cited as an example of problems such as a complicated configuration of the entire apparatus.

  The present invention has been made in view of the circumstances as described above, and an object thereof is to perform voice guidance in a simple form in consideration of the emotional state of a user.

According to a first aspect of the present invention, content reproducing means for reproducing multimedia content; and feature quantities estimated to reflect human emotions from the multimedia content reproduced by the content reproducing means Feature amount extracting means for extracting audiovisual data; audiovisual data storage means for storing audiovisual data each representing a presentation form of audiovisual information corresponding to the type of emotion of the person; and an event to present the audiovisual information to a user when occurs, reads the audiovisual data corresponding to the feature amount extracted by the feature extracting unit from the audio-visual data storage means, and audio-visual information reproduction means for reproducing audiovisual information applicable; wherein the The feature amount extraction means extracts the multimedia content last played by the content playback means. The feature amount, hold up the course of the play, or a predetermined time of a new multimedia content, it is a navigation apparatus according to claim.

According to a second aspect of the present invention, there is provided a feature amount extraction step of extracting a feature amount estimated to reflect a human emotion from multimedia content reproduced by the content reproduction means ; An audiovisual information reproduction step of reproducing audiovisual information having a presentation form corresponding to the type of the person's emotion based on the feature amount extracted in the feature amount extraction step when an event to present the audiovisual information occurs And in the feature amount extraction step, the feature amount extracted with respect to the multimedia content last played by the content playback means is held until a new multimedia content is played or a predetermined time elapses. Is a navigation method characterized by

  According to a third aspect of the present invention, there is provided a navigation program characterized in that the navigation method of the present invention is executed by a computing means of a navigation device.

  According to a fourth aspect of the present invention, there is provided a recording medium on which a navigation program is recorded, wherein the navigation program of the present invention is recorded so as to be readable by arithmetic means of the navigation device.

  Hereinafter, an embodiment of the present invention will be described with reference to FIGS. In the present embodiment, a navigation device related to traveling as a movement of a vehicle or the like that is a moving body will be described as an example. In addition, it is assumed that the media data handled by the navigation device of the present embodiment is music data, the multimedia content to be played is music, and the audiovisual information presented to the user is an audio guide.

[Constitution]
FIG. 1 is a block diagram showing the configuration of the navigation device 100 according to this embodiment. As shown in FIG. 1, the navigation device 100 includes a control unit 110, a hard disk device 120, an optical disk drive device (“recording medium reading means” in the present invention) 130, an operation input unit 140, an audio An input unit 150, an image display unit 160, an audio output unit 170, a travel sensor unit 180, a GPS (Global Positioning System) receiving unit 190, and a media broadcast receiving unit 200 are provided. Elements 120 to 200 other than the control unit 110 are connected to the control unit 110, respectively.

  The control unit 110 performs overall control of the navigation device 100 and also functions as a calculation unit to perform overall navigation processing. The control unit 110 includes a central processing unit (CPU), a read only memory (ROM), a random access memory (RAM), and the like, and executes various programs. It has come to be.

  The control unit 110 executes a program to execute (i) a content reproduction unit (“content reproduction unit” according to the present invention) 111 and (ii) a music tone extraction unit (“feature amount extraction unit” according to the present invention). 112, and (iii) a function as a voice guide reproducing unit ("audiovisual information reproducing means" according to the present invention) 113.

  The content playback unit 111 has a function of controlling playback of various multimedia contents. The content playback unit 111 can be accessed by the music data designated by the user, that is, (i) music data that is media data stored in advance in the hard disk device 120, or (ii) the optical disk drive device 130. The music data which is the media data recorded on the recording medium RM is read out. Then, the content playback unit 111 plays back the music that is the multimedia content specified by the user through the audio output unit 170 using the read music data.

  The music tone extraction unit 112 extracts the music tone of the corresponding music as a feature amount estimated to reflect human emotion from each element of the meta information associated with the music played by the content playback unit 111. It has a function. Basically, every time the content reproduction unit 111 is instructed to reproduce a new piece of music, the music piece extraction unit 112 extracts a necessary piece of music in real time from the meta information related to the piece of music and sequentially updates it. The music tone extraction unit 112 also has a function of holding the music tone extracted with respect to the music played last by the content playback unit 111 until a new music is played back or until a predetermined time elapses.

  The voice guide playback unit 113 has a function of playing back a voice guide having an utterance form corresponding to the tune of the music extracted by the tune extraction unit 112 when an event for performing a voice guide occurs for the user. As an event for which voice guidance should be performed, for example, when the user designates a change in the travel route of the vehicle, there is a pressing operation by a user of an unillustrated speech button in the operation unit 140. In addition, an escape route notice (point recognition automatically performed by the apparatus itself) before the vehicle enters a road junction such as an intersection is also an event for which voice guidance is to be performed.

  The hard disk device 120 stores a program executed by the control unit 110 and stores various data such as music data, music meta information, voice guide data, and map data, which will be described later. The control unit 110 can access the storage area of the hard disk device 120, and can write and read data to and from the storage area.

  The hard disk device 120 includes a music data storage area ("media data storage means" according to the present invention) 121, a music meta information storage area ("meta information storage means" according to the present invention) 122, and a voice guide data storage area. ("Audiovisual data storage means" according to the present invention) 123 and a map data storage area 124 are set.

  The music data storage area 121 is an area for storing music data related to a plurality of music pieces in advance. Here, the content playback unit 111 of the control unit 110 functions to read music data related to music specified by the user through the operation input unit 140 from the music data storage area 121 and to play back the corresponding music. As a file format of the music data, for example, MP3 (MPEG-1 (Moving Picture Experts Group-1) Audio Layer 3) can be applied.

  The music meta information storage area 122 is an area for storing in advance a plurality of music meta information respectively associated with a plurality of music data stored in the music data storage area 121. Here, the music tone extraction unit 112 of the control unit 110 functions to read the music meta information related to the music reproduced by the content reproduction unit 111 from the music meta information storage area 122 and extract a required music tone. As the format of the music meta information, when MP3 is applied to the file format of the music data, an ID3 (Identification 3) tag, which is meta information attached to the MP3 file, can be applied as it is (hereinafter referred to as the music meta information format). , Assuming application of MP3 files and ID3 tags).

  For example, as shown in FIG. 2, the music meta information storage area 122 includes (i) an ID3 area 122A for storing basic elements of the ID3 tag for each music, and (ii) the ID3 tag. A write-once area 122B for additionally storing other elements that are not necessary is set. Here, elements such as “song name”, “artist name”, “album name”, “genre” and the like relating to the corresponding music are stored as the ID3 area 122A, and “BPM ( An example in which elements such as “Beats Per Minute)”, “average volume”, and “tonality” are stored is shown. Each element of the additional recording area 122B contributes to optimization of music tone extraction by the music tone extraction unit 112.

  Returning to FIG. 1, the voice guide data storage area 123 is an area for storing a plurality of voice guide data each representing an utterance form corresponding to the type of human emotion.

  Here, as shown in FIG. 3, the music tone extraction unit 112 of the control unit 110 determines the music tone of the music currently being played by the content playback unit 111 based on each element of the music meta information storage area 122. It extracts whether it corresponds to “sounding tone”, “bright tone”, “healed tone”, “quiet tone”, or “sad tone”. Then, the voice guide reproduction unit 113 of the control unit 110 uses the “preferred words” (most “Positive”), “bright words”, “healed words” as voice guide data corresponding to the extracted tunes. One of “use”, “quiet use of words”, and “use of sad words (most“ Negative ”)” is read from the voice guide data storage area 123 and the corresponding voice guide is reproduced through the voice output unit 170.

  Note that if an event that requires voice guidance occurs before a predetermined time has elapsed since the music was last played by the content playback unit 111, the voice guide playback unit 113 is held by the music tone extraction unit 112 until the present time. It functions to play the corresponding voice guide corresponding to the tune to be played. Further, when an event for performing voice guidance occurs after the predetermined time has elapsed, the voice guide reproducing unit 113 reproduces a default voice guide (for example, “Normal” “healed words”). It has become.

  Returning to FIG. 1, the map data storage area 124 stores map data used in navigation processing for realizing a navigation function, which is a basic function of the navigation device 100, as a DVD-ROM (Digital Video Disk-Read Only Memory). This is an area that is introduced from a recording medium or the like and held. The voice guide data for each word usage stored in the voice guide data storage area 123 is stored in the map data storage area 124 with respect to the voice guide data for the above-mentioned exit route notice when entering the road junction. Correlation is made with point information on the map data.

  The optical disk drive device 130 can access any recording medium RM such as a CD (Compact Disc) or a DVD-ROM in which music data (MP3 file) and music meta information (ID3 tag) associated therewith are recorded. Is. Here, the optical disk drive device 130 transfers the music data read from the recording medium RM to the content reproduction unit 111 of the control unit 110 regarding the music specified by the user through the operation input unit 140. At this time, the content reproduction unit 111 performs a reproduction process of the transferred music data, and also transfers the music meta information attached to the music data to the music tone extraction unit 112, which is used in the music tone extraction unit 112. Used for music tone extraction.

  The operation input unit 140 includes a key unit provided in the main body of the navigation device 110, a remote input device including the key unit, and the like. Here, both the key units are equipped with speech buttons for causing the voice input unit 150 and the voice output unit 170 to function when the user designates a change in the travel route of the vehicle. Moreover, as a key part provided in the main body part, a touch panel provided in a display device of the image display unit 160 can be used. When the user operates the operation input unit 140, the operation content of the navigation device 100 is set. For example, in addition to destination setting, information search setting, vehicle running status display setting, and the like, music reproduction designation including designation of a reproduction target medium (hard disk device 120 or recording medium RM) corresponds to this. The above input contents are sent from the operation input unit 140 to the control unit 110.

  The voice input unit 150 includes a voice recognition device that recognizes the content of the user's utterance. The voice recognition result at this time is sent from the voice input unit 150 to the control unit 110, and the control unit 110 executes command processing related to, for example, a route change (different route search) based on the voice recognition result.

  The image display unit 160 is based on (i) a display device such as a liquid crystal display panel, an organic EL (Electro Luminescence) panel, a PDP (Plasma Display Panel), and (ii) display control data sent from the control unit 110. The image display unit 160 includes a display controller such as a graphic renderer that controls the entire image display unit 160, and (iii) a display image memory that stores display image data. This image display unit 160 displays map information, route information, operation guidance information, and the like under the control of the control unit 110, and is applicable when the multimedia content reproduced by the content reproduction unit 111 is composed of image data. The image to be displayed is also displayed.

  The voice output unit 170 is amplified through a voice synthesizer or a voice amplifier for synthesizing a response voice (voice guide) at the time of a command response by the control unit 110 (response to the pressing operation of the utterance button in the operation input unit 140). A speaker that converts the synthesized voice signal into voice and emits it outside is provided. Under the control of the control unit 110, the sound output unit 170 outputs a voice guide related to the traveling direction of the vehicle, the traveling situation, the traffic situation, the command response, etc., and outputs the music reproduced by the content reproducing unit 111. .

  The travel sensor unit 180 includes (i) a speed sensor that detects a moving speed of the vehicle, (ii) an azimuth angle sensor that detects an azimuth angle that is a vehicle traveling direction, and (iii) detects an acceleration that acts on the vehicle. An acceleration sensor. Here, the speed sensor detects, for example, a pulse signal or a voltage value output by rotation of an axle or a wheel. The azimuth angle sensor is configured as a so-called gyro sensor, for example, and detects the azimuth angle. The acceleration sensor detects, for example, gravitational acceleration. Such a detection result is sent from the traveling sensor unit 180 to the control unit 110.

  The GPS receiving unit 190 calculates a pseudo coordinate value of the current position of the vehicle based on reception results of radio waves from a plurality of GPS satellites, and reports it to the control unit 110. The GPS receiving unit 190 measures the current time based on the time transmitted from the GPS satellite and sends this to the control unit 110.

  The media broadcast receiving unit 200 includes, for example, a terrestrial digital broadcast receiver, an FM (Frequency Modulation) multiplex broadcast receiver, and the like. The media broadcast receiving unit 200 reproduces a broadcast signal from the received broadcast wave such as terrestrial digital broadcast or FM multiplex broadcast, and sends it to the control unit 110. These broadcast signals are transferred from the control unit 110 to the image display unit 160 and the audio output unit 170, and used for broadcast viewing by the user.

  The configuration of the navigation device 100 according to the embodiment has been described above, but the program elements 111 to 113 as the components are recorded in an arbitrary form in a form that can be read by the control unit 110 that functions as a calculation unit. It is possible to record on a medium.

[Operation]
Next, an operation related to the voice guidance process of the navigation device 100 configured as described above will be described. In the following description, the user designates a change in the travel route of the vehicle in a situation where the music data (music) stored in the music data storage area 121 of the hard disk device 120 has already been reproduced while the vehicle is traveling. Therefore, an example of voice guidance processing when the utterance button of the operation input unit 140 is pressed will be described.

  As shown in FIG. 4, the voice guidance process S10 is started when the control unit 110 of the navigation device 100 determines whether or not the utterance button of the operation input unit 140 is pressed by the user in step S11. The If it is not determined that the utterance button has been pressed (step S11; N), the control unit 110 maintains the standby state for the voice guidance until it is determined that the utterance button has been pressed.

  Here, when the user presses the utterance button of the operation input unit 140 in order to specify the change of the travel route of the vehicle, and the control unit 110 determines that fact (step S11; Y), the music tone of the control unit 110 is determined. First, the extraction unit 112 reads, from the music meta information storage area 122 of the hard disk device 120, music meta information related to the music currently being played by the content playback unit 111 (music data in the music data storage area 121). Next, in step S12, the music tone extraction unit 112 extracts the music tone related to the currently played music from the read music meta information ("feature amount extraction process" according to the present invention). In step S13, the control unit 110 mutes the music currently being played by the content playback unit 111.

  Next, the voice guide reproducing unit 113 of the control unit 110 reads the voice guide data for “speech button response” corresponding to the extracted music tone from the voice guide data storage area 123 of the hard disk device 120 in step S14. . Then, in step S15, the content reproduction unit 111 of the control unit 110 reproduces the audio guide corresponding to the read audio guide data, and emits the sound to the outside through the audio output unit 170.

  At this time, for example, when the music tone extracted in step S12 is “bright music tone”, the voice guide reproducing unit 113, as shown in FIG. Plays a voice guide that expresses the word “?” In bright words. On the other hand, when the extracted music tone is “sad music tone”, the voice guide reproducing unit 113 uses the word “How do you like it?” As the voice guide corresponding to the music tone as shown in FIG. 5B. Play voice guides expressed in sad language.

  Next, when the voice guide is reproduced as described above and the user utters the phrase “change route” for changing the travel route of the vehicle (see FIGS. 5A and 5B), the control unit 110. In step S16, the user's voice is input through the voice input unit 150. At this time, the voice input unit 150 performs voice recognition related to the user's utterance and sends the voice recognition result to the control unit 110. In step S17, the control unit 110 executes a required command process from the voice recognition result.

  Here, at the time of the command processing, the control unit 110 determines whether or not a response corresponding to the user request content identified from the voice recognition result is necessary in step S18. Here, since the request content of the user is “change driving route” and it is necessary to make a response to present another driving route to the user (step S18; Y), the control unit 110 is described above. In step S14, the voice guide data for “presenting another route” corresponding to the previously extracted musical tone is read from the voice guide data storage area 123 of the hard disk device 120 (one of the “audiovisual information reproduction process” in the present invention). Part).

  At this time, for example, if the musical tone extracted in step S12 described above is “brighter musical tone”, the voice guide reproducing unit 113, as shown in FIG. Play a voice guide that expresses the words "Let's make a paid standard route." On the other hand, when the extracted tune is “sad tune”, the voice guide playback unit 113 recommends the “paid standard route as a tune-corresponding voice guide, as shown in FIG. 5B. Is reproduced with a sad wording (part of the “audiovisual information reproduction process” in the present invention).

  Next, when the voice guide is reproduced as described above and the user utters the word “pay avoidance” in order to avoid the selection of the pay standard route when the travel route of the vehicle is changed (FIG. 5A and FIG. 5A). In step S16 described above, the control unit 110 inputs the user's voice through the voice input unit 150, and in the subsequent step S17, executes the required command processing from the voice recognition result.

  Here, at the time of the above-described command processing, the control unit 110 determines whether or not a response corresponding to the user's request content identified from the voice recognition result is necessary in step S18 described above. Here, since the user's request content is “avoidance of selection of toll standard route” and it is necessary to make a response for further presenting the toll fee avoidance route to the user (step S18; Y), the control unit 110 reads out the voice guide data “for pay avoidance route presentation” corresponding to the previously extracted music tone from the voice guide data storage area 123 of the hard disk device 120 in step S14 described above.

  At this time, for example, when the tune extracted in the above-described step S12 is “bright tune”, the voice guide reproducing unit 113, as shown in FIG. 5A, displays “noisy” as the voice guide corresponding to the tune. Then, I will give priority to the paid avoidance route. ”Play a voice guide that expresses the wording in bright words. On the other hand, when the extracted tune is “sad tune”, as shown in FIG. 5B, the voice guide reproducing unit 113 “sorry. Plays a voice guide that expresses the phrase "Prefer route" in sad language.

  Next, when the voice guide is reproduced as described above, the control unit 110 actually calculates the pay avoidance route, and uses the new route indicated by the calculation result as map information on the screen display unit 160. Superimposed display. By this processing, the “travel route change” which is the content requested by the user is achieved. Therefore, the control unit 110 finally determines whether or not a response corresponding to the content requested by the user is necessary in the above-described step S18 without performing the processes in subsequent steps S16 and S17. Here, since the content requested by the user has been reached and it is no longer necessary to make a response (step S18; N), the control unit 110 responds to the music being played back in step S13 described above in step S19. Cancel the mute function. Then, the control unit 110 maintains the standby state for the voice guide until the user presses the utterance button next time.

  As described above, with regard to the operation related to the voice guide processing S10 of the navigation device 100 according to the embodiment, an example of extracting the tune based on the music data stored in the music data storage area 121 of the hard disk device 120 when reproducing the voice guide is given. explained. Instead, according to the present invention, it is of course possible to extract the music tone based on the music meta information associated with the music data recorded on the recording medium RM. In this case, the object of tone extraction (step S12) in the voice guidance process S10 described above is changed to the song meta information recorded along with the song data in the recording medium RM, and the playback song mute (step) What is necessary is just to change the object of S13) and music mute cancellation | release (step S19) to the recording medium RM (optical disc drive apparatus 130).

  In the above example, the case where the required voice guide is played back in the situation where the music data (song) is already played back is shown. However, according to the present invention, the music is not played back during the voice guide playback. It is also possible to cope with cases (when played back in the past). In this case, the music tone extraction (step S12) in the voice guidance process S10 is performed in (i) every time the music is designated for reproduction, the required music tone is extracted from the music meta information in real time, and (ii) the music is extracted (last) What is necessary is just to change into the process which hold | maintains music meta-information (related to the music reproduced | regenerated in 1) over predetermined time. Then, the audio guide reproduction according to the emotional state of the person in the audio guide reproduction output (step S15) is executed, for example, in a limited manner before the predetermined time elapses, and after that, the default audio guide is reproduced. You just have to do it.

  Further, in the above example, the case where a required voice guide is reproduced in accordance with the user's operation of pressing the utterance button has been shown. However, according to the present invention, the stage before the vehicle enters a road branch such as an intersection. It is possible to cope with the case where the voice guide is reproduced in accordance with the escape route notice at. In this case, the utterance button press determination (step S11), the user voice input (step S16), and the response necessity determination (step S17) in the voice guidance process S10 are excluded, and the navigation device 100 (control unit 110) performs automatic point recognition. What is necessary is just to make a required audio | voice guide be reproduced | regenerated automatically whenever it is performed.

[Function and effect]
As described above, in the present embodiment, the music tone extraction unit 112 of the control unit 110 reflects the human emotion from each element of the music meta information associated with the music reproduced by the content reproduction unit 111. Extract the tone of the music that is estimated to be present. Then, the voice guide reproducing unit 113 of the control unit 110 reads out the voice guide data corresponding to the musical tone extracted by the musical tone extracting unit 112 from the voice guide data storage area 123 of the hard disk device 120 and reproduces the corresponding voice guide. To do.

  For this reason, the voice guide considering the emotional state of the user uses only the music playback function mounted as standard in the navigation device 100 without using a contact type sensor such as a temperature sensor or a pressure sensor as in the prior art. This can be realized easily. As a result, it is possible to configure the navigation device 100 having a voice guide function with an excellent human interface only by changing the program configuration.

[Modification of Embodiment]
The present invention is not limited to the above-described embodiment, and various modifications are possible.

  For example, in the above embodiment, the music tone extraction unit 112 itself extracts the music tone of the music. On the other hand, the music tone determined from each element of the meta information is stored in advance in the additional recording area 122B or the like in the music meta information storage area 122 so that the music extraction unit 122 directly refers to the storage area. Also good.

  In the above-described embodiment, the music tone extraction unit 112 is referred to the music meta information storage area 122 to extract the music tone of the music. On the other hand, the music tone extraction unit 112 itself directly analyzes the waveform data of the music reproduced by the content reproduction unit 111 without referring to the music meta information storage area 122, and from the analysis result at this time, the music tone of the music is calculated. May be extracted. This analysis result can be added to the additional recording area 122B of the musical piece meta information storage area 122, and can be used as new musical piece meta information for use in appropriate extraction of musical tone.

  In the above embodiment, it is assumed that the type of multimedia content is music, but in addition to this, various images can be handled as long as meta information is attached. In this case, an image data storage area is provided in addition to the music data storage area 121 of the hard disk device 120, or the contents of the recording medium RM on which the image data is recorded are read by the optical disk drive device 130 to perform a required voice guidance process. It is sufficient to make it perform.

  Further, in the above-described embodiment, the case where multimedia content is built in the navigation device 100 in advance or is read from the recording medium RM has been described. In addition, broadcasts such as terrestrial digital broadcasts and FM multiplex broadcasts received through the media broadcast receiving unit 200 can also be used as multimedia content providing media. In this case, when the meta information is superimposed on the broadcast signal being played back, the feature amount of the multimedia content (for example, a tune in the case of a broadcast song, a program in the case of a broadcast image) using the meta information. The content) is extracted and used for selection of voice guide data.

  In the above embodiment, it is assumed that the audiovisual information is a voice guide. However, other than this, for example, when the vehicle approaches a registration point during a navigation operation, sound is emitted from the voice output unit 170. The timbre of the notification sound can also be changed according to the type of human emotion. In this case, for example, when the extracted tone is “bright tone”, the data in the hard disk device 120 relating to the tone color of the notification tone set as a chime tone or the like is set to “trumpet tone” when the extracted tone is “bright tone”. For “sad tune”, it may be set to “flute sound”.

  In addition, for example, the audio guide (see FIGS. 5A and 5B) shown in the embodiment is simultaneously displayed on the image display unit 160 in relation to the audiovisual information, and the display form of the image information to be used at this time is changed from the default value. It is also possible to change it. In this case, the data in the hard disk device 120 relating to the display form of the image information, for example, when the extracted music tone is “bright music”, the font display by “pop” is displayed in the display window with rounded corners. If it is “sad tune”, it may be set to display fonts with “Mincho” font in a display window with four right corners.

  In the above embodiment, each function in the control unit 110 is realized by executing a corresponding program. However, a part or all of the functions can be realized by hardware implemented with firmware. .

  In the above-described embodiment, the example in which the present invention is applied to an in-vehicle navigation device has been described. However, as long as it has a multimedia playback function, for example, in a navigation device mounted on an aircraft, a ship, or the like. In addition, the present invention can be applied. In addition, the present invention also applies to a navigation apparatus mounted on, for example, a PDA (Personal Digital Assistant), a mobile phone terminal, a PHS (Personal Handyphone System) terminal, a portable personal computer, or the like, which is a portable information device under similar conditions. Can be applied.

It is a functional block diagram which shows the internal structure of the navigation apparatus which concerns on one Embodiment of this invention. It is a figure which shows an example of the music meta information element memorize | stored in the music meta information storage area of FIG. It is a figure which shows the correspondence between the extracted music tone and the word usage set to audio | voice guide data. It is a flowchart for demonstrating the audio | voice guidance process performed in the control unit of FIG. It is a figure which shows an example of the voice guide form when the extraction music tone is set to "bright" in the voice guide process of FIG. It is a figure which shows an example of the voice guide form when the extraction music tone is set to "sad" in the voice guide process of FIG.

Claims (16)

Content playback means for playing back multimedia content;
Feature quantity extraction means for extracting a feature quantity estimated to reflect human emotions from the multimedia content reproduced by the content reproduction means;
Audiovisual data storage means for storing audiovisual data each representing a presentation form of audiovisual information corresponding to the type of human emotion;
When an event to present the audiovisual information to the user occurs, audiovisual data corresponding to the feature amount extracted by the feature amount extraction unit is read from the audiovisual data storage unit, and the corresponding audiovisual information is obtained. A navigation apparatus comprising: audio-visual information reproducing means for reproducing;   The feature amount extraction unit extracts a required feature amount in real time and sequentially updates each time reproduction of a new multimedia content is designated to the content reproduction unit. The navigation device described in 1.   The feature amount extraction unit holds the feature amount extracted with respect to the multimedia content last played by the content playback unit until a new multimedia content is played or a predetermined time elapses. Item 3. The navigation device according to Item 2.   4. The navigation apparatus according to claim 3, wherein the audiovisual information reproduction means reproduces default audiovisual information when an event for presenting the audiovisual information occurs after the predetermined time has elapsed. Media data storage means for storing the multimedia content;
Meta information storage means for storing meta information associated with the multimedia content stored in the media data storage means;
The content reproduction means reproduces multimedia content read from the media data storage means,
The feature amount extraction unit extracts a required feature amount from meta information stored in the meta information storage unit with respect to the multimedia content reproduced by the content reproduction unit. Navigation device.   The navigation apparatus according to claim 5, wherein the meta information storage unit includes a write-once area for additionally writing an element that can optimize the extraction of the feature value by the feature value extraction unit. A recording medium reading unit capable of accessing a recording medium on which the multimedia content is recorded;
The content reproduction means reproduces the multimedia content read from the recording medium by the recording medium reading means,
The navigation apparatus according to claim 1, wherein the feature amount extraction unit extracts a required feature amount from meta information accompanying the multimedia content reproduced by the content reproduction unit. Media broadcast receiving means capable of receiving the multimedia content further comprises
The content reproduction means reproduces the multimedia content received by the media broadcast reception means,
The navigation apparatus according to claim 1, wherein the feature amount extraction unit extracts a required feature amount from meta information accompanying the multimedia content reproduced by the content reproduction unit.   The navigation apparatus according to claim 1, wherein the feature amount extraction unit extracts a required feature amount from a result of analyzing the waveform data of the multimedia content reproduced by the content reproduction unit. The audiovisual information includes an audio guide,
The navigation apparatus according to claim 1, wherein the audiovisual data includes voice guide data each representing an utterance form of the voice guide according to a type of emotion of the person. The audiovisual information includes a notification sound,
The navigation apparatus according to claim 1, wherein the audiovisual data includes notification sound data each representing a tone color of the notification sound according to a type of emotion of the person. The audiovisual information includes image information,
The navigation apparatus according to claim 1, wherein the audiovisual data includes image information data each representing a display form of the image information according to a type of emotion of the person. The multimedia content is a song,
The navigation apparatus according to claim 1, wherein the feature amount extraction unit extracts the tune of the music as a required feature amount. A feature amount extraction step of extracting feature amounts estimated to reflect human emotions from multimedia content;
When an event in which audiovisual information should be presented to the user occurs, audiovisual information having a presentation form corresponding to the type of human emotion is reproduced based on the feature amount extracted in the feature amount extraction step. An audiovisual information reproduction step; and a navigation method comprising:   A navigation program for causing a calculation means of a navigation device to execute the navigation method according to claim 14.   16. A recording medium storing a navigation program, wherein the navigation program according to claim 15 is recorded so as to be readable by a calculation means of the navigation device.

Images