JP4322736B2 - Audio equipment - Google Patents

Description

The present invention relates to an audio device mounted on an automobile, and more particularly to an audio device capable of displaying an image corresponding to music selected by a user (driver) of the own vehicle on a monitor .

  2. Description of the Related Art Conventionally, an in-vehicle audio system that can display a playback track number, a music title name, an album name, an artist name, and the like of a selected music on a monitor during music playback by the in-vehicle audio apparatus is known. . Furthermore, in recent years, there has been a technology that enables image information (video) to be acquired via the Internet, e-mail, or the like using a communication device provided in an in-vehicle audio device and displayed on a monitor while listening to music. Are known.

  In addition, as a related art regarding this type of in-vehicle audio system, for example, in Patent Document 1, an identification ID is assigned in advance to music information and video information, and a favorite music is based on the assigned identification ID. Is a distribution control technology for video media (CD, DVD) that obtains video information corresponding to, and Patent Document 2 links the music information and the image information with the same file to be selected (changing the identifier). Japanese Patent Application Laid-Open No. 2004-133867 describes an audio technology for specifying and reproducing video information corresponding to a music to be played from video information.

JP 2002-342621 A Japanese Patent Laid-Open No. 11-275503 JP 2002-204432 A

  However, the above-described conventional in-vehicle audio system has the following problems. In other words, as described above, in an audio device using a conventional in-vehicle audio system, music is obtained by changing the display on a monitor in accordance with the volume of music using a graphic equalizer or by acquiring image information via the Internet or the like. While it is possible to display a favorite image on the monitor while listening, the association between the music information and the image information does not change depending on the user's environment or the like, so the user (driver) needs it. There is a problem that a favorite image cannot be automatically displayed.

The present invention has been made to solve the above-described problems in the prior art, and relates to an audio device mounted on an automobile . In particular, the present invention appropriately responds to a situation or environment encountered by a user (driver). An object of the present invention is to provide an audio device capable of displaying the image information (video information) on the monitor .

In order to solve the above-described problems and achieve the object, the invention according to claim 1 is directed to music information, storage means for storing a larger number of image information than the number of the music information, and reproduction of the music information. Based on the music information playback means, the environment acquisition means for acquiring environment information related to the playback environment in which the music information is played back, the music information played back by the playback means, and the environment information acquired by the environment acquisition means And image information reproducing means for extracting and reproducing corresponding image information from the storage means .

According to the first aspect of the present invention, music information, storage means for storing a larger number of image information than the number of music information, music information playback means for playing back music information, and music information are played back. Based on the environment acquisition means for acquiring environment information relating to the playback environment, the music information reproduced by the music information reproduction means, and the environment information acquired by the environment acquisition means, the corresponding image information is extracted from the storage means, Image information reproducing means for reproducing .

According to a second aspect of the present invention, in the first aspect of the present invention, the storage means sets a plurality of pieces of image information or a plurality of types of image information for each piece of music information or various kinds of music information. They are stored in association with each other .

According to the second aspect of the present invention, the storage means stores a plurality of pieces of image information or a plurality of types of image information in association with each piece of music information or various types of music information .

According to a third aspect of the present invention, in the first or second aspect of the present invention, the storage means stores image information or image information corresponding to each reproduction environment for each piece of music information or each type of music information. Is stored in association with each other .

According to the third aspect of the present invention, the storage means stores the image information corresponding to each reproduction environment or the type of image information in association with each music information or various types of music information .

According to a fourth aspect of the present invention, in the first , second, or third aspect of the invention, the image information reproduction unit is configured to display image information to be reproduced when the environmental information acquired by the environment acquisition unit is changed. It is characterized by switching .

According to the fourth aspect of the present invention, the image information reproducing means is acquired by the environment acquisition means.
When the environment information is changed, the image information to be reproduced is switched .

The invention according to claim 5 is the invention according to any one of claims 1 to 4, wherein the environmental information is a travel region of a vehicle in which the music information is reproduced, and the music information is reproduced. And at least one of traffic jam information in a travel region of a vehicle in which the audio device is mounted .

According to the fifth aspect of the present invention, the environmental information includes the travel area of the vehicle in which the music information is reproduced, the time zone in which the music information is reproduced, and the traffic jam in the travel area of the vehicle in which the audio device is mounted. at least one of the information to.

The invention of claim 6 is the invention according to any one of claims 1 to 5, those
Navigation means for setting a travel route of a vehicle on which the audio device is mounted is further provided.
The environment acquisition unit acquires the environment information from the navigation unit .

According to the sixth aspect of the present invention, the environment acquisition means is a vehicle equipped with an audio device.
Environmental information is acquired from navigation means for setting both travel routes .

The invention according to claim 7 is the invention according to any one of claims 1 to 6,
Voice recognition means for recognizing the music information stored in the storage means is further provided, and the storage
Means for storing the stored music information or the storage based on the recognition result of the voice recognition means;
A plurality of pieces of image information or a plurality of types of image information are associated with types of music information to be played .

According to the seventh aspect of the invention, the sound for recognizing the music information stored in the storage means is recognized.
Voice recognition means is further provided, and the storage means stores sound based on the recognition result of the voice recognition means.
The music information or the type of music information stored includes a plurality of pieces of image information or a plurality of pieces of image information.
Associate types .

According to the first aspect of the present invention, music information, storage means for storing a larger number of image information than the number of music information, music information reproduction means for reproducing music information, and music information are reproduced. Based on the environment acquisition means for acquiring environment information related to the reproduction environment, the music information reproduced by the music information reproduction means, and the environment information acquired by the environment acquisition means, the corresponding image information is extracted from the storage means and reproduced. When the user (driver) listens to the music in the car, the image information reproducing means appropriately displays the image corresponding to the driving environment of the vehicle by the user (driver). There is an effect that it can be displayed.

According to the second aspect of the invention, the storage means can store a plurality of pieces of image information or a plurality of types of image information in association with each piece of music information or various types of music information. .

According to the third aspect of the present invention, the storage means can store the image information corresponding to each reproduction environment or the type of image information in association with each music information or various types of music information. I can .

According to the invention described in claim 4, the image information reproducing means is obtained by the environment obtaining means.
When changing the environmental information, it is possible to switch the image information to be reproduced.
When both travel areas are switched, image information is correctly associated with music information.
There is an effect that can be done .

According to the fifth aspect of the present invention, the environmental information includes the travel area of the vehicle in which the music information is reproduced, the time zone in which the music information is reproduced, and the travel area of the vehicle in which the audio device is mounted. It can be at least one of the traffic jam information .

According to the sixth aspect of the present invention, the environment acquisition means is equipped with an audio device.
Environment information can be acquired from navigation means that set the vehicle's travel route
The image information for the music information is based on the travel destination set by the navigation means.
There is an effect that the correspondence of the information can be accurately performed .

According to the seventh aspect of the present invention, the music information stored in the storage means is recognized by voice.
Voice recognition means is further provided, and the storage means is stored based on the recognition result of the voice recognition means.
Multiple types of image information or multiple types of image information in the type of music information or stored music information
Since different types can be associated with each other, the type of music information or stored music information or multiple images
Images according to the image associated with the type of image information can be displayed on the image information reproducing means.
There is an effect that that.

Exemplary embodiments of an audio apparatus according to the present invention will be explained below in detail with reference to the accompanying drawings . In the first embodiment described below, the outline and features of the in-vehicle audio system including the audio apparatus according to the present invention will be described, and then the configuration and functions of the audio apparatus will be described in detail. In addition, this invention is not limited by each Example 1-2 shown below.

First, the features and configuration of an in- vehicle audio system having an audio apparatus according to the first embodiment will be described with reference to FIG. FIG. 1 is not a functional block diagram illustrating the overall configuration of the in-vehicle audio system according to the first embodiment.

  Here, the features of the in-vehicle audio system according to the present invention will be schematically described. Image information corresponding to music information selected by a user (driver of the own vehicle) is automatically extracted and displayed on a monitor. It is in. In addition, the image information captured on the Internet or the like is acquired, and an identification ID and a recognition ID for each title and genre are given to the image information, and the same genre is given to the image information from a plurality of music information. When the music information is searched and the music is listened to, the searched image information can be displayed on the monitor. Furthermore, based on the situation (driving state) acquired by using the navigation system (car navigation system) such as travel area, travel time zone, going to work, and returning home by the own vehicle, it is most suitable for the user along with favorite music information It is to display image information on a monitor (study correspondence control). Further, the in-vehicle audio system according to the present embodiment additionally has the following features in relation to the main features described above.

  That is, in the first embodiment, when the situation such as the traveling time zone or traveling area of the host vehicle changes, the music image correspondence control unit 400 (image switching processing unit 410) can switch the image information at any time. I have to. That is, when the user (driver) listens to music in the vehicle, the image according to the image appropriately corresponding to the driving situation of the user (driver) and the traveling environment of the host vehicle can be displayed on the monitor 600. it can.

  Hereinafter, the configuration and functions of the in-vehicle audio apparatus 110 will be described in detail with reference to FIG. That is, as shown in FIG. 1, the in-vehicle audio system 100 includes an in-vehicle audio device 110, and the in-vehicle audio device 110 includes a music image information processing unit 200 and a music image information classification control unit 300. A music image correspondence control unit 400, a travel region determination unit 500, a music information database 710, an image information database 720, a music correspondence image registration database 730, and a captured image information database 740. The photographed image information database 740 has a function of storing photographing information photographed by a digital camera, a video camera, or the like, or image information obtained from the Internet or a homepage. Details of the databases 710 to 730 will be described later.

  The music image information processing unit 200 includes a music recording / playback unit 210 and an image recording / playback unit 220. The music image information processing unit 200 has a function of playing and recording / playing music from a radio station broadcast (AM / FM), a CD, and the like, and a DVD. A function of recording / reproducing image information (video information) from an image reproduction medium is provided. The music image information classification control unit 300 includes a music information classification unit 310 and an image information classification unit 320, and a plurality of music information and image information is classified by genre (pops, rock,. It has a function to classify images into images and mountains. Specifically, the music information classification unit 310 can classify music type names by genre, and has a function of classifying music information stored (recorded) by a plurality of types by genre. Further, the image information classification unit 320 has a function of classifying a plurality of types of stored (recorded) image information by scene / genre. When the image information classification unit 320 wants to listen to music or a place (for example, , During work, on the way home, holidays, sea, mountains, dating, etc.). In this case, the classification of the image information is classified so as to be matched with the music information.

  The music image correspondence control unit 400 includes an image switching processing unit 410, an image switching control unit 420, a music corresponding image setting unit 430, and a music image link unit 440. When the situation changes, the image information corresponding to the music information is switched.

  The image switching processing unit 410 has a function of switching images based on a change in the travel area under the control of the image switching control unit 420. Further, the image switching control unit 420 may be provided with a timer function, and image information can be switched based on the passage of time (morning, noon, night) by the timer.

  The music-compatible image setting unit 430 has a function of setting an image corresponding to music selected by the user (driver). In this case, a plurality of images can be set for one piece of music instead of one image, and a plurality of images can be simultaneously displayed on the monitor 600. In addition, a plurality of images corresponding to one piece of music can be sequentially displayed on the monitor 600 at regular time intervals. Image information for the music information set by the music corresponding image setting unit 430 can be stored in the music corresponding image database 730. The music image link unit 440 has a function of linking and displaying an original image or a recorded image taken by a digital camera or a digital video camera.

  The travel region determination unit 500 includes a travel time zone determination unit 510 and a traffic jam information determination unit 520. In this example, the travel region information, travel time zone information, traffic jam information, and the like acquired by the navigation system 800 are acquired. And a function of determining the traveling area of the host vehicle. Reference numeral 600 denotes a monitor for displaying an image, reference numeral 650 denotes a speaker, and reference numeral 680 denotes an operation unit. In addition to the display of image information corresponding to music information, which is a feature of the present invention, the monitor 600 can display a travel route display by the navigation system 800 and a music image information management menu screen 610 (FIG. 5).

  The navigation system 800 includes a GPS receiver 810 that detects the current position of the host vehicle A through communication with a GPS artificial satellite, searches for a scheduled travel route (scheduled travel route) by the host vehicle, and travels by the host vehicle. It has a function to acquire the planned road condition and the traveling area of the host vehicle that is currently traveling. The map database 820 is a database in which detailed map information is stored.

  Next, details of the music information database 710, the image information database 720, and the music corresponding image registration database 730 will be described. FIG. 2 shows the music information database 710. As shown in the figure, the music information database 710 stores a plurality of pieces of music information (xxx to xxx) in association with the set identification IDs (000A1 to 000A4...). (Stored). The music information database 710 is stored (stored) by the recording function of the music recording / reproducing unit 210 and can be set and registered by a manual operation by a user (driver). Also, the music information can be classified and stored by genre of music recognized by a music information recognition unit 230 (FIG. 16) described later.

  FIG. 3 shows the image information database 720. As shown in the figure, in this image information database 720, a plurality of pieces of image information (sea XX, mountain XX, bird XX, etc.) are associated with the set identification IDs (000B1 to 000B3...). ..) is stored (stored). The image information database 720 is stored (stored) by the recording function of the image recording / reproducing unit 220 and can be set and registered by a manual operation by a user (driver). Further, the image information can be classified and stored by genre of images recognized by an image information recognition unit 240 (FIG. 16) described later.

  FIG. 4 shows the music corresponding image registration database 730. As shown in the figure, in the music corresponding image registration database 730, a plurality of pieces of image information (sea XX, mountain XX) are associated with identification IDs (000A1, 000A2, 000A5,...) Of a plurality of music information. × ...) identification IDs (000B4, 000B6, 000B9,...) Are stored (stored). For example, the image information corresponding to the music information with the identification ID “000A1” stored in the music information database 710 is “sea XX” which is the image information with the identification ID “000B4” stored in the image information database 720. ". The music information and the image information corresponding to each identification ID are managed as corresponding IDs (xxx × 1 to xxx × 3...).

  Next, the music image information management menu screen 610 will be described with reference to FIG. FIG. 5 shows an example of the music image information management menu screen 610 displayed on the monitor 600 when the power switch of the in-vehicle audio apparatus 110 is pressed (ON).

  As shown in the figure, the monitor 600 is provided with a music classification setting icon 620, an image classification setting icon 630, and a music-compatible image setting icon 640 as the music image information management menu screen 610. In this example, three types of management items (“1. Music classification setting”, “2. Image classification setting”, “3. Music image correspondence setting”) can be set by pressing (ON) to 630. . Specifically, an arbitrary registration / setting screen can be displayed on the monitor 600 by selecting a desired management item from the music image setting management menu screen 610.

  More specifically, for example, when the “1. Music classification setting” icon 620 displayed on the music image setting management menu screen 610 is pressed (ON), the monitor 600 displays “ 1. A screen (list of music information) relating to “1. Music classification setting” can be displayed.

  The details of “music information classification”, “image information classification”, and “music-compatible image information setting / registration” will be described below with reference to FIGS. FIG. 6 shows a music category selection screen 635. In this example, by selecting one type from a plurality of selection items (title, album, artist, genre) displayed on the music category selection screen 635, FIG. The registration setting screen 680 shown in FIG. 7 can be displayed. FIG. 7 of this example shows a setting screen in which a title is selected from the music classification selection screen 635 of FIG. Also, predetermined image information can be set (registered) in association with a plurality of titles (titles 1, 2 to n) by a setting procedure described later.

  In this registration setting screen 680, 681 is a setting button for setting a plurality of displayed music titles in sequence, 682 is a setting button for setting the title of the selected music information, and 683 is for returning the screen to the previous screen. A return instruction button 684, an image selection button for selecting image information corresponding to the music title set by the setting button 682, and an image confirmation button 685 for checking image information corresponding to the set music information. It is. Similarly, when an album is selected on the music classification setting screen 635 in FIG. 6, the album setting screen shown in FIG. 8 is displayed, and the registration setting screen 680 is used to select from a plurality of albums. The image information corresponding to the album can be set.

  Next, the image classification selection screen 635a will be described. FIG. 9 shows an image classification selection screen 635a. In this example, one of a plurality of pieces of image information (landscape, plant, animal, character, other, music genre) displayed on the image classification selection screen 635a is displayed. By selecting the type, a registration setting screen 680 for registering an image shown in FIG. 10 can be displayed. FIG. 10 shows a registration setting screen 680 when a landscape is selected in FIG. As shown in FIG. 10, in this example, a plurality of landscape images (scenery 1 to landscape 6) are displayed in a thumbnail format, and the user (driver) selects a desired landscape image from the plurality of landscape images. Can be registered in association with the previously set music information. Here, the example of FIG. 10 shows an example in which the image of the landscape 1 is selected. Here, when a desired image is selected on the registration setting screen 680, music corresponding to the previously selected image can be reproduced. In the example of FIG. 11, an example in which an image of POPS1 is selected is shown.

  Hereinafter, setting / registration of music-compatible image information will be described with reference to FIGS. That is, as shown in FIG. 12, first, the music information to be selected is registered. Specifically, when title 1 is a music selection target, the icon of title 1 is reversed, and registration is performed by pressing (ON) a setting button 682. Next, the screen shifts to the registration setting screen 680 shown in FIG. 13, and image information to be a favorite image is selected (in this example, POPS1 is selected), and registration is performed by pressing the setting button 682 (ON). As a result, the music corresponding image registration database 730 stores the music information title 1 and the image information POPS 1 in association with each other. Actually, the image information of POPS1 is displayed on the monitor 600 when the title 1 is selected.

(Basic control procedure for in-vehicle audio system)
Next, a basic control procedure in the in-vehicle audio system of the present invention will be described. FIG. 14 is a flowchart for explaining a basic control procedure of the in-vehicle audio control method according to the present invention. That is, the in-vehicle audio control method according to the present invention is roughly classified into (1) music / image classification processing step (SA110), (2) music-compatible image setting step, (SA120), and (3) music-compatible image. (4) traveling region determination step (SA140), (5) music corresponding image extraction step (SA150), and (6) music corresponding image display step (SA160). .

(1) The music / image classification processing step is a processing procedure for classifying a plurality of music information and a plurality of image information by genre (pops, rock, folk songs, etc.). In this example, this music / image classification processing step allows the user (driver) to classify by setting operation on the music image setting management menu screen 610 (FIG. 5). It can also be automatically performed by the information classification unit 320.

(2) The music-compatible image setting step is a processing procedure for setting music information and image information in association with each other by the music-compatible image setting unit 430 (FIG. 1).

(3) The music corresponding image registration step is a processing procedure for setting and registering image information corresponding to the music information set in the music corresponding image setting step. Image information associated with the music information registered in the music-compatible image registration step is stored (stored) in the music-compatible image registration database 730. The music information and image information set by this music-compatible image setting step are stored (registered) in the music-compatible image registration database 730 (FIG. 1). In this example, a plurality of pieces of image information can be set corresponding to music information of one song.

(4) The travel region determination step is a processing procedure for acquiring the travel region of the host vehicle. This travel area determination step can be performed by the navigation system 800.

(5) In the music corresponding image extraction step, the music image registration database is collated in correspondence with the reproduced music information, and the image information identification ID associated with the music information registered in the music corresponding image registration step is set. It is a processing procedure for extracting an associated image.

(6) The music-compatible image display step is a processing procedure for causing the monitor 600 to display the image extracted by the music-compatible image extraction step.

(Vehicle audio control procedure by vehicle audio system)
Hereinafter, the in-vehicle audio control procedure by the above-described in-vehicle audio system will be described in detail with reference to FIG. FIG. 15 is a flowchart illustrating details of an in-vehicle audio control procedure by the in-vehicle audio system according to the first embodiment. This flowchart shows a detailed control procedure executed by the in-vehicle audio apparatus 110.

  That is, first, when the driver gets on his / her vehicle and the power source (monitor power switch) of the in-vehicle audio device 110 is pressed (ON) (step S110), the driver plays the favorite music (music). The process proceeds to the “music selection mode” to be selected (step S120). Next, the driver waits for a music selection (selection) operation (step S130), and if any music is selected by the driver (Yes in step S130), hereinafter, “study mode” according to the first embodiment. (Step S140).

  As described above, the “situation correspondence mode” is a procedure (mode) for automatically determining image information corresponding to the driving situation and the traveling region of the host vehicle. Specifically, the operation mode branches into two modes: a travel region and a travel time, and the next travel region in which the vehicle is traveling is determined in step S150 (step S150). Next, the travel area is searched by the own vehicle (step S160) based on the determination of the travel area, and the travel area of the own vehicle is acquired by this search (step S170). Next, based on the travel area of the host vehicle acquired in step S170, the image information corresponding to the travel area is searched (step S180). Here, as described above, the search of the travel area in step S160 is performed by using the navigation system 800.

  Thereafter, an image corresponding to the travel region is acquired by the search in step S180 (step S185), and the acquired image information is extracted (step S186). Hereinafter, based on the image extracted by the process of step S186, the display image displayed on the monitor 600 is set (step S188). The image set in step S188 is registered and stored in the music corresponding image registration database 730 (FIG. 1) (step S190). Thereafter, the set image is displayed on the monitor 600 (step S195), and all the processes are terminated.

  Here, in the “situation correspondence mode” in step S140, it is possible to set an image to be displayed on the monitor 600 by the travel time zone determination process in addition to the travel region determination process described above. That is, the process proceeds to the determination of the travel time by the determination of step S140, the determination of the travel time period is performed by step S151 (step S151), the search of the travel time period (step S152), and the acquisition of the travel time period (step S153). ), Search for image information corresponding to the travel time zone (step S154) is sequentially performed. In the following, according to the processing procedure of steps S185 to S195 described above, the image information of the travel time zone is made to correspond to the music information 600. (End).

  Here, as described above, the situation related to the driving state by the own vehicle includes a plurality of patterns acquired by using a navigation system (car navigation system) such as when going to work or when going home, in addition to the travel area and travel time zone. Therefore, image information that is most suitable for the user is displayed on the monitor 600 together with favorite music information by appropriately registering the image information based on the plurality of situations (driving conditions). Can do.

  As described above, since the image switching processing unit 410 is provided in the present invention, for example, when the travel area changes during traveling of the host vehicle, the image is switched to an image corresponding to the travel area after the change. Can be done. In this case, when a plurality of images are switched to make a round within the music playback time, the images can be repeatedly switched and displayed on the monitor 600.

As described above, according to the audio device according to the first embodiment of the present invention, appropriate image information (video) corresponding to the music information selected by the user (the driver of the own vehicle) is automatically extracted, It can be displayed on the monitor 600, and further corresponds to music information based on the situation (driving state) acquired by using the navigation system (car navigation system) such as the traveling time zone of the own vehicle, when going to work, and when going home. Since the image information is set, the most suitable image information for the user can be displayed on the monitor 600.

Next, a second embodiment according to the audio apparatus of the present invention will be described. FIG. 16 is an overall functional block diagram of an in-vehicle audio system 100a including the in-vehicle audio device 110 according to the second embodiment. In the following description, the same components as those in the first embodiment are denoted by the same reference numerals, and detailed description thereof is omitted. The difference between the second embodiment and the first embodiment is the same as that of the first embodiment except for the components constituting the music image information processing unit 200a. A detailed description that matches is omitted.

  Here, the feature of the second embodiment is that by automatically recognizing the genre related to the music information, the image information representing an image suitable for the music information is automatically displayed on the monitor 600 by determining the keyword of the music information. There is a feature in doing. Therefore, the music image information processing unit 200a includes a music information recognition unit 230 and an image information recognition unit 240.

  The music information recognition unit 230 has a function of recognizing music information reproduced by the in-vehicle audio device 110. Specifically, keywords related to the genre of music (pops, popular songs, music themes) are extracted from the music selected by the user (driver) by the music information recognition unit 230, and the selected music information is selected. A function for determining the genre by genre. Here, when listening to a radio (AM / FM broadcast) music program or the like, the music information recognizing unit 220 records the desired music when the registration mode (not shown) is pressed (ON). By recognizing the keyword based on the music piece, it can be automatically classified by genre and stored in the image information database 720. The image information recognition unit 230 has a function of automatically recognizing image information, classifying images acquired by the Internet, a digital camera, a video camera, and the like and storing them in the image information database 720.

  That is, as shown in the flowchart of FIG. 17, first, when the driver gets on the host vehicle and the power source (monitor power switch) of the in-vehicle audio device 110 is pressed (ON) (step S110), driving is performed. The driver shifts to the “music selection mode” in which the user selects his / her favorite music (music) (step S120). The driver then waits for a music selection (selection) operation (step S130), and the driver selects the music. If this is the case (Yes at step S130), the process proceeds to a music information recognition mode for recognizing the selected music information (step S135).

  As described above, in this music information recognition mode, keywords related to the genre of music (pops, pop songs, music themes) and the like are extracted from the music selected by the user (driver) by the music information recognition unit 230. In this processing mode, the selected music information is determined by genre. That is, in the next step S145, a keyword for image setting is searched from the selected music information (step S145), and by extracting this keyword (step S155), the theme of the selected music information (song) is determined. Perform (step S165). Specifically, step S145 to step S165 will be described. When the music selected by the user (driver) is a song with the theme of the sea or the like, the lyrics of the song include “sea”, “wave” and the like. Will appear. Therefore, paying attention to this point, for example, when music having the keyword “sea” is selected by the music information recognizing unit 230, the selected music can be determined as a sea-themed song. .

  Thereafter, the theme of the music information is determined by the determination in step S165, and based on the determined theme (keyword), image information related to the keyword is searched from the image information database 720 (step S175). Image information is extracted (step S186), and the display image to be displayed on the monitor 600 is set based on the image extracted by the process of step S186 (step S188). The image set in step S188 is registered and stored in the music corresponding image registration database 730 (FIG. 1) (step S190). Thereafter, the set image is displayed on the monitor 600 (step S195), and all the processes are terminated.

  Here, in the second embodiment, a function of recognizing image information encountered in the past by the image information recognition unit 230 and displaying it again on the monitor 600 based on keywords such as the travel region and travel time zone of the host vehicle. You may make it provide. In addition to a speaker that reproduces music, a microphone that captures sound may be provided, and desired image information may be displayed on the monitor 600 by the sound of the user (driver).

As described above, according to the audio apparatus according to the second embodiment of the present invention, the music image information processing unit 200a includes the music information recognition unit 230 that recognizes music information and the image information recognition unit 240 that recognizes image information. Therefore, the reproduction of the image information with respect to the music information is controlled by searching for / extracting the keyword based on the recognition information recognized by the music information recognition unit 230 and the image information recognition unit 240. When the (driver) listens to music in the vehicle, an image according to the image appropriately corresponding to the driving situation can be displayed on the monitor 600 more accurately.
is not.

As described above, the audio device according to the present invention is useful for an audio device mounted on an automobile, and is particularly suitable for an audio device that can display an image as it is when listening to music on a monitor.

1 is a functional block diagram showing a schematic configuration of an in-vehicle audio system according to Embodiment 1 of the present invention. It is a figure which shows an example of a structure of a music information database. It is a figure which shows an example of a structure of an image information database. It is a figure which shows an example of a structure of a music corresponding | compatible image registration database. It is a figure which shows a music image information management menu screen. It is a figure which shows an example of a music classification selection screen. It is a figure which shows an example of a registration setting screen (title setting). It is a figure which shows an example of a registration setting screen (album setting). It is a figure which shows an example of an image classification selection screen. It is a figure which shows an example of a registration setting screen (landscape setting). It is a figure which shows an example of a registration setting screen (POPS1 setting). It is explanatory drawing which shows an example of the music classification selection screen at the time of registration. It is explanatory drawing which shows an example of the registration setting screen at the time of registration. It is a flowchart which shows the basic control procedure in the audio system for vehicle installation. 3 is a flowchart illustrating a control procedure of the in-vehicle audio system according to the first embodiment. It is a functional block diagram which shows the general | schematic structure of the vehicle-mounted audio apparatus which concerns on Example 2 of this invention. 10 is a flowchart illustrating a control procedure of the in-vehicle audio system according to the second embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 110 In-vehicle audio apparatus 200, 200a Music image information processing part 210 Music recording / reproducing part 220 Image recording / reproducing part 230 Music information recognition part 240 Image information recognition part 300 Music image information classification control part 310 Music information classification part 320 Image information classification part 400 Music Image Corresponding Control Unit 410 Image Switching Processing Unit 420 Image Switching Control Unit 430 Music Corresponding Image Setting Unit 440 Music Image Linking Unit 500 Traveling Area Determination Unit 510 Traveling Time Zone Determination Unit 520 Congestion Information Determination Unit 600 Monitor 650 Speaker 610 Music Image Setting management menu screen 620 Music classification setting icon 630 Image classification setting icon 635 Music classification selection screen 635a Image classification selection screen 640 Music-compatible image setting icon 680 Operation unit 681 Registration setting screen 682 Setting button 683 Return Display buttons 684 image selection button 685 image confirmation button 710 music information database 720 the image information database 730 music corresponding image registration database 740 captured image information database 800 the navigation system 810 GPS receiver 820 map database

Claims (7)

Storage means for storing music information and more image information than the number of the music information;
Music information reproducing means for reproducing the music information;
Environment acquisition means for acquiring environment information relating to a reproduction environment in which the music information is reproduced;
Image information reproducing means for extracting and reproducing corresponding image information from the storage means based on the music information reproduced by the reproducing means and the environment information acquired by the environment acquiring means;
An audio apparatus comprising: The audio device according to claim 1, wherein the storage unit stores a plurality of pieces of image information or a plurality of types of image information in association with each piece of music information or various kinds of music information. . The storage unit stores image information corresponding to each reproduction environment or a type of image information in association with each piece of music information or various kinds of music information. Audio equipment. The image information reproducing means reproduces when the environment information acquired by the environment acquiring means is changed.
The audio apparatus according to claim 1, 2 or 3 , wherein image information to be switched is switched . The environmental information is at least one of a travel area of the vehicle in which the music information is reproduced, a time zone in which the music information is reproduced, and traffic information in a travel area of the vehicle in which the audio device is mounted. The audio apparatus according to claim 1 , wherein the audio apparatus is provided. 6. The navigation apparatus according to claim 1, further comprising navigation means for setting a travel route of a vehicle on which the audio device is mounted, wherein the environment acquisition means acquires the environment information from the navigation means . The audio device according to one. Voice recognition means for recognizing music information stored in the storage means;
The storage means is based on the recognition result of the voice recognition means, the stored music information, or
Corresponds to multiple types of image information or multiple types of image information corresponding to the types of stored music information
The audio apparatus according to claim 1 , wherein the audio apparatus is attached .

Images