WO2006095688A1

WO2006095688A1 - Information reproduction device, information reproduction method, information reproduction program, and computer-readable recording medium

Info

Publication number: WO2006095688A1
Application number: PCT/JP2006/304281
Authority: WO
Inventors: Koji Koga; Takeshi Sato; Goro Kobayashi
Original assignee: Pioneer Corporation
Priority date: 2005-03-11
Filing date: 2006-03-06
Publication date: 2006-09-14

Abstract

An information reproduction device has an acquisition section (201) for detecting the condition of seating of a vehicle occupant; an identification section (202) for identifying the occupant based on the information on the seating condition acquired by the acquisition section (201); a reproduction section (203) for reproducing sound data associated with the occupant identified by the identification section (202); and a control section (204) for controlling, based on the result identified by the identification section (202), a sound field formed by a sound of the sound data reproduced by the reproduction section (203).

Description

Specification

Information reproducing apparatus, information reproducing method, information reproducing program, and computer-readable recording medium

Technical field

[0001] The present invention relates to an information reproduction apparatus, an information reproduction method, an information reproduction program, and a computer-readable recording medium that acquire information related to the sitting state of a passenger in a vehicle and reproduce audio data and the like. However, the use of the present invention is not limited to the above-described information reproducing apparatus, information reproducing method, information reproducing program, and computer-readable recording medium.

Background art

[0002] Conventionally, in a vehicle, the passengers in each seat are identified, stored for each passenger, and the position and operating state of in-vehicle devices such as seats and mirrors are adjusted according to the setting information. In-vehicle equipment adjustment devices, virtual speaker amplifiers, etc. that accurately localize sound images according to the shape of the head of a voice listener have been proposed.

[0003] In the in-vehicle device adjustment apparatus as described above, for example, each passenger can be identified by selecting setting information for himself / herself from the setting information registered in advance by the passenger or by the passenger himself / herself. This is done by, for example, reading an information stored in the ID card with an ID force reader provided for each vehicle seat.

[0004] Further, in the virtual speaker amplifier as described above, the sound image localization of the audio signal detects the head shape of the listener and detects the speaker position force based on the head-related transfer function or the like. This is done by accurately simulating the transfer characteristics up to and obtaining the filter coefficient, and using the obtained filter coefficient to localize the sound image.

[0005] For example, in the in-vehicle profile system and the drive environment setting method described in Patent Document 1 below, the preferred in-vehicle environment (in-vehicle device) set by each passenger in each seat of the vehicle (driver's seat, front passenger seat, etc.) (Such as the location and operating state of the vehicle) is stored in an ID card using an IC as profile information for each passenger. And the passenger's profile from the ID card By adjusting the in-vehicle equipment by reading out the vehicle information, it is set to the passenger's preferred in-vehicle environment.

[0006] For example, in the virtual speaker amplifier described in Patent Document 2 below, the face of the user (listener) is photographed with a CCD camera, and the width of the user's face and the size of the auricle are based on this image. Detect. Using the face width and pinna size as the user's head shape data, the rear speaker force calculates the head-related transfer function that is the transfer function to the user's ears. Then, the sound image localization of the rear speaker is realized with the front speaker by performing the finisher processing with the DSP of the USB amplifier so as to realize the characteristics of the head-related transfer function.

Patent Document 1: Japanese Patent Application Laid-Open No. 2002-104105

Patent Document 2: JP 2003-230199 A

Disclosure of the invention

Problems to be solved by the invention

However, when using an ID card for passenger identification as described in Patent Document 1, it is necessary to install an _ID card reading device for each vehicle seat. An example of the installation of such special equipment for each seat is the burden on the interior space and money.

[0009] In addition, it is necessary to create and possess an ID card for each passenger, which makes it difficult to create and handle ID cards. One example is the problem that if the ID card is lost or damaged, the passenger cannot be identified.

[0010] Also, with the prior art disclosed in Patent Document 1, it is possible to store in-vehicle device setting information according to the passenger's preference, but to actively make the in-vehicle device setting suitable for the passenger. An example of this is the problem that cannot be done.

[0011] Further, as in Patent Document 2, when a head image is obtained by photographing a listener's face image and filter processing is performed and sound image localization is performed, complicated operations such as image calculation processing and audio filter processing are performed. As an example, there is a problem that sound image localization associated with sound reproduction cannot be performed easily and easily because a simple process is essential.

Means for solving the problem

[0012] An information reproducing apparatus according to the invention of claim 1 detects a seating state of a passenger in a vehicle, An acquisition means for acquiring information relating to the seating state; an identification means for identifying the occupant based on information relating to the seating state acquired by the acquisition means; and an occupant identified by the identification means. Reproduction means for reproducing the sound data being reproduced, and control means for controlling the sound field formed by the sound of the sound data reproduced by the reproduction means based on the identification result identified by the identification means. It is characterized by providing.

[0013] Further, the information reproduction method according to the invention of claim 7 is obtained by an acquisition step of detecting a seating state of a passenger in a vehicle and acquiring information on the seating state, and the acquisition step. An identification step for identifying the occupant based on information related to the seating state, a reproduction step for reproducing audio data associated with the occupant identified by the identification step, and an identification identified by the identification step And a control step of controlling the sound field formed by the sound of the sound data reproduced by the reproduction process based on the result.

An information reproduction program according to the invention of claim 8 causes a computer to execute the information reproduction method according to claim 7.

[0015] Further, the computer-readable recording medium according to the invention of claim 9 is the claim.

The information reproduction program described in 8 is recorded.

Brief Description of Drawings

[0016] FIG. 1 is an explanatory view showing an example of the inside of a vehicle on which an information reproducing apparatus that is useful for an embodiment is mounted.

[FIG. 2] FIG. 2 is a block diagram showing an example of a functional configuration of an information reproducing apparatus according to an embodiment.

FIG. 3 is a flowchart showing an example of an information reproduction processing procedure of the information reproducing apparatus according to the embodiment.

[FIG. 4] FIG. 4 is a block diagram showing an example of a hardware configuration of an information reproducing apparatus according to the embodiment.

FIG. 5 is a block diagram illustrating an example of an internal configuration of an image processing unit in the information reproducing apparatus according to the embodiment. Ο

FIG. 6 is a block diagram illustrating an example of the internal configuration of the audio processing unit in the information reproducing apparatus according to the embodiment.

1—

FIG. 7 is an explanatory diagram showing an example of the inside of a vehicle on which the information reproducing apparatus according to the example is mounted.

[FIG. 8] FIG. 8 is a flowchart showing an example of an information reproduction processing procedure of the information reproducing apparatus according to the embodiment.

Explanation of symbols

Acquisition department

202 Identification part

203 Playback section

204 Control unit

205 '1 thought p ^: [5

206 Camera

207 Image display equipment

208 Audio output device

400 Navigation control unit

412 Image processing unit

414 Audio processing unit

510 Image analysis unit

610 Audio playback processor

613 Sound field controller

BEST MODE FOR CARRYING OUT THE INVENTION

[0018] Exemplary embodiments of an information reproducing apparatus, an information reproducing method, an information reproducing program, and a computer-readable recording medium recording the program according to the present invention will be described in detail below with reference to the accompanying drawings. explain.

[0019] (Embodiment)

First, an explanation will be given of the inside of a vehicle on which an information reproducing apparatus that is useful for the embodiment of the present invention is mounted. FIG. 1 shows an information reproducing apparatus that is useful for the embodiment of the present invention. It is explanatory drawing which shows an example inside the made vehicle. In FIG. 1, for example, an image display device (display) 121a, an audio output device (speaker) 122, and an information reproducing device 126a are provided around the driver's seat 111 and the passenger seat 112.

[0020] In addition, a photographing device (camera) 123 is provided on the ceiling 114 of the vehicle, and an image display device (display) 121 is provided on the passenger seat 112 to the passenger on the rear seat 113. b and an information reproducing device 126b are provided. A sound output device (speaker) (not shown) is provided behind the rear seat 113, and a photographing device (camera) 123 is provided in each information reproduction device 126 (126a, 126b).

[0021] (Functional configuration of information reproducing apparatus)

Next, a functional configuration of the information reproducing apparatus which is useful for the embodiment of the present invention will be described. FIG. 2 is a block diagram showing an example of a functional configuration of the information reproducing apparatus according to the embodiment of the present invention. In FIG. 2, the information reproduction apparatus includes an acquisition unit 201, an identification unit 202, a reproduction unit 203, a control unit 204, and a storage unit 205, and further includes a photographing device (camera) 206 and an image display device. (Display) 207 and audio output device (speaker) 208 are provided. Note that the information reproducing apparatus may have a structure that can be attached to and detached from the vehicle.

[0022] The acquisition unit 201 detects the seating state of the passenger on each of the seats 111 to 113 of the vehicle in FIG. 1, and acquires information on the seating state. Each of the seats 111 to 113 is a seat of a vehicle on which an information reproducing device is mounted. Further, the passenger is a person who gets on the vehicle, and includes a person who gets on the driver's seat 111 and a person who gets on the passenger seat 112 and the rear seat 113. Specifically, the detection of the seating state is, for example, by detecting the position in the vehicle where the passenger is seated using image data of an image taken by the photographing device 206 described later. is there.

[0023] Specifically, the information on the sitting state includes information such as seating position information, sitting height information, face image information, and ear position information of the passenger. Note that the acquisition unit 201 may be configured by so-called seating sensors provided in each of the seats 111 to 113, for example.

[0024] Here, the information regarding the sitting state includes, for example, information regarding the body part of the passenger May be included. The body part of the passenger is the position of each part of the body. Information on the body part is specifically information on the position of each part of the body, such as the position of the shoulders, abdomen, and head, the length of arms, legs, height, weight, and sitting height. is there. The information on the body part includes, for example, information on the positions of eyes and ears in the head. Further, the information on the body part may be information representing the ability of the body part such as visual acuity and hearing ability, in addition to the information on these positions alone.

[0025] When acquiring information related to the body part as information related to the sitting state, specifically, the acquiring unit 201 prays, for example, image data captured by the imaging device 206, and the boarding obtained thereby. Based on the image of the body part of the person, information on the body part is calculated and acquired. Note that the acquisition unit 201 may acquire information related to the body part as information related to the sitting state by an input operation from the passenger or reading from an external recording device.

The identification unit 202 identifies the passenger based on the information regarding the seating state acquired by the acquisition unit 201. Identification refers to the presence or absence of image data playback information on the image display device 207 corresponding to the passenger and audio data playback information on the audio output device 208, and what playback information is associated with the passenger. It is to discriminate power.

[0027] Further, in order to identify the passenger in more detail, for example, face authentication processing is performed using the passenger's face image information included in the information related to the seating state to identify and identify the person. May be. Note that information on the sitting state and information such as the identification result by the identification unit 202 are stored in the storage unit 205 described later.

The reproduction unit 203 reproduces image data and audio data associated with the passenger identified by the identification unit 202. Image data and audio data are reproduced based on the reproduction information stored in the storage unit 205. Examples of the image data reproduced by the reproduction unit 203 include image data obtained by recording a TV program, image data captured by the image capturing device 206, and the like. The audio data reproduced by the reproduction unit 203 includes music such as music and sound data such as sound effects.

[0029] Based on the identification result identified by the identification unit 202, the control unit 204 forms audio output from the audio output device 208 based on the audio data reproduced by the reproduction unit 203. To control the sound field. Specifically, the sound field control includes, for example, adjustment of sound volume of sound output from the sound output device 208, sound equalization processing, sound image localization, and the like.

[0030] When the control unit 204 performs sound image localization as control of the sound field, the sound image localization of the sound is performed using, for example, a known sound image localization method. Although the description is omitted here because it is publicly known, as a sound image localization method, for example, sound data is filtered based on the head-related transfer function to generate a virtual sound source in the sound field inside the vehicle, or the sound output device 2 It is possible to use a method of changing the audio output delay characteristic of 08.

[0031] As described above, the storage unit 205 stores information on the sitting state and information such as an identification result by the identification unit 202. In addition, the storage unit 205 stores reproduction information of image data and audio data associated with the passenger. The playback information is considered to be highly relevant to the passenger based on the information regarding the playback history and music selection history of the image data and audio data considering the preference of each passenger, or the age and gender of the identified passenger. Includes information about image and audio selection. Various types of information stored in the storage unit 205 are temporarily stored, for example, stored in a learning manner or statistically like a database, depending on the type.

[0032] The imaging device 206 captures an image inside the vehicle, for example. Image data of the captured image is provided to the acquisition unit 201. The image display device 207 displays the image data reproduced by the reproducing unit 203 on the display screen. The sound output device 208 outputs sound based on the sound data reproduced by the reproducing unit 203 and controlled by the control unit 204 to the inside of the vehicle.

(Information reproduction processing procedure of information reproduction apparatus)

Next, the information reproduction processing procedure of the information reproducing apparatus that is relevant to the embodiment of the present invention will be described. FIG. 3 is a flowchart showing an example of an information reproduction processing procedure of the information reproducing apparatus according to the embodiment of the present invention. First, an image inside the vehicle is shot by the shooting device 206 (see FIG. 2, the same applies hereinafter) (step S301). Next, based on the image data of the photographed image, it is determined whether or not the passenger is seated on the seat (step S302).

[0034] When it is determined that the passenger is not seated on each of the seats 111 to 113 (see FIG. 1, the same applies hereinafter) If yes (step S302: No), the process returns to step S301 to take an image. When it is determined that the passenger is seated on each of the seats 111 to 113 (step S302: Yes), the acquisition unit 201 (see FIG. 2, the same applies hereinafter) detects the seating state and acquires information on the seating state ( Step S303).

When information related to the seating state is acquired, the identification unit 202 (see FIG. 2, the same applies hereinafter) identifies the passenger (step S304). When the occupant is identified, the playback unit 203 (see FIG. 2 and so on) stores the playback information of the image data and audio data associated with the identified occupant in the storage unit 205 (see FIG. 2 and so on). ) To play back images and sounds on the image display device 207 (see FIG. 2, the same applies hereinafter) and the audio output device 208 (see FIG. 2, the same applies hereinafter) (step S305).

[0036] Then, the audio data reproduced by the reproduction unit 203 based on the identification result identified by the identification unit 202 by the control unit 204 when the reproduction unit 203 reproduces image data or audio data. The sound field formed by the voice is controlled (step S306). The control of the sound field in step S306 includes, for example, performing sound image localization according to the seating position of the passenger so as to form a sound field where the sound can be heard optimally for the passenger. Thus, the series of information reproduction processing according to this flowchart is completed.

[0037] As described above, according to the information reproducing apparatus according to the embodiment of the present invention, the passenger is identified based on the information on the seating state of the passenger on the vehicle, and the boarding that has been identified. In addition to playing back image data and sound data associated with a person, the sound field formed by the sound of the sound data to be played can be controlled based on the identification result! For this reason, it is possible to automatically optimize the sound field inside the vehicle according to the occupant without manually performing an input operation for sound field control.

[0038] Next, examples that are useful for the embodiment of the present invention will be described in detail. Here, a case where the information reproducing apparatus according to this embodiment is applied to an in-vehicle navigation apparatus will be described as an example.

Example

[0039] (Hardware configuration of information reproducing apparatus) First, the hardware configuration of an information reproducing apparatus according to the embodiment of the present invention will be described. FIG. 4 is a block diagram showing an example of the hardware configuration of the information reproducing apparatus according to the embodiment of the present invention.

In FIG. 4, the information reproducing apparatus is mounted on the vehicle in a detachable structure as described above, and includes a navigation control unit 400, a user operation unit (remote control and touch panel) 401, and a display unit (monitor). ) 402, position acquisition unit 403, recording medium 404, recording medium decoding unit 405, guidance sound output unit 406, communication unit 407, route search unit 408, route guidance unit 409, and guidance sound generation The unit 410 includes a speaker 411, an image processing unit 412, an image input / output IZF 413, an audio processing unit 414, and a photographing unit 415.

[0041] The navigation control unit 400 controls the entire information reproducing apparatus, for example, and performs various arithmetic processes according to the control program, thereby comprehensively controlling each unit included in the information reproducing apparatus. The navigation control unit 400 includes, for example, a CPU (Central Processing Unit) that executes predetermined arithmetic processing, a ROM (Read Only Memory) that stores various control programs, and a RAM (Random Access Memory) that functions as a work area for the CPU. ) Or the like.

[0042] In addition, the navigation control unit 400, for example, when the vehicle route is guided, information on the current position of the vehicle (current position information) acquired by the position acquisition unit 403 and the recording medium 404 to the recording medium decoding unit 405 Based on the map information obtained via the map, the position on the map where the vehicle is traveling is calculated, and the calculation result is output to the display unit 402. The navigation control unit 400 inputs / outputs information related to route guidance between the route search unit 408, the route guidance unit 409, and the guidance sound generation unit 410 when performing the above-described route guidance, and obtains information obtained as a result. The information is output to the display unit 402 and the guidance sound output unit 406.

[0043] The user operation unit 401 outputs information input by the user, such as characters, numerical values, and various instructions, to the navigation control unit 400. As the configuration of the user operation unit 401, various known forms such as a push button switch that detects physical pressing Z non-pressing, a touch panel, a keyboard, and a joystick can be employed. This user operation unit 401 uses, for example, a microphone for inputting sound of external power to You can also use the input operation mode!

[0044] Further, the user operation unit 401 may be provided integrally with the information reproducing apparatus, or may be configured to be able to be operated with a position force separated from the information reproducing apparatus, such as a remote controller. . In addition, the user operation unit 401 may be configured in any one of the various forms described above, or may be configured in a plurality of forms. The user inputs information by appropriately performing an input operation according to the form of the user operation unit 401.

[0045] Information input by an input operation of the user operation unit 401 includes, for example, information on a destination regarding navigation. Specifically, for example, when the information reproducing apparatus is provided in a vehicle or the like, a point to be reached by the passenger of this vehicle is set. Further, as information input to the user operation unit 401, for example, regarding information reproduction, selection information of audio reproduced by an audio processing unit 414 described later can be cited. Specifically, for example, audio data such as music desired by the passenger of this vehicle is selected and set.

Here, for example, when a touch panel is adopted as the form of the user operation unit 401, the touch panel is used by being stacked on the display screen side of the display unit 402. In this case, the input timing by the input operation is recognized by managing the display timing on the display unit 402, the operation timing for the touch panel (user operation unit 401) and its position coordinates.

[0047] By adopting a touch panel stacked on the display unit 402 as a form of the user operation unit 401, it is possible to input a large amount of information without enlarging the form of the user operation unit 401. As this touch panel, various known touch panels such as a resistive film type and a pressure sensitive type can be adopted.

[0048] Display unit 402 includes, for example, a CRT (Cathode Ray Tube), a TFT liquid crystal display, an organic EL display, a plasma display, and the like. Specifically, the display unit 402 can be configured by, for example, a video IZF or a video display device connected to the video IZF, not shown.

Here, specifically, the video IZF is, for example, a graphic controller that controls the entire display device, and a VRAM (V It consists of a buffer memory such as ideo RAM) and a control IC or GPU (Graphics Processing Unit) that controls display based on image information output from the graphics controller. The display unit 402 displays icons, cursors, menus, windows, or various information such as characters and images. Further, the display unit 402 displays image data processed by an image processing unit 412 described later.

[0050] The position acquisition unit 403 acquires the current position information (latitude and longitude information) of the vehicle on which the information reproducing device is mounted, for example, by receiving radio waves of artificial satellite power. Here, the current position information is information that receives radio waves from an artificial satellite and obtains the geometric position with the artificial satellite, and can be measured anywhere on the earth. The position acquisition unit 403 includes a GPS antenna (not shown).

[0051] Here, GPS (Global Positioning System) is a system that accurately obtains a position on the ground by receiving radio waves from four or more artificial satellites. Here, explanation of GPS is omitted because it is a publicly known technology. This position acquisition unit 403 can be configured by, for example, a tuner that demodulates radio waves received by satellite power, an arithmetic circuit that calculates the current position based on the demodulated information, and the like.

[0052] It should be noted that the radio wave from the artificial satellite is 1. Carrier wave of 57542 GHz, using L1 radio wave carrying CZA (Coarse and Access) code and navigation message. Thereby, the current position (latitude and longitude) of the vehicle on which the information reproducing apparatus is mounted is detected. When detecting the current position of the vehicle, information collected by various sensors such as a vehicle speed sensor and a gyro sensor may be taken into account. The vehicle speed sensor detects the vehicle speed from the output shaft of the transmission of the vehicle equipped with the information reproducing device.

[0053] In addition, when detecting the current position of the vehicle, information collected by various sensors such as an angular velocity sensor, a travel distance sensor, a tilt angle sensor, and a lateral G (Gravity) sensor may be taken into consideration. The angular velocity sensor detects the angular velocity when the vehicle rotates and outputs angular velocity information and relative orientation information. The mileage sensor calculates the number of pulses per one rotation of the wheel by counting the number of pulses of a pulse signal output with the rotation of the wheel in a given period, and the mileage based on the number of pulses per one rotation Output information.

[0054] The inclination angle sensor detects the inclination angle of the road surface and outputs inclination angle information. Horizontal G The sensor detects lateral G, which is an outward force (gravity) generated by centrifugal force during vehicle cornering, and outputs lateral G information. The vehicle current position information acquired by the position acquisition unit 403 and the information detected by the vehicle speed sensor, gyro sensor, angular velocity sensor, travel distance sensor, inclination angle sensor, and lateral G sensor are used for navigation. Output to the control unit 400.

[0055] The recording medium 404 records various control programs and various information in a state readable by a computer. The recording medium 404 accepts writing of information by the recording medium decoding unit 405 and records the written information in a nonvolatile manner. The recording medium 404 can be realized by HD (Hard Disk), for example.

[0056] Note that the recording medium 404 is not limited to HD. Instead of HD or in addition to HD, DVD (Digital Versatile Disk), CD (Compact Disk), or other recording medium decoding unit 405 can be attached and detached. A medium that is portable and has portability may be used as the recording medium 404. The recording medium 404 is not limited to a DVD and a CD. The recording medium 404 is attached to and detached from a recording medium decoding unit 405 such as a CD-ROM (CD-R, CD-RW), MO (Magneto-Optical disk), or a memory card. Use media that is portable and portable.

Note that the recording medium 404 records an information reproduction program, a navigation program, image data, audio data, map information, and the like that realize the present invention. Here, the image data refers to, for example, a two-dimensional array value representing an image of an image taken inside the vehicle. Audio data refers to data for reproducing music such as music. The map information includes background information representing features (features) such as buildings, rivers, and the ground surface, and road shape information representing the shape of the road.

It is drawn in 2D or 3D.

The background information includes background shape information representing the shape of the background and background type information representing the type of the background. The background shape information includes information indicating, for example, representative points of features, polylines, polygons, coordinates of features, and the like. The background type information includes, for example, text information indicating the name, address, telephone number, and the like of the feature, and type information indicating the type of the feature such as a building 'river'. [0059] The road shape information is information relating to a road network having a plurality of nodes and links. The node is information indicating an intersection where a plurality of roads intersect, such as a three-way “crossroad” and a five-way. A link is information indicating a road connecting nodes. Some links have shape interpolation points that allow the expression of curved roads. Road shape information has traffic condition information. The traffic condition information is information indicating the characteristics of the intersection, the length (distance) of each link, vehicle width, traveling direction, traffic prohibition, road type, and the like.

[0060] The characteristics of this intersection include, for example, complex intersections such as three- and five-way intersections, intersections where roads diverge at shallow ridge angles, intersections around destinations, highway entrances and junctions, and route deviation rates. For example, high intersections. The route deviation rate can be calculated by, for example, the past driving history force. Examples of road types include highway, toll road, and general road.

[0061] In the present embodiment, for example, the power for recording image data, audio data, and map information in the recording medium 404 is not limited to this. Image data, audio data, and map information are recorded only if they are provided integrally with the hardware of the information reproducing device, and are not provided, but may be provided outside the information reproducing device. Yo ...

[0062] In this case, the information reproducing apparatus acquires image data and audio data via the network through the communication unit 407, for example. In addition, the information reproducing apparatus acquires map information via a network, for example, through the communication unit 407. The image data, audio data, and map information acquired in this way may be stored in the RAM of the navigation control unit 400, for example.

[0063] The recording medium decoding unit 405 controls reading and writing of information on the recording medium 404. For example, when HD is used as the recording medium 404, the recording medium decoding unit 405 is an HDD (Hard Disk Drive). Similarly, when DV D or CD (including CD-R, CD-RW) is used as the recording medium 404, the recording medium decoding unit 405 is a DVD drive! / ヽ is a CD drive.

[0064] Further, when a CD-ROM (CD-R, CD-RW), MO, memory card, or the like is used as the writable and detachable recording medium 404, writing of information to various recording media and Dedicated drive capable of reading information stored in various recording media An apparatus or the like is appropriately used as the recording medium decoding unit 405.

The guidance sound output unit 406 reproduces the navigation guidance sound by controlling the output to the connected speaker 411. There may be one or more speakers 411. Specifically, the guide sound output unit 406 can be realized by an audio IZF (not shown) connected to the audio output speaker 411. More specifically, the audio IZ F is, for example, a DZ A converter that performs DZA conversion of digital audio data, an Ό / A converter power, an amplifier that amplifies the analog audio signal that is output, and an AZD conversion of the analog audio signal. It can be configured with AZD converter and force.

[0066] The communication unit 407 performs communication with, for example, another information reproducing apparatus. The communication unit 407 of this embodiment may be a communication module that communicates with a communication server (not shown) via a base station (not shown) such as a mobile phone, for example. It may be a communication module that performs direct wireless communication with the device.

Here, the wireless communication is communication performed using radio waves or infrared rays' ultrasonic waves without using a wire line as a communication medium. There are various technologies such as wireless LAN, IrDA (Infrared Data Association), HomeRF (Home Radio Frequency), and BlueTooth as standards that enable wireless communication. Technology can be used. Wireless LAN is preferred from the aspect of information transfer speed and can be used as an example.

[0068] In addition, the communication unit 407 may receive road traffic information such as traffic jams and traffic regulations on a regular basis (may be irregular). Receiving road traffic information by the communication unit 407 may be performed at the timing when the VICS (Venicle Information and Communication System) Center ~~ Rikido Road ¾ · Transport † Blue Bulletin is distributed, or periodically to the vies center. It may be done by requesting road traffic information. The communication unit 407 can be realized as, for example, an AMZFM tuner, a TV tuner, a VICSZ beacon receiver, and other communication devices.

[0069] Note that rviCSj is a well-known technology that omits detailed explanations. RviCSj is a vehicle navigation device that sends traffic traffic information such as traffic jams and traffic regulations edited and processed in the VICS center in real time. Information communication system that displays characters on graphics Is. As a method of transmitting road traffic information (VICS information) edited and processed in this VICS center to the navigation device, there is a method of using “beacon” and “FM multiplex broadcasting” installed on each road.

Here, “beacons” include “radio wave beacons” mainly used on expressways and “optical beacons” used on major general roads. When “FM multiplex broadcasting” is used, road traffic information in a wide area can be received. When using a “beacon”, it is possible to receive necessary road traffic information at the location where the vehicle is located, such as detailed information on the most recent road based on the location of the vehicle (vehicle). Become. If the communication method with another information reproducing apparatus is different from the communication method for receiving image data, audio data, and road traffic information, the communication unit 407 has a plurality of corresponding methods. Have a means of communication.

[0071] The route search unit 408 calculates an optimal route from the current position to the destination based on the current position information of the vehicle acquired by the position acquisition unit 403 and the information on the destination input by the user. To do. The route guidance unit 409 includes information on the guidance route searched by the route search unit 408 or route information received by the communication unit 407, current position information acquired by the position acquisition unit 403, and a recording medium 404 Based on the map information obtained via the decoding unit 405, real-time route guidance information is generated. The route guidance information generated by the route guidance unit 409 is output to the display unit 402 via the navigation control unit 400.

[0072] Guide sound generation section 410 generates tone and voice information corresponding to the pattern. In other words, based on the route guidance information generated by the route guidance unit 409, the virtual sound source corresponding to the guidance point is set and the voice guidance information is generated, and these are transmitted via the navigation control unit 400. The sound is output to the guide sound output unit 406.

The speaker 411 reproduces (outputs) the navigation guidance sound output from the guidance sound output unit 406 and the sound output from the audio processing unit 414 described later. For example, a headphone or the like may be provided for the speaker power 411 so that the sound output sound of the guidance sound or sound is appropriately changed so that the sound field of the guidance sound or sound output from the entire vehicle interior is not obtained. Oh ,.

[0074] The image processing unit 412 receives an image input / output IZF4 from an imaging unit 415 and a communication unit 407, which will be described later. Image processing such as image data acquired through 13 and image data recorded on the recording medium 404 is performed. Specifically, the image processing unit 412 is configured by a GPU, for example. The image processing is performed by, for example, playing back image data obtained by recording a TV program obtained via the image input / output IZF413 based on reproduction information associated with the passenger. The image processing unit 412 performs, for example, image data analysis processing in accordance with a control command from the navigation control unit 400.

Based on the image data taken by the shooting unit 415 including a shooting device (VC), etc., the passenger recognizes and recognizes the passenger from the image image inside the vehicle, and analyzes information related to the seating state of the passenger To do. Specifically, the analysis of information related to the sitting state is based on, for example, determining the state in which the passenger is seated based on the seating position information of the passenger inside the vehicle and information on the body part. It is carried out. For this reason, the image processing unit 412 may be configured to have a DSP (Digital Signal Processor) function, for example.

Image Input / Output IZF 413 inputs / outputs image data input / output to / from image processing unit 412 from the outside. Image input / output IZF413 uses USB (Universal Serial Bus), IEEE 1394 to transfer image data from recording medium 404 that stores image data captured by DSC or DVC, for example, or image data stored in DSC or DVC, for example. (Institut e of Electrical and Electronic Engineers 1394) and image data input from the communication unit 407 by communication such as infrared rays is output to the image processing unit 412 and the image data output from the image processing unit 412 is output to the recording medium 404. And output to the communication unit 407.

Note that the image input / output IZF 413 has a function of a controller for controlling read Z write of the recording medium 404 when inputting / outputting image data to / from the recording medium 404. Further, the image input / output IZF 413 may have a function of a communication controller that controls communication with the communication unit 407 when inputting / outputting image data to / from the communication unit 407.

[0078] The audio processing unit 414 receives audio data obtained from the recording medium 404 through the recording medium decoding unit 405 and audio data obtained from the communication unit 407 through the navigation control unit 400. Data is selected, and the selected audio data is played back. Further, the audio processing unit 414 performs reproduction processing of audio data stored in a storage device such as an audio database (hereinafter referred to as “audio DB”) 611 (see FIG. 6) described later. Audio data to be played back includes audio data such as music and sound effects. The reproduction process includes, for example, control of the sound field formed by the sound output from the speaker 411. In addition, when the information reproducing apparatus includes an AMZFM tuner or a TV tuner, the audio processing unit 414 may be configured to reproduce, for example, radio or television sound.

[0079] Also, the audio processing unit 414 performs audio data reproduction processing based on the audio data reproduction information associated with the passenger identified and recognized by the image processing unit 412. Yeah. The sound processing unit 414 controls the output of sound output from the force 411 based on the selected and reproduced sound data. More specifically, for example, sound volume adjustment and equalizing processing and sound image localization are performed to control the sound output state. The audio output control by the audio processing unit 414 is performed by, for example, an input operation from the user operation unit 401 or a control by the navigation control unit 400.

[0080] The imaging unit 415 includes an imaging device (camera) 123 mounted on the vehicle in FIG. 1 and an external imaging device such as the above-described DSC and DVC, and includes a photoelectric conversion element such as a C-MOS or a CCD. And take images inside the vehicle. This photographing unit 415 is connected to the information reproducing device by wire or wirelessly, and photographs a video (image) including, for example, a passenger inside the vehicle by a photographing command from the navigation control unit 400. Image data of the image captured by the imaging unit 415 is output to the image processing unit 412 via the image input / output IZF 413.

Here, the information reproducing apparatus replaces the information related to the sitting state of the passenger inside the vehicle in place of or instead of the image data photographed by the photographing unit 415 and analyzed by the image processing unit 412, for example, each seat It may be obtained based on signals detected by a seating sensor that also has a force, such as a membrane switch mounted on 111-113 (see Fig. 1, the same applies hereinafter). In this case, the signal indicating the seating sensor force is input to the navigation control unit 400, and the navigation control unit 400 determines the seating state of the passenger.

[0082] Note that the acquisition unit 201 and the identification unit 202 in FIG. The function is realized by the processing unit 412 and the navigation control unit 400, and the playback unit 203 realizes the function by, for example, the image processing unit 412, the sound processing unit 414, and the navigation control unit 400. Further, the control unit 204 in FIG. 2 specifically realizes its function by, for example, the audio processing unit 414 and the navigation control unit 400, and the storage unit 205 includes, for example, the recording medium 404 and the recording medium decoding unit 405. The function is realized by.

[0083] In addition, specifically, the imaging device 206 in FIG. 2 realizes its function by the imaging unit 415, for example. Further, the image display device 207 in FIG. 2 specifically realizes its function by the display unit 402, for example, and the audio output device 208 realizes its function by, for example, the speaker 411.

Here, the internal configurations of the image processing unit 412 and the audio processing unit 414 will be described. FIG. 5 is a block diagram showing an example of the internal configuration of the image processing unit in the information reproducing apparatus according to the embodiment of the present invention. FIG. 6 is a block diagram showing an example of the internal configuration of the audio processing unit in the information reproducing apparatus according to the embodiment of the present invention.

In FIG. 5, an image processing unit 412 includes an image analysis unit 510, a display control unit 511, an image recognition unit 512, an image storage unit 513, a passenger recognition unit 514, a passenger database (hereinafter referred to as “passenger database”). , “Passenger DB”) 515. The image analysis unit 510 includes an image input / output I / F 413 through an image input unit 415 (see FIG. 4; the same applies hereinafter), external image data input to the image processing unit 412, and a recording medium decoding unit 405 (see FIG. 4). The same applies to the following) and the navigation control unit 400 (see FIG. 4; the same applies to the following), and analyzes the image data input from the recording medium 404 (see FIG. 4; the same applies to the following) to the image processing unit 412. Specifically, the image analysis unit 510 is configured by, for example, a GPU.

The display control unit 511 performs control for displaying the image data output from the image analysis unit 510 on the display screen of the display unit 402. The image recognition unit 512 recognizes what image image is included in the image data based on the image data input to the image analysis unit 510. Specifically, the image recognizing unit 512 recognizes, for example, where the passenger is seated in the vehicle. The image storage unit 513 stores the image data input to the image analysis unit 510. The image storage unit 513 is an information reproducing device. The reproduction information of the image data to be reproduced is stored. This reproduction information is stored in association with the identified passenger.

[0087] The occupant recognition unit 514 stores the image of the occupant in the image data input to the image analysis unit 510. If the image of the occupant is included, the occupant recognition unit 514 stores the occupant recognition unit 514. The passenger's image is read out, and the passenger's identification 'recognition process represented by the image is performed. Specifically, the identification / recognition process is performed, for example, by face authentication based on the passenger's face image information. Since face authentication is a known technique, description thereof is omitted here. The passenger DB 515 stores image data including image images of passengers of the vehicle, personal identification data such as the age and gender of these passengers, and the like.

On the other hand, in FIG. 6, an audio processing unit 414 includes an audio reproduction processing unit 610, an audio data base (hereinafter referred to as “audio DB”) 611, and a history database (hereinafter referred to as “history DB”). 612, a sound field control unit 613, and a parameter storage unit 614. The audio reproduction processing unit 610 performs selection / reproduction processing of audio data input to the audio processing unit 414 and audio data stored in the audio DB 611. Also, the audio reproduction processing unit 610 performs selection / reproduction processing of audio data associated with the passenger identified by the image processing unit 412 (see FIG. 5, the same applies hereinafter). The voice data associated with the passenger is, for example, voice data associated with a rhythm or tempo that seems to be optimal for the age of the passenger.

The audio DB 611 stores audio data to be selected and reproduced by the audio processing unit 414.

The audio data stored in the audio DB 611 is the audio data input to the audio processing unit 414 even if the recording medium 404 (see FIG. 4; the same applies hereinafter) and the communication unit 407 (see FIG. 4; the same applies hereinafter) It may also be audio data equipped in the brute force information reproducing apparatus. The history DB 612 stores information related to the playback history and music selection history of the music when the audio data selected and played back by the audio processing unit 414 is music data. This history DB 612 stores, for example, information related to the playback history and music selection history of music played during driving when the information playback device is mounted on a vehicle.

[0090] The sound field control unit 613 is configured to output the sound data and the navigation data output from the sound reproduction processing unit 610. Based on the information regarding the seating state output from the motion control unit 400, the sound field parameter for sound field control is read from the parameter storage unit 614, and the sound output from the speaker 411 is read based on the read sound field parameter. Controls the sound field that forms. The sound field is controlled by, for example, sound image localization.

The parameter storage unit 614 stores sound field parameters for sound field control used in the sound field control unit 613. The stored sound field parameters are determined in advance so that an optimal sound field can be formed in accordance with information such as the seating position, sitting height, and ear position of the passenger in sound image localization. It is a thing. Here, the sound image localization by the sound field control unit 613 will be described. FIG. 7 is an explanatory view showing an example of the internal part of the vehicle on which the information reproducing apparatus according to the embodiment of the present invention is mounted.

[0092] In FIG. 7, a plurality of speakers (SP1 to SP4) of the information reproducing apparatus 411 (see FIG. 4, the same applies hereinafter) are installed inside the vehicle, SP1 is in front of the passenger seat 712, and SP2 is driving In front of the seat 711, SP3 is installed behind the rear left seat 713, and SP4 is installed behind the rear right seat 714.

[0093] When the occupant is seated only in the driver's seat 711, the sound field control unit 613 (see FIG. 6, the same applies hereinafter), for example, the sound output delay characteristics of SP1 to SP4 based on the sound field parameters. The values are set to SPl = +0.001 seconds, SP2 = -0. 001 seconds, SP3 = +0.03 seconds, SP4 = +0.002 seconds, and optimal for passengers on driver seat 711 Sound image localization is performed so that a sound field can be provided.

[0094] When the passenger is seated only in the driver's seat 711 and the passenger seat 712, the sound field control unit 613 calculates, for example, the sound output delay characteristic values of SP1 to SP4 based on the sound field parameters. , SP1 = 0 seconds, SP2 = 0 seconds, SP3 = +0.002 seconds, SP4 = +0.002 seconds, and the optimal sound field for passengers in the driver's seat 711 and passenger seat 712 Sound image localization is performed so that can be provided. In addition, the sound field control unit 613 reads out the sound field parameters from the parameter storage unit 614 (refer to FIG. 6, the same applies hereinafter) and performs sound image localization appropriately in accordance with the boarding position pattern of the passenger.

[Information Reproduction Processing Procedure of Information Reproducing Device]

Next, the information reproduction processing procedure of the information reproducing apparatus according to the embodiment of the present invention explain. FIG. 8 is a flowchart showing an example of the information reproduction processing procedure of the information reproducing apparatus according to the embodiment of the present invention. Here, the case where information reproduction processing is performed based on the seating position of the passenger will be described. In FIG. 8, first, an image inside the vehicle is captured by the imaging unit 415 (see FIG. 4, the same applies hereinafter) provided inside the vehicle (step S801).

[0096] Image data of the captured image is input to an image processing unit 412 (see Fig. 5 and the same below) via an image input / output IZF413 (see Fig. 4 and the same below), and an image analysis unit 510 (Fig. It is determined whether or not the passenger is seated on the seat (see step S802). If it is determined that the passenger is not seated on the seat (step S802: No), the process returns to step S801 to capture an image. When it is determined that the passenger is seated on the seat (step S802: Yes), the navigation control unit 400 (see FIG. 4, the same applies hereinafter) acquires seating position information from the image processing unit 412 (step S803).

Based on the seating position information acquired in this way, the navigation control unit 400 determines whether there is a change in the seating position of the occupant (step S804). If it is determined that there is a change in the seating position (step S804: Yes), the process returns to step S803, and the navigation control unit 400 acquires the seating position information from the image processing unit 412 again. If it is determined that there is no change in the seating position (step S804: No), the navigation control unit 400 identifies the passenger inside the vehicle based on the information about the passenger identified in the image processing unit 412 ( Step S805).

Next, the navigation control unit 400 selects the audio data based on the reproduction information associated with the identified occupant for the audio processing unit 414 (see FIG. 6, the same applies hereinafter). The sound field control unit 613 (see FIG. 6; the same applies hereinafter) generates a sound field optimal for the seating position of the passenger. The sound field parameters are read from (Step S806).

[0099] Then, the sound processing unit 414 reproduces the sound based on the selected sound data (step S807), and the sound field control unit 613 forms the sound based on the read sound field parameters. The sound image of the sound field to be localized is localized (step S808). Thus, a series of information reproduction processing according to this flowchart is completed. The image processing unit 412 is associated with the identified passenger. Based on the reproduced information, the image data may be appropriately reproduced together with the reproduction of the audio data by the audio processing unit 414. Also, based on the seating position of the passenger, the image display on the display screen of the display unit 402 (see FIG. 4; the same applies hereinafter) is controlled so that the image can be viewed optimally. Let's play it.

[0100] As described above, the information reproducing apparatus according to the present embodiment acquires the seating position information of the passenger based on the image data obtained by photographing the inside of the vehicle, and controls the sound field suitable for the seating position. You can perform sound image localization. For this reason, the sound field inside the vehicle can be automatically optimized in accordance with the passenger.

As described above, according to the information reproducing apparatus, the information reproducing method, the information reproducing program, and the computer-readable recording medium according to the present invention, the sound field is controlled based on the seated state of the passenger. As a result, the sound field inside the vehicle can be optimized according to the passenger.

[0102] The information reproduction method described in the present embodiment can be realized by executing a prepared program on a computer such as a personal computer or a workstation. This program is recorded on a computer-readable recording medium such as a hard disk, a flexible disk, a CD-ROM, an MO, and a DVD, and is executed by being read by the computer. Further, this program may be a transmission medium that can be distributed through a network such as the Internet.

Claims

The scope of the claims

[1] An acquisition means for detecting a seating state of a passenger in the vehicle and acquiring information related to the seating state;

Identification means for identifying the occupant based on information on the seating state acquired by the acquisition means;

Reproduction means for reproducing audio data associated with the passenger identified by the identification means;

Control means for controlling the sound field formed by the sound of the sound data reproduced by the reproducing means based on the identification result identified by the identifying means;

An information reproducing apparatus comprising:

[2] The acquisition means acquires at least one of the sitting position information, sitting height information, face image information, and ear position information of the passenger as the information on the sitting state. The information reproducing apparatus according to claim 1.

3. The information reproducing apparatus according to claim 1, wherein the identification unit identifies an age and a gender of the passenger.

4. The information reproducing apparatus according to claim 1, wherein the reproducing unit reproduces image data associated with the passenger.

[5] The information according to claim 4, wherein the reproduction means selects at least one of the image data and the audio data to be reproduced based on information on the seating state. Playback device.

6. The information reproducing apparatus according to claim 1, wherein the control means localizes a sound image of a sound field formed by the sound of the sound data reproduced by the reproducing means.

[7] An acquisition process for detecting a seated state of a passenger in the vehicle and acquiring information related to the seated state;

An identification step for identifying the occupant based on the information on the seating state acquired by the acquisition step;

A reproduction step of reproducing audio data associated with the passenger identified by the identification step; A control step for controlling the sound field formed by the sound of the audio data reproduced by the reproduction step based on the identification result identified by the identification step;

A method for reproducing information, comprising:

[8] An information reproduction program that causes a computer to execute the information reproduction method according to claim 7.

[9] A computer-readable recording medium on which the information reproduction program according to claim 8 is recorded.