JP2006261886A - Recording/reproducing system, recording device and method, reproducing device and method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide technology capable of easily reproducing a sound field at recording. <P>SOLUTION: Sound data produced at a recording environment are acquired on the basis of outputs from sound input sections 11-1 to 11-m. Further, in this case, sound input section information comprising information such as identification information, a position, a direction, a type, directivity, frequency characteristic and impedance of the respective sound input sections 11-1 to 11-m are acquired. For example, the respective identification information items, positions, and directions of the sound input sections 11-1 to 11-m are acquired from an image photographing the recording environment and a table prepared in advance is referred to on the basis of the acquired identification information items to acquire the other information items in the sound input section information. The acquired sound input section information is used for reproducing the sound data. The technology above can be applied to sound recording devices and reproducing devices for reproducing the recorded sound. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a recording / playback system, a recording device and method, a playback device and method, and a program, and more particularly to a recording / playback system, recording device and method, and playback that can easily reproduce a sound field of a recording environment. The present invention relates to an apparatus and method, and a program.

  Conventionally, a multi-surround speaker has been arranged in a movie theater or the like, so that it is possible to reproduce surround sound with a sense of presence in addition to an image projected on a large screen. Such surround sound reproduction is becoming possible in general households in recent years with the spread of relatively low-priced surround systems.

  At present, a 5.1 channel surround system is generally used to reproduce surround sound. The 5.1 channel surround system is composed of a playback device that reproduces sound, five speakers in front center, front left and right, rear left and right, and a subwoofer that produces a deep bass enhancement effect. By using these six speakers, a virtual sound source can be arranged at a position different from the position of the actual speaker, and a three-dimensional and realistic sound environment can be realized rather than a stereo output. It is possible.

  By the way, in order to realize the reproduction of the surround sound, the sound data corresponding to the 5.1 channel surround system is required. For example, “Digital Performer” (trademark), software released from “Mark of the Unicorn (MOTU)”, and “Logic Pro” (trademark), software released from “Apple Computer, Inc.” Then, for example, the creator of the audio data can set the virtual sound source position of each recorded track data on a two-dimensional graphic, thereby easily creating 5.1 channel audio data. it can.

For example, Patent Document 1 discloses a technique for combining a video and a surround system, dynamically generating audio data according to the motion of the video, and reproducing a surround sound field that matches the video.
JP 2002-345097 A

  The conventional technology has a problem that the virtual sound source position of each track data has to be input by the creator of the audio data or the viewer, which is complicated.

  For example, the software as described above provides a user interface that allows anyone to set the virtual sound source position, but if the number of microphones during recording increases and the track data increases, all track data Setting the virtual sound source position is very laborious. In addition, by setting the virtual sound source position using those software, there is an advantage that the user can freely build a surround sound field according to his / her preference, but the surround sound field at the time of recording is reduced. It is difficult to reproduce faithfully.

  On the other hand, as in Patent Document 1, it is possible to automatically calculate the virtual sound source position by recording a plurality of microphones arranged in a spherical shape, but this method is used for live and concerts. It is not suitable for situations where multiple microphones need to be arranged for each instrument, such as recording, and in order to achieve surround playback of live performances and concerts, the location of each microphone, for example, creation of audio data Must be entered manually by the user.

  In addition, since characteristics such as type, frequency characteristics, directivity, and impedance differ depending on the microphone, it is difficult to reflect these characteristics on the virtual sound source.

  The present invention has been made in view of such a situation, and makes it possible to easily reproduce the sound field of the recording environment.

  The recording / playback system of the present invention is a recording / playback system comprising a recording device and a playback device, and the recording device is a microphone comprising information representing the position and orientation of a microphone used for recording and information representing the characteristics of the microphone. And a playback device including a first acquisition unit for acquiring information, a voice obtained by recording, and a providing unit for providing the microphone information acquired by the first acquisition unit. A second acquisition unit that acquires microphone information, and a reproduction control unit that edits and reproduces audio data to be reproduced based on the microphone information acquired by the second acquisition unit. It is characterized by that.

  The provision by the provision means includes provision performed in a form recorded on a recording medium in addition to provision performed via a network.

  The recording apparatus of the present invention includes an acquisition means for acquiring microphone information composed of information indicating the position and orientation of a microphone used for recording, and information indicating characteristics of the microphone, sound obtained by recording, and an acquisition means. And providing means for providing the acquired microphone information together.

  The playback device according to the present invention includes, together with audio data to be played back, information indicating the position and orientation of the microphone used for recording, and information indicating the characteristics of the microphone, which are obtained when the audio is recorded. An acquisition means for acquiring the microphone information, and a reproduction control means for editing and reproducing the audio data to be reproduced based on the microphone information acquired by the acquisition means.

  In the recording device of the recording / playback system of the present invention, microphone information including information indicating the position and orientation of the microphone used for recording and information indicating the characteristics of the microphone is acquired, and the sound obtained by recording The acquired microphone information is also provided. In the playback device, microphone information is acquired together with audio data to be played back, and the audio data to be played back is edited based on the acquired microphone information and played back.

  In the recording apparatus of the present invention, microphone information consisting of information indicating the position and orientation of the microphone used for recording and information indicating the characteristics of the microphone is acquired, the sound obtained by recording, and the acquired microphone information Are also provided.

  In the playback device of the present invention, together with the audio data to be played back, information indicating the position and orientation of the microphone used for recording, and information indicating the characteristics of the microphone, acquired at the time of recording the audio Is acquired, audio data to be reproduced is edited based on the acquired microphone information, and reproduction is performed.

  According to the present invention, the sound field of the recording environment can be easily reproduced.

  Embodiments of the present invention will be described below. The correspondence relationship between the invention described in this specification and the embodiments of the invention is exemplified as follows. This description is intended to assure that embodiments supporting the claimed invention are described in this specification. Therefore, although there is an embodiment which is described in the embodiment of the invention but is not described here as corresponding to the invention, it means that the embodiment is not It does not mean that it does not correspond to the invention. Conversely, even if an embodiment is described herein as corresponding to an invention, that means that the embodiment does not correspond to an invention other than the invention. Absent.

  Further, this description does not mean all the inventions described in this specification. In other words, this description is for the invention described in the present specification and not claimed in this application, i.e., the existence of an invention that will be filed in the future or added by amendment. There is no denial.

  The recording / playback system according to claim 1 is a recording / playback system including a recording device and a playback device, and the recording device is a microphone used for recording (for example, the audio input units 11-1 to 11- in FIG. 2). m) first acquisition means for acquiring microphone information (speech input unit information) comprising information representing the position and orientation of m) and information representing the characteristics of the microphone (for example, the voice input unit information measurement unit 14 in FIG. 2). ) And providing means (for example, the registration control unit 16 in FIG. 2) that provides the sound obtained by recording and the microphone information acquired by the first acquiring means together, The second acquisition means (for example, the communication unit 31 in FIG. 5) that acquires the microphone information together with the audio data to be reproduced, and the audio data to be reproduced , Edited based on said microphone information obtained by the second acquisition unit, characterized by comprising a reproduction control means for reproducing (e.g., voice data editing unit 34 of Fig. 5).

  Also in the recording apparatus according to the second aspect, the embodiment (however, an example) corresponding to each means is the same as the recording apparatus constituting the recording / reproducing system according to the first aspect.

  The recording method according to claim 5 is based on information indicating the position and orientation of a microphone (for example, the voice input units 11-1 to 11-m in FIG. 2) used for recording, and information indicating the characteristics of the microphone. The acquisition step (for example, step S4 in FIG. 3) for acquiring the microphone information (audio input unit information), the audio obtained by recording, and the microphone information acquired by the processing of the acquisition step are provided together. Providing step (for example, step S7 in FIG. 3).

  Also in the program described in claim 6, the embodiment (however, an example) to which each step corresponds is the same as the recording method described in claim 5.

  Also in the reproducing apparatus according to the seventh aspect, the embodiment (however, an example) to which each means corresponds is the same as the reproducing apparatus constituting the recording / reproducing system according to the first aspect.

  The reproduction method according to claim 8 is a microphone used for recording (for example, the audio input units 11-1 to 11 in FIG. 2) acquired at the time of recording the audio together with the audio data to be reproduced. -M) an acquisition step (for example, step S22 in FIG. 6) for acquiring microphone information (speech input unit information) including information indicating the position and orientation of the microphone and information indicating the characteristics of the microphone; A reproduction control step (for example, step S26 in FIG. 6) for editing and reproducing the audio data based on the microphone information acquired by the processing of the acquisition step.

  Also in the program according to the ninth aspect, the embodiment (however, an example) to which each step corresponds is the same as the reproduction method according to the eighth aspect.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a diagram showing a configuration example of a recording / playback system according to an embodiment of the present invention.

  As shown in FIG. 1, the recording / playback system is configured by connecting a surround sound field recording device 1, a surround sound field playback device 2, and a surround data storage device 3 via a communication network 4.

  The surround sound field recording apparatus 1 records (collects) sounds generated in a recording environment using a plurality of microphones, and surrounds the surround data obtained by the recording via the communication network 4. Upload to.

  The surround sound field reproduction device 2 downloads the surround data stored in the surround data storage device 3 via the communication network 4 and reproduces the obtained surround data in a form suitable for the reproduction environment.

  For example, when playing in a playback environment of a home theater system that supports 5.1 channels, the surround sound field playback device 2 mixes down the surround data track acquired from the surround data storage device 3 to 5.1 channels for playback. To do. The mixdown is to convert a plurality of recorded tracks (for example, 48 tracks) into 6 tracks in a 5.1 channel reproduction environment.

  Further, the surround sound field reproduction device 2 adjusts the volume, localization, effector, and the like of each track as necessary when reproducing the surround data.

  Here, the surround data recorded by the surround sound field recording device 1 is once stored in the surround data storage device 3 and then provided to the surround sound field reproduction device 2 via the communication network 4. Is provided from the surround sound field recording device 1 to the surround sound field reproduction device 2 via a recording medium such as a magnetic tape, a CD (Compact Disk), a DVD (Digital Versatile Disc), or a Blu-ray Disc (registered trademark). You may make it do.

  The surround data storage device 3 receives the surround data transmitted from the surround sound field recording device 1 via the communication network 4 and stores (stores) it in a built-in storage medium. The surround data storage device 3 transmits the stored surround data to the surround sound field reproduction device 2 at a predetermined timing via the communication network 4.

  In a recording / playback system composed of such devices, as will be described in detail later, at the time of recording audio, along with the audio data, characteristic information indicating the characteristics of the microphone used for recording, such as position and orientation, is displayed. It is automatically recorded by the recording device 1.

  At the time of reproduction, the sound data is edited by the surround sound field reproduction device 2 based on the characteristic information of the microphone provided together with the audio data to be reproduced, and sound suitable for the reproduction environment is output. As a result, the same sound field as the recording environment is reproduced.

  Next, the configuration and operation of the surround sound field recording device 1 and the surround sound field reproduction device 2 in FIG. 1 will be described.

  First, the configuration and operation of the surround sound field recording device 1 will be described.

  FIG. 2 is a block diagram illustrating a functional configuration example of the surround sound field recording apparatus 1.

  The audio input units 11-1 to 11-m are microphones, and output signals of collected sounds that are generated in the surroundings to the audio interface 12, respectively. The number of voice input units can be arbitrarily changed depending on the recording target. For example, when the recording target is music live, an audio input unit can be arranged for each instrument.

  For example, when the user instructs to start recording, the audio interface 12 aligns the levels of the signals supplied from the audio input units 11-1 to 11-m, and performs A / D (Analog / Digital) conversion. I do. The audio data obtained by the audio interface 12 by processing such as A / D conversion is output to the audio data recording unit 13.

  When the number of audio input units is large, a plurality of audio interfaces 12 and audio data recording units 13 are prepared, and the inputs from the audio input units are processed by each audio interface 12 in a distributed manner. Good. In this case, in order to synchronize the audio data obtained by the audio interface 12, the same time code generated by the time code generator, for example, SMPTE (Society of Motion Picture and Television Engineers) is added to the audio data. The

  The audio data recording unit 13 stores the audio data supplied from the audio interface 12 in a storage medium such as an HDD (Hard Disk Drive). The audio data stored in the storage medium by the audio data recording unit 13 is read by the registration control unit 16 as appropriate.

  For example, when the user instructs to start recording, the voice input unit information measurement unit 14 includes information indicating the position and orientation of each of the voice input units 11-1 to 11-m, the type, the directivity, Audio input unit information including information representing characteristics such as frequency characteristics and impedance is acquired.

  Information such as type, directivity, frequency characteristics, and impedance in the voice input unit information is information unique to the voice input units 11-1 to 11-m. Therefore, if the voice input unit information measuring unit 14 can identify each of the voice input units 11-1 to 11-m, the identification information is associated with information indicating the type, directivity, frequency characteristics, impedance, and the like. Such information can be acquired by referring to the table (product specification).

  This table may be prepared in advance in the surround sound field recording apparatus 1 or may be managed by a predetermined server connected via the communication network 4.

  The specific information (identification information necessary for obtaining the specific information), the position and the direction information of the voice input units 11-1 to 11-m are, for example, Japanese Patent Application 2002 filed by the present applicant. Using the technique described in the specification of Japanese Patent No. 057837 (Japanese Patent Laid-Open No. 2003-254716), it is simultaneously measured by the voice input unit information measuring unit 14.

  Depending on the technique described in Japanese Patent Application Laid-Open No. 2003-254716, optical identification information can be obtained from a marker issuance pattern by photographing with a camera a measurement target object in which a plurality of light emitters called markers are arranged on the surface. And the three-dimensional position and orientation of the measurement target object can be measured from the positional relationship of the markers.

  In addition, in order to acquire audio | voice input part information, you may make it use techniques other than what is described in Unexamined-Japanese-Patent No. 2003-254716. In addition, the information indicating the position and orientation and the information indicating the characteristics such as type, directivity, frequency characteristics, impedance, etc. in the voice input unit information may be acquired separately instead of simultaneously. .

  For example, the identification information of the voice input unit may be acquired from a two-dimensional barcode printed on the surface of the voice input units 11-1 to 11-m or an RFID tag provided. For the position, a position detection system using wireless communication such as wireless LAN (Local Area Network), RFID, UWB (Ultra Wide Band), etc. may be used and acquired. In this case, it may be acquired by GPS (Global Positioning System) or PHS (Personal Handyphone System). The direction may be acquired from the output of the gyro sensor mounted on the voice input units 11-1 to 11-m.

  The voice input unit information measurement unit 14 outputs the voice input unit information acquired in this way to the voice input unit information storage unit 15.

  The voice input unit information storage unit 15 stores the voice input unit information supplied from the voice input unit information measurement unit 14. The voice input unit information stored by the voice input unit information storage unit 15 is also appropriately read out by the registration control unit 16.

  When the surround data is provided to the surround sound field reproducing device 2 via the communication network 4, the registration control unit 16 includes the surround data stored by the audio data recording unit 13 and the audio input unit information storage unit. 15 reads out the voice input unit information stored in 15 and outputs the read data to the communication unit 17 together.

  In addition, when the surround data is provided to the surround sound field reproduction device 2 via a predetermined recording medium, the registration control unit 16 includes the surround data stored by the audio data recording unit 13 and the audio input unit. The voice input unit information stored by the information storage unit 15 is read, and the read data is recorded on the recording medium.

  The communication unit 17 uploads the data supplied from the registration control unit 16 to the surround data storage device 3 via the communication network 4.

  Here, the recording process of the surround sound field recording apparatus 1 will be described with reference to the flowchart of FIG. This process is started, for example, when the start of recording is instructed by the recording person (user).

  In step S1, the audio interface 12 determines whether or not to end recording. For example, the start / end of recording is performed in response to a user pressing a recording start button or a recording end button provided in the surround sound field recording apparatus 1 or “recording starts after 10 minutes, ends after 30 minutes”. And so on according to a predetermined rule. Note that the recording may be terminated when there is no more free space on the storage medium or when a system error such as an overflow error occurs.

  If the audio interface 12 determines in step S1 that the recording is not finished (recording is performed), the process proceeds to step S2.

  In step S <b> 2, the voice input units 11-1 to 11-m collect sound and output the obtained sound signal to the audio interface 12.

  In step S3, the audio interface 12 acquires audio data from the signals supplied from the audio input units 11-1 to 11-m, and causes the audio data recording unit 13 to store the acquired audio data.

  In step S4, the voice input unit information measuring unit 14 acquires the voice input unit information of the voice input units 11-1 to 11-m as described above, and uses the acquired voice input unit information as the voice input unit information storage unit. 15 is output.

  In step S <b> 5, the voice input unit information storage unit 15 stores the voice input unit information supplied from the voice input unit information measurement unit 14.

  FIG. 4 is a diagram illustrating an example of the voice input unit information stored by the voice input unit information storage unit 15.

  As illustrated in FIG. 4, the voice input unit information includes, for example, information such as ID, position, orientation, type, directivity, frequency characteristics, impedance, and the like. The ID is identification information assigned to each of the voice input units 11-1 to 11-m, and is managed by associating this with other information.

  In the example of FIG. 4, for example, the voice input unit information of the voice input unit to which the ID “0001” is assigned has the position “(−98, 103, 119)” and the direction “(22, 0, 174). ) ”, The type is“ dynamic type ”, the directivity is“ unidirectional ”, the frequency characteristic is“ 50 Hz-16 kHz ”, and the impedance is“ 150Ω ”.

  The positions of the audio input units 11-1 to 11-m are represented by, for example, positions in a three-dimensional space where the center of the recording environment is (0, 0, 0), and the direction is the Euler angle in the three-dimensional space. It is represented by That is, at the time of reproduction, the position represented by the center (0, 0, 0) is set as the listener position, thereby reproducing the same sound field as that of the recording environment.

  Although the position and orientation are expressed in a three-dimensional space, they may be expressed in a two-dimensional space. In this case, it is treated that there is no sound localization in the vertical direction.

  The types of the voice input units 11-1 to 11-m are structural differences of the voice input units 11-1 to 11-m, and are classified into dynamic type, capacitor type, carbon type, velocity type, crystal type, and the like. The

  The directivity of the sound input units 11-1 to 11-m represents how much sensitivity is given to each sound that enters from the front, rear, left, and right, and is unidirectional, omnidirectional, or bi-directional. Broadly divided into directivity types. The unidirectional type may be further classified into a cardioid, a super cardioid, a hyper cardioid, and the like.

  The frequency characteristics of the audio input units 11-1 to 11-m represent the range of frequencies (sound pitch) that can be recorded and changes in sensitivity.

  The impedance of the voice input units 11-1 to 11-m is the value of the AC resistance inside the voice input unit viewed from the output side. The higher the impedance, the better the signal transmission efficiency but the weaker it is to noise.

  Returning to the description of FIG. 3, after storing the voice input unit information, the process returns to step S <b> 1 and the subsequent processes are repeated. That is, accumulation of audio data, accumulation of audio input unit information, and the like are repeated until it is determined that recording is to be ended.

  If the audio interface 12 determines in step S1 that the recording has been instructed, the process proceeds to step S6.

  In step S6, the registration control unit 16 determines whether or not to transmit the surround data (audio data and audio input unit information) recorded by the above processing to the surround data storage device 3 according to an instruction from the user, for example. If it is determined not to transmit, the process is terminated. In this case, the recorded surround data is stored as a local file in the storage medium of the surround sound field recording apparatus 1, and is written and provided on a recording medium such as a CD at a predetermined timing.

  On the other hand, if the registration control unit 16 determines in step S6 that the recorded surround data is to be transmitted to the surround data storage device 3, the registration control unit 16 proceeds to step S7 and controls the communication unit 17 to send the surround data to the surround data storage device. 3 to send.

  As described above, by simultaneously storing the sound data and the sound input unit information, the surround sound field recording device 1 can obtain information necessary for reproducing the sound field of the recording environment.

  Here, in the processing of FIG. 3, the measurement of the voice input unit information is repeatedly performed along with the recording of the voice data, but this corresponds to the situation where the voice input unit information changes with the passage of time. Is to be done.

  For example, in live recording or the like, the positions and orientations of the audio input units 11-1 to 11-m change with the passage of time. By repeatedly measuring the input unit information, it is possible to acquire information for reproducing the sound field of the recording environment.

  When the voice input unit information does not change with time, the voice input unit information may be measured only once at the start of recording or at the end of recording.

  Next, the configuration and operation of the surround sound field reproduction device 2 will be described.

  FIG. 5 is a block diagram illustrating a functional configuration example of the surround sound field reproduction device 2.

  The communication unit 31 downloads the surround data from the surround data storage device 3 and outputs the acquired surround data to the audio data analysis unit 32 and the audio input unit information analysis unit 33. As described above, the surround data stored in the surround data storage device 3 includes audio data and audio input unit information.

  When surround data is acquired via a recording medium such as a CD instead of being acquired by downloading from the surround data storage device 3, the surround data read from the recording medium by a drive (not shown) The data is output to the voice data analysis unit 32 and the voice input unit information analysis unit 33.

  For example, the audio data analysis unit 32 acquires audio data by analyzing the surround data supplied from the communication unit 31 and outputs the acquired audio data to the audio data editing unit 34.

  For example, the voice input unit information analysis unit 33 acquires the voice input unit information by analyzing the surround data supplied from the communication unit 31 and outputs the acquired voice input unit information to the voice data editing unit 34.

  The audio data editing unit 34 is based on the audio input unit information supplied from the audio input unit information analysis unit 33, and the audio data supplied from the audio data analysis unit 32 so as to be audio data suitable for the reproduction environment. Edit the data.

  For example, the audio data editing unit 34 arranges corresponding audio data so that the position of the virtual sound source comes to the position specified by the audio input unit information, or adds an effect based on the audio input unit information. Build a sound field. Also, the audio data editing unit 34 mixes down the track data (for example, 48 tracks) included in the audio data into track data corresponding to the number of audio output units (for example, 6 for 5.1 channel), for example. As described above, in order to reproduce the sound field using the sound output units 36-1 to 36-n, the sound data supplied from the sound data analysis unit 32 is used as the sound output units 36-1 to 36-n. Convert to audio data to be output from each.

  The audio data obtained by the audio data editing unit 34 is output to the audio interface 35.

  The audio interface 35 performs D / A conversion of the audio data supplied from the audio data editing unit 34, and outputs the obtained audio signal to each of the audio output units 36-1 to 36-n.

  The audio output units 36-1 to 36-n are speakers, and output audio corresponding to the signal supplied from the audio interface 35.

  Here, with reference to the flowchart of FIG. 6, the reproduction process of the surround sound field reproduction device 2 will be described. This process is started when, for example, the user (listener) instructs to start the reproduction of surround data.

  In step S21, the audio data analysis unit 32 determines whether or not to end the reproduction. For example, the start / end of playback is performed in response to a user pressing a playback start button or playback end button provided in the surround sound field playback device 2, or “start playback after 10 minutes, end after 30 minutes” And so on according to a predetermined rule.

  If the sound data analysis unit 32 determines in step S21 that the reproduction is not to be ended (reproduction is performed), the process proceeds to step S22.

  In step S22, the audio data analysis unit 32 acquires the surround data to be reproduced by controlling the communication unit 31 to download from the surround data storage device 3 or reading from a predetermined recording medium. Which surround data is to be acquired is determined according to an instruction from the user. At this time, the same data as the surround data acquired by the audio data analysis unit 32 is also supplied to the audio input unit information analysis unit 33.

  Downloading from the surround data storage device 3 and reading from the recording medium may not be performed if the surround data to be played is already stored in a local file or cache of the surround sound field playback device 2. Is possible. In addition, when surround data is already stored in the surround sound field reproducing device 2, the surround data is identical to the surround data of the same title and prepared in the surround data storage device 3 that can be downloaded. The download may be performed when it is confirmed and does not match.

  In step S <b> 23, the audio data analysis unit 32 acquires audio data by analyzing the acquired surround data, and outputs the acquired audio data to the audio data editing unit 34.

  In step S <b> 24, the voice input unit information analysis unit 33 acquires the voice input unit information by analyzing the acquired surround data, and outputs the acquired voice input unit information to the voice data editing unit 34.

  In step S <b> 25, the audio data editing unit 34 supplies from the audio data analysis unit 32 so as to obtain audio data suitable for the reproduction environment based on the audio input unit information supplied from the audio input unit information analysis unit 33. The audio data that has been edited is edited as described above. The audio data editing unit 34 outputs the audio data obtained by editing to the audio interface 35.

  In step S26, the audio interface 35 performs D / A conversion on the audio data supplied from the audio data editing unit 34, and outputs the obtained audio signal to each of the audio output units 36-1 to 36-n. To play.

  Thereafter, the processing returns to step S21, and the subsequent processing is repeated. That is, until it is determined that the reproduction is to be ended, the editing of the surround data, the reproduction of the surround data obtained by editing, and the like are repeated.

  If it is determined in step S21 that the reproduction is to be terminated, the process is terminated.

  Through the processing as described above, the sound field of the recording environment is reproduced in accordance with the reproduction environment based on the surround data obtained by the surround sound field recording apparatus 1.

  In the process of FIG. 6, it is assumed that the sound input unit information is analyzed every time surround data is input (acquired). This is because the sound input unit information changes over time. This is done to cope with the situation. Therefore, when the voice input unit information does not change with the passage of time, the analysis may be performed only once at the start of reproduction.

  With the recording / playback system as described above, a person who performs recording does not have to leave the position and orientation of the microphone in the memo for reference when editing the surround data.

  In addition, the user of the surround sound field reproduction device 2 does not need to input the position of the microphone or the like that recorded each audio data based on the recording environment information during reproduction. That is, the user can easily reproduce the sound field of the recording environment.

  In the above, the voice input unit information is used to reproduce the sound field. However, in addition to that, for example, in order to display the positional relationship of each microphone in the recording environment on the display. It may be used.

  Thus, the recording person can avoid the “fogging” of the recorded sound by setting the position and orientation of the microphone at the time of recording while watching the display on the display.

  FIG. 7 is a diagram illustrating an example of a screen displayed based on the voice input unit information. This screen is displayed by, for example, the voice input unit information measurement unit 14. The screen of FIG. 7 represents the recording environment of the performance of the piano in which a plurality of microphones are installed.

  In the screen of FIG. 7, a circle with a color represents the position of the voice input unit (microphone) displayed based on the “position” of the voice input unit information. The ID indicated by the lead line from the circle is the ID of each voice input unit displayed based on the “ID” of the voice input unit information. A solid line above or around the colored circle represents a recordable area determined from the “direction”, “type”, “directivity”, etc. of the voice input unit information.

  For example, the voice input unit whose ID is “101” is a “omnidirectional” voice input unit, and therefore the area that can be recorded (sound collection) by the voice input unit is substantially circular as shown in the figure. It has become. Also, the voice input unit whose ID is “001” is a “unidirectional” voice input unit, and the recordable area changes depending on the orientation, and is as shown in the figure. The size of the recordable area varies depending on the sensitivity of the voice input unit.

  Thus, the recordable area of each voice input unit is graphically displayed, so that the recorder can visually determine in which area the “cover” is concentrated.

  In addition, by changing the position and orientation of the audio input unit during recording while viewing the display on the screen of FIG. 7, the recorder can record the information obtained by the surround sound field recording apparatus 1 on the audio input unit. It is possible to dynamically reflect the positional relationship.

  Note that not only the display based on the ID, position, orientation, and directivity in the voice input unit information, but also other information acquired from the voice input unit may be displayed. For example, by displaying the recordable area for each frequency band, the recorder can select the frequency range for each of the frequency bands, such as the “fogging” situation of heavy bass in the recording environment, and the “fogging” situation of treble. It is possible to confirm the status of “cover”.

  In addition, in the example of the screen of FIG. 7, an image of the appearance of the piano is also displayed in order to make it easy to grasp the positional relationship of the voice input unit, but if it is only for the purpose of preventing the “fogging” of the voice, It is not necessarily displayed.

  Furthermore, when the voice input unit information as shown in FIG. 4 has been acquired, a three-dimensional screen is displayed instead of the screen as shown in FIG. 7 showing the recordable area of each voice input unit in two dimensions. You may be made to do.

  In this manner, by displaying information that can be recorded, that is, an area that cannot be seen with the eyes, the recording person can visually confirm the information of the sound field.

  The series of processes described above can be executed by hardware, but can also be executed by software. In this case, the software is executed by a personal computer as shown in FIG.

  In FIG. 8, a CPU (Central Processing Unit) 51 performs various processes according to a program stored in a ROM (Read Only Memory) 52 or a program loaded from a storage unit 58 to a RAM (Random Access Memory) 53. Execute. The RAM 53 also appropriately stores data necessary for the CPU 51 to execute various processes.

  The CPU 51, ROM 52, and RAM 53 are connected to each other via a bus 54. An input / output interface 55 is also connected to the bus 54.

  The input / output interface 55 includes an input unit 56 including a keyboard and a mouse, a display including an LCD (Liquid Crystal Display), an output unit 57 including a speaker, a storage unit 58 including a hard disk, and a network. A communication unit 59 for performing all communication processes is connected.

  A drive 60 is also connected to the input / output interface 55 as necessary. A removable medium 61 composed of a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is appropriately attached to the drive 60, and a computer program read therefrom is installed in the storage unit 58 as necessary.

  When a series of processing is executed by software, a program constituting the software may execute various functions by installing a computer incorporated in dedicated hardware or various programs. For example, it is installed from a network or a recording medium into a general-purpose personal computer or the like.

  As shown in FIG. 8, the recording medium is distributed to provide a program to the user separately from the apparatus main body, and includes a magnetic disk (including a flexible disk) on which the program is recorded, an optical disk (CD- Removable media 61 composed of ROM (compact disk-read only memory), DVD (digital versatile disk), magneto-optical disk (including MD (registered trademark) (mini-disk)), or semiconductor memory In addition, it is configured by a ROM 52 on which a program is recorded and a hard disk included in the storage unit 58 provided to the user in a state of being pre-installed in the apparatus main body.

  In the present specification, each step includes not only processing performed in time series according to the described order but also processing executed in parallel or individually, although not necessarily performed in time series.

  Further, in this specification, the system represents the entire apparatus constituted by a plurality of apparatuses.

It is a figure which shows the structural example of the recording / reproducing system which concerns on one Embodiment of this invention. It is a block diagram which shows the function structural example of a surround sound field recording device. It is a flowchart explaining the recording process of a surround sound field recording device. It is a figure which shows the example of audio | voice input part information. It is a block diagram which shows the function structural example of a surround sound field reproduction apparatus. It is a flowchart explaining the reproduction | regeneration processing of a surround sound field reproduction apparatus. It is a figure which shows the example of the screen displayed based on audio | voice input part information. And FIG. 16 is a block diagram illustrating a configuration example of a personal computer.

Explanation of symbols

  1 surround sound field recording device, 2 surround sound field reproduction device, 3 surround data storage device, 4 communication network, 11-1 to 11-m audio input unit, 12 audio interface, 13 audio data recording unit, 14 audio input unit information Measurement unit, 15 voice input unit information storage unit, 16 registration control unit, 17 communication unit, 31 communication unit, 32 voice data analysis unit, 33 voice input unit information analysis unit, 34 voice data editing unit, 35 audio interface, 36- 1 to 36-n audio output unit

Claims (9)

In a recording / playback system consisting of a recording device and a playback device,
The recording device is:
First acquisition means for acquiring microphone information including information representing the position and orientation of a microphone used for recording and information representing characteristics of the microphone;
Providing means for providing both the voice obtained by recording and the microphone information acquired by the first acquisition means;
The playback device
A second acquisition means for acquiring the microphone information together with audio data to be reproduced;
A recording / playback system comprising: playback control means for editing and playing back the audio data to be played back based on the microphone information acquired by the second acquisition means. Acquisition means for acquiring microphone information composed of information indicating the position and orientation of the microphone used for recording, and information indicating the characteristics of the microphone;
A recording apparatus comprising: voice obtained by recording, and providing means for providing the microphone information acquired by the acquiring means together. The recording apparatus according to claim 2, wherein the acquisition unit repeatedly acquires the microphone information while recording is being performed. The acquisition unit further displays, based on the acquired microphone information, a recordable range of the microphone on a screen representing a recording environment in which the microphone is installed. Recording device. An acquisition step of acquiring microphone information consisting of information indicating the position and orientation of the microphone used for recording and information indicating the characteristics of the microphone;
A recording method comprising: a voice obtained by recording, and a providing step of providing the microphone information acquired by the processing of the acquiring step together. An acquisition step of acquiring microphone information consisting of information indicating the position and orientation of the microphone used for recording and information indicating the characteristics of the microphone;
The program which makes a computer perform the process containing the audio | voice obtained by recording, and the provision step which provides together the said microphone information acquired by the process of the said acquisition step. Acquires microphone information including information representing the position and orientation of the microphone used for recording, and information representing the characteristics of the microphone, which was acquired when recording the sound, together with the audio data to be reproduced. Acquisition means;
A playback apparatus comprising: a playback control unit that edits and plays back the audio data to be played back based on the microphone information acquired by the acquiring unit. Acquires microphone information including information representing the position and orientation of the microphone used for recording, and information representing the characteristics of the microphone, which was acquired when recording the sound, together with the audio data to be reproduced. An acquisition step;
A reproduction control step of editing and reproducing the audio data to be reproduced based on the microphone information acquired by the processing of the acquisition step. Acquires microphone information including information representing the position and orientation of the microphone used for recording, and information representing the characteristics of the microphone, which was acquired when recording the sound, together with the audio data to be reproduced. An acquisition step;
A program for causing a computer to execute a process including a playback control step of editing and playing back the audio data to be played back based on the microphone information acquired by the process of the acquiring step.

Images