JP2012105174A - Image voice recording/playback system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image voice recording/playback system for allowing a user to recall travelling memories easily with a feature similar to a time capsule.SOLUTION: An image voice recording/playback system installed in a vehicle for detecting the vehicle location, and guiding a travelling route to a destination based on the detected location information, includes: a navigation unit 2 for recording and transmitting an in-vehicle video data and/or a voice data; and a recording/playback unit 3 for recording and playing back the video data and/or the voice data received from the navigation unit. The navigation unit transmits a video data and/or a voice data together with at least one unit of information selected from the information on passengers, dates, destination, and travelling route to the destination. The recording/playback unit can record and play back the video data and/or the voice data received from the navigation unit based on the at least one unit of information described above.

Description

  The present invention relates to an image / audio recording / reproducing apparatus which records / reproduces an image / sound in a vehicle such as an automobile and can function as a time capsule.

  For example, as described in Patent Document 1, the car navigation system can display the travel route to the set destination on the display, store the route traveled by the automobile, and display the route on the display.

  Further, Patent Document 2 uses a car navigation system and a digital camera, reads out image data of a vehicle that has been on board during a travel period recorded on a hard disk by an image composition display means, and indicates a current location in route data. A navigation album system that displays information about the vehicles that were on board during the trip and members who traveled together so that the user can easily recall the memories of the trip by synthesizing the vehicle symbols. Is disclosed.

JP 2002-81955 A JP 2006-38514 A

  According to the navigation album system described in Patent Document 2, a user can easily recall memories at the time of travel. However, image data to be combined with a vehicle symbol indicating the current location in route data is used for a passenger or the like. However, there was a problem that it took time to shoot by himself.

  SUMMARY OF THE INVENTION An object of the present invention is to provide an audio / video recording / playback apparatus that allows a user to more easily recall memories at the time of travel and to function like a time capsule.

  In order to achieve the above object, the present invention is an image / audio recording / reproducing apparatus, which is installed in a vehicle, detects the position of the vehicle, and guides a travel route to the destination based on the detected position information. And a navigation device that records and transmits video data or / and audio data in the vehicle, and a recording / reproducing device that records and reproduces video data and / or audio data received from the navigation device. And

  According to the present invention, since the video data or / and the audio data in the vehicle is recorded by the navigation device, it is not necessary for the rider or the like to take a picture by himself / herself, and it is saved from the navigation device by the recording / reproducing device. Video data and / or audio data can be easily reproduced.

  In the video / audio recording / reproducing apparatus, the navigation device selects at least one selected from the information about the passenger, the information about the date, the information about the destination, and the information about the route to the destination as the video data and / or the audio. The recording / reproducing apparatus transmits the video data and / or audio data received from the navigation apparatus from information on the passenger, information on date and time, information on the destination, and information on the route to the destination. Recording / reproduction can be performed based on at least one of them, and desired video and / or audio can be reproduced more easily.

  In the video / audio recording / reproducing apparatus, the person who gets on the vehicle can be specified from the utterance included in the recorded audio data by the speaker identification process for specifying the speaker.

  In addition, the recording / reproducing apparatus can record and reproduce the video data or / and audio data based on personal information of a predetermined person among the passengers. It is possible to perform detailed reproduction according to personal information and to function as a time capsule.

  As described above, according to the present invention, it is possible to provide an image / audio recording / reproducing apparatus that allows a user to more easily recall memories at the time of travel and to function like a time capsule. Become.

1 is a block diagram showing an embodiment of an image / audio recording / reproducing apparatus according to the present invention. FIG. It is a block diagram which shows an example of a structure of the navigation apparatus of the image audio | voice recording / reproducing apparatus of FIG. It is a block diagram which shows an example of a structure of the recording / reproducing apparatus of the image audio recording / reproducing apparatus of FIG. It is a flowchart which shows the flow of a process in the navigation apparatus of FIG. 4 is a flowchart showing a flow of recording processing in the recording / reproducing apparatus of FIG. 3. 4 is a flowchart showing a flow of reproduction processing in the recording / reproducing apparatus of FIG. 3.

  Next, modes for carrying out the invention will be described in detail with reference to the drawings. Here, a case where the audio / video recording / reproducing apparatus according to the present invention is applied to a vehicle such as an automobile will be described as an example.

  FIG. 1 shows an embodiment of an image / audio recording / reproducing apparatus according to the present invention. The image / audio recording / reproducing apparatus 1 includes a navigation apparatus 2 connected via a network 4 such as the Internet, and a recording / reproducing apparatus 3. It consists of.

  The navigation device 2 is installed in, for example, an automobile, detects the position of the vehicle, and guides the travel route to the destination designated by the user based on the detected position information. In addition, the navigation device 2 acquires video data and audio data in the vehicle, and acquires information on the date and time, the destination, the travel route, the passenger, and the like when the video data and audio data are acquired. Then, the acquired video data and audio data are associated with various types of information, and transferred to the recording / reproducing apparatus 3 via the network 4 at a predetermined timing.

  The recording / reproducing apparatus 3 is, for example, a PC (Personal Computer) or a server installed in a user's home or company, and classifies and records received video data and audio data based on associated information.

  FIG. 2 shows an example of the configuration of the navigation device 2 shown in FIG. As shown in FIG. 2, the navigation device 2 is roughly divided into an imaging unit 11, a voice input unit 12, a recording unit 13, a communication unit 14, a display unit 15, an operation unit 16, and GPS (Global Positioning). System) It includes an antenna 17, a GPS receiver 18, a clock 19, and a controller 20.

  The imaging unit 11 is a video camera, for example, and converts light received by an imaging element such as a CCD (Charge Coupled Devices) or a CMOS (Complementary Metal-Oxide Semiconductor) image sensor into an imaging signal. The imaging signal is subjected to predetermined signal processing such as gamma correction and white balance adjustment, and video data is generated and output. Note that an imaging signal may be output from the imaging unit 11 and predetermined signal processing may be performed on the imaging signal by the control unit 20 described later.

  The voice input unit 12 is, for example, a microphone, collects ambient voice, and outputs it as voice data.

  The recording unit 13 is, for example, an HDD (Hard Disc Drive) or a flash memory, which records map data and also records video data output from the imaging unit 11 and audio data output from the audio input unit 12. In the following, video data and audio data are collectively referred to as AV (Audio / Video) data. The recording unit 13 records in advance information indicating the characteristics of the person's utterance necessary for analysis of audio data, which will be described later.

  The communication unit 14 performs wireless communication with the recording / reproducing apparatus 3 according to a predetermined protocol, and the AV data recorded in the recording unit 13 is transmitted to the recording / reproducing apparatus 3 via the network 4 based on control by the control unit 20 described later. Send.

  The display unit 15 includes, for example, an LCD (Liquid Crystal Display), and displays a map screen, a menu screen, and the like. As the display unit 15, for example, a touch panel display in which a touch panel having a touch sensor is stacked on an LCD can be used.

  The operation unit 16 is provided with a predetermined operator for operating the navigation device 2 by a user, and outputs a control signal corresponding to an operation on the operator. For example, a power key for turning on / off the power of the navigation device 2 and a key for setting guidance from the current location to the destination are provided as the operation elements. For example, these various keys may be provided as hardware keys on the casing of the navigation device 2. When the display unit 15 is a touch panel display, the various keys are displayed on the display unit 15 as software keys. You may make it do.

  The GPS receiver 18 receives a GPS signal from a GPS satellite via the GPS antenna 17. The timepiece 19 can generate the current time information of the navigation device 2 based on, for example, the oscillation frequency of the crystal resonator. The timepiece 19 is always driven by a battery (not shown).

  The control unit 20 controls the entire navigation device 2, and includes an input control unit 21, a display control unit 22, a navigation processing unit 23, an imaging / sound collection control unit 24, a recording control unit 25, and information acquisition. Unit 26 and communication control unit 27.

  The input control unit 21 determines input contents and selection contents based on a control signal corresponding to a user operation supplied from the operation unit 16 and outputs an operation signal. The display control unit 22 controls image display on the display unit 15. For example, the display control unit 22 reads out map data from the recording unit 13 to generate a map image, or performs a process of switching the display screen of the display unit 15 according to a user operation on the operation unit 16.

  The navigation processing unit 23 acquires position information indicating the position (latitude, longitude) of the vehicle based on the GPS signal received by the GPS receiving unit 18, and stores map data corresponding to the current position indicated by the position information from the recording unit 13. A process of reading and displaying on the display unit 15 and displaying the position of the vehicle on the displayed map data is performed. Further, when the destination is set by the user operating the operation unit 16, the travel route from the current location to the destination is extracted from the map data and displayed on the map data displayed on the display unit 15. Process.

  The imaging / sound collection control unit 24 controls the start / end of imaging and sound collection by the imaging unit 11 and the sound input unit 12. The imaging / sound collection control unit 24 starts imaging and sound collection when, for example, the navigation apparatus 2 is turned on or the start of the vehicle engine is detected, and the navigation apparatus 2 is turned off or the vehicle engine is turned on. When a stop is detected, the imaging and sound collection are terminated.

  The recording control unit 25 controls recording of AV data obtained by imaging and sound collection on the recording unit 13. The information acquisition unit 26 acquires information that can determine the situation when the AV data is captured and collected, and performs processing for associating this information with the AV data. The communication control unit 27 supplies AV data recorded in the recording unit 13 to the communication unit 14 and performs communication control in the communication unit 14.

  Here, information associated with AV data will be described. The information associated with the AV data is information with which the situation at the time of imaging and sound collection can be determined, and specifically, for example, date / time information, destination information, route information, and passenger information.

  The date / time information is information indicating the date / time when the AV data is imaged and collected, and can be obtained from the time information output from the clock 19. The destination information is information indicating the destination, and can be acquired based on the destination set by the user. The route information is information indicating a route on which the vehicle has traveled from the current location to the destination, and can be acquired based on the travel route to the destination set by the user. The rider information is information related to the person who rides the vehicle, that is, the driver and the passenger, and can be acquired by analyzing collected voice data, for example. Specifically, for example, speaker identification processing for specifying a speaker from utterances included in voice data is performed, and a person who gets on the vehicle is specified.

  FIG. 3 shows an example of the configuration of the recording / reproducing apparatus 3 shown in FIG. As shown in FIG. 3, the recording / reproducing apparatus 3 is roughly composed of a communication unit 31, a recording unit 32, an operation unit 33, a clock 34, and a control unit 35.

  The communication unit 31 performs wireless communication with the navigation device 2 according to a predetermined protocol, and receives AV data from the navigation device 2 via the network 4.

  The recording unit 32 is, for example, an HDD or a flash memory, and AV data is classified and recorded by the control unit 35 described later. For example, the recording unit 32 creates a folder according to the classification, and stores the classified AV data in the corresponding folder according to the classification result. In addition, personal information indicating personal information of a predetermined person, such as age and date of birth, is recorded in the recording unit 32 in advance.

  The operation unit 33 is provided with a predetermined operator for operating the recording / reproducing apparatus 3 by a user, and outputs a control signal corresponding to an operation on the operator. As the operator, for example, a key for reproducing or stopping AV data is provided as a hardware key on the housing. As the operation unit 33, a remote controller using infrared communication or wireless communication, a mouse, a keyboard, or the like can be used.

  The clock 34 can generate the current time information of the recording / reproducing apparatus 3 based on, for example, the oscillation frequency of the crystal resonator. The timepiece 34 is always driven by a battery (not shown).

  The control unit 35 controls the entire recording / reproducing apparatus 3 and includes a communication control unit 41, a data classification processing unit 42, a recording control unit 43, and a reproduction control unit 44. The communication control unit 41 performs communication control in the communication unit 31 and receives AV data received by the communication unit 31. The data classification processing unit 42 classifies AV data based on information (date information, destination information, route information, passenger information) associated with the AV data received from the navigation device 2.

  The recording control unit 43 controls recording of AV data received by the communication unit 31 to the recording unit 32. When AV data is recorded in the recording unit 32, the recording control unit 43 records the AV data in a folder of the corresponding recording unit 32 based on the classification result.

  The playback control unit 44 controls playback of AV data recorded in the recording unit 32. The reproduction control unit 44 reads AV data from the recording unit 32 and outputs it to the outside. A display device such as a television receiver or a monitor device is connected to the outside, and video display and audio output are performed. For example, the recording / reproducing apparatus 3 may be provided with a display unit.

  Next, the operation of the audio / video recording / reproducing apparatus 1 having the above configuration will be described.

  Here, first, the operation of the navigation device 2 will be described with reference to FIG. FIG. 4 is a flowchart showing a flow of processing by the navigation device 2 according to the present invention. Unless otherwise specified, the following processing is assumed to be performed under the control of the control unit 20.

  In step S1, it is determined whether or not the navigation apparatus 2 is turned on or the start of the engine of the vehicle on which the navigation apparatus 2 is mounted is detected. If it is detected that the navigation device 2 is powered on or the engine is started, the process proceeds to step S2. On the other hand, when the power of the navigation device 2 is turned on or the start of the engine is not detected, the process returns to step S1.

  In step S2, it is determined whether AV data is recorded in the recording unit 13 or not. When AV data is not recorded in the recording unit 13, imaging and sound collection by the imaging unit 11 and the audio input unit 12 are started (step S4). On the other hand, if AV data is recorded in the recording unit 13, the AV data is transferred to the recording / reproducing apparatus 3 via the communication unit 14 (step S3), and the process proceeds to step S4.

  When imaging and sound collection are started, the control unit 20 acquires date and time information indicating the date and time when imaging and sound collection are started based on the time information from the clock 19 (step S5).

  Next, when the destination is set by the user operating the operation unit 16 of the navigation device 2, the control unit 20 acquires position information based on the GPS signal from the GPS receiving unit 18, and obtains the destination from the current location. Set the travel route to. Then, the map data is read from the recording unit 13, and the travel route set together with the corresponding map data is displayed on the display unit 15 (step S6).

  At this time, the control unit 20 acquires destination information and route information based on the set destination and travel route (step S7). In addition, the control unit 20 analyzes the audio data obtained by collecting the sound, identifies the person who is on the vehicle, and acquires the passenger information indicating the person who is on the vehicle (step S8). Note that the analysis of the sound data and the acquisition of the passenger information are continuously performed on the sound data obtained, for example, every predetermined time while the image pickup and sound collection are performed.

  Here, a method for analyzing audio data will be schematically described. For the analysis of the voice data, for example, a speaker identification process for specifying a speaker from a utterance included in the voice data can be applied. In the speaker identification process, first, a feature of the speaker is extracted in advance from the voice data including the utterance of the specific speaker, and is recorded in the recording unit 13 as a template. Then, a feature is extracted by analyzing the voice data collected by the voice input unit 12, and the extracted feature is compared with the feature included in the template recorded in the recording unit 13. Can be specified.

  In step S9, it is determined whether the navigation apparatus 2 is turned off or an engine stop is detected. When it is detected that the navigation apparatus 2 is turned off or the engine is stopped, the process proceeds to step S10, and imaging and sound collection by the imaging unit 11 and the voice input unit 12 are completed. On the other hand, when the power of the navigation device 2 is turned off or the engine stop is not detected, the process returns to step S9.

  When imaging and sound collection are completed, various types of information (date and time information, destination information, route information, passenger information) are associated with the obtained AV data (step S11) and recorded in the recording unit 13 (step S11). S12). Then, the process returns to step S1, and the processes from step S1 to step S12 are repeated cyclically.

  In the above-described example, the audio data analysis and the passenger information acquisition process in step S8 are described as being continuously performed during sound collection. However, this is not limited to this example. For example, audio data analysis and passenger information acquisition processing may be performed after completing the imaging and sound collection in step S10.

  Next, the operation of the recording / reproducing apparatus 3 will be described with reference to FIGS.

  First, AV data recording processing by the recording / reproducing apparatus 3 will be described with reference to FIG. FIG. 5 is a flowchart showing a flow of recording processing by the recording / reproducing apparatus 3 according to the present invention. Unless otherwise specified, the following processing is assumed to be performed under the control of the control unit 35.

  When AV data is received from the navigation device 2 via the network 4 (step S21), the control unit 35, from the received AV data, various associated information (date and time information, destination information, route information, passenger information) Are extracted (step S22), and AV data is classified based on the extracted information (step S23).

  Here, the AV data classification method in step S23 shown in FIG. 5 will be described.

  The classification of the AV data is arbitrarily set by a user operation on the operation unit 33, and various classifications such as a classification by date and time, a classification by an event such as a trip or a drive, and a classification by a person on board can be considered. In such a case, the control unit 35 classifies the AV data with reference to information suitable for classification from various information associated with the AV data based on the user setting. For example, when the information associated with the AV data is date / time information, destination information, route information, and passenger information, when the AV data is classified by date / time, the date / time information is referred to and classified by event. If so, the destination information and / or route information is referred to. Further, for example, when the AV data is classified for each person, the passenger information is referred to.

  When classifying AV data, one of the plurality of classifications may be selected, or a plurality of classification methods may be combined. For example, AV data may be classified by date and person by referring to date and time information and passenger information.

  Returning to FIG. 5, when the AV data is classified in step S23, the control unit 35 records the AV data in the recording unit 32 based on the classification result (step S24). In the recording unit 32, a folder corresponding to the classification set by the user is created, and AV data is recorded. For example, when the user sets to classify by date and time, a folder with the date as the name is created in the recording unit 32. When the user sets to classify by event, the event or A folder with the destination as the name is created. Also, for example, when the user is set to classify by person, a folder with a person name as a name is created. Then, AV data corresponding to each name is recorded in each folder.

  By the way, it is conceivable that there are a plurality of persons in the vehicle equipped with the navigation device 2. Therefore, by analyzing the AV data, a plurality of persons are specified from one AV data. That is, when AV data is classified by person, one AV data is associated with a plurality of persons.

  Therefore, in such a case, this AV data is stored in each folder corresponding to a plurality of specified persons. For example, in the case of classifying AV data by person, if three persons, person A, person B, and person C, are specified from the AV data, the AV data is stored in each folder of person A, person B, and person C. The

  Next, AV data playback processing by the recording / playback apparatus 3 will be described with reference to FIG. In the recording / reproducing apparatus 3 according to the present invention, when video and / or audio conditions to be reproduced are designated by the user operating the operation unit 33, AV data corresponding to the designated conditions is recorded in the recording unit 32. Read from and play.

  FIG. 6 is a flowchart showing the flow of reproduction processing by the recording / reproducing apparatus 3 according to the present invention. Unless otherwise specified, the following processing is assumed to be performed under the control of the control unit 35. When the condition is designated by the user (step S31), the control unit 35 searches the AV data recorded in the recording unit 32 for AV data corresponding to the condition (step S32).

  At this time, the conditions specified by the user are performed based on the classification at the time of recording, for example. For example, when the AV data is classified by date and time, the date and time is specified as a condition, and when the AV data is classified by event, the event and the destination are specified as conditions. Further, for example, when classification by person is performed, a person name is designated as a condition.

  Based on the specified condition, the control unit 35 refers to the folder in the recording unit 32 and reads AV data stored in the folder according to the condition (step S33). For example, when the date and time when an image is captured and collected, an event, a specific person name, or the like is specified by the user, the control unit 35 stores the image in a corresponding folder in the recording unit 32 based on the specified condition. Read AV data. Then, the control unit 35 outputs the read AV data to an external playback device (step S34), and ends a series of processing. Note that the playback method is not limited to the above-described playback method, and for example, playback may be performed by the user directly specifying AV data.

  The recording / reproducing apparatus 3 can also reproduce video and / or audio based on the personal information of the person. For example, when the AV data is classified for each person, personal information such as the birthday and age of each person is registered in advance, and when the AV data is recorded in the recording unit 32, the personal information and the AV data are recorded. Associate with data.

  For example, when the reproduction process is performed for the first time after the birthday of a predetermined person using the personal information, the past AV data corresponding to the birthday is read and output. Thus, for example, when AV data is played back, the video and / or voice may be played back with a display such as “Happy Birthday!” Or “Video / sound of Mr. XX ’s 5 years old”. it can.

  In addition, for example, when the child is a family hot spring trip by car when the child is in the sixth grade of elementary school, or when the child is a family ski trip by car when the child is the third grade of elementary school, the state and sound in the car automatically recorded and recorded At the same time, I can recall the details that I have forgotten so far and recall a real time.

  Here, the recording and reproducing operation by the recording / reproducing apparatus 3 has been described. However, as the operation by the recording / reproducing apparatus 3, the recorded AV data is deleted or the AV data is edited. Is also possible.

  In the above-described example, the passenger information is acquired by the navigation device 2. However, the present invention is not limited to this. For example, the passenger information may be acquired on the recording / reproducing device 3 side. Specifically, for example, the recording / reproducing apparatus 3 registers in advance information indicating the characteristics of a person's utterance in the recording unit 32, and analyzes audio data included in the received AV data based on this information. To obtain passenger information. Thereby, the load concerning the process by the side of the navigation apparatus 2 can be reduced.

DESCRIPTION OF SYMBOLS 1 Image audio recording / reproducing apparatus 2 Navigation apparatus 3 Recording / reproducing apparatus 4 Network 11 Image pick-up part 12 Audio | voice input part 13 Recording part 14 Communication part 15 Display part 16 Operation part 17 GPS antenna 18 GPS receiving part 19 Clock 20 Control part 21 Input control part 22 Display control unit 23 Navigation processing unit 24 Imaging / sound collection control unit 25 Recording control unit 26 Information acquisition unit 27 Communication control unit 31 Communication unit 32 Recording unit 33 Operation unit 34 Clock 35 Control unit 41 Communication control unit 42 Data classification processing unit 43 Recording control unit 44 Playback control unit

Claims (4)

A navigation device that is installed in a vehicle, detects the position of the vehicle, guides a travel route to the destination based on the detected position information, and records and transmits video data or / and audio data in the vehicle When,
An image / audio recording / reproducing apparatus comprising: a recording / reproducing apparatus for recording / reproducing video data and / or audio data received from the navigation apparatus. The navigation device transmits at least one selected from information on a passenger, information on date and time, information on a destination, information on a route to the destination, together with the video data and / or audio data,
The recording / reproducing device selects at least one of video data and / or audio data received from the navigation device from information on a passenger, information on date and time, information on a destination, and information on a route to the destination. The video / audio recording / reproducing apparatus according to claim 1, wherein the video / audio recording / reproducing apparatus performs recording / reproduction based on the information.   3. The image / audio recording / reproducing apparatus according to claim 1, wherein a person who gets on the vehicle is specified from a utterance included in the recorded audio data by speaker identification processing for specifying a speaker. 4.   The said recording / reproducing apparatus records and reproduces | regenerates the said video data or / and audio | voice data based on the personal information of the predetermined | prescribed person of the said passengers. Video and audio recording and playback device.

Images