JP2015230519A - Vehicle memory sharing system, on-vehicle device, and memory sharing program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a vehicle memory sharing system, an on-vehicle device, and a memory sharing program capable of more easily sharing memory information among members who went on a trip together.SOLUTION: A cooperative terminal identification unit included in an on-vehicle device 1 identifies a mobile terminal 3 brought into a cabin by a user and cooperating with the on-vehicle device 1. A memory information acquisition unit included in either the on-vehicle device 1 or the mobile terminal 3 acquires memory information representing a memory during a trip. A memory information distribution unit distributes the memory information acquired by the memory information acquisition unit or viewing information for viewing the memory information to the mobile terminal cooperating with the on-vehicle device in the current trip.

Description

  The present invention relates to a technique for storing images and videos taken in the process of moving by a vehicle.

  In Patent Document 1, a video for a certain time determined on the basis of a point in time when a predetermined condition is satisfied among videos shot while an in-vehicle camera installed so that an imaging surface faces the outside of the vehicle is running. An apparatus for storage is disclosed. For example, the device described in Patent Document 1 stores images captured by a vehicle-mounted camera for a certain period of time before and after a shooting instruction operation performed by a driver. Patent Document 1 describes an example in which the device is used as an operation record (that is, a drive recorder) for elucidating the cause of a traffic accident.

JP 2009-246503 A

  Although not disclosed in Patent Document 1, it is considered that the apparatus described in Patent Document 1 can also be used to store images taken of scenery outside the vehicle as memories when traveling by vehicle. . In other words, the user can save a scene image captured by the on-board cameras before and after that point by performing a shooting instruction operation at a desired timing.

  As a means for leaving memories during travel, there is a method of using a portable terminal with a camera function. Users of these mobile terminals can take pictures and videos such as scenery using the camera of the mobile terminal as memories during travel.

  By the way, when traveling with multiple members such as friends, I want to share the data (collected as memory information) such as photos and videos taken with mobile devices with camera functions owned by each member with the members who traveled There is a demand.

  In recent years, so-called online storage services that lend storage areas for file storage on the Internet have become widespread. For example, each member saves photos and videos taken by themselves on a predetermined online storage server. Memories information can be shared among members. Of course, the above-mentioned scenery image captured by the in-vehicle camera can also be shared among members by using the online storage service.

  However, in this case, it is necessary for some of the members accompanying the trip to select an online storage server for storing memory information, and to inform other members of the URL, password for storing the file, and the like. is there. In addition, each member has to manually select memory information to be shared and perform an operation for storing the information in the online storage, which is troublesome.

  The present invention has been made based on this situation, and the purpose of the present invention is to provide a vehicle memory sharing system that can more easily share memory information among members who have traveled together, To provide an in-vehicle device and a memory sharing program.

  An invention for a vehicle memory sharing system for achieving the object includes a vehicle memory sharing system including at least one portable terminal (3) carried by a user and an in-vehicle device (1) mounted on the vehicle. The in-vehicle device is provided in the vehicle by the user and includes a cooperation terminal specifying unit (F5) that specifies a mobile terminal that cooperates with the in-vehicle device, and at least one of the in-vehicle device and the mobile terminal is a vehicle A memory information acquisition unit (F6, F36, F9) for acquiring memory information representing memories during a trip in the vehicle, the vehicle memory sharing system includes a memory information acquisition unit in the portable terminal specified by the cooperation terminal specification unit A memory information distribution unit (F43, F4) for distributing memory information acquired by the mobile terminal or information for browsing for the user of the mobile terminal to browse the memory information And features.

  In the above configuration, the cooperation terminal specifying unit is brought into the vehicle by the user and specifies a portable terminal that cooperates with the in-vehicle device. Then, the memory information distribution unit distributes the memory information acquired by the memory acquisition unit or the browsing information for browsing the memory information to the portable terminal linked with the vehicle-mounted device in this trip.

  Here, the portable terminal linked with the vehicle-mounted device 1 means a portable terminal owned by a member who accompanied the vehicle traveling. In other words, the memory information distribution unit distributes memory information or information for browsing the memory information to the mobile terminals of the members accompanying the trip. In addition, when there are a plurality of mobile terminals linked to the vehicle-mounted device, the memory information distribution unit distributes the memory information or information for browsing the memory information to each mobile terminal linked to the vehicle-mounted device.

  Therefore, according to the above configuration, there is no need to select an online storage server for storing memory information by any of the members accompanying the travel as in the past, and for saving the URL and file. There is no need to contact other members about passwords. Furthermore, it is not necessary for each member to perform an operation for storing the memory information in the online storage.

  Therefore, according to the above configuration, memory information can be shared more easily among members who have traveled together.

  An invention of an in-vehicle device for achieving the above object is an in-vehicle device used in a vehicle memory sharing system (100, 100A, 100B) including at least one portable terminal (3) carried by a user. , A linked terminal identifying unit (F5) for identifying a portable terminal linked with the vehicle-mounted device, a memory information acquiring unit (F6, F9) for acquiring memory information representing memories during travel in the vehicle, and a memory information acquiring unit And a memory information distribution unit (F4, F8) for transmitting the memory information acquired in (1) to the portable terminal directly or via a server (4) provided outside the vehicle.

  Furthermore, the invention of the memory sharing program for achieving the above object includes an in-vehicle device cooperation processing unit (F35) that performs processing for linking a computer with the in-vehicle device (1) mounted on the vehicle, and a travel in the vehicle. It is made to function as a memory information receiving part (F34, F37) which receives the memory information showing the memory inside from a vehicle (2) provided outside the vehicle or the vehicle.

  In addition, the code | symbol in the parenthesis described in the claim shows the correspondence with the specific means as described in embodiment mentioned later as one aspect, Comprising: The technical scope of this invention is limited is not.

1 is a block diagram illustrating an example of a schematic configuration of a vehicle memory sharing system 100 according to Embodiment 1. FIG. 2 is a block diagram illustrating an example of a schematic configuration of an in-vehicle device 1. FIG. 3 is a block diagram illustrating an example of a schematic configuration of an in-vehicle device side control unit 11. FIG. 3 is a block diagram illustrating an example of a schematic configuration of a mobile terminal 3. FIG. 3 is a block diagram illustrating an example of a schematic configuration of a portable side control unit 31. FIG. 3 is a block diagram illustrating an example of a schematic configuration of a server 4. FIG. It is a flowchart for demonstrating the vehicle equipment side process which the vehicle equipment side control part 11 implements. It is a flowchart for demonstrating a departure related process. It is a flowchart for demonstrating a cooperation terminal acquisition process. It is a flowchart for demonstrating vehicle equipment side memory information acquisition processing. It is a flowchart for demonstrating a parking relevant process. It is a figure for demonstrating the action | operation of the memory sharing system 100 for vehicles in Embodiment 2. FIG. It is a figure for demonstrating the action | operation of the memory sharing system 100 for vehicles in Embodiment 2. FIG. It is a figure for demonstrating the action | operation of the memory sharing system for vehicles in Embodiment 3. FIG.

<Embodiment>
Hereinafter, a first embodiment (referred to as Embodiment 1) of the present invention will be described with reference to the drawings. FIG. 1 is a diagram illustrating an example of a schematic configuration of a vehicle memory sharing system 100 according to the present embodiment. As shown in FIG. 1, a vehicle memory sharing system 100 includes an in-vehicle device 1 mounted on a vehicle, at least one portable terminal 3 that is brought into the vehicle by a user and performs mutual communication with the in-vehicle device 1, and the vehicle. A server 4 provided outside is provided.

  As the mobile terminal 3, a known smartphone equipped with a camera for taking pictures and moving images (referred to as a mobile camera), a tablet terminal, or the like can be used. An ordinary mobile terminal such as a smartphone is installed with an application program (hereinafter simply referred to as an application) for operating as the mobile terminal 3 included in the vehicle memory sharing system 100, and the application is executed. In the state, it operates as the portable terminal 3 in the present embodiment. This application corresponds to the memory sharing program described in the claims.

  Before describing the specific configuration of the vehicle memory sharing system 100, an outline thereof will be described. The vehicle memory sharing system 100 is configured to share data (collected as memory information) such as photographs and videos taken as memories in the course of a vehicle trip (referred to as a trip) among the members of the group accompanying the trip. It is something to share.

  Here, the trip is a travel from the departure point to the arrival point. Of course, the trip from the departure point to the destination point and returning to the departure point may be a trip. Trip corresponds to the travel described in the claim.

  The memory information may be generated by the mobile terminal 3 carried by each member, or may be generated by the in-vehicle device 1. The memory information generated by the mobile terminal 3 (referred to as mobile-side memory information) corresponds to a photograph or a video taken by the mobile camera when the user operates the mobile terminal 3 during the trip. The memory information generated by the in-vehicle device 1 (referred to as in-vehicle device side memory information) corresponds to a photograph or a moving image taken by an in-vehicle camera (described later) provided in the vehicle during the trip.

  The in-vehicle device 1 collects mobile-side memory information generated by the mobile terminal 3 in cooperation with the mobile terminal 3 by establishing a communication connection with the mobile terminal 3 brought into the vehicle interior. Then, the integrated memory information in which the acquired mobile memory information and the in-vehicle device memory information are collected is transmitted to the server 4. In addition, the in-vehicle device 1 transmits cooperation terminal information indicating the mobile terminal 3 that cooperates with the in-vehicle device 1 to the server 4.

  Based on the cooperation terminal information transmitted from the in-vehicle device 1, the server 4 specifies the in-vehicle device 1 used in the trip, the portable terminal 3 that cooperates with the in-vehicle device 1, and the user of the portable terminal 3. . And the server 4 will deliver integrated memory information with respect to the portable terminal 3 which cooperated with the vehicle equipment 1 in the trip, if integrated memory information is received from the vehicle equipment 1. Hereinafter, a specific configuration of the vehicle memory sharing system 100 will be described.

(Configuration of in-vehicle device 1)
As shown in FIG. 2, the in-vehicle device 1 includes an in-vehicle device side control unit 11, an in-vehicle camera 12, an in-vehicle camera 13, a photographing switch 14, a microphone (hereinafter referred to as a microphone) 15, a voice recognition device 16, and an in-vehicle device side storage unit. 17, an external input interface (hereinafter, external input I / F) 18, a navigation device 19, an audio device 20, a wide area communication unit 21, and a vehicle interior communication unit 22. In-vehicle device side control unit 11, in-vehicle camera 12, in-vehicle camera 13, shooting switch 14, microphone 15, voice recognition device 16, in-vehicle device side storage unit 17, external input I / F 18, navigation device 19, audio device 20 The wide area communication unit 21 and the vehicle interior communication unit 22 are connected to each other by a known in-vehicle network so as to be able to communicate with each other. Below, the vehicle in which this vehicle equipment 1 is mounted is called a self-vehicle.

  The in-vehicle camera 12 is installed in the vehicle interior so that the photographing range covers each seat in the vehicle interior. For example, the in-vehicle camera 12 may be installed on the rearview mirror so as to be in the above-described shooting range. In the present embodiment, the in-vehicle camera 12 outputs a video signal, but may output a still image (that is, a photograph) as another aspect. The video signal of the in-vehicle camera 12 is output to the in-vehicle device side control unit 11.

  Further, as an example, the in-vehicle camera 12 is configured to always shoot while the ignition power is on, but is not limited thereto. As another aspect, it may be configured to perform photographing based on an instruction from the in-vehicle device side control unit 11 when a later-described video storage condition is satisfied.

  A plurality of in-vehicle cameras 12 may be provided such as a camera for photographing the front seat and a camera for photographing the rear seat. As the in-vehicle camera 12, for example, an optical camera such as a CMOS camera or a CCD camera can be used.

  The vehicle exterior camera 13 is a front camera that captures a predetermined range in front of the host vehicle, for example. The front camera as the vehicle external camera 13 may be installed on the rear mirror or the upper part of the front window. The external camera 13 is not limited to the front camera, and may be a left side camera that captures a predetermined range on the left side of the host vehicle, or a right side camera that captures a predetermined range on the right side of the host vehicle. It may be a rear camera that captures a predetermined range behind the vehicle. Moreover, you may provide combining these.

  In the present embodiment, the vehicle exterior camera 13, as with the vehicle interior camera 12, always shoots while the ignition power is on and outputs the video signal to the vehicle-mounted device side control unit 11. To do. Of course, as another aspect, the vehicle-mounted camera 13 shoots based on an instruction from the in-vehicle device side control unit 11 when an image storage condition described later is satisfied, and the image signal is transmitted to the in-vehicle device side control unit. 11 may be sequentially output.

  Further, the vehicle exterior camera 13 may output a still image. As the vehicle camera 13, for example, an optical camera such as a CMOS camera or a CCD camera can be used. Hereinafter, when the in-vehicle camera 12 and the in-vehicle camera 13 are not distinguished from each other, they are simply referred to as in-vehicle cameras.

  The photographing switch 14 is used by a user (for example, a driver) to instruct the in-vehicle device 1 so as to save an image captured by the in-vehicle camera 12 or the in-vehicle camera 13 in the in-vehicle device storage unit 17. Switch. The photographing switch 14 is provided at a position where the user can easily operate, for example, near the side surface of the steering column cover or near the shift lever.

  The photographing switch 14 includes a plurality of switches corresponding to the in-vehicle camera 12 and the out-of-vehicle camera 13, and the user can store the images photographed by the in-vehicle camera corresponding to the photographing switch 14 that is pressed. it can. When the shooting switch 14 is pressed by the user, the imaging switch 14 outputs a control signal corresponding to the switch pressed by the user to the in-vehicle device side control unit 11. The photographing switch 14 is a so-called click type switch.

  The microphone 15 is, for example, a small omnidirectional microphone, collects ambient sounds such as voices and noises uttered by the user, converts them into electrical voice signals, and outputs them to the in-vehicle device side control unit 11. . The microphone 15 is provided at a position where the user's voice can be easily picked up, for example, near the center of the instrument panel in the vehicle width direction or near the center of the vehicle interior. A plurality of microphones 15 may be provided. The voice signal acquired by the microphone 15 is supplied to the voice recognition device 16 as well as the in-vehicle device side control unit 11.

  The voice recognition device 16 uses various data stored in a voice recognition database (not shown) storing data necessary for well-known voice recognition processing, to the voice signal acquired by the microphone 15. Perform voice recognition processing. The speech recognition database includes, as data necessary for speech recognition processing, for example, an acoustic model in which acoustic features of small units (phonemes) of human utterances are described, a recognition dictionary that associates acoustic features of phonemes and words, and It stores a language model that expresses the connection between words.

  The voice recognition device 16 analyzes the content of the user's utterance and detects, for example, laughter or cheer. Then, the excitement of the user's conversation is detected from the utterance content, the presence or absence of laughter and cheer, and the loudness of the voice. For example, when a laughing voice or a cheering voice whose loudness is equal to or greater than a certain threshold is detected, it is determined that the users are excited.

  The in-vehicle device side storage unit 17 includes a rewritable nonvolatile storage medium and a device that reads and writes data from and to the storage medium. As the storage medium provided in the in-vehicle device side storage unit 17, a known storage medium such as a magnetic disk, an optical disk, and a flash memory can be used. In the present embodiment, a removable storage medium such as an SD card is used as an example of a storage medium included in the in-vehicle device storage unit 17. Of course, a DVD, CD, HDD or the like may be employed as the storage medium. A plurality of types of storage media may be provided in combination.

  The in-vehicle device side storage unit 17 stores a plurality of music data that can be reproduced by the audio device 20 and data (such as map data) used in various processes performed by the navigation device 19. It is assumed that metadata such as music title, artist name, album / single title, genre name, performance time, release year, track number, etc. is added to the music data. In addition, the in-vehicle device side storage unit 17 stores various kinds of memory information acquired in the memory information acquisition related process described later.

  The external input I / F 18 is used for the in-vehicle device side control unit 11 to acquire information (vehicle information) indicating the traveling state of the own vehicle and the control state of the body system from the ECU and the sensor mounted on the own vehicle. Interface. For example, vehicle information is input to the external input I / F 18 from an ECU or a sensor mounted on the host vehicle via a predetermined in-vehicle network.

  Examples of vehicle information include a shift position sensor signal, a parking brake switch on / off signal, a door courtesy switch on / off signal, an ignition (hereinafter, IG) power switch (not shown) signal for switching on / off, etc. There is.

  The navigation device 19 has the same function as a well-known navigation device, and for example, from the current position to the destination based on the map data stored in the in-vehicle device side storage unit 17 and the current position of the host vehicle. A route guidance process for guiding the travel of the guidance route is performed. The current position of the host vehicle is sequentially (for example, 100 milliseconds) based on a received signal of a GNSS receiver that receives radio waves from a satellite used in GNSS (Global Navigation Satellite System), and sensor values of an acceleration sensor and a gyro sensor. Detected). The position information indicating the current position may be expressed by, for example, latitude and longitude. Position information indicating the current position of the host vehicle detected by the navigation device 19 is sequentially output to the in-vehicle device side control unit 11.

  In addition, in the navigation device 19, the user can register a stop point in addition to the destination. When the stop point is registered by the user, the navigation device 19 passes the stop point to the destination. A route is calculated and set as a guide route. And the navigation apparatus 19 outputs information, such as a departure place, a destination, and a stop point, to the vehicle equipment side control part 11. FIG. The departure point may be a point at the time when the IG power source is turned on, or may be a point where an operation for setting a destination is performed.

  The audio device 20 reproduces the music data stored in the in-vehicle device side storage unit 17 based on a user operation. When the music data is being reproduced, the audio device 20 outputs the information indicated in the metadata added to the music data being reproduced to the in-vehicle device side control unit 11.

  The wide area communication unit 21 includes a transmission / reception antenna and communicates with the server 4 via a known communication network such as a telephone line or the Internet. Here, the wide-area communication unit 21 is assumed to be realized by an in-vehicle communication module such as a DCM (Data Communication Module) used for telematics communication as an example. The wide area communication unit 21 demodulates the received signal and outputs the demodulated signal to the in-vehicle device side control unit 11, and modulates and transmits data input from the in-vehicle device side control unit 11.

  The vehicle interior communication unit 22 includes a transmission / reception antenna that uses the vehicle interior as a wireless communication area. The vehicle interior communication unit 22 is equipped with a portable terminal 3 (more specifically, a narrow communication unit 39) that is brought into the vehicle, and a known short-range wireless communication. Implement data transmission / reception by communication. Communication between the vehicle interior communication unit 22 and the portable terminal 3 may be performed in accordance with a known communication standard.

  For example, as a standard used for communication between the vehicle interior communication unit 22 and the portable terminal 3, a wireless LAN standard such as IEEE802.11 or a short-range wireless communication standard such as Bluetooth (registered trademark) can be employed. In the present embodiment, as an example, a wireless LAN standard such as IEEE802.11 is adopted, and a plurality of portable terminals 3 can simultaneously access the in-vehicle device 1.

  In the present embodiment, the in-vehicle device 1 and the portable terminal 3 are configured to transmit and receive data by wireless communication. However, as another aspect, the configuration may be such that data is transmitted and received by wired communication such as USB communication. Moreover, the vehicle equipment 1 may implement communication with the portable terminal 3 by the wide area communication part 21 as another aspect.

  The in-vehicle device side control unit 11 is configured as a normal computer, and includes a well-known CPU, a nonvolatile memory such as a ROM and a flash memory, a volatile memory such as a RAM, an I / O, and a bus for connecting these configurations. Lines (both not shown) are provided. The nonvolatile memory stores programs and data for executing various processes, and a vehicle identifier (hereinafter, vehicle ID) that is a unique identifier set in the in-vehicle device 1.

  The internal memory 111 provided in the in-vehicle device side control unit 11 is a rewritable storage medium, and is realized by, for example, a flash memory provided in the in-vehicle device side control unit 11. Also, a part of the internal memory 111 has a ring buffer structure, and video data obtained by converting (that is, encoding) video signals sequentially input from the in-vehicle camera 12 and the in-vehicle camera 13 into a predetermined format. Is temporarily held. That is, the images shot by the in-vehicle camera 12 and the in-vehicle camera 13 are held in the internal memory 111 for a certain period of time.

  The vehicle ID is for distinguishing a plurality of in-vehicle devices 1 used in the vehicle memory sharing system 100 from each other. That is, the vehicle ID only needs to be set so that the vehicle-mounted device 1 can be distinguished from other vehicle-mounted devices. For example, the serial number of the vehicle-mounted device 1 or the MAC address of the wide area communication unit can be used. The vehicle ID may be set by the user. Each vehicle ID of the plurality of in-vehicle devices 1 used in the vehicle memory sharing system 100 is stored in a user database (hereinafter referred to as a user DB) of the server 4 and managed together with user information to be described later.

  As shown in FIG. 3, the in-vehicle device side control unit 11 includes a navigation information acquisition unit F1, an audio information acquisition unit F2, a traveling state determination unit F3, a vehicle interior communication processing unit F4, a cooperation terminal specifying unit F5, an in-vehicle unit. A machine-side memory information acquisition unit F6, a memory information extraction unit F7, and a wide area communication processing unit F8 are provided.

  The navigation information acquisition unit F1 acquires information on a destination, a stop point, and a departure place set in the navigation device 19, and sequentially acquires the current position of the host vehicle. Moreover, the navigation information acquisition part F1 produces | generates the information (it makes driving locus information) which shows the driving locus of the own vehicle by arranging the positional information on the own vehicle acquired sequentially from the navigation apparatus 19 in time series.

  The travel locus information may be acquired from the navigation device 19. Further, the travel locus may be indicated by information on a traveled link or node. A node here means a point where a plurality of roads intersect, merge and branch in a road map showing the connection relation of roads, and a link means a road connecting the nodes.

  As described in the outline, the trip from the departure point to the arrival point is equivalent to a trip. Hereinafter, the departure point, departure time, destination, arrival time at the destination, stop-off point, and travel locus information are referred to as trip information.

  It should be noted that the stop point in the present embodiment refers to not only a point registered as a stop point in the navigation device 19 but also a point parked other than the destination. The trip information is stored in the in-vehicle device side storage unit 17 in association with memory information described later.

  The audio information acquisition unit F2 acquires from the audio device 20 metadata of music data currently being played back by the audio device 20.

  The traveling state determination unit F3 determines a traveling state such as whether or not the host vehicle is traveling based on the vehicle information. For example, the traveling state determination unit F3 determines that the vehicle is parked when detecting a user operation for changing the IG power source from the on state to the off state based on the signal of the power switch.

  Of course, in addition, it may be determined that the host vehicle is parked when it is detected that the shift lever is set to the parking position based on the signal of the shift position sensor. On the other hand, when the IG power supply is turned on, or when the shift lever is set to a position that transmits the driving force such as the drive position to the drive wheels based on the signal of the shift position sensor, the vehicle has started running What is necessary is just to judge.

  The vehicle interior communication processing unit F4 controls the operation of the vehicle interior communication unit 22 and performs a process for communicating with the portable terminal 3 brought into the vehicle interior. More specifically, while controlling the data output to the vehicle interior communication part 22, the data which the vehicle interior communication part 22 received are acquired, and it passes to another functional block (for example, cooperation terminal specific | specification part F5). This vehicle interior communication processing unit F4 corresponds to the in-vehicle device side portable terminal communication processing unit described in the claims.

  Examples of data acquired by the vehicle interior communication processing unit F4 include a registration request and memory information acquired by the mobile-side memory information acquisition unit F36 included in the mobile terminal 3 (that is, mobile-side memory information). The registration request here is data that establishes a communication connection with the in-vehicle device 1 and requests registration as a portable terminal that cooperates with the in-vehicle device 1. The registration request includes the mobile ID of the mobile terminal 3 that transmitted the registration request.

  The mobile ID is an ID unique to the mobile terminal, and is used to distinguish a plurality of mobile terminals 3 used in the vehicle memory sharing system 100 from each other. The mobile ID is also managed together with the user information in the user DB of the server 4.

  The cooperation terminal specific | specification part F5 specifies the portable terminal 3 which cooperated with the vehicle equipment 1 which transmitted the said registration request, ie, the vehicle equipment 1, from portable ID contained in the registration request which the vehicle interior communication process part F4 received. Here, the user of the portable terminal 3 that cooperates with the vehicle-mounted device 1 in the trip means that the user is a member of a group that has acted together in the trip. That is, the cooperation terminal specific | specification part F5 bears the role which specifies the user who shares the memory information of this trip. Hereinafter, the portable terminal 3 that is linked to the in-vehicle device 1 is also referred to as a linked terminal 3. The mobile ID of the cooperation terminal 3 is stored in the in-vehicle device side storage unit 17.

  The in-vehicle device side memory information acquisition unit F6 acquires and collects in-vehicle device side memory information in the trip. As shown in FIG. 3, the in-vehicle device side memory information acquisition unit F6 includes an in-vehicle camera data storage processing unit F61 and an audio information storage processing unit F62 as finer functional blocks. In addition, this vehicle equipment side memory information acquisition part F6 is corresponded to an example of the memory information acquisition part as described in a claim.

  The in-vehicle camera data storage processing unit F61 determines whether or not a predetermined video storage processing condition is satisfied. When it is determined that the video storage processing condition is satisfied, the video captured by the in-vehicle camera determined according to the satisfied video storage processing condition is stored in the in-vehicle device storage unit 17 as one moving image file. The video to be stored as a moving image file may be a video for a predetermined time before and after the time point when it is determined that the video storage processing condition is satisfied.

  In addition, as described above, whether the video captured by the in-vehicle camera 12, the video captured by the external camera, or the video captured by both in-vehicle cameras is stored is satisfied. What is necessary is just to set it as the structure decided uniquely according to a preservation | save process condition.

  For example, the in-vehicle camera data storage processing unit F61 stores the video input from the in-vehicle camera 12 or the in-vehicle camera 13 as a moving image file in the in-vehicle device side storage unit 17 for a predetermined time from the time when the user turns on the photographing switch 14. Store. The vehicle-mounted camera that is the acquisition source of the video to be stored is a vehicle-mounted camera that corresponds to the shooting switch 14 pressed by the user. That is, when the shooting switch 14 corresponding to the vehicle exterior camera 13 is pressed, the image captured by the vehicle exterior camera 13 is stored as a moving image file.

  In addition, when the voice recognition device 16 detects the user's excitement, the in-vehicle camera data storage processing unit F61 captures images taken by the in-vehicle camera 12 at a predetermined time before and after the detection time point as a reference. Save to. For example, a video for a total of 5 minutes from 1 minute before to 4 minutes after the point when the climax is detected may be stored as one moving image file.

  It is assumed that the in-vehicle camera data storage processing unit F61 generates a moving image file that includes not only video captured by the in-vehicle camera but also audio acquired by the microphone 15. In addition, the moving image file is stored in the in-vehicle device side storage unit 17 with the location information of the point where the moving image file is generated and information such as time added.

  The audio information storage processing unit F62 associates the metadata (music name, etc.) for each piece of music data acquired by the audio information acquisition unit F2 with the location information of the point where the music starts to be played and the time on the vehicle-mounted device side. Save in the storage unit 17.

  The memory information extraction unit F7 inquires of the cooperation terminal 3 whether there is memory information to be transmitted to the in-vehicle device 1. And when the response to the effect that the memory information which should be transmitted from the cooperation terminal 3 to the vehicle equipment 1 exists, corresponding memory information is extracted from the said portable side memory | storage part 37. FIG. The extraction here means that the mobile-side memory information stored in the mobile-side storage unit 37 is acquired through communication performed by the vehicle interior communication unit 22.

  The wide area communication processing unit F <b> 8 controls the operation of the wide area communication unit 21 and performs processing for performing communication with the server 4. More specifically, the data output to the wide area communication unit 21 is controlled, and the data received by the wide area communication unit 21 is acquired.

  Information that the in-vehicle device 1 transmits to the server 4 includes trip information, information on the mobile terminal 3 that cooperates with the in-vehicle device 1 in the trip (that is, linked terminal information), in-vehicle device side memory information, and mobile side memory information. There are integrated memory information. In addition, the wide area communication processing unit F8 transmits and receives control data for establishing communication between the in-vehicle device 1 and the server 4. The wide area communication processing unit F8 corresponds to the in-vehicle device side server communication processing unit described in the claims.

  Note that the wide area communication processing unit F8 adds the vehicle ID of the in-vehicle device 1 or information for specifying the vehicle ID to the header of data to be transmitted to the server 4 and transmits the data. With this vehicle ID, the server 4 can identify the in-vehicle device 1 that is the transmission source of the received data. That is, the in-vehicle device 1, the cooperation terminal 3 of the in-vehicle device 1, trip information, and integrated memory information can be managed in association with each other.

(Configuration of mobile terminal 3)
Next, a schematic configuration of the mobile terminal 3 will be described. As shown in FIG. 4, the portable terminal 3 includes a portable side control unit 31, a display 32, a touch panel 33, a microphone 34, a portable side camera 35, a GNSS receiver 36, a portable side storage unit 37, a wide area communication unit 38, and a narrow area. A communication unit 39 is provided. Here, for the sake of convenience, among the configurations related to the functions of a portable terminal such as a general smartphone, the description of those that are not necessary for the description of the present embodiment is omitted. The portable side control unit 31, the display 32, the touch panel 33, the microphone 34, the portable side camera 35, the GNSS receiver 36, the portable side storage unit 37, the wide area communication unit 38, and the narrow area communication unit 39 can communicate with each other. It is connected to the.

  The display 32 displays text and images based on the input from the portable control unit 31. The display 32 is capable of full color display, for example, and can be configured using a liquid crystal display, an organic EL display, or the like. The touch panel 33 is a capacitive touch panel integrated with the display 32. The user gives instructions to execute various functions to the portable control unit 31 by touching the touch panel. Of course, the mobile terminal 3 may be provided with a mechanical switch or the like instead of the touch panel 33 as an interface for accepting a user operation.

  The microphone 34 is, for example, a small omnidirectional microphone. The microphone 34 collects ambient sounds such as voices and noises spoken by the user, converts them into electrical voice signals, and outputs them to the portable control unit 31. The portable camera 35 is an optical camera such as a CMOS camera. The portable camera 35 takes a photo or a moving image based on a user operation and outputs the data to the portable control unit 31. Note that the moving image captured by the portable camera 35 includes sound acquired by the microphone 34.

  The GNSS receiver 36 detects its current position based on radio waves from the GNSS satellite. The GNSS receiver 36 detects the current position sequentially (for example, every 100 milliseconds), and sequentially outputs position information indicating the current position to the portable control unit 31.

  The portable storage unit 37 includes a rewritable nonvolatile storage medium and a device that reads and writes data from and to the storage medium. A known storage medium such as a flash memory can be used as the storage medium included in the portable storage unit 37. In the present embodiment, the storage medium included in the portable storage unit 37 is an SD card as an example.

  The wide area communication unit 38 includes a transmission / reception antenna and communicates with the server 4 via a known communication network. Here, as an example, the wide area communication unit 38 is assumed to be realized by a communication module used in a known third generation mobile communication system. The wide area communication unit 38 demodulates the received signal and outputs the demodulated signal to the portable side control unit 31, and modulates and transmits the data input from the portable side control unit 31.

  The narrow area communication unit 39 includes a transmission / reception antenna, and performs data transmission / reception with the vehicle-mounted device 1 by a known short-range wireless communication. The narrow area communication unit 39 demodulates the received signal and outputs it to the portable side control unit 31, and modulates and transmits the data input from the portable side control unit 31.

  The mobile-side control unit 31 is configured as a computer, similar to the vehicle-mounted device-side control unit 11, and includes a well-known CPU, a non-volatile memory such as a ROM and a flash memory, a volatile memory such as a RAM, an I / O, and these A bus line (not shown) or the like for connecting these configurations is provided. In the non-volatile memory, a portable ID set in the portable terminal 3 is stored in addition to a program for executing various processes such as the above-described application.

  As shown in FIG. 5 as a functional block, the mobile side control unit 31 includes an operation reception unit F31, a display processing unit F32, a position information acquisition unit F33, a narrow area communication processing unit F34, an in-vehicle device cooperation processing unit F35, a mobile side memory. An information acquisition unit F36 and a wide area communication processing unit F37 are provided.

  The operation reception unit F31 receives a process (such as a shooting operation with the portable camera 35) corresponding to an operation performed by the user on the touch panel 33 based on a signal input from the touch panel 33. The processes received by the operation receiving unit F31 are accumulated in a queue and are sequentially performed.

  The display processing unit F32 generates an image to be displayed on the display 32, and outputs and displays the image on the display 32. That is, the display processing unit F32 controls the display screen of the display 32. The position information acquisition unit F33 acquires position information indicating the current position from the GNSS receiver 36. The narrow area communication processing unit F34 controls the operation of the narrow area communication unit 39, and performs processing for performing communication with the in-vehicle device 1. More specifically, the data output to the narrow area communication unit 39 is controlled, and the data received by the narrow area communication unit 39 is acquired. Data to be transmitted to the in-vehicle device 1 is acquired from the in-vehicle device cooperation processing unit F35 described below. The narrow area communication processing unit F34 corresponds to the portable side in-vehicle device communication processing unit described in the claims.

  The in-vehicle device cooperation processing unit F35 performs processing for the in-vehicle device 1 and the portable terminal 3 to cooperate through the narrow-area communication processing unit F34, and in the state where the in-vehicle device 1 is in cooperation, the in-vehicle device. 1 transmits and receives various data. For example, when the mobile terminal 3 is not yet linked to the vehicle-mounted device 1, the vehicle-mounted device cooperation processing unit F35 generates a registration request and passes it to the narrow area communication processing unit F34. When the registration request is input from the in-vehicle device cooperation processing unit F35, the narrow-area communication processing unit F34 transmits the registration request to the in-vehicle device 1 through the narrow-area communication unit 39.

  Further, in a state where the portable terminal 3 is linked with the in-vehicle device 1, a response signal for the signal transmitted from the in-vehicle device 1 is generated and returned to the narrow area communication processing unit F34. As a signal received from the vehicle-mounted device 1, there is, for example, a signal for inquiring whether there is portable-side memory information to be transmitted. If there is mobile-side memory information to be transmitted, the mobile-side memory information is transmitted to the in-vehicle device 1.

  The mobile-side memory information acquisition unit F36 acquires mobile-side memory information on the trip in the mobile terminal 3. This portable-side memory information acquisition unit F36 corresponds to an example of a memory information acquisition unit described in the claims. The mobile-side memory information acquired by the mobile-side memory information acquisition unit F36 is data of a photograph or a moving image taken by the mobile-side camera 35. The photo and video data taken by the mobile camera 35 are added with time information at the time when the data is generated and the location information acquired by the location information acquisition unit F33, and are carried as mobile memory information. It is stored in the side storage unit 37.

  Note that the mobile-side memory information acquisition unit F36 divides various data stored in the mobile-side storage unit 37 as mobile-side memory information into data that has already been transmitted to the vehicle-mounted device 1 and data that has not yet been transmitted. Manage separately. Data that has not yet been transmitted to the vehicle-mounted device 1 corresponds to the memory information to be transmitted to the vehicle-mounted device 1 described above.

  The wide area communication processing unit F <b> 37 controls the operation of the wide area communication unit 38 and performs processing for performing communication with the server 4. More specifically, the data output to the wide area communication unit 38 is controlled, and the data received by the wide area communication unit 38 is acquired. For example, the wide area communication processing unit F37 acquires integrated memory information from the server 4 via the wide area communication unit 38. The wide area communication processing unit F37 corresponds to the mobile server communication processing unit or the memory information receiving unit described in the claims.

  In addition, the wide area communication process part F37 stores in the portable side memory | storage part 37, when integrated memory information is received. In the present embodiment, the wide area communication processing unit F37 receives the data body of the integrated memory information, but is not limited thereto. As another aspect, the server 4 may access a place where the integrated memory information is stored, and acquire information for browsing the memory information (referred to as browsing information). Here, the browsing information corresponds to a URL (Uniform Resource Locator) indicating a location where the integrated memory information is stored on the network.

  According to such a configuration, the user can access the server 4 using the browsing information at a desired timing and browse the integrated memory information of the current trip. When the integrated memory information can be browsed, the user can not only browse but also download the electronic data.

  Even when data corresponding to the memory information is received from the server 4, the difference data obtained by subtracting the mobile-side memory information provided by the terminal from the integrated memory information is not the data corresponding to the entire integrated memory information. It is good also as a structure which receives. That is, it is good also as a structure which receives the memory information produced | generated by the other portable terminal 3 linked with the vehicle equipment 1 and the vehicle equipment 1 from the server 4. FIG. According to such a configuration, the amount of communication can be reduced compared to a configuration in which data corresponding to the entire integrated memory information is received.

  Note that the integrated memory information stored in the portable storage unit 37 is displayed on the display 32 based on a user operation.

(Configuration of server 4)
The server 4 is a computer provided outside the vehicle and connected to a communication network such as the Internet. The server 4 receives the integrated memory information transmitted from the in-vehicle device 1 and distributes the integrated memory information to the cooperation terminal 3. The server 4 may be a so-called cloud server realized by a plurality of computers on the network.

  The server 4 includes a server-side control unit 41, a wide area communication unit 42, and a user DB 43 as shown in FIG. The server-side control unit 41, the wide area communication unit 42, and the user DB 43 are connected so as to be able to communicate with each other. The wide area communication unit 42 performs wireless communication with each of the in-vehicle device 1 and the portable terminal 3 via the communication network. That is, the wide area communication unit 42 demodulates a signal received from the in-vehicle device 1 or the portable terminal 3 and outputs the demodulated signal to the server-side control unit 41 and modulates data input from the server-side control unit 41 to modulate the in-vehicle device 1. Or it transmits to the cooperation terminal 3.

  The user DB 43 is a storage device implemented using a nonvolatile rewritable storage medium, and includes user information for each user who uses the vehicle memory sharing system 100 and integrated memories transmitted from the in-vehicle device 1. Store information. This user DB 43 corresponds to the server-side storage unit described in the claims. The user information for each user is at least one of the vehicle ID of the vehicle owned by the user and the mobile ID of the mobile terminal 3 in addition to identification information (user ID) for distinguishing the user from other users. Includes one or the other.

  The user ID may be set manually or automatically when the user registers that the vehicle memory sharing system 100 is used. In this embodiment, the mobile ID of the mobile terminal 3 owned by the user is used. Or it shall be automatically set based on vehicle ID. Of course, the user ID may be arbitrarily settable by the user.

  The server-side control unit 41 is configured as a normal computer, and includes a well-known CPU, a nonvolatile memory such as a ROM and a flash memory, a volatile memory such as a RAM, an I / O, and a bus line that connects these configurations. (Not shown). The server-side control unit 41 performs various processes based on a program stored in the nonvolatile memory.

  More specifically, the server-side control unit 41 includes a reception processing unit F41, a data management unit F42, and a transmission processing unit F43 as functional blocks. The reception processing unit F41 acquires the signals transmitted from the in-vehicle device 1 and the portable terminal 3 via the wide area communication unit 42. That is, the reception processing unit F41 receives cooperation terminal information, integrated memory information, trip information, and the like from the in-vehicle device 1. As described above, the information transmitted from the in-vehicle device 1 to the server 4 includes the vehicle ID of the in-vehicle device 1 or information for specifying the vehicle ID. The reception processing unit F41 corresponds to the server-side reception processing unit described in the claims.

  The data management unit F42 stores the linked terminal information, the integrated memory information, and the trip information received from the in-vehicle device 1 in association with the vehicle ID set in the in-vehicle device 1. More specifically, based on the linked terminal information, the mobile terminal and the in-vehicle device 1 that are associated with the in-vehicle device 1 in this trip are managed as one group. Then, the integrated memory information and trip information received from the in-vehicle device 1 belonging to the group are stored in association with the group.

  That is, for each trip, the data management unit F42 manages the integrated memory information, the trip information, and the members accompanying the trip. The data management unit F42 corresponds to the server-side memory information management unit described in the claims.

  The transmission processing unit F43 distributes the integrated memory information to the cooperation terminal 3 via the wide area communication unit 42. In addition, the transmission process part F43 may distribute the browsing information to the cooperation terminal 3 as another aspect. The transmission processing unit F43 corresponds to the memory information distribution unit and the server-side transmission processing unit described in the claims.

(In-vehicle device side processing)
Hereinafter, the process (referred to as in-vehicle apparatus side processing) performed by the in-vehicle apparatus side control unit 11 during the trip will be described with reference to the flowchart shown in FIG. The flowchart in FIG. 7 is started when the IG power source is turned on as an example.

  First, in step S10, departure related processing is performed, and the process proceeds to step S20. This departure related process will be described separately using the flowchart shown in FIG.

  The flowchart in FIG. 8 is executed when the process proceeds to step S10 in FIG. In step S11, it is determined whether or not the current user operation to turn on the IG power supply is an operation in the case of returning from the stopped state. Here, the stop-by state means a state where the user stops at a point other than the destination (that is, a stop-off point). In other words, the return from the stop state means that the user has finished the business at the stop point and has resumed the movement in the vehicle. Whether or not it is a return from the stop state is determined based on a stop state flag set during a parking-related process described later. The stop state flag is set to ON when parked at a point other than the destination, and set to OFF when parked at the destination. Note that the drop-in state flag is stored in the internal memory 111, and the set value is retained while the IG power supply is off.

  If the current user operation to turn on the IG power supply is an operation when returning from the stopped state, that is, if the stopped state flag is turned on, step S11 becomes YES and step S12 is performed. Move. On the other hand, when the user operation to turn on the IG power supply this time is not an operation when returning from the stop-by state, that is, when the stop-state flag is off, step S11 becomes NO and the process proceeds to step S14. Move.

  In step S12, the memory information extraction unit F7 performs a memory information extraction process, and proceeds to step S13. More specifically, the memory information extraction unit F7 inquires of the cooperation terminal 3 whether there is mobile-side memory information to be transmitted to the in-vehicle device 1. And when the cooperation terminal 3 is provided with the portable memory information which should be transmitted to the vehicle equipment 1, the corresponding portable memory information is extracted from the portable memory 37. This memory information extraction process is sequentially performed on all the linked terminals 3. That is, by carrying out this memory information extraction process, mobile-side memory information such as photos and videos taken by the user while staying at this stop-off point is collected in the in-vehicle device 1.

  In step S <b> 13, the mobile-side memory information acquired from each link terminal 3 is stored in the in-vehicle device-side storage unit 17 as memory information at the stop-off point, grouped into one group. For example, the mobile-side memory information acquired from each cooperation terminal 3 may be grouped by being tagged with the location name of the stop-off location, or may be stored together in a dedicated folder. The memory information at the stop point is stored with information such as the location information and time of the stop point. When the process in step S13 is completed, the departure-related process ends, and the process proceeds to step S20 in FIG.

  In step S14, trip information such as the departure point, departure time, and destination is acquired from the navigation device 19, and the process proceeds to step S20 in FIG. In addition, what is necessary is just to acquire trip information which cannot be acquired at the time of departure, such as a travel locus, a stop point, and arrival time, at any time during the subsequent travel.

  In step S20, a cooperation terminal acquisition process is implemented and it moves to step S30. This linked terminal acquisition process will be described separately using the flowchart shown in FIG.

  The flowchart in FIG. 9 is executed when the process proceeds to step S20 in FIG. In step S21, it is determined whether a registration request has been received. Here, when the registration request is received, step S21 becomes YES and moves to step S22. On the other hand, when the registration request has not been received, step S21 is NO and this flow is ended, and the process proceeds to step S30 in the flowchart shown in FIG.

  In step S22, the mobile terminal 3 that has transmitted the registration request, that is, the mobile terminal 3 that cooperates with the in-vehicle device 1 is specified from the mobile ID included in the registration request. And portable ID of cooperation terminal 3 is matched with trip information, and is stored in in-vehicle machine side storage part 17. When the process in step S22 is completed, this flow is terminated, and the process proceeds to step S30 in FIG.

  In step S30, the in-vehicle device side memory information acquisition process is performed, and the process proceeds to step S40. This in-vehicle device side memory information acquisition process will be described separately using the flowchart shown in FIG.

  The flowchart in FIG. 10 is executed when the process proceeds to step S30 in FIG. In step S31, the in-vehicle camera data storage processing unit F61 determines whether or not the user's excitement is detected by the voice recognition device 16. If the user's excitement is detected by the voice recognition device 16, step S31 is YES and the process proceeds to step S32. On the other hand, when the user's excitement is not detected by the voice recognition device 16, step S31 is NO and the process proceeds to step S33.

  In step S32, the in-vehicle camera data storage processing unit F61 associates the video imaged by the in-vehicle camera 12 from one minute before to four minutes after the climax is detected as one moving image file with the position information. And save. Of course, the length of the video recording time stored here may be set as appropriate. When the storage process in step S32 is started, the process proceeds to step S33. The storage process started in step S34 automatically ends at a timing when a predetermined time (four minutes in this case) has elapsed from the time when the excitement is detected.

  In the present embodiment, the voice recognition device 16 detects the excitement of the users based on the result of the voice recognition process, but the present invention is not limited to this. As another aspect, the climax may be detected by performing a known image recognition process on the video signal captured by the in-vehicle camera 12. For example, it may be determined that the users are excited when the smiles of the users are detected by performing an image recognition process on the video captured by the in-vehicle camera 12. Further, the user's excitement may be detected by combining the voice recognition process and the image recognition process as described above.

  As a result of the speech recognition process, when the excitement is detected, and the user's utterance content includes a word reminiscent of a preset landscape such as the sea, river, mountain, landscape, beautiful The video taken by the vehicle camera 13 may be stored.

  In step S33, the in-vehicle camera data storage processing unit F61 determines whether or not the photographing switch 14 has been pressed by the user. If the photographing switch 14 is pressed by the user, step S33 becomes YES and the process moves to step S34. On the other hand, when the photographing switch 14 is pressed by the user, step S33 is NO and the process proceeds to step S35.

  In step S <b> 34, the in-vehicle camera data storage processing unit F <b> 61 sends the video signal input from the in-vehicle camera 12 or the in-vehicle camera 13 to the in-vehicle device side storage unit 17 for a predetermined time from when the user turns on the photographing switch 14. Store. As described above, the vehicle-mounted camera that is the acquisition source of the video to be stored is a vehicle-mounted camera that corresponds to the shooting switch 14 pressed by the user.

  For example, when the shooting switch 14 corresponding to the external camera 13 is pressed by the user, the video captured by the external camera 13 is stored as a moving image file. In the case where a plurality of front cameras, left side cameras, right side cameras, and the like are provided as the external cameras 13, and the photographing switch 14 includes switches corresponding to the respective external cameras 13. In addition, among the external cameras 13, an image captured by the external camera 13 (for example, the left side camera) corresponding to the switch pressed by the user is stored as a moving image file.

  In the present embodiment, the means for accepting a shooting instruction by the user is realized by the mechanical shooting switch 14, but is not limited thereto. A voice command for instructing to save a video shot by the in-vehicle camera may be registered in the voice recognition device 16, and the shooting instruction may be executed by speaking the voice command. That is, the voice recognition device 16 may be used in place of the shooting switch 14.

  When the storage process in step S34 is started, the process proceeds to step S35. Note that the storage process started in step S34 automatically ends at a timing when a predetermined time has elapsed since the photographing switch 14 was pressed.

  In step S35, the audio information storage processing unit F62 stores the audio information acquired by the audio information acquisition unit F2 in association with the position information, and proceeds to step S40 of the flowchart shown in FIG.

  In step S40, the traveling state determination unit F3 determines whether or not the host vehicle is parked. If it is determined that the host vehicle is parked, step S40 becomes YES and the process moves to step S50. On the other hand, if it is not determined that the host vehicle is parked, step S40 is NO and the process proceeds to step S20. That is, step S20 to step S40 are repeated until it is determined that the host vehicle has departed and has been parked.

  In step S50, a parking related process is implemented and it moves to step S60. This parking-related process will be described separately using the flowchart shown in FIG.

  The flowchart in FIG. 11 is executed when the process proceeds to step S50 in FIG. In step S51, it is determined whether or not the destination has been reached. Here, not only when the current position and the destination completely match, but also when the current position is within a predetermined range of the destination (for example, within 500 m), it is determined that the destination has been reached. And when it has arrived at the destination, step S51 becomes YES and moves to step S53. On the other hand, when it has not arrived at the destination, step S51 becomes NO and moves to step S52. In addition, having parked other than the destination means having stopped at a point other than the destination.

  In step S52, the fact that the vehicle is in the stopped state is held as an internal state, the present flow is ended, and the process proceeds to step S60 in FIG. In the present embodiment, by setting the stop state flag to ON, the fact that it is a stop state is held as an internal state. The drop-in state flag is stored in a non-volatile memory included in the internal memory 111 and is retained even when the IG power supply is turned off.

  In step S53, the wide area communication processing unit F8 transmits the cooperative terminal information to the server 4 and proceeds to step S54. In step S54, trip information is transmitted to the server 4 and the process proceeds to step S55. At this time, it is assumed that the elements as trip information are complete. As described above, the element as trip information corresponds to the departure place, departure time, drop-in point, destination, arrival time, travel locus information, and the like. In the present embodiment, the trip information is provided as described above, but is not limited thereto. The trip information only needs to include at least the destination and the travel locus.

  In step S54, the integrated memory information is transmitted to the server 4. When the transmission process is completed, this flow is finished and the process proceeds to step S60 in FIG.

  In step S60, the IG power supply is turned off, and the power supply of the vehicle-mounted device 1 is shut off. In addition, even if it is the structure which determines with the driving | running | working state determination part F3 having parked the own vehicle when user operation which turns off IG power is performed, until the transmission process in step S54 is completed, vehicle equipment The power supply to the side control unit 11 and the wide area communication unit 21 is maintained. For example, power may be supplied to the in-vehicle device side control unit 11 and the wide area communication unit 21 by maintaining the IG power supply in an on state until the transmission process of the integrated memory information is completed. Moreover, you may maintain the electric power supply to the vehicle equipment side control part 11 and the wide area communication part 21 with a battery power supply. When the power shutdown is completed in step S60, this flow is finished.

(Summary of Embodiment 1)
In the above configuration, the in-vehicle device 1 transmits information on the mobile terminal 3 that cooperates with the in-vehicle device 1 in a certain trip (that is, cooperation terminal information) and trip information of the trip to the server 4. The in-vehicle device 1 also converts the mobile-side memory information generated by the cooperation terminal 3 during the trip and the integrated memory information that summarizes the in-vehicle device-side memory information generated by the in-vehicle device 1 into the trip information and the cooperation terminal information. Is transmitted to the server 4 so as to correspond.

  The server 4 specifies the mobile terminal 3 that cooperates with the in-vehicle device 1 in the trip based on the cooperation terminal information received from the in-vehicle device 1. And the server 4 will distribute integrated memory information with respect to each of the portable terminal 3 which cooperated with the vehicle equipment 1 in the trip, if the integrated memory information is received from the vehicle equipment 1.

  Here, the portable terminal 3 linked with the vehicle-mounted device 1 means the portable terminal 3 owned by the member who accompanied the trip. That is, the server 4 distributes the integrated memory information in a certain trip to the mobile terminals 3 of the members accompanying the trip.

  In other words, according to the above configuration, there is no need to select an online storage server for storing memory information by any of the members accompanying the trip as in the past, and for saving the URL and file. There is no need to send passwords to other members. Furthermore, it is not necessary for each member to perform an operation for storing the memory information in the online storage.

  Therefore, according to the above configuration, memory information can be shared more easily among members who have traveled together.

  In addition, in this embodiment, it was set as the structure which performs a cooperation terminal acquisition process sequentially during driving | running | working in order to consider the following situations. That is, a known mobile terminal functions as the mobile terminal 3 of the system 100 for sharing memories when the above-described application is activated. However, when the user gets on the vehicle, the application is not always activated on the portable terminal carried by the user. The application may be activated after the start of traveling such as waiting for a signal.

  Therefore, in the present embodiment, the cooperation terminal acquisition process is performed from the time of departure until the arrival. As a result, the user of the mobile terminal can operate the mobile terminal owned by the user at any time (starting up an application or the like) to link with the in-vehicle device 1.

  As mentioned above, although Embodiment 1 of this invention was demonstrated, this invention is not limited to the above-mentioned embodiment, The modified example described below is also contained in the technical scope of this invention, and also in addition to the following Various modifications can be made without departing from the scope of the invention.

  For example, in the first embodiment described above, the vehicle-mounted device 1 is configured to transmit the integrated memory information collected during the trip to the server 4 at the timing when it arrives at the destination, but this is not a limitation. The in-vehicle device 1 may be configured to sequentially transmit to the server 4 each time the in-vehicle device side memory information acquisition unit F6 and the memory information extraction unit F7 acquire memory information. And the server 4 is good also as a structure which collects the memory information in the said trip by collectively managing the memory information transmitted from the vehicle equipment 1 for every vehicle ID.

  In such a configuration, a part or all of the memory information in the current trip can be transmitted to the server 4 until the host vehicle arrives at the destination. As a result, the time required for transmitting the memory information to the server 4 after arrival at the destination (step S55 in FIG. 11) can be shortened or omitted. That is, it is possible to shorten the time from the arrival at the destination until the power is turned off in step S60.

  In Embodiment 1 described above, the memory information extraction unit F7 extracts the mobile-side memory information from the cooperation terminal 3 when returning from the stop-by state. However, the present invention is not limited to this. The memory information extraction process (step S12 in FIG. 8) may be performed sequentially during traveling. According to such a configuration, the vehicle-mounted device 1 can also collect photographs and videos taken by the user other than the driver with the cooperation terminal 3 during traveling.

  Furthermore, in Embodiment 1 mentioned above, in-vehicle cameras such as the in-vehicle camera 12 and the in-vehicle camera 13 output video signals, and the in-vehicle camera data storage processing unit F61 uses the video signals output from the in-vehicle camera as moving image files. Although it was set as the structure preserve | saved, it is not restricted to this.

  The in-vehicle camera data storage processing unit F61 may generate and store a still image (that is, a photograph) based on a video signal captured by the in-vehicle camera. When the in-vehicle camera outputs still image data, the in-vehicle camera data storage processing unit F61 may store the image data output from the in-vehicle camera. The in-vehicle camera may switch and output a video signal and a still image based on a user operation.

  In addition, when the user logs in to a web site for enjoying the service provided by the server 4 (referred to as a memory sharing service), the server 4 can browse the integrated memory information of the trip that the user has accompanied. Also good. According to such a configuration, the integrated memory situation can be browsed even by a computer other than the portable terminal 3 (for example, a home computer).

  Moreover, although it was set as the structure provided with both the vehicle equipment 1 and the portable terminal 3 with the function which acquires memory information above, it is not restricted to this. The function for acquiring the memory information may be provided in at least one of the in-vehicle device 1 and the portable terminal 3.

  Furthermore, although the vehicle equipment 1 is provided with the wide area communication part 21 and set it as the structure which transmits various data to the server 4 via this wide area communication part 21, it is not restricted to this. Instead of the wide area communication unit 21, various data may be transmitted to the server 4 via the wide area communication unit 38 included in one of the cooperation terminals 3. In the case of such a configuration, the wide area communication unit 21 of the in-vehicle device 1 can be omitted.

<Embodiment 2>
In the first embodiment described above, the mobile terminal 3 provides the mobile-side memory information to the in-vehicle device 1 that is linked, and the in-vehicle device 1 aggregates the in-vehicle device-side memory information and the mobile-side memory information (that is, integrated memory information). As) to be transmitted to the server 4. However, the mobile-side memory information may be transmitted directly from the mobile terminal 3 to the server 4 without going through the in-vehicle device 1. With such a configuration as a second embodiment, the operation of the vehicle memory sharing system 100A according to the second embodiment will be described with reference to FIGS. 12 and 13.

  The vehicle memory sharing system 100A according to the second embodiment includes an in-vehicle device 1, a portable terminal 3, and a server 4 as in the first embodiment, for example, as illustrated in FIG. For convenience, members having the same functions as those shown in the drawings used in the description of the first embodiment are given the same reference numerals, and descriptions thereof are omitted. Further, when only a part of the configuration is described, the first embodiment described above can be applied to the other parts of the configuration.

  The functions of the in-vehicle device 1, the mobile terminal 3, and the server 4 are mainly the same as those in the first embodiment. However, the in-vehicle device side control unit 11 does not need to include the memory information extraction unit F7.

  FIG. 12 is a conceptual diagram for explaining the operation of the in-vehicle device 1, the cooperation terminal 3, and the server 4 during a trip. The in-vehicle device 1 transmits trip information to the server 4 and, when the cooperation terminal specifying unit F5 acquires the mobile ID of the cooperation terminal 3, transmits information indicating the mobile ID to the server 4. The transmission of such information is not limited to the timing of arrival at the destination, but may be performed at any time (for example, sequentially). Therefore, the server 4 sequentially acquires the mobile ID (that is, the linked terminal information) and the trip information of the mobile terminal 3 that is linked to the vehicle-mounted device 1 in this trip. The in-vehicle device 1 sequentially transmits the in-vehicle device-side memory information acquired by the in-vehicle device-side memory information acquisition unit F6 to the server 4 in association with the vehicle ID of the in-vehicle device 1.

  The cooperative terminal 3 sequentially transmits the portable memory information acquired by the portable memory information acquisition unit F36 to the server 4 in association with the portable ID of the cooperative terminal 3. It is assumed that position information at the time when the mobile-side memory information is acquired is added to the mobile-side memory information.

  When the server 4 receives the in-vehicle device-side memory information or the mobile-side memory information, the memory 4 as the memory information for each trip is based on the vehicle ID and the mobile ID added to the received memory information as in the first embodiment. Centralize and manage.

  FIG. 13 is a conceptual diagram for explaining the operations of the vehicle-mounted device 1, the cooperation terminal 3, and the server 4 when the host vehicle arrives at the destination. When determining that the host vehicle has arrived at the destination, the vehicle-mounted device 1 transmits a trip end notification indicating that the current trip has ended to the server 4. Here, the determination of whether or not the host vehicle has arrived at the destination may be performed in the same manner as in step S51 of the parking-related process shown in FIG.

  The server 4 that has received the trip end notification from the in-vehicle device 1 groups the memory information acquired from the in-vehicle device 1 and the cooperation terminal 3 by that time as integrated memory information in the current trip. And based on the cooperation terminal information and vehicle ID which were received from the vehicle equipment 1 during the trip, the member who accompanied the trip is specified and the user information of each member and integrated memory information are matched. When the association process is completed, the integrated memory information or the browsing information of the integrated memory information is distributed to the mobile terminal 3 of each user.

  Even in such a configuration, the same effects as those of the first embodiment can be obtained. On-vehicle device-side memory information is transmitted from the on-vehicle device 1 to the server 4, while portable-side memory information is transmitted directly to the server 4 from the portable terminal 3 that acquired the portable-side memory information. That is, each data that becomes memory information in the current trip is transmitted to the server 4 through a plurality of communication paths. Therefore, even when the size of the data indicating the memory information is large, the time required for transmitting the memory information to the server 4 can be shortened as compared with the configuration of the first embodiment.

<Embodiment 3>
In the above description, the configuration in which the vehicle memory sharing system 100 includes the server 4 is illustrated, but the present invention is not limited thereto. That is, the vehicle memory sharing system may not include the server 4. Such a configuration is referred to as Embodiment 3, and the operation of the vehicle memory sharing system 100B according to Embodiment 3 will be described with reference to FIG.

  Embodiment 3 is provided with the vehicle equipment 1 and the at least 1 portable terminal 3, as shown in FIG. For convenience, members having the same functions as those shown in the drawings used in the description of the first embodiment are given the same reference numerals, and descriptions thereof are omitted. Further, when only a part of the configuration is described, the first embodiment described above can be applied to the other parts of the configuration.

  The functions of the in-vehicle device 1 and the mobile terminal 3 are mainly the same as those in the first embodiment. However, the in-vehicle device side control unit 11 does not need to include the wide area communication processing unit F8. Moreover, the vehicle equipment 1 in Embodiment 3 is provided with the memory information collection part F9 as a functional block which collects memory information. The memory information collecting unit F9 includes both the functions of the in-vehicle device side memory information acquiring unit F6 and the memory information extracting unit F7 described in the first embodiment. That is, the memory information collecting unit F9 collects memory information on the trip by collecting the in-vehicle device side memory information and extracting the mobile side memory information from the cooperation terminal 3. In the third embodiment, the memory information collection unit F9 corresponds to an example of a memory acquisition unit described in the claims.

  And the vehicle interior communication process part F4 delivers integrated memory information to each cooperation terminal 3 at the timing which the own vehicle arrived at the destination, for example. Therefore, in the third embodiment, the vehicle interior communication processing unit F4 corresponds to the memory information distribution unit described in the claims. Further, the narrow area communication processing unit F34 of the mobile terminal 3 receives the integrated memory information distributed from the in-vehicle device 1. That is, the narrow area communication processing unit F34 corresponds to the memory information receiving unit described in the claims.

  Note that, as described in the modification of the first embodiment, each linked terminal 3 may be configured to deliver difference data obtained by subtracting the mobile-side memory information generated by the linked terminal 3 from the integrated memory information.

  In addition, the timing at which the vehicle interior communication processing unit F4 delivers various kinds of memory information to the cooperation terminal 3 is not limited to the timing at which the vehicle arrives at the destination. For example, the vehicle interior communication processing unit F4 may distribute the in-vehicle device side memory information to the cooperation terminal 3 every time the in-vehicle device side memory information acquisition unit F6 acquires the in-vehicle device side memory information. Moreover, it is good also as a structure which delivers the portable side memory information to the other cooperation terminal 3, whenever the memory information extraction part F7 extracts portable side memory information from one of the some cooperation terminals 3. FIG.

  Even in the configuration as described above, the same effects as those of the first embodiment can be obtained. In the third embodiment, as an example, the memory information collecting unit F9 has the functions of both the in-vehicle device side memory information acquiring unit F6 and the memory information extracting unit F7 described in the first embodiment. Not exclusively. It is good also as a structure provided with either one of the vehicle equipment side memory information acquisition part F6 and the memory information extraction part F7.

<Modification 1>
In the vehicle memory sharing system 100 according to the first embodiment, when the in-vehicle device 1 extracts the mobile-side memory information from the mobile terminal 3 and transmits it to the server 4, the mobile terminal 3 performs the mobile-side memory information as in the second embodiment. It is good also as a structure which can implement by switching suitably the case where it transmits to the server 4 directly.

  For example, in the first embodiment, the memory information extraction unit F7 inquires whether there is memory information to be transmitted to the cooperation terminal 3, and obtains a response from the cooperation terminal 3 that there is memory information to be transmitted. The size of the data is also acquired at the same time. If the data size is equal to or greater than a predetermined threshold value, an instruction is given to directly or partially transmit the data from the portable terminal 3 to the server 4.

  On the other hand, based on an instruction from the in-vehicle device 1, the mobile terminal 3 transmits a part or all of the data to be transmitted to the in-vehicle device 1 directly to the server 4 in association with the mobile ID.

  In other words, in the configuration of the first modification, an upper limit is set for the amount of data corresponding to the mobile-side memory information extracted from the mobile terminal 3. For example, data exceeding the upper limit is directly transmitted from the mobile terminal 3 to the server 4. To send to.

  According to the above configuration, in the configuration in which the vehicle-mounted device 1 includes the memory information extraction unit F7 as in the first embodiment, the mobile-side memory information can be transmitted to the server 4 more smoothly. More specifically, it is as follows. That is, the size of the data to be extracted in the memory information extraction process depends on the data size of the memory information generated by each user on the mobile terminal 3 at the stop-off point. Therefore, when a large amount of memory information is generated at the stop point, the amount of data to be extracted in the memory information extraction process also increases.

  In this case, the time required for the memory information extraction process also increases. The in-vehicle device 1 transmits the data extracted from the cooperation terminal 3 sequentially or collectively to the server 4. When the size of the data extracted from the cooperation terminal 3 is large, the data is transmitted to the server 4. The time required for this also increases.

  Therefore, a configuration in which the portable terminal 3 directly transmits the mobile-side memory information to the server 4 and the case where the in-vehicle device 1 extracts the mobile-side memory information and transmits it to the server 4 can be used together. The memory information can be transmitted to the server 4 more smoothly.

100 / 100A / 100B Memories sharing system for vehicle, 1 vehicle-mounted device, 11 vehicle-mounted device side control unit, F4 vehicle interior communication processing unit (memory information distribution unit, vehicle-mounted device side mobile terminal communication processing unit), F5 linked terminal specifying unit, F6 vehicle-mounted device side memory information acquisition unit (memory information acquisition unit), F61 vehicle-mounted camera data storage processing unit, F62 audio information storage processing unit, F7 memory information extraction unit, F8 wide area communication processing unit (vehicle-device side server communication processing unit) , F9 Memory information collection unit (memory information acquisition unit), 3 mobile terminal, 31 mobile side control unit, 35 mobile side camera, F34 narrow area communication processing unit (mobile side in-vehicle device communication processing unit, memory information receiving unit), F35 In-vehicle device cooperation processing unit, F36 mobile memory information acquisition unit (memory information acquisition unit), F37 wide area communication processing unit (mobile server communication processing unit, memory information) Receiving part), 4 server, 41 server side control part, 43 user database (server side storage part), F41 reception processing part (server side reception processing part), F42 data management part (server side memory information management part), F43 transmission Processing unit (memory information distribution unit, server side transmission processing unit)

Claims (12)

A vehicle memory sharing system comprising at least one portable terminal (3) carried by a user and an in-vehicle device (1) mounted on the vehicle,
The in-vehicle device includes a cooperation terminal specifying unit (F5) that is brought into the vehicle by the user and specifies the portable terminal that cooperates with the in-vehicle device.
At least one of the in-vehicle device and the mobile terminal includes a memory information acquisition unit (F6, F36, F9) that acquires memory information representing memories during travel in the vehicle,
The vehicle memory sharing system includes:
Memories information distribution for distributing the memory information acquired by the memory information acquisition unit or browsing information for the user of the mobile terminal to browse the memory information to the mobile terminal specified by the cooperation terminal specifying unit Part (F43, F4), The memory sharing system for vehicles characterized by the above-mentioned. In claim 1,
The vehicle memory sharing system includes a server (4) provided outside the vehicle,
The in-vehicle device is
An in-vehicle device side server communication processing unit (F8) for performing communication with the server;
The onboard device side server communication processing unit transmits linked terminal information, which is information of the mobile terminal specified by the linked terminal specifying unit, to the server,
The server
A server side reception processing unit (F41) for receiving the cooperation terminal information transmitted by the in-vehicle device side server communication processing unit;
The server side that stores the memory information acquired by the memory information acquisition unit in the server-side storage unit (43) in association with the information of the mobile terminal linked to the in-vehicle device based on the linkage terminal information Memory information management part (F42),
A server side transmission processing unit (F43) that communicates with the portable terminal and operates as the memory information distribution unit,
The server-side transmission processing unit distributes the memory information stored in the server-side storage unit or the browsing information of the memory information to the mobile terminal linked to the in-vehicle device. Memories sharing system for vehicles. In claim 2,
The in-vehicle device is
The vehicle-mounted device side memory information acquisition unit (F6) that operates as the memory information acquisition unit,
The onboard device side server communication processing unit transmits the memory information acquired by the onboard device side memory information acquisition unit to the server,
The server side reception processing unit receives the memory information transmitted by the in-vehicle device side server communication processing unit,
The server-side memory information management unit associates the mobile terminal linked to the vehicle-mounted device and the vehicle-mounted device in a current trip as a group based on the cooperation terminal information, and the server-side reception process. A memory sharing system for a vehicle, wherein the memory stores the memory information received from the in-vehicle device as memory information of the group. In claim 3,
The in-vehicle device includes, as an in-vehicle camera, at least one of an in-vehicle camera (13) whose imaging range is a predetermined range outside the vehicle and an in-vehicle camera (12) whose imaging range is a predetermined range inside the vehicle interior,
The vehicle-mounted device-side memory information acquisition unit acquires a photograph or a video generated by the vehicle-mounted camera as the memory information. In claim 4,
The in-vehicle device includes a voice recognition device (16) that acquires voice of an occupant of the vehicle and performs voice recognition processing on the voice.
The in-vehicle device-side memory information acquisition unit detects a photograph or a video generated by the in-vehicle camera when the swell of an occupant in the vehicle is detected based on a result of a voice recognition process performed by the voice recognition device. A vehicle memory sharing system characterized in that it is acquired as information. In any one of Claim 3 to 5,
The portable terminal is
A mobile-side memory information acquisition unit (F36) that operates as the memory information acquisition unit, acquires a photo or video captured by the mobile-side camera (35) that captures a photo or video based on a user operation, and the memory information acquisition unit;
A mobile-side in-vehicle device communication processing unit (F34) that communicates with the in-vehicle device,
The in-vehicle device is
A vehicle-mounted device-side mobile terminal communication processing unit (F4) that communicates with the mobile terminal via the mobile-side vehicle-mounted device communication processing unit;
A memory information extraction unit (F7) for extracting the memory information acquired by the mobile-side memory information acquisition unit of the mobile terminal from the mobile terminal via the vehicle-mounted device-side mobile terminal communication processing unit;
The vehicle-mounted device side server communication processing unit transmits the memory information extracted by the memory information extraction unit to the server, the vehicle memory sharing system according to claim 1. In claim 6,
The mobile terminal includes a mobile server communication processing unit (F37) that transmits the memory information acquired by the mobile memory information acquisition unit to the server,
The server side reception processing unit receives the memory information transmitted by the mobile server communication processing unit,
The memory information extraction unit obtains the size of data corresponding to the memory information to be extracted from the mobile terminal, and when the data size is equal to or larger than a predetermined threshold, part or all of the data Is transmitted from the mobile terminal to the server,
When the portable server communication processing unit receives the instruction from the in-vehicle device, the portable server memory processing unit transmits the memory information acquired by the portable memory information acquisition unit to the server,
The server-side memory information management unit
Based on the cooperation terminal information, the mobile terminal and the in-vehicle device that are associated with the in-vehicle device in this trip are associated as a group, and the server-side reception processing unit includes the in-vehicle device and the in-vehicle device belonging to the group. The vehicle memory sharing system, wherein the memory information received from the mobile terminal is managed as memory information of the group. In any one of Claim 2 to 5,
The portable terminal is
A mobile-side memory information acquisition unit (F36) that operates as the memory information acquisition unit, acquires a photo or a video generated by the mobile side camera (35) that takes a photo based on a user operation as the memory information;
A mobile-side server communication processing unit (F37) communicating with the server,
The mobile server communication processing unit transmits the memory information acquired by the mobile memory information acquisition unit to the server,
The server side reception processing unit receives the memory information transmitted by the mobile server communication processing unit,
The server-side memory information management unit
Based on the cooperation terminal information, the mobile terminal associated with the vehicle-mounted device in the current trip and the vehicle-mounted device are associated as a group, and the server-side reception processing unit is associated with the mobile terminal belonging to the group. A memory sharing system for vehicles, wherein the received memory information is stored as memory information of the group.   In Claim 1, the said vehicle equipment is provided with the said memory information acquisition part (F9) and the said memory information distribution part (F4), The memory sharing system for vehicles characterized by the above-mentioned. In any one of Claim 1 to 9,
The vehicle memory sharing system, wherein the memory information is associated with position information of a point where the memory information is acquired. An in-vehicle device used in a vehicle memory sharing system (100, 100A, 100B) including at least one portable terminal (3) carried by a user,
A cooperative terminal identifying unit (F5) that identifies the portable terminal that cooperates with the in-vehicle device;
A memory information acquisition unit (F6, F9) for acquiring memory information representing memories during travel in the vehicle;
Memory information distribution unit (F4, F8) for transmitting the memory information acquired by the memory information acquisition unit to the mobile terminal directly or via a server (4) provided outside the vehicle, An in-vehicle device characterized by comprising. Computer
An in-vehicle device cooperation processing unit (F35) that performs processing in cooperation with the in-vehicle device (1) mounted on the vehicle;
A memory sharing program for functioning as a memory information receiving unit (F34, F37) for receiving memory information representing memories during travel in the vehicle from the vehicle-mounted device or a server (4) provided outside the vehicle.

Images