JP2018038009A - Image output device and image output method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To reproduce the landscape of a spot which a moving object has passed through, in real time.SOLUTION: An image output device comprises a storage part, a detection part, and an output part. The storage part stores as image data the landscape of the environment of the moving body photographed by a photographing device during the travel of the moving body which transports passengers. The detection part detects reaction by the passengers during the travel of the moving body. The output part outputs image data corresponding to the detected reaction among the stored image data.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a video output device and a video output method.

  2. Description of the Related Art There is a known technique for capturing a scene in the outside world of a moving body such as a train or a passenger car and displaying the captured image. For example, a technique for reproducing past image data taken outside the vehicle according to the same angle of view, time, and vehicle position as a camera that acquires image data taken outside the vehicle in a train is known.

JP 2009-93076 A

  However, with the above technology, it is not possible to reproduce the scenery at a point where the moving body has passed in real time. For example, in the above technology, if you want to look back at a scene taken while driving and display it again, you will find the scene you want to look back from in the recorded video, so you can reproduce the scenery in real time. Cannot be done, and the burden on the user is large.

  In one aspect, an object of the present invention is to provide a video output device and a video output method capable of reproducing in real time a landscape at a point where a moving body has passed.

  In one aspect, the video output device includes a storage unit, a detection unit, and an output unit. The storage unit stores, as video data, an external landscape of the moving body that is captured by the imaging device while the moving body that transports the passenger is moving. The detection unit detects a reaction by the passenger while the moving body is moving. The output unit outputs video data corresponding to the detected reaction among the stored video data.

  According to one aspect, it is possible to reproduce the scenery at a point where the moving body has passed in real time.

FIG. 1 is a diagram illustrating an example of a moving object on which the video output apparatus according to the first embodiment is mounted. FIG. 2 is a diagram illustrating an example of a functional configuration according to the first embodiment. FIG. 3 is a diagram illustrating an example of the video DB according to the first embodiment. FIG. 4 is a diagram illustrating an example of the operation DB. FIG. 5 is a diagram illustrating an example of an image displayed on the vehicle window according to the first embodiment. FIG. 6 is a flowchart illustrating an example of a process flow according to the first embodiment. FIG. 7 is a diagram illustrating an example of a functional configuration according to the second embodiment. FIG. 8 is a diagram illustrating an example of the voice DB. FIG. 9 is a diagram illustrating an example of the landmark DB. FIG. 10 is a flowchart illustrating an example of a process flow according to the second embodiment. FIG. 11 is a diagram illustrating an example of an image displayed on the vehicle window according to the third embodiment. FIG. 12 is a diagram illustrating an example of a functional configuration according to the third embodiment. FIG. 13 is a diagram illustrating an example of the different time point image DB. FIG. 14 is a flowchart illustrating an example of a process flow according to the third embodiment. FIG. 15 is a diagram illustrating an example of a moving object on which the video output device according to the fourth embodiment is mounted. FIG. 16 is a diagram illustrating an example of a functional configuration according to the fourth embodiment. FIG. 17 is a diagram illustrating an example of a video DB according to the fourth embodiment. FIG. 18 is a flowchart illustrating an example of a process flow according to the fourth embodiment. FIG. 19 is a hardware configuration diagram illustrating an example of a computer that implements the functions of the video output apparatus.

  Hereinafter, embodiments of a video output device and a video output method disclosed in the present application will be described in detail with reference to the accompanying drawings. In addition, this invention is not limited by embodiment shown below.

[System configuration]
In the present embodiment, the video output device 100 is, for example, a computer, and is used by being mounted on a moving body or the like. FIG. 1 is a diagram illustrating an example of a moving object on which the video output apparatus according to the first embodiment is mounted. The video output device 100 according to the present embodiment records, for example, a video taken while the moving body is moving, and outputs the recorded video to a passenger of the moving body. Examples of the moving body include ships, airplanes and the like in addition to vehicles such as passenger cars, taxis and sightseeing buses, trains including trains and passenger cars. In the present embodiment, the description will be made assuming that the moving body is a vehicle that transports a passenger such as a passenger car.

  As shown in FIG. 1, a passenger car 1000 on which the video output device 100 is mounted is provided with a landscape photographing device 200, a motion photographing device 300, and a display device 500, and communicates with the video output device 100 in a wired or wireless manner. Connected as possible.

  The landscape photographing device 200 captures an image of the outside of the moving moving object and outputs the captured image data to the image output device 100. The image of the outside world is, for example, an image of a landscape that can be viewed through a car window from a moving body on which a passenger is moving. The landscape photographing device 200 is, for example, a digital video camera installed near the left and right car windows of the passenger car 1000.

  The motion image capturing device 300 captures the motion of the passenger on the moving moving object and outputs the captured image data to the image output device 100. The movement of the passenger is a change in the line of sight of the passenger, a change in facial expression, a hand movement, or the like. The motion imaging apparatus 300 is, for example, a digital video camera installed on a ceiling portion in the passenger car 1000.

  The display device 500 displays the video output from the video output device 100. The display device 500 is an output display device such as a liquid crystal display. In this embodiment, an example in which the display device 500 is a window of a passenger car 1000 will be described. However, the present invention is not limited to this, and a liquid crystal display device installed in front of a passenger's seat may be used. It may be a projector device that projects an image on a car window. Furthermore, the display device 500 may be a device that can detect that a passenger has touched the display device 500, such as a touch panel.

  For example, as shown in FIG. 1, the video output device 100 is installed at the rear of the passenger car 1000 and records video data acquired from the landscape photographing device 200. In addition, the video output device 100 detects the motion of the passenger using the video data acquired from the motion imaging device 300. Furthermore, the video output device 100 estimates a time zone or an object designated by the passenger based on the detected motion, and reads and outputs recorded video data corresponding to the estimated time zone or the object. . The said time slot | zone is a time slot | zone when the said target object was image | photographed with the landscape imaging device 200, ie, the time slot | zone when the said target object is recorded on the image | video.

  Note that the number of devices is not limited to the example shown in FIG. 1. For example, only one landscape photographing device 200 is mounted, or a plurality of motion photographing devices 300 are prepared for each passenger seat. May be. Each device is not limited to a dedicated device, and an existing drive recorder, in-vehicle display, car navigation system, or the like may be used. Each device is not limited to a stationary device, and may be a portable terminal such as a smartphone or a tablet.

  Further, the position where the video output device 100 in each embodiment is installed is not limited to the position shown in FIG. 1, and may be installed in any place inside and outside the passenger car 1000. Further, the video output device 100 may be installed at a remote place and connected to other devices via the Internet or the like.

[Function configuration]
Next, the functional configuration of the video output apparatus 100 will be described with reference to FIG. The video output device 100 includes a storage unit 120 and a control unit 130. The storage unit 120 stores programs and data used by the video output device 100. For example, the storage unit 120 is realized by a semiconductor memory device such as a RAM (Random Access Memory) or a flash memory, or a storage device such as a hard disk or an optical disk. In addition, the storage unit 120 appropriately stores information used for each process performed by the control unit 130.

  As illustrated in FIG. 2, the storage unit 120 includes a video DB 121 and an operation DB 122. The video DB 121 stores video captured by a moving moving body. FIG. 3 is a diagram illustrating an example of the video DB according to the first embodiment. As shown in FIG. 3, the video DB 121 stores “shooting date and time” and “file name” in association with each other. For example, it is recorded that a file whose file name is “XXXXXXX01.mp4” was taken at “2016/08/01 13:00:00”.

  The operation DB 122 stores a time zone or a target corresponding to the detected operation. FIG. 4 is a diagram illustrating an example of the operation DB. As illustrated in FIG. 4, the motion DB 122 stores time zones or objects corresponding to motions such as “look back” and “point finger”. In this embodiment, “change in line of sight”, “change in facial expression”, and the like are also included in “motion”.

  In this embodiment, as shown in FIG. 4, even when the operation is the same, the operation DB 122 stores different time zones or objects in association with each other when the speed and size of the operation are different. For example, in the operation DB 122 shown in FIG. 4, when the “return” operation is detected, if the turn-back speed is “less than 0.3 seconds”, the corresponding time point is “0.5” seconds ago. Remember. Similarly, the operation DB 122 illustrated in FIG. 4 stores that the corresponding time point is “3” seconds ago when the turning-back speed is “0.3 seconds or more”.

  Further, in the present embodiment, the operation DB 122 stores a coefficient to be multiplied by the time zone or the object according to the moving speed of the moving body carrying the passenger. For example, when it is detected that the passenger turns back “90 degrees or more” and the moving speed of the moving body is “X km / hour” or more, the motion DB 122 “0.7” in “2” seconds. It is memorized that it becomes “1.4” multiplied by.

  Next, each function of the control unit 130 will be described. For example, the control unit 130 is realized by a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or the like executing various programs stored in a storage device inside the video output device 100 using the RAM as a work area. Is done. The control unit 130 may be realized by an integrated circuit such as an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA).

  The control unit 130 includes a video recording unit 131, an operation detection unit 132, a video extraction unit 133, and a video output unit 134, and realizes or executes functions and operations of information processing described below. The internal configuration of the control unit 130 is not limited to the configuration illustrated in FIG. 2, and may be another configuration as long as the information processing described later is performed. In addition, the video recording unit 131, the operation detection unit 132, the video extraction unit 133, and the video output unit 134 are an example of an electronic circuit such as a processor or an example of a process executed by the processor.

  The video recording unit 131 is a processing unit that records a video taken from a moving moving body. For example, the video recording unit 131 acquires a video shot by the landscape shooting apparatus 200 and stores a video data file in the video DB 121 in association with the shooting time.

  The motion detection unit 132 is a processing unit that detects the motion of a passenger on the moving body. Note that, as described above, the motion detection unit 132 performs not only the movement of the passenger's hand, but also the passenger's “change in line of sight”, “change in facial expression”, touch on the display device 500, and the like. Detect together. The motion detection unit 132 can detect a line of sight, a facial expression, or a motion using, for example, a known image recognition technique. The motion detection unit 132 is an example of a detection unit.

  For example, the motion detection unit 132 extracts feature points such as eyes, nose or mouth from the face of the passenger included in the video data acquired from the motion imaging device 300, and the passenger's face is extracted according to the position of the feature point. Detect gaze direction or facial expression. Note that the motion detection unit 132 may be configured to detect the passenger's line-of-sight direction by specifying the direction of the passenger's eyeball and the like.

  In addition to the change in facial expression and line of sight, the motion detection unit 132 recognizes the position of the passenger's hand, for example, and detects the movement of the hand by the passenger such as pointing a finger. Furthermore, when the passenger touches a window that is the display device 500, the motion detection unit 132 detects the touched position. The motion detection unit 132 generates motion data related to the detected facial expression and line-of-sight change, as well as hand movement and window touch, and outputs the motion data to the video extraction unit 133.

  The video extraction unit 133 is a processing unit that extracts a video estimated from the detected motion. For example, if the video extraction unit 133 receives the output of the operation data from the operation detection unit 132 at the time of “13:00:10”, the video extraction unit 133 specifies the operation of the passenger corresponding to the operation data.

  When the identified motion of the occupant is identified as “pointing backward 120 ° or more”, the video extraction unit 133 refers to the motion DB 122 illustrated in FIG. 4 and the time corresponding to the motion data is “10”. ”Estimate that it is seconds ago. Then, the video extraction unit 133 extracts the video data file “XXXXXXX01.mp4” at the time “2016/08/01 13:00:00” that is 10 seconds before the time when the output of the operation data is received. Specified as video data.

  Note that the video extraction unit 133 identifies the extracted video data as storage target data. For example, the video extraction unit 133 copies the specified video data file to another storage device (not shown). In addition, the video extraction unit 133 excludes the file from the deletion target by associating a bookmark with the file of the video data. As a result, for example, a video data recorded by a video recording device in which the captured video data is deleted after a lapse of a certain time, such as a known drive recorder, does not delete the video data related to the noted landscape. Can be saved.

  The video output unit 134 is a processing unit that outputs the specified video data to the display device 500. For example, the video output unit 134 reads a video data file such as “XXXXXXX02.mp4” specified by the video extraction unit 133 from the video DB 121 and outputs the file to the display device 500. The video output unit 134 is an example of an output unit.

  An example of the video output by the video output unit 134 will be described with reference to FIG. FIG. 5 is a diagram illustrating an example of an image displayed on the vehicle window according to the first embodiment. In FIG. 5, a case will be described in which a passenger car 1000 carrying a passenger is moving in the traveling direction indicated by the arrow, and the current position is a point 3000.

  When the video output device 100 detects that the passenger turns around and determines that the angle turned back is less than 90 degrees, the video output device 100 refers to the action DB 122 and corresponds to the action “0.5 seconds ago”. The video data captured at the time 3001 is displayed on the display device 500. Further, when the video output device 100 detects that the passenger points back 120 degrees or more, the video output device 100 refers to the motion DB 122 and captures the video data captured at the time point 3010 “10 seconds before” corresponding to the motion. It is displayed on the display device 500.

[Process flow]
Next, the processing flow of the video output apparatus 100 in the present embodiment will be described with reference to FIG. FIG. 6 is a flowchart illustrating an example of a process flow according to the first embodiment. First, the video recording unit 131 outputs the video currently being shot input from the landscape photographing device 200 to the video output unit 134 and stores the video data in the video DB 121. The video output unit 134 causes the display device 500 to display the video output from the video recording unit 131 (step S101).

  Next, the motion detection unit 132 receives input of video data from the motion imaging apparatus 300, detects a passenger's motion, and outputs the motion data to the video extraction unit 133. The video extraction unit 133 that has received the operation data first determines whether or not a change in line of sight has been detected (step S111). If it is determined that a change in the line of sight of the passenger has been detected (step S111: Yes), the video extraction unit 133 proceeds to step S191.

  When it is determined that a change in line of sight has not been detected (step S111: No), the video extraction unit 133 determines whether a change in the passenger's facial expression has been detected (step S113). If it is determined that a change in the passenger's facial expression has been detected (step S113: Yes), the video extraction unit 133 proceeds to step S191.

  When it is determined that a change in facial expression has not been detected (step S113: No), the video extraction unit 133 determines whether movement of the passenger's hand has been detected (step S115). When it is determined that the movement of the passenger's hand has been detected (step S115: Yes), the video extraction unit 133 proceeds to step S191.

  When it is determined that the movement of the hand has not been detected (step S115: No), the video extraction unit 133 determines whether or not a touch on the screen by the passenger is detected in the display device 500 (step S117). . If it is determined that a touch on the screen has been detected (step S117: Yes), the video extraction unit 133 proceeds to step S191.

  In step S191, the video extraction unit 133 refers to the motion DB 122, and the time zone or target corresponding to the gaze change, facial expression change, hand movement, or screen touch detected in steps S111 to S117. Estimate things. Then, the video extraction unit 133 specifies video data corresponding to the estimated time zone or the object from the video DB 121 (step S191). The video output unit 134 reproduces the specified video by causing the display device 500 to display the specified video (step S193).

  Returning to step S117, when it is determined that the touch on the screen has not been detected (step S117: No), the video extraction unit 133 determines whether an instruction to end the process has been received from the passenger (step S161). ). If it is not determined that an instruction to end the process has been received (step S161: No), the process returns to step S101 and the process is repeated. If it is determined that an instruction to end the process has been received (step S161: Yes), the process ends.

  As described above, according to the present embodiment, the video output device 100 detects a reaction by the passenger while the moving body is moving, and estimates a time zone or an object corresponding to the detected reaction. In addition, the video output device 100 outputs a video corresponding to the estimated time zone or the target object from the external video stored in the storage unit. Accordingly, the passenger can easily look back in real time at the point where the passenger has passed without requiring a complicated operation.

  In addition, according to the present embodiment, it is possible to easily save a noticed landscape for video data shot by a video recording apparatus in which the shot video data is deleted after a lapse of a predetermined time.

  In the first embodiment, the configuration in which the video output device 100 outputs corresponding video data based on the movement of the passenger's line of sight, facial expression, hand movement, and the like has been described. However, the embodiment is not limited thereto. Absent. In the present embodiment, a configuration will be described in which the video output device outputs corresponding video data based on the sound emitted by the passenger.

[Function configuration]
First, the functional configuration of the video output apparatus 700 in this embodiment will be described with reference to FIG. FIG. 7 is a diagram illustrating an example of a functional configuration according to the second embodiment. In the following embodiment, the video DB 121, the video recording unit 131, the video output unit 134, the landscape photographing device 200, and the display device 500 perform the same processing as in the first embodiment, and thus detailed description thereof is omitted.

  The video output device 700 according to the present embodiment is mounted in, for example, a passenger car 1000 as in the first embodiment. The video output device 700 is communicably connected to the landscape photographing device 200, the sound acquisition device 400, and the display device 500 provided in the passenger car 1000.

  The sound acquisition device 400 acquires the sound of the passenger of the moving moving object, generates sound data, and outputs the sound data to the video output device 100. The passenger's voice is, for example, “Ah!”, “Eh!” Or other voices that indicate the surprise or excitement of the passenger, “That mountain”, “That bridge”, “That time”, “About 5 seconds ago”, etc. Contains wording indicating the object or point of the. The voice acquisition device 400 is, for example, a microphone installed on a ceiling portion in the passenger car 1000.

  Similar to the first embodiment, the video output device 700 is installed at the rear of the passenger car 1000 as shown in FIG. 1, for example, and records video data acquired from the landscape photographing device 200. The video output device 700 in the present embodiment detects the passenger's voice using the audio data acquired from the audio acquisition device 400. Further, the video output device 700 estimates a time zone or an object designated by the passenger based on the detected sound, reads out and outputs recorded video data corresponding to the estimated time zone or the object. .

  In the present embodiment, the video output device 700 includes a storage unit 720 and a control unit 730. The storage unit 720 stores programs and data used by the video output device 700. In addition, the storage unit 720 appropriately stores information used for each process performed by the control unit 730.

  As illustrated in FIG. 7, the storage unit 720 includes a video DB 121, an audio DB 723, and a landmark DB 724. The voice DB 723 stores a time zone or an object corresponding to the detected voice. FIG. 8 is a diagram illustrating an example of the voice DB. As illustrated in FIG. 8, the voice DB 723 stores “keyword” and “Rt (seconds)” in association with each other.

  In FIG. 8, “keyword” indicates a word extracted from the voice data, and “Rt” indicates a time that goes back from the time when the keyword corresponding to each keyword was detected. The keyword is, for example, a voice indicating a passenger's surprise or impression such as “Ah!” Or “Eh!” Or a word indicating a specific place such as “mountain” or “bridge”. For example, when the voice corresponding to the keyword “mountain” is detected, the voice DB 723 illustrated in FIG. 8 stores that the corresponding target is a mountain “captured within n seconds”. Also, the voice DB 723 illustrated in FIG. 8 stores, for example, that when a surprising voice corresponding to the keyword “Ah!” Is detected, the corresponding time point is “0.5 seconds ago”.

  Returning to FIG. 7, the landmark DB 724 stores landmarks to be noticed by the occupant in association with landmark categories, visible ranges, and related words. FIG. 9 is a diagram illustrating an example of the landmark DB. As illustrated in FIG. 9, the landmark DB 724 stores “landmark”, “category”, “viewable range”, and “related word” in association with each other.

  “Landmarks” in FIG. 9 are objects to be noticed by passengers, and are classified into “categories” such as mountains, towers, and stores. “Visible range” indicates a range in which the landmark can be visually recognized. As shown in FIG. 9, for example, a landmark as large as a mountain can be viewed from a distance, so that the visible range is wide, and conversely, the visible range is narrow for a store or the like. “Related word” refers to a word corresponding to a landmark, and when a voice included in the related word is detected, the corresponding landmark is specified. For example, with respect to the landmark "~~ cafe", not only the word "cafe" but also words such as "Mise" and "Kissaten" are the objects for specifying the landmark.

  Next, each function of the control unit 730 will be described. For example, the control unit 730 is realized by executing various programs stored in a storage device inside the video output apparatus 100 using the RAM as a work area by a CPU, an MPU, or the like. The control unit 730 may be realized by an integrated circuit such as an ASIC or FPGA.

  The control unit 730 includes a video recording unit 131, a video extraction unit 733, a video output unit 134, and an audio detection unit 735, and realizes or executes information processing functions and operations described below. Note that the internal configuration of the control unit 730 is not limited to the configuration illustrated in FIG. 7, and may be another configuration as long as the information processing described below is performed. The video extraction unit 733 and the audio detection unit 735 are an example of an electronic circuit such as a processor or an example of a process executed by the processor.

  The voice detection unit 735 is a processing unit that detects the voice of the passenger of the moving body. For example, the voice detection unit 735 acquires voice data from the voice acquisition device 400 and extracts speech data from the acquired voice data. Here, it is assumed that the utterance data is, for example, a character string representing the content uttered by the passenger. The voice detection unit 735 can extract utterance data included in the acquired voice data by using, for example, a known voice recognition technique. The voice detection unit 735 is an example of a detection unit.

  Specifically, the voice detection unit 735 determines whether or not the extracted utterance data matches a keyword stored in the voice DB 723. If the speech detection unit 735 determines that the utterance data matches a keyword such as “Ah!” Or “Slightly before”, the speech detection unit 735 outputs the utterance data to the video extraction unit 733.

  Further, the voice detection unit 735 determines whether or not the extracted utterance data matches a related word stored in the landmark DB 724. If the speech detection unit 735 determines that the speech data matches a related word such as “Yama” or “Mise”, the speech detection unit 735 outputs the speech data to the video extraction unit 733.

  In the present embodiment, the video extraction unit 733 is a processing unit that extracts a video estimated from the output speech data. For example, when the video extraction unit 733 receives the output of the utterance data from the voice detection unit 735, the video extraction unit 733 refers to the voice DB 723, estimates the time zone or the point corresponding to the output utterance data, and the estimated time zone or the point Is specified and output to the video output unit 134. Note that the video extraction unit 733 is an example of a specifying unit.

  Specifically, when the video extraction unit 733 receives the output of the speech data “slightly before” from the voice detection unit 735 at the time of “13:00:10”, the video extraction unit 733 refers to the voice DB 723 illustrated in FIG. The time point corresponding to the speech data is estimated to be “10” seconds ago. Then, the video extraction unit 733 refers to the video DB 121 shown in FIG. 3, and the video data file “XXXXXXX01.mp4” at the time “13:00:00” that is 10 seconds before the time when the output of the utterance data is received. "Is specified as the video data to be extracted.

[Process flow]
Next, the processing flow of the video output apparatus 700 in the present embodiment will be described with reference to FIG. FIG. 10 is a flowchart illustrating an example of a process flow according to the second embodiment. In the following description, the same reference numerals as those shown in FIG. 6 are the same steps, and detailed description thereof will be omitted.

  The voice detection unit 735 receives voice data input from the voice acquisition device 400 and determines whether or not a passenger's voice is detected (step S211). If it is determined that no sound is detected (step S211: No), the sound detection unit 735 proceeds to step S161.

  When it is determined that the passenger's voice is detected (step S211: Yes), the voice detection unit 735 generates utterance data regarding the detected voice and outputs the utterance data to the video extraction unit 733. The video extraction unit 733 determines whether or not the input utterance data matches the keyword stored in the audio DB 723 (step S221).

  If it is determined that the utterance data matches the keyword (step S221: Yes), the video extraction unit 733 specifies a time zone or an object corresponding to the wording detected with reference to the audio DB 723 (step S223), The process proceeds to step S241.

  On the other hand, when it is determined that the utterance data does not match the keyword (step S221: No), the video extraction unit 733 determines whether the utterance data matches the related word stored in the landmark DB 724. (Step S231). When it is determined that the utterance data does not match the related word (step S231: No), the process returns to step S211.

  On the other hand, when it is determined that the utterance data matches the related word (step S231: Yes), the video extraction unit 733 refers to the landmark DB 724 and identifies a landmark corresponding to the utterance data (step S233). Then, the video extraction unit 733 specifies video data in which the specified landmark is photographed (step S235). Thereafter, the video extraction unit 733 outputs the specified video data to the video output unit 134, and the process proceeds to step S241.

  According to the above embodiment, since the time zone or the object intended by the passenger can be specified based on the voice of the passenger, the scenery of the point where the moving body passes can be reproduced in real time.

  Note that instead of outputting speech data, the audio detection unit 735 outputs a video extraction request to the video extraction unit 733 when audio is detected, and the video extraction unit 733 receives audio when receiving the video extraction request. The configuration may be such that video data at the time of being emitted is extracted. This makes it possible to reproduce the scenery in real time more easily and quickly without generating or analyzing speech data.

  Further, the information stored in the voice DB 723 and the processing by the voice detection unit 735 are not limited to those described in each embodiment. For example, the speech DB 723 stores speech features instead of character information, and the speech detection unit 735 recognizes speech by comparing the features extracted from the acquired speech data with the stored speech features. It may be a simple configuration.

  In each of the embodiments described above, the scenery at the point where the moving body passes can be reproduced in real time. However, even if the weather is unsatisfactory and the field of view is poor, the moving speed is too fast and the image is blurred, or there is an obstacle such as a parked vehicle in front of the object, The object may not be visible. In the present embodiment, a description will be given of a configuration for reproducing videos taken at different times in the same place.

[Output example]
First, an example of an image output in this embodiment will be described with reference to FIG. FIG. 11 is a diagram illustrating an example of an image displayed on the vehicle window according to the third embodiment. FIG. 11A shows an example of video data taken at a time point 3001 from a moving passenger car 1000. For example, at the time point 3001, the weather is clear and the object tower is clearly photographed. On the other hand, (b) of FIG. 11 shows an example of video data obtained by shooting the same object from the moving passenger car 1000 at different time points 3101. For example, the time point 3101 is cloudy, and the tower that is the object is hidden behind the clouds as shown in FIG.

  In such a case, the video output device 800 according to the present embodiment outputs video data captured at a time 3201 that is a clear time different from the time 3101 as shown in FIG. According to such a configuration, the video output device 800 can visually recognize an object photographed at a different time point, for example, a time point 3201 even when the object cannot be visually recognized in the video imaged from the moving passenger car 1000. Video data can be output.

  Note that videos taken at different times (hereinafter, sometimes referred to as “different time images”) are taken, for example, when the passenger car 1000 passes the same point in the past, and stored in the different time point video DB 825. However, it is not limited to this. For example, the different time point video data may be video data shot by another device at the same point and stored in an external server.

[Function configuration]
Next, the functional configuration of the video output device 800 in this embodiment will be described with reference to FIG. FIG. 12 is a diagram illustrating an example of a functional configuration according to the third embodiment. In the following embodiment, the video DB 121, the motion DB 122, the motion detection unit 132, the video extraction unit 133, the video output unit 134, the landscape photographing device 200, the motion photographing device 300, and the display device 500 are processed in the same manner as in the first embodiment. Therefore, detailed description is omitted.

  The video output device 800 according to the present embodiment is mounted in, for example, a passenger car 1000 as in the first embodiment. The video output device 800 is communicably connected to the landscape photographing device 200, the motion photographing device 300, and the display device 500 provided in the passenger car 1000. Furthermore, the video output device 800 is communicably connected to the external video server 210.

  The video server 210 is an external server that stores captured video at different time points. The video server 210 transmits the video data at different time points to the video output device 800 based on the request received from the video output device 800.

  Similar to the first embodiment, the video output device 800 is installed at the rear of the passenger car 1000 as shown in FIG. 1, for example, and records video data acquired from the landscape photographing device 200.

  In the present embodiment, the video output device 800 includes a communication unit 810, an operation unit 811, a storage unit 820, and a control unit 830.

  The communication unit 810 transmits / receives information to / from an external device. For example, the communication unit 810 transmits a request for different time video data output from the control unit 830 to the video server 210, receives the different time video data from the video server 210, and outputs the request to the control unit 830. Further, the communication unit 810 may receive a request for video display at a different time from a passenger terminal (not shown) and output the request to the control unit 830.

  The operation unit 811 receives an operation by a passenger. For example, the operation unit 811 receives a request for video display at a different time from the passenger and outputs the request to the control unit 830. The operation unit 811 is an operation button included in the video output device 800, for example. However, the operation unit 811 is not limited thereto, and may be configured such that the display device 500 that is a touch panel, for example, has the function of the operation unit 811.

  The storage unit 820 stores programs and data used by the video output device 800. In addition, the storage unit 820 appropriately stores information used for each process performed by the control unit 830. As illustrated in FIG. 12, the storage unit 820 includes a video DB 121, an operation DB 122, and a different time point video DB 825.

  The different time point image DB 825 stores the different time point image data together with the date and time when the image was taken. FIG. 13 is a diagram illustrating an example of the different time point image DB. As illustrated in FIG. 13, the different time point image DB 825 stores “shooting date / time”, “shooting point”, and “file name” in association with each other. For example, in the different time point image DB 825, the file with the file name “XXXXYYY01.mp4” was taken at “XXX Expressway 10.0 km point” at “2016/02/01 13:00:00”. It is recorded that there is.

  Next, each function of the control unit 830 will be described. For example, the control unit 830 is realized by executing various programs stored in a storage device inside the video output device 800 using the RAM as a work area by a CPU, an MPU, or the like. The control unit 830 may be realized by an integrated circuit such as an ASIC or FPGA.

  The control unit 830 includes a video acquisition unit 831, a motion detection unit 132, a video extraction unit 133, a video output unit 134, and a different time point video processing unit 836, and functions and functions of information processing described below. Realize or execute. Note that the internal configuration of the control unit 830 is not limited to the configuration illustrated in FIG. 8, and may be another configuration as long as the information processing described below is performed. The video acquisition unit 831 and the different time point video processing unit 836 are an example of an electronic circuit such as a processor or an example of a process executed by the processor.

  The video acquisition unit 831 is a processing unit that records a video taken from a moving moving body and acquires a video taken at a different time. Similar to the video recording unit 131, the video acquisition unit 831 acquires the video shot by the landscape shooting apparatus 200, and stores the video data file in the video DB 121 in association with the shooting time. Further, the video acquisition unit 831 acquires a video corresponding to the current time of the moving moving object from the video server 210 through the communication unit 810 and stores the video in the different time point video DB 825.

  The different time point video processing unit 836 is a processing unit that performs control related to display of different time point video data. For example, the different time point video processing unit 836 receives a request for different time point video display from the passenger via the operation unit 811 or the communication unit 810. Further, the different time point video processing unit 836 refers to the different time point video DB 825, and specifies the different time point video imaged at the same point as the video point output by the video output unit 134 based on the request.

[Process flow]
Next, a processing flow of the video output apparatus 800 in the present embodiment will be described with reference to FIG. FIG. 14 is a flowchart illustrating an example of a process flow according to the third embodiment.

  First, the different time point video processing unit 836 determines whether or not a request for different time point video display has been received when the specified video is being played back (step S311). When it is determined that the request has been received (step S311: Yes), the different time video processing unit 836 identifies a point corresponding to the currently played video (step S391). Then, the different time point video processing unit 836 specifies the different time point video corresponding to the specified point, and outputs it to the video output unit 134. The video output unit 134 reproduces the output different time point video data (step S393).

  Returning to step S311, when it is determined that the request has not been received (step S311: No), the different time video processing unit 836 determines whether an instruction to end the process has been received (step S361). If it is not determined that an instruction to end the process has been received (step S361: No), the process returns to step S193 and is repeated. If it is determined that an instruction to end the process has been received (step S361: Yes), the process ends.

  According to the present embodiment, even when the target object cannot be visually recognized in the video shot while moving, it is possible to reproduce the video related to the landscape including the target object. In addition, since images taken at different points in time can be displayed, it is possible to reproduce changes in scenery such as night views and scenery at the time of events such as fireworks displays.

  The different time point video DB 825 may store a plurality of different time point video data with different shooting dates and times for one shooting point. Also, the different time point video processing unit 836 receives a request for different time point video display including designation of conditions such as the shooting date and time and the weather condition at the time of shooting, and identifies the different time point video data that matches the specified condition. It may be a configuration.

  Note that the different time point image DB 825 may further store the shooting direction in addition to the shooting point, for example, and may store the shooting point by latitude and longitude, altitude, and other information. Thereby, for example, a corresponding landscape on the ground can be reproduced while moving in the basement. Further, the different time point image DB 825 may store the weather situation at the time of shooting, the event holding situation, and the like in addition to the shooting date and time.

  Further, the different time point video processing unit 836 is configured to display the different time point image when the date and time, the weather, or the like matches a predetermined condition in addition to the case where the request for displaying the different time point image is received from the passenger. It may be. For example, when the illuminance acquired from the illuminance sensor (not shown) or the like by the different time point image processing unit 836 is determined to be lower than the threshold value stored in advance in the storage unit 820, the different time point image is displayed. May be.

  Also, the different time point image processing unit 836 compares the different time point image including the predetermined object with the current image shot by the landscape photographing device 200 at the same point, and displays the different time point image based on the comparison result. The structure which makes it do may be sufficient. For example, the different time point video processing unit 836 may be configured to display the different time point image when it is determined that a predetermined object cannot be visually recognized in the current video.

  Note that the video output unit 134 in this embodiment may superimpose and display the different time point video and the current video, or use a known video recognition technique to calculate the difference between the different time point video and the current video. May be calculated and displayed.

  By the way, in a large-sized moving body such as a sightseeing bus, a train, and a passenger plane, the number of passengers is large, and the scenery that can be visually recognized from the passenger may vary depending on the seating position of the passenger. For example, a passenger seated on the left seat of the sightseeing bus may not easily see the scenery on the right side of the sightseeing bus seen by the passenger seated on the right seat. Therefore, in the present embodiment, a configuration will be described in which a seating position of a passenger is specified and an image corresponding to the seating position is displayed.

  The video output device 900 in the present embodiment is mounted on a large mobile body such as a sightseeing bus. FIG. 15 is a diagram illustrating an example of a moving object on which the video output device according to the fourth embodiment is mounted. As shown in FIG. 15, the video output device 900 is installed on the ceiling of a sightseeing bus 5000, for example. In the following embodiments, the operation DB 122, the video output unit 134, the landscape photographing device 200, and the display device 500 perform the same processing as in the first embodiment, and thus detailed description thereof is omitted.

  In this embodiment, the sightseeing bus 5000 has two landscape photographing devices 200, a landscape photographing device 200a that photographs a landscape on the left side in the traveling direction and a landscape photographing device 200b that photographs a landscape on the right side. Similarly, the sightseeing bus 5000 detects the motion of the passenger 5500a seated in the left seat and the motion photographing device 300b detects the motion of the passenger 5500b seated in the right seat. And two motion photographing apparatuses 300. The sightseeing bus 5000 has the display devices 500a and 500b on the left and right, respectively, but is not limited thereto, and may be configured to have only one display device 500, and the display device is provided in each passenger's seat. May be provided.

[Function configuration]
Next, the functional configuration of the video output apparatus 900 in this embodiment will be described with reference to FIG. FIG. 16 is a diagram illustrating an example of a functional configuration according to the fourth embodiment. Note that, in the following embodiments, the same parts are denoted by the same reference numerals, and redundant description is omitted.

  As shown in FIG. 16, the video output device 900 in this embodiment includes a storage unit 920 and a control unit 930. The storage unit 920 stores programs and data used by the video output device 900. Further, the storage unit 920 appropriately stores information used for each process performed by the control unit 930. As illustrated in FIG. 16, the storage unit 920 includes a video DB 921 and an operation DB 122.

  The video DB 921 in this embodiment stores the video data acquired from the landscape imaging devices 200a and 200b together with the shooting date / time, shooting location, and shooting direction. FIG. 17 is a diagram illustrating an example of a video DB according to the fourth embodiment. As illustrated in FIG. 17, the video DB 921 stores “shooting date / time”, “shooting point”, “shooting direction”, and “file name” in association with each other.

  In the present embodiment, “left side” is stored in the “shooting direction” for the video data acquired from the landscape shooting apparatus 200a, and “right side” is displayed in the “shooting direction” for the video data acquired from the landscape shooting apparatus 200b. Remembered. For example, in the video DB 921, a file with the file name “XXXXR01.mp4” is photographed by the landscape photographing device 200b at “2016/08/01 13:00:00” at “XX Expressway 10.0 km point”. Is recorded.

  Next, each function of the control unit 930 will be described. For example, the control unit 930 is realized by executing various programs stored in a storage device in the video output apparatus 900 using the RAM as a work area by a CPU, an MPU, or the like. The control unit 930 may be realized by an integrated circuit such as an ASIC or FPGA.

  The control unit 930 includes a video recording unit 931, motion detection units 932a and 932b, a video extraction unit 933, and a video output unit 134, and realizes or executes information processing functions and operations described below. Note that the internal configuration of the control unit 930 is not limited to the configuration illustrated in FIG. 16, and may be another configuration as long as the information processing described below is performed. In addition, the video recording unit 931, the motion detection units 932a and 932b, and the video extraction unit 933 are examples of electronic circuits such as a processor or processes executed by the processor.

  The video recording unit 931 in this embodiment is a processing unit that records a video shot from a moving moving body in association with a shooting direction. The video recording unit 931 acquires the video shot by the landscape shooting device 200a, and stores the video data file in the video DB 921 in association with the shooting time, shooting point, and shooting direction “left side”. Also, the video recording unit 931 acquires a video shot by the landscape shooting device 200b, and stores a video data file in the video DB 921 in association with the shooting time, shooting point, and shooting direction “right”.

  The motion detection unit 932a is a processing unit that detects the motion of the passenger 5500a seated in the left seat of the moving object. The motion detection unit 932b is a processing unit that detects the motion of the passenger 5500b seated in the right seat of the moving object. Since the processing in the motion detection units 932a and 932b is the same as that in the motion detection unit 132, detailed description thereof is omitted.

  The video extraction unit 933 is a processing unit that extracts a video estimated from the detected movement of the passenger and the seating position of the passenger. For example, in the example shown in FIG. 15, the video extraction unit 933 receives an output of operation data indicating that the passenger 5500a points to the left rear from the operation detection unit 932a. In this case, when the video extraction unit 933 matches the motion stored in the motion DB 122, the video extraction unit 933 specifies a time zone or an object corresponding to the matched motion. Then, the video extraction unit 933 specifies video data corresponding to the specified time zone or the object whose shooting direction is “left side”. In addition, the video extraction unit 933 specifies a time zone or an object corresponding to the operation that matches the operation data output from the operation detection unit 932b, and the shooting direction corresponding to the specified time zone or the object is “ Identify the video data that is "right".

[Process flow]
Next, the flow of processing of the video output apparatus 900 in this embodiment will be described with reference to FIG. FIG. 18 is a flowchart illustrating an example of a process flow according to the fourth embodiment. In the following description, the same reference numerals as those shown in FIG. 6 are the same steps, and detailed description thereof will be omitted.

  The motion detection units 932a and 932b receive video data input from the motion imaging apparatuses 300a and 300b, respectively, detect a passenger's motion, and output the motion data to the video extraction unit 933. Receiving the operation data, the video extraction unit 933 performs each process shown in steps S111 to S117.

  When each motion is detected in steps S111 to S117, the video extraction unit 133 refers to the motion DB 122, and changes the line of sight, facial expression, hand movement, or screen touch detected in steps S111 to S117. Estimate the corresponding time zone or object. In addition, the video extraction unit 933 specifies that the shooting direction is “left side” when the motion is detected in the motion detection unit 932a, and the motion direction is “right side” when the motion is detected in the motion detection unit 932b. ”. Then, the video extraction unit 933 specifies video data corresponding to the estimated time zone or the object and the shooting direction from the video DB 921 (step S401), and proceeds to step S193.

  According to the present embodiment, a passenger sitting in a seat on the opposite side of the seat where the scenery can be seen can enjoy the scenery as well as a passenger sitting in the seat where the scenery can be seen. For example, when displaying an image captured by the landscape photographing device 200a on the left side using the vehicle window on the right side of the sightseeing bus 5000 as the display device 500b, a look-back image so that the traveling direction of the vehicle coincides with the direction in which the image moves. May be displayed by reversing left and right.

  Although the embodiments of the present invention have been described so far, the present invention may be implemented in various different forms other than the embodiments described above. For example, the processes shown in FIGS. 6, 10, 14, and 18 are not limited to the above-described order, and are performed simultaneously within a range that does not contradict the process contents, such as steps S111 to S117 in FIG. Alternatively, the order may be changed.

  Further, each component of each illustrated apparatus is functionally conceptual, and does not necessarily need to be physically configured as illustrated. That is, the specific form of distribution / integration of each device is not limited to that shown in the figure. That is, all or a part of them can be configured to be functionally or physically distributed / integrated in arbitrary units according to various loads or usage conditions. For example, in the video output device 100, the video extraction unit 133 and the video output unit 134 may be integrated, or the motion detection unit 132 may be a processing unit that detects the line of sight and a process that detects the movement of the hand. The configuration may be such that it is distributed to each part. Moreover, the structure which integrates the action | operation imaging | photography apparatus 300 and the audio | voice acquisition apparatus 400 may be sufficient. Further, all or a part of each processing function performed in each device can be realized by a CPU and a program that is analyzed and executed by the CPU, or can be realized as hardware by wired logic.

  In each embodiment, the configuration in which the video output device performs either audio detection or motion detection has been described. However, the configuration is not limited to this, and the video output device has a configuration in which both audio detection and motion detection are performed. May be. Further, the video output device may be configured to perform at least one of a change in line of sight, a change in facial expression, and a hand movement. For example, the processing flow may be such that the video output apparatus 100 executes at least one of the determination processes indicated by reference numerals S111 to S117 in FIG. In addition, the configuration includes a process of detecting information indicating that the passenger has specified a specific time zone or point by a method other than the processes shown in S111 to S117 of FIG. 6 or S211 to S231 of FIG. There may be. For example, when the sound detection unit 735 detects sound having a predetermined volume (for example, 80 db or more), the video extraction unit 733 may identify a corresponding time zone or object.

  In addition, the video output unit 134 may be configured to display a video when a passenger's voice or motion is detected, normally without displaying the video. In such a configuration, for example, when the display device 500 also serves as a window of the moving body, when the video is not displayed, the outside world of the moving body can be directly viewed instead of the video.

  Note that the video recording units 131 and 931 or the video acquisition unit 831 are configured to continuously acquire video data from the landscape photographing device 200 while the video output unit 134 displays the video on the display device 500. May be. In this case, the operation detection units 132, 932a and 932b and the audio detection unit 735 are configured to further detect audio or operation even while the video output unit 134 is displaying video on the display device 500. There may be. As a result, even when the video data of the time zone or point specified based on the voice or action of the passenger is being reproduced, the time zone or point is further specified based on the voice or action of the passenger, and the video Data can be played back.

  Note that the correspondence between the action or voice and the target time zone or point is specified based on, for example, a pre-stored table, but is not limited to this. For example, the correspondence between the operation and the time zone is determined. The time zone may be specified by applying the operation data to the formula.

  The video data output by the video output unit 134 is, for example, moving image data captured in real time, but is not limited thereto, and may be video data such as a still image or a frame advance image. Note that the video DB shown in FIG. 3 or FIG. 17 is an example, and for example, a configuration in which a time stamp attached to one video data recorded continuously may be stored.

  Further, the video extraction units 133, 733, and 933 may be configured to further display a video in a time zone different from the video to be displayed based on an instruction from the passenger. For example, at the point 3000 shown in FIG. 5, the video extraction unit 133 may extract the video data taken at the time point 3001, but the scenery that the passenger 1500 wants to look back at is not the time point 3001 but the time point 3010. is there. In this case, for example, the motion detection unit 132 detects that the passenger 1500 swipes the display device 500 or points to the rear of the passenger 1500, and the video extraction unit 133 extracts video data captured at the time point 3001. Such a configuration may be adopted. Thereby, the video extraction unit 133 can further extract the video data intended by the passenger even if the extracted video data is not intended by the passenger 1500.

  Further, the video extraction units 133, 733, and 933 may be configured to update the operation DB 122, the audio DB 723, or the landmark DB 724 in accordance with an operation by a passenger or a learning result by audio. For example, when video data including a specific store is reproduced a plurality of times, the video extraction unit 733 may newly register information regarding the store in the landmark DB 724.

  In addition, when the voice detection unit 735 detects the voice “slightly before” and the video extraction unit 733 refers to the voice DB 723 and outputs the video data “10 seconds ago”, the passenger is “10 seconds ago”. In some cases, a video of “2 seconds ago” is requested instead of the video of. When such requests are continuous, the video extraction unit 733 updates “Rt (seconds)” corresponding to “a little before” in the audio DB 723 from “10” to “2”. Also good.

  Moreover, the structure which the image | video extraction parts 133, 733, and 933 specify a time slot | zone or a target object based on a passenger | crew's operation | movement or an audio | voice is not restricted above. For example, the video extraction unit 733 acquires position information at the time when the voice of the passenger 1500 is detected, and refers to the landmark DB 724 to extract a video including a landmark corresponding to the position information. It may be. Further, the video output unit 134 may display the images taken at a plurality of time points on the display device 500 as thumbnails, and output video data corresponding to the images selected by the passenger 1500. .

[Hardware configuration]
The video output devices 100, 700, 800, and 900 according to the present embodiment can be realized by a computer 600 having a configuration shown as an example in FIG. FIG. 19 is a hardware configuration diagram illustrating an example of a computer that implements the functions of the video output apparatus.

  The computer 600 includes a CPU (Central Processing Unit) 610, a ROM (Read Only Memory) 620, a RAM (Random Access Memory) 630, and an HDD (Hard Disk Drive) 640. The computer 600 also includes a media interface (I / F) 650, a communication interface (I / F) 660, and an input / output interface (I / F) 670.

  The computer 600 may include an SSD (Solid State Drive), and the SSD may execute a part or all of the functions of the HDD 640. Further, an SSD may be provided instead of the HDD 640.

  The CPU 610 operates based on a program stored in at least one of the ROM 620 and the HDD 640 and controls each unit. The ROM 620 stores a boot program executed by the CPU 610 when the computer 600 starts up, a program depending on the hardware of the computer 600, and the like. The HDD 640 stores a program executed by the CPU 610, data used by the program, and the like.

  The media I / F 650 reads programs and data stored in the storage medium 680 and provides them to the CPU 610 via the RAM 630. The CPU 610 loads such a program from the storage medium 680 onto the RAM 630 via the media I / F 650, and executes the loaded program. Alternatively, the CPU 610 executes a program using such data. The storage medium 680 is, for example, a magneto-optical recording medium such as a DVD (Digital Versatile Disc), an SD card, or a USB memory.

  The communication I / F 660 receives data from other devices such as the video server 210 via the network 690 and sends the data to the CPU 610, and transmits the data generated by the CPU 610 to other devices via the network 690. Alternatively, the communication I / F 660 receives a program from another device via the network 690, sends the program to the CPU 610, and the CPU 610 executes the program. The communication I / F 660 realizes the function of the communication unit 810, for example.

  The CPU 610 controls the landscape photographing device 200, the motion photographing device 300, the sound acquisition device 400, the display device 500, and the like via the input / output I / F 670. The CPU 610 acquires data from the landscape imaging device 200, the motion imaging device 300, the sound acquisition device 400, and the like via the input / output I / F 670. In addition, the CPU 610 acquires data from the video server 210 or the like via the communication I / F 660. In addition, the CPU 610 outputs the generated data to the display device 500 or the like via the input / output I / F 670.

  For example, when the computer 600 functions as the video output device 100, 700, 800, or 900, the CPU 610 of the computer 600 executes a program loaded on the RAM 630. Thereby, the CPU 610 includes the video recording unit 131 or 931, the video acquisition unit 831, the motion detection unit 132, 932a or 932b, the video extraction unit 133, 733, 933, the video output unit 134, the audio detection unit 735, and the different time video processing. The function of each unit of the unit 836 is realized.

  For example, the CPU 610 of the computer 600 reads these programs from the storage medium 680 and executes them, but as another example, these programs may be acquired from other devices via the network 690.

100, 700, 800, 900 Video output device 120, 720, 820, 920 Storage unit 121, 921 Video DB
122 Operation DB
130, 730, 830, 930 Control unit 131, 931 Video recording unit 132, 932a, 932b Motion detection unit 133, 733, 933 Video extraction unit 134 Video output unit 723 Audio DB
724 Landmark DB
735 Audio detection unit 810 Communication unit 811 Operation unit 825 Different time point video DB
831 Video acquisition unit 836 Inter-time point video processing unit 200, 200a, 200b Scene shooting device 210 Video server 300, 300a, 300b Motion shooting device 400 Audio acquisition device 500, 500a, 500b Display device

Claims (8)

A storage unit for storing, as video data, an external landscape of the moving body imaged by the imaging device during movement of the moving object that transports the passenger;
A detection unit for detecting a reaction by the passenger during the movement of the moving body;
An output unit that outputs video data corresponding to the detected reaction among the stored video data. It further has a specifying unit for specifying an object photographed from a past time zone or a point that has passed in the past,
The detection unit detects, as the reaction, that the passenger has issued a gesture indicating that the scenery of the outside world has been overlooked,
The specifying unit specifies the past time zone or the object using a correspondence relationship between the gesture and a time zone or the object,
The video output apparatus according to claim 1, wherein the output unit outputs video data corresponding to the specified time zone or the object. The storage unit stores, as different video data, videos obtained by photographing the scenery of the outside world seen from the boarding positions of the plurality of passengers,
The detection unit detects a boarding position of a passenger from which the reaction is detected,
The output unit is a boarding position different from the boarding position of the passenger from which the reaction is detected, out of a plurality of the stored video data, video data of an external scenery seen from the boarding position of the passenger is detected. The video output device according to claim 1, wherein the video output device outputs to a passenger. The detection unit detects, as the gesture, a change in the line of sight of the passenger, a change in facial expression, or a hand movement,
The specifying unit uses the correspondence between the change in the line of sight, the change in the facial expression, or the movement of the hand and the time zone or the object, and the change in the visual line detected, the change in the facial expression, Or identify the time zone or object corresponding to the hand movement,
The video output apparatus according to claim 2, wherein the output unit outputs video data corresponding to the specified time zone or the object. The detection unit detects the voice of the passenger,
5. The video output apparatus according to claim 1, wherein the output unit outputs the video data captured in a time zone in which the sound is generated. The detection unit extracts a word included in the passenger's voice,
The specifying unit specifies a time associated with the word or an object indicated by the word,
The output unit outputs video data at a time point that is traced back by the specified time from the detected time point, or video data obtained by photographing the specified object. The video output device described in 1. The storage unit further stores different time point video data shot at a time point different from the time point when the outside landscape of the moving object was shot, corresponding to the video data.
The video output device according to claim 2, wherein the output unit outputs the video at different time points corresponding to the specified time zone or the object. Computer
Storing, as video data, the scenery of the outside of the moving body, which was captured by the imaging device during the movement of the moving body that transports the passenger,
Detecting a reaction by the passenger during the movement of the moving body;
A video output method comprising: executing a process of outputting video data corresponding to the detected reaction among the stored video data.

Images