WO2021261307A1

WO2021261307A1 - Control device, image display system, image display method, and mobile body

Info

Publication number: WO2021261307A1
Application number: PCT/JP2021/022469
Authority: WO
Inventors: 伸高梨; 真朗江里口
Original assignee: ソニーグループ株式会社
Priority date: 2020-06-26
Filing date: 2021-06-14
Publication date: 2021-12-30

Abstract

[Problem] To provide a control device, an image display system, an image display method, and a mobile body with which it is possible to provide users with a highly entertaining and moving experience in a ship's cabin or another chamber of a mobile body. [Solution] A control device according to one embodiment of the present invention comprises an acquisition unit and a display control unit. The acquisition unit acquires a captured image of the surroundings of the mobile body. The display control unit causes a display unit installed in the chamber of the mobile body to display, in a superposed manner, the captured image and content related to the environment in the surroundings of the mobile body.

Description

Control device, image display system, image display method, and moving object

The present technology relates to a control device, an image display system, an image display method, and a moving body capable of providing entertainment in the room of the moving body.

The technology to display the image taken underwater on board is known. For example, Patent Document 1 discloses a work system for collecting shellfish and algae from the ship by displaying an image taken by a camera attached to the work rod on a monitor TV installed on the work ship. There is.

Japanese Unexamined Patent Publication No. 2016-165230

With the spread of marine leisure in recent years, the number of pleasure boat users is increasing. On the other hand, for example, the longer the stay at sea, the more likely it is to get bored on board. Further, simply displaying an image taken underwater as described in Patent Document 1 on a display device on a ship is not entertaining and cannot provide a sufficient moving experience to the user.

In view of the above circumstances, the purpose of this technology is a control device, an image display system, an image display method, and movement that can provide a user with a highly entertaining and moving experience in a moving body such as a cabin. To provide the body.

The control device according to one embodiment of the present technology includes an acquisition unit and a display control unit.
The acquisition unit acquires a photographed image around the moving body.
The display control unit causes the display unit installed in the room of the moving body to superimpose and display the content related to the environment around the moving body and the captured image.

Since the control device is configured to superimpose the captured image around the moving body and display the content related to the environment around the moving body on the display unit, the user is highly impressed with the entertainment. Can provide an experience.

The above content may have a main content and an effect content.
The main content includes a pseudo-environment image preset according to the type of the moving body. The effect content includes an effect image related to the pseudo environment image that is reproduced when the environment around the moving object satisfies a predetermined condition.

The display control unit may have a determination unit for determining whether or not the environment around the moving body satisfies the predetermined conditions. The display control unit reproduces the effect image based on the determination result of the determination unit.

The acquisition unit may further acquire a detection signal related to the posture of the moving body. The determination unit determines whether or not the moving body has a predetermined or greater posture change based on the detection signal, and the display control unit reproduces the effect image based on the predetermined or greater posture change of the moving body. ..

The above content may include audio data. The control device further includes an audio signal output unit that outputs an audio signal for driving a speaker installed in the room based on the audio data.

The above content may include tactile presentation data. The control device further includes a control signal generation unit that outputs a control signal for controlling the drive of the engine of the moving body based on the tactile presentation data.

The image display system according to one embodiment of the present technology includes an image pickup unit, a display unit, and a control device.
The image pickup unit is installed on the moving body and photographs the surroundings of the moving body.
The display unit is installed in the room of the moving body.
The control device includes an acquisition unit that acquires a captured image of the imaging unit, and a display control unit that superimposes and displays the content related to the environment around the moving body and the captured image on the display unit.

The image pickup unit may include a plurality of cameras installed around the moving body.
The display unit includes a plurality of display surfaces arranged corresponding to the shooting directions of the plurality of cameras and displaying images shot by the plurality of cameras.

The image display system may further include a storage unit that stores a plurality of types of the content, and a content input unit that selects arbitrary content from the plurality of types of content stored in the storage unit. The control device causes the display unit to display the content input by the content input unit.

The image display system may further include a posture detection unit that detects a change in the posture of the moving body. The control device controls the content to be displayed on the display unit based on the posture change of the moving body by a predetermined value or more.

The image display method according to one embodiment of the present technology includes acquiring a photographed image around a moving body.
The content related to the environment around the moving body and the captured image are superimposed and displayed on the display unit installed inside the moving body.

The moving body according to one embodiment of the present technology includes an image pickup unit for photographing the outside, a display unit installed in the room, and a control device.
The control device includes an acquisition unit that acquires a captured image of the imaging unit, and a display control unit that superimposes and displays the content related to the outdoor environment and the captured image on the display unit.

It is a block diagram which shows the structure of the image display system which concerns on one Embodiment of this technique. It is a schematic external perspective view of a boat as a moving body. It is a schematic plan view of the said moving body which shows the installation example of the image pickup part. It is a schematic plan view of the said moving body which shows the other installation example of the image pickup part. It is a schematic perspective view which shows one structural example of the display part installed in the room of the said moving body. It is a functional block diagram which shows the structure of the control device which concerns on one Embodiment of this technique. It is a flowchart which shows the processing procedure executed by the said control device. It is a schematic diagram explaining one operation of the said image display system. It is a schematic diagram explaining the other operation of the said image display system. It is a schematic block diagram which shows the other embodiment of this technique.

Hereinafter, embodiments relating to this technology will be described with reference to the drawings.

The image display system of this embodiment is installed on a moving body such as a ship, an aircraft, or a vehicle. In the present embodiment, the image display system of the present embodiment will be described by taking, for example, a ship, particularly a boat for marine leisure such as a pleasure boat, as an example of a moving body.

1 is a block diagram showing the configuration of the image display system 100 of the present embodiment, FIG. 2 is a schematic external perspective view of the boat 1 as a moving body, and FIG. 3 is a schematic plan view of the boat 1.
In FIGS. 2 and 3, the X-axis, the Y-axis, and the Z-axis indicate three axes orthogonal to each other, the X-axis is the front-rear direction of the boat 1, the Y-axis is the left-right direction of the boat 1, and the Z-axis. Corresponds to each of the vertical directions of the boat 1.

[Image display system]
As shown in FIG. 1, the image display system 100 mainly includes a control device 10, an image pickup unit 20, and a display unit 30.

(Control device)
The control device 10 controls each part of the image display system 100. The control device 10 displays an image taken by the image pickup unit 20 in the sea around the boat 1 on the display unit 30 installed in the cabin 3 of the boat 1, and captures the content related to the environment around the boat 1 as described above. It is configured to be superimposed on the image and displayed on the display unit 30. The details of the control device 10 will be described later.

(Image pickup unit)
The image pickup unit 20 includes a plurality of cameras 21 to 25 that photograph the sea around the boat 1. The plurality of cameras 21 to 25 are underwater cameras installed on the hull 2 of the boat 1, as shown in FIGS. 2 and 3 with a slight exaggeration.

For example, the camera 21 is installed at the bow and captures the underwater field of view in front of the boat 1. The camera 22 is installed at the stern and captures the underwater field of view behind the boat 1. The camera 23 is installed on the starboard side and captures the underwater field of view to the right of the boat 1. The camera 24 is installed on the port side and captures the underwater field of view on the left side of the boat 1. Then, the camera 25 is installed at the bottom of the ship and photographs the field of view under the sea below the boat 1.

As each camera 21 to 25, a digital camera equipped with an image sensor such as a CMOS (Complementary Metal-Oxide Semiconductor) sensor or a CCD (Charge Coupled Device) sensor is used. In addition, an infrared camera equipped with infrared illumination such as an infrared LED may be used. The image captured by the image pickup unit 2 includes both a still image and a moving image (video). The image pickup unit 20 is not limited to the underwater camera that captures the underwater image, and may be a camera that captures the state of the sea.

The angle of view of each camera 21 to 25 is not particularly limited, and it is preferable that the captured image can be acquired in the sea around the boat 1 in just proportion, but at least a part of the images captured by the cameras 21 to 25 overlap. You may.

Also, the number and placement positions of cameras are not limited to those mentioned above. For example, as shown in FIG. 4, the four cameras 26 to 29 may be arranged on the hull 2 at an angle (45 degrees in the illustrated example) with respect to the X-axis direction and the Y-axis direction. In this case, the front underwater field of view is by the

cameras

26 and 27, the rear underwater field of view is by the

cameras

28 and 29, the right underwater field of view is by the

cameras

27 and 29, and the left underwater field of view is by the camera. It is possible to take pictures by 26 and 28, respectively.

A fisheye camera having a wide viewing angle may be used for these cameras 21 to 29. Further, by using a camera capable of photographing the entire peripheral field of view, it is possible to reduce the number of cameras constituting the image pickup unit 20 for photographing the periphery of the boat 1.

(Display part)
The display unit 30 is installed in the cabin 3 of the boat 1. FIG. 5 is a schematic perspective view showing a configuration example of the display unit 30 installed in the cabin 3. As shown in the figure, the display unit 30 includes a plurality of display panels 31 to 35. The plurality of display panels 31 to 35 are three-dimensionally arranged so as to surround the user U. The display panels 31 to 35 are arranged so as to correspond to the shooting directions of the cameras 21 to 25, and are configured to display the shot images of the cameras 21 to 25, respectively.

For example, the display panel 31 is arranged in front of the cabin 3 and displays a photographed image of the camera 21 installed at the bow. The display panel 32 is arranged behind the cabin 3 and displays a photographed image of the camera 22 installed at the stern. The display panel 33 is arranged on the right side of the cabin 3 and displays a photographed image of the camera 23 installed on the starboard side. The display panel 34 is arranged on the left side of the cabin 3 and displays a photographed image of the camera 24 installed on the port side. The display panel 35 is arranged on the floor of the cabin 3 and displays a photographed image of the camera 25 installed on the bottom of the ship.

The display panels 31 to 35 may be display devices such as a liquid crystal panel and an organic EL panel, or may be screens capable of reflecting or transmitting the projected images of the cameras 21 to 25. Further, the display panels 31 to 34 arranged at the front, rear, left and right positions of the user U may also serve as the window portion of the cabin 3. Further, the number of display panels does not have to correspond to the number of cameras, and for example, an omnidirectional (all-around) image obtained by synthesizing the captured images of the cameras 21 to 24 may be displayed on one cylindrical display. ..
Further, the display unit 30 may be a projector device and a screen. Specifically, a screen may be arranged in the window portion of the cabin 3 and an image may be projected from the projector device and displayed on the screen. As a result, the space of the window portion can be effectively utilized as the display portion 30.

As shown in FIG. 1, the image display system 100 may further include a storage unit 40, a content input unit 50, a hull attitude detection unit 60, a speaker 70, and a communication unit 80.

(Memory)
The storage unit 40 is composed of a storage device such as a hard disk and a semiconductor memory. The storage unit 40 stores various contents to be displayed on the display unit 30. The content is typically image data related to the environment around the moving object. In the present embodiment to which the boat 1 is applied as a moving body, the content image is an image in the sea or underwater.

More specifically, the content includes the main content and the effect content.

The main content includes a pseudo-environment image preset according to the type of moving object. In the present embodiment in which the moving body is a boat 1, the pseudo-environment image typically includes an image of the sea including a school of fish, seaweed, and the like. Pseudo-environment images include not only realistic images but also virtual images. That is, the pseudo-environment image may be not only a live-action image but also an image or an animation created by using computer graphic technology. Further, the pseudo environment image is not limited to a three-dimensional image, and may be a two-dimensional image. The main content may include not only image data but also other information such as voice data and tactile presentation data.

It is preferable that multiple main contents are prepared for each theme. For example, an image of the sea area where the boat 1 is currently located, or an image of a plurality of domestic or foreign sea areas different from the current position may be prepared. Further, an image corresponding to the depth in the sea (for example, an image of the deep sea) may be prepared. Further, not only the image taken by the camera but also the image having a story (scenario) may be used. Further, a part of the plurality of main contents may include contents irrelevant to the type of the moving object.

On the other hand, the effect content includes an effect image related to a pseudo environment image that is played when the environment around the moving object satisfies a predetermined condition.

The environment around the moving body is, for example, detection data of various sensors installed in the moving body (for example, detection data of speed and posture of the moving body, detection data of exploration equipment such as radar), and imaging of the imaging unit 20. Examples include image data (for example, subject, image quality, etc.), relative position with other moving objects (ship in this embodiment), wind direction, wind force, and the like.
The predetermined condition is a condition preset in relation to the environment around the moving body such as the speed and the posture (angle) of the moving body, and the effect image is reproduced by the condition as a trigger.

A specific example of the effect image will be described later, but the effect image is preferably an image that can attract the attention of the user more than the image included in the main content. As with the main content, it is preferable that multiple effect images are prepared for each theme. Further, the effect content is not limited to the case where the environment around the moving object is reproduced when the predetermined condition is satisfied, and the pseudo environment image is not limited to the case where the pseudo environment image satisfies the predetermined condition (for example, the pseudo environment image is the predetermined value or more on the boat 1). It may be regenerated when approaching or separating).

It is preferable that the main content and the effect content are prepared for each of the plurality of display panels 31 to 35 (front-back direction, left-right direction, ship bottom direction) constituting the display unit 30. As a result, it is possible to display an image having a relevance on each display panel 31 to 35 of a specific object (for example, the movement of a school of fish) in the image.

(Content input section)
The content input unit 50 is for selecting the content to be displayed on the display unit 30 from various contents stored in the storage unit 40. As will be described later, the control device 10 causes the display unit 30 to display the content input by the content input unit 50.

The content input unit 50 typically has a display surface provided with a touch sensor, and content selected by the user U is input. The content selected by the content input unit 50 includes the main content and the effect content, and various combinations thereof can be arbitrarily selected. The content input unit 50 may be configured by a stationary device installed at an arbitrary position in the cabin 3, or may be configured by a portable device such as a remote controller.

(Posture detector)
The posture detection unit 60 is composed of various sensors that detect information related to the posture of the moving body. As will be described later, the control device 10 controls the content (for example, reproduction of the effect image) to be displayed on the display unit 30 based on the posture change of the moving body by a predetermined value or more.

The posture detection unit 60 can be configured by a motion sensor such as an angular velocity sensor or an acceleration sensor installed at an arbitrary position of the boat 1, or a combination thereof. In this case, the posture detection unit 60 may be composed of a sensor unit in which each of the angular velocity sensor and the acceleration sensor is arranged in the three-axis direction, or the sensor to be used may be different depending on each axis. Further, a geomagnetic sensor may be adopted for detecting the direction of the ship around the vertical axis (Z axis). Alternatively, the geomagnetic sensor and the motion sensor may be combined. This enables highly accurate detection of directional or attitude changes.

In the present embodiment, the posture detection unit 60 has a surge that is a reciprocating motion in the X-axis direction, a roll that is a rotational motion around the X-axis, a sway that is a reciprocating motion in the Y-axis direction, and a pitch that is a rotational motion around the Y-axis. Furthermore, it is configured so that heave, which is a reciprocating motion in the Z-axis direction, and yaw, which is a rotational motion around the Z-axis, can be detected. The attitude detection unit 60 may include an anemometer, an anemometer, or the like.

(Speaker)
The speaker 70 is installed in the cabin 3 and is configured to be capable of outputting voice or sound. The number of speakers 70 may be one, but a plurality of speakers 70 may be installed according to the number and positions of the display panels 31 to 35. As a result, it is possible to form an acoustic space with a sense of presence. The speaker 70 is mainly used as a device for reproducing the audio data when the audio data is included in the content input by the content input unit 50. Therefore, if the content does not include audio data, the installation of the speaker 70 can be omitted.

(Communication department)
The communication unit 80 is composed of a wireless communication device including a communication antenna. The boat 1 may be able to communicate with other vessels via the communication unit 80. Further, the communication unit 80 may be configured to be connectable to an Internet line. As a result, various contents to be displayed on the display unit 30 can be acquired by downloading from the cloud server. In this case, the downloaded content may be stored in the storage unit 40. Further, when the content to be downloaded can be selected via the content input unit 50 or the like, it is possible to eliminate the need to install the storage unit 40 in which a plurality of contents are stored in advance.

The communication unit 80 may include a GPS (Global Positioning System) receiver. This makes it possible to acquire the current position (longitude, latitude) and the current time of the boat 1.

[Details of control device]
Subsequently, the details of the control device 10 will be described.
The control device 10 is composed of a computer (information processing device) including a CPU (Central Processing Unit) and a memory. The memory stores programs and various parameters for executing various functions described later by the CPU. Note that these programs and parameters may be stored in the storage unit 40.

FIG. 6 is a functional block diagram showing the configuration of the control device 10. The control device 10 includes an acquisition unit 11, a display control unit 12, an audio signal control unit 13, and a control signal generation unit 14.

The acquisition unit 11 is configured to be able to acquire an image of the surroundings of the moving body (boat 1) from the image pickup unit 20. The acquisition unit 11 is further configured to be able to acquire an input signal from the content input unit 50, a detection signal from the attitude detection unit 60, information related to another ship from the communication unit 80, and the like.

The display control unit 12 causes the display unit 30 to display the captured image of the image pickup unit 20 acquired via the acquisition unit 11. The captured image is a live image (through image), but the captured image may be delayed and reproduced with a delay of several seconds.

Further, the display control unit 12 reads the content selected based on the input signal from the content input unit 50 from the storage unit 40, generates an image signal for displaying the read content (main content), and displays the image signal. Output to unit 30. As a result, the captured images of the cameras 21 to 25 and the contents can be superimposed and displayed on the display panels 31 to 35.

The display control unit 12 has a determination unit 121. The determination unit 121 determines whether or not the environment around the moving body (boat 1) satisfies the above predetermined conditions. The display control unit 12 is configured to reproduce the effect image based on the determination result of the determination unit 121.

For example, the determination unit 121 determines whether or not the posture of the boat 1 has changed by a predetermined value or more based on the detection signal from the attitude detection unit 60. The display control unit 12 is configured to reproduce the effect image based on the posture change of the boat 1 by a predetermined value or more.

Even if the determination unit 121 is configured to be able to perform image processing on the captured image of the imaging unit 20 and determine whether or not a subject preset as a reproduction trigger of the effect image is reflected in the captured image. good. This makes it possible to control the reproduction of the effect image based on the captured image of the imaging unit 20.

The audio signal generation unit 13 is configured to be able to output an audio signal for driving the speaker 70 based on the audio data included in the content. The audio signal may be a stereo signal or a monaural signal. The audio signal is generated in synchronization with the pseudo-environment image or the effect image. If the speaker 70 is not installed, the audio signal generation unit 13 can be omitted.

The control signal generation unit 14 is configured to be able to output a control signal for controlling the drive of the engine of the moving body (boat 1) based on the tactile presentation data included in the content.

The tactile presentation data is typically included in the effect content. The control signal is generated when the effect image is played back. As shown in FIG. 1, the control signal is output to the drive control unit 5 that controls the drive unit 4 (engine or motor) of the boat 1. The drive control unit 5 controls the drive unit 4 so that the boat 1 swings in the front-rear direction (pitch direction) or the left-right direction (roll direction) based on the control signal. As a result, the user U can experience the shaking of the boat 1 when the effect image is reproduced. Instead of the drive control of the drive unit 4, for example, a control signal capable of applying vibration to the seat on which the user U sits may be generated.

[Operation of image display system]
Subsequently, the details of the control device 10 will be described together with the operation of the image display system 100. FIG. 7 is a flowchart showing a processing procedure executed by the control device 10. First, a basic processing procedure executed by the control device 10 will be described.

As shown in FIG. 5, the control device 10 displays the captured images G1 of the cameras 21 to 25 acquired from the image pickup unit 20 on the corresponding display panels 31 to 35 of the display unit 30 (S101).

Subsequently, the control device 10 accepts the content selection operation in the content input unit 50 and reads the input content from the storage unit 40 (S102). The input signal from the content input unit 50 includes an input signal related to the main content and an input signal related to the effect content. The input signal related to the effect content includes the above-mentioned predetermined condition that triggers the reproduction of the effect image.

Subsequently, the control device 10 reproduces the pseudo environment image G2 included in the selected main content (S103), as schematically shown in FIG. As a result, the superimposed image of the captured image G1 and the pseudo environment image G2 is displayed on the display panels 31 to 35. Here, the pseudo-environment image G2 shows an image of a predetermined kind of fish. As a result, fish that do not actually exist around the boat 1 can attract the user's interest as if they actually existed.

Subsequently, the control device 10 determines in a predetermined time cycle whether or not a predetermined condition that triggers the reproduction of the effect image is satisfied (S104). When the predetermined condition is satisfied (YES in S104), the control device 10 reproduces the effect content and superimposes and displays the effect image G3 on the predetermined display panels 31 to 35 (S105). As an example, FIG. 8 schematically shows how an image of a shark as an effect image G3 is displayed on the display panel 33 on the right side.

When the selected effect content includes audio data or tactile presentation data, the control device 10 generates an audio signal or a control signal and outputs the audio signal or the control signal to the speaker 70 or the drive control unit 5. As a result, the sound and tactile sensation related to the effect image G3 are presented to the user U.

As described above, according to the present embodiment, the content related to the environment around the moving object is displayed on the display unit by superimposing it on the captured image around the moving object, so that the user can see the content. It is possible to provide a highly entertaining and moving experience. Hereinafter, in various application examples, the details of the effect image reproduction trigger (predetermined condition) for each type of content will be described.

(Application example 1: Rolling)
A predetermined condition for reproducing the effect content is a change in the posture of the boat 1. In this case, the control device 10 reproduces the effect content based on the posture detection unit 60 detection signal. FIG. 9A shows a state in which the boat is tilted to the left, and FIG. 9B shows a display form of the effect image G3.

In this example, the pseudo-environment image G2 including the fish in the sea is reproduced as the main content. The boat 1 that moves or stops on the ocean swings in a predetermined direction under the influence of the sea surface condition (swell, etc.) and the wind. Therefore, when the control device 10 detects an inclination of the boat 1 to the left by a predetermined angle or more based on the detection signal from the attitude detection unit 60, as shown in FIG. 9B, the right display panel 33 Play back the effect image G3 as if a shark collided with it. As a result, the user U can experience the appearance of a shark and the attack of the shark on the boat 1. When the boat 1 is tilted to the right by a predetermined value or more, the same effect image G3 may be displayed on the display panel 34 on the left side. At this time, an audio signal imitating the collision sound of a shark may be generated and reproduced from the speaker. This makes it possible to further enhance the sense of presence. Instead of the collision of the shark, an effect image in which the whale passes by the side of the boat 1 may be reproduced.

(Application example 2: pitching)
As the main content, for example, a pseudo-environment image including an iceberg such as the Antarctic Ocean can be mentioned. In this case, the posture detecting unit 60 detects the posture of the boat 1, and when the pitching of the boat 1 becomes a predetermined magnitude or more, the control device 10 reproduces an effect image of breaking the iceberg as the effect content. In this case, the effect image may be displayed on the front display panel 31.

As effect contents that are played by detecting pitching above a predetermined level, an effect image in which the boat 1 plunges into a school of fish from the front and an effect image in which a whale passes under the boat 1 are played. May be good.

(Application example 3: Rotation)
When the posture detection unit 60 detects that the boat 1 is turning on the sea around a predetermined position, the effect content may be reproduced such that the boat 1 is sucked into the whirlpool.

(Application example 4: Fishfinder)
When the boat 1 is equipped with a fish finder, when the fish finder is detected as a predetermined condition, the effect content including the fish finder may be reproduced on the display panel 35 displaying the photographed image of the bottom of the boat. Further, the fish school may be displayed on the

display panels

31 and 32 in the front-rear direction or the

display panels

33 and 34 in the left-right direction by using the posture detection signal of the boat 1.

(Application example 5: Playback of effect image based on state transition of pseudo environment image)
As the main content, a pseudo-environment image depicting the movement on the same ocean as other ships may be reproduced. In this case, when the relative distance to the other ship is more than a predetermined distance, an effect image simulating the appearance of a torpedo being fired from the other ship toward the own ship (boat 1) is reproduced as effect content. May be done.

(Application example 6: Environmental change of captured image)
If it is a shallow place, the transparency may change depending on the date and time even in the same place depending on how the sand dances. Therefore, an effect image including deep-sea fish and ancient fish may be displayed by using the transparency of seawater as a trigger.

(Application example 7: Other main contents)
For example, at night, it is difficult to understand the state of the sea. In this case, a pseudo environment image showing a night sky with wide stars may be displayed as the main content. As the effect content, an effect image representing a shooting star may be displayed by using the posture of the boat 1 as a trigger.

[Other embodiments]
In the above embodiment, the example in which the image pickup unit 20 is arranged around the hull 2 has been described, but instead of or in addition to this, as shown in FIG. 10, the camera 26 is attached to the anchor 6 of the boat 1. It may be installed. As a result, it is possible to acquire an underwater image having a depth corresponding to the position of the anchor 6. Instead of the anchor 6, the camera may be installed on a rope or a chain that can be submerged in the sea.

When the camera 26 includes an infrared camera, the underwater can be visually recognized even in a dark place where the underwater cannot be visually recognized. Further, depending on the length at which the anchor 6 is lowered, an effect image that gradually dives deep into the sea may be displayed. The captured image becomes darker according to the depth, but when the captured image becomes dark enough to be invisible, a full CG effect image may be displayed using this as a trigger.
Further, when the image pickup unit 20 is a camera that captures a state of water, an effect image in which a flying fish bounces on the water surface or a whale may dive may be superimposed as effect contents.

Further, in the above embodiment, an example of application to a boat 1 moving on the sea or water as a moving body has been described, but the present invention is not limited to this, and is not limited to this, such as an aircraft such as a private jet, a railroad vehicle such as a night train, and a long-distance bus. This technology can also be applied to vehicles in Japan.

Note that this technology can also adopt the following configurations.

(1) An acquisition unit that acquires captured images of the surroundings of a moving object,
A control device including a display unit installed in a room of the moving body, and a display control unit for superimposing and displaying contents related to the environment around the moving body and the captured image.
(2) The control device according to (1) above.
The content is
The main content including the pseudo-environment image preset according to the type of the moving object, and
A control device having an effect content including an effect image related to the pseudo-environment image to be played when the environment around the moving body satisfies a predetermined condition.
(3) The control device according to (2) above.
The display control unit has a determination unit that determines whether or not the environment around the moving body satisfies the predetermined condition, and is a control device that reproduces the effect image based on the determination result of the determination unit.
(4) The control device according to (3) above.
The acquisition unit further acquires a detection signal related to the posture of the moving body, and obtains the detection signal.
Based on the detection signal, the determination unit determines whether or not the moving body has a posture change of a predetermined value or more.
The display control unit is a control device that reproduces the effect image based on a posture change of the moving body of a predetermined value or more.
(5) The control device according to any one of (1) to (4) above.
The content includes audio data and
The control device further includes a voice signal generation unit that outputs a voice signal for driving a speaker installed in the room based on the voice data.
(6) The control device according to any one of (1) to (5) above.
The content includes tactile presentation data.
The control device further includes a control signal generation unit that outputs a control signal for controlling the drive of the engine of the moving body based on the tactile presentation data.
(7) An image pickup unit installed on the moving body and photographing the surroundings of the moving body, and
The display unit installed in the room of the moving body and
An image including an acquisition unit for acquiring a captured image of the imaging unit, and a control device having a display control unit for superimposing and displaying the content related to the environment around the moving body and the captured image on the display unit. Display system.
(8) The image display system according to (7) above.
The imaging unit includes a plurality of cameras installed around the moving body.
The display unit is an image display system including a plurality of display surfaces arranged corresponding to the shooting directions of the plurality of cameras and displaying images shot by the plurality of cameras.
(9) The image display system according to (7) or (8) above.
A storage unit that stores multiple types of the contents, and
A content input unit for selecting an arbitrary content from a plurality of types of content stored in the storage unit is further provided.
The control device is an image display system that displays the content input by the content input unit on the display unit.
(10) The image display system according to any one of (7) to (9) above.
Further, a posture detecting unit for detecting a change in the posture of the moving body is provided.
The control device is an image display system that controls content to be displayed on the display unit based on a posture change of the moving body of a predetermined value or more.
(11) Acquire the photographed image around the moving object and
An image display method in which a content related to the environment around the moving body and the captured image are superimposed and displayed on a display unit installed in the room of the moving body.
(12) An image pickup unit that captures the outdoors and
The display unit installed in the room and
A mobile body including a control device having an acquisition unit for acquiring a captured image of the imaging unit and a display control unit for superimposing and displaying the content related to the outdoor environment and the captured image on the display unit.

1 ... Boat (mobile)
10 ... Control device 11 ... Acquisition unit 12 ... Display control unit 13 ... Audio signal generation unit 14 ... Control signal generation unit 20 ... Image pickup unit 30 ... Display unit 40 ... Storage unit 50 ... Content input unit 60 ... Attitude detection unit 70 ... Speaker 100 ... Image display system G1 ... Shooting image G2 ... Pseudo-environment image G3 ... Effect image

Claims

The acquisition unit that acquires the captured image around the moving object,
A control device including a display unit installed in a room of the moving body, and a display control unit for superimposing and displaying contents related to the environment around the moving body and the captured image.
The control device according to claim 1.
The content is
The main content including the pseudo-environment image preset according to the type of the moving object, and
A control device having an effect content including an effect image related to the pseudo-environment image to be played when the environment around the moving body satisfies a predetermined condition.
The control device according to claim 2.
The display control unit has a determination unit that determines whether or not the environment around the moving body satisfies the predetermined condition, and is a control device that reproduces the effect image based on the determination result of the determination unit.
The control device according to claim 3.
The acquisition unit further acquires a detection signal related to the posture of the moving body, and obtains the detection signal.
Based on the detection signal, the determination unit determines whether or not the moving body has a posture change of a predetermined value or more.
The display control unit is a control device that reproduces the effect image based on a posture change of the moving body of a predetermined value or more.
The control device according to claim 1.
The content includes audio data and
The control device further includes a voice signal generation unit that outputs a voice signal for driving a speaker installed in the room based on the voice data.
The control device according to claim 1.
The content includes tactile presentation data.
The control device further includes a control signal generation unit that outputs a control signal for controlling the drive of the engine of the moving body based on the tactile presentation data.
An image pickup unit installed on a moving body and photographing the surroundings of the moving body,
The display unit installed in the room of the moving body and
An image including an acquisition unit for acquiring a captured image of the imaging unit, and a control device having a display control unit for superimposing and displaying the content related to the environment around the moving body and the captured image on the display unit. Display system.
The image display system according to claim 7.
The imaging unit includes a plurality of cameras installed around the moving body.
The display unit is an image display system including a plurality of display surfaces arranged corresponding to the shooting directions of the plurality of cameras and displaying images shot by the plurality of cameras.
The image display system according to claim 7.
A storage unit that stores multiple types of the contents, and
A content input unit for selecting an arbitrary content from a plurality of types of content stored in the storage unit is further provided.
The control device is an image display system that displays the content input by the content input unit on the display unit.
The image display system according to claim 7.
Further, a posture detecting unit for detecting a change in the posture of the moving body is provided.
The control device is an image display system that controls content to be displayed on the display unit based on a posture change of the moving body of a predetermined value or more.
Get the captured image around the moving object,
An image display method in which a content related to the environment around the moving body and the captured image are superimposed and displayed on a display unit installed in the room of the moving body.
An image pickup unit that shoots outdoors, and
The display unit installed in the room and
A mobile body including a control device having an acquisition unit for acquiring a captured image of the imaging unit and a display control unit for superimposing and displaying the content related to the outdoor environment and the captured image on the display unit.