JP2021047612A - Display system, vehicle, and portable device - Google Patents

Abstract

To allow a driver viewing a screen of a portable device during parking of a vehicle to safely start driving.SOLUTION: There is provided a display system comprising a vehicle and a portable device. The vehicle includes a front image generation unit for generating a front image indicating a situation ahead of the vehicle, and a transmission unit for transmitting the front image to the portable device. The portable device includes a reception unit for receiving the front image from the vehicle, a screen generation unit for generating a screen including the front image and a base image based on a function during execution of the portable device, and a display unit for displaying the screen.SELECTED DRAWING: Figure 5

Description

The present invention relates to display systems, vehicles and portable devices.

The driver may use a mobile device such as a mobile phone while the vehicle is stopped due to a red light or a traffic jam. When the driver pays close attention to the display of the portable device, he / she may lose attention to the front of the vehicle and may not be able to start at an appropriate timing. Patent Document 1 proposes a technique for notifying a user that a vehicle can be started via a portable device.

JP-A-2017-138830

In the technique described in Patent Document 1, since the driver is notified after the vehicle is ready to start, the driver hastily starts the vehicle. As a result, the driver may neglect to check the surrounding traffic environment. One aspect of the present invention is to provide a technique for allowing a driver looking at a screen of a mobile device to safely start while the vehicle is stopped.

In view of the above problems, a display system including a vehicle and a portable device, wherein the vehicle transmits a front image generation unit that generates a front image showing a situation in front of the vehicle, and the front image to the mobile device. A screen for generating a screen including a receiving unit for receiving the front image from the vehicle, a base image based on a function being executed by the mobile device, and the front image. A display system including a generation unit and a display unit for displaying the screen is provided.

By the above means, the driver who is looking at the screen of the portable device while the vehicle is stopped can safely start.

The block diagram explaining the configuration example of the vehicle which concerns on embodiment. The block diagram explaining the configuration example of the display system which concerns on embodiment. The flow diagram explaining the operation example of the vehicle which concerns on embodiment. The flow diagram explaining the operation example of the portable device which concerns on embodiment. The schematic diagram explaining the example of the screen which concerns on embodiment. The schematic diagram explaining the example of the front image which concerns on embodiment. The schematic diagram explaining the example of the screen transition which concerns on embodiment. The schematic diagram explaining another example of the screen which concerns on embodiment. The schematic diagram explaining another example of the screen which concerns on embodiment.

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. The following embodiments do not limit the invention according to the claims, and not all combinations of features described in the embodiments are essential to the invention. Two or more of the plurality of features described in the embodiments may be arbitrarily combined. Further, the same or similar configuration will be given the same reference number, and duplicate description will be omitted.

FIG. 1 is a block diagram of a vehicle 1 according to a part of the embodiment of the present invention. In FIG. 1, the outline of the vehicle 1 is shown in a plan view and a side view. Vehicle 1 is, for example, a sedan-type four-wheeled passenger car. The vehicle 1 may be such a four-wheeled vehicle, a two-wheeled vehicle, or another type of vehicle.

The vehicle 1 includes a vehicle control device 2 (hereinafter, simply referred to as a control device 2) that controls the vehicle 1. The control device 2 includes a plurality of ECUs 20 to 29 that are communicably connected by an in-vehicle network. Each ECU includes a processor typified by a CPU, a memory such as a semiconductor memory, an interface with an external device, and the like. The memory stores programs executed by the processor and data used by the processor for processing. Each ECU may include a plurality of processors, memories, interfaces, and the like. For example, the ECU 20 includes a processor 20a and a memory 20b. When the processor 20a executes an instruction included in the program stored in the memory 20b, the processing by the ECU 20 is executed. Instead of this, the ECU 20 may be provided with a dedicated integrated circuit such as an ASIC for executing the process by the ECU 20. The same applies to other ECUs.

Hereinafter, the functions and the like that each ECU 20 to 29 is in charge of will be described. The number of ECUs and the functions in charge can be appropriately designed, and can be subdivided or integrated as compared with the present embodiment.

The ECU 20 executes control related to the automatic driving of the vehicle 1. In automatic driving, at least one of steering control of vehicle 1 and speed control (acceleration / deceleration control) is automatically performed. In the control example described later, both steering and acceleration / deceleration are automatically controlled.

The ECU 21 controls the electric power steering device 3. The electric power steering device 3 includes a mechanism for steering the front wheels in response to a driving operation (steering operation) of the driver of the vehicle 1 with respect to the steering wheel 31. The driver of the vehicle 1 is a passenger who is the driver of the vehicle 1, regardless of whether or not he / she is actually performing the driving operation. In the following description, the driver of the vehicle 1 is simply referred to as a driver. The electric power steering device 3 includes a motor that exerts a driving force for assisting steering operation and automatically steering the front wheels, a sensor that detects a steering angle, and the like. When the driving state of the vehicle 1 is automatic driving, the ECU 21 automatically controls the electric power steering device 3 in response to an instruction from the ECU 20 to control the traveling direction of the vehicle 1.

The ECUs 22 and 23 control the detection units 41 to 43 for detecting the surrounding conditions of the vehicle and process the information processing of the detection results. The detection unit 41 is a camera that photographs the front of the vehicle 1 (hereinafter, may be referred to as a camera 41), and in the case of the present embodiment, it is attached to the vehicle interior side of the front window at the front of the roof of the vehicle 1. Be done. By analyzing the image taken by the camera 41, it is possible to extract the outline of the target and the lane marking line (white line or the like) on the road.

The detection unit 42 is a lidar (Light Detection and Ranging) (hereinafter, may be referred to as a lidar 42), detects a target around the vehicle 1, and measures a distance from the target. .. In the case of the present embodiment, five riders 42 are provided, one at each corner of the front portion of the vehicle 1, one at the center of the rear portion, and one at each side of the rear portion. The detection unit 43 is a millimeter-wave radar (hereinafter, may be referred to as a radar 43), detects a target around the vehicle 1, and measures a distance from the target. In the case of the present embodiment, five radars 43 are provided, one in the center of the front portion of the vehicle 1, one in each corner of the front portion, and one in each corner of the rear portion.

The ECU 22 controls one of the cameras 41 and each rider 42, and processes information processing of the detection result. The ECU 23 controls the other camera 42 and each radar 43, and processes information processing of the detection result. By equipping two sets of devices that detect the surrounding conditions of the vehicle, the reliability of the detection results can be improved, and by equipping different types of detection units such as cameras, riders, and radar, the surrounding environment of the vehicle can be analyzed. Can be done in multiple ways. Further, the vehicle 1 may include a camera 44 that captures the inside of the vehicle (particularly the driver).

The ECU 24 controls the gyro sensor 5, the GPS sensor 24b, and the communication device 24c, and processes the detection result or the communication result. The gyro sensor 5 detects the rotational movement of the vehicle 1. The course of the vehicle 1 can be determined based on the detection result of the gyro sensor 5, the wheel speed, and the like. The GPS sensor 24b detects the current position of the vehicle 1. The communication device 24c wirelessly communicates with a server that provides map information and traffic information, and acquires such information. The ECU 24 can access the map information database 24a built in the memory, and the ECU 24 searches for a route from the current location to the destination. The ECU 24, the map database 24a, and the GPS sensor 24b constitute a so-called navigation device.

The ECU 25 includes a communication device 25a for vehicle-to-vehicle communication. The communication device 25a wirelessly communicates with other vehicles in the vicinity and exchanges information between the vehicles. Further, the communication device 25a may be used for communication with a device other than another vehicle.

The ECU 26 controls the power plant 6. The power plant 6 is a mechanism that outputs a driving force for rotating the driving wheels of the vehicle 1, and includes, for example, an engine and a transmission. The ECU 26 controls the engine output in response to the driver's driving operation (accelerator operation or acceleration operation) detected by the operation detection sensor 7a provided on the accelerator pedal 7A, the vehicle speed detected by the vehicle speed sensor 7c, or the like. The shift stage of the transmission is switched based on the information of. When the operating state of the vehicle 1 is automatic operation, the ECU 26 automatically controls the power plant 6 in response to an instruction from the ECU 20 to control acceleration / deceleration of the vehicle 1.

The ECU 27 controls a lighting device (head light, tail light, etc.) including a direction indicator 8 (winker). In the case of the example of FIG. 1, the direction indicator 8 is provided at the front portion, the door mirror, and the rear portion of the vehicle 1.

The ECU 28 controls the input / output device 9. The input / output device 9 outputs information to the driver and accepts input of information from the driver. The voice output device 91 notifies the driver of information by voice. The display device 92 notifies the driver of information by displaying an image. The display device 92 is arranged on the surface of the driver's seat, for example, and constitutes an instrument panel or the like. In addition, although voice and display are illustrated here, information may be notified by vibration or light. In addition, information may be transmitted by combining a plurality of voices, displays, vibrations, and lights. Further, the combination may be different or the notification mode may be different depending on the level of information to be notified (for example, the degree of urgency). The input device 93 is a group of switches that are arranged at a position that can be operated by the driver and give an instruction to the vehicle 1, but a voice input device may also be included.

The ECU 29 controls the braking device 10 and the parking brake (not shown). The brake device 10 is, for example, a disc brake device, which is provided on each wheel of the vehicle 1 and decelerates or stops the vehicle 1 by applying resistance to the rotation of the wheels. The ECU 29 controls the operation of the brake device 10 in response to the driver's driving operation (brake operation) detected by the operation detection sensor 7b provided on the brake pedal 7B, for example. When the driving state of the vehicle 1 is automatic driving, the ECU 29 automatically controls the brake device 10 in response to an instruction from the ECU 20 to control deceleration and stop of the vehicle 1. The braking device 10 and the parking brake can also be operated to maintain the stopped state of the vehicle 1. Further, when the transmission of the power plant 6 is provided with a parking lock mechanism, this can be operated to maintain the stopped state of the vehicle 1.

The display system 200 according to some embodiments will be described with reference to FIG. The display system 200 includes the vehicle 1 described above and the portable device 210. The portable device 210 is brought inside the vehicle 1 and can be used by the driver of the vehicle 1. In other words, the user of the mobile device 210 is the driver of the vehicle 1. The display system 200 operates so that the portable device 210 displays an image showing the situation in front of the vehicle 1. Hereinafter, an image showing the situation in front of the vehicle 1 is referred to as a front image. By displaying the front image on the mobile device 210, the driver of the vehicle 1 can grasp the situation in front of the vehicle 1 while looking at the mobile device 210 while the vehicle 1 is stopped. FIG. 2 shows the components used for this operation, and the display system 200 may have other components not shown in FIG.

The vehicle 1 has a processor 201, a memory 202, an imaging unit 203, and a communication unit 204. Processor 201 executes the overall processing of vehicle 1. The processor 201 may be the processor 20a included in each ECU of FIG. 1. The memory 202 stores a program executed by the processor 201 and data used when the program is executed. The memory 202 may be the memory 20b included in each ECU of FIG. 1.

The imaging unit 203 acquires an image of the surroundings of the vehicle 1. The imaging unit 203 may acquire an image of the front (forward direction) of the vehicle 1, and may additionally acquire an image of a direction other than the front, for example, the rear. The image pickup unit 203 may be the cameras 41 and 42 of FIG. 1, or may be an image pickup device of a drive recorder. The communication unit 204 communicates with another device, for example, the portable device 210. The communication unit 204 may be the communication device 25a of FIG. Communication with other devices by the communication unit 204 may be wired communication or wireless communication. The wireless communication may be peer-to-peer short-range wireless communication, or may be communication via an access point or a base station.

The mobile device 210 may be a mobile terminal having a call function such as a mobile phone or a smartphone. Instead, the portable device 210 may be a device that does not have a call function, for example, a portable game machine. The mobile device 210 can execute a plurality of functions, for example, a standby function (a function of waiting for application startup), a browser function, a music playback function, a moving image playback function, and the like.

The portable device 210 includes a processor 211, a memory 212, a display unit 213, an input unit 214, and a communication unit 215. The processor 211 performs the overall processing of the portable device 210. The memory 212 stores a program executed by the processor 211 and data used when the program is executed. The display unit 213 displays information to the user of the mobile device 210. The display unit 213 is realized by a display device such as a liquid crystal display or an organic EL display. The input unit 214 receives an input from the user of the mobile device 210. The input unit 214 is realized by an input device such as a keypad or a touch panel. The display unit 213 and the input unit 214 may be configured as an integrated device such as a touch screen.

The communication unit 215 communicates with another device, for example, the vehicle 1. Communication with other devices by the communication unit 215 may be wired communication or wireless communication. The wireless communication may be peer-to-peer short-range wireless communication, or may be communication via an access point or a base station.

A communication link 220 is established between the vehicle 1 and the portable device 210 by the communication unit 204 and the communication unit 215. Data is transmitted and received between the vehicle 1 and the portable device 210 via the communication link 220.

With reference to FIG. 3, the operation by the vehicle 1 for displaying the image in front of the vehicle on the portable device 210 will be described. The vehicle 1 starts the operation shown in FIG. 3 when the function of displaying the front image on the portable device 210 is enabled. This function may be automatically enabled when the vehicle 1 is started, or may be enabled according to an instruction from the driver. The operation of FIG. 3 may be executed by the processor 201 executing the computer program stored in the memory 202. In this case, the processor 201 becomes the execution subject of each process in the flowchart of FIG. Alternatively, some or all of the steps in the flowchart of FIG. 3 may be performed by a dedicated processing circuit such as an ASIC (application specific integrated circuit). In this case, the dedicated processing circuit becomes the execution subject of each process.

In step S301, the processor 201 determines whether the connection of the communication link 220 is valid. The processor 201 transitions the process to step S302 when the connection is valid (“YES” in step S301), and transitions the process to step S306 in other cases (“NO” in step S301). If the connection of the communication link 220 is invalid, that is, if the vehicle 1 cannot communicate with the mobile device 210, the vehicle 1 cannot transmit the forward image to the mobile device 210. Therefore, the processor 201 does not create and transmit the forward image described later. Step S301 may be omitted. In this case, a transmission error occurs in the transmission of the front image, which will be described later, and the processor 201 recognizes that the front image cannot be transmitted.

In step S302, the processor 201 determines whether the vehicle 1 is stopped. The processor 201 transitions the process to step S303 when the vehicle 1 is stopped (“YES” in step S302), and transitions the process to step S306 in other cases (“NO” in step S302). If the vehicle 1 is not stopped, the driver should not look at the screen of the mobile device 210. Therefore, the processor 201 does not create and transmit the forward image described later. Further, by not transmitting the forward image, the battery consumption of the portable device 210 can be suppressed. Further, when the communication between the vehicle 1 and the portable device 210 is wireless communication, the amount of communication can be reduced. The processor 201 may determine whether or not the vehicle 1 is stopped by using a wheel speed sensor or the like provided on the vehicle 1. Step S302 may be omitted. In this case, the vehicle 1 transmits the front image in the step described later regardless of whether the vehicle 1 is stopped.

In step S303, the processor 201 determines whether the display unit 213 of the mobile device 210 is on. The processor 201 transitions the process to step S304 when the display unit 213 of the portable device 210 is on (“YES” in step S303), and performs the process in step S306 in other cases (“NO” in step S303). Transition to. If the display unit 213 of the mobile device 210 is not on, it is considered that the driver is not looking at the display unit 213. Therefore, even if the vehicle 1 transmits the front image to the mobile device 210, the driver does not see the front image. Therefore, the processor 201 does not create and transmit the forward image described later. Further, by not transmitting the forward image, the battery consumption of the portable device 210 can be suppressed. The processor 201 may acquire information indicating the operating status of the display unit 213 of the mobile device 210 from the mobile device 210. Alternatively or additionally, the processor 201 may determine the operating status of the display unit 213 of the mobile device 210 based on the image of the camera 44 facing the vehicle interior. Step S302 may be omitted. In this case, the vehicle 1 transmits the front image in the step described later regardless of whether the vehicle 1 is stopped.

In step S304, the processor 201 uses the imaging unit 203 to generate a forward image. The front image may be the image itself taken by the camera 41 that captures the front of the vehicle 1, or may be an image obtained by processing this image.

In step S305, the processor 201 uses the communication unit 204 to transmit the generated forward image to the mobile device 210. Steps S304 and S305 are executed when all of the above steps S301, S302 and S303 are YES. That is, the conditions for the vehicle 1 to transmit the front image to the mobile device 210 are that the connection with the mobile device 210 is valid, the vehicle 1 is stopped, and the display unit 213 is on. And, including. If any of steps S301-S303 described above is omitted, the corresponding requirement is omitted from this condition.

In step S306, the processor 201 determines whether the function of displaying the front image on the portable device 210 has been disabled. The processor 201 ends the process when the function of displaying the front image on the portable device 210 is disabled (“YES” in step S306), and steps the process in other cases (“NO” in step S306). Transition to S301. This function may be disabled when the operation of the vehicle 1 is completed (for example, the power is turned off), or may be disabled according to an instruction from the driver.

As described with reference to FIG. 3, the operations of steps S301 to S306 are repeated while the function of displaying the front image is effective. The repetition period may be, for example, 20 milliseconds. Therefore, when the conditions of steps S301 to S303 are changed, whether or not to execute steps S304 and S305 is immediately switched accordingly. For example, it is assumed that all the conditions of steps S301 to S303 are satisfied, and the processor 201 is transmitting the forward image to the mobile device 210. When the vehicle 1 transmits in this state, the condition of step S302 is not satisfied, and the processor 201 does not generate and transmit the front image.

With reference to FIG. 4, the operation by the mobile device 210 for displaying the image in front of the vehicle on the mobile device 210 will be described. The mobile device 210 starts the operation shown in FIG. 4 when the function of displaying the front image on the mobile device 210 is enabled. This function may be enabled in response to an instruction from the vehicle 1 or may be enabled in response to an instruction from the driver. The operation of FIG. 4 may be executed by the processor 211 executing the computer program stored in the memory 212. In this case, the processor 211 becomes the execution subject of each process in the flowchart of FIG. Alternatively, some or all of the steps in the flowchart of FIG. 4 may be performed by a dedicated processing circuit such as an ASIC (application specific integrated circuit). In this case, the dedicated processing circuit becomes the execution subject of each process.

In step S401, the processor 211 determines whether or not the front image has been received from the vehicle 1. When the processor 211 receives the front image from the vehicle 1 (“YES” in step S401), the processor transitions to step S402, and in other cases (“NO” in step S401), the processor transitions to step S403. ..

In step S402, the processor 211 generates a screen that includes an image based on the function being executed by the mobile device 210 and a received forward image. The function being executed by the mobile device 210 is a function currently being executed by the mobile device 210 among a plurality of functions possessed by the mobile device 210. An image to be displayed on the display unit 213 while the mobile device 210 is executing this function is called a base image. The processor 211 generates a screen including the base image and the forward image.

An example of the screen 500 generated in step S402 will be described with reference to FIG. The screen 500 includes a base image 501 and a front image 502. The base image 501 is an image to be displayed while the mobile device 210 is executing the standby function. The base image 501 may be an image to be displayed while a function other than the standby function is being executed. The front image 502 is an image showing the situation in front of the vehicle 1. On the screen 500, the front image 502 is superimposed on the base image 501. Instead, the entire base image 501 may be displayed on a part of the screen 500, and the entire front image 502 may be displayed on another part of the screen 500. That is, the base image 501 and the front image 502 may not be superimposed on each other and may be displayed side by side.

In step S403, processor 211 generates a screen containing the base image. Since the processor 211 has not received the front image from the vehicle 1, the front image is not included in this screen.

In step S404, the processor 211 displays the generated screen on the display unit 213. When the screen includes a front image, the driver can grasp the situation in front of the vehicle 1 while looking at the display unit 213 of the portable device 210.

In step S405, the processor 211 determines whether the function of displaying the front image on the portable device 210 has been disabled. The processor 211 ends the process when the function of displaying the front image on the portable device 210 is disabled (“YES” in step S405), and steps the process in other cases (“NO” in step S405). Transition to S401. This function may be disabled when the operation of the vehicle 1 is completed, or may be disabled according to an instruction from the driver.

As described with reference to FIG. 4, the operations of steps S401 to S405 are repeated while the function of displaying the front image is effective. The repetition period may be, for example, 20 milliseconds. Therefore, when the condition of step S401 is changed, the execution of step S402 or the execution of step S403 is immediately switched accordingly. For example, it is assumed that the condition of step S401 is satisfied and the mobile device 210 is displaying a screen including a front image. If the front image is no longer received from the vehicle 1 in this state, the condition of step S401 is not satisfied, and the processor 211 does not display the front image. In this case, only the base image is displayed on the display unit 213.

An example of modification of the above-described embodiment will be described with reference to FIGS. 5 to 9. The following modification examples can be implemented in combination. The processor 201 of the vehicle 1 highlights at least one of the traffic lights, vehicles and pedestrians included in the front image in step S304 described above. FIG. 5 shows an example of a front image 502 in which a part is highlighted. The front image 502 includes a traffic light 601, a pedestrian 602, and a vehicle 603. As shown in FIG. 5, the traffic light 601 and the pedestrian 602 and the vehicle 603 are all highlighted by being surrounded by a broken line. The highlighting may be done by other methods. The vehicle 603 to be highlighted may be a four-wheeled vehicle as shown in FIG. 5, a two-wheeled vehicle, or a light vehicle, for example, a bicycle. The processor 201 may highlight only a part of the traffic light 601 and the pedestrian 602 and the vehicle 603, or may highlight them differently. By highlighting in this way, the driver can easily recognize the position of a pedestrian or the like before starting, so that the safety of starting is further improved.

The processor 211 of the mobile device 210 may change the position of the front image 502 in the screen 500 in step S402 described above in response to an input from the user of the mobile device 210. For example, as shown in FIG. 6, the processor 211 may change the display position of the front image 502 from the lower right to the upper left of the screen 500. The display position may be changed, for example, by the user dragging or flicking the front image 502. By making the display position changeable, the convenience of the user is improved.

As shown in FIG. 8, the portable device 210 may include, in addition to the front image 502, an image showing a situation in a direction other than the front of the vehicle 1 on the screen 500. An image showing the situation in a direction other than the front is called an auxiliary image. The auxiliary image may be an image showing the situation behind the vehicle 1. For example, the auxiliary image 801 is an image of the rear of the vehicle 1 taken from the left side mirror of the vehicle 1, and the auxiliary image 802 is an image of the rear of the vehicle 1 taken from the right side mirror of the vehicle 1.

In order to realize the display of the screen 500 of FIG. 8, the processor 201 of the vehicle 1 further generates an auxiliary image in addition to the front image in step S304 of FIG. In step 305 of FIG. 3, processor 201 transmits an auxiliary image to the mobile device 210 in addition to the forward image. The processor 211 of the portable device 210 receives an auxiliary image in addition to the forward image in step S401 of FIG. Processor 211 further includes an auxiliary image on the screen in step S402 of FIG. For example, the processor 211 superimposes the front image 502 and the auxiliary images 801 and 802 on the base image 501. The processor 211 may arrange the front image 502 and the auxiliary images 801 and 802 side by side. By displaying the auxiliary image, the safety is improved even when the vehicle 1 makes a right or left turn immediately after the vehicle starts.

As shown in FIG. 9, the portable device 210 may include information 901 indicating the remaining time until the traffic light in front of the vehicle 1 is switched on the screen 500. In order to realize the display of the screen 500 of FIG. 9, the processor 201 of the vehicle 1 acquires the remaining time until the traffic light in front of the vehicle 1 is switched in addition to the generation of the front image in step S304 of FIG. .. Information representing the remaining time is acquired from, for example, V2I (Vehicle to Infrastructure) signal data from a traffic light. In step 305 of FIG. 3, the processor 201 transmits information indicating the remaining time in addition to the forward image to the mobile device 210. In step S401 of FIG. 4, the processor 211 of the portable device 210 further receives information indicating the remaining time in addition to the forward image. The processor 211 further includes information representing the remaining time on the screen in step S402 of FIG. By displaying information representing the remaining time, the driver can smoothly prepare to return to the driving position.

<Summary of Embodiment>
<Item 1>
A display system (200) including a vehicle (1) and a portable device (210).
The vehicle
A front image generation unit (201, S304) that generates a front image (502) showing the situation in front of the vehicle, and
A transmission unit (204) for transmitting the forward image to the mobile device is provided.
The portable device is
A receiving unit (215) that receives the front image from the vehicle, and
A screen generator (211 and S404) that generates a screen (500) including a base image (501) and a front image based on the function being executed by the portable device.
A display system including a display unit (213) for displaying the screen.
According to this item, the driver who is looking at the screen of the portable device while the vehicle is stopped can safely start. For example, the driver can grasp the situation in front of the vehicle by looking at a part of the screen of the portable device, so that he / she can prepare to return to the driving posture before starting.
<Item 2>
The vehicle further includes a stop determination unit (201, S302) for determining whether or not the vehicle is stopped.
The display system according to item 1, wherein the condition for the transmitting unit to transmit the front image to the portable device includes that the vehicle is stopped.
According to this item, since the front image is not displayed when the vehicle is not stopped, it is possible to prevent the driver from looking at the screen of the portable device while the vehicle is running. <Item 3>
The vehicle further includes a display determination unit (201, S303) for determining whether or not the display unit of the portable device is on.
The display system according to item 1 or 2, wherein the condition for the transmitting unit to transmit the front image to the portable device includes that the display unit is on.
According to this item, by not transmitting the forward image while the driver is not looking at the screen of the mobile device, it is possible to promote the driver's recognition of the surrounding environment and reduce the battery usage of the mobile terminal.
<Item 4>
The display system according to item 2 or 3, wherein the vehicle and the portable device can wirelessly communicate with each other.
According to this item, the amount of communication can be reduced by not transmitting the forward image.
<Item 5>
The front image generation unit further generates auxiliary images (801, 802) showing a situation in a direction other than the front of the vehicle.
The transmission unit further transmits the auxiliary image to the portable device, and the transmission unit further transmits the auxiliary image to the portable device.
The display system according to any one of items 1 to 4, wherein the screen generation unit further includes the auxiliary image in the screen.
According to this item, safety is improved even when turning left or right immediately after the vehicle starts.
<Item 6>
The vehicle further includes an acquisition unit (201) for acquiring the remaining time until the traffic light in front of the vehicle is switched.
The transmission unit further transmits the remaining time to the portable device, and the transmission unit further transmits the remaining time to the portable device.
The display system according to any one of items 1 to 5, wherein the screen generation unit includes information (901) representing the remaining time in a part of the screen.
According to this item, the time until the traffic light is switched can be grasped, so that the driver can smoothly prepare to return to the driving position.
<Item 7>
Any one of items 1 to 6, wherein the front image generation unit highlights at least one of a traffic light (601), a vehicle (603), and a pedestrian (602) included in the front image. The display system according to item 1.
According to this item, the driver can easily recognize the position of a pedestrian or the like before starting, so that the safety of starting is further improved.
<Item 8>
The display system according to any one of items 1 to 7, wherein the screen generation unit changes the position of the front image on the screen in response to an input from the user of the portable device. ..
According to this item, the convenience of the user is improved.
<Item 9>
The display system according to any one of items 1 to 8, wherein the screen generation unit superimposes the front image on the base image.
According to this item, the screen space can be effectively used.
<Item 10>
Vehicle (1)
A front image generation unit (201, S304) that generates a front image (502) showing the situation in front of the vehicle, and
A vehicle including a transmission unit (204) for transmitting the front image to a mobile device.
According to this item, the driver who is looking at the screen of the portable device while the vehicle is stopped can safely start.
<Item 11>
The vehicle further includes a stop determination unit (201, S302) for determining whether or not the vehicle is stopped.
The vehicle according to item 10, wherein the condition for the transmitting unit to transmit the front image to the portable device includes that the vehicle is stopped.
According to this item, since the front image is not displayed when the vehicle is not stopped, it is possible to prevent the driver from looking at the screen of the portable device while the vehicle is running. <Item 12>
The vehicle further includes a display determination unit (201, S303) for determining whether or not the display unit of the portable device is on.
The vehicle according to item 10 or 11, wherein the condition for the transmitting unit to transmit the front image to the portable device includes that the display unit is on.
According to this item, by not transmitting the forward image while the driver is not looking at the screen of the mobile device, it is possible to promote the driver's recognition of the surrounding environment and reduce the battery usage of the mobile terminal.
<Item 13>
The vehicle according to item 11 or 12, wherein the vehicle and the portable device can wirelessly communicate with each other.
According to this item, the amount of communication can be reduced by not transmitting the forward image.
<Item 14>
The front image generation unit further generates auxiliary images (801, 802) showing a situation in a direction other than the front of the vehicle.
The vehicle according to any one of items 10 to 13, wherein the transmission unit further transmits the auxiliary image to the portable device.
According to this item, safety is improved even when turning left or right immediately after the vehicle starts.
<Item 15>
The vehicle further includes an acquisition unit (201) for acquiring the remaining time until the traffic light in front of the vehicle is switched.
The vehicle according to any one of items 10 to 14, wherein the transmission unit further transmits the remaining time to the portable device.
According to this item, the driver can afford to prepare to return to the driving position because the time until the traffic light is switched can be grasped.
<Item 16>
Any one of items 10 to 15, wherein the front image generation unit highlights at least one of a traffic light (601), a vehicle (603), and a pedestrian (602) included in the front image. The vehicle described in item 1.
According to this item, the driver can easily recognize the position of a pedestrian or the like before starting, so that the safety of starting is further improved.
<Item 17>
It is a portable device (210)
A receiving unit (215) that receives a front image (502) showing the situation in front of the vehicle (1) from the vehicle, and
A screen generator (211 and S404) that generates a screen (500) including a base image (501) and a front image based on the function being executed by the portable device.
A portable device including a display unit (213) for displaying the screen.
According to this item, the driver who is looking at the screen of the portable device while the vehicle is stopped can safely start.
<Item 18>
The mobile device according to item 17, wherein the screen generation unit changes the position of the front image on the screen in response to an input from the user of the mobile device.
According to this item, the convenience of the user is improved.
<Item 19>
The portable device according to item 17 or 18, wherein the screen generation unit superimposes the front image on the base image.
According to this item, the screen space can be effectively used.

The invention is not limited to the above-described embodiment, and various modifications and changes can be made within the scope of the gist of the invention.

1 vehicle, 2 control device, 20-29 ECU, 7A accelerator pedal, 7B brake pedal, 31 steering wheel

Claims (19)

A display system equipped with a vehicle and a portable device.
The vehicle
A front image generator that generates a front image showing the situation in front of the vehicle,
A transmission unit that transmits the front image to the mobile device is provided.
The portable device is
A receiving unit that receives the front image from the vehicle, and
A screen generator that generates a screen including a base image based on the function being executed by the mobile device and the front image, and a screen generator.
A display system including a display unit for displaying the screen. The vehicle further includes a stop determination unit for determining whether or not the vehicle is stopped.
The display system according to claim 1, wherein the condition for the transmitting unit to transmit the front image to the portable device includes that the vehicle is stopped. The vehicle further includes a display determination unit that determines whether or not the display unit of the portable device is on.
The display system according to claim 1 or 2, wherein the condition for the transmission unit to transmit the front image to the portable device includes that the display unit is on. The display system according to claim 2 or 3, wherein the vehicle and the portable device can wirelessly communicate with each other. The front image generation unit further generates an auxiliary image showing a situation in a direction other than the front of the vehicle, and further generates an auxiliary image.
The transmission unit further transmits the auxiliary image to the portable device, and the transmission unit further transmits the auxiliary image to the portable device.
The display system according to any one of claims 1 to 4, wherein the screen generation unit further includes the auxiliary image in the screen. The vehicle further includes an acquisition unit that acquires the remaining time until the traffic light in front of the vehicle is switched.
The transmission unit further transmits the remaining time to the portable device, and the transmission unit further transmits the remaining time to the portable device.
The display system according to any one of claims 1 to 5, wherein the screen generation unit includes information representing the remaining time in a part of the screen. The display system according to any one of claims 1 to 6, wherein the front image generation unit highlights at least one of a traffic light, a vehicle, and a pedestrian included in the front image. The display according to any one of claims 1 to 7, wherein the screen generation unit changes the position of the front image on the screen in response to an input from the user of the portable device. system. The display system according to any one of claims 1 to 8, wherein the screen generation unit superimposes the front image on the base image. It ’s a vehicle
A front image generator that generates a front image showing the situation in front of the vehicle,
A vehicle including a transmission unit that transmits the front image to a mobile device. The vehicle further includes a stop determination unit for determining whether or not the vehicle is stopped.
The vehicle according to claim 10, wherein the condition for the transmitting unit to transmit the front image to the portable device includes that the vehicle is stopped. The vehicle further includes a display determination unit for determining whether or not the display unit of the portable device is on.
The vehicle according to claim 10 or 11, wherein the condition for the transmitting unit to transmit the front image to the portable device includes that the display unit is on. The vehicle according to claim 11 or 12, wherein the vehicle and the portable device can wirelessly communicate with each other. The front image generation unit further generates an auxiliary image showing a situation in a direction other than the front of the vehicle, and further generates an auxiliary image.
The vehicle according to any one of claims 10 to 13, wherein the transmitting unit further transmits the auxiliary image to the portable device. The vehicle further includes an acquisition unit that acquires the remaining time until the traffic light in front of the vehicle is switched.
The vehicle according to any one of claims 10 to 14, wherein the transmission unit further transmits the remaining time to the portable device. The vehicle according to any one of claims 10 to 15, wherein the front image generation unit highlights at least one of a traffic light, a vehicle, and a pedestrian included in the front image. It ’s a mobile device,
A receiver that receives a front image showing the situation in front of the vehicle from the vehicle, and
A screen generator that generates a screen including a base image based on the function being executed by the mobile device and the front image, and a screen generator.
A portable device including a display unit for displaying the screen. The mobile device according to claim 17, wherein the screen generation unit changes the position of the front image on the screen in response to an input from the user of the mobile device. The portable device according to claim 17 or 18, wherein the screen generation unit superimposes the front image on the base image.

Images