JP2018075868A - Image processing device, image processing system and image processing method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve the operability at the setting of support information.SOLUTION: An image processing device includes a signal output part, a reception part, a signal replacement part and an image output part. The signal output part outputs a shift signal input from a shift sensor of a vehicle to a display device. The reception part receives an operation signal at the setting start by a user. The signal replacement part replaces a parking signal output by the signal output part with a reverse signal in the case of being in the specific state where the reception part receives the operation signal and the shift signal is the parking signal. The image output part outputs a setting image performing setting of information displayed on the display device to the display device in a case of being in the specific state.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an image processing apparatus, an image processing system, and an image processing method.

  2. Description of the Related Art Conventionally, there is an image processing apparatus that generates information (hereinafter referred to as support information) for assisting driving based on captured images around a vehicle and outputs the information to a display device. In such an image processing apparatus, for example, support information can be set at the time of attachment or the like (see, for example, Patent Document 1).

  The in-vehicle display device displays support information generated by the image processing device when a reverse signal input from a shift sensor of the vehicle is received.

JP 2000-134608 A

  However, in the above-described conventional technology, the user needs to set the support information in a state where the shift lever of the vehicle is reversed, and the operability may be reduced.

  The present invention has been made in view of the above, and an object of the present invention is to provide an image processing apparatus, an image processing system, and an image processing method that can improve operability when setting support information.

  In order to solve the above-described problems and achieve the object, an image processing apparatus according to the present invention includes a signal output unit, a reception unit, a signal replacement unit, and an image output unit. The signal output unit outputs a shift signal input from the vehicle shift sensor to the display device. The reception unit receives an operation signal for starting setting by a user. The signal replacement unit replaces the parking signal output from the signal output unit with a reverse signal when the reception unit receives the operation signal and the shift signal is in a specific state that is a parking signal. The image output unit outputs a setting image for setting information to be displayed on the display device to the display device in the specific state.

  According to the present invention, it is possible to provide an image processing apparatus, an image processing system, and an image processing method capable of improving operability when setting support information.

FIG. 1 is a diagram showing an outline of an image processing method. FIG. 2 is a block diagram showing the configuration of the image processing system. FIG. 3 is a diagram illustrating an example of the operation unit. FIG. 4 is a state transition diagram of the image processing system. FIG. 5A is a diagram (part 1) illustrating a specific example of a setting image. FIG. 5B is a second diagram illustrating a specific example of the setting image. FIG. 5C is a third diagram illustrating a specific example of the setting image. FIG. 5D is a diagram (part 4) illustrating a specific example of the setting image. FIG. 6 is a diagram illustrating an example of a warning image. FIG. 7 is a flowchart illustrating a first processing procedure executed by the image processing apparatus. FIG. 8 is a flowchart illustrating a second processing procedure executed by the image processing apparatus.

  Hereinafter, an image processing apparatus, an image processing system, and an image processing method according to the present invention will be described with reference to the accompanying drawings. In addition, this invention is not limited by this embodiment.

  First, the outline of the image processing method according to the embodiment will be described with reference to FIG. FIG. 1 is a diagram illustrating an overview of an image processing method according to the embodiment. Note that this image processing method is executed by the image processing apparatus 10.

  Further, the image processing apparatus 10 generates information (hereinafter referred to as support information) for supporting driving of the vehicle 100 based on a captured image input from a camera C (see FIG. 2) described later, for example. Note that the image processing apparatus 10 can generate, for example, a fixed guide line indicating the vehicle width of the vehicle 100 as the support information.

  As shown in FIG. 1, the image processing apparatus 10 is mounted on a vehicle 100. The image processing device 10 is installed between the shift sensor 5 and the display device 31 and connected to the shift sensor 5 and the display device 31.

  The shift sensor 5 generates a shift signal indicating the position of the shift lever and outputs it to the image processing apparatus 10. The display device 31 is, for example, a touch panel display including an operation unit, and displays, for example, a navigation image generated by a navigation device 32 (see FIG. 2) described later.

  In general, the in-vehicle display device 31 is switched to an external input instead of the navigation image input from the navigation device 32 when a reverse signal is input from the shift sensor 5.

  This is because, when the vehicle 100 moves backward, the display device 31 displays a captured image in which the periphery of the vehicle 100 is captured.

  Here, for example, when the user purchases a used car, the image processing apparatus 10 may be attached later to the vehicle 100 including the display device 31. For this reason, the user needs to set support information such as the above-described fixed guide line in accordance with the vehicle 100 to be attached.

  However, in the conventional image processing apparatus, it is necessary to reverse the shift lever in order to switch the display device 31 to the external input when setting the support information.

  When the shift lever is reverse, the user needs to check the side brake so that the vehicle 100 does not move. Further, when the shift lever is in the reverse state, a beep sound is generated from the vehicle 100, and the user may feel the beep sound troublesome.

  For these reasons, in the conventional image processing apparatus, it is necessary to reverse the shift lever when setting the support information, and the operability of the user may be reduced.

  Therefore, in the image processing method according to the embodiment, the operability at the time of setting the support information is improved by enabling the setting of the support information when the shift lever is parking. The outline of the image processing method according to the embodiment will be described below.

  For example, the image processing apparatus 10 receives a setting start operation signal from the user from an operation unit 14 (see FIG. 2) described later (step S1). At this time, the image processing apparatus 10 checks the shift signal input from the shift sensor 5, for example.

  If the shift signal is a parking signal, the image processing device 10 replaces the parking signal with a reverse signal and outputs the signal to the display device 31 (step S2).

  That is, the image processing apparatus 10 receives the operation signal and replaces the shift signal output to the display device 31 from the parking signal to the reverse signal when the shift signal is in the specific state that is the parking signal.

  Thereby, even if a shift lever is parking, the display apparatus 31 can be switched to an external input. Then, in the case of the specific state described above, the image processing apparatus 10 outputs a support information setting image to the display device 31 (step S3).

  Therefore, the setting image is displayed on the display device 31, and the support information can be set in a state where the shift lever is parked. Therefore, unlike the case where the shift lever is reverse, it is not necessary to check the side brake, and the setting operation can be performed in a state where the above-described beep sound is not generated.

  Therefore, according to the image processing method according to the embodiment, it is possible to improve operability when setting support information. Note that the image processing apparatus 10 may perform the processes of step S2 and step S3 in parallel when the specific state described above is reached, or the process of step S3 is performed prior to the process of step S2. You may decide to do it.

  By the way, the image processing apparatus 10 can detect an obstacle that may collide with the vehicle 100 and can also set a detection range of the obstacle. Details of this point will be described later with reference to FIG. 5C.

  Further, as described above, for example, the image processing device 10 is attached to the display device 31 later. For this reason, the image processing apparatus 10 includes a dedicated operation unit 14 so that support information can be set regardless of the model of the display device 31. Details of this point will be described later with reference to FIG.

  Hereinafter, in order to avoid the confusion of terms, the reverse signal input from the shift sensor 5 may be referred to as a vehicle reverse signal, and the reverse signal replaced by the image processing device 10 may be referred to as a pseudo reverse signal.

  Next, the configuration of the image processing system 50 including the image processing apparatus 10 will be described with reference to FIG. FIG. 2 is a block diagram of the image processing system 50. FIG. 2 shows the shift sensor 5 and the navigation device 32 together.

  As shown in FIG. 2, the image processing system 50 includes an image processing device 10, a display device 31, and a camera C. The display device 31 is a touch panel display, for example, and displays a navigation image input from the navigation device 32. Further, when a reverse signal is input, the display device 31 is switched to an external input instead of the navigation image. The display device 31 displays an image input from the image processing device 10 during the period of the external input mode.

  In addition, although this embodiment demonstrates the case where the display apparatus 31 functions as a display part of the navigation apparatus 32, it is not limited to this.

  For example, the display device 31 may be a so-called audio display having a television reception function, a CD (Compact Disc) playback function, a DVD (Digital Versatile Disk) playback function, and the like.

  The navigation device 32 generates a navigation image such as a map showing a route to the destination and outputs it to the display device 31. In addition, the navigation device 32 has a function of reproducing moving images and music, and can output such moving images and music to the display device 31.

  The camera C includes an imaging element such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS), and is a back camera that images the rear of the vehicle 100, for example.

  Further, the camera C outputs the captured image to the control unit 11 of the image processing apparatus 10. In the image processing system 50, a plurality of cameras C may be provided so as to capture the entire periphery of the vehicle 100.

  The image processing apparatus 10 includes a control unit 11, a storage unit 12, a signal output unit 13, and an operation unit 14. The storage unit 12 stores setting information 12a. The details of the operation unit 14 will be described later with reference to FIG.

  The control unit 11 includes, for example, a computer having a central processing unit (CPU), a read only memory (ROM), a random access memory (RAM), a hard disk drive (HDD), an input / output port, and various circuits.

  The CPU of the computer functions as a receiving unit 11a, a signal replacement unit 11b, an object detection unit 11c, an image generation unit 11d, and an image output unit 11e of the control unit 11, for example, by reading and executing a program stored in the ROM. To do.

  In addition, at least one or all of the reception unit 11a, the signal replacement unit 11b, the object detection unit 11c, the image generation unit 11d, and the image output unit 11e of the control unit 11 are connected to an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). ) Or the like.

  Moreover, the memory | storage part 12 respond | corresponds to ROM and HDD, for example. The ROM and HDD can store setting information 12a. Note that the control unit 11 may acquire various types of information via another computer or a portable recording medium connected via a wired or wireless network.

  The receiving unit 11a receives a setting start operation signal input from the operation unit 14. Then, when receiving the operation signal, the reception unit 11a outputs a replacement request to the signal replacement unit 11b.

  The accepting unit 11 a accepts an operation signal input from the operation unit 14 when setting support information, and updates the setting information 12 a stored in the storage unit 12. Thereby, the image processing apparatus 10 can output the support information set by the user.

  When a replacement request is input from the reception unit 11a and the shift signal input from the shift sensor 5 is a parking signal, the signal replacement unit 11b replaces the parking signal with a pseudo reverse signal.

  In other words, the signal replacement unit 11b replaces the parking signal output by the signal output unit 13 with a reverse signal when the reception unit 11a receives an operation signal and the shift signal is a specific state.

  Then, the signal replacement unit 11 b outputs a pseudo reverse signal to the signal output unit 13. At this time, the signal replacement unit 11b instructs the image generation unit 11d to generate a setting image.

  When the replacement request is input from the reception unit 11a and the shift signal input from the shift sensor 5 is other than the parking signal, the signal replacement unit 11b warns the image generation unit 11d instead of the set image. Instructs generation of an image.

  At this time, the signal replacement unit 11 b replaces the shift signal other than the vehicle reverse signal and the parking signal with the pseudo reverse signal and outputs the signal to the signal output unit 13. As a result, the image output unit 11e outputs a warning image during a period in which the display device 31 is switched to the external input.

  Details of the setting image will be described later with reference to FIGS. Details of the warning image will be described later with reference to FIG.

  Further, the signal replacement unit 11b supports the image generation unit 11d when the operation signal for starting the setting is not input from the reception unit 11a, that is, when the vehicle reverse signal is input from the shift sensor 5 except when the support information is set. Instructs the generation of information.

  The signal output unit 13 outputs the shift signal input from the shift sensor 5 to the display device 31. The signal output unit 13 is, for example, an OR synthesis circuit, and OR-synthesizes the vehicle reverse signal and the pseudo reverse signal input from the shift sensor 5 and the signal replacement unit 11 b and outputs the result to the display device 31.

  In other words, the signal output unit 13 outputs a reverse signal to the display device 31 when at least one of the vehicle reverse signal and the pseudo reverse signal is input.

  The signal output unit 13 may output a shift signal other than the reverse signal to the display device 31 or may not output it.

  As shown in the figure, in the image processing apparatus 10, the signal output unit 13 is provided separately from the control unit 11. By doing so, it is possible to output a vehicle reverse signal input from the shift sensor 5 to the display device 31 even when a malfunction such as a failure occurs in the control unit 11.

  That is, the vehicle reverse signal can be reliably output to the display device 31 even when a malfunction occurs in the control unit 11. The signal output unit 13 may be provided in the control unit 11 and function as software.

  Moreover, although the figure showed the case where the captured image of the camera C was output to the display apparatus 31 via the image processing apparatus 10, the camera C may output a captured image directly to the display apparatus 31. Good.

  By doing in this way, even if it is a case where the image processing apparatus 10 fails, the user can confirm the captured image of the back of the vehicle 100, when a shift lever is reversed.

  The object detection unit 11c detects an obstacle existing around the vehicle 100 based on a captured image input from the camera C, for example. For example, the object detection unit 11c extracts a movement vector (optical flow) connecting the same feature points from a plurality of frames of captured images arranged in time series, and the position and size of the obstacle based on the extracted optical flow. Is detected.

  When the object detection unit 11c detects an obstacle within the detection range, the object detection unit 11c outputs the detection result to the image generation unit 11d and instructs generation of a warning symbol. Thus, the image processing apparatus 10 can notify the user of the presence of an obstacle by including the object detection unit 11c.

  Therefore, it is possible to assist the vehicle 100 in avoiding a collision with an obstacle. Note that the object detection unit 11c may detect an obstacle based on a signal input from a radar (not shown) such as a sonar provided around the vehicle 100, for example.

  In the image processing apparatus 10, the obstacle detection range by the object detection unit 11c can be set. Details of this point will be described later with reference to FIG. 5C.

  The image generation unit 11d receives a setting image or warning image generation instruction input from the signal replacement unit 11b, generates a setting image or warning image, and outputs the setting image or warning image to the image output unit 11e.

  In addition, the image generation unit 11d generates an image for synthesis serving as support information and outputs it to the image output unit 11e. For example, the image generation unit 11d generates a fixed guide line indicating the vehicle width of the vehicle 100 as the composition image.

  In addition, the image generation unit 11d can synthesize a prediction line indicating a travel locus of the vehicle 100 predicted based on a sensor value input from a steering angle sensor (not shown), for example. As described above, the image generation unit 11d generates a fixed guide line or a prediction line as a synthesis image. Thereby, driving of the vehicle 100 can be supported.

  The image generation unit 11d can also generate a warning symbol as an image for synthesis in response to a detection result from the object detection unit 11c. Thereby, the display device 31 can be visually warned of the presence of an obstacle. In such a case, for example, a warning sound may be output from a speaker (not shown).

  When a plurality of cameras C that capture the entire periphery of the vehicle 100 are provided, the image generation unit 11d may generate a virtual viewpoint image when the vehicle 100 is viewed from the upper virtual viewpoint as support information.

  The image output unit 11e outputs the setting image input from the image generation unit 11d to the display device 31 when the signal replacement unit 11b replaces the parking signal with a pseudo reverse signal. In other words, the image output unit 11e outputs the above-described setting image to the display device 31 when the reception unit 11a receives an operation signal and the shift signal is a parking signal.

  Further, when the vehicle 100 moves backward, the image output unit 11e superimposes the composite image generated by the image generation unit 11d on the captured image input from the camera C and outputs the superimposed image to the display device 31.

  Next, the operation unit 14 will be described with reference to FIG. FIG. 3 is a diagram illustrating an example of the operation unit 14. As shown in the figure, the operation unit 14 is connected to the control unit 11 via a cable, for example.

  For example, the operation unit 14 includes a plurality of switches. In the example shown in the figure, the operation unit 14 includes a changeover switch 14a, a determination switch 14b, a minus switch 14c, and a plus switch 14d.

  For example, when the changeover switch 14 a is pressed by the user, the operation unit 14 outputs a setting start operation signal to the control unit 11. That is, a setting screen or a warning image is displayed on the display device 31 when the changeover switch 14a is pressed.

  The decision switch 14b, the minus switch 14c, and the plus switch 14d are switches for adjusting support information when setting support information. When the determination switch 14b, the minus switch 14c, and the plus switch 14d are operated, the operation unit 14 outputs an operation signal corresponding to each switch to the reception unit 11a.

  As described above, the image processing apparatus 10 is provided with the dedicated operation unit 14. This is because the support information may not be set when the display device 31 does not include an operation unit, for example.

  Therefore, by providing the dedicated operation unit 14, it is possible to set support information regardless of the model of the display device 31. In the image processing apparatus 10, the operation unit 14 is detachable from the control unit 11.

  For example, when the operation unit 14 is removed after setting the support information, the installation space of the image processing apparatus 10 can be reduced in size by the operation unit 14.

  Further, when setting support information at a store where the image processing apparatus 10 is purchased, it is sufficient to have one operation unit 14 at each store. Therefore, since it is sufficient to manufacture fewer operation units 14 than the image processing apparatus 10, it is possible to provide the operation unit 14 at a reduced price.

  Further, when the operation unit 14 is left attached after the support information is set, each switch of the operation unit 14 functions as another switch, for example, as a switch for switching the viewpoint position of the virtual viewpoint image described above. It can also be made.

  Note that the operation unit 14 shown in the figure is an example, and the present invention is not limited to this. For example, the operation unit 14 may be configured with a touch pad or the like.

  Moreover, although the case where the operation part 14 and the control part 11 were connected via a cable was shown, it is good also as the operation part 14 and the control part 11 being mutually connected by radio | wireless communication. Further, when the display device 31 supports the setting operation, the operation unit 14 is not necessary.

  Next, a state transition diagram of the image processing system 50 will be described with reference to FIG. FIG. 4 is a state transition diagram of the image processing system 50. As shown in the figure, the image processing system 50 has, for example, a navigation mode st1, a setting mode st2, and a reverse mode st3.

  For example, in the navigation mode st1, the display device 31 displays a navigation image, a moving image, or the like input from the navigation device 32. Further, in the navigation mode st1, route guidance, moving image voice and music are output from a speaker (not shown). In the setting mode st2, the display device 31 displays a setting image input from the image processing device 10.

  Further, in the reverse mode st3, the display device 31 displays the support image input from the image processing device 10. In the setting mode st2 and the reverse mode st3, since the reverse signal is input to the display device 31, the external input mode is set.

  Next, the transition conditions c1 to c6 for the modes st1 to st3 shown in FIG. The transition conditions c1 and c5 from the navigation mode st1 and the reverse mode st3 to the setting mode st2 are shifted when the user presses the changeover switch 14a shown in FIG.

  Further, the transition condition c2 from the setting mode st2 to the navigation mode st1 is, for example, that the user finishes the setting of support information (for example, an operation for selecting the OK button B3 shown in FIG. When the changeover switch 14a shown in FIG.

  Further, the transition condition c3 from the navigation mode st1 to the reverse mode st3 is transitioned, for example, when the user reverses the shift lever. Further, the transition condition c4 from the reverse mode st3 to the navigation mode st1 is transitioned when the user switches the shift lever from reverse to another gear.

  Also, the transition condition c6 from the setting mode st2 to the reverse mode st3 is shifted, for example, when the user switches the shift lever to reverse after the setting is completed. Each transition condition described above is an example, and the present invention is not limited to this.

  Next, details of the setting image will be described with reference to FIGS. 5A to 5D are diagrams illustrating specific examples of setting images. FIG. 5A shows a menu image that is initially displayed as a setting image. Such a menu image is an image generated by the image generation unit 11d.

  As shown in the figure, the menu image includes a plurality of operation items. Such operation items include a fixed guide line setting M1, a predicted line display setting M2, an obstacle detection setting M3, and the like.

  The menu image includes a return button B1 and a backward confirmation button B2 in addition to the operation items. For example, when the return button B1 is selected, the image processing system 50 returns from the setting mode st2 to the navigation mode st1.

  When the backward confirmation button B2 is selected, the image processing system 50 displays a captured image input from the camera C. Thereby, the user can confirm the state of the back, without putting a shift lever into reverse.

  Next, a fixed guide line setting screen will be described with reference to FIG. 5B. This figure shows a case where the fixed guide line setting M1 shown in FIG. 5A is selected. As shown in the figure, the positions of the left guide line LL and the right guide line LR can be set on the fixed guide line setting screen.

  The fixed guide lines and various buttons shown in the figure are images for synthesis generated by the image generation unit 11d, and the setting image is a captured image input from the camera C to the composite image by the image output unit 11e. It is a superposition.

  For example, the user can adjust the position of the left guide line LL by selecting the button BR1 and the button BL1, and can adjust the position of the right guide line LR by selecting the button BR2 and the button BL2.

  At this time, the operation unit 14 outputs an adjustment signal corresponding to the adjustment operation to the reception unit 11a, and the reception unit 11a receives the adjustment signal and updates the setting information 12a in the storage unit 12.

  Then, the image generation unit 11d generates a fixed guide line whose position has been changed based on the updated setting information 12a as a composition image.

  Thus, by displaying the captured image together when setting the fixed guide line, the user can adjust the fixed guide line according to the actual video.

  Thereby, adjustment of a fixed guide line can be made easy and the operativity of the user at the time of a setting can be improved. In addition, it is possible to appropriately support driving by adjusting the fixed guide line.

  In addition, in the same figure, although the case where the display mode of the fixed guide line was set was shown, the captured image may be similarly used for the above-described prediction line. Further, the image processing apparatus 10 may set the thickness, color, or the like as the display mode of the fixed guide line and the predicted line, or may set the fixed guide line and the predicted line so as not to be displayed. .

  Next, an obstacle detection setting image will be described with reference to FIG. 5C. The distance shown in the figure indicates, for example, the distance from the rear end of the vehicle 100 to the detected obstacle. Further, such a setting image is generated by the image generation unit 11d.

  When the user selects the up buttons BU1, BU2 and BU3 shown in the figure, the corresponding digit increases, and by selecting the down button BD1, BD2 and BD3BU1, BD2 and BD3, the corresponding digit increases. Decrease.

  In such a case, the operation unit 14 outputs an adjustment signal corresponding to the adjustment operation to the reception unit 11a as described above, and the reception unit 11a updates the setting information 12a of the storage unit 12 in response to the adjustment signal. .

  Then, the image generation unit 11d generates an image in which the number is changed based on the setting information 12a. In addition, the object detection unit 11c detects an obstacle in the distance detection range set based on the setting information 12a.

  As described above, the image processing apparatus 10 can set an obstacle detection range, so that convenience can be improved. Note that the detection range of the object detection unit 11c is not limited to the rear of the vehicle 100, and may detect an obstacle on the front or side. In such a case, a detection range with a different distance depending on the direction may be set.

  Next, another setting screen will be described with reference to FIG. 5D. As shown in the figure, the vehicle 100 may be moved in the adjustment process in the setting mode st2.

  In such a case, for example, when the user selects the OK button B3, the operation unit 14 outputs a continuation signal to the reception unit 11a. And the reception part 11a continues outputting a replacement request to the signal replacement part 11b.

  Thereby, for example, after the shift lever is switched from parking to driving, the signal replacement unit 11b replaces the shift signal with the pseudo reverse signal.

  For this reason, the display device 31 can continuously display the setting screen. In addition, although the case where the vehicle 100 is moved forward is illustrated here, the vehicle 100 may move backward. In this case, since the shift signal is a vehicle reverse signal, the signal replacement unit 11b does not need to replace the shift signal, but the setting mode st2 is continued.

  Next, the warning image will be described with reference to FIG. FIG. 6 is a diagram illustrating an example of a warning image. This warning image is an image generated by the image generation unit 11d when the shift lever is other than parking when the changeover switch 14a shown in FIG. 3 is operated.

  As shown in the figure, in the warning image, for example, characters that prompt the switching of the shift lever to parking are displayed. And if a user puts a shift lever in parking, it will switch to the setting image shown to FIG. 5A.

  That is, the setting image shown in FIG. 5A is displayed on the display device 31 only when the shift lever is parked. In other words, other than parking, the process is not shifted to the setting of support information.

  Thereby, in parking, since the vehicle 100 does not have a possibility of self-propelling, the user can set support information in a safe state. Note that the warning image is not limited to the example illustrated in FIG. 6, and may be an image that informs the user that the setting image is not displayed, or the warning image may not be generated. Further, a warning sound may be output in accordance with the warning image.

  Next, a processing procedure executed by the image processing system 50 according to the embodiment will be described with reference to FIGS. 7 and 8. FIG. 7 is a flowchart illustrating a first processing procedure executed by the image processing apparatus 10 according to the embodiment. FIG. 8 is a flowchart illustrating a second processing procedure executed by the image processing apparatus 10 according to the embodiment.

  Here, the process executed by the image processing apparatus 10 when the support information is set is referred to as a first process, and the process executed at a time other than the setting time is referred to as a second process.

  As shown in FIG. 7, first, the receiving unit 11a receives a setting start operation signal (step S101), and the signal replacing unit 11b replaces a shift signal other than the reverse signal with a pseudo reverse signal (step S102).

  At this time, the signal replacement unit 11b determines whether or not the shift signal input from the shift sensor 5 is a parking signal (step S103). Here, when the shift signal input from the shift sensor 5 is a parking signal (step S103, Yes), the image output unit 11e displays the setting image illustrated in FIG. The output is made to shift to the setting mode st2 (step S104).

  Note that the image processing apparatus 10 may execute the processes of step S103 and step S102 in parallel, or may execute the process of step S102 after the process of step S103.

  Then, the reception unit 11a receives an operation signal for ending the setting mode st2 (step S105), and the signal replacement unit 11b stops replacing the parking signal with the pseudo-reverse signal (step S106) and ends the process. .

  On the other hand, if it is determined in step S103 that the shift signal input from the shift sensor 5 is not a parking signal (No in step S103), the image output unit 11e outputs a warning image (step S107). Thereafter, the image processing apparatus 10 repeats the processes after step S103. At this time, when the user views the warning image and switches the shift lever to reverse, the image processing apparatus 10 shifts to the setting mode st2.

  Next, a second processing procedure executed by the image processing apparatus 10 will be described with reference to FIG. First, the signal replacement unit 11b determines whether or not the shift signal is a reverse signal (step S201). In this determination, if the shift signal is a reverse signal (step S201, Yes), the signal output unit 13 outputs a reverse signal and shifts to the reverse mode st3 (step S202).

  Then, the image generation unit 11d generates an image for synthesis (step S203), and the image output unit 11e outputs support information in which the image for synthesis is superimposed on the captured image (step S204), and ends the process. .

  If the shift signal is not a reverse signal in the determination of step S201 (step S201, No), the reverse signal is not output to the display device 31, and the image processing system 50 continues the navigation mode st1 (step S201). S205), the process ends.

  As described above, the image processing apparatus 10 according to the present embodiment includes the signal output unit 13, the reception unit 11a, the signal replacement unit 11b, and the image output unit 11e. The signal output unit 13 outputs a shift signal input from the shift sensor 5 of the vehicle 100 to the display device 31. The accepting unit 11a accepts a setting start operation signal by the user. The signal replacement unit 11b replaces the parking signal output by the signal output unit 13 with a reverse signal when the reception unit 11a receives an operation signal and the shift signal is a specific state that is a parking signal. The image output unit 11 e outputs a setting image for setting information to be displayed on the display device 31 to the display device 31 in the specific state. Therefore, according to the image processing apparatus 10 according to the present embodiment, it is possible to improve operability when setting support information.

  In the above-described embodiment, the case where the signal replacement unit 11b replaces the shift signal with the reverse signal when the changeover switch 14a (see FIG. 3) of the operation unit 14 is operated by the user has been described. It is not limited.

  Therefore, hereinafter, another trigger for the signal replacement unit 11b to replace the shift signal with the reverse signal will be described. For example, the control unit 11 or the operation unit 14 may be provided with a function of recognizing a voice or a gesture, and the shift signal may be replaced with a reverse signal triggered by recognition of a predetermined voice keyword or gesture.

  Further, the image processing apparatus 10 may include a communication unit, and the shift signal may be replaced with a reverse signal triggered by communication with an electronic device such as an infrared remote controller or a mobile phone or a smartphone.

  In such a case, for example, an identification image such as a two-dimensional code may be displayed on the display device 31, and the above-described support information may be set only by an electronic device that has read the identification image. Further, asynchronous serial communication may be used as a communication format with the electronic device.

  Further, the image processing apparatus 10 may be connected to various sensors such as a G sensor and an illuminance sensor, and the shift signal may be replaced with a reverse signal using a signal input from the various sensors as a trigger.

  Further, for example, the shift signal may be replaced with a reverse signal when an external medium such as a USB (Universal Serial Bus) or an SD card is inserted into the image processing apparatus 10 as a trigger.

  Further, the image processing apparatus 10 acquires a vehicle signal such as an illumination signal, and the signal replacement unit 11b replaces the shift signal with a reverse signal triggered by the vehicle signal blinking a predetermined number of times or more within a predetermined time. Also good.

  Further effects and modifications can be easily derived by those skilled in the art. Thus, the broader aspects of the present invention are not limited to the specific details and representative embodiments shown and described above. Accordingly, various modifications can be made without departing from the spirit or scope of the general inventive concept as defined by the appended claims and their equivalents.

DESCRIPTION OF SYMBOLS 10 Image processing apparatus 11a Reception part 11b Signal replacement part 11c Object detection part 11d Image generation part 11e Image output part 13 Signal output part 14 Operation part 31 Display apparatus 32 Navigation apparatus 50 Image processing system 100 Vehicle
C camera

Claims (9)

A signal output unit that outputs a shift signal input from a shift sensor of the vehicle to a display device;
A reception unit for receiving an operation signal for starting setting by a user;
A signal replacement unit that replaces the parking signal output by the signal output unit with a reverse signal when the receiving unit receives the operation signal and the shift signal is a parking signal in a specific state;
An image processing apparatus comprising: an image output unit configured to output a setting image for setting information to be displayed on the display device to the display device in the specific state. The display device
The image processing apparatus according to claim 1, wherein when the reverse signal is input, an image output from the image output unit is displayed by shifting to an external input state. An image generation unit that generates an image for synthesis indicating the vehicle width of the vehicle as the information;
The image output unit includes:
The image processing apparatus according to claim 1, wherein the setting image including an operation item for adjusting a display mode of the composition image generated by the image generation unit is output. The image output unit includes:
The image processing apparatus according to claim 3, wherein when the composition image is set, the composition image is output while being superimposed on a captured image in which the periphery of the vehicle is captured. An object detection unit for detecting obstacles existing around the vehicle;
The image output unit includes:
The image processing apparatus according to claim 1, wherein the setting image including an operation item for setting a detection range by the object detection unit is output. The signal replacement unit is
When the reception unit receives the operation signal, the shift signal other than the reverse signal and the parking signal is replaced with the reverse signal,
The image output unit includes:
When the shift signal is the reverse signal, and when the signal replacement unit replaces the shift signal other than the reverse signal and the parking signal with the reverse signal, a warning image is output instead of the setting image. The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus. The image processing apparatus according to claim 1, further comprising: an operation unit that outputs an operation signal for starting the setting to the reception unit when a predetermined operation by a user is received. . The image processing apparatus according to any one of claims 1 to 7,
An imaging device for imaging the periphery of the vehicle;
An image processing system comprising: the display device. A signal output step of outputting a shift signal input from a shift sensor of the vehicle to a display device;
An accepting step for accepting an operation signal for starting the setting by the user;
A signal replacement step of replacing the parking signal output in the signal output step with a reverse signal when the receiving step receives the operation signal and the shift signal is a parking signal in a specific state;
And an image output step of outputting to the display device a setting image for setting information to be displayed on the display device in the specific state.

Images