JP2020041826A - On-vehicle navigation device - Google Patents

Abstract

To provide an on-vehicle navigation device that gives permission to a passenger sitting on the front passenger seat by detecting a navigation operation of the passenger during driving.SOLUTION: An on-vehicle navigation device 100 comprises: a display unit 10 mounted on a vehicle 90 for displaying navigation information; an operation unit 20 for operating the display unit; a detection unit 30 including a sensor 31 which is arranged on the front passenger seat 91 side of the operation unit for detecting an object in the vicinity range 31a; and a processing unit for permitting or restricting the operation of the display unit based on a detection reaction outputted from the detection unit while the vehicle is running. When the processing unit detects a hand of a passenger sitting on the front passenger seat in the vicinity range on the front passenger seat side of the operation unit based on the detection reaction outputted from the detection unit while the vehicle is running, the passenger sitting on the front passenger seat can perform a navigation operation even while the vehicle is running by being permitted to operate the display unit through the operation unit when it is determined that the passenger sitting on the front passenger seat, but not a driver, operates it.SELECTED DRAWING: Figure 4A

Description

  The present invention relates to an in-vehicle navigation device.

  2. Description of the Related Art An in-vehicle navigation device (also simply referred to as a navigation device) that is mounted on a vehicle such as an automobile and guides a route from a current position to a destination when traveling is used. The navigation device is generally arranged at the center of the instrument panel so that it can be operated from the driver's seat and the passenger's seat. However, during traveling, the operation of the navigation device is restricted in order to prohibit the operation of the navigation device (i.e., simply referred to as the navigation operation) by the driver (ie, the driver) in the driver's seat to prevent an accident. I have. For this reason, not only the driver but also the passengers in the passenger seat are restricted while driving, and if an operation such as changing the destination is required while driving, the driver must stop temporarily. there were.

Therefore, for example, in Patent Document 1, a sensor is disposed vertically on the driver's seat side of the front panel, and while traveling, ultrasonic waves are radiated forward from the sensor, and an object, that is, a driver's hand is in the ultrasonic wave. A navigation device that prohibits a predetermined input from a touch switch when it crosses is disclosed. As a result, the operation by the driver during traveling is restricted, but the operation by the passenger in the passenger seat becomes possible. However, the range of ultrasonic waves emitted by the sensor is narrow, and is not necessarily sufficient to limit the navigation operation by detecting the driver's hand.
Patent Document 1 JP-A-9-292261

  SUMMARY OF THE INVENTION It is an object of the present invention to provide an in-vehicle navigation device that detects a navigation operation by a passenger in a passenger seat and permits the navigation operation during traveling.

  According to a first aspect of the present invention, a display unit for displaying navigation information mounted in a vehicle, an operation unit for operating the display unit, and an object in a near range provided on a passenger seat side of the operation unit are displayed. An on-vehicle navigation device provided with a detection unit having a first detector for detecting, and a processing unit for permitting or restricting operation of a display unit based on a detection reaction output from the detection unit while the vehicle is running is provided. Is done.

  According to a second aspect of the present invention, a display unit that displays navigation information mounted in a vehicle, an operation unit that operates the display unit, an imaging unit that captures an image of a range near the operation unit, A processing unit that permits or restricts operation of the display unit based on a captured image of the imaging unit, wherein the processing unit detects the right hand of the operator in the captured image when the right seat of the vehicle is the driver's seat An on-vehicle navigation device is provided which permits operation of the display unit when the operation is performed and restricts operation of the display unit when the left hand of the operator is detected.

  According to a third aspect of the present invention, a display unit that displays navigation information mounted in a vehicle, an operation unit that operates the display unit, an imaging unit that captures an image of a range near the operation unit, A processing unit that permits or restricts operation of the display unit based on a captured image of the imaging unit, wherein the processing unit detects the left hand of the operator in the captured image when the left seat of the vehicle is the driver's seat An in-vehicle navigation device is provided which permits the operation of the display unit when the operation is performed and restricts the operation of the display unit when the right hand of the operator is detected.

  According to a fourth aspect of the present invention, there is provided a method for controlling an operation of a display unit for displaying navigation information, comprising the steps of: determining whether a vehicle is running; Judging whether or not a detection reaction is output from a detection unit having a first detector for detecting an object within a proximity range provided on a seat side, and detecting the detection output from the detection unit while the vehicle is running. Allowing or restricting operation of the display based on the reaction.

  According to a fifth aspect of the present invention, there is provided a method for controlling an operation of a display unit for displaying navigation information, comprising the steps of: determining whether a vehicle is running; A step of determining whether or not a detection response is output from the imaging unit that images the range; and a step of permitting or restricting operation of the display unit based on a captured image of the imaging unit while the vehicle is running. The right seat is a driver's seat, and the operation of the display unit is permitted when the right hand of the operator is detected in the captured image, and the operation of the display unit is restricted when the left hand of the operator is detected. A method for providing is provided.

  According to a sixth aspect of the present invention, there is provided a method for controlling an operation of a display unit for displaying navigation information, comprising the steps of: determining whether a vehicle is running; A step of determining whether or not a detection response is output from the imaging unit that images the range; and a step of permitting or restricting operation of the display unit based on a captured image of the imaging unit while the vehicle is running. The left seat is a driver's seat, and the operation of the display unit is permitted when the left hand of the operator is detected in the captured image, and the operation of the display unit is restricted when the right hand of the operator is detected, and A method for providing is provided.

  The above summary of the present invention is not an exhaustive listing of all features of the present invention. Further, a sub-combination of these feature groups can also be an invention.

2 shows an arrangement of each component of the navigation device according to the first embodiment. 1 shows a functional configuration of a navigation device according to a first embodiment. 3 shows a processing pattern of a navigation operation. 9 shows an aspect of a processing pattern 1 of the navigation operation. 9 shows an aspect of a processing pattern 2 of the navigation operation. 3 shows a processing flow of a navigation operation by the navigation device according to the first embodiment. 7 shows an arrangement of each component of the navigation device according to the second embodiment. 5 shows a functional configuration of a navigation device according to a second embodiment. 3 shows a processing pattern of a navigation operation. 9 shows an aspect of a processing pattern 1 of the navigation operation. 9 shows an aspect of a processing pattern 2 of the navigation operation. 9 shows an aspect of a processing pattern 3 of the navigation operation. 9 shows an aspect of a processing pattern 4 of the navigation operation. 9 shows a processing flow of a navigation operation by the navigation device according to the second embodiment. 7 shows an arrangement of components of a navigation device according to a third embodiment. 7 shows a functional configuration of a navigation device according to a third embodiment. 3 shows a processing pattern of a navigation operation. 9 shows an aspect of a processing pattern 1 of the navigation operation. 9 shows an aspect of a processing pattern 2 of the navigation operation. 13 shows a processing flow of a navigation operation by the navigation device according to the third embodiment.

  Hereinafter, the present invention will be described through embodiments of the invention, but the following embodiments do not limit the invention according to the claims. In addition, not all combinations of the features described in the embodiments are necessarily essential to the solution of the invention.

  The navigation device 100 according to the first embodiment will be described.

  1 and 2 show the arrangement and functional configuration of each component of the navigation device 100, respectively. The navigation device 100 is a device that detects a navigation operation by a passenger in the passenger seat 91 during traveling and permits the navigation operation, and includes a display unit 10, an operation unit 20, a detection unit 30, and a processing unit 40. In the present embodiment, the vehicle 90 has a right-hand drive vehicle, that is, a driver's seat 92 on the right side in the traveling direction (right side in FIG. 1) and a passenger seat 91 on the left side (left side in FIG. 1). The occupant is referred to as a driver 92a, and the occupant in the passenger seat 91 is referred to as a passenger 91a, and the occupant including the driver 92a and the occupant 91a is referred to as a passenger.

  The display unit 10 is a unit that displays navigation information, and has, as an example, a liquid crystal display mounted in the center of an instrument panel 90a in the vehicle 90. The display unit 10 displays a road map on the display, a mark that indicates the current location of the vehicle 90, a route to the destination, a traveling direction, and the like, and auxiliary information such as a mileage to the destination and an arrival time. (Not shown) is displayed. These pieces of navigation information can be received from the processing unit 40.

  The operation unit 20 is a unit for operating the display of navigation information by the display unit 10. As an example, the operation unit 20 is provided on the left and right sides of the display unit 10 on the instrument panel 90 a (that is, on the passenger seat 91 side and the driver seat 92 side). Operation buttons 21 and 22. Using the operation buttons 21 and 22, for example, an operation of setting a departure point, a destination, a scale of a road map to be displayed, and the like, an operation of instructing a route search from the current position to the destination, and the like can be performed. These operations of the display unit 10 using the operation unit 20 are collectively referred to as a navigation operation. Note that the operation unit 20 may include a touch sensor (not shown) provided to overlap the liquid crystal display of the display unit 10. The content of the navigation operation by the operation unit 20 is transmitted to the processing unit 40.

  The detection unit 30 is a unit that detects a hand of an operator who performs a navigation operation using the operation unit 20. In the present embodiment, the detection unit 30 includes the sensor 31. The sensor 31 is an example of a first detector, and may employ an infrared sensor that emits infrared light and detects the object by receiving light reflected by the object. The detection response of the sensor 31 is transmitted to the processing unit 40.

  In the present embodiment, the sensor 31 is provided on the instrument panel 90a on the left side of the operation button 21 of the operation unit 20 (that is, on the side of the passenger seat 91 of the operation unit 20), and detects an object in the vicinity range 31a. When the passenger 91a (passenger in the passenger seat 91) reaches the operation button 21 or 22 of the operation unit 20 from the passenger seat 91 to perform the navigation operation, the hand enters the vicinity 31a and is detected by the sensor 31. Is done. However, the detection range of the sensor 31 (that is, the proximity range 31a) is such that even if the driver 92a reaches the operation button 21 or 22 of the operation unit 20 from the driver's seat 92 to perform the navigation operation, the detection range is not , So that it is determined not to be detected. For example, the sensor 31 may be separated from the operation button 21 of the operation unit 20 to the passenger seat 91 side.

  The processing unit 40 is a unit that processes a navigation operation by the operation unit 20. The processing unit 40 is connected to the display unit 10, the operation unit 20, and the detection unit 30 in a communicable manner by wire or wirelessly, edits navigation information according to an operation by the operation unit 20, transmits the navigation information to the display unit 10, and While the vehicle is traveling, the navigation operation is permitted or restricted based on the detection response output from the detection unit 30. Here, the processing unit 40 enables the operation by the operation unit 20, edits the navigation information according to the operation, transmits the navigation information to the display unit 10, permits the navigation operation, and invalidates the operation by the operation unit 20, The navigation information is edited according to the operation before being invalidated and transmitted to the display unit 10, thereby restricting the navigation operation.

  The processing unit 40 is an information processing device such as a microcomputer having a read-only memory (ROM), a random access memory (RAM), and the like, for example. The ROM stores an editing program for editing navigation information and a processing program for processing navigation operations. The processing unit 40 reads out the editing and processing program stored in the ROM, expands the program in the RAM, and executes the program to realize its function.

  FIGS. 3 and 4A to 4B show a processing pattern of the navigation operation (operation of the display unit 10 via the operation unit 20) by the processing unit 40 and an aspect of each processing pattern, respectively.

  When the detection reaction of the object is output from the sensor 31 according to the processing pattern 1 (when there is a sensor response), as illustrated in FIG. 4A, the processing unit 40 performs the process of the passenger 91a (the passenger in the passenger seat 91) as illustrated in FIG. Is detected, it is determined that not the driver 92a but the passenger 91a is operating the display unit 10 via the operation unit 20, and the navigation operation is permitted. This allows the fellow passenger 91a to perform a navigation operation even during traveling.

  When the detection response of the object is not output from the sensor 31 according to the processing pattern 2 (in the case where there is no sensor response), the processing unit 40 causes the driver 92a to display the display unit 10 via the operation unit 20 as shown in FIG. It is determined that there is a risk of operating, and the navigation operation is restricted. This prohibits the driver 92a from performing a navigation operation during traveling.

  FIG. 5 shows a processing flow S100 of the navigation operation by the navigation device 100. The processing flow S100 is started, for example, by turning on an engine switch of the vehicle 90.

  In step S102, it is determined whether or not vehicle 90 is running. The processing unit 40 determines whether the vehicle 90 is stopped or running, for example, based on whether a parking brake (not shown) is operating. The determination may be made based on whether the vehicle speed is zero. If it is determined that the vehicle is stopped, the process proceeds to step S108, and the navigation operation is permitted. If it is determined that the vehicle is traveling, the process proceeds to step S104.

  In step S104, it is determined whether or not a detection response has been output from the sensor 31 of the detection unit 30. As shown in FIG. 4A, when the passenger 91 a (passenger in the passenger seat 91) reaches the hand from the passenger seat 91 and tries to perform a navigation operation using the operation button 21 of the operation unit 20, the sensor 31 causes the operation button 21 to be operated. The hand of the fellow passenger 91a touching is detected. If the detection response has been output, it is determined that the fellow passenger 91a is operating the display unit 10 via the operation unit 20, and the process proceeds to step S106. If the detection response has not been output, it is determined that the driver 92a may operate the display unit 10 via the operation unit 20 as shown in FIG. 4B, and the process proceeds to step S110 to limit the navigation operation.

  In step S106, it is determined whether or not the detection reaction of the sensor 31 of the detection unit 30 has continued for a predetermined time. For example, upon detecting the detection response of the detection unit 30 in step S104, the processing unit 40 starts a timer and measures the duration thereof. Here, the processing unit 40 stops the timer if the detection reaction of the detection unit 30 cannot be detected in step S104. If the duration exceeds a predetermined time (for example, 3 minutes, 5 minutes, or 10 minutes), the processing unit 40 determines that the operator's hand has been erroneously detected due to a failure, misuse, or the like of the sensor 31. Alternatively, it is determined that an improper use such as attaching a seal to the detection surface of the sensor 31 or erroneous detection due to dirt on the detection surface of the sensor 31 has occurred, and a warning sound is emitted and / or a warning lamp is turned on. Proceeding to S110, the navigation operation is restricted. Thereby, unauthorized use and malfunction can be prevented. If the duration does not exceed the predetermined time, the process proceeds to step S108.

  In step S108, the navigation operation is permitted. The processing unit 40 enables the operation of the operation unit 20, edits the navigation information according to the operation of the operation unit 20, and transmits the navigation information to the display unit 10. This allows the passenger 91a (passenger in the passenger seat 91) to perform a navigation operation even during traveling.

  In step S110, the navigation operation is restricted. The processing unit 40 invalidates the operation performed by the operation unit 20, edits the navigation information according to the operation before the invalidation, and transmits the navigation information to the display unit 10. This prevents the driver 92a from navigating while traveling.

  After the end of steps S108 and S110, the process returns to step S102, and a series of steps S102 to S110 is repeated. The process flow S100 ends when, for example, the engine switch of the vehicle 90 is turned off.

  According to the in-vehicle navigation device 100 according to the first embodiment, the display unit 10 that displays navigation information mounted in the vehicle 90, the operation unit 20 that operates the display unit 10, the passenger seat 91 side of the operation unit 20 , A detection unit 30 having a sensor 31 for detecting an object in the vicinity range 31a provided in the vehicle, and permitting or restricting the operation of the display unit 10 based on a detection response output from the detection unit 30 during traveling of the vehicle 90. The processing unit 40 is provided. Since the sensor 31 that detects an object in the vicinity range 31 a is provided on the passenger seat 91 side of the operation unit 20, the processing unit 40 can perform processing based on a detection response output from the detection unit 30 while the vehicle 90 is traveling. When an object is detected in the vicinity 31 a of the operation unit 20 on the passenger seat 91 side, the hand of the passenger in the passenger seat 91 is detected, and the driver in the passenger seat 91 is used instead of the driver 92 a. By judging that the display unit 10 is operated via the control unit and permitting the operation, the passenger in the passenger seat 91 can operate the display unit 10 via the operation unit 20 even while the vehicle is running. It becomes possible.

  In the first embodiment, the navigation operation processing has been described as an example in which the navigation device 100 is mounted on a right-hand drive vehicle. However, the navigation device 100 is mounted on a left-hand drive vehicle (the driver's seat on the left side in the traveling direction and the assistant on the right side). Seats). In such a case, the sensor 31 is arranged on the right side of the operation buttons 21 and 22 (that is, on the driver's seat side). The navigation device 100 processes a navigation operation in the same manner as the above-described process.

  A navigation device 101 according to the second embodiment will be described.

  6 and 7 show the arrangement and functional configuration of each component of the navigation device 101, respectively. The navigation device 101 includes a display unit 10, an operation unit 20, a detection unit 30, a processing unit 40, and an operation terminal 50. Note that units and devices that are the same as or correspond to the components of the navigation device 100 according to the first embodiment are denoted by the same reference numerals. The display unit 10, the operation unit 20, and the processing unit 40 are configured similarly to those in the navigation device 100 according to the first embodiment. Therefore, only the differences will be described below.

  The detection unit 30 is a unit that detects a hand of an operator who performs a navigation operation using the operation unit 20. In the present embodiment, the detection unit 30 has first and second sensors 31 and 32. The first and second sensors 31 and 32 are examples of first and second detectors, respectively, and an infrared sensor similar to the sensor 31 described above can be employed. The detection reaction of the first and second sensors 31 and 32 is transmitted to the processing unit 40.

  The first sensor 31 is provided on the instrument panel 90a on the left side of the operation button 21 of the operation unit 20 (that is, on the side of the passenger seat 91 of the operation unit 20), and detects an object in the vicinity range 31a. When the passenger 91a (passenger in the front passenger seat 91) reaches the operation button 21 or 22 of the operation unit 20 from the front passenger seat 91 to perform the navigation operation, the hand enters the vicinity 31a and the first sensor 31 enters. Is detected by However, even if the driver 92a reaches the operation button 21 or 22 of the operation unit 20 from the driver's seat 92 to perform the navigation operation, the detection range of the first sensor 31 (that is, the vicinity range 31a) is not changed. Suppose that it is set so that it is not detected within the detection range. For example, the first sensor 31 may be separated from the operation button 21 of the operation unit 20 toward the passenger seat 91.

  The second sensor 32 is provided on the right side of the operation button 22 of the operation unit 20 on the instrument panel 90a (that is, on the driver's seat 92 side of the operation unit 20), and detects an object in the vicinity range 32a. When the driver 92a reaches the operation button 21 or 22 of the operation unit 20 from the driver's seat 92 to perform the navigation operation, the hand enters the vicinity 32a and is detected by the second sensor 32. However, the detection range of the second sensor 32 (that is, the proximity range 32a) is set such that even if the passenger in the passenger seat 91 reaches the operation button 21 or 22 of the operation unit 20 from the passenger seat 91 to perform the navigation operation, It is assumed that the hand is set so as not to be detected within the detection range. For example, the second sensor 32 may be separated from the operation button 22 of the operation unit 20 toward the driver's seat 92.

  The operation terminal 50 is a device that operates display of navigation information on the display unit 10 by wireless communication. As an example, a remote controller attached to the device, a smartphone carried by the occupant of the vehicle 90, and the like are applicable. In the case of a smartphone, the function is expressed by activating the application dedicated to the navigation operation, and the same navigation operation as the operation unit 20 becomes possible.

  FIGS. 8 and 9A to 9D show the processing patterns of the navigation operation (operation of the display unit 10 via the operation unit 20) by the processing unit 40 and the modes of the processing patterns, respectively.

  When the detection response of the object is output from the first sensor 31 and the detection response of the object is not output from the second sensor 32 according to the processing pattern 1 (in the case of the first sensor response and the absence of the second sensor response), the processing is performed. As illustrated in FIG. 9A, the hand of the passenger 91 a (passenger in the passenger seat 91) is detected in the unit 40, and the passenger 91 a instead of the driver 92 a operates the display unit 10 via the operation unit 20. And permit the navigation operation. This allows the fellow passenger 91a to perform a navigation operation even during traveling.

  When the detection response of the object is not output from the first sensor 31 and the detection response is output from the second sensor 32 as in the processing pattern 2 (when there is no first sensor response and there is a second sensor response), The processing unit 40 detects the hand of the driver 92a as shown in FIG. 9B, determines that the driver 92a is operating the display unit 10 via the operation unit 20, and restricts the navigation operation. This prevents the driver 92a from navigating while traveling.

  When the detection response is output from both the first and second sensors 31 and 32 according to the processing pattern 3 (when the first sensor response and the second sensor response are present), the processing unit 40 illustrated in FIG. 9C. Thus, the hand of the passenger 91a and the hand of the driver 92a are detected, and it is determined that not only the passenger 91a but also the driver 92a is operating the display unit 10 via the operation unit 20, and the navigation operation is restricted. I do. This prevents the driver 92a from performing a navigation operation during traveling.

  When the processing patterns 2 and 3 are put together, when the detection response is output from the second sensor 32, regardless of whether the detection response is output from the first sensor 31, the processing unit 40 is configured as shown in FIG. 9C, it is determined that the driver 92a is operating the display unit 10 via the operation unit 20, and the navigation operation is restricted. This prevents the driver 92a from performing a navigation operation during traveling.

  When the detection response is not output from both the first and second sensors 31 and 32 according to the processing pattern 4 (the case where there is no first sensor response and the case where there is no second sensor response), the processing unit 40 shown in FIG. 9D. Thus, it is determined that the driver 92a may operate the display unit 10 by wireless communication using the operation terminal 50, and the navigation operation is restricted. This prevents the driver 92a from navigating through the operation terminal 50 during traveling.

  FIG. 10 shows a processing flow S200 of the navigation operation by the navigation device 101. The processing flow S200 is started, for example, by turning on an engine switch of the vehicle 90.

  In step S202, similarly to step S102 described above, it is determined whether or not vehicle 90 is running. If it is determined that the vehicle is stopped, the process proceeds to step S210, and the navigation operation is permitted. If it is determined that the vehicle is traveling, the process proceeds to step S204.

  In step S204, it is determined whether or not a detection response has been output from the second sensor 32 of the detection unit 30. As shown in FIGS. 9B and 9C, when the driver 92 a reaches the driver's seat 92 and tries to operate the navigation using the operation button 22 of the operation unit 20, the driver touches the operation button 22 by the second sensor 32. The hand 92a is detected. If the detection response has been output (corresponding to the processing patterns 2 and 3 in FIG. 8), it is determined that the driver 92a is operating the display unit 10 via the operation unit 20, and the process proceeds to step S212 to navigate. Restrict operations. This prevents the driver 92a from performing a navigation operation during traveling. If the detection response has not been output, the process proceeds to step S206.

  In step S206, it is determined whether or not a detection response has been output from the first sensor 31 of the detection unit 30. As shown in FIG. 9A, when the passenger 91a reaches the hand from the passenger seat 91 and tries to operate the navigation using the operation button 21 of the operation unit 20, the hand of the passenger 91a touching the operation button 21 is detected by the sensor 31. Is done. If the detection response has been output (corresponding to the processing pattern 1 in FIG. 8), it is determined that the fellow passenger 91a is operating the display unit 10 via the operation unit 20, and the process proceeds to step S208. When the detection response is not output (corresponding to the processing pattern 4 in FIG. 8), there is a possibility that the driver 92a operates the display unit 10 by wireless communication using the operation terminal 50 as shown in FIG. 9D. After the determination, the process proceeds to step S212 to limit the navigation operation. This prevents the driver 92a from performing a navigation operation during traveling.

  In step S208, similarly to step S106 described above, it is determined whether the detection response of the first sensor 31 of the detection unit 30 has continued for a predetermined time. If the duration exceeds the predetermined time, the processing unit 40 determines that the first sensor 31 has been improperly used or has malfunctioned, emits a warning sound and / or turns on a warning lamp, and Proceeding to S212, the navigation operation is restricted. If the duration does not exceed the predetermined time, the process proceeds to step S210.

  In step S210, the navigation operation is permitted. The processing unit 40 enables the operation of the operation unit 20, edits the navigation information according to the operation of the operation unit 20, and transmits the navigation information to the display unit 10. This allows the passenger 91a (passenger in the passenger seat 91) to perform a navigation operation even during traveling.

  In step S212, the navigation operation is restricted. The processing unit 40 invalidates the operation by the operation unit 20 and the operation terminal 50, edits the navigation information according to the operation before the invalidation, and transmits the navigation information to the display unit 10. This prevents the driver 92a from navigating while traveling.

  After the end of steps S210 and S212, the process returns to step S202, and a series of steps S202 to S212 is repeated. The processing flow S200 ends, for example, by turning off the engine switch of the vehicle 90.

  According to the in-vehicle navigation device 101 according to the second embodiment, the display unit 10 that displays navigation information mounted in the vehicle 90, the operation unit 20 that operates the display unit 10, the passenger seat 91 side of the operation unit 20 A detection unit 30 having a first sensor 31 for detecting an object in a proximity range 31a provided in the operation unit 20 and a second sensor 32 for detecting an object in a proximity range 32a provided on the driver's seat 92 side of the operation unit 20; An operation terminal 50 that operates the unit 10 by wireless communication, and a processing unit 40 that permits or restricts the operation of the display unit 10 based on a detection response output from the detection unit 30 while the vehicle 90 is running. According to this, by using the first and second sensors 31 and 32 provided on the passenger seat 91 side and the driver seat 92 side of the operation unit 20, respectively, objects in the respective adjacent ranges 31a and 32a are detected. Which of the passenger 91a (passenger in the passenger seat 91) and the driver 92a is touching the operation unit 20 based on the detection reaction, that is, which one of the passenger 91a and the driver 92a is operating the operation unit 20 It is possible to more accurately determine the status of the navigation operation as to whether the display unit 10 is operated via the device 20.

  In the second embodiment, the navigation operation process has been described as an example in which the navigation device 101 is mounted on a right-hand drive vehicle. However, the navigation device 101 is mounted on a left-hand drive vehicle (the driver's seat on the left side in the traveling direction and the assistant driver on the right side). Seats). In such a case, the first and second sensors 31 and 32 are arranged on the right and left sides of the operation buttons 21 and 22, respectively. The navigation device 101 processes a navigation operation in the same manner as the above-described process.

  A navigation device 102 according to the third embodiment will be described.

  11 and 12 show the arrangement and functional configuration of each component of the navigation device 102, respectively. The navigation device 102 includes a display unit 10, an operation unit 20, an imaging unit 60, and a processing unit 40. Units and devices that are the same as or correspond to the components of the navigation devices 100 and 101 according to the first and second embodiments are denoted by the same reference numerals. The display unit 10, the operation unit 20, and the processing unit 40 are configured similarly to those in the navigation devices 100 and 101 according to the first and second embodiments. Therefore, only the differences will be described below.

  The imaging unit 60 is a unit that images the hand of an operator who performs a navigation operation using the operation unit 20. In the present embodiment, the imaging unit 60 includes a camera 61 and an analysis device 62.

  As an example, the camera 61 may be an infrared camera that emits infrared light and receives reflected light reflected by an object to capture an image of the object. The captured image captured by the camera 61 is transmitted to the analysis device 62.

  In the present embodiment, the camera 61 is provided above the operation buttons 21 and 22 of the display unit 10 and the operation unit 20 on the instrument panel 90a, and captures an image of the vicinity 61a. When the passenger 91 a (passenger in the passenger seat 91) reaches the operation button 21 or 22 of the operation unit 20 from the passenger seat 91 to perform a navigation operation, the hand enters the vicinity 61 a and is imaged by the camera 61. Is done. When the driver 92a reaches the operation button 21 or 22 of the operation unit 20 from the driver's seat 92 to perform the navigation operation, the hand enters the vicinity 61a and is imaged by the camera 61. However, when the passenger 91a and the driver 92a reach the operation buttons 21 or 22 of the operation unit 20 from their respective seats to perform the navigation operation, the imaging range of the camera 61 (that is, the vicinity range 61a) It is assumed that the hand is set within the detection range, and at least the entire hand from the fingertip to the wrist is imaged. For example, the camera 61 may be provided near the operation buttons 21 and 22 of the operation unit 20 on the instrument panel 90a, and more preferably at the center of the passenger seat 91 and the driver seat 92.

  The analysis device 62 is a device that analyzes a captured image received from the camera 61 and determines whether or not the hand of the operator is included and, if so, whether it is a right hand or a left hand. is there. The analysis device 62 extracts, for example, the contour of the object from the captured image, and determines whether or not the object is a hand based on the shape. When it is determined that the object is a hand, the analysis device 62 determines, for example, whether the finger is a right hand or a left hand from the direction in which the finger joint bends. Alternatively, the analysis device 62 may determine the asymmetry of the contour shape, for example, from the direction in which the thumb extends when the five fingers are open, from the index finger standing only, and from the position of the index finger with respect to the outline of the hand when the other fingers are closed. Alternatively, it may be determined whether the user is a right hand or a left hand. Alternatively, a skeleton may be estimated from an image using an estimation model constructed by machine learning, and whether the user is a right hand or a left hand may be determined. When the right hand and the left hand are detected by the analysis of the captured image by the analysis device 62, the detection reaction of the right hand and the detection reaction of the left hand are transmitted to the processing unit 40, respectively.

  Note that the imaging unit 60 may include only the camera 61. In such a case, the camera 61 transmits the captured image to the processing unit 40, and the processing unit 40 analyzes the captured image on behalf of the analysis device 62. Further, the camera 61 may be a driver monitor camera (DMC).

  The processing unit 40 is connected to the display unit 10, the operation unit 20, and the imaging unit 60 in a communicable manner by wire or wirelessly. The processing unit 40 edits navigation information according to the operation of the operation unit 20, transmits the navigation information to the display unit 10, and During the traveling, the navigation operation is permitted or restricted based on the analysis result of the captured image of the imaging unit 60.

  FIGS. 13 and 14A to 14B show processing patterns of a navigation operation (operation of the display unit 10 via the operation unit 20) by the processing unit 40 and aspects of the processing patterns, respectively.

  When the detection response of the right hand is output from the imaging unit 60 according to the processing pattern 1 (in the case of right hand detection), the processing unit 40 performs the right hand of the passenger 91a (the passenger in the passenger seat 91) as illustrated in FIG. 14A. Is detected, it is determined that not the driver 92a but the passenger 91a is operating the display unit 10 via the operation unit 20, and the navigation operation is permitted. This allows the fellow passenger 91a to perform a navigation operation even during traveling.

  When the detection response of the left hand is output from the imaging unit 60 according to the processing pattern 2 (in the case of left hand detection), the processing unit 40 detects the left hand of the driver 92a as illustrated in FIG. It is determined that the display unit 10 is being operated via the operation unit 20, and the navigation operation is restricted. This prohibits the driver 92a from performing a navigation operation during traveling.

  When neither the right hand detection reaction nor the left hand detection reaction is output from the imaging unit 60, the processing unit 40 transmits the display unit 10 to the display unit 10 by wireless communication using the operation terminal 50 according to the second embodiment. It may be determined that there is a risk of operating, and the navigation operation may be restricted. This prevents the driver 92a from navigating through the operation terminal 50 during traveling.

  FIG. 15 shows a processing flow S300 of the navigation operation by the navigation device 101. The process flow S300 is started, for example, by turning on an engine switch of the vehicle 90.

  In step S302, it is determined whether or not the vehicle 90 is running, as in steps S102 and S202 described above. If it is determined that the vehicle is stopped, the process proceeds to step S308, and the navigation operation is permitted. If it is determined that the vehicle is traveling, the process proceeds to step S304.

  In step S304, it is determined whether or not a detection response has been output from the imaging unit 60. If the detection response has been output, the process proceeds to step S306. If the detection response has not been output, the processing unit 40 determines that the driver 92a may operate the display unit 10 by wireless communication using the operation terminal 50 according to the second embodiment, and determines in step S310. Proceed to and restrict the navigation operation. This prevents the driver 92a from navigating through the operation terminal 50 during traveling.

  In step S306, it is determined whether or not the detection response of the right hand is output from the imaging unit 60. As shown in FIG. 14A, when the passenger 91a reaches the hand from the passenger seat 91 and tries to perform the navigation operation using the operation button 21 of the operation unit 20, the hand of the passenger 91a touching the operation button 21 by the camera 61 is imaged. Is done. When the detection response of the right hand is output (corresponding to the processing pattern 1 in FIG. 13), it is determined that the fellow passenger 91a is operating the display unit 10 via the operation unit 20 with the right hand, and the process proceeds to step S308. . When the detection reaction of the right hand is not output, that is, when the detection reaction of the left hand is output (corresponding to the processing pattern 2 in FIG. 13), the driver 92a operates the operation unit 20 with the left hand as shown in FIG. 14B. Then, it is determined that the display unit 10 is being operated, and the process proceeds to step S310 to limit the navigation operation. This prevents the driver 92a from performing a navigation operation during traveling.

  In step S308, the navigation operation is permitted. The processing unit 40 enables the operation of the operation unit 20, edits the navigation information according to the operation of the operation unit 20, and transmits the navigation information to the display unit 10. This allows the passenger 91a (passenger in the passenger seat 91) to perform a navigation operation even during traveling.

  In step S310, the navigation operation is restricted. The processing unit 40 invalidates the operation by the operation unit 20 and the operation terminal 50, edits the navigation information according to the operation before the invalidation, and transmits the navigation information to the display unit 10. This prevents the driver 92a from navigating while traveling.

  After the end of steps S308 and S310, the process returns to step S302, and a series of steps S302 to S310 is repeated. The processing flow S300 ends, for example, by turning off the engine switch of the vehicle 90.

  According to the in-vehicle navigation device 102 according to the third embodiment, the display unit 10 that displays navigation information mounted in the vehicle 90, the operation unit 20 that operates the display unit 10, and the vicinity 61a of the operation unit 20 are displayed. An image capturing unit 60 that captures an image and a processing unit 40 that permits or restricts the operation of the display unit 10 based on a captured image of the image capturing unit 60 while the vehicle 90 is traveling. In the case of, the operation of the display unit 10 is permitted when the right hand of the operator is detected in the captured image, and the operation of the display unit 10 is restricted when the left hand of the operator is detected. The passenger 61a (passenger in the passenger seat 91) and driving are imaged by the imaging unit 60 by imaging the vicinity 61a of the operation unit 20 and determining whether the operator's hand detected in the captured image is the right hand or the left hand. It is possible to more accurately determine which hand of the driver 92a is touching the operation unit 20 and to determine the state of the navigation operation more accurately, restrict the navigation operation by the driver 92a, and permit the navigation operation by the fellow passenger 91a.

  In the third embodiment, the navigation operation processing has been described as an example in which the navigation device 102 is mounted on a right-hand drive vehicle. However, the navigation device 102 is mounted on a left-hand drive vehicle (a driver's seat on the left side in the traveling direction and an assistant on the right side). Seats). In such a case, the processing unit 40 permits the operation of the display unit 10 when the left hand of the operator is detected in the captured image, and restricts the operation of the display unit 10 when the right hand of the operator is detected. Thus, even if the vehicle 90 is a left-hand drive vehicle, which hand of the passenger 91a (passenger in the passenger seat 91) or the driver 92a is touching the operation unit 20 as in the case of the right-hand drive vehicle The situation of the navigation operation can be determined more accurately, the navigation operation by the driver 92a can be restricted, and the navigation operation by the fellow passenger 91a can be permitted.

  As described above, the present invention has been described using the embodiments, but the technical scope of the present invention is not limited to the scope described in the above embodiments. It is apparent to those skilled in the art that various changes or improvements can be made to the above embodiment. It is apparent from the description of the appended claims that embodiments with such changes or improvements can be included in the technical scope of the present invention.

  The execution order of each processing such as operation, procedure, step, and stage in the apparatus, system, program, and method shown in the claims, the description, and the drawings is particularly “before”, “before”. It should be noted that they can be realized in any order as long as the output of the previous process is not used in the subsequent process. Even if the operation flow in the claims, the specification, and the drawings is described using “first,” “second,” or the like for convenience, it means that it is essential to perform the operation in this order. Not something.

  10 display unit, 20 operation unit, 21, 22 operation button, 30 detection unit, 31 first sensor (sensor), 31a near range, 32 second sensor, 32a near range, 40 process Unit, 50 operation terminal, 60 imaging unit, 61 camera, 61a neighborhood area, 62 analysis device, 90 vehicle, 90a instrument panel, 91 passenger seat, 91a passenger, 92 driver seat, 92a: Driver, 100, 101, 102: In-vehicle navigation device (navigation device), S100, S200, S300: Processing flow.

Claims (16)

A display unit for displaying navigation information mounted in the vehicle,
An operation unit for operating the display unit;
A detection unit having a first detector for detecting an object in a vicinity range provided on a passenger seat side of the operation unit;
A processing unit that permits or restricts the operation of the display unit based on a detection response output from the detection unit during traveling of the vehicle;
An in-vehicle navigation device comprising:   The in-vehicle navigation device according to claim 1, wherein the processing unit permits the operation of the display unit when an object detection response is output from the first detector. The detection unit further includes a second detector that detects an object in a vicinity range provided on the driver's seat side of the operation unit,
The in-vehicle navigation according to claim 1, wherein the processing unit permits operation of the display unit when a detection response is output from the first detector and a detection response is not output from the second detector. apparatus.   The in-vehicle navigation device according to claim 3, wherein the processing unit restricts operation of the display unit when a detection response is output from the second detector. Further comprising an operation terminal for operating the display unit by wireless communication,
5. The in-vehicle navigation device according to claim 3, wherein the processing unit restricts operation of the display unit when a detection response is not output from both the first detector and the second detector. 6.   The in-vehicle navigation according to any one of claims 1 to 5, wherein the processing unit limits the operation of the display unit when the detection response of the detection unit continues for a predetermined time. apparatus. A display unit for displaying navigation information mounted in the vehicle,
An operation unit for operating the display unit;
An imaging unit that images a range near the operation unit;
A processing unit that permits or restricts the operation of the display unit based on the captured image of the imaging unit during traveling of the vehicle,
The processing unit, when the right seat of the vehicle is a driver's seat, allows the operation of the display unit when the right hand of the operator is detected in the captured image, and displays the display when the left hand of the operator is detected. In-vehicle navigation device that restricts the operation of parts. A display unit for displaying navigation information mounted in the vehicle,
An operation unit for operating the display unit;
An imaging unit that images a range near the operation unit;
A processing unit that permits or restricts the operation of the display unit based on the captured image of the imaging unit during traveling of the vehicle,
The processing unit, when the left seat of the vehicle is a driver's seat, permits the operation of the display unit when detecting the operator's left hand in the captured image, and displays the display when the operator's right hand is detected. In-vehicle navigation device that restricts the operation of parts. A method of controlling operation of a display unit that displays navigation information,
Determining whether or not the vehicle is running;
Determining whether or not a detection response is output from a detection unit having a first detector that detects an object within a vicinity range provided on a passenger seat side of the operation unit that operates the display unit;
During traveling of the vehicle, allowing or restricting the operation of the display unit based on a detection reaction output from the detection unit,
A method comprising:   The method according to claim 9, wherein in the permitting or restricting step, operation of the display unit is permitted when a detection response of an object is output from the first detector. The detection unit further includes a second detector that detects an object in a vicinity range provided on the driver's seat side of the operation unit,
10. The operation according to claim 9, wherein in the permitting or restricting step, when the detection response is output from the first detector and the detection response is not output from the second detector, the operation of the display unit is permitted. Method.   The method according to claim 11, wherein, in the permitting or restricting step, operation of the display unit is restricted when a detection response is output from the second detector. The display unit is operable by wireless communication using an operation terminal,
The method according to claim 11, wherein in the permitting or restricting step, operation of the display unit is restricted when a detection response is not output from both the first detector and the second detector. It further comprises a step of determining whether or not the detection reaction of the detection unit continues for a predetermined time,
14. The method according to claim 9, wherein in the permitting or restricting step, when the detection reaction of the detection unit continues for a predetermined time, the operation of the display unit is restricted. 15. Method. A method of controlling operation of a display unit that displays navigation information,
Determining whether or not the vehicle is running;
Determining whether or not a detection response has been output from an imaging unit that images the vicinity of the operation unit that operates the display unit;
During traveling of the vehicle, permitting or restricting operation of the display unit based on a captured image of the imaging unit, wherein a right seat of the vehicle is a driver seat, and a right hand of an operator is included in the captured image. When the operation of the display unit is permitted, and the operation of the display unit is restricted when the left hand of the operator is detected, and
A method comprising: A method of controlling operation of a display unit that displays navigation information,
Determining whether or not the vehicle is running;
Determining whether or not a detection response has been output from an imaging unit that images the vicinity of the operation unit that operates the display unit;
During traveling of the vehicle, permitting or restricting operation of the display unit based on a captured image of the imaging unit, wherein a left seat of the vehicle is a driver seat, and a left hand of an operator is included in the captured image. When the operation of the display unit is permitted, and when the right hand of the operator is detected, the operation of the display unit is restricted, and
A method comprising:

Images