JP4844193B2 - Display device and program - Google Patents

Description

  The present invention relates to a display device for a vehicle that can display two different screens on a single display surface on a driver seat side and a passenger seat side according to the viewing angle.

As techniques related to conventional display devices, techniques described in Patent Document 1 and Patent Document 2 below are known.
In the technique described in Patent Document 1, when the driver operates the switches provided on the left and right of the steering wheel simultaneously (that is, when both hands are attached to the steering wheel), the input operation prohibition state during traveling ( This is a technology that enables the input operation of the navigation device or the like to the passenger in the passenger seat. That is, when it is assumed that the current state of the driver is an inoperable state of the navigation device or the like, the prohibition state of the input operation is canceled. Therefore, in this state, only a passenger other than the driver can operate the navigation device and the like, which is convenient.

The technique described in Patent Document 2 is a technique similar to the above technique, and cancels the traveling forced state when a switch such as a power window, a wiper, or a lamp is operated. Further, when the two operating switches that cannot be operated by the driver who is driving are simultaneously pressed, the traveling forced state is canceled. Therefore, it is possible to operate the navigation device of the passenger seat while prohibiting the driver from operating the vehicle while traveling.
JP 11-198745 A JP 200426050 A

  In recent years, display devices capable of displaying different images depending on the viewing angle have been developed. When a navigation device is configured using such a display device, different information can be displayed and an operation screen can be displayed on the driver side and the passenger seat side, thereby improving convenience. However, when different information displays and operation screens are displayed on the driver side and the passenger seat side in this way, whether the operation command input to the operation unit is from the driver. It is necessary to distinguish whether it is due to passengers. In this case, if the operation unit for the driver and the operation unit for the passenger seat are completely separated, it is determined that the operation command input to the operation unit for the driver is from the driver, Since it is possible to determine that the operation command input to the operation section for the seat is made by the passenger, the distinction is easy. However, in general, it is difficult to install an operation unit for a driver and an operation unit for a passenger seat independently in a vehicle cabin in which the installation location and installation area of the operation unit are limited.

  Therefore, consider sharing the operation section between the driver and the passenger. Then, it is necessary to determine by some method whether the command input to the operation unit is from the driver or from the passenger.

  Based on such a premise, the present invention accurately determines whether the command input to the operation unit is from the driver or from the passenger, and displays a different image depending on the viewing angle. The purpose is to improve usability.

  The display device according to claim 1, which solves the above-described problem, includes a control unit, and the control unit includes a driver operation state in which the operation command received by the reception unit is regarded as a driver operation, and a reception unit. Has at least two states that regard the operation command received by the passenger as the operation of the passenger seat, and according to the state, determines whether the operation command received by the receiving means is from the driver or from the passenger seat To do. Then, the control means causes the pointer to be displayed at a random position on the passenger side screen of the display means in the driver operation state, and when the reception means accepts an operation on the pointer, the control means changes from the driver operation state to the passenger seat operation state. Transition. The “pointer” here may be a character, a figure, a combination of a character and a figure, or the like.

  According to such a display device, the pointer can be seen only by the passenger, and the driver cannot know the exact position. Therefore, since it is possible to reliably determine the operation start intention for the passenger seat instead of the driver, it is possible to smoothly accept the operation by the passenger seat on the assumption that the operation is performed by the passenger seat passenger.

  Note that the above-described “accepting means accepts an operation on the pointer” means that, for example, when the accepting means is configured by a touch panel, the “accepting means operates on the pointer when the operator's finger touches the pointer. It may be determined that the operation has been accepted and the operation proceeds to the passenger seat operation state, and the subsequent operation is accepted as an operation by the passenger seat regardless of the pointer. On the other hand, the relationship with the pointer may be forced for the operation that continues after it is determined that “the accepting unit has accepted the operation on the pointer”. Specifically, when the accepting unit accepts a drag operation on the pointer, the control unit shifts to a passenger seat operation state, and when the accepting unit accepts a pointer drop operation, the control unit displays the drop position. It may be determined that an operation of a passenger is performed on the object being held (claim 2).

  If this is the case, the number of operation procedures that can be performed only by the passenger's seat increases, so that an operation command by the passenger's seat can be more reliably recognized as an operation by the passenger's seat.

  By the way, after shifting to the passenger seat operation state, it is preferable to return to the driver operation state when some condition is satisfied. For example, as described in claim 3, when a predetermined time has elapsed since the reception unit finally received the operation command, it is preferable to shift to the driver operation state. Here, the “predetermined time” is a time that can be determined that the passenger has finished the operation, and for example, a time of about 30 seconds to 3 minutes is considered suitable.

  If this is the case, “After the passenger's operation is completed, the next time the driver tries to operate, the driver's operation cannot be performed because the passenger's passenger operation is still in progress. It is possible to reduce the problem of “difficult to use”.

  Further, the display device is configured to further include a traveling state information acquisition unit that acquires traveling state information that is information about the traveling state of the vehicle, and the control unit has a predetermined vehicle speed in the passenger seat operation state. As soon as it is determined that the speed is higher than the traveling speed, and the speed is equal to or lower than the predetermined traveling speed, it may be determined to shift to the driver operation state after the predetermined time has elapsed. Here, the “predetermined traveling speed” means a speed that does not cause a problem even if the driver performs an operation, and is preferably an extremely low speed of about 0 km / h to about 5 km / h. In addition, the “predetermined time” is suitable for a time from when the vehicle becomes a predetermined traveling speed or less until the driver may start some operation using the display device. A time of about 10 seconds is conceivable.

  Even if this is the case, after the operation of the passenger seat is completed, the next time the driver tries to operate, the driver's operation cannot be performed because the passenger seat is still operating. It is possible to reduce the problem of “difficult to use”.

  In this way, when the vehicle becomes faster than the predetermined traveling speed again after the vehicle transitions from the passenger seat operating state to the driver operating state due to the vehicle becoming less than or equal to the predetermined traveling speed, the passenger seat passenger again It should be possible to return to the operating state. Specifically, when the control means determines that the speed of the vehicle has again become higher than the predetermined traveling speed, the control means displays a pointer at a random position on the passenger side screen of the display means, and shifts to the passenger seat operation state. It is good to make it possible (Claim 5). The “predetermined traveling speed” here is the same as described above.

If it becomes like this, a passenger's seat person can be made to transfer to a passenger's seat person operation state by operating with respect to a pointer again.
However, when the vehicle traveling speed again becomes higher than the predetermined traveling speed within a predetermined time, the operation may be returned to the passenger seat operation state without requiring an operation on the pointer (claim 6). The "predetermined time" here refers to the extent that the operation intention when the passenger seat is still in the passenger seat operation state continues even after the transition to the driver operation state due to the vehicle becoming below the predetermined travel speed. For example, a time of about 3 to 30 seconds can be considered. The “predetermined traveling speed” here is the same as described above.

  If this is the case, the vehicle immediately starts (within a predetermined time) even when the vehicle is temporarily stopped at the stop point, for example, when the passenger seat operation state is shifted to the driver operation state. If the speed is higher than the predetermined traveling speed, the passenger can continue the operation again without performing any special operation.

  By the way, in the passenger seat operation state, there may be a case where the passenger seat transitions the screen displayed on the passenger seat side screen of the display means to another screen and ends the operation. For this reason, the control means may shift to the driver operation state when the screen displayed on the passenger seat side screen of the display means transitions to another screen in the passenger seat operation state. Item 7). “Transition to other screens” here refers to the case where most of the functions or display contents have changed, for example, when a transition is made from a radio channel selection screen to a map display screen or a CD playback screen. To do.

In this case, even if the passenger does not explicitly indicate that the operation has been completed, the operation is shifted to the driver operation state, so that an operation for shifting to the driver operation state is not necessary.
In addition, even if the vehicle does not stop, there may be a case where the passenger seat passenger wants to shift from the passenger seat passenger operation state to the driver operation state. Accordingly, when the control means is in the passenger seat operation state, the control means displays a button indicating the transition to the driver operation state on the passenger seat side screen of the display means, and when the reception means accepts an operation on the button, the driver It is good to shift to an operation state (Claim 8).

If this is the case, the passenger can explicitly shift from the passenger seat operation state to the driver operation state, so that the driver can start the operation smoothly.
Similarly, there may be a case where the driver wants to shift from the passenger seat operation state to the driver operation state. Therefore, when the control means is in the passenger seat operation state, the control means displays a button indicating the transition to the driver operation state on the driver seat side screen of the display means, and when the reception means accepts the operation on the button, It is good to shift to a person operation state (Claim 9).

If it is in this way, since the driver can explicitly shift from the passenger seat passenger operation state to the driver operation state, the operation that the driver wants to perform can be started smoothly.
By the way, the accepting means may be configured as a touch panel, and the operator may directly touch the pointer with a finger, but the cursor is displayed on the display means instead of the finger, The pointer may be indirectly touched by the operator operating the cursor. In other words, as described in claim 10, the accepting means accepts an operation command for moving the cursor displayed on the passenger seat side screen of the display means, and the control means displays on the passenger seat side screen of the display means. It may be determined that an operation has been performed on the pointer by overlapping the cursor with the pointer.

  If it becomes like this, it will become possible to enjoy the merit (for example, merit known generally, such as being easy to specify a fine position) of operating using a cursor.

  After determining that there is an operation on the pointer, after the cursor is moved, the pointer is displayed in the vicinity of the cursor or superimposed on the cursor, and after the transition from the passenger operation state to the driver operation state When the transition to the passenger seat operation state is made again, the pointer may be displayed at the position displayed before the transition to the driver operation state (claim 11).

If it becomes like this, when it will be necessary to operate with respect to a pointer again, a passenger's seat person will be able to operate with respect to a pointer quickly, and usability improves.
In addition, as the above-described receiving means, various input devices such as a touch panel integrally formed with the display means, a joystick, a trackball, etc. configured separately from the display means can be considered, but the receiving means is a device called a prompter. It may be constituted by. That is, the accepting unit includes a photographing unit that captures the image of the hand that is presented within a predetermined photographing range, and the photographing range of the photographing unit is a place different from the display surface of the display unit. May correspond to the position in the display surface, and the image of the hand photographed by the photographing unit may be transparently combined with the display means. Then, the control means detects from the video imaged by the photographing unit whether the hand that has been drawn out is the right hand or the left hand, the operation action by the hand is an operation action by the right hand, and the display means When it is determined that the operation is for the pointer displayed on the passenger seat side screen, it is preferable to shift from the driver operation state to the passenger seat operation state (claim 12).

  In this way, if the information on the left and right hands is taken into account, it can be reliably determined that the operation on the pointer is performed by the passenger. In the case of a left-hand drive vehicle, it is detected from the video taken by the photographing unit whether the hand that has been put out is the right hand or the left hand, and the operation operation by the hand is the operation operation by the left hand, And when it determines with it being operation with respect to the pointer displayed on the passenger seat side screen of the display means, it is good to shift from a driver operation state to a passenger seat operation state.

  In addition, the reception unit may be configured by a haptic device that can change the reaction force pattern. In this case, the control means changes the reaction pattern of the haptic device to that for the passenger seat when the driver operation state transitions to the passenger seat passenger operation state, and the driver operation state is changed from the passenger seat operation state to the driver operation. When the state is shifted to the state, the reaction pattern of the haptic device may be changed to that for the driver (claim 13).

  If it is in this way, according to the current state of the control unit (whether it is a driver operation state or a passenger seat operation state), the operator performs an operation with an operation reaction force suitable for himself / herself. This improves usability.

Incidentally, the following display device may be used as a display device that solves the above-described problems. In other words, in addition to accepting means for accepting operation commands from the driver and front passenger, when the first switch installed at a position where only the front passenger can operate is accepted in the driver operation state, It is a display apparatus provided with the control means which transfers to a passenger's seat passenger operation state from a passenger operation state.

  According to such a display device, the driver cannot operate the first switch. Therefore, it is possible to reliably determine the operation start intention of the passenger seat, and it is possible to smoothly accept the subsequent operation by the passenger seat.

By the way, after shifting to the passenger seat operation state, it is preferable to return to the driver operation state when some condition is satisfied. For example, it may be adapted to transition the driver operating state when the receiving with means predetermined period of time has elapsed since the last reception of the operation instruction. Here, the “predetermined time” is a time that can be determined that the passenger has finished the operation, and for example, a time of about 30 seconds to 3 minutes is considered suitable.

  If this is the case, “After the passenger's operation is completed, the next time the driver tries to operate, the driver's operation cannot be performed because the passenger's passenger operation is still in progress. It is possible to reduce the problem of “difficult to use”.

Further, the display device is configured to further include a travel state information acquisition unit that acquires travel state information that is information about the travel state of the vehicle, and the control unit is based on the travel speed information acquired by the travel speed information acquisition unit. Determining whether or not the vehicle is below a predetermined traveling speed, and as soon as it is determined that the speed of the vehicle has changed from a speed higher than the predetermined traveling speed to a speed equal to or lower than the predetermined traveling speed in the passenger seat operation state; or The determination may be made to shift to the driver operation state after a predetermined time has elapsed . The “predetermined time” here is a suitable time from when the vehicle becomes a predetermined traveling speed or less until the driver may start some operation using the display device. A time of about 1 to 10 seconds can be considered. The “predetermined traveling speed” here is the same as described above.

  Even if this is the case, after the operation of the passenger seat is completed, the next time the driver tries to operate, the driver's operation cannot be performed because the passenger seat is still operating. It is possible to reduce the problem of “difficult to use”.

Of course, when the speed returns to a speed higher than the predetermined traveling speed within a predetermined time, it may be shifted to the passenger seat operation state without requesting the first switch to be pressed . The "predetermined time" here refers to the extent that the operation intention when the passenger seat is still in the passenger seat operation state continues even after the transition to the driver operation state due to the vehicle becoming below the predetermined travel speed. For example, a time of about 3 to 30 seconds can be considered. The “predetermined traveling speed” here is the same as described above.

  If this is the case, the vehicle immediately starts (within a predetermined time) even when the vehicle is temporarily stopped at the stop point, for example, when the passenger seat operation state is shifted to the driver operation state. If the speed is higher than the predetermined traveling speed, the passenger can continue the operation again without performing any special operation.

Incidentally, there may be a case where the passenger seat passenger wants to shift from the passenger seat passenger operation state to the driver operation state regardless of the traveling speed of the vehicle. Therefore, it is preferable that the control means shifts from the passenger seat operation state to the driver operation state when the first switch accepts the pressing operation again after shifting to the passenger seat operation state .

If it is in this way, regardless of the stop of the vehicle or the like, it is possible to shift from the passenger seat operation state to the driver operation state according to the will of the passenger seat, and the usability is improved.
In addition, the display device is configured to include at least a second switch that accepts a pressing operation from the driver, which is different from the first switch, and the control means shifts to the passenger seat operation state, When the second switch accepts a pressing operation, the state may be changed from the passenger-seat operation state to the driver operation state .

If it becomes like this, it can be made to shift from a passenger seat operation state to a driver operation state by a driver's will, and usability improves.
By the way, the first switch may be realized by a fixedly assigned switch (that is, the switch having the function of the first switch may always be determined), but at a non-fixed period. There may be. That is, instead of the first switch or in addition to the first switch, the display device is configured to include a plurality of switch groups that accept pressing operations from the driver and the passenger, and the control means Any one of the switches may be assigned as a switch corresponding to the function of the first switch, and information necessary for specifying the switch may be displayed on the display unit .

If this is the case, the existing switch can be used, and even in such a case, the willingness to start the operation of the passenger can be reliably determined.
Further, the control means displays information indicating whether the driver is operating or the passenger is operating on at least one of the driver side screen and the passenger side screen of the display means. (Claim 14 ).

In this way, the passenger can easily know whether the current state is the driver operation state or the passenger seat operation state.
Further, the control means may output a signal for outputting a sound for the passenger in the passenger seat side only to the speaker on the passenger seat side in the passenger seat operation state (claim 15 ).

  It is considered that there is little meaning in outputting the voice for the passenger in the driver's side speaker to the driver's speaker in the passenger seat operation state. Therefore, in the passenger seat operation state, if the voice for the passenger seat is output only from the speaker on the passenger seat side, the driver can concentrate more on driving.

In addition, the control means causes the display means to display a button that means switching between the driver side screen and the passenger seat side screen in the passenger seat operation state, and when the accepting means accepts an operation on the button, the driver side screen And the screen on the passenger seat side may be interchanged (claim 16 ).

  If this is the case, for example, if the passenger seat is unclear about the operation screen displayed on the passenger seat screen, the passenger seat replaces the driver screen and the passenger seat screen. Since the operation screen can be temporarily shown to the driver by pressing the button, the operation screen can be explained from the driver.

The function as the control means described above may be realized by a program (claim 17 ). If such a program is executed by a computer built in the display device, the same operations and effects as those of the display device described above can be obtained. Further, the program can be distributed using a network or the like, and the replacement of the program in the display device is easier than the replacement of the parts. Accordingly, it is possible to easily improve the function of the display device.

  Embodiments to which the present invention is applied will be described below with reference to the drawings. The embodiments of the present invention are not limited to the following embodiments, and various forms can be adopted as long as they belong to the technical scope of the present invention.

[Description of configuration]
FIG. 1 is a block diagram showing a schematic configuration of a navigation device 20 in which the function of the display device of the present invention is incorporated.

  The navigation device 20 is mounted on a vehicle, and a position detector 21 that detects the current position of the vehicle, an operation switch group 22 for inputting various instructions from a user, and various instructions as with the operation switch group 22 are input. A remote control terminal (hereinafter referred to as a remote control) 23a that is possible and separate from the navigation device 20, a remote control sensor 23b that inputs a signal from the remote control 23a, a packet communication network, etc. An external communication device 24 that performs communication, a map data input device 25 that inputs data from a map storage medium in which map data, audio data, and the like are recorded, a display unit 26 that displays a map and various types of information, A voice output unit 27 for outputting a guide voice or the like, a microphone 28 for outputting an electrical signal based on a voice spoken by a user, a vehicle An in-vehicle LAN communication unit 33 that communicates with various ECUs connected to the LAN, the above-described position detector 21, operation switch group 22, remote control sensor 23b, external communication device 24, map data input device 25, microphone 28, in-vehicle A control unit 29 that executes various processes in response to an input from the LAN communication unit 33 and controls the external communication device 24, the display unit 26, the audio output unit 27, and the in-vehicle LAN communication unit 33 is provided.

  The position detector 21 receives a radio wave from a GPS (Global Positioning System) artificial satellite via a GPS antenna (not shown) and outputs a received signal, and a magnitude of rotational motion applied to the vehicle. A gyroscope 21b for detecting the distance and a distance sensor 21c for detecting a distance traveled from the longitudinal acceleration or the like of the vehicle are provided. And the control part 29 calculates the position, direction, speed, etc. of a vehicle based on the output signal from these sensors 21a-21c. Although there are various methods for obtaining the current position based on the output signal from the GPS receiver 21a, either a single positioning method or a relative positioning method may be used.

  The operation switch group 22 includes a touch panel configured integrally with the display surface of the display unit 26 and mechanical key switches (hereinafter referred to as “hard switches”) provided around the display unit 26. The touch panel and the display unit 26 are laminated and integrated. There are various types of touch panels such as a pressure-sensitive method, an electromagnetic induction method, a capacitance method, or a combination of these methods. It may be used.

  The remote controller 23a is composed of a plurality of buttons. When any one of the buttons is pressed, a signal corresponding to the type of the button reaches the remote control sensor 23b via short-range wireless communication such as infrared rays. ing.

The remote control sensor 23 b receives a signal sent from the remote control 23 a and outputs the received signal to the control unit 29.
The external communication device 24 acquires accident information, traffic jam information, and the like from the VICS information center via an optical beacon or a radio beacon installed on the roadside.

  The map data input device 25 is a device for inputting various data stored in a map data storage medium (not shown) (for example, a hard disk or a DVD-ROM). Map data storage media include map data (node data, link data, cost data, background data, road data, name data, mark data, intersection data, facility data, etc.), voice data for guidance, voice recognition data, etc. Is remembered. Instead of inputting these data from the map data storage medium, these data may be input via a communication network.

  The display unit 26 includes a liquid crystal display, an organic EL display, and the like. The display screen of the display unit 26 includes a current position of the vehicle detected by the position detector 21 and map data input from the map data input unit 25. Additional data such as a mark indicating the identified current location, a guide route to the destination, a name, a landmark, and a mark of various facilities can be displayed in an overlapping manner. Also, facility guides can be displayed.

  The microphone 28 outputs an electric signal (voice signal) based on the inputted voice to the control unit 29 when the user inputs (speaks) voice. The user can operate the navigation device 20 by inputting various sounds to the microphone 28.

  The in-vehicle LAN communication unit 33 is responsible for communication with various ECUs (engine ECU, AT-ECU, brake ECU, etc.) and various sensors (direction indicator sensor, door open / close sensor, etc.) connected to the in-vehicle LAN.

  The control unit 29 is configured around a well-known microcomputer including a CPU, ROM, RAM, SRAM, I / O, and a bus line connecting these components, and is based on a program stored in the ROM and RAM. Various processes. For example, the current position of the vehicle is calculated as a set of coordinates and traveling directions based on each detection signal from the position detector 21, and a map or the like near the current position read via the map data input device 25 is displayed on the display unit 26. Based on the current location display processing, the map data stored in the map data input device 25, and the destination set in accordance with the operation of the operation switch group 22 or the remote controller 23a, the optimum route from the current position to the destination is determined. A route calculation process for calculating, a route guidance process for guiding the route by displaying the calculated route on the display unit 26 or outputting it as a voice to the voice output unit 27, and the like are executed. In the ROM of the control unit 29, reaction force data of the haptic device 31 is stored separately for the driver and for the passenger seat. Reaction force data may be stored for each occupant.

  Next, the haptic device 31 will be described with reference to the explanatory diagram of FIG. FIG. 2 illustrates a haptic device 31 (cross-sectional view) and a haptic device control unit 61 (block diagram) that controls the haptic device 31. The haptic device 31 is shared by the driver and the passenger.

  The haptic device 31 mainly includes a trackball holding unit 51, a trackball unit 52, an actuator unit 53, a trackball position detection unit 54, and an LED unit 56.

The trackball holding unit 51 is a housing that holds the trackball unit 52, the actuator unit 53, the trackball position detection unit 54, and the like so as to surround the inside.
The trackball portion 52 is formed of a semi-transparent hemisphere, and is configured to be rotatable in all directions within a predetermined range with the center point of the hemisphere as a fulcrum. Further, a protrusion 55 is provided on the uppermost part of the hemisphere so that it can be easily operated by the driver by being caught by the driver (user). The hemisphere has a return characteristic, and the protrusion 55 returns to a predetermined position when the driver releases the hand. In addition, an LED unit 56 is arranged inside the hemisphere, and emits light according to a command from the haptic device control unit 61. The trackball unit 52 is configured to be pressed in the direction of the arrow 57.

  The actuator unit 53 is for giving a reaction force characteristic to the trackball unit 52. Based on the control signal from the haptic device control unit 61, the actuator unit 53 responds to the rotation operation and the pressing operation of the trackball unit 52 described above. And has a function to limit in multiple steps.

The trackball position detection unit 54 has a function of detecting a rotation operation or a pressing operation of the trackball unit 52 and outputting it to the haptic device control unit 61.
The haptic device control unit 61 performs various calculations based on the program and reaction force data stored therein, and outputs the calculation results to the actuator unit 53 and the LED unit 56 as control data. Also, the detection result is transmitted to the control unit 29.

[Description of operation]
(1) Foreword The operation of the navigation device 20 of this embodiment will be described. In the following description, descriptions of processes normally executed by the navigation device 20 (for example, route setting processing, route calculation processing, route guidance processing, etc.) are omitted.

The table shown in FIG. 3 is a table showing the correspondence between whether or not the navigation device 20 can be operated by the driver and the front passenger and the screen displayed on the display unit 26.
First, a case will be described in which the same screen is displayed on both the driver seat side and the passenger seat side, and the screen is an operable screen (see frame A). In this screen state, when the vehicle is stopped, both the driver and passenger should be able to operate, and it can be said that this is the same state as a conventional one-screen display navigation device. In this case, the navigation device 20 does not need to determine whether the operation performed on the operation switch group 22 or the haptic device 31 is an operation performed by the driver or an operation performed by the passenger.

  However, when the vehicle travels, the driver should not be operated, or should be limited to simple operations even if operated. On the other hand, passengers need not be subject to such restrictions. Therefore, the navigation device 20 needs to determine whether an operation performed on the operation switch group 22 or the haptic device 31 is an operation performed by the driver or an operation performed by the passenger.

  Next, a description will be given of a screen state in which the operable screen A is displayed on the driver's seat side and the operable screen B is displayed on the passenger seat side (the operable screen A and the operable screen B are different screens) (see frame B). ). In this screen state, since the driver and the passenger can operate when the vehicle is stopped, the navigation device 20 performs the operation performed on the operation switch group 22 and the haptic device 31 by the driver. It is necessary to determine whether this is an operation performed by the passenger.

  In addition, when the vehicle is running, the driver should not be operated, or should be limited to simple operations even if operated, and passengers need not be subject to such restrictions. Should be operable. Therefore, the navigation device 20 needs to determine whether the operation performed on the operation switch group 22 or the haptic device 31 is performed by the driver or the passenger.

  In other screen states (other than the frame A and the frame B), the navigation device 20 performs an operation performed on the operation switch group 22 or the haptic device 31 by a driver or a passenger. Can be determined unambiguously. Therefore, in the following description, description of this case is omitted.

(2) State transition processing 1 (when using a random pointer)
The state transition process 1 executed by the control unit 29 will be described with reference to the flowchart of FIG. The state transition process 1 is started when the screen state indicated by the frames A and B in FIG.

  When starting the state transition process 1, the control unit 29 first executes the driver operation state transition process (S105). This driver operation state transition process will be described later. When the execution of the driver operation state transition process is finished, the control unit 29 determines whether or not the vehicle speed is equal to or lower than a predetermined traveling speed (S110). This is determined by acquiring speed information from the speed sensor via the in-vehicle LAN communication unit 33. For example, a speed of about “0 km / h” or “5 km / h” is suitable as the predetermined traveling speed. In S110, when it is determined that the vehicle speed is equal to or less than the predetermined travel speed (S110: Yes), the process proceeds to S150, and when it is determined that the vehicle speed is not equal to or less than the predetermined travel speed (S110: No), The process proceeds to S115.

  In step S115, which is performed when it is determined that the vehicle speed is not equal to or less than the predetermined traveling speed, the transition button for shifting to the driver seat state is deleted if displayed on the driver seat screen. The transition button is a button that is touched when the driver wants to shift from the passenger seat operation state to the driver operation state.

  Subsequently, the control unit 29 determines whether or not the current state is a passenger seat operation state (S120). Whether the passenger seat is in the passenger seat operation state is determined by a state flag (not shown) provided in the control unit 29. This state flag indicates one of the driver operation state and the passenger seat operation state. If it is determined that the current state is the passenger seat operation state (S120: Yes), the process returns to S110. If it is determined that the current state is not the passenger seat operation state (S120: No), the process proceeds to S125. To migrate.

  In S125, which proceeds when it is determined that the current state is not the passenger seat operation state, it is determined whether or not the state is shifted from the passenger seat operation state to the driver operation state within a predetermined time. This means that the control unit 29 stores the time at the time of the state transition and determines whether or not the elapsed time from the time to the current time is within a predetermined time (for example, within 10 seconds). If it is determined that it is within the predetermined time since the transition from the passenger seat operation state to the driver operation state (S125: Yes), the processing proceeds to S145, and the transition from the passenger seat operation state to the driver operation state proceeds. If it is determined that it is not within the predetermined time (S125: No), the process proceeds to S130.

  In S130, which proceeds when it is determined that it is within the predetermined time after shifting from the passenger seat operation state to the driver operation state, a random pointer is drawn on the passenger seat screen. This random pointer is a pointer displayed at a random position, and a specific example will be described later.

  Subsequently, it is determined whether or not the random pointer is touched with a finger or a cursor (S135). When it is determined that the random pointer is touched by the finger or the cursor (S135: Yes), the process proceeds to S140, and when it is determined that the random pointer is not touched by the finger or the cursor (S135: No), S110. Return processing to.

In S140, which is performed when it is determined that the random pointer is touched by the finger or the cursor, the random pointer is deleted from the passenger seat side screen.
In S145, a passenger seat operation state transition process is executed. The passenger seat operation state transition process will be described later. When the execution of the passenger seat operation state transition process is completed, the control unit 29 returns the process to S110.

  In S150, which proceeds when it is determined in S110 that the vehicle speed is equal to or lower than the predetermined traveling speed, it is determined whether or not the current state is the passenger seat operation state. When it is determined that the current state is the passenger seat operation state (S150: Yes), the process proceeds to S155, and when it is determined that the current state is not the passenger seat operation state (S150: No), The process returns to S125.

  When the current state is determined to be the passenger passenger operation state, a transition button is drawn on the driver's seat side screen in S155, which proceeds. Then, it is determined whether or not the transition button is touched with a finger or a cursor (S160). If it is determined that the transition button is touched by a finger or cursor (S160: Yes), the process proceeds to S165, and if it is determined that the transition button is touched by a finger or cursor (S160: No), the process proceeds to S110. To return.

In S165, which proceeds when it is determined that the transition button has been touched with a finger or a cursor, the transition button is deleted from the driver's seat screen. Then, the process returns to S105.
(3) Operation Command Allocation Processing Next, operation command allocation processing executed by the control unit 29 will be described using the flowchart of FIG. In the operation command allocation process, the operation switch group 22 or the haptic device 31 is operated by the user (driver or front passenger) in the screen state indicated by the frames A and B in FIG. Execution is started when input is made to 29.

  When starting the execution of the operation command allocation process, the control unit 29 first determines whether or not the input operation command is a command for a random pointer or a transition button (S205). If it is determined that the instruction is for the random pointer or the transition button (S205: Yes), the process proceeds to S210. If it is determined that the instruction is not for the random pointer or the transition button (S205: No), the process proceeds to S215. .

  In S210, which proceeds when it is determined that the command is for the random pointer or the transition button, the input operation command is passed to the execution program for the state transition process 1 described above. Then, this process (operation command allocation process) is terminated.

  In S215, which proceeds when it is determined that the command is not for the random pointer or the transition button, it is determined whether or not the current state is a passenger seat operation state. Whether or not the passenger seat passenger operation state is determined is determined by a state flag provided in the control unit 29. If it is determined that the current state is the passenger seat operation state (S215: Yes), the process proceeds to S220, and if it is determined that the current state is not the passenger seat operation state (S215: No), The process proceeds to S225.

  In S220, which proceeds when it is determined that the current state is the passenger seat operation state, the input operation command is passed to the passenger seat side application. The “passenger side application” here refers to an application that is currently in charge of drawing the passenger side screen of the display unit 26. When the operation command is passed to the passenger seat side application, this processing (operation command allocation processing) ends.

  In S225, which proceeds when it is determined that the current state is not the passenger's seat operation state, the input operation command is passed to the driver's seat side application. The “driver's seat side application” here refers to an application that is currently in charge of drawing the driver's seat side screen of the display unit 26. In addition, this driver's seat side application assumes that the function which performs operation regulation according to the traveling speed of a vehicle is separately mounted. When the operation command is passed to the driver's seat side application, this processing (operation command allocation processing) ends.

(4) Driver Operation State Transition Processing Next, driver operation state transition processing executed by the control unit 29 will be described with reference to the flowchart of FIG. The driver operation state transition process is started when called in the process of another process (for example, state transition process 1).

  When starting the execution of the driver operation state transition process, the controller 29 first reads out the driver reaction force data (S305). This is to read the reaction force data for the driver stored in the ROM of the control unit 29 into the RAM. Subsequently, the reaction force data read to the RAM is sent to the haptic device control unit 61 of the haptic device 31, and the reaction force data used by the haptic device control unit 61 is rewritten (S310).

  Subsequently, the control unit 29 sets the state flag to the driver operation state (S315). Then, the control unit 29 changes the driver side screen to the operable state and changes the passenger side screen to the inoperable state (S320). This is, for example, changing the command button on the passenger side screen to gray display, changing it to a state where it can be determined that the operation is impossible, and canceling the gray display of the command button etc. on the driver side screen, It is to change the display to indicate that it can be operated. When the change is completed, the present process (passenger seat operation state transition process) is terminated.

  By executing this process, the operation reaction force of the haptic device 31 is changed to one suitable for the driver, and the driver side screen is changed to a display state in which the driver side screen can be operated. Further, the state flag provided in the control unit 29 changes to the driver operation state.

(5) Passenger operation state transition process Next, the passenger operation state transition process executed by the control unit 29 will be described with reference to the flowchart of FIG. The passenger seat operation state transition process is started when another process (for example, state transition process 1) is executed and is called during the process.

  When starting the execution of the passenger seat operation state transition process, the control unit 29 first reads the passenger seat reaction force data (S355). This is to read the reaction force data for passengers stored in the ROM of the control unit 29 into the RAM. Subsequently, the reaction force data read to the RAM is sent to the control unit 61 of the haptic device 31, and the reaction force data used by the control unit 61 is rewritten (S360).

  Subsequently, the control unit 29 sets the state flag to the passenger seat operation state (S365). Then, the control unit 29 changes the driver's seat screen to an inoperable state and sets the passenger side screen to an operable state (S370). This can be done, for example, by changing the command button on the driver's side screen to gray and changing it to a state where it is known that the operation is impossible, and canceling the gray display of the command button on the passenger's side screen. It is to change the display to show that it is possible. When the change is completed, the present process (passenger seat operation state transition process) is terminated.

  By executing this processing, the operation reaction force of the haptic device 31 is changed to one suitable for the passenger, and the passenger side screen is changed to a display state in which the operation can be performed. Further, the state flag provided in the control unit 29 is changed to the passenger seat operation state.

(6) Timeout Process Next, the timeout process executed by the control unit 29 will be described with reference to the flowchart of FIG. The time-out process is started when the screen state indicated by frame A and frame B in FIG. 3 is reached.

  When starting the execution of the timeout process, the control unit 29 first determines whether or not a predetermined time has elapsed since the last operation command was received (S405). This is because whether or not a predetermined time (for example, 1 minute) has elapsed since the operation switch group 22 or the haptic device 31 was operated by the user (driver or passenger) and the operation command was last input to the control unit 29. This is done by judging. If it is determined that a predetermined time or more has elapsed since the last operation command was received (S405: Yes), the process proceeds to S410, and it is determined that the predetermined time or more has not elapsed since the last operation command was received (S405: No), this processing (timeout processing) is terminated.

  In step S410, which is performed when it is determined that a predetermined time or more has elapsed since the last operation command was received, it is determined whether or not the current state is a passenger seat operation state. This is done by referring to a status flag provided in the control unit 29. When it is determined that the current state is the passenger seat operation state (S410: Yes), the process proceeds to S415, and when it is determined that the current state is not the passenger seat operation state (S410: No), This process (timeout process) ends.

  In step S415, which is performed when it is determined that the current state is the passenger seat operation state, driver operation state transition processing (see FIG. 6) is executed. Then, when the execution of the driver operation state transition process is finished, this process (timeout process) is terminated.

By executing this process, when no operation is performed for a predetermined time in the passenger seat operation state, the operation state automatically shifts to the driver operation state.
(7) Screen Transition Processing Next, screen transition processing executed by the control unit 29 will be described with reference to the flowchart of FIG. Note that the screen transition processing is performed when a screen transition occurs in the screen state indicated by the frames A and B in FIG. 3, for example, when the radio channel selection screen is changed to the map display screen or the CD playback screen. In addition, execution starts when most of the function or display content changes.

  When starting the execution of the process at the time of screen transition, the control unit 29 first determines whether or not the current state is the passenger seat operation state (S455). This is done by referring to a status flag provided in the control unit 29. When it is determined that the current state is the passenger seat operation state (S455: Yes), the process proceeds to S460, and when it is determined that the current state is not the passenger seat operation state (S455: No), This processing (screen transition processing) is terminated.

  In S460, which proceeds when it is determined that the current state is the passenger seat operation state, the driver operation state transition process (see FIG. 6) is executed. Then, when the execution of the driver operation state transition process is finished, this process (screen transition process) is terminated.

By executing this process, when the screen transition occurs, the state automatically shifts to the driver operation state.
(8) Screen Example Next, an example of a screen displayed on the display unit 26 will be described.

  A screen 511 in FIG. 10A is an example of a passenger seat side screen displayed after execution of S130 described above. On the screen 511, various command buttons 512 to 517 are arranged, and a random pointer 518 is displayed. The random pointer 518 is displayed at a different position every time a screen similar to the screen 511 is newly displayed. Note that the random pointer 518 may move slowly and irregularly in the screen 511. The command buttons 512 to 517 are not operable in the initial state (for example, grayed out), and when the passenger seats the random pointer 518 with a finger, the random pointer 518 disappears and the screen 511 is displayed. The command buttons 512 to 517 can be operated.

  A screen 521 in FIG. 10B is an example of a driver seat side screen displayed after the execution of S155 described above. On the screen 521, various command buttons 522 to 527 are arranged, and a passenger-seat operation end button 528 (corresponding to a transition button) is displayed. In this state, only the passenger's passenger operation end button 528 can be operated. When the driver's passenger seat operation end button 528 is touched with a finger, the passenger's passenger operation end button 528 disappears, and the command in the screen 521 is displayed. The buttons 522 to 527 can be operated. In this case, the random pointer disappears from the passenger side screen, and the command buttons cannot be operated.

  A screen 531 in FIG. 10C is a screen displayed when the command button 515 in the screen 511 in FIG. 10A is touched by a passenger. On the screen 531, command buttons 532 to 537 are arranged and a random pointer 538 is displayed. The random pointer 538 is displayed at a different position every time a screen similar to the screen 531 is newly displayed. The command buttons 532 to 537 are not operable in the initial state (for example, grayed out). When the passenger seats the random pointer 538 with a finger, the random pointer 538 disappears and the screen 531 The command buttons 532 to 537 can be operated.

When the screen transitions in this way, the random pointer is displayed again, and the screen cannot be operated unless the displayed random pointer is touched.
A screen 541 in FIG. 11A is a screen when a screen operation is performed using the cursor 542. The cursor 542 moves in conjunction with an operation on the haptic device 31 performed by the passenger. Then, when the cursor 542 moves to the display position of the random pointer 543, the random pointer 543 disappears, and the passenger seat person can operate the passenger side screen (command buttons 544 to 549 can be operated). Next, a state until operation becomes possible will be described.

By the way, the random pointer may be moved following the cursor. This will be described next.
A screen 561 in FIG. 11B is a screen for explaining how the random pointer follows the cursor in the same screen as the screen 541 in FIG. By operating the haptic device 31, the passenger 562a moves the cursor 562a. When the cursor 562a is moved to the position of the random pointer 563a, the random pointer does not disappear and then the cursor moves. Accordingly, the random pointer moves. The random pointer is always located near the cursor (see the cursor 562b and the random pointer 563b). After that, when the state shifts to the driver operation state, the random pointer does not follow the movement of the cursor and is fixedly displayed at the position when the state shifts to the driver operation state.

  If the random pointer is made to follow the cursor in this way, the passenger can quickly move when the random pointer needs to be operated again by shifting to the driver operation state. The cursor can be moved to the display position of the random pointer.

[Effect of the embodiment]
According to the navigation device 20 of the above embodiment, the control unit 29 displays a pointer at a random position on the passenger seat side screen of the display unit 26 in the driver operation state, and the operation switch group 22, the remote controller 23a, or the haptic device. When an operation on the pointer is accepted by 31 (S135 in FIG. 4), the driver operation state is shifted to the passenger seat operation state (S145 in FIG. 4).

  In this way, if there is an operation on a pointer that can only be seen by the passenger seat, the driver will disguise as a passenger seat if the driver operation state shifts to the passenger seat operation state. Thus, it is possible to reliably determine the passenger's willingness to start the operation. As a result, the subsequent operation can be smoothly accepted on the assumption that the operation is performed by the passenger.

  In addition, after the transition to the passenger seat operation state, the transition to the driver operation state is made when a predetermined time has elapsed since the last operation command was received (S405: Yes, S415 in FIG. 8).

  For this reason, after the operation of the passenger's seat is completed, the next time the driver tries to operate, it is still difficult for the driver to operate because the passenger's seat is still operating. The occurrence of problems can be reduced.

  Further, when the vehicle traveling speed is equal to or lower than the predetermined traveling speed (S110: Yes in FIG. 4) and the current state is the passenger seat operation state (S150: Yes in FIG. 4), the driver's seat state A transition button for shifting to is displayed on the driver's seat screen (S155 in FIG. 4). In this state, when the transition button is operated by the driver (S160: Yes in FIG. 4), the state shifts from the passenger seat operation state to the driver operation state (S105).

  In this way, when the predetermined condition is satisfied, it is possible to shift from the passenger seat operation state to the driver operation state according to the will of the driver. When the driver tries to operate the vehicle, it is possible to reduce the occurrence of the problem that it is difficult for the driver to use the vehicle because the driver's passenger operation state still continues. In addition, you may change conditions, such as whether it is below a predetermined traveling speed continuously for a fixed time (for example, about 1 second-about 10 seconds). If so, the transition button is not frequently displayed and erased. Moreover, even if the transition button is not pressed by the driver, the passenger seat operation state may be shifted to the driver operation state. If so, the driver can start the operation smoothly.

  Further, even after the transition from the passenger seat operation state to the driver operation state, when the vehicle traveling speed becomes higher than the predetermined traveling speed again, the transition to the passenger seat passenger operation state is possible. Specifically, when it is determined that the speed of the vehicle has again become higher than the predetermined traveling speed (S110: No in FIG. 4), a random pointer is displayed on the passenger seat side screen (S130 in FIG. 4), and the passenger seat Transition to the operation state is enabled.

Thus, the passenger seat person can make a transition to the passenger seat passenger operation state by operating the random pointer again.
Further, when the speed of the vehicle again becomes higher than the predetermined traveling speed within a predetermined time (S125: Yes), the operation is returned to the passenger seat operation state without requesting an operation on the pointer. (S145).

  For this reason, for example, even when the vehicle is temporarily stopped at the pause position and the vehicle is shifted from the passenger seat operation state to the driver operation state, the vehicle immediately starts traveling (within a predetermined time) and the predetermined traveling speed is reached. If it becomes faster, the passenger can continue the operation again without performing any operation.

In the passenger seat operation state, when the screen displayed on the passenger seat side screen transitions to another screen, the screen is shifted to the driver operation state (screen transition processing in FIG. 9).
For this reason, even if the passenger seat does not explicitly indicate that the operation has been completed, the operation shifts to the driver operation state, so that an operation for shifting to the driver operation state becomes unnecessary.

  The driver and the passenger can also operate the random pointer by directly touching the display unit 26, but can also operate the pointer via the cursor. .

For this reason, the merit (for example, merit generally known, such as being easy to specify a fine position) is obtained by operating using a cursor.
Further, when the driver operation state is shifted to the passenger seat operation state, the reaction force pattern of the haptic device for operating the cursor is changed to that for the passenger seat (S355 and S360 in FIG. 7), and the passenger seat is changed. When the driver operation state is shifted to the driver operation state, the reaction force pattern of the haptic device is changed to that for the driver (S305 and S310 in FIG. 6).

  For this reason, since the operator can perform an operation with an operation reaction force suitable for himself / herself in accordance with the current state (whether the driver is operating or the passenger is operating), it is easy to use. .

[Other Embodiments]
(1) Drag and drop In the above-described embodiment, the random pointer is touched with a finger (or touched with a cursor) to shift from the driver operation state to the passenger seat operation state. Only while the vehicle is touched, the driver operation state may be shifted to the passenger seat operation state. That is, the random pointer may be moved while touching the random pointer, and the random pointer may be released on the command button to be pressed (drag and drop operation). Below, it demonstrates concretely using an example of a screen.

  The screen 571 in FIG. 12A is the same as the screen 511 in FIG. 10A, but the difference is that the screen 511 in FIG. 10A disappears when the finger touches the random pointer 518. However, even if the finger touches the random pointer 572a on the screen 571 in FIG. 12A, it does not disappear. Then, after touching with a finger, the random pointer moves with the movement by tracing the display surface with the finger (see random pointer 572b). Then, when the finger is released at the position after the movement, it is determined that the command button at the position is pressed (see the random pointer 572b and the command button 573).

If it is in this way, operation performed with respect to the touch panel can be judged as operation by a passenger seat more certainly, and it can change to a passenger seat person operation state.
A screen 581 in FIG. 12B is a screen for explaining the process from moving the cursor 582a to the position of the random pointer 583a, then moving the random pointer together with the cursor, and pressing the command button 584. As shown in the screen 581, when the cursor 582 a is moved to the position of the random pointer 583 a and the trackball unit 52 is pressed at that position, the random pointer is accompanied with the movement of the cursor thereafter. Then, it is determined that the command button 584 is pressed by bringing the cursor over the command button 584 and pressing the trackball unit 52 (see the cursor 582b and the random pointer 583b). Thereafter, in the example of the screen 581, the screen transitions, a random pointer is arranged at a random position different from the cursor position, and the same procedure is followed.

If it is in this way, it can judge as operation by a passenger seat person more reliably, and can transfer to a passenger seat person operation state.
(2) A button for forcibly returning to the driver operation state is displayed on the passenger seat side screen. In the above embodiment, the driver forcibly shifts from the passenger seat operation state to the driver operation state by pressing the transition button. However, it is preferable that the passenger seat passenger can shift from the passenger seat passenger operating state to the driver operating state. Specifically, as shown in a screen 591 shown in FIG. 13, an operation end button 592 is arranged on the passenger seat side screen, and when the operation end button 592 is operated, the driver operation from the passenger seat operation state is performed. It is good to shift to the state.

If this is the case, the passenger can explicitly shift from the passenger seat operation state to the driver operation state, so that the driver can start the operation smoothly.
(3) In the case of hard switch with fixed assignment In the above embodiment, it is determined that there is an operation with respect to the random pointer, thereby shifting from the passenger seat operation state to the driver operation state. However, it may be configured to shift from the passenger seat operation state to the driver operation state by determining that the hard switch that can be operated only by the passenger seat is operated. In that case, the control unit 29 may execute the state transition process 2 instead of (or in parallel with) the state transition process 1 described above. The state transition process 2 will be described with reference to the flowchart of FIG. The state transition process 2 is started when the screen state indicated by the frames A and B in FIG.

  When starting the execution of the state transition process 2, the control unit 29 first executes the driver operation state transition process (S605). This driver operation state transition process is the process described with reference to FIG. When the execution of the driver operation state transition process is finished, the control unit 29 determines whether or not the vehicle speed is equal to or lower than a predetermined traveling speed (S610). This is determined by acquiring speed information from the speed sensor via the in-vehicle LAN communication unit 33. For example, a speed of about “0 km / h” or “5 km / h” is suitable as the predetermined traveling speed. In S610, when it is determined that the vehicle speed is equal to or lower than the predetermined travel speed (S610: Yes), the process proceeds to S640, and when it is determined that the vehicle speed is not lower than the predetermined travel speed (S610: No), The process proceeds to S615.

  In step S615, which is performed when it is determined that the vehicle speed is not equal to or lower than the predetermined traveling speed, it is determined whether or not the current state is the passenger seat operation state. If it is determined that the current state is the passenger seat operation state (S615: Yes), the process proceeds to S620, and if it is determined that the current state is not the passenger seat operation state (S615: No), The process proceeds to S625.

  In S620, which proceeds when it is determined that the current state is the passenger seat operation state, it is determined whether or not the passenger seat side hard switch has been pressed. This hard switch on the passenger side is a hard switch that can be operated only in the passenger seat and is pressed when the passenger wants to switch between the driver operation state and the passenger operation state. It is a switch to do.

  When it is determined in S520 that the passenger seat side hard switch is pressed (S620: Yes), the process returns to S605, and when it is determined that the passenger seat side hard switch is not pressed (S620: No), The process returns to S610.

  In S625, which proceeds when it is determined that the current state is not the passenger seat operation state, it is determined whether or not the state is shifted from the passenger seat operation state to the driver operation state within a predetermined time. This means that the control unit 29 stores the time at the time of the state transition and determines whether or not the elapsed time from the time to the current time is within a predetermined time (for example, within 10 seconds). When it is determined that it is within the predetermined time after the transition from the passenger seat operation state to the driver operation state (S625: Yes), the processing proceeds to S635, and the passenger seat operation state transitions to the driver operation state. If it is determined that it is not within the predetermined time (S625: No), the process proceeds to S630.

  In S630, which proceeds when it is determined that the transition from the passenger seat operation state to the driver operation state is not within the predetermined time, it is determined whether or not the passenger seat side hard switch has been pressed. If it is determined that the passenger seat side hard switch has been pressed (S630: Yes), the process proceeds to S635, and if it is determined that the passenger seat side hard switch has not been pressed (S630: No), the process proceeds to S610. return.

  In step S635 that is performed when it is determined that it is within the predetermined time after shifting from the passenger seat operation state to the driver operation state, the passenger seat operation state transition processing is executed. This passenger seat operation state transition process is the process described with reference to FIG. When the passenger seat operation state transition process is finished, the process returns to S610.

  In S640, which proceeds when it is determined in S610 that the vehicle speed is equal to or lower than the predetermined traveling speed, it is determined whether or not the current state is the passenger seat operation state. If it is determined that the current state is the passenger seat operation state (S640: Yes), the process proceeds to S645, and if it is determined that the current state is not the passenger seat operation state (S640: No). , The process returns to S625.

  In S645, which proceeds when it is determined that the current state is the passenger seat operation state, it is determined whether or not the driver side hard switch has been pressed. The driver side hard switch is a hard switch arranged at a position where the driver can operate, and is pressed when the driver wants to change from the passenger seat operation state to the driver operation state. In addition, this switch may be arrange | positioned in the position which a front passenger's seat can operate.

  If it is determined in S645 that the driver's seat side hard switch has been pressed (S645: Yes), the process returns to S605. If it is determined that the driver's seat side hard switch has not been pressed (S645: No), the process proceeds to S610. Return processing.

  The state transition processing 2 has been described above. In this case, the screen displayed on the display unit 26 is a random pointer from the screen example of the above-described embodiment (the embodiment described before the title [other embodiments]). And the same as deleting the transition button.

  In this way, if the driver's side hard switch that can only be operated by the passenger's seat is pressed and the driver's operating state is shifted to the passenger's seat's operating state, the driver can It is not possible to pretend to be a seated person, and it is possible to reliably determine the passenger's willingness to start operation. As a result, the subsequent operation can be smoothly accepted on the assumption that the operation is performed by the passenger.

  Further, in this embodiment, after the transition to the passenger seat operation state, when the passenger seat side hard switch accepts the pressing operation again, the passenger seat operation state transitions to the driver operation state. For this reason, it is possible to shift from the passenger seat operation state to the driver operation state with the intention of the passenger seat.

  Further, in this embodiment, when the driver's side hard switch that can be operated by the driver is pressed, the state is shifted from the passenger's passenger operation state to the driver operation state. For this reason, it is possible to shift from the passenger-seat operation state to the driver operation state according to the driver's will, which is convenient.

  The operation command allocation process, the driver operation state transition process, the passenger seat operation state transition process, the time-out process, and the screen transition process described above are executed in the same manner in the present embodiment. The same effect can be obtained.

(4) In the case of a hard switch whose assignment changes dynamically In the embodiment of (3) above, a switch (passenger seat side) that is pressed when the passenger wants to shift from the driver operation state to the passenger operation state. The hard switch) is fixed, but the passenger side hard switch is not provided, and a switch having the function may be dynamically assigned to an existing hard switch. In this case, it is preferable that the control unit 29 executes the state transition process 3 instead of the state transition process 2 described above. The state transition process 3 will be described with reference to the flowchart of FIG. The state transition process 3 is started when the screen state indicated by the frames A and B in FIG.

  When starting the execution of the state transition process 3, the control unit 29 first executes the driver operation state transition process (S705). This driver operation state transition process is the process described with reference to FIG. When the execution of the driver operation state transition process is finished, it is determined whether or not the vehicle speed is equal to or lower than a predetermined traveling speed (S710). This is determined by acquiring speed information from the speed sensor via the in-vehicle LAN communication unit 33. For example, a speed of about “0 km / h” or “5 km / h” is suitable as the predetermined traveling speed. In S710, when it is determined that the vehicle speed is equal to or lower than the predetermined traveling speed (S710: Yes), the process proceeds to S750, and when it is determined that the vehicle speed is not equal to or lower than the predetermined traveling speed (S710: No), The process proceeds to S715.

  In step S715, which is performed when it is determined that the vehicle speed is not equal to or lower than the predetermined traveling speed, the transition button is deleted if the transition button is displayed on the driver's seat screen. The transition button is a button that is touched when the driver wants to shift from the passenger seat operation state to the driver operation state.

  Subsequently, the control unit 29 determines whether or not the current state is a passenger seat operation state (S720). If it is determined that the current state is the passenger seat operation state (S720: Yes), the process returns to S710, and if it is determined that the current state is not the passenger seat operation state (S720: No), S725 is performed. Transfer processing to.

  In S725, which proceeds when it is determined that the current state is not the passenger seat operation state, it is determined whether or not the state is shifted from the passenger seat user operation state to the driver operation state within a predetermined time. This means that the control unit 29 stores the time at the time of the state transition and determines whether or not the elapsed time from the time to the current time is within a predetermined time (for example, within 10 seconds). When it is determined that it is within the predetermined time since the transition from the passenger seat operation state to the driver operation state (S725: Yes), the process proceeds to S745, and the process proceeds from the passenger seat operation state to the driver operation state. If it is determined that it is not within the predetermined time (S725: No), the process proceeds to S730.

  In S730, which proceeds when it is determined that it is within the predetermined time after shifting from the passenger seat operation state to the driver operation state, a marker is drawn on the passenger seat side screen. The marker referred to here indicates which hard switch can be pressed to shift from the driver operation state to the passenger seat operation state. The hard switch may be selected at random from hard switches in a range that can be operated by the passenger.

  Subsequently, the control unit 29 determines whether or not a hard switch indicated by the marker (hereinafter referred to as a specific hard switch) has been pressed (S735). If it is determined that the specific hard switch has been pressed (S735: Yes), the process proceeds to S740. If it is determined that the specific hard switch has not been pressed (S735: No), the process returns to S710.

  In S740, which proceeds when it is determined that the specific hard switch has been pressed, the marker is erased from the passenger seat side screen. In the subsequent S745, a passenger seat operation state transition process is executed. This passenger seat operation state transition process is the process described with reference to FIG. When the passenger seat operation state transition process is finished, the process returns to S710.

  In S750, which proceeds when it is determined in S710 that the vehicle speed is equal to or lower than the predetermined traveling speed, it is determined whether or not the current state is a passenger seat operation state. When it is determined that the current state is the passenger seat operation state (S750: Yes), the process proceeds to S755, and when it is determined that the current state is not the passenger seat operation state (S750: No), The process returns to S725.

  In step S755, which is performed when it is determined that the current state is the passenger seat operation state, a transition button is drawn on the driver's seat side screen. Then, it is determined whether or not the transition button is touched with a finger or a cursor (S760). If it is determined that the transition button is touched by the finger or the cursor (S760: Yes), the process proceeds to S765. If it is determined that the transition button is not touched by the finger or the cursor (S760: No), the process proceeds to S710. Return processing.

In S765, which proceeds when it is determined that the transition button has been touched with a finger or a cursor, the transition button is deleted from the driver's seat side screen. Then, the process returns to S705.
The state transition processing 3 has been described above. Next, a screen when the marker is displayed, which is displayed on the passenger seat side screen of the display unit 26, will be described.

  FIG. 16 shows the operation switch group 22 (hard switches 22a to 22n) arranged around the display unit 26 and its periphery. A screen 801 displayed on the display unit 26 is an example of a passenger seat side screen displayed after the execution of S730 described above. It can be confirmed that a marker 802 is drawn on the screen 801. This marker 802 means that the specific hard switch is the hard switch 22k. Therefore, only the passenger seat can know that the specific hard switch is the hard switch 22k.

Therefore, according to such a navigation apparatus 20, it is not necessary to provide a passenger seat side hard switch, and the degree of freedom in layout design in the vehicle is increased.
(5) Prompter Method In the above-described embodiment (the embodiment described before the title [other embodiments]), the touch panel and the haptic device 31 constituting the operation switch group 22 are operated on the random pointer. However, instead of these, an input device called a prompter is used, and it is determined whether the hand put out to the prompter is by the driver or the passenger, and the result of the determination is also In consideration of this, the transition between the driver operation state and the passenger seat operation state may be performed. Hereinafter, this prompter will be described.

  The prompter is equipped with a camera that captures a video image of a hand that is presented in a predetermined imaging area, and only the hand portion is extracted from the video image and is superimposed on another video image in a translucent state. In addition, it is possible to identify the location indicated by the hand from the video image of the hand by using an image recognition technique and associate it with the corresponding location of the superimposed video. This will be specifically described with reference to the drawings.

  The illustration shown in FIG. 17A is an illustration when the front of the vehicle is viewed from the right rear seat of the vehicle (passenger car). The center console is provided with a camera 71, and a photographing table 73 is photographed by the camera 71. When a hand is put out on the photographing table 73, the camera 73 photographs the state and outputs it to the control unit 29. FIG. 17B is an example of the captured image.

  When receiving a video from the camera 73, the control unit 29 extracts only the hand portion from the video and superimposes it on the image displayed on the display unit 26. FIG. 17C is an example of a superimposed image displayed on the display unit 26.

  In addition, the control unit 29 recognizes the operation operation indicated by the hand from the video. For example, in the example of FIG. 17C, it is recognized that the hand operation is an operation of touching the orientation mark 851. Further, it is determined whether the hand is the right hand (passenger's hand) or the left hand (driver's hand). Then, based on these pieces of information, the determinations of S135 and S160 in FIG. 4 described above are performed. For example, with regard to S135, if it is recognized that an operation on the random pointer has been performed by the hand photographed by the camera 73 and it is determined that the hand is a passenger's hand, the process proceeds to S140. Further, regarding S160, when it is recognized that an operation on the transition button has been performed by the hand photographed by the camera 73 and it is determined that the hand is the driver's hand, the process proceeds to S165. In the case of a left-hand drive vehicle, the determination regarding the passenger's hand and the driver's hand is reversed.

  If it is in this way, it can be judged more accurately whether the operation for the random pointer is performed by the driver or the passenger. Therefore, for example, more complicated operations can be permitted in the passenger seat operation state.

(6) Other 1
Furthermore, it is preferable that information indicating whether the driver is operating or the passenger seat is displayed on at least one of the driver side screen and the passenger seat screen of the display unit 26. Specifically, for example, it is conceivable to display the characters “driver operation state” or “passenger seat operation state” on both the driver side screen and the passenger side screen of the display unit 26.

In this way, the passenger can easily know whether the current state is the driver operation state or the passenger seat operation state.
(7) Other 2
In addition, in the passenger seat operation state, the control unit 29 performs various processes (route setting processing) executed by the control unit 29 on a signal indicating that the voice for the passenger seat passenger is output only to the speaker on the passenger seat side. Etc.) should be notified. This signal may be output to the audio device.

Thus, in the passenger seat operation state, if the voice for the passenger seat is output only from the speaker on the passenger seat side, the driver can concentrate more on driving.
(8) Other 3
In addition, in the passenger seat operation state, the control unit 29 causes the display unit 26 to display a button that means switching between the driver side screen and the passenger seat side screen, and the operation switch group 22 and the like operate the button. When accepted, the driver side screen and the passenger seat side screen may be temporarily replaced.

  If this is the case, for example, if the passenger seat is unclear about the operation screen displayed on the passenger seat screen, the passenger seat replaces the driver screen and the passenger seat screen. By operating the above button, the operation screen can be temporarily shown to the driver, so that the driver can receive an explanation of the operation screen.

[Correspondence with Claims]
The correspondence between the terms used in the above embodiment and the terms used in the description of the claims is shown. The display unit 26 corresponds to display means, the operation switch group 22, the remote controller 23a, and the haptic device 31 correspond to reception means, the control unit 29 corresponds to control means, and the in-vehicle LAN communication unit 33 serves as travel speed information acquisition means. Equivalent to.

Further, the passenger seat side hard switch in (3) of [another embodiment] corresponds to the first switch, and the driver seat side hard switch corresponds to the second switch.
Moreover, the hard switches 22a to 22n in (4) of [Other Embodiments] correspond to a switch group.

It is explanatory drawing which shows schematic structure of a navigation apparatus. It is explanatory drawing which shows schematic structure of a haptic device. It is a table | surface which shows a response | compatibility with the operation display of a driver and a passenger's seat person with respect to a navigation apparatus, and the screen displayed on a display part. 5 is a flowchart for explaining state transition processing 1; It is a flowchart for demonstrating the operation command allocation process. It is a flowchart for demonstrating a driver | operator operation state transfer process. It is a flowchart for demonstrating a passenger seat person operation state transfer process. It is a flowchart for demonstrating a timeout process. It is a flowchart for demonstrating a screen transition process. It is an example of a screen displayed on a display part. It is an example of a screen displayed on a display part. It is an example of a screen displayed on a display part. It is an example of a screen displayed on a display part. It is a flowchart for demonstrating the state transfer process 2. FIG. 10 is a flowchart for explaining state transition processing 3; It is explanatory drawing for demonstrating the mode of the hard switch group arrange | positioned around the example of a screen displayed on a display part, and a display part. It is a figure for demonstrating the input method using a prompter.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 20 ... Navigation apparatus, 21 ... Position detector, 21a ... GPS receiver, 21b ... Gyroscope, 21c ... Distance sensor, 22 ... Operation switch group, 23a ... Remote control, 23b ... Remote control sensor, 24 ... External communication device, 25 ... Map data input device, 26 ... display unit, 27 ... audio output unit, 28 ... microphone, 29 ... control unit, 31 ... haptic device, 33 ... in-vehicle LAN communication unit, 51 ... trackball holding unit, 52 ... trackball unit, 53 ... Actuator part, 54 ... Trackball position detection part, 55 ... Projection part, 56 ... LED part, 61 ... Haptic device control part.

Claims (17)

Display means capable of displaying two different screens on the one display surface on the driver seat side and the passenger seat side according to the viewing angle;
Accepting means for accepting operation commands from the driver and passengers;
A driver operation state in which the operation command received by the reception unit is regarded as a driver operation; and at least two states in which the operation command received by the reception unit is regarded as a passenger seat operation; Control means for determining whether the operation command received by the receiving means is by the driver or by the passenger seat according to the state,
With
The control means displays a pointer at a random position on the passenger seat side screen of the display means in the driver operation state, and when the reception means accepts an operation on the pointer, the control means starts the assistant operation state from the driver operation state. Shifting to the seated person operating state,
The display apparatus used in the vehicle characterized by this. The display device according to claim 1,
The control means shifts to the passenger seat operation state when the accepting means accepts a drag operation on the pointer. When the accepting means accepts the drop operation of the pointer, the control means displays at the drop position. Determining that a passenger has operated on the object being
A display device. The display device according to claim 1 or 2,
The control means shifts to the driver operation state when a predetermined time elapses after the reception means finally receives an operation command after shifting to the passenger seat operation state.
A display device. The display device according to any one of claims 1 to 3,
Furthermore, a travel speed information acquisition means for acquiring travel speed information that is information relating to the travel speed of the vehicle is provided,
The control means determines whether or not the vehicle is below a predetermined travel speed based on the travel speed information acquired by the travel speed information acquisition means, and determines the speed of the vehicle in the passenger seat operation state. As soon as it is determined that the speed has become lower than the predetermined traveling speed from the speed higher than the predetermined traveling speed, or after the predetermined time has elapsed and determined to shift to the driver operation state,
A display device. The display device according to claim 4,
The control means changes the speed of the vehicle after the transition from the passenger seat operation state to the driver operation state by the vehicle speed changing from a speed higher than the predetermined travel speed to a speed equal to or lower than the predetermined travel speed. When it is determined based on the traveling state information acquired by the traveling state information acquisition means that the speed is again faster than the predetermined traveling speed, the pointer is displayed at a random position on the passenger seat side screen of the display means, Being able to shift to the passenger seat operation state,
A display device. The display device according to claim 4 or 5,
The control means is configured to change the speed of the vehicle from the speed higher than the predetermined travel speed to the speed equal to or lower than the predetermined travel speed, and then, after the transition from the passenger seat operation state to the driver operation state, When it is determined based on the traveling state information acquired by the traveling state information acquisition means that the speed has again become higher than the predetermined traveling speed within a predetermined time, transition to the passenger seat operation state,
A display device. The display device according to any one of claims 1 to 6,
The control means shifts to the driver operation state when the screen displayed on the passenger seat side screen of the display means transitions to another screen in the passenger seat operation state.
A display device. The display device according to any one of claims 1 to 7,
When the control means is in the passenger seat operation state, the control means displays a button indicating a transition to the driver operation state on the passenger seat side screen of the display means, and the reception means accepts an operation on the button. And transition to the driver operation state,
A display device. The display device according to any one of claims 1 to 8,
When the control means is in the passenger seat operation state, the control means displays a button indicating a shift to the driver operation state on the driver seat side screen of the display means, and the reception means performs an operation on the button. If accepted, transition to the driver operation state,
A display device. The display device according to any one of claims 1 to 9,
The accepting means accepts an operation command for moving a cursor displayed on the passenger seat side screen of the display means;
The control means determines that an operation has been performed on the pointer when the cursor displayed on the passenger side screen of the display means overlaps the pointer;
A display device. The display device according to claim 10.
The control means determines that there is an operation on the pointer when the cursor displayed on the passenger seat side screen of the display means overlaps the pointer. Is displayed in the vicinity of the cursor or overlapped with the cursor, and after the transition to the driver operation state from the passenger seat operation state, the driver operation is performed again when the transition to the passenger seat operation state is performed. Displaying the pointer at the position displayed before entering the state;
A display device. The display device according to any one of claims 1 to 11,
The accepting means includes a photographing unit that photographs an image of a hand that is presented within a predetermined photographing range,
The shooting range of the shooting unit is a place different from the display surface of the display unit, but the position in the shooting range corresponds to the position in the display surface,
The control means transparently synthesizes the image of the hand photographed by the photographing unit with the display means, and detects whether the inserted hand is the right hand or the left hand from the image photographed by the photographing unit. When the operation operation by the hand is an operation operation by the right hand and is determined to be an operation on the pointer displayed on the passenger seat side screen of the display means, Transition to operational state,
A display device. The display device according to any one of claims 1 to 11,
The reception means is constituted by a haptic device capable of changing a reaction force pattern,
When the control means shifts from the driver operation state to the passenger seat operation state, the control means changes the reaction force pattern of the haptic device to that for the passenger seat, from the passenger seat operation state. When transitioning to the driver operation state, changing the reaction pattern of the haptic device to that for the driver,
A display device. The display device according to any one of claims 1 to 13 ,
The control means displays information indicating whether the driver is in the driver's operation state or the passenger's passenger's operation state on at least one of the driver side screen and the passenger side screen of the display means;
A display device. The display device according to any one of claims 1 to 14 ,
The control means outputs, in the passenger seat operation state, a signal for outputting a sound for the passenger seat passenger only to a speaker on the passenger seat side;
A display device. The display device according to any one of claims 1 to 15 ,
The control means causes the display means to display a button that means switching between the driver side screen and the passenger seat side screen in the passenger seat operation state, and when the accepting means accepts an operation on the button, Swapping the passenger side screen with the passenger side screen,
A display device. A program for causing a computer to function as the control unit in the display device according to any one of claims 1 to 16.