JP6487837B2 - Vehicle display device - Google Patents

Description

  The present invention relates to a vehicle display device.

  Conventionally, a vehicular instrument device mounted on a vehicle is known. This vehicle instrument device includes a meter unit, and the meter unit is provided with a vehicle information display area for displaying vehicle information such as speed and engine speed. The vehicle is also equipped with an in-vehicle display that is used for multimedia devices and navigation systems.

  In recent years, there has been a remarkable spread of portable terminals such as smartphones. This portable terminal has various functions such as a navigation function using GPS information, an audio playback function for viewing video and music, a WEB browsing function provided on the Internet, and is naturally used in a vehicle. Is expected. Therefore, for the purpose of improving convenience for vehicle occupants, a method has been proposed in which a vehicle-side device and a mobile terminal are connected and a display image of the mobile terminal is displayed on an in-vehicle display.

  For example, Patent Document 1 discloses an in-vehicle system that displays an image displayed on a display unit of a mobile phone on a display unit of an in-vehicle device. Specifically, when connected to the in-vehicle device, the control unit of the mobile phone reads image data indicating an image displayed on the display unit of the mobile phone from the memory, and transmits the image data to the in-vehicle device through the interface. The control unit of the in-vehicle device receives image data from the mobile phone via the interface, performs image processing via the memory, and displays an image on the display unit of the in-vehicle device.

  For example, Patent Document 2 discloses a technique for performing an icon operation on a portable-side image displayed on a display device of a vehicle by operating a switch on an operation unit (pointing device) provided on a center console of the vehicle.

JP 2012-124578 A JP 2012-111330 A

  By the way, the operation of the mobile terminal is generally performed by a touch operation on the display screen. Therefore, even if the display screen of the mobile terminal is displayed on the display on the vehicle side, there is a problem that the operation cannot be performed with a general operation switch.

  The present invention has been made in view of such circumstances, and an object thereof is equivalent to a touch operation through an operation unit that allows a vehicle occupant to perform a switch operation while displaying an image displayed on a portable display unit on the vehicle side. Provided is a vehicle display device capable of performing operations on a mobile terminal.

In order to solve such a problem, the present invention is communicably connected to a portable terminal including a portable display unit that reads information on a touch operation based on a position, direction, or timing with which a finger touches the entire screen, or a combination thereof. Connection unit, a display unit that displays a mobile display image displayed on the mobile display unit in a state where the mobile terminal is connected to the connection unit, a control unit that performs display control of the display unit, and a direction in which direction operation is performed An operation unit that includes a switch and a confirmation switch that performs a confirmation operation, and that inputs an operation instruction according to the switch operation of the vehicle occupant to the control unit. Here, when a touch operation is performed, the mobile terminal reads the coordinates of the part touched by the finger as information on the touch operation. The control unit converts the operation instruction input from the operation unit into an operation signal corresponding to the touch operation based on a correspondence relationship in which the touch operation on the portable display unit and the operation mode of the operation unit are associated with each other. Output to a mobile device. In this case, the operation signal corresponding to the touch operation is a coordinate signal corresponding to the coordinate signal recognized by the mobile terminal when the touch operation is performed on the mobile display unit. On the other hand, on the display unit, a portable display image area for displaying a portable display image is set separately from a vehicle information display area for displaying vehicle information, and the two are separated and displayed at the same time. A cursor that moves in response to the input operation instruction is displayed only in the mobile display image area.

  Here, in the present invention, it is preferable that the operation unit is a steering switch disposed on a steering wheel of the vehicle.

In the present invention, the operation unit preferably further includes a mode switch for switching the operation mode. Here, the operation mode includes a cursor mode in which a cursor displayed superimposed on the mobile display image displayed on the display unit is moved according to the operation of the direction switch, and a mobile display image itself displayed on the display unit. It is desirable to have a scroll mode that moves according to the operation of the direction switch. In this case, it is desirable that the cursor mode and the scroll mode can be used only when the portable terminal is connected to the connection unit.

  In the present invention, when the direction switch is operated in the scroll mode, it is preferable that the mobile display image displayed on the display unit gradually moves in accordance with the operation direction of the direction switch over a predetermined period.

  It is preferable that the mobile display image displayed on the display unit gradually move corresponding to the operation direction of the direction switch for a certain period after the operation of the direction switch.

  It is preferable that the mobile display image displayed on the display unit gradually move in accordance with the operation direction of the direction switch while the direction switch is operated.

  ADVANTAGE OF THE INVENTION According to this invention, operation equivalent to touch operation can be performed with respect to a portable terminal through the operation part in which switch operation is possible by a vehicle passenger.

1 is a block diagram schematically showing the configuration of a vehicle instrument device according to a first embodiment. Explanatory diagram schematically showing the configuration of the meter unit Explanatory drawing showing the display state of the instrument display Explanatory drawing showing another display state of the instrument display Explanatory drawing explaining the drawing process by a graphic controller Explanatory diagram schematically showing the configuration of the operation unit Illustration of operation mode Explanation of focus mode Explanatory drawing showing the range of operation with the cursor Explanatory drawing which shows the correspondence of a touch operation and the operation mode and the operation mode of an operation part. Explanatory drawing which shows the concept of coordinate transformation processing Explanatory drawing showing the marker for scroll mode A flowchart showing a control operation for realizing a flick operation or a swipe operation by the operation unit. Explanatory drawing which shows the concept of the process of the graphic controller which concerns on pinch out operation The perspective view which shows typically the external appearance of the operation part which concerns on 4th Embodiment. Explanatory diagram schematically showing the configuration of the operation unit

(First embodiment)
FIG. 1 is a block diagram schematically showing a configuration of a vehicle instrument device 1 according to the present embodiment. This vehicular instrument device 1 is mainly composed of a meter unit (display unit) 10 and a control unit 50. In the present embodiment, the meter unit 10 and the control unit 50 are configured separately, but they may be integrated.

  FIG. 2 is an explanatory diagram schematically showing the configuration of the meter unit 10. The meter unit 10 is arranged, for example, on a dashboard in front of the driver's seat, and displays vehicle information to vehicle occupants. Here, the vehicle information is information related to the vehicle, and in the present embodiment is related to the vehicle state. This vehicle state includes at least the speed or the engine speed, but other examples include the total travel distance, shift position, direction indicator, time, various warnings, and the like.

  The meter unit 10 includes a vehicle information display area AI that displays vehicle information. In the vehicle information display area AI, various instruments such as a speedometer 11 for displaying speed, a tachometer 12 for displaying engine speed, and the like are arranged. The speedometer 11 and the tachometer 12 are general analog instruments, and are composed of arc-shaped scales 11a, 12a, 13a, and 14a, and hands 11b, 12b, 13b, and 14b that indicate required positions on the scale. ing.

  Further, an instrument display 20 that displays various kinds of information is arranged in the vehicle information display area AI. The instrument display 20 displays, for example, the time held by the vehicle, the outside temperature around the vehicle, the shift position, the travel distance, various warnings, and other vehicle information. Moreover, the display image displayed on the portable display part 101 of the portable terminal 100 mentioned later is displayed on this instrument display 20 as needed.

  The instrument display 20 is disposed between the speedometer 11 and the tachometer 12 in the approximate center of the vehicle information display area AI, for example, in consideration of visibility from the driver's seat. As the instrument display 20, a TFT-LCD (Thin Film Transistor Liquid Crystal Display: an example of a liquid crystal display) can be used. The instrument display 20 has a required screen size (for example, about 7 inches) necessary for securing various display areas described later. The resolution of the instrument display 20 may be the same as that of the mobile display unit 101 of the mobile terminal 100. However, from the viewpoint of reducing the calculation load and reducing the cost, the mobile display unit of the mobile terminal 100 A resolution lower than 101 can be used.

  The control unit 50 performs display control of the meter unit 10, and includes a meter controller (meter CPU) 51 that controls the entire meter unit 10, and a graphic controller (GDC) 55 that performs display control of the instrument display 20. And a power supply unit (PWR) 60. The meter controller 51 and the graphic controller 55 are connected to be communicable with each other.

  The meter controller 51 transmits predetermined control data to the graphic controller 55 in order to display the vehicle information via the instrument display 20. The graphic controller 55 performs a drawing process according to the control data.

  The graphic controller 55 is mainly composed of a microcomputer mainly composed of a CPU, a ROM, a RAM, and an I / O interface. The graphic controller 55 is connected to a memory 57 made of a semiconductor nonvolatile memory.

  The graphic controller 55 performs a drawing process according to the control data from the meter controller 51. The graphic controller 55 causes the instrument display 20 to display a required image by outputting image data to the instrument display 20 through a drawing process.

  FIG. 3 is an explanatory diagram showing a display state of the instrument display 20. In the instrument display 20, the time information held by the vehicle is displayed in the time area 20a, and the other areas 20b to 20g are information on the outside air temperature around the vehicle, shift position information, section travel distance information, and total travel distance information. An icon indicating a display menu is displayed, and vehicle information content other than these is displayed in the vehicle information content area 20g. For example, in the vehicle information content area 20g, instantaneous fuel consumption, average fuel consumption, boost pressure, and the like are graphically displayed together with a predetermined scale.

  The graphic controller 55 is connected to a communication interface 56 that connects the portable terminal 100 to the vehicular instrument device 1 in a communicable manner. The communication interface 56 is a wired communication interface, for example, and USB (Universal Serial Bus) is used, for example. Of course, a wireless communication interface can also be used as the communication interface 56, and short-range wireless communication such as Bluetooth (registered trademark) or wireless LAN is also applicable.

  Here, the mobile terminal 100 is a smartphone as an example, but other mobile terminals such as a mobile phone and a PDA (Personal Digital Assistance) can be used. The mobile terminal 100 includes a mobile display unit 101 that displays an image corresponding to the content processed by the mobile terminal 100. The portable display unit 101 has a function of reading operation information based on a position, direction or timing with which a finger touches the entire screen, or a combination thereof, and specifically, a touch panel that allows a user to perform a touch operation. It has.

  The touch operation refers to an operation performed according to various contact modes such as a position, a direction, and a timing at which a finger touches the entire mobile display unit 101 (touch panel). When the mobile terminal 100 performs the touch operation, the operation is performed. The coordinate information of the information finger, specifically, the part touched by the finger is read. Typical touch operations include taps, flicks, swipes, pinch-ins, and pinch-outs. The tap operation is an operation of touching an arbitrary position on the portable display unit 101 with a fingertip. The flick operation is an operation of touching an arbitrary position on the mobile display unit 101 with a finger and paying it as it is, and the swipe operation is an operation of touching an arbitrary position on the mobile display unit 101 with a finger and sliding it as it is. The pinch-out operation is an operation of sliding two fingers to spread at an arbitrary position on the portable display unit 101, and the pinch-in operation is to pinch two fingers at an arbitrary position on the portable display unit 101. It is an operation to slide to. Note that the touch operation can be performed with an operation tool such as a touch pen in addition to the finger itself, and in this specification, the operation with the finger will be described including the case where the touch operation is performed with the operation tool.

  After the portable terminal 100 is connected to the communication interface 56 of the vehicle instrument device 1, when a predetermined menu item (for example, “display portable display screen” menu) is selected by the operation unit 70, the graphic controller 55 Mobile image data is input from the mobile terminal 100. Here, the portable image data is image data indicating a display image displayed on the portable display unit 101, and is output from the portable terminal 100 in response to a request from the graphic controller 55. The mobile image data is generated through a predetermined process by the mobile terminal 100 and is displayed on the mobile display unit 101 (hereinafter referred to as “mobile display image”). Image processing is performed so as to correspond to the screen size of the area 20h.

  When portable image data is input from the portable terminal 100, the graphic controller 55 performs a drawing process according to this data. The graphic controller 55 outputs required image data to the instrument display 20 through a drawing process, thereby displaying a portable display image on the instrument display 20.

  FIG. 4 is an explanatory diagram showing another display state of the instrument display 20. The instrument display 20 displays not only vehicle information but also a portable display image. In the instrument display 20, a mobile display image area 20h is set instead of the vehicle information content area 20g shown in FIG. 3, and the mobile display image is displayed in the mobile display image area 20h. Thus, the instrument display 20 simultaneously displays the vehicle information display area for displaying vehicle information (including the display areas 20a to 20f) and the mobile display image area 20h for displaying mobile display images. In addition, the mobile display image area 20h is set separately from the vehicle information display area, and the two are separated.

  The instrument display 20 displays a cursor 20i that moves on the display screen in response to an operation instruction input from the operation unit 70, which will be described later, in accordance with the display of the mobile display image. The cursor 20i is not always displayed on the instrument display 20, but is displayed only when the cursor mode is set as an operation mode to be described later.

  Note that the mobile display image area 20h does not need to be set to the same size and layout as the vehicle information content area 20g, and can have any size and layout. However, the mobile display image area 20 h is preferably set to a size larger than the screen size of the mobile display unit 101 of the mobile terminal 100. Thereby, the vehicle occupant can visually recognize the mobile display image in the vehicle information content area 20g having a screen size larger than that of the mobile display unit 101 of the mobile terminal 100. Further, since the mobile display image area 20h corresponds to a large size, it is possible to display all of the mobile display images displayed on the mobile display unit 101 without cutting them out.

  FIG. 5 is an explanatory diagram for explaining a drawing process by the graphic controller 55. The images displayed on the instrument display 20 are hierarchized. That is, the graphic controller 55 draws an image on each layer (layer) based on the control data output from the meter controller 51 and the portable image data output from the mobile terminal 100, and superimposes one or more layers. Image data is created, and this image data is output to the instrument display 20.

  In the present embodiment, the layer is composed of four layers, and an image formed by superposing four layers L1 to L4 from the upper layer to the lower layer is displayed in the mobile display image area 20h. The cursor 20i is drawn in the uppermost layer L1, the vehicle information is drawn in the second upper layer L2, the portable display image is drawn in the third upper layer L3, and the lower layer L2 Other information (for example, a captured image when a camera is connected) is drawn on the layer L4. As described above, the graphic controller 55 provides the dedicated layer L3 for drawing the mobile display image, and draws the vehicle information on the layer L2 different from the layer L3. In the present embodiment, the cursor 20i is drawn on a layer L1 different from the layer L3 on which the mobile display image is drawn.

  As shown in FIG. 4, the screen displayed on the instrument display 20 is a portion where an image in the upper layer is displayed in a portion where the image is in the upper layer, and there is no image in the upper layer. Then, the image of the lower layer is displayed. That is, the image drawn on the upper layer is preferentially displayed. In addition to the display method in which the lower layer image is not displayed by the upper layer image, a display mode in which the transmittance is set and the lower layer image is transmitted may be adopted. Good.

  Further, as one of the features of this embodiment, the graphic controller 55 limits the drawing range (movement range) of the cursor 20i within the drawing area of the portable display image, that is, within the portable display image area 20h. That is, the cursor 20i is displayed only in the mobile display image area 20h, and its control specifications are set so that the cursor 20i is not displayed beyond this range.

  On the other hand, when the cursor 20i is moved from the position of the outer edge (for example, the left outer edge) of the portable display image area 20h or the vicinity thereof to the opposite outer edge (for example, the right outer edge) or the vicinity thereof, the cursor 20i is displayed by the portable display. It is necessary to move over the entire range of the image area 20h. In this case, not only does it take time to move the cursor 20i, but also the vehicle occupant must continuously perform necessary operations, which is inconvenient.

  Therefore, when an operation instruction for moving the cursor 20i to the outside (for example, the left direction) is input with the cursor 20i positioned at the outer edge (for example, the left outer edge) of the mobile display image area 20h. The graphic controller 55 preferably performs loop processing. This loop process is a process of displaying the cursor 20i on the outer edge (for example, the right outer edge) of the mobile display image area 20h located on the opposite side to the previous display position. As a result, the cursor 20i can be efficiently moved in the mobile display image area 20h, and usability can be improved.

  In addition, as one of the features of the present embodiment, the graphic controller 55 converts the operation instruction input from the operation unit 70 into an operation signal corresponding to the touch operation and outputs the operation signal to the mobile terminal 100. Here, the converted operation signal corresponds to a pseudo coordinate signal and corresponds to a coordinate signal recognized by the mobile terminal 100 when a touch operation is performed on the mobile display unit 101. As a premise for performing such processing, an operation mode on the operation unit 70 and a touch operation are associated in advance. The graphic controller 55 can perform an operation equivalent to the touch operation on the portable terminal 100 through the switch operation unit 70 by performing such conversion processing. The operation method of the portable terminal 100 using the operation unit 70 will be described later.

  FIG. 6 is an explanatory diagram schematically showing the configuration of the operation unit 70. An operation unit 70 is connected to the graphic controller 55. The operation unit 70 is for inputting an operation instruction according to the operation of the vehicle occupant, and is a steering switch (STRSW) provided on the steering wheel 2, for example.

  The operation unit 70 includes four direction switches 70a, 70b, 70c, and 70d that are up, down, left, and right, a confirmation switch 70e, a mode switch 70f, and a back switch 70g. Each of the switches 70a to 70g can be operated by a vehicle occupant (pressing operation as an example).

  The four direction switches 70a to 70d are used to move the cursor 20i displayed superimposed on the mobile display image displayed in the mobile display image area 20h, or to move the mobile display image itself displayed in the mobile display image area 20h. This is for inputting operation instructions regarding directions. The confirmation switch 70e is used to input an operation instruction related to a vehicle occupant's intention to confirm.

  The mode switch 70f is used to input an operation instruction related to switching of operation modes. As shown in FIG. 7, a menu mode, a cursor mode, a focus mode, a scroll mode, an audio mode, and the like are prepared as the operation mode.

  Here, the menu mode is an operation mode for operating a menu item for switching the display contents of the vehicle information content area 20g and the mobile display image area 20h and the operation target of the mobile terminal 100.

  The cursor mode is an operation mode in which the cursor 20i displayed in the mobile display image area 20h is moved according to the operation of the four direction switches 70a to 70d, and a touch operation such as a tap operation, a double tap operation, or a long tap operation is realized. Is for.

  As shown in FIG. 8, the focus mode is an operation mode in which the focus 20k displayed in the mobile display image area 20h is moved according to the operation of the four direction switches 70a to 70d. For example, in this focus mode, an application screen displaying a list or icon of the application is displayed in the portable display image area 20h on the basis of the application information acquired from the portable terminal 100, and the focus 20k is displayed in a superimposed manner. Let Then, according to the operation of the focus 20k, a list or an icon in the application screen can be designated and operated.

  The scroll mode is an operation mode in which the mobile display image itself displayed in the mobile display image area 20h is moved according to the operation of the four direction switches 70a to 70d, and a touch operation such as a flick operation and a swipe operation is realized. belongs to.

  The audio mode is an operation mode for performing a reproduction operation of music and video held by the mobile terminal 100.

  Of these modes, modes other than the menu mode can be used only when the mobile terminal 100 is connected to the communication interface 56. The operation mode is such that the menu mode, the cursor mode, the focus mode, and the audio mode can be sequentially switched in this order every time the mode switch 70f is operated.

  The back switch 70g inputs an operation instruction for returning the transition of the mobile display image displayed in the mobile display image area 20h to the previous state.

  In the vehicle instrument device 1 having such a configuration, when the mobile terminal 100 is not connected to the communication interface 56 of the vehicle instrument device 1, the vehicle information display area AI including the instrument display 20 is all related to vehicle information. Information is displayed.

  At this time, the vehicle occupant can switch the type of vehicle information displayed on the instrument display 20 through the operation of the operation unit 70.

  Next, an operation method of the portable terminal 100 using the operation unit 70 will be described on the assumption that the portable display image is displayed in the portable display image area 20h.

  FIG. 10 is an explanatory diagram illustrating a correspondence relationship between the touch operation, the operation mode, and the operation mode of the operation unit 70. For example, “tap” in the touch operation corresponds to an operation with a single press of the confirmation switch 70e in the cursor mode. Similarly, of the touch operations, “double tap” corresponds to an operation in which the confirmation switch 70e is pressed twice in the cursor mode. Of the touch operations, “long tap” corresponds to an operation of long pressing the enter switch 70e in the cursor mode. Further, “flick” of the touch operation corresponds to a single press operation of the direction switches 70a to 70d in the scroll mode. Of the touch operations, “swipe” corresponds to an operation of long pressing the direction switches 70a to 70d in the scroll mode. In addition, “pinch-in” among the tap operations corresponds to a single press of the confirmation switch 70e in the scroll mode. The tap operation “pinch out” corresponds to an operation of long pressing the confirmation switch 70e in the scroll mode. Note that such correspondence is merely an example, and any operation of the operation unit 70 may be associated with the touch operation.

  Usually, an application using the mobile terminal 100 is executed by tapping an application displayed on the mobile display unit 101. The vehicle occupant can select and operate an application installed in the mobile terminal 100 by selecting the cursor mode as the operation mode.

  Hereinafter, an operation method of the mobile terminal 100 using the cursor mode will be described. As shown in FIG. 4, when the cursor 20i is displayed in the portable display image area 20h together with the selection of the cursor mode, the vehicle occupant moves the cursor 20i by operating the direction switches 70a to 70d. Thereby, the desired application displayed on the mobile display image and the center position of the cursor 20i are superimposed. Then, the vehicle occupant performs a single operation with a single push of the confirmation switch 70e.

  When the confirmation switch 70e is pressed once, the graphic controller 55 uses the coordinates (cursor) where the center point 20ia of the cursor 20i is positioned based on the two-dimensional coordinates preset in the mobile display image area 20h. 20i center coordinates). On the other hand, since the coordinate system is different between the mobile display image area 20h and the mobile display unit 101, the graphic controller 55 performs coordinate conversion processing based on the center coordinates of the cursor 20i. By this coordinate conversion processing, as shown in FIG. 11, coordinates (hereinafter referred to as “corresponding coordinates”) 101a on the mobile display unit 101 corresponding to the center point 20ia of the cursor 20i are identified. Then, the graphic controller 55 transmits a pseudo touch operation signal (coordinate signal) to the mobile terminal 100 based on the identified corresponding coordinate 101a.

  When the mobile terminal 100 receives the pseudo touch operation signal, the mobile terminal 100 recognizes as if the tap operation has been performed on the corresponding coordinates 101 a of the mobile display unit 101. Thereby, the portable terminal 100 will execute the application which exists in the tap operation position.

  The process related to the tap operation is the same for the double tap operation and the long tap operation.

  Next, operation mode switching processing will be described. First, when the mode switch 70f is operated, the graphic controller 55 distinguishes between the single press operation and the long press operation based on the ON time of the mode switch 70f (that is, the time when the switch 70f is pressed). To do.

  When the operation of the mode switch 70f is single-pressed, the graphic controller 55 sequentially switches the operation mode among the four modes including the menu mode, the cursor mode, the focus mode, and the audio mode (see FIG. 7).

  When the operation of the mode switch 70f is a long press, the graphic controller 55 switches the operation mode between the cursor mode and the scroll mode. As shown in FIG. 7, the operation mode can be switched between the focus mode and the scroll mode or between the audio mode and the scroll mode.

  When the cursor mode is switched, the graphic controller 55 switches the cursor 20i displayed on the instrument display 20 to the scroll mode marker 20j as shown in FIG. The display position of the marker 20j is set so that the center coordinate of the marker 20j matches the center coordinate of the mobile display image area 20h, regardless of the previous cursor position. In the scroll mode, the image itself is moved with reference to the position of the marker 20j. Therefore, the image is easily moved in any direction by initially placing the image at the center.

  Next, an operation method using the scroll mode will be described. Usually, when a mobile display image (for example, a map image) displayed on the mobile display unit 101 is moved, the mobile display unit 101 is flicked or swiped. The vehicle occupant can move the mobile display image displayed in the mobile display image area 20h by using the scroll mode.

  FIG. 13 is a flowchart illustrating a control operation for realizing a flick operation or a swipe operation by the operation unit 70. First, in step 30 (S30), the graphic controller 55 determines whether or not an operation signal has been input from the direction switches 70a to 70d. When the operation is performed on the direction switches 70a to 70d, an affirmative determination is made in step 30, and the process proceeds to step 31 (S31).

  In step 31, the graphic controller 55 determines whether or not the ON time of the direction switches 70 a to 70 d, that is, the time when the switches 70 a to 70 d are pressed is equal to or less than the determination value n (msec). Here, the determination value n is a value set to distinguish between a single press operation and a long press operation.

  When the operation of the direction switches 70a to 70d is a single press (in the case of a flick operation), the ON time is equal to or less than the determination value n, so an affirmative determination is made in step 31 and the process proceeds to step 32 (S32). On the other hand, when the operation of the direction switches 70a to 70d is a long press (in the case of a swipe operation), the ON time is longer than the determination value n, so a negative determination is made in step 31 and the process proceeds to step 35 (S35).

  In step 32, the graphic controller 55 transmits a pseudo flick operation signal to the mobile terminal 100. Specifically, first, the graphic controller 55 specifies target coordinates. In the case where the direction switches 70a to 70d are operated and the process of step 32 is executed first, the center coordinates of the marker 20j in the portable display image area 20h are used as the target coordinates. On the other hand, in the subsequent cases, the target coordinates updated in step 34 (S34) described later are used as the target coordinates.

  Next, the graphic controller 55 performs a coordinate conversion process based on the target coordinates. By this coordinate conversion processing, the coordinates (corresponding coordinates) on the portable display unit 101 corresponding to the target coordinates in the portable display image area 20h are identified. Then, the graphic controller 55 transmits a pseudo flick operation signal (coordinate signal) to the mobile terminal 100 based on the identified corresponding coordinates.

  In step 33 (S33), the graphic controller 55 determines whether or not the target coordinate has reached a predetermined end coordinate. The end coordinates are set according to the amount of image movement by the flick operation, and can be, for example, half (1/2) the size of the mobile display image area 20h. For example, when a flicking operation with a finger in the left direction is reproduced in a pseudo manner, the coordinate at the center of the left end of the mobile display image area 20h corresponds to the end coordinate, and a flicking operation with a finger in the upward direction is reproduced in a pseudo manner. In this case, the coordinates of the center of the upper end of the mobile display image area 20h correspond to the end coordinates.

  If the target coordinates have reached the end coordinates, an affirmative determination is made in step 33, and this process ends. On the other hand, if the target coordinates have not reached the end coordinates, a negative determination is made in step 33, and the process proceeds to step 34 (S34).

  In step 34, the graphic controller 55 performs a coordinate update process. This coordinate update process is a process of updating the target coordinate to a position shifted from the current coordinate position by a predetermined amount according to the operation direction of the direction switches 70a to 70d. For example, when the left switch 70c is operated, the target coordinates are updated to a position shifted by a predetermined amount in the left direction from the current coordinate position. Note that the amount of coordinate shift can be determined by initial settings or by vehicle occupant settings.

  When the processing from step 32 to step 34 is continued for a certain period, a pseudo flick operation signal is input to the mobile terminal 100 over time, and the mobile terminal 100 performs the flick operation when the mobile display unit 101 is operated. Similarly, information on coordinates continuously changing is acquired. Thereby, the portable terminal 100 recognizes as if the flick operation is performed on the portable display unit 101 according to the transition of the corresponding coordinates. And in the portable terminal 100, the process which shifts the coordinate position of the image displayed on the center position of the portable display part 101 gradually is reverse to a flick operation direction. Thereby, in the portable display unit 101 and the portable display image area 20h, the portable display image gradually moves corresponding to the operation direction of the direction switches 70a to 70d for a certain period after the operation of the direction switches 70a to 70d. Become. In a general flick operation, the moving speed of the image is not constant from beginning to end, and a display mode that changes with time is used. For example, the moving speed of the image is initially fast and gradually slows down. Therefore, the shift amount of the coordinate position of the image does not need to be handled in a constant manner, and may be changed with time.

  On the other hand, in step 35, the graphic controller 55 transmits a pseudo swipe operation signal to the mobile terminal 100. Specifically, first, the graphic controller 55 specifies target coordinates. In the case where the direction switches 70a to 70d are operated and the process of step 35 is first executed, the center coordinates of the marker 20j in the portable display image area 20h are used as the target coordinates. On the other hand, in the subsequent cases, the target coordinates updated in step 37 (S37) described later are used as the target coordinates.

  The graphic controller 55 performs a coordinate conversion process based on the target coordinates. By this coordinate conversion processing, the coordinates (corresponding coordinates) on the portable display unit 101 corresponding to the target coordinates in the portable display image area 20h are identified. Then, the graphic controller 55 transmits a pseudo swipe operation signal (coordinate signal) to the mobile terminal 100 based on the identified corresponding coordinates.

  In step 36 (S36), the graphic controller 55 determines whether or not the operation signal from the direction switches 70a to 70d has ended. When the operation of the direction switches 70a to 70d is stopped, the operation signal from the direction switches 70a to 70d is terminated. Therefore, an affirmative determination is made in step 36, and this process is terminated. On the other hand, when the operation of the direction switches 70 a to 70 d is continued, a negative determination is made in step 36, and the process proceeds to step 37.

  In step 37, the graphic controller 55 performs a coordinate update process. This coordinate update process is a process of updating the target coordinate to a position shifted from the current coordinate position by a predetermined amount according to the operation direction of the direction switches 70a to 70d. For example, when the left switch 70c is operated, the target coordinates are updated to a position shifted by a predetermined amount in the left direction from the current coordinate position. Note that the amount of coordinate shift can be determined by initial settings or by vehicle occupant settings. When the target coordinates reach the coordinates of the end of the mobile display image area 20h, the next coordinate update process sets the center coordinates in the mobile display image area 20h as the target coordinates, and coordinates from the center coordinates The update process is repeated.

  When the processing from step 35 to step 37 is continued for the operation period of the direction switches 70a to 70d, a pseudo swipe operation signal is input to the mobile terminal 100 over time. As with the swipe operation, coordinate information that continuously changes is acquired. Thereby, the portable terminal 100 recognizes as if the swipe operation was performed on the portable display unit 101 according to the transition of the corresponding coordinates. And in the portable terminal 100, the process which shifts the coordinate position of the image displayed on the center position of the portable display part 101 gradually is performed contrary to the swipe operation direction. Thereby, in the portable display unit 101 and the portable display image area 20h, the portable display image gradually moves corresponding to the operation direction of the direction switches 70a to 70d during the period in which the direction switches 70a to 70d are operated. It becomes.

  As described above, in this embodiment, the vehicular instrument device 1 includes the communication interface 56 that is communicably connected to the portable terminal 100 including the portable display unit 101 that can be touch-operated, and the portable terminal 100 is connected to the communication interface 56. Instrument display 20 (portable display image area 20h) for displaying a portable display image displayed on the portable display unit 101 in a state in which it is in a state, a control unit 50 for performing display control of the instrument display 20, and a direction switch for performing a direction operation 70 a to 70 d and a confirmation switch 70 e that performs a confirmation operation, and an operation unit 70 that inputs an operation instruction according to the switch operation of the vehicle occupant to the control unit 50. Here, the control unit 50 converts the operation instruction input from the operation unit 70 into an operation signal corresponding to the touch operation and outputs the operation signal to the mobile terminal 100.

  According to this configuration, since the mobile display image is displayed in a part of the vehicle information display area AI of the meter unit 10, the mobile display image can be viewed through the meter unit 10. Since the vehicle instrument device 1 is a device that is mounted on a vehicle as a standard device for displaying vehicle information, the vehicle instrument device 1 having a predetermined function displays an image of the portable terminal 100. be able to. In addition, since the vehicular instrument device 1 is arranged at a position excellent in visibility from a vehicle occupant, particularly a driver, the movement of the line of sight is less than that in the case of displaying on a vehicle-mounted display, and the mobile display image Visibility can be improved. For this reason, it is not necessary to visually recognize the portable terminal 100, and the situation where concentration on driving | operation is inhibited can be suppressed.

  By the way, since some display devices on the vehicle side are provided with a touch panel for use in multimedia devices and navigation systems, it is conceivable to operate the portable terminal 100 through this touch panel. In this case, since it is necessary to specify which display object is operated from the position of the touch operation on the display on the vehicle side, a common dedicated application is installed in each of the vehicle and the mobile terminal, and a control event is sent. It is necessary to associate in advance. Therefore, the dedicated application can be used on the vehicle side, but there is a problem that a normal application installed only on the mobile terminal cannot be used.

  In addition, when the display on the vehicle side is not disposed at a position where it can be operated by a vehicle occupant, there is a disadvantage that the touch operation cannot be performed in the first place regardless of the presence or absence of the touch panel.

  In addition, it is conceivable to operate a display object with a cursor or focus that is linked to the switch operation of the operation unit. However, as described above, it is necessary to specify which display object has been operated. It is necessary to install a dedicated application common to each terminal.

  In this regard, according to the configuration of the present embodiment, an operation equivalent to a touch operation can be performed on the mobile terminal 100 through the operation unit 70 that can be operated by a vehicle occupant. In particular, according to the present embodiment, the operation instruction of the operation unit 70 is converted, and an operation signal corresponding to the touch operation, specifically, a pseudo coordinate signal corresponding to the touch operation is output. Therefore, the portable terminal 100 recognizes as if the portable display unit 101 was touched through this signal. As a result, it is not necessary to specify which display object is operated from the position of the operation on the mobile display image area 20h on the vehicle side, so there is no need to install a dedicated application common to both the vehicle and the mobile terminal. . Thereby, the application installed in the portable terminal 100 can be freely operated.

  Moreover, in this embodiment, since a portable display image is displayed on the vehicular instrument device 1, it cannot be directly touch-operated. However, according to this embodiment, since it can operate using the operation part 70 which performs switch operation, the display and operation of the portable display image to the vehicle instrument apparatus 1 are realizable.

  In the present embodiment, the operation unit 70 is a steering switch disposed on the steering wheel 2 of the vehicle.

  According to this configuration, the driver can easily operate the operation unit 70.

  In the present embodiment, the operation unit 70 further includes a mode switch 70f for switching the operation mode. Here, the operation mode includes a cursor mode in which the cursor 20i displayed in a superimposed manner with the portable display image displayed on the instrument display 20 is moved according to the operation of the direction switches 70a to 70d, and the instrument display 20. There is a scroll mode in which the displayed mobile display image itself is moved according to the operation of the direction switches 70a to 70d.

  According to this configuration, an operation mode for operating the cursor 20i for selecting a display object and for moving the mobile display image itself is provided. These modes can be freely selected by operating the mode switch 70f, and various operations can be realized by using the operation unit 70 having a limited switch.

  In the above-described embodiment, the operations related to the switches 70a to 70g of the operation unit 70 have been described in association with the cursor mode and the scroll mode. However, operations related to the switches 70a to 70g of the operation unit 70 may be associated with the menu mode or the audio mode. For example, in the audio mode, the media is “reproduced” by a single operation of the right switch 70d.

(Second Embodiment)
Hereinafter, the vehicle instrument device 1 according to the second embodiment will be described. The vehicle instrument device 1 according to the second embodiment is different from that of the first embodiment in an operation mode switching method. Hereinafter, description common to the first embodiment will be omitted, and description will be made focusing on differences.

  First, a flow when the mobile terminal 100 is connected to the communication interface 56 of the vehicle instrument device 1 will be described. When the vehicle occupant physically connects the portable terminal 100 to the communication interface 56, the graphic controller 55 outputs a predetermined signal to the portable terminal 100. This signal output includes information on the screen size of the display unit 101, information on applications held by the mobile terminal 100 (such as a category to which the application belongs), and control events associated with the mobile terminal 100 (for example, music playback, temporary Stop, skip, etc.).

  Based on the response from the mobile terminal 100, the graphic controller 55 determines whether or not the connection with the mobile terminal 100 is successful. Then, the graphic controller 55 displays the connection result with the portable terminal 100 in a predetermined area of the instrument display 20.

  Next, a flow related to selection of an operation mode at the time of application activation will be described. First, when the vehicle occupant operates the confirmation switch 70e in a state where an application to be activated by operating the four direction switches 70a to 70d is selected, the selected application is activated in the mobile terminal 100.

  Next, the graphic controller 55 reads information (category) of the activated application from the mobile terminal 100. When the category of the activated application is music, the graphic controller 55 assigns an audio mode as the operation mode of the operation unit 70. On the other hand, when the category of the activated application is not music, the graphic controller 55 assigns the cursor mode as the operation mode of the operation unit 70. Then, the graphic controller 55 displays the operation mode assigned to the operation unit 70 in a predetermined area of the instrument display 20.

  Next, the flow at the end of the application will be described. The graphic controller 55 determines the end of the application operation by the vehicle occupant. Specifically, the graphic controller 55 determines whether or not there has been no operation input to the operation unit 70 for a certain period of time starting from the last operation input to the operation unit 70.

  When there is no operation input on the operation unit 70, the graphic controller 55 changes the assignment of the operation mode to the operation unit 70 based on a preset setting mode. The setting mode allows the vehicle occupant to select an arbitrary mode from among the menu mode, cursor mode, focus mode, scroll mode, and audio mode, depending on the initial setting. In this case, the vehicle occupant selects an operation mode that is frequently used during traveling.

  As described above, according to the second embodiment, even if the operation of the mode switch 70f is not performed, the operation mode according to the activated application is automatically switched according to the condition of activation of the application.

  If there is no such automatic switching function, for example, it is assumed that the current operation mode is the menu mode. When the music application is selected, as shown in FIG. 7, the music application can be operated by operating the cursor mode, the focus mode, the audio mode and the mode switch 70f three times from the menu mode. However, according to the present embodiment, the operation mode is automatically switched according to the application information. Accordingly, for example, in the case of a music application, an operation mode adapted to an operation such as playback / stop can be used when an application is selected.

  In addition, as a means other than the determination based on the category of the application, an operation mode having a high operation frequency for each usable application may be set in advance and registered by the user. In addition, the frequency of use of the cursor mode and the focus mode varies depending on the mobile terminal 100 and the application to be used. For this reason, it is preferable that an operation mode to be selected can be registered in advance according to the user's preference when an application other than the audio-related application is selected in the initial setting.

  Further, according to the present embodiment, when the no-operation state continues for a certain time, the current operation mode is automatically switched to the setting mode.

  When the operation of the application to be operated is completed, the operation mode is used less frequently again. For example, when the operation of the map application is completed using the cursor mode or the scroll mode, the operation is not performed for a while after that. Therefore, the setting mode is automatically switched on condition that a certain time has passed. For example, a person with many operations of an audio player automatically switches to the audio mode by setting the setting mode to the audio mode. Alternatively, in the case of a user who frequently switches and confirms contents such as vehicle information during driving, the setting mode is set to the menu mode to automatically switch to the menu mode. Thereby, since the frequency of operation by the vehicle occupant can be suppressed, usability can be improved.

  It should be noted that such automatic switching setting is preferably made so that it is possible to select whether or not to operate according to the initial setting.

(Third embodiment)
A pinch-in operation or a pinch-out operation realized by the operation unit 30 will be described. The pinch-out operation is used, for example, when enlarging the image magnification, and the pinch-in operation is used, for example, when reducing the image magnification. When an operation corresponding to these operations is performed on the operation unit 70, the graphic controller 55 updates and transmits coordinates (pseudo pinch-in operation signal or pseudo-signal) for the coordinates of two points corresponding to two fingers. Processing such as transmission of a pinch-out operation signal is continued for a predetermined period. Thereby, a pseudo pinch-in operation signal or a pseudo pinch-out operation signal is input to the mobile terminal 100 over time.

  First, the 1st aspect is demonstrated about the process regarding pinch in operation or pinch out operation. In the pinch-in operation, the coordinates are updated so that the coordinates of the two points move in the direction approaching each other along the left-right direction with reference to the center coordinates of the mobile display image area 20h. On the other hand, in the pinch-out operation, the coordinate update is performed so that the coordinates of the two points move in directions away from each other along the left-right direction with reference to the center coordinate of the mobile display image area 20h. Thereby, the portable terminal 100 will acquire the information of the coordinate which changes continuously similarly to when the portable display part 101 is pinched in or pinched out.

  Next, a second aspect of the processing related to the pinch-in operation or the pinch-out operation will be described. Hereinafter, the process will be described by taking a pinch-out operation as an example. Here, FIG. 14 is an explanatory diagram showing a concept of processing of the graphic controller 55 related to the pinch-out operation.

  When an operation corresponding to the pinch out is performed on the operation unit 70, the graphic controller 55 selects a direction in which the amount of movement in the left-right direction and the up-down direction is maximized based on the center coordinates of the displayed cursor 20i. For example, taking the state shown in FIG. 14 as an example, the right direction and the upward direction are selected as directions in which the movement amount is maximum.

  The graphic controller 55 updates the coordinates so that the coordinates of the two points move with respect to the selected direction based on the center coordinates of the cursor 20i. At this time, the change in coordinates due to the coordinate update is assumed to be limit coordinates (for example, the coordinates of the end of the mobile display image area 20h) in the selected direction.

  Along with such processing, a pseudo pinch-out operation signal is input to the mobile terminal 100. As a result, the image displayed in the mobile display image area 20h is enlarged and displayed while the image point corresponding to the center of the displayed cursor 20i gradually moves toward the center of the mobile display image area 20h. It will be.

  In addition, a third aspect of the processing related to the pinch-in operation or the pinch-out operation will be described. Hereinafter, the process will be described by taking a pinch-out operation as an example.

  When an operation corresponding to the pinch out is performed on the operation unit 70, the graphic controller 55 sets the coordinates of one of the two coordinates as the center coordinates of the displayed cursor 20i, and the coordinates of the other point. Is set to a coordinate several pixels away from the coordinates of one point. Then, the coordinates of one point remain fixed, and the coordinates of the other point are coordinated so as to move from the center coordinate of the cursor 20i in a direction going straight through the center coordinate of the mobile display image area 20h. Update.

  Thus, according to the 2nd mode and the 3rd mode, the scale which can be expanded by one operation will increase compared with what is shown in the 1st mode. Further, an arbitrary position can be enlarged according to the position of the cursor 20i. As a result, even when the operation unit 70 is used, the pinch-out operation can be performed with a sense similar to the touch operation of the mobile terminal 100. In addition, although the pinch out operation was demonstrated in the 2nd aspect and the 3rd aspect, you may apply these aspects to pinch in operation.

(Fourth embodiment)
Hereinafter, the configuration of the operation unit 70 according to the fourth embodiment will be described. Here, FIG. 15 is a perspective view schematically showing an appearance of the operation unit 70 according to the fourth embodiment. FIG. 16 is an explanatory diagram schematically showing the configuration of the operation unit 70, FIG. 16 (a) is a side view schematically showing the configuration of the operation unit 70, and FIG. 16 (b) is a sensor configuration. It is explanatory drawing which shows the detail of.

  In the present embodiment, the operation unit 70 includes an operation knob 71, an elastic body 72, and a plurality of load sensors 73 (four load sensors 73 in the present embodiment). The operation unit 70 also includes a mode switch 74 and a back switch 75.

  The operation knob 71 includes a columnar base 71a and an annular portion 71b projecting around the flange 71. The operation knob 71 is disposed on the upper surfaces of the four load sensors 73 via elastic bodies 72 such as rubber, soft resin, and springs. The load sensor 73 is a sheet-like sensor and detects a load input to the sheet surface. The four load sensors 73 are two-dimensionally arranged in a matrix on the substrate.

  According to such a configuration, the operation knob 71 can be pressed in the vertical direction with respect to the top of the base portion 71a, and can be tilted in the vertical and horizontal directions with respect to the annular portion 71b. Further, the up / down / left / right tilting operation on the annular portion 71b can be performed alone, or the tilting operation can be performed as it is while performing the pressing operation in the vertical direction with respect to the top portion of the base portion 71a.

  At this time, since the load according to the operation mode to the operation knob 71 is input to the four load sensors 73 via the elastic body 72, the load to the operation knob 71 is based on the load distribution to the four load sensors 73. The operation mode can be determined. In this case, the pressing operation in the vertical direction with respect to the top of the base 71a is made to correspond to the operation (confirmation operation) of the confirmation switch 70e in the first embodiment, and the up / down / left / right tilting operation on the annular portion 71b is performed as the first operation. It can be made to correspond to operation (direction operation) of four direction switches 70a, 70b, 70c, and 70d in the embodiment.

  According to such a configuration, since a complex operation can be performed by operating the single operation knob 71, a more intuitive operation is possible. In addition, when the switches are individually separated, a blank period of operation occurs when the operation is performed across a plurality of switches, and it is difficult to obtain a continuous operation mode. In this respect, in the present embodiment, since the confirmation operation and the direction operation can be performed continuously, the operability can be improved.

  As mentioned above, although the vehicle instrument apparatus concerning embodiment of this invention was demonstrated, it cannot be overemphasized that a various deformation | transformation is possible within the scope of the invention, without this invention being limited to embodiment mentioned above. Absent. For example, the display form and layout of the vehicle information and the portable display image in the instrument display can be individually set according to the design of the meter unit. Furthermore, in this embodiment, when displaying vehicle information, an analog instrument is used for some information, but the entire vehicle information display area is configured by a display, and for various instruments and instruments by graphic processing. The display content of the display may be displayed.

  Further, in the above-described embodiment, application to a vehicle instrument device has been exemplified. However, the present invention is applied to a vehicle display device mounted in a vehicle such as a navigation system / multimedia display or a head-up display. Can be widely applied. In this case, the vehicle information can include not only vehicle state information but also vehicle traveling information including route guidance, map information around the vehicle, and route guidance information.

  In this embodiment, an independent switch is provided for each function (direction, confirmation, mode, back). However, the present invention is not limited to this, and one switch may be configured to correspond to a plurality of functions.

1 Vehicle instrumentation device (vehicle display device)
10 Meter Unit 11 Speedometer 12 Tachometer 13 Water Temperature Meter 14 Fuel Meter 15 Direction Indicator Light 20 Instrument Display (Display Unit)
20h Mobile display image area (display part)
50 Control unit (control unit)
51 Meter controller 52 CAN communication part 55 Graphic controller 56 Communication interface (connection part)
60 power supply unit 70 operation unit 100 portable terminal 101 portable display unit

Claims (6)

A connection unit communicably connected to a portable terminal including a portable display unit that reads information on a touch operation based on a position, direction, or timing touched by a finger in the entire screen or a combination thereof;
A display unit for displaying a portable display image displayed on the portable display unit in a state where the portable terminal is connected to the connection unit;
A control unit that performs display control of the display unit;
An operation unit that includes a direction switch that performs a direction operation and a confirmation switch that performs a confirmation operation, and inputs an operation instruction according to a switch operation of a vehicle occupant to the control unit;
When a touch operation is performed, the mobile terminal reads the coordinates of a location touched by a finger as information on the touch operation,
The control unit converts an operation instruction input from the operation unit into an operation signal corresponding to the touch operation based on a correspondence relationship in which a touch operation on the portable display unit is associated with an operation mode of the operation unit. Convert and output to the mobile device ,
The operation signal corresponding to the touch operation is a coordinate signal corresponding to a coordinate signal recognized by the mobile terminal when a touch operation is performed on the mobile display unit.
In the display section,
The mobile display image area for displaying the mobile display image is set separately from the vehicle information display area for displaying vehicle information, and the two are separated and displayed at the same time.
A vehicle display device , wherein a cursor that moves in response to an operation instruction input from the operation unit is displayed only in the portable display image area .   The vehicle display device according to claim 1, wherein the operation unit is a steering switch disposed on a steering wheel of the vehicle. The operation unit further includes a mode switch for switching an operation mode,
The operation mode is:
A cursor mode for moving a cursor displayed superimposed on the mobile display image displayed on the display unit according to the operation of the direction switch;
A scroll mode for moving the mobile display image itself displayed on the display unit according to the operation of the direction switch ;
The vehicle display device according to claim 1 or 2, wherein the cursor mode and the scroll mode can be used only when the mobile terminal is connected to the connection unit.   The portable display image displayed on the display unit gradually moves in accordance with the operation direction of the direction switch over a predetermined period when the direction switch is operated in the scroll mode. The vehicle display device described in 1.   5. The vehicle display according to claim 4, wherein the portable display image displayed on the display unit gradually moves corresponding to the operation direction of the direction switch for a certain period after the operation of the direction switch. apparatus.   5. The vehicle display device according to claim 4, wherein the portable display image displayed on the display unit gradually moves in accordance with an operation direction of the direction switch while the direction switch is operated. Display device.

Images