JP6095273B2 - In-vehicle device and control method thereof - Google Patents

Description

  The present invention relates to an in-vehicle device and a control method thereof.

  In recent years, in-vehicle devices that perform route guidance in cooperation with a portable information processing terminal such as a smartphone (hereinafter referred to as “mobile terminal”) have been developed. For example, such an in-vehicle device can receive image data, audio data, and the like used for route guidance from a mobile terminal, and perform route guidance by displaying, reproducing, and the like according to an instruction from an application on the mobile terminal side. it can.

  When the touch panel display of the in-vehicle device is touched by the user, operation information indicating the operation content is transmitted from the in-vehicle device to the mobile terminal. For example, when a touch operation is performed by touching buttons such as buttons and icons displayed on the touch panel display of the in-vehicle device, operation data indicating the content of the touch operation on the in-vehicle device is transmitted from the in-vehicle device to the mobile terminal. Depending on the operation information, the mobile terminal updates the image and audio data to be output to the in-vehicle device.

JP 2002-357450 A JP 2006-275931 A JP 2008-276277 A JP 2008-21094 A

  However, the user interface of the application installed in the mobile terminal is constructed on the assumption that the user performs a touch operation on the touch panel display of the mobile terminal. On the other hand, the operation environment of the touch panel display is greatly different between the mobile terminal and the in-vehicle device as follows.

  Comparing the operation environment of smartphones and in-vehicle devices, smartphones can be touched nearby, but in in-vehicle devices, the distance between the user sitting on the seat and the touch panel display is relatively long, It is necessary to perform a touch operation on the touch panel display with a little extended hand, and a fine touch operation is not easy.

  Moreover, although the touch operation in a smart phone can be performed in a stationary state, in the in-vehicle device, it is necessary to perform the touch operation in a vehicle that is shaken as the vehicle travels, and a fine touch operation is not easy. In many cases, hard buttons are arranged on a frame surrounding the periphery of the touch panel display in the in-vehicle device. Therefore, the in-vehicle device may be difficult to perform a touch operation in the end region of the touch panel display as compared to the smartphone.

Therefore, when the user interface of the mobile terminal is used as it is as the user interface of the in-vehicle device, the operability of the touch panel display in the in-vehicle device may be deteriorated due to the difference in the operation environment and operation conditions of the touch panel display. is there. The present invention has been made in view of the above circumstances, and it is an object of the present invention to provide a technique capable of improving the operability of a touch panel display of an in-vehicle device by a user in an in-vehicle device capable of cooperating with a mobile terminal. .

  The present invention employs the following means in order to solve the above-described problems. That is, the present invention is an in-vehicle device that operates in cooperation with a mobile terminal by being communicably connected to the mobile terminal, and can accept a communication means that communicates with the mobile terminal and a touch operation by a user. When a touch operation on the first image is received when the first image using the touch panel display and the image data received from the mobile terminal via the communication unit is displayed on the touch panel display, A second image obtained by enlarging an image of a portion corresponding to a predetermined area including the touch position coordinates in the first image is displayed on the touch panel display, and the second image displayed on the touch panel display is displayed. When a touch operation is accepted, the correspondence of the position corresponding to the touch position coordinates on the second image in the first image Into a target, and a control means for transmitting the data for the corresponding coordinates (hereinafter, also referred to as "touch position coordinate data") of the mobile terminal.

  According to the above configuration, even if the user performs a touch operation on the first image, the position data related to the touch operation is not immediately transmitted to the mobile terminal. A portion corresponding to a predetermined area including the touch position coordinates, for example, a second image (enlarged image) obtained by enlarging the image of the touch operation position and the surrounding area is displayed on the touch panel display of the in-vehicle device. Will wait for the touch operation.

  When the user performs a touch operation on the second image, according to the present invention, the touch position coordinates on the second image are converted into corresponding coordinates on the corresponding position in the first image. Since the second image has a higher display magnification than the first image, there is a touch error by the user, for example, a button or icon (hereinafter also referred to as “buttons”) in the image. The possibility of doing is extremely low.

  According to this, the touch operation mistake of the touch panel display of the vehicle equipment by a user can be suppressed, and the operativity of a touch panel display can be improved. Thereby, the reliability of the user's operation data with respect to the touchscreen display of a vehicle-mounted apparatus sent from a vehicle-mounted apparatus to a portable terminal can be improved. Therefore, operation data having contents not intended by the user is not transmitted from the in-vehicle device to the portable terminal, and therefore, there is no inconvenience that processing not intended by the user is performed thereafter.

  The control means may display the second image in a part of the display area of the touch panel display and display the first image in the remaining display area of the touch panel display. According to this, when the second image is displayed on the touch panel display of the in-vehicle device, it is possible to prevent the information by the first image from being provided to the user.

  The range of the predetermined area may be defined based on the number of pixels from the touch position coordinates. Alternatively, the predetermined area is set in advance as an area surrounding one button alone in the first image, or as an area surrounding a plurality of buttons together, and the control means When the touch operation to the predetermined area is received from the first image displayed on the touch panel display, the second image obtained by enlarging the image of the portion corresponding to the predetermined area is displayed on the touch panel display. You may let them.

Moreover, this invention can be grasped | ascertained as one side surface of the control method of a vehicle equipment. That is, the present invention is a method for controlling an in-vehicle device provided with a touch panel display that operates in cooperation with the mobile terminal by being connected to be communicable with the mobile terminal and can accept a touch operation by a user, When a first image display step of displaying a first image using image data received from the portable terminal via the communication unit on the touch panel display and a touch operation on the first image are received, A second image display step of causing the touch panel display to display a second image obtained by enlarging an image of a portion corresponding to a predetermined area including the touch position coordinates in the first image; and the second image displayed on the touch panel display. When a touch operation on the second image is received, the touch position coordinates on the second image are set to the first image. A coordinate conversion step of converting the corresponding coordinate positions corresponding in the image, a control method of the vehicle-mounted device including a coordinate data transmitting step of transmitting data to said mobile terminal for said corresponding coordinate after conversion.

  Further, the present invention may be a program for causing a computer of an in-vehicle device to execute each step related to the above control method, or a computer-readable storage medium that records such a program. . Here, the computer-readable recording medium is a medium that can store information such as a program by electrical, magnetic, optical, mechanical, or chemical action.

  The means for solving the problems in the present invention can be employed in combination as much as possible.

  ADVANTAGE OF THE INVENTION According to this invention, in the vehicle equipment which can be cooperated with a portable terminal, the technique which can improve the operativity of the touch panel display of a vehicle equipment by a user can be provided.

It is a lineblock diagram of an in-vehicle system concerning an embodiment. 1 is an external perspective view of a navigation device according to an embodiment. 1 is a configuration diagram of a navigation device and a mobile terminal according to an embodiment. It is a figure which shows the sequence of the route guidance control in the vehicle-mounted system which concerns on embodiment. It is a figure which shows the example of a display of the original image in the touchscreen of a navigation apparatus. It is a figure which shows the example of a display of the image in the touchscreen of a portable terminal. It is a figure explaining the enlarged display process which concerns on embodiment. It is a figure explaining the enlarged display process which concerns on embodiment. It is a figure explaining the setting method of the touch peripheral area which concerns on embodiment. It is a figure explaining the 2nd touch position coordinate at the time of receiving the touch operation to an enlarged image. It is a figure explaining the modification of the enlarged display process which displays an enlarged image.

  DETAILED DESCRIPTION Exemplary embodiments for carrying out the present invention will be described in detail below with reference to the drawings. The dimensions, materials, shapes, relative arrangements, and the like of the components described in the present embodiment are not intended to limit the technical scope of the invention to those unless otherwise specified. Absent.

<In-vehicle system>
FIG. 1 is a configuration diagram of an in-vehicle system 1 according to the embodiment. The in-vehicle system 1 according to the present embodiment includes a navigation device 2 and a portable information processing terminal (hereinafter simply referred to as “portable terminal”) 3 as in-vehicle devices mounted on a vehicle. FIG. 2 is an external perspective view of the navigation device 2 according to the embodiment. FIG. 3 is a configuration diagram of the navigation device 2 and the mobile terminal 3 according to the embodiment.

<Navigation device>
The navigation device 2 is, for example, a car navigation device integrated with a main body and a monitor of 2DIN (Deutsche Industry Normen), such as a car navigation function for performing route guidance (route guidance) to the current location or destination of the vehicle, and various audio / visual devices. It has a content playback function (hereinafter referred to as AV), a function of receiving broadcast waves, and the like. The navigation device 2 is a portable terminal cooperative navigation device that operates in cooperation with the portable terminal 3 by being connected to the portable terminal 3 in a communicable manner. The navigation device 2 receives an operation from the user. Then, the navigation device 2 transmits operation data indicating the accepted operation content to the mobile terminal 3. The mobile terminal 3 is, for example, a mobile phone such as a smartphone, a PC (Personal Computer), or the like. The portable terminal 3 receives the operation data from the navigation device 2 and executes various processes according to the operation data. The navigation device 2 serves as a user interface for the mobile terminal 3.

Here, the configuration of the navigation device 2 will be described first. The navigation device 2 includes a control unit 20, a communication unit 21, a power amplifier 22, a speaker 23, a touch panel display 24, a display processing unit 25, an operation reception unit 26, an operation button 27, and the like.
The control unit 20 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), an input / output interface, and the like. When the accessory power supply of the vehicle is turned on, the control unit 20 executes a computer program recorded in the ROM, and implements various functions using data stored in the RAM.
Although details of various functions realized by the control unit 20 will be described later, the control unit 20 receives signals from each unit of the navigation device 2 or a connected external device (for example, the portable terminal 3) or a user operation. An operation instruction signal or the like from each operation unit is received, and each unit of the navigation device 2 or an external device is comprehensively controlled based on these signals.

  The communication unit 21 is a communication module for the navigation device 2 to communicate with the mobile terminal 3 and corresponds to a communication unit in the present invention. The communication unit 21 is appropriately selected depending on the type of communication performed between the navigation device 2 and the mobile terminal 3. For example, the communication unit 21 may be a USB (Universal Serial Bus) interface, a Wi-Fi (Wireless Fidelity (registered trademark)) module, a Bluetooth (registered trademark) module, or the like.

The navigation device 2 performs auditory guidance by drivingly controlling the power amplifier 22 and the speaker 23. The power amplifier 22 is a module for outputting sound from the speaker 23. Audio data held in the RAM or the like of the control unit 20 is input to the power amplifier 22 via the input / output interface.
The power amplifier 22 is a circuit that amplifies a signal related to audio data sent from the control unit 20 to the speaker 23. The power amplifier 22 is controlled by the control signal of the control unit 20, and outputs a sound signal in which the volume and sound are adjusted to the speaker 23 with respect to the signal related to the input sound data. The speaker 23 outputs a signal related to the audio data input by the power amplifier 22 as audio.

The navigation device 2 visually provides route guidance using the touch panel display 24 and the display processing unit 25. The display processing unit 25 is a module for displaying an image (video) on the touch panel display 24. Image (video) data held in the RAM or the like of the control unit 20 is input to the display processing unit 25. Note that the RAM of the control unit 20 can receive and hold the image data received by the communication unit 21 from the mobile terminal 3 side.

  The touch panel display (hereinafter simply referred to as “touch panel”) 24 is, for example, a GUI (Graphical User Interface) that combines a color liquid crystal display and a touch sensor. The touch panel 24 displays a screen on, for example, an enhanced graphics adapter (EGA) type liquid crystal display, and a touch sensor detects this when a button or an icon (hereinafter referred to as “buttons”) displayed on the screen is pressed. .

  The display processing unit 25 is a circuit that performs drawing processing on an image to be displayed on the liquid crystal display (screen) of the touch panel 24. The display processing unit 25 draws an image on the display of the touch panel 24 by driving thin film transistors that are evenly arranged in a lattice pattern on the liquid crystal display based on the video signal sent from the control unit 20. In addition, when the touch sensor detects a touch operation on the touch panel 24, the operation reception unit 26 specifies a touched position (coordinates) on the screen and sends information on the operated position (coordinates) to the control unit 20. .

  The operation button 27 is not a button displayed as an icon on the touch panel 24 but a mechanical button (hard button). The operation button 27 is a push button switch for operation disposed below the touch panel 24 as shown in FIG. The operation button 27 may be, for example, a volume adjustment button for sound output from the speaker 23. When the operation button 27 is pressed, a signal of the pressed button is sent to the control unit 20.

<Mobile device>
Next, the configuration of the mobile terminal 3 will be described. The portable terminal 3 includes a control unit 30, a communication unit 31, a power amplifier 32, a speaker 33, a touch panel display 34, a display processing unit 35, an operation reception unit 36, a GPS (Global Positioning System) information reception unit 37, and a card memory interface 38. Prepare. The card memory interface 38 is represented as “card memory IF” in FIG.

  The control unit 30 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), an input / output interface, and the like. The control unit 30 executes a computer program recorded in the ROM, and implements various functions using data stored in the RAM.

  The communication unit 31 is a communication module for the mobile terminal 3 to communicate with the navigation device 2 and is the same as the communication unit 21 on the navigation device 2 side. The communication unit 31 is appropriately selected depending on the type of communication performed between the navigation device 2 and the mobile terminal 3. For example, the communication unit 31 may be a USB (Universal Serial Bus) interface, a Wi-Fi (Wireless Fidelity (registered trademark)) module, a Bluetooth (registered trademark) module, or the like.

  The portable terminal 3 can output sound from the speaker 33 by driving and controlling the power amplifier 32 by the control unit 30. The power amplifier 32 is a module for outputting sound from the speaker 33. The power amplifier 32 of the portable terminal 3 has the same configuration as the power amplifier 22 on the navigation device 2 side, and detailed description thereof is omitted. Further, the touch panel display (hereinafter referred to as “touch panel”) 34, the display processing unit 35, and the operation receiving unit 36 have the same configurations as the touch panel 24, the display processing unit 25, and the operation receiving unit 26 on the navigation device 2 side. Detailed explanation is omitted.

  The GPS information receiving unit 37 receives a radio wave signal from a GPS satellite received by a GPS antenna (not shown), and sends the received signal to the control unit 30. The card memory interface 38 is a memory card reader / writer that reads and writes a nonvolatile semiconductor memory card, for example. The control unit 30 accesses a memory card inserted into the card memory interface 38 and acquires data recorded in the memory card, thereby various functions such as route search of the navigation device 2 linked to the portable terminal 3. Is realized.

  The memory area of the memory card inserted into the card memory interface 38 includes map data (image data) including road information such as highways and general roads, point information (POI data) regarding various facilities such as theme parks and gas stations. In addition, voice data for route guidance, detailed information on various facilities such as telephone numbers, facility names, and addresses are recorded.

<Description of operation>
The navigation device 2 and the mobile terminal 3 configured as described above can communicate with each other by connecting the communication units 21 and 31 with, for example, a cable (not shown). As described above, the application program (hereinafter referred to as “navigation application”) in the mobile terminal 3 is executed by the control unit 30 in a state in which communication with each other is possible. Car navigation function for route guidance is realized.

  The navigation application is recorded in the ROM of the control unit 30 and is activated when the CPU of the control unit 30 executes the application program recorded in the ROM. In addition, an icon corresponding to the navigation application (hereinafter referred to as “navigation icon”) is displayed on the basic screen of the touch panel 34 in the mobile terminal 3. When the touch sensor on the touch panel 34 detects that the navigation icon is pressed by the user, the information is sent to the control unit 30 and the navigation application is executed by the control unit 30.

  Hereinafter, in the in-vehicle system 1, route guidance control in which the navigation device 2 and the mobile terminal 3 cooperate with each other to perform route guidance of the vehicle will be described. In this embodiment, the outline of the route guidance control realized by the cooperation of the navigation device 2 and the portable terminal 3 is as follows. In other words, in route guidance control, image data used to perform vehicle route guidance (for example, image data for creating an image showing the position of the vehicle, destination, waypoint, route, etc. on a map) ) And audio data are sequentially transmitted from the portable terminal 3 to the navigation device 2.

  When the navigation device 2 receives image data or audio data from the mobile terminal 3, the image displayed on the liquid crystal display of the touch panel 24 is updated based on the received data, or guidance audio is output from the speaker 23. Thus, the car navigation function in the navigation device 2 is realized.

Further, during route guidance control, various buttons such as “menu”, “destination”, “periphery”, and the like are displayed on the touch panel 24 of the navigation device 2, and a touch operation by the user is accepted. When the touch operation of the touch panel 24 by the user is detected in the navigation device 2, the control unit 20 indicates information indicating the content of the touch operation, specifically, coordinate information indicating which position on the screen the user has pressed. Is transmitted to the portable terminal 3. And the portable terminal 3 which received the said coordinate information from the navigation apparatus 2 can acquire the touch position of the touch panel 24 by the user based on the received coordinate information. Thereby, the control unit 30 of the mobile terminal 3 performs image update for displaying on the navigation device 2 and other various processes according to the touch position of the touch panel 24.

  Hereinafter, details of route guidance control in the in-vehicle system 1 will be described. FIG. 4 is a diagram illustrating a route guidance control sequence in the in-vehicle system 1 according to the embodiment. As described above, the route guidance control is started when the control unit 30 of the mobile terminal 3 starts the navigation application. When the route guidance control is started, a communication connection process is executed between the navigation device 2 and the portable terminal 3 (OP1). Specifically, the control unit 20 in the navigation device 2 controls the communication unit 21, and the control unit 30 of the mobile terminal 3 controls the communication unit 31, thereby enabling communication between the navigation device 2 and the mobile terminal 3. It becomes possible. As a result, data can be exchanged between the navigation device 2 and the portable terminal 3.

  Next, the control unit 30 of the portable terminal 3 transmits image data related to the route guidance of the vehicle to the navigation device 2 (OP2). The image data here is, for example, image data obtained by combining the own vehicle position, the route from the current location to the destination, and the like on a map. In addition, the control part 30 of the portable terminal 3 transmits the audio | voice data regarding the route guidance of a vehicle with respect to the navigation apparatus 2 suitably as needed.

  In addition, in a previous process in which the control unit 30 of the mobile terminal 3 transmits image data to the navigation device 2, the control unit 30 of the mobile terminal 3 receives a destination setting input by the user via the touch panel 34 and receives GPS information. The unit 37 obtains the current vehicle position by acquiring the own vehicle position information received from the GPS satellite, and searches for a route from the current location to the destination. At the time of route search, the control unit 30 can search the travel route from the current position of the vehicle to the destination from the map data of the memory card inserted in the card memory interface 38. The control unit 30 determines the course of the vehicle from the relationship between the searched travel route and the position of the vehicle, and the map image data is read from the memory card based on the determined path. Then, the control unit 30 generates image data (hereinafter referred to as “navigation image data”) to be displayed on the touch panel 24 of the navigation device 2 based on the map image data read from the memory card, the vehicle position data, and the like. To the navigation device 2.

  The control unit 20 of the navigation device 2 that has received the navigation image data from the portable terminal 3 stores the navigation image data in the RAM and displays the entire image corresponding to the navigation image data on the touch panel 24 (OP3). Here, the image corresponding to the navigation image data is the image data received from the portable terminal 3 as it is, that is, an image drawn on the touch panel 24 without performing special additional image processing. This is called “image”.

  FIG. 5 shows a state in which the original image is displayed on the touch panel 24 of the navigation device 2. In the example shown in FIG. 5, the original image is drawn on the map as an image obtained by synthesizing the vehicle position and the route from the current location to the destination. In the present embodiment, the original image corresponds to the first image referred to in the present invention.

  A display mode of the touch panel 34 of the mobile terminal 3 during the route guidance control will be described. FIG. 6 is a diagram illustrating a display example of an image on the touch panel 34 of the mobile terminal 3. As shown in FIG. 6, during the route guidance control, the entire original image similar to the touch panel 24 of the navigation device 2 is displayed on the touch panel 34. The original image displayed on the touch panel 34 of the mobile terminal 3 is an image drawn based on the navigation image data generated by the mobile terminal 3.

  The control unit 20 of the navigation device 2 accepts a touch operation on the touch panel 24 by the user in a state where the original image is displayed on the touch panel 24. During route guidance control, various buttons are displayed on the touch panel 24. In the example illustrated in FIG. 5, three buttons such as “menu”, “destination”, and “periphery” are displayed side by side in the lower left area of the touch panel 24.

  When the user performs a touch operation on the touch panel 24, that is, here, a touch operation on the original image, this touch operation is detected by a touch sensor on the touch panel 24. When the touch sensor detects a touch operation, the control unit 20 of the navigation device 2 may acquire coordinates (hereinafter, also referred to as “first touch position coordinates”) CO1 related to a position where the user touches the touch panel 24 from the touch sensor. it can. The first touch position coordinate CO1 here can be said to be a touch position coordinate touched by the user with respect to the original image.

  The control unit 20 that has acquired the first touch position coordinate CO1 for the original image has an area associated with the touch position coordinate, specifically, an area drawn in a predetermined range including the touch position coordinate and its surroundings ( Hereinafter, an enlargement display process is performed to enlarge and display “touch peripheral area” on the touch panel 24 (OP4).

  Here, details of the enlarged display processing will be described with reference to the drawings. Here, a case where the user presses the cross mark portion shown in FIG. 7 while the original image is displayed on the touch panel 24 will be described as an example. That is, the user touches the “destination” button (icon) displayed on the touch panel 24 in order to reset the destination. The control unit 20 acquires the coordinates of the cross mark portion shown in FIG. 7, that is, the first touch position coordinates CO1, based on the detection signal from the touch sensor. Then, the control unit 20 sends a command signal to the display processing unit 25, and an image (shown by a thick broken line AP1 in FIG. 7) drawn as a predetermined region including the first touch position coordinate CO1 ( Hereinafter, the “touch peripheral image portion”) is enlarged from the original image and is displayed in the enlarged image display area shown in FIG. The touch peripheral area AP1 corresponds to a predetermined area including touch position coordinates in the first image referred to in the present invention.

  The navigation image data received from the portable terminal 3 is held in the RAM of the control unit 20, and an original image is drawn based on this navigation image data. The enlarged image is equivalent to an image obtained by cutting and enlarging a part of the original image. Therefore, the control unit 20 can generate an enlarged image based on the navigation image data stored in its own RAM.

  In FIG. 7, the cross mark indicating the first touch position coordinate CO1 and the boundary line indicating the touch peripheral area AP1 are shown to help understanding of the present invention, and these marks and boundary lines are actually used. There is no need to display on the touch panel 24. However, in order to make the user recognize the position and range of the first touch position coordinate CO1 and the touch peripheral area AP1, these marks and boundary lines are displayed on the touch panel 24 when the touch operation is performed on the original image. May be.

Although various methods can be set as the touch peripheral area AP1 setting method shown in FIG. 7, in this embodiment, the touch peripheral area AP1 is defined based on the number of pixels from the first touch position coordinate CO1. Yes. For example, as shown in FIG. 7, the touch peripheral area AP1 has a rectangular shape, and is arranged between the four sides as the outline defining the touch peripheral area AP1 and the first touch position coordinates CO1. The number of pixels to be set is set in advance. Here, the number of pixels arranged between the first touch position coordinate CO1 and each side may be the same or different. For example, in the example shown in FIG. 9, the number of pixels up to the right side is A and the left side out of the four sides that divide the touch peripheral area AP1 from other areas around the first touch position coordinate CO1 (x, y). The number of pixels is defined as B, the number of pixels up to the upper side is defined as C, and the number of pixels up to the lower side is defined as D. Each of A to D can be arbitrarily determined.

  Further, when the enlarged image is displayed on the touch panel 24, the control unit 20 causes the enlarged image to be displayed in the enlarged image display area while partially displaying the original image on the touch panel as shown in FIG. Specifically, the display processing unit 25 divides the display area of the touch panel 24 into an original image display area DR1 and an enlarged image display area DR2 based on a command signal from the control unit 20. In the example shown in FIG. 8, the enlarged image display area DR2 is located on the lower left side of the display area of the touch panel 24, and is set as an area smaller than the original image display area DR1. However, the arrangement position of the enlarged image display area DR2 in the display area of the touch panel 24, the area ratio between the enlarged image display area DR2 and the original image display area DR1, and the like can be arbitrarily determined. Further, the enlargement magnification of the enlarged image based on the original image can be set to an arbitrary magnification as long as the enlargement image display magnification is set higher than that of the original image.

  As shown in FIG. 8, the control unit 20 of the navigation device 2 accepts a touch operation on the enlarged image by the user in a state where the enlarged image is displayed in the enlarged image display region DR <b> 2 of the touch panel 24. Here, the touch operation on the enlarged image means a touch operation on the enlarged image display region DR2 of the touch panel 24 on which the enlarged image is drawn. When the control unit 20 receives a touch operation on the enlarged image displayed in the enlarged image display region DR2, the control unit 20 determines a touch position coordinate (hereinafter referred to as “second touch position coordinate”) CO2 to the enlarged image. The coordinates of the corresponding position in the original image (hereinafter referred to as “corresponding coordinates”) are converted into CO3 (OP5). The corresponding coordinate CO3 is a coordinate indicating which position in the original image the position touched by the user with respect to the enlarged image corresponds to.

  FIG. 10 is a diagram illustrating the second touch position coordinate CO2 when a touch operation on the enlarged image displayed in the enlarged image display region DR2 is received. Similarly to the first touch position coordinate CO1, the control unit 20 can also acquire the second touch position coordinate CO2 based on a detection signal from the touch sensor of the touch panel 24. In FIG. 10, the position where the touch operation is performed on the enlarged image, that is, the position of the second touch position coordinate CO2 is represented by an asterisk. The second touch position coordinate CO2 represented by an asterisk coincides with the position where the character “target” is written in the button (icon) indicated as “destination” in the enlarged image. Yes. By the way, returning to FIG. 7, when the user performs a touch operation on the original image in a state before displaying the enlarged image, among the buttons (icons) labeled “Destination”, "" Matches the position where the character "" is written.

  The control unit 20 of the navigation device 2 obtains the corresponding coordinate CO3 of the position corresponding to the second touch position coordinate CO2 in the enlarged image in the original image. That is, referring to FIG. 10, since the second touch position coordinate CO2 matches the “target” portion of the “destination” button in the enlarged image, the control unit 20 determines the corresponding position in the original image shown in FIG. That is, the coordinates of the position corresponding to the “target” of the “destination” button are obtained. Specifically, the control unit 20 can obtain the second touch position coordinate CO2 by converting it into the corresponding coordinate CO3 based on the enlargement magnification of the enlarged image when the original image is used as a reference.

The control unit 20 of the navigation device 2 transmits data relating to the corresponding coordinate CO3 after conversion from the second touch position coordinate CO2 (hereinafter also referred to as “touch position coordinate data”) to the portable terminal 3 (OP6). The control unit 30 of the mobile terminal 3 that has received the touch position coordinate data from the navigation device 2 acquires, based on the touch position coordinate data, coordinates at which the user touches the touch panel 24 in the navigation device 2, that is, corresponding coordinates CO3. .

  And the control part 30 of the portable terminal 3 produces | generates the navigation image data for updating the image of the touch panel 24 of the navigation apparatus 2, and the own touch panel 34 based on the acquired corresponding coordinate CO3 (OP7). In the above example, the control unit 30 recognizes that the “destination” button has been pressed by the touch operation of the touch panel 24 by the user, and therefore generates navigation image data related to the destination setting screen (resetting screen). Based on the new navigation image data generated in this way, the control unit 30 updates the image drawn on the touch panel 34. At the same time, the control unit 30 transmits the newly generated navigation image data to the navigation device 2 (OP1), and the processes after OP2 up to the above are sequentially performed. By repeating the sequence OP1 to OP7 as described above, the route guidance control in the in-vehicle system 1 is executed. Note that OP1 may be omitted if the communication connection process between the navigation device 2 and the portable terminal 3 has already been performed when each process of the sequence control in FIG. 4 is repeated. Of course.

  Next, with reference to FIG. 11, a modified example of processing performed when the user performs a touch operation on the original image in the route guidance control will be described. FIG. 11 is a diagram for explaining a modification of the enlarged display process for displaying an enlarged image. In this modified example, the touch target peripheral area AP2 is an area that collectively surrounds various buttons included in the original image (for example, “menu button”, “destination button”, “peripheral button”). It is set in advance. The broken line in FIG. 11 shows the touch target peripheral area AP2 for convenience, and may not be shown on the actual screen.

  The control unit 20 of the navigation device 2 displays the original image on the touch panel 24, and when a part of the touch target peripheral area AP2 is touched by the user, the control unit 20 controls the touch target peripheral area AP2. An enlarged image is generated by enlarging the image of the corresponding part. At that time, an enlarged image may be drawn by enlarging a part of the touch target peripheral area AP2, or an enlarged image may be drawn by enlarging the entire area of the touch target peripheral area AP2. Note that the image of the portion corresponding to the touch target peripheral area AP2 can be generated based on the navigation image data held in the RAM.

  Then, the control unit 20 of the navigation device 2 displays the enlarged image in the enlarged image display region DR2 set as a part of the display region of the touch panel 24. The magnification of the enlarged image with respect to the original image can be arbitrarily set. In this modification, when a touch operation is performed on an area other than the touch target peripheral area AP2 in the original image, the process for displaying the enlarged screen on the touch panel 24 may not be performed. Note that the touch target peripheral area AP <b> 2 illustrated in FIG. 11 may be set as an area surrounding the surroundings of any of the buttons in the original image displayed on the touch panel 24. In the present modification, the touch target peripheral area AP2 corresponds to the predetermined area referred to in the present invention.

In the route guidance control according to the present embodiment, the vehicle-mounted navigation device 2 that cooperates with the mobile terminal 3 receives navigation image data generated by the mobile terminal 3, and an image related to the navigation image data is displayed on the touch panel 24 as an original image. By displaying, vehicle route guidance is performed. When the touch operation of the touch panel 24 by the user is performed, the touch position coordinate related to the first touch operation, that is, the data related to the first touch position coordinate CO1 with respect to the original image is not sent to the mobile terminal 3 as it is. As described above, the enlarged image is displayed on the touch panel 24 to accept further touch operations such as buttons and icons from the user. Then, based on the second touch position coordinate CO2 when the user performs a touch operation on the enlarged image, a corresponding coordinate CO3 that is a coordinate of a position corresponding to the second touch position coordinate CO2 in the original image is calculated, and the user performs The touch position coordinate data indicating the position where the touch operation is performed is transmitted to the mobile terminal 3.

  According to this, as the touch position coordinate data transmitted to the mobile terminal 3, not the position touched by the user with respect to the original image but the position touched by the user with respect to the enlarged image obtained by enlarging the original image is applied. . Therefore, even when a user performs a touch operation, for example, various buttons are arranged in the original image generated based on the navigation application of the mobile terminal 3, it is possible to suppress erroneous button pressing by the user. Is possible. That is, even in the case where a plurality of buttons are adjacently arranged in a manner in which the distance between each other is narrow in the original image, it is possible to prevent a user from pressing mistakes in advance, Although the user wants to set the destination, it is possible to suppress the processing such as shifting to the peripheral search screen or the menu screen.

  Normally, the navigation application by the mobile terminal 3 is constructed on the assumption that the user performs a touch operation on the touch panel 34 on the mobile terminal 3 side, and the touch operation on the touch panel 24 in the navigation device 2 that is the cooperation destination is sufficient. It may not be considered. The navigation device 2 that is an in-vehicle device is likely to be an operating environment in which it is difficult to obtain an accurate touch operation, for example, it is necessary to extend a hand during the touch operation on the touch panel 24 or to perform a touch operation in a swaying vehicle. . On the other hand, according to the navigation device 2 according to the present embodiment, even in such an operation environment, it is possible to suppress touch operation mistakes by the user without changing the navigation application on the mobile terminal 3 side. .

  As described above, according to the in-vehicle system 1 according to the present embodiment, in principle, the functions of the application are regularly linked (linked) between the navigation device 2 and the portable terminal 3, As an exception, the user's convenience for the user can be achieved by irregularly linking the transmission of the touch position to the mobile terminal 3 in response to the touch operation on the touch panel 24 by the user. According to this, in the navigation device 2 that cooperates with the portable terminal 3, it is possible to significantly improve the operability of the touch panel 24 by the user as compared with the conventional case.

  In the route guidance control of the present embodiment, when the control unit 20 of the navigation device 2 displays the enlarged image on the touch panel 24, the enlarged image is displayed on a part of the display area of the touch panel 24 (enlarged image display area DR2). (Second image) is displayed, and the original image (first image) is displayed in the remaining display area (original image display area DR1). As a result, there is an effect that the route guidance using the original image can be continuously performed during the period until the touch operation is performed on the enlarged image displayed in the enlarged image display region DR2. That is, it is possible to continuously provide useful information from the original image to the user even during the period.

  The embodiment described above is an example for explaining the present invention, and various modifications can be made to the above-described embodiment without departing from the gist of the present invention. For example, data used for vehicle route guidance may be stored in the storage device of the mobile terminal 3. The mobile terminal 3 may function as a relay device, receive data used for route guidance from another device (for example, a server), and transfer the received data to the navigation device 2.

In addition, regarding the respective hardware configurations of the navigation device 2 and the mobile terminal 3 configuring the in-vehicle system 1, the components may be appropriately omitted, replaced, and added according to the embodiment. For example, the navigation device 2 and the mobile terminal 3 may include a communication unit for connecting to a network such as the Internet. And the navigation apparatus 2 and the portable terminal 3 may be comprised so that various information and an application program may be acquired via a network.

  In the route guidance control in the present embodiment, each process and function executed by the control unit 20 of the navigation device 2 is realized by the CPU in the control unit 20 executing various application programs stored in the ROM. Yes. Moreover, each process and function which the control part 30 of the portable terminal 3 performs are implement | achieved when CPU in the control part 30 executes the various application programs memorize | stored in ROM.

  In addition, a program that causes a computer to realize the above functions can be recorded on a computer-readable recording medium. The function can be provided by causing the computer to read and execute the program of the recording medium. Here, the computer-readable recording medium refers to a recording medium in which information such as data and programs is accumulated by electrical, magnetic, optical, mechanical, or chemical action and can be read from a computer. Examples of such a recording medium that can be removed from the computer include a flexible disk, a magneto-optical disk, a CD-ROM, a CD-R / W, a DVD, a DAT, an 8 mm tape, and a memory card. In addition, there are a hard disk, a ROM, and the like as a recording medium fixed to the computer.

  In the present embodiment, the navigation device is described as an example of the in-vehicle device mounted on the vehicle. However, the present invention is applicable to any in-vehicle device that operates in cooperation with the mobile terminal 3 such as a smartphone. Can be applied. For example, it may be an audiovisual device that reproduces audiovisual content.

DESCRIPTION OF SYMBOLS 1 ... In-vehicle system 2 ... Navigation apparatus 3 ... Portable terminal 20, 30 ... Control part 21, 31 ... Communication part 24, 34 ... Touch panel display

Claims (6)

It is an in-vehicle device that operates in cooperation with the mobile terminal by being communicably connected to the mobile terminal,
Communication means for communicating with the portable terminal;
A touch panel display that can accept user touch operations,
Control means for storing image data received from the portable terminal via the communication means, and causing the touch panel display to display a first image using the image data received from the portable terminal;
With
When the control means accepts a touch operation on the first image while displaying the first image on the touch panel display, the control means applies a predetermined area including the touch position coordinates in the first image. Generating a second image obtained by enlarging the image of the corresponding part based on the image data received from the portable terminal stored in the memory and displaying the generated second image on the touch panel display; When a touch operation on the second image displayed on the touch panel display is received, the touch position coordinates on the second image are converted into corresponding coordinates on the corresponding position in the first image, and the correspondence Send data about coordinates to the mobile device ,
The predetermined area is set in advance as an area that collectively surrounds a plurality of buttons in the first image,
When the control means receives a touch operation on the predetermined area of the first image displayed on the touch panel display, the control means enlarges the entire predetermined area and displays the second image. Displaying on the touch panel display;
In-vehicle device. The control means sets the display area of the second image as an area that does not include an image indicating the position of the host vehicle.
The in-vehicle device according to claim 1. The control means displays the second image in a part of the display area of the touch panel display, and displays the first image in the remaining display area of the touch panel display.
The in-vehicle device according to claim 1 or 2. The range of the predetermined area is defined based on the number of pixels from the touch position coordinates.
The in-vehicle device according to any one of claims 1 to 3. It is a method for controlling an in-vehicle device equipped with a touch panel display that operates in cooperation with the mobile terminal by being connected to be communicable with the mobile terminal and can accept a touch operation by a user,
A first image display step of storing, in a memory, image data received from the portable terminal via communication means, and displaying a first image using the received image data on the touch panel display;
When a touch operation on the first image is received, a second image obtained by enlarging a portion of the first image corresponding to a predetermined area including the touch position coordinates is stored in the memory. A second image display step of generating the second image generated based on the image data received from the portable terminal and displaying the generated second image on the touch panel display;
Coordinate conversion for converting the touch position coordinate to the second image into the corresponding coordinate of the corresponding position in the first image when a touch operation on the second image displayed on the touch panel display is received. Steps,
A coordinate data transmission step of transmitting data relating to the corresponding coordinates after conversion to the mobile terminal;
Only including,
The predetermined area is set in advance as an area that collectively surrounds a plurality of buttons in the first image,
When a touch operation to the predetermined area is received from the first image displayed on the touch panel display, the entire area of the predetermined area is enlarged and the second image is displayed on the touch panel display. Let
In-vehicle device control method. It is an in-vehicle device that operates in cooperation with the mobile terminal by being communicably connected to the mobile terminal,
Communication means for communicating with the portable terminal;
A touch panel display that can accept user touch operations,
When a first operation using the image data received from the portable terminal via the communication unit is displayed on the touch panel display and a touch operation on the first image is received, the first image A second image obtained by enlarging an image of a portion corresponding to a predetermined area including the touch position coordinates in the image is displayed on the touch panel display;
When a touch operation on the second image displayed on the touch panel display is received, the touch position coordinates on the second image are converted into corresponding coordinates on the corresponding position in the first image, and Control means for transmitting data relating to corresponding coordinates to the portable terminal;
With
The predetermined area is set in advance as an area that collectively surrounds a plurality of buttons in the first image,
When the control means receives a touch operation on the predetermined area of the first image displayed on the touch panel display , the control means enlarges the entire predetermined area and displays the second image. The display area of the second image is displayed on the touch panel display, and the display area of the second image does not include an image indicating the vehicle position.
In-vehicle device.

Images