JP5625804B2 - In-vehicle device - Google Patents

Description

  The present invention relates to an in-vehicle device mounted on a mobile body, and more particularly to a technique for displaying a mobile-side image displayed on a display screen of an external mobile device on a display unit included in the mobile body.

  2. Description of the Related Art Conventionally, there is known a system for instructing operations on in-vehicle devices such as a navigation device, an air conditioner, and an audio on a display screen of a display device (hereinafter referred to as “in-vehicle display device”) mounted on a vehicle. This display screen is constituted by a liquid crystal display, for example, and the position of a selection item image such as an icon or button displayed on the liquid crystal display is instructed, and the in-vehicle device is operated accordingly.

  In such a system, it is preferable to dispose the display screen at a position as far upward and as far as possible in front of the driver, because it is necessary to reduce the viewpoint movement while the driver is driving. On the other hand, it is preferable to arrange the operation unit for instructing the position on the display screen at the driver's hand.

  Therefore, a remote operation system in which a display screen and an operation unit are separated has been put into practical use. In such a system, a cursor that is moved by the operation knob of the operation unit is displayed on the display screen, and the position of the display screen is indicated by this cursor. At this time, a technology has been proposed in which a reaction force (resistance force or assist force) corresponding to the display content of the display screen is applied to the operation knob to tactilely support the driver's operation and improve operability. Yes.

  For example, a technique is known in which a reaction force for assisting a cursor to be drawn into the selection item image is applied to an operation knob in the vicinity of the selection item image (see, for example, Patent Document 1). Specifically, reaction force information defining a reaction force map for applying a reaction force to the operation knob in accordance with the position of the selection item image is prepared, and a reaction force for assisting the operation knob according to the reaction force information. Apply power.

  By the way, in recent years, mobile devices have become more sophisticated. For example, a mobile phone such as a smartphone equipped with GPS can provide route guidance similar to that of an in-vehicle navigation device. Then, when considering using a portable device inside a vehicle, using a portable device using a vehicle-mounted display apparatus can be considered. For example, the portable device and the vehicle-side ECU are connected, and the display screen of the portable device is displayed on the display screen of the in-vehicle display device.

JP 2010-96669 A

  However, unlike in-vehicle devices such as a conventional navigation device, an air conditioner, and an audio, the position of the selection item image on the display screen of the portable device changes every moment and cannot be determined in advance on the vehicle side. Therefore, even if the selection item image is displayed on the display screen of the in-vehicle display device, the selection item image cannot be designated by the operation knob. Also, if the position of the selection item image is not known, reaction force information for defining a reaction force map or the like cannot be prepared, so that a reaction force corresponding to the selection item image cannot be applied to the operation knob.

  The present invention has been made to solve the above-described problems, and the object thereof is not to input information other than the display screen from the mobile device, and the selection item image is based on the display screen information of the mobile device. It is to provide a technique for specifying the position of the.

The in- vehicle device of the present invention made to achieve the above object displays a portable side image displayed on a display screen of an external portable device on a display means included in the vehicle. The external mobile device is embodied as a mobile phone such as a smartphone. Of course, a personal digital assistant called PDA (Personal Digital Assistant) is also included.

Here, the in-vehicle device includes an input / output unit, a template input unit, and a control unit.
The input / output unit is configured to perform data communication with an external portable device, and is configured by, for example, a USB interface or a wireless LAN interface. Note that the data communication referred to here may be wired or wireless.

  From the template input unit, a plurality of templates prepared in advance according to the type of the portable side image are acquired in order to specify the display position of the selection item image displayed on the portable side image. The selection item image is an image called “icon” or “button” for user operation.

At this time, a correspondence determination process and a display position specifying process are executed by the control unit.
In the correspondence determination process, it is determined which of the plurality of templates corresponds to the mobile-side image input from the input / output unit. In the display position specifying process, the display position of the selection item image on the display unit is specified based on the template determined to be supported by the corresponding determination process. For example, if the template is an image similar to the mobile-side image, the display position is specified by specifying the position of the selection item image in the template by image processing. Further, for example, the position of the selection item image may be stored in advance corresponding to each template. That is, the position of the selection item image is linked to each template.

  In other words, the mobile-side image that is the display screen of the external mobile device is used as it is, and a template corresponding to the mobile-side image is identified by comparing with a plurality of templates prepared in advance, and the display position of the selection item image on the display means Is specified. In this way, the position of the selection item image can be specified without inputting information other than the display screen from the external portable device.

By the way, as shown in Claim 1 , it can be considered that the in-vehicle device has a configuration including an operation unit. The operation unit has an operation knob that can be moved according to an operation by the user, and uses a cursor displayed on the display unit in conjunction with the operation knob to instruct the user to select a selection item image displayed on the display unit. Let The operation knob may be slidable or tiltable. At this time, when there is an instruction to select the selection item image via the operation unit, the control unit outputs from the input / output unit to the external portable device that the selection instruction has been made. In this way, the external portable device can be operated with the in-vehicle device.

Further, on the premise of such a configuration, as shown in claim 5 , the operation unit may include reaction force generation means for applying a reaction force to the operation knob to the operation knob according to the set reaction force information. Good. At this time, the control unit executes a reaction force information setting process for setting reaction force information based on the template determined to be supported by the correspondence determination process. The reaction force information is defined by, for example, a reaction force map corresponding to the image on which the selection item image is displayed. This reaction force information may be created from the position of the selection item image in the template by image processing if the template is the same image as the mobile-side image, as in the case of specifying the display position described above. It may also be stored in advance. In this way, a reaction force according to the selection item image can be applied to the operation knob.

By the way, as shown in claim 6 , when there is no template determined to be supported by the correspondence determination process, the control unit may store the mobile-side image as a new template. In other words, a template is automatically added for the next time. This is advantageous in that the template is automatically added.

In this case, as shown in claim 7 , the control unit may specify the display position of the selection item image corresponding to the new template based on the selection item image selection instruction via the operation unit. Illustrated. That is, when there is no template, the position of the selection item image is specified from the user's operation under the configuration in which the mobile-side image is stored as a template. In this way, the position of the selection item image corresponding to the new template is automatically added.

Further, as shown in claim 8 , the control unit may generate reaction force information corresponding to a new template based on an instruction to select a selection item image via the operation unit. That is, when there is no template, reaction force information is generated from the user's operation under a configuration in which the mobile-side image is stored as a template. In this way, even reaction force information corresponding to a new template is automatically added.

It is conceivable to update such reaction force information based on an operation by a user.
For example, as shown in claim 9 , the control unit may update the reaction force information so as to expand or contract the reaction force generation area for the user's operation according to the number of selection instruction image selection instructions via the operation unit. Conceivable. For example, for a selection item image with a relatively large number of selection instructions, the pulling reaction force generation area is enlarged. If it does in this way, it contributes to a user's operativity improvement. For example, as shown in claim 10 , the control unit updates the reaction force information so as to increase or decrease the magnitude of the reaction force with respect to the user operation according to the number of selection item image selection instructions via the operation unit. Can be considered. For example, for a selection item image with a relatively large number of selection instructions, the magnitude of the pull-in reaction force is increased. If it does in this way, it contributes to a user's operativity improvement.

In particular, in the configuration in which the template is automatically added, the entire data size of the template may be increased. Therefore, as shown in claim 2 , the control unit may be configured to delete some templates according to the number of template selections by the correspondence determination process. For example, a template with a relatively low use frequency is deleted. In this way, the overall data size of the template can be suppressed, and the number of templates is reduced, so that the time required for the correspondence determination process is also shortened.

Here, variations of the template will be described.
For example, as shown in claim 3 , an image prepared in advance corresponding to the mobile-side image is input as a template from the template input unit, and the control unit performs the correspondence determination process based on the similarity between the two images. It is conceivable to determine a template corresponding to the mobile-side image. If a template is created based on the mobile-side image in this way, the template can be created relatively easily.

  However, from the viewpoint of shortening the time required for image processing, as shown in claim 11, a partial image prepared in advance corresponding to a part of the mobile-side image is input as a template from the template input unit. It is desirable to have a configuration. That is, a partial comparison with the mobile-side image is performed. In this way, the time required for image processing can be shortened. In addition, the data size of the template can be reduced.

  Further, as shown in claim 12, a configuration is conceivable in which a characteristic image appearing in the mobile-side image is input as a template from the template input unit. For example, as shown in claim 13, it is conceivable that the characteristic image is a unique symbol image related to processing executed in the external portable device. The process executed by the external portable device is a process based on an application program. Specifically, if the mobile-side image (application program) relates to the weather, it may be an image indicating “sunny”, “cloudy”, “rain”, or the like. Also, for example, if the mobile-side image (application program) displays characters such as e-mail, it is possible that the image is a keyboard “A” or “W” on the assumption that a keyboard image is displayed. . In this way, the time required for image processing can be shortened. In addition, the data size of the template can be reduced.

Furthermore, as shown in claim 4 , a character string displayed at a specific position of the mobile-side image is input as a template from the template input unit, and the control unit performs a specific position of the mobile-side image in the correspondence determination process. It is conceivable to determine a template corresponding to the mobile-side image by image recognition. The character string displayed at the specific position may be a character string indicating a title, for example. This is advantageous in that the data size of the template is reduced because the template becomes character string data.

It is a block diagram which shows schematic structure of a navigation apparatus. It is explanatory drawing which shows typically the arrangement | positioning condition in the vehicle interior of a display part and an operation part. It is explanatory drawing which shows typically the reaction force map corresponding to an operation screen. It is a flowchart which shows reaction force information setting processing. It is explanatory drawing which shows the variation of a template.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram illustrating a schematic configuration of a navigation device 1 according to the embodiment.
The navigation device 1 according to the embodiment is mounted on a vehicle and, as shown in FIG. 1, is stored in a display unit 10, a position detection unit 11 that detects the current location of the vehicle, a navigation ECU 12, and a storage medium. A data input unit 13 for inputting various data such as map data and programs, an operation unit 14 operated by an operator, an audio output unit 15, and a USB terminal 40.

  As shown in FIG. 2, in the passenger compartment of the automobile, the display unit 10 is disposed at a position intermediate between the driver seat and the passenger seat on the dashboard 30 in front of the driver. The viewpoint movement when the person looks at the display surface of the display unit 10 is reduced. On the other hand, the operation unit 14 is disposed on the upper surface of the center console 32 just next to the driver's seat, so that the driver can easily operate without extending his hand or changing his posture. .

  Returning to the description of the block diagram of FIG. The display unit 10 is a color display device having a display surface 10a such as a liquid crystal display, and can display various images on the display surface 10a in response to an input of a video signal from the navigation ECU 12.

  The operation unit 14 is a pointing device for inputting a cursor movement direction and a determination instruction on the screen, and includes an operation knob 18 that is moved by an operator (vehicle user). The operation knob 18 is movable in a two-dimensional direction (directions indicated by symbols X and Y in the drawing) along a plane perpendicular to the axial direction of the shaft portion 18a. In the present embodiment, the movable region of the operation knob 18 in the two-dimensional direction is a rectangular region equal to the aspect ratio of the display surface 10a (generally configured with a rectangle). The operation knob 18 is also movable downward in the axial direction of the shaft portion 18a (in the direction of the arrow Z in FIG. 1), and in the state where no downward force is applied by the operator, that is, in the state where it is not pressed, It returns to a fixed position in the upper direction.

  The operation unit 14 also includes the operation control unit 16, a push operation detection sensor 20 that detects that the operation knob 18 is pressed in the Z-axis direction, and the position coordinates of the operation knob 18 in the X-axis direction and the Y-axis direction. The position detecting sensor 22 to be detected and the shaft portion 18a of the operation knob 18 are supported, and a reaction force such as a resistance force or an assist force corresponding to the operation force in the X-axis direction and the Y-axis direction applied to the operation knob 18 is applied to the shaft portion 18a. And a reaction force generating unit 24 to be added. When the operation knob 18 is moved in the X-axis direction and the Y-axis direction by the operator, a constant resistance force is always applied by the reaction force generation unit 24 in the X-axis direction and the Y-axis direction of the shaft portion 18a. You may make it feel responsive to the operation.

  The operation control unit 16 coordinates the operation target area on the operation screen (assuming the entire area of the display surface 10a of the display unit 10 in this embodiment) and the coordinates in the movable area of the operation knob 18 in the X-axis direction and the Y-axis direction. And one-to-one correspondence.

  Then, the coordinate value of the operation knob 18 in the movable region is output as operation data to the navigation ECU 12, and the navigation ECU 12 displays an arrow-shaped cursor at a position on the display screen corresponding to the coordinates of the operation knob 18. Thereby, when the position of the operation knob 18 is moved to an arbitrary position in the movable area by the operation of the operator, the cursor on the operation screen is also moved to the corresponding position in the operation target area. Note that the positions of the operation knob 18 in the X-axis direction and the Y-axis direction are stagnant at the positions when no force is applied by the operator. In addition, when an operation of pressing the operation knob 18 in the Z-axis direction (hereinafter also referred to as a determination operation) is performed, the operation control unit 16 determines that an input instruction at the cursor position has been made, and determines the determined operation information as the navigation ECU 12. Output to.

  Further, the operation control unit 16 applies a reaction force to the operation knob 18 at a predetermined position via the reaction force generation unit 24 according to the reaction force content defined by reaction force information (details will be described later) input from the navigation ECU 12. Add (resistance and assist power).

  The position detector 11 receives a radio wave transmitted from an artificial satellite for GPS (Global Positioning System) and detects a position coordinate of the vehicle, and outputs a detection signal corresponding to the angular velocity of the rotational motion applied to the vehicle. The gyroscope is a vehicle speed sensor that outputs a detection signal corresponding to the vehicle speed. And the present location of a vehicle is detected by using each of these sensors complementing each other.

  The data input unit 13 is a device for reading out various programs stored in a storage medium such as a DVD-ROM and a hard disk drive, and various data such as map data for navigation processing, and inputting them to the navigation ECU 12. In the present embodiment, a plurality of templates are input via the data input unit 13. This template will be described later.

  The voice output unit 15 is a device for notifying the user of various information by voice. As a result, it is possible to provide various types of information to the user by both the display by the display unit 10 and the sound output from the sound output unit 15.

  The navigation ECU 12 is a device for comprehensively controlling the above-described units, and is configured around a known computer including a CPU, a ROM, a RAM, an I / O, a bus line connecting these, and the like. The navigation ECU 12 executes various processes according to programs read from the ROM and the data input unit 13.

  Various external devices can be connected to the USB terminal 40. In the present embodiment, a mobile phone 50 such as a smartphone is connected. Here, connection in terminal mode is possible. The terminal mode is a mode in which a mobile-side image displayed on the display screen of the mobile phone 50 is displayed on the display surface 10a of the display unit 10 via the navigation ECU 12.

  At this time, the display screen 10a is used as an operation screen, and an operation via the operation unit 14 is possible. Then, the mobile phone 50 connected to the USB terminal 40 is operated by an operation on the operation screen. In the following, the description will be continued assuming terminal mode.

  The navigation ECU 12 displays the mobile-side image of the mobile phone 50 on the display surface 10 a of the display unit 10 and accepts an operation from the operator via the operation unit 14. At this time, the coordinates input from the operation unit 14 are determined as the designated position in the operation screen. When a determination operation by the operation unit 14 is performed on various icons displayed on the operation screen, the navigation ECU 12 notifies the mobile phone 50 of the icon determination operation via the USB terminal 40.

  When the navigation ECU 12 accepts an operation from the operator via the operation unit 14, the navigation ECU 12 inputs reaction force information defining a reaction force map such as a pulling reaction force corresponding to the icon to the operation unit 14. This reaction force information is set, for example, as a matrix-like data table that corresponds one-to-one with the coordinates of the movable region of the operation knob 18.

  FIG. 3 is a diagram schematically showing a reaction force map defined in reaction force information set by the navigation ECU 12 on the operation screen. As shown in FIG. 3, a pulling reaction force generation range (gray portion in the drawing) is provided in a range corresponding to the position and shape of each icon on the operation screen. In this reaction force information, when the operation knob 18 is located at the coordinates corresponding to the pulling reaction force generation range, the assist force toward the center of the reaction force generation range (“+” in the drawing) is displayed. 18 to be defined. However, the reaction force generation range corresponding to each icon on the operation screen is set to a range slightly larger than the size of the corresponding icon. By doing so, it is possible to generate a pulling reaction force from the time when the cursor approaches the vicinity of the icon, and it is possible to easily match the indicated position of the cursor to the position of the icon.

  By the way, the mobile-side image displayed on the display screen of the mobile phone 50 depends on the application program of the mobile phone 50, and the position of the icon in the mobile-side image also depends on the application program. Therefore, in the present embodiment, the navigation ECU 12 acquires the icon position and the like on the operation screen based on the mobile-side image input from the mobile phone 50, and sets the reaction force information described above.

  As described above, a plurality of templates are input to the navigation ECU 12 via the data input unit 13. These templates are images prepared in correspondence with the mobile-side image displayed on the display screen of the mobile phone 50. That is, an image similar to the mobile-side image is prepared in advance. Specifically, mobile-side images by application programs that may be used by the mobile phone 50 are acquired by capture processing or the like, and these images are stored. Further, each template is associated with the position of the icon and reaction force information defining a reaction force map corresponding to the icon.

  On the assumption that such a template is prepared, the navigation ECU 12 executes a reaction force information setting process shown in FIG. Therefore, the reaction force information setting process will be described next. This reaction force information setting process is repeatedly executed by the navigation ECU 12.

  In first S100, it is determined whether or not there is a user operation. This process is to determine whether or not there has been an operation with the operation knob 18 of the operation unit 14. If it is determined that there is a user operation (S100: YES), the process proceeds to S110. On the other hand, when it is determined that there is no user operation (S100: NO), the subsequent process is not executed and the reaction force information setting process is terminated. In this case, the determination process of S100 is repeated by repeatedly executing the reaction force information setting process.

  In S110, a portable side image is acquired. In this process, the mobile-side image of the mobile phone 50 input via the USB terminal 40 is taken into the navigation ECU 12. That is, in the terminal mode, since the portable side image is sent to the navigation device 10, the portable side image is taken into the navigation ECU 12. In S120, a plurality of templates prepared in advance are acquired. This process is performed via the data input unit 13. As described above, the template is prepared as an image similar to the mobile-side image for various applications of the mobile phone 50.

In subsequent S130, matching processing is performed. In this process, the similarity between both images acquired in S110 and S120 is calculated using an image recognition technique.
In next step S140, it is determined whether or not the similarity between both images is equal to or greater than a threshold value. That is, it is determined whether or not both images are sufficiently similar. If the similarity is greater than or equal to the threshold (S140: YES), the process proceeds to S150. On the other hand, when the similarity is less than the threshold (S140: NO), the process proceeds to S170.

  In S150, the position of the icon is acquired. In this process, the position of the icon associated with the template whose similarity is determined to be greater than or equal to the threshold in S140 is acquired. Thereby, the icon position on the display surface 10a which is an operation screen can be specified.

In subsequent S160, reaction force information is acquired. In this process, reaction force information associated with a template whose similarity is determined to be equal to or greater than a threshold value in S140 is acquired.
On the other hand, dummy reaction force information is acquired in S170, which is shifted to when it is determined that the similarity is less than the threshold. The dummy reaction force information is information that defines a reaction force map in which no reaction force is set.

  In the next S180, the reaction force information acquired in S160 or S170 is set. In this process, reaction force information is set for the operation control unit 16 of the operation unit 14. As a result, the operation control unit 16 can apply a reaction force to the operation knob 18 via the reaction force generation unit 24 in accordance with the content of the reaction force defined by the reaction force information. The reason for setting the dummy reaction force information is to prevent the reaction force unrelated to the screen from being applied due to the old reaction force information remaining.

Next, the effect which the navigation apparatus 1 of this embodiment exhibits is demonstrated.
In the navigation device 1 of the present embodiment, when the navigation ECU 12 receives an operation from the operator via the operation unit 14, reaction force information defining a reaction force map such as a pulling reaction force corresponding to the icon is displayed on the operation unit 14. Enter against. That is, it is determined whether or not there is an operation (S100), and if there is an operation via the operation unit 14 (S100: YES), a portable side image is acquired (S110), and a plurality of images as templates are acquired. (S120), matching processing is performed (S130). Then, a template having a similarity equal to or higher than a threshold is used (S140: YES), the position of the icon and reaction force information associated with the template are acquired (S150, S160), and reaction force information is set (S180). . When the degree of similarity is less than the threshold (S140: NO), dummy reaction force information is acquired (S170), and reaction force information is set (S180).

  That is, by using the mobile-side image displayed on the display screen of the mobile phone 50 as it is and comparing it with a plurality of templates prepared in advance, the template corresponding to the mobile-side image is specified, and the position of the icon on the operation screen is determined. It is specified. In this way, the position of the icon can be specified without inputting information other than the display screen from the mobile phone 50. Moreover, since reaction force information is set with respect to the operation part 14, the reaction force according to the position of an icon can be added to the operation knob 18 (shaft part 18a).

  On the other hand, even when the template is not specified, dummy reaction force information is set, so that reaction force unrelated to the screen is not applied to the operation knob 18 (shaft portion 18a) due to the old reaction force information.

  Further, in this embodiment, when a determination operation is performed by the operation unit 14 on various icons displayed on the operation screen, the navigation ECU 12 notifies the mobile phone 50 of the icon determination operation via the USB terminal 40. . Thereby, the mobile phone 50 can be operated by the operation of the operation unit 14 on the operation screen.

Note that the navigation device 1 in this embodiment constitutes an “in-vehicle device”, the display unit 10 constitutes a “display unit”, and the mobile phone 50 constitutes an “external portable device”.
The USB terminal 40 constitutes an “input / output unit”, the data input unit 13 constitutes a “template input unit”, and the navigation ECU 12 constitutes a “control unit”. Furthermore, the icon corresponds to a “selected item image”. The operation unit 14 constitutes an “operation unit”, the operation knob 18 constitutes an “operation knob”, and the reaction force generation unit 24 constitutes “reaction force generation means”.

  Furthermore, the processing of S130 and S140 in FIG. 4 corresponds to “correspondence determination processing”, the processing of S150 corresponds to “display position specifying processing”, and the processing of S160 and S180 is “reaction force information setting processing”. Equivalent to.

As mentioned above, this invention is not limited to the said embodiment at all, In the range which does not deviate from the summary, it can be implemented with a various form.
(A) In the above embodiment, an image similar to the image on the mobile phone 50 side, that is, an image similar to the image displayed on the entire display screen of the mobile phone 50 is prepared as a template.

  On the other hand, it is conceivable to prepare a part of the mobile-side image as a template. For example, an image of a portion indicated by a two-dot chain line in FIG. 5A is prepared as a template. Comparing areas that are about ¼ of the entire screen is usually sufficient to determine their similarity. In this way, the time required for image processing is shortened. In addition, the data size of the template can be reduced.

  Further, as shown in FIG. 5B, the template image may be a special image displayed on a part of the mobile phone image. The special image is exemplified as a symbol image related to processing based on the application program. For example, in the case of a weather-related application program, it may be an image indicating “sunny”, “cloudy”, “rain”, or the like. Further, for example, in the case of an application program that handles characters such as e-mails, an image such as “A” or “W” can be considered on the assumption that a keyboard image is displayed. In this way, the time required for image processing can be shortened. In addition, the data size of the template can be reduced.

  Furthermore, as shown in FIG. 5C, character string data displayed at a specific position on the entire screen may be used as a template. For example, the title of the application program displayed at a specific position is used as a template. At this time, the character string data is acquired in S130 described above. Then, the template is compared with the template depending on whether the character string is in the mobile phone image. In this way, the template data can be made smaller.

  (B) In the above embodiment, a slide type knob is adopted as the operation knob 18 of the operation unit 14, but a tilting type knob may be adopted. In this case, the degree of inclination of the knob in the X-axis direction and the Y-axis direction corresponds to the cursor position on the operation screen.

  (C) In the above embodiment, the cursor position on the operation screen and the stagnation position of the operation knob 18 have a configuration of absolute operation in a one-to-one correspondence. On the other hand, when the cursor is moved by sliding or tilting the operation knob and no force is applied to the operation knob, a configuration of relative operation in which the operation knob returns to the center position regardless of the cursor position may be adopted.

  (D) In the above embodiment, when there is no corresponding template (S140: NO in FIG. 4), dummy reaction force information is acquired and set (S170, S180). In addition, in S170, the mobile-side image captured in S110 may be stored. In other words, a new template is automatically added. In this case, after that, based on the selection operation via the operation knob 18, the position of the icon in the new template is specified, or the reaction force information defining the reaction force map corresponding to the icon is created. The This is advantageous in that the template is automatically added. In addition, the position of the selection item image corresponding to the new template and reaction force information are automatically added.

  (E) It is conceivable to update the reaction force information described above based on an operation by a user. For example, the reaction force generation area for the operation by the operator may be enlarged or reduced according to the number of times of icon selection instruction via the operation knob 18. Further, for example, it is conceivable to update the reaction force information so as to increase or decrease the magnitude of the reaction force with respect to the operation of the operator according to the number of icon selection instructions via the operation knob 18. For example, for a selection item image with a relatively large number of selection instructions, for example, the area of the pulling reaction force is enlarged or the magnitude of the pulling reaction force is increased. If it does in this way, it contributes to a user's operativity improvement.

  (F) In the configuration as described above in which the template is automatically added, the entire data size of the template may increase. Therefore, a configuration may be adopted in which some templates are deleted according to the number of template selections. For example, a template with a relatively low use frequency is deleted. In this way, the overall data size of the template can be suppressed, and the number of templates is reduced, so that the time required for the matching process is shortened.

  DESCRIPTION OF SYMBOLS 1 ... Navigation apparatus, 10 ... Display part, 10a ... Display surface, 11 ... Position detection part, 12 ... Navigation ECU, 13 ... Data input part, 14 ... Operation part, 16 ... Operation control part, 18a ... Operation knob, 20 ... Push operation detection sensor, 22 ... Position detection sensor, 24 ... Reaction force generation unit, 30 ... Dashboard, 32 ... Center console, 40 ... USB terminal, 50 ... Mobile phone.

Claims (13)

An in-vehicle device that displays a mobile-side image displayed on a display screen of an external mobile device on a display means included in the vehicle,
An input / output unit for performing data communication with the external portable device;
A template input unit for inputting a plurality of templates prepared in advance according to the type of the mobile-side image in order to specify the display position of the selection item image displayed on the mobile-side image in the display means;
A correspondence determination process for determining which of the plurality of templates corresponds to the portable image input from the input / output unit;
And a display position specifying process for specifying a display position of the selection item image on the display unit based on the template determined to be supported by the correspondence determining process,
A control unit capable of executing
An operation knob that can be moved in accordance with an operation by a user, and a cursor displayed on the display unit in conjunction with the operation knob, and causing a user to select and select a selection item image displayed on the display unit. With a possible operation part,
When there is an instruction to select the selection item image via the operation unit, the control unit outputs from the input / output unit to the external portable device that the selection instruction has been made. . An in-vehicle device that displays a mobile-side image displayed on a display screen of an external mobile device on a display means included in the vehicle,
An input / output unit for performing data communication with the external portable device;
A template input unit for inputting a plurality of templates prepared in advance according to the type of the mobile-side image in order to specify the display position of the selection item image displayed on the mobile-side image in the display means;
A correspondence determination process for determining which of the plurality of templates corresponds to the portable image input from the input / output unit;
And a display position specifying process for specifying a display position of the selection item image on the display unit based on the template determined to be supported by the correspondence determining process,
And a control unit capable of executing
The control unit deletes a part of the template according to the number of times the template is selected by the correspondence determination process . An in-vehicle device that displays a mobile-side image displayed on a display screen of an external mobile device on a display means included in the vehicle,
An input / output unit for performing data communication with the external portable device;
A template input unit for inputting a plurality of templates prepared in advance according to the type of the mobile-side image in order to specify the display position of the selection item image displayed on the mobile-side image in the display means;
A correspondence determination process for determining which of the plurality of templates corresponds to the portable image input from the input / output unit;
And a display position specifying process for specifying a display position of the selection item image on the display unit based on the template determined to be supported by the correspondence determining process,
And a control unit capable of executing
From the template input unit, an image prepared in advance corresponding to the mobile side image is input as the template,
The said control part determines the said template corresponding to the said portable side image based on the similarity of both said images by the said corresponding | compatible determination process, The vehicle-mounted apparatus characterized by the above-mentioned . An in-vehicle device that displays a mobile-side image displayed on a display screen of an external mobile device on a display means included in the vehicle,
An input / output unit for performing data communication with the external portable device;
A template input unit for inputting a plurality of templates prepared in advance according to the type of the mobile-side image in order to specify the display position of the selection item image displayed on the mobile-side image in the display means;
A correspondence determination process for determining which of the plurality of templates corresponds to the portable image input from the input / output unit;
And a display position specifying process for specifying a display position of the selection item image on the display unit based on the template determined to be supported by the correspondence determining process,
And a control unit capable of executing
From the template input unit, a character string displayed at a specific position of the mobile-side image is input as the template,
The in-vehicle device , wherein the control unit determines the template corresponding to the portable side image by image recognition at a specific position of the portable side image in the correspondence determination process . The in-vehicle device according to claim 1 ,
The operation unit has reaction force generation means for applying a reaction force to a user operation to the operation knob according to the set reaction force information.
The in-vehicle device, wherein the control unit executes a reaction force information setting process for setting the reaction force information based on the template determined to correspond by the correspondence determination process. The in-vehicle device according to claim 5,
The said control part memorize | stores the said portable side image as a new template, when the said template determined to respond | correspond by the said corresponding | compatible determination process does not exist. The in-vehicle device according to claim 6 ,
The in-vehicle device , wherein the control unit specifies a display position of the selection item image corresponding to the new template based on an instruction to select the selection item image via the operation unit . The in-vehicle device according to claim 7 ,
The control unit generates the reaction force information corresponding to the new template based on an instruction to select the selection item image via the operation unit . In the in-vehicle device according to any one of claims 5 to 8 ,
The in-vehicle device , wherein the control unit updates the reaction force information so as to expand or contract a reaction force generation area for a user operation according to the number of selection instructions of the selection item image via the operation unit. . In the in-vehicle device according to any one of claims 5 to 9 ,
The control unit updates the reaction force information so as to increase or decrease the magnitude of the reaction force with respect to a user's operation according to the number of selection instructions for the selection item image via the operation unit. . The in-vehicle device according to claim 3 ,
The in-vehicle device, wherein a partial image prepared in advance corresponding to a part of the mobile-side image is input from the template input unit as the template. The in-vehicle device according to claim 3 ,
An in-vehicle device, wherein a characteristic image appearing in the mobile-side image is input as the template from the template input unit. The in-vehicle device according to claim 12,
The in-vehicle apparatus, wherein the characteristic image is a unique symbol image related to processing executed in the external portable device.