JP5522023B2 - Screen display system, in-vehicle device, and portable device - Google Patents

Description

  The present invention relates to a screen display system mounted on a vehicle, and more particularly to a technique for displaying a mobile-side image displayed on a display screen of a mobile device on a display unit included in an in-vehicle device.

  2. Description of the Related Art Conventionally, a system for instructing operations on in-vehicle devices such as a navigation device, an air conditioner, and an audio on a display screen of a display device (hereinafter referred to as “in-vehicle display device”) mounted on a vehicle is known. This display screen is composed of a liquid crystal display, for example, and the position of a selection item image such as a button displayed on the liquid crystal display is instructed, and the in-vehicle device is operated accordingly.

  In such a system, it is preferable to dispose the display screen at a position as far upward and as far as possible in front of the driver, because it is necessary to reduce the viewpoint movement while the driver is driving. On the other hand, it is preferable to arrange the operation unit for instructing the position on the display screen at the driver's hand.

  Therefore, a remote operation system in which a display screen and an operation unit are separated has been put into practical use. In such a system, a cursor that is moved by the operation knob of the operation unit is displayed on the display screen, and the position of the display screen is indicated by this cursor. At this time, a technology has been proposed in which a reaction force (resistance force or assist force) corresponding to the display content of the display screen is applied to the operation knob to tactilely support the driver's operation and improve operability. Yes.

  For example, a technique is known in which a reaction force for assisting a cursor to be drawn into the selection item image is applied to an operation knob in the vicinity of the selection item image (see, for example, Patent Document 1). Specifically, reaction force information defining a reaction force map for applying a reaction force to the operation knob in accordance with the position of the selection item image is prepared, and a reaction force for assisting the operation knob according to the reaction force information. Apply power.

  By the way, in recent years, mobile devices have become more sophisticated. For example, a mobile phone such as a smartphone equipped with GPS can provide route guidance similar to that of an in-vehicle navigation device. Then, when considering using a portable device inside a vehicle, using a portable device using a vehicle-mounted display apparatus can be considered. For example, the portable device and the vehicle-side ECU are connected, and the display screen of the portable device is displayed on the display screen of the in-vehicle display device.

JP 2010-96669 A

  However, unlike conventional navigation devices, on-vehicle devices such as air conditioners and audio devices, the position of the selection item image on the display screen of the mobile device changes depending on the application program on the mobile device side. I can't leave. Therefore, even if the selection item image is displayed on the display screen of the in-vehicle display device, the selection item image cannot be designated by the operation knob. Also, if the position of the selection item image is not known, reaction force information for defining a reaction force map or the like cannot be prepared, so that a reaction force corresponding to the selection item image cannot be applied to the operation knob.

  The present invention has been made to solve the above-described problems, and the object thereof is not to input information other than the display screen from the mobile device, and the selection item image is based on the display screen information of the mobile device. It is to provide a technique for specifying the position of the.

  The screen display system according to claim 1 made to achieve the above object includes a portable device and an in-vehicle device. The mobile device is embodied as a mobile phone such as a smartphone. Of course, a personal digital assistant called PDA (Personal Digital Assistant) is also included.

  Data communication is performed between the portable device and the in-vehicle device. For example, a configuration including a USB interface or a wireless LAN interface can be considered. Note that the data communication referred to here may be wired or wireless. Then, the in-vehicle device displays the mobile-side image displayed on the display screen of the mobile device on the display means that the vehicle has.

  Particularly in the portable device, the information embedding unit embeds information on the selection item image displayed on the portable side image in a part of the portable side image in such a manner that the information content cannot be visually recognized by the user. The “mode in which the information content cannot be visually recognized” is intended to exclude a mode in which coordinate values are clearly indicated by a numeric font or the like. The selection item image is an image called a “button” for user operation.

On the other hand, in the in-vehicle device, the position specifying unit specifies the display position of the selection item image on the display unit based on the information embedded in the mobile-side image.
In other words, on the assumption that the mobile-side image that is the display screen of the mobile device is input, the information of the selection item image is embedded in a part of the mobile-side image. In this way, it is possible to specify the position of the selection item image based on the display screen information of the mobile device without requiring input of information other than the display screen from the mobile device.

Specifically, information embedding means, the information region is a predetermined image area of the portable side image, embedding information of the selection item image. For example, a plurality of information areas may be set according to the number of selection item images. If the information of the selection item image is embedded in such an information area, the display position can be easily specified by the position specifying means.

Information area is set on the edge of the mobile side image. For example, it may be set side by side at least one of the right end, left end, upper end, and lower end of the mobile-side image. In this way, the information area becomes inconspicuous, and the uncomfortable feeling caused by the information being embedded in the mobile-side image is reduced.

The information area may be an area composed of a single pixel. However, as described in claim 2 , the information area is an area composed of a plurality of pixels, and the information embedding means is an image area adjacent to the information area among the plurality of pixels. It is preferable to embed information on the selection item image in a specific pixel that is not easily affected by the above. Being influenced by an adjacent image area means that embedded information is rewritten when the mobile-side image is compressed or converted into an analog signal. Therefore, for example, an area composed of 10 × 10 pixels is set as an information area, and a pixel near the center is set as a specific pixel. In this way, it is possible to prevent the embedded information from being rewritten even if the mobile-side image is compressed or analog-converted.

In view of such a cellular-side image compression and analog conversion, as shown in claim 3, information embedding means, preferably embedded information on the selected item image to the upper side of bits of a particular pixel. This is because an error due to conversion or the like may occur as the lower bits are used.

Although information area is already mentioned that there be composed of a plurality of regions, in the present invention, information area, location number area and the selection item image number information indicating the number of selection item image is embedded It is comprised in the position area | region where the positional information which shows is embedded . In this way, the number of selection item images can be grasped from the number information of the number area.

Furthermore, as shown in claim 4 , in the number area, area specifying information for specifying the position area may be embedded together with the number information. In this way, since the position area is specified from the area specifying information of the number area, the display position can be easily specified by the position specifying means.

Incidentally, the car mounting device comprises an operating unit. The operation unit has an operation knob that can be moved in accordance with an operation by the user, and uses a cursor displayed on the display unit in conjunction with the operation knob to cause the user to select and instruct a selection item image displayed on the display unit. . The operation knob may be slidable or tiltable. At this time, if there is an instruction to select a selection item image via the operation unit, the in-vehicle device outputs to the portable device that the selection instruction has been made. If it does in this way, a portable apparatus can be operated with a vehicle-mounted apparatus.

In addition , the operation unit includes a reaction force generation unit that applies a reaction force to a user operation to the operation knob according to the set reaction force information . At this time, in the in-vehicle device, the reaction force information setting unit sets the reaction force information based on the information embedded in the mobile-side image. The reaction force information is defined by, for example, a reaction force map corresponding to the image on which the selection item image is displayed. The reaction force information may be created from the position information of the selection item image, or may be embedded in advance in the mobile-side image as one piece of selection item image information. In this way, a reaction force according to the selection item image can be applied to the operation knob.

Although the above has been described as an invention of a screen display system, it can also be realized as an invention of an in-vehicle device constituting the screen display system.
That is, an in-vehicle device configured to display a mobile-side image displayed on a display screen of a mobile device on a display unit included in the vehicle and to enable data communication with the mobile device as shown in claim 5. A position specifying unit, an operation unit, and a reaction force information setting unit. When there is an instruction to select a selection item image via the operation unit, the fact that the selection instruction has been made is output to a portable device. This is an in-vehicle device. The mobile-side image is a predetermined image area set at the edge of the mobile-side image, and includes a number area in which number information indicating the number of selection item images displayed on the mobile-side image is embedded, and a selection item The information of the selection item image is embedded by the portable device in an information area configured by a position area in which position information indicating the position of the image is embedded in such a manner that the information content cannot be visually recognized by the user. The position specifying means specifies the display position of the selection item image on the display means based on the information embedded in the mobile-side image. The operation unit includes an operation knob that is movable in response to an operation by the user, and a reaction force generation unit that applies a reaction force to the operation knob to the operation knob according to the set reaction force information, and is interlocked with the operation knob. Using the cursor displayed on the display means, the user can be instructed to select the selection item image displayed on the display means. The reaction force information setting unit sets the reaction force information based on information embedded in the mobile-side image.

Moreover, it is also realizable as invention of the portable apparatus which comprises a screen display system.
That is, according to claim 6, as shown, a mobile device configured to communicate data to and from the displayable vehicle apparatus portable side image displayed on the display screen on the display means the vehicle has, the cellular side A predetermined image area set at the edge of the image, and a number area in which the number information indicating the number of selection item images displayed on the mobile-side image is embedded, and position information indicating the position of the selection item image are embedded. The mobile device is characterized by comprising information embedding means for embedding the information of the selection item image in an information area configured by the position area in such a manner that information contents cannot be visually recognized by the user .

The same configuration as the screen display system according to claims 2 to 4 described above can also be adopted for these in-vehicle devices and portable devices.

It is a block diagram which shows schematic structure of a navigation apparatus. It is explanatory drawing which shows typically the arrangement | positioning condition in the vehicle interior of a display part and an operation part. It is explanatory drawing which shows typically the reaction force map corresponding to an operation screen. It is a flowchart which shows an information embedding process. It is explanatory drawing which shows an information area typically. It is a flowchart which shows a position specific process.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram illustrating a schematic configuration of a screen display system according to an embodiment.
The screen display system according to the embodiment includes a navigation device 1 and a mobile phone 50. As shown in FIG. 1, the navigation device 1 inputs a display unit 10, a position detection unit 11 that detects the current location of the vehicle, a navigation ECU 12, and various data such as map data and programs stored in a storage medium. A data input unit 13, an operation unit 14 operated by an operator, an audio output unit 15, and a USB terminal 40.

  As shown in FIG. 2, in the passenger compartment of the automobile, the display unit 10 is disposed at a position intermediate between the driver seat and the passenger seat on the dashboard 30 in front of the driver. The viewpoint movement when the person looks at the display surface of the display unit 10 is reduced. On the other hand, the operation unit 14 is disposed on the upper surface of the center console 32 just next to the driver's seat, so that the driver can easily operate without extending his hand or changing his posture. .

  Returning to the description of the block diagram of FIG. The display unit 10 is a color display device having a display surface 10a such as a liquid crystal display, and can display various images on the display surface 10a in response to an input of a video signal from the navigation ECU 12.

  The operation unit 14 is a pointing device for inputting a cursor movement direction and a determination instruction on the screen, and includes an operation knob 18 that is moved by an operator (vehicle user). The operation knob 18 is movable in a two-dimensional direction (directions indicated by symbols X and Y in the drawing) along a plane perpendicular to the axial direction of the shaft portion 18a. In the present embodiment, the movable region of the operation knob 18 in the two-dimensional direction is a rectangular region equal to the aspect ratio of the display surface 10a (generally configured with a rectangle). The operation knob 18 is also movable downward in the axial direction of the shaft portion 18a (in the direction of the arrow Z in FIG. 1), and in the state where no downward force is applied by the operator, that is, in the state where it is not pressed, It returns to a fixed position in the upper direction.

  The operation unit 14 also includes the operation control unit 16, a push operation detection sensor 20 that detects that the operation knob 18 is pressed in the Z-axis direction, and the position coordinates of the operation knob 18 in the X-axis direction and the Y-axis direction. The position detecting sensor 22 to be detected and the shaft portion 18a of the operation knob 18 are supported, and a reaction force such as a resistance force or an assist force corresponding to the operation force in the X-axis direction and the Y-axis direction applied to the operation knob 18 is applied to the shaft portion 18a. And a reaction force generating unit 24 to be added. When the operation knob 18 is moved in the X-axis direction and the Y-axis direction by the operator, a constant resistance force is always applied by the reaction force generation unit 24 in the X-axis direction and the Y-axis direction of the shaft portion 18a. You may make it feel responsive to the operation.

  The operation control unit 16 coordinates the operation target area on the operation screen (assuming the entire area of the display surface 10a of the display unit 10 in this embodiment) and the coordinates in the movable area of the operation knob 18 in the X-axis direction and the Y-axis direction. And one-to-one correspondence.

  Then, the coordinate value of the operation knob 18 in the movable region is output as operation data to the navigation ECU 12, and the navigation ECU 12 displays an arrow-shaped cursor at a position on the display screen corresponding to the coordinates of the operation knob 18. Thereby, when the position of the operation knob 18 is moved to an arbitrary position in the movable area by the operation of the operator, the cursor on the operation screen is also moved to the corresponding position in the operation target area. Note that the positions of the operation knob 18 in the X-axis direction and the Y-axis direction are stagnant at the positions when no force is applied by the operator. In addition, when an operation of pressing the operation knob 18 in the Z-axis direction (hereinafter also referred to as a determination operation) is performed, the operation control unit 16 determines that an input instruction at the cursor position has been made, and determines the determined operation information as the navigation ECU 12. Output to.

  Further, the operation control unit 16 applies a reaction force to the operation knob 18 at a predetermined position via the reaction force generation unit 24 according to the reaction force content defined by reaction force information (details will be described later) input from the navigation ECU 12. Add (resistance and assist power).

  The position detector 11 receives a radio wave transmitted from an artificial satellite for GPS (Global Positioning System) and detects a position coordinate of the vehicle, and outputs a detection signal corresponding to the angular velocity of the rotational motion applied to the vehicle. The gyroscope is a vehicle speed sensor that outputs a detection signal corresponding to the vehicle speed. And the present location of a vehicle is detected by using each of these sensors complementing each other.

  The data input unit 13 is a device for reading out various programs stored in a storage medium such as a DVD-ROM and a hard disk drive, and various data such as map data for navigation processing, and inputting them to the navigation ECU 12.

  The voice output unit 15 is a device for notifying the user of various information by voice. As a result, it is possible to provide various types of information to the user by both the display by the display unit 10 and the sound output from the sound output unit 15.

  The navigation ECU 12 is a device for comprehensively controlling the above-described units, and is configured around a known computer including a CPU, a ROM, a RAM, an I / O, a bus line connecting these, and the like. The navigation ECU 12 executes various processes according to programs read from the ROM and the data input unit 13.

  Various external devices can be connected to the USB terminal 40, and a mobile phone 50 such as a smartphone is connected thereto. Here, connection in terminal mode is possible. The terminal mode is a mode in which a mobile-side image displayed on the display screen of the mobile phone 50 is displayed on the display surface 10a of the display unit 10 via the navigation ECU 12.

  At this time, the display screen 10a is used as an operation screen, and an operation via the operation unit 14 is possible. Then, the mobile phone 50 connected to the USB terminal 40 is operated by an operation on the operation screen. In the following, the description will be continued assuming terminal mode.

  The navigation ECU 12 displays the mobile-side image of the mobile phone 50 on the display surface 10 a of the display unit 10 and accepts an operation from the operator via the operation unit 14. At this time, the coordinates input from the operation unit 14 are determined as the designated position in the operation screen. When a determination operation by the operation unit 14 is performed on various buttons displayed on the operation screen, the navigation ECU 12 notifies the mobile phone 50 of the button determination operation via the USB terminal 40.

  When the navigation ECU 12 receives an operation from the operator via the operation unit 14, the navigation ECU 12 inputs reaction force information defining a reaction force map such as a pulling reaction force corresponding to the button to the operation unit 14. This reaction force information is set, for example, as a matrix-like data table that has a one-to-one correspondence with the coordinates of the movable region of the operation knob 18.

  FIG. 3 is a diagram schematically showing a reaction force map defined in reaction force information set by the navigation ECU 12 on the operation screen. As shown in FIG. 3, a pulling reaction force generation range (gray portion in the drawing) is provided in a range corresponding to the position and shape of each button on the operation screen. In this reaction force information, when the operation knob 18 is located at the coordinates corresponding to the pulling reaction force generation range, the assist force toward the center of the reaction force generation range (“+” in the drawing) is displayed. 18 to be defined. However, the reaction force generation range corresponding to each button on the operation screen is set to a range slightly larger than the size of the corresponding button. In this way, a pulling reaction force can be generated from the time when the cursor approaches the vicinity of the button, and the cursor pointing position can be easily aligned with the button position.

  By the way, the mobile-side image displayed on the display screen of the mobile phone 50 depends on an application program executed by the CPU of the mobile phone 50, and the position of the button in the mobile-side image also depends on the application program. In the present embodiment, the navigation ECU 12 acquires the button position and the like on the operation screen based on the mobile-side image input from the mobile phone 50, and sets the reaction force information described above.

  Therefore, in the mobile phone 50, an information embedding process for embedding button information in the mobile-side image is executed by the CPU. FIG. 4 is a flowchart showing the information embedding process. This information embedding process is performed when any application program is executed on the mobile phone 50.

  In the first S100, the button position is acquired. In this process, the position of a button displayed on the screen of the application program is acquired from the application program being executed on the mobile phone 50.

  In subsequent S110, number information and area specifying information are set. The number information is information indicating the number of buttons on the screen of the application program being executed. The area specifying information is information for specifying a position area having button position information, and is the number of dots on one side of the position area which is a square area.

  In the next S120, the number information and the area specifying information are written into the number area. The number area is set in the mobile-side image as an area of 10 dots × 10 dots. For example, as shown in FIG. 5A, the number area K is set at the right end of the mobile-side image G. In the present embodiment, as shown in FIG. 5B, the number information and the area specifying information are embedded in the center pixel GS of the number area K. The pixel GS is expressed as color information by a total of 24 bits of 8 bits for each of RGB. Therefore, the number information and the area specifying information are embedded in the upper 12 bits of the pixel GS.

  In subsequent S130, position information is set. The position information is information indicating the position of the button acquired in S100, and is indicated by the coordinate values of the X coordinate and the Y coordinate. The position information is set for the number of buttons.

  In the next S140, the position information is written into the position area. The position area is also set at the right end of the mobile-side image as a 10 dot × 10 dot area, like the number area. For example, as shown in FIG. 5A, a plurality of position areas I are set at the right end of the mobile-side image G in a number area K. Similar to the number information and area specifying information described above, in this embodiment, position information is embedded in the pixel GS at the center of the position area I as shown in FIG. As described above, the pixel GS is expressed by a total of 24 bits of RGB, but the positional information uses, for example, the upper 21 bits of the pixel GS from the relationship with the resolution of the mobile-side image G. The X coordinate value is embedded in 11 bits, and the Y coordinate value is embedded in the remaining 10 bits.

  In subsequent S150, it is determined whether or not position information for the number of buttons has been processed. If it is determined that the position information for the number of buttons has been processed (S150: YES), the information embedding process is terminated. On the other hand, if there is position information that has not been processed (S150: NO), the processing from S130 is repeated. At this time, the next position area specified based on the number of dots on one side of the position area indicated by the area specifying information is targeted.

  By such information embedding processing, the number area K and the position area I are set at the right end of the mobile-side image G (see FIG. 5A). That is, an information area composed of a number area and a position area is set at the right end of the mobile-side image. Then, the number information and the area specifying information are embedded in the center pixel of the number area (S110 and S120 in FIG. 4), and the position information is embedded in the center pixel of the position area (S130 and S140). As described above, the navigation ECU 12 obtains the button position and the like on the operation screen based on such a mobile-side image input from the mobile phone 50, and sets the reaction force information described above.

Then, next, the position specification process which navigation ECU12 performs is demonstrated. FIG. 6 is a flowchart showing the position specifying process.
In the first S200, the number information and the area specifying information are read out. In this process, the color information of the central pixel in the number area set in the mobile-side image is read out. As a result, the number of buttons on the screen of the mobile-side image and the number of dots on one side of the position area in which the button position is embedded are known.

  In the next S210, position information is read. In this process, the color information of the center pixel of the position area arranged side by side in the number area is read. Thereby, the coordinate value of a button position is known.

  In S220, it is determined whether or not position information for the number of buttons has been processed. If it is determined that the position information for the number of buttons has been processed (S220: YES), the process proceeds to S230. On the other hand, if there is position information that has not been processed (S220: NO), the processing from S210 is repeated. At this time, the next position area specified based on the number of dots on one side of the position area indicated by the area specifying information is targeted.

  In S230, a reaction force map for generating a pulling reaction force to each button is created based on the coordinate value of the button position, and reaction force information defining the reaction force map is set. The reaction force information is set in the operation control unit 16 of the operation unit 14.

Next, the effect which the screen display system of this embodiment exhibits is demonstrated.
In this embodiment, the mobile phone 50 acquires the button position on the screen of the application program being executed (S100 in FIG. 4), and specifies the number information indicating the number of buttons and the area specification for specifying the position area. Information is set (S110), and the information is written in the number area (S120). Further, position information for the number of buttons is set (S130, S150), and the information is written in the position area (S140, S150). On the other hand, the navigation device 1 reads the number information and the area specifying information (S200 in FIG. 6), and reads the position information for the number of buttons (S210, S220).

  That is, on the premise that the mobile-side image that is the display screen of the mobile phone 50 is input, the button information is embedded in a part of the mobile-side image. Accordingly, it is possible to specify the position of the button based on the display screen information of the mobile phone 50 without requiring input of information other than the display screen from the mobile phone 50.

  In the present embodiment, as shown in FIG. 5A, an information area including a number area K and a position area I is provided in the mobile-side image G of the mobile phone 50, and button information is embedded in the information area. . Thereby, the position specifying process in the navigation device 1 is facilitated.

  At this time, as shown in FIG. 5A, the information area is set at the edge that is the right end of the mobile-side image G. As a result, the information area becomes inconspicuous, and the uncomfortable feeling caused by the information being embedded in the mobile-side image is reduced.

  Furthermore, in the present embodiment, as shown in FIG. 5B, the number region K and the position region I are set as a 10-dot square, and information is embedded in the center pixel GS. I have to. Further, the number information and the area specifying information are embedded using the upper 12 bits of the pixel GS. Further, the position information is embedded using the upper 21 bits of the pixel GS. As a result, even if the mobile-side image is compressed or analog-converted, it is possible to prevent the embedded information from being rewritten.

  In the present embodiment, as shown in FIG. 5A, the information area includes a number area K in which the number information indicating the number of buttons is embedded and a position area I in which position information indicating the position of the button is embedded. Configured. Thereby, the number of buttons can be grasped from the number information of the number area.

  Furthermore, in the present embodiment, the area specifying information for specifying the position area is embedded in the number area together with the number information. Thereby, since the position area is specified from the area specifying information of the number area, the position specifying process in the navigation device 1 is facilitated.

  In the present embodiment, the navigation device 1 includes the operation unit 14, and the operation unit 14 has an operation knob 18 that can be moved according to an operation by the user, and is displayed on the display surface 10 a in conjunction with the operation knob 18. Using the cursor, the user is instructed to select a button. Then, when there is a button selection instruction via the operation unit 14, the navigation device 1 outputs to the mobile phone 50 that the selection instruction has been made. Thereby, the mobile phone 50 can be operated by the navigation device 1.

  Moreover, the navigation device 1 generates a reaction force map for applying a pulling reaction force to the button from the identified button position, and sets reaction force information that defines the reaction force map (in FIG. 6). S230). Thereby, a reaction force corresponding to the button can be applied to the operation knob 18.

  Note that the navigation device 1 and the mobile phone 50 in this embodiment constitute a “screen display system”, the navigation device 1 corresponds to an “in-vehicle device”, and the mobile phone 50 corresponds to a “mobile device”.

The operation knob 18 corresponds to an “operation knob”, the operation unit 14 corresponds to an “operation unit”, and the reaction force generation unit 24 corresponds to a “reaction force generation unit”.
Furthermore, the display unit 10 corresponds to “display means”, the CPU of the mobile phone 50 corresponds to “information embedding means”, and the navigation ECU 12 of the navigation device 1 includes “position specifying means” and “reaction force information setting means”. Is equivalent to.

  Also, the information embedding process in FIG. 4 corresponds to the process as the function of “information embedding means”, the processes of S200 to S220 in FIG. 6 correspond to the process as the function of “position specifying means”, and S230 This processing corresponds to processing as a function of the “reaction force information setting means”.

As mentioned above, this invention is not limited to the said embodiment at all, In the range which does not deviate from the summary, it can be implemented with a various form.
(A) In the above embodiment, as shown in FIG. 5B, the central pixel GS of the number region K and the position region I is used as a specific pixel, and information is embedded in the pixel GS. On the other hand, the specific pixel may not be a pixel near the center. However, it is preferable to employ, as the specific pixel, a pixel that is not easily affected by an adjacent image region due to compression or analog conversion. Further, as shown in FIG. 5C, a plurality of pixels GS may be adopted as specific pixels.

  (B) In the above embodiment, the area specifying information is embedded together with the number information. However, for example, when the position area has a predetermined size, the area specifying information may not be embedded.

  (C) In the above embodiment, the information area is composed of the number area and the position area, but the method of setting the area is not particularly limited. For example, one region that is not distinguished may be set, and pixels for embedding information may be determined in advance.

  In this sense, for example, a two-dimensional code such as a QR code may be embedded in the edge of the screen. It is also conceivable to embed button information in the mobile-side image using a technique called “digital watermark”, for example.

  DESCRIPTION OF SYMBOLS 1 ... Navigation apparatus, 10 ... Display part, 10a ... Display surface, 11 ... Position detection part, 12 ... Navigation ECU, 13 ... Data input part, 14 ... Operation part, 16 ... Operation control part, 18a ... Operation knob, 20 ... Push operation detection sensor, 22 ... Position detection sensor, 24 ... Reaction force generation unit, 30 ... Dashboard, 32 ... Center console, 40 ... USB terminal, 50 ... Mobile phone.

Claims (6)

A mobile device and a vehicle-mounted device capable of displaying a mobile-side image displayed on the display screen of the mobile device on a display means included in the vehicle, and configured to allow data communication between the mobile device and the vehicle-mounted device. A screen display system,
The portable device is a predetermined image area set at an edge of the portable side image, the number area in which number information indicating the number of selection item images displayed on the portable side image is embedded, and the selection the information area position information indicating the position of the item image is composed of the location area that is embedded in the information content of the invisible aspect for the user, comprising an information embedding means for embedding the information before cyclohexene択項eye images,
The in-vehicle device,
Based on the information embedded in front Symbol mobile side image, a position specifying means for specifying a display position on the display means of the selection item image,
An operation knob that is movable in response to an operation by a user, and a reaction force generation unit that applies a reaction force to the operation knob to the operation knob according to the set reaction force information, and the display is linked to the operation knob. An operation unit capable of instructing a user to select and select the selection item image displayed on the display unit using a cursor displayed on the unit;
Reaction force information setting means for setting the reaction force information based on the information embedded in the mobile-side image,
When there is an instruction to select the selection item image via the operation unit, the screen display system outputs to the portable device that the selection instruction has been made . The screen display system according to claim 1,
The information area is an area composed of a plurality of pixels,
The screen embedding system , wherein the information embedding unit embeds information on the selection item image in a specific pixel that is not easily influenced by an image region adjacent to the information region among the plurality of pixels . The screen display system according to claim 2,
The screen embedding system , wherein the information embedding unit embeds information on the selection item image in a higher-order bit of the specific pixel . The screen display system according to any one of claims 1 to 3 ,
In the number area, area specifying information for specifying the position area is embedded together with the number information . A vehicle-side image displayed on a display screen of a mobile device can be displayed on a display means of a vehicle, and is an in-vehicle device configured to be capable of data communication with the mobile device,
The mobile side image is a predetermined image region set at an edge of the mobile side image, and a number region in which number information indicating the number of selection item images displayed on the mobile side image is embedded, and The information of the selection item image is embedded by the portable device in an information area configured by a position region in which position information indicating the position of the selection item image is embedded in a manner in which information content cannot be visually recognized by the user. And
Position specifying means for specifying the display position of the selection item image on the display means based on the information embedded in the portable image;
An operation knob that is movable in response to an operation by a user, and a reaction force generation unit that applies a reaction force to the operation knob to the operation knob according to the set reaction force information, and the display is linked to the operation knob. An operation unit capable of instructing a user to select and select the selection item image displayed on the display unit using a cursor displayed on the unit;
Reaction force information setting means for setting the reaction force information based on the information embedded in the mobile-side image,
When there is an instruction to select the selection item image via the operation unit, the fact that the selection instruction has been made is output to the portable device.
In-vehicle device characterized by In a vehicle-mounted device capable of displaying a mobile-side image displayed on a display screen of a mobile device on a display means included in the vehicle,
Position specification that specifies the display position of the selection item image displayed on the mobile-side image on the display means based on information embedded in an information area that is a predetermined image area set at an edge of the mobile-side image Means,
An operation knob that is movable in response to an operation by a user, and a reaction force generation unit that applies a reaction force to the operation knob to the operation knob according to the set reaction force information, and the display is linked to the operation knob. An operation unit capable of instructing a user to select and select the selection item image displayed on the display unit using a cursor displayed on the unit;
Reaction force information setting means for setting the reaction force information based on the information embedded in the mobile-side image,
When there is an instruction to select the selection item image via the operation unit, the fact that the selection instruction has been made is output to the portable device.
A portable device configured to be capable of data communication with an in-vehicle device characterized by
A predetermined image area set at an edge of the portable side image, a number area in which number information indicating the number of selection item images displayed on the portable side image is embedded, and a position of the selection item image An information embedding unit for embedding information of the selection item image in an information area configured by a position area in which position information to be embedded is embedded in a manner in which the information content is invisible to the user;
A portable device characterized by