JP2008108184A - Touch panel mounting device, external device, and operation method for external device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To easily operate an external device, using a display and a touch panel of a touch panel mounting device. <P>SOLUTION: This touch panel mounting device is provided with a storage means for storing screen information which is information as to each screen displayed in a display part of the touch panel mounting device by the external device, and which includes information about a display position of each operation pattern in each screen, a screen notification receiving means (step 41) for receiving a notification of the screen displayed in the display part, from the connected or built-in external device, a recognition means (steps 42-44) for recognizing the operated operation pattern, based on the display position based on the screen information of each operation pattern in the screen notified from the external device, and based on a touch position output from a touch panel sensor, and a pattern notification means (step 45) for notifying the operation pattern recognized by the recognition means to the external device. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

The present invention relates to a touch panel mounting device including a display unit and a touch panel sensor, an external device that can be connected to or built in the device, and a method of operating the external device using the display unit and the touch panel sensor.
About.

  In recent years, so-called AV navigation systems that allow users to enjoy music and video software in addition to the car navigation function are on the market. Most operations such as AV navigation can be performed using a touch panel. In AV navigation, button graphics for operation are displayed on an on-screen display (hereinafter referred to as “OSD”). By comparing the display position of the button graphic with the coordinate data of the touch position input from the touch panel sensor, the AV navigation can recognize which button graphic has been operated.

  FIG. 5 is a block diagram showing an example of such a touch panel mounting apparatus. This touch panel mounting device is constituted by internal devices such as a navigation device and a DVD playback device, and includes a display device shared by these devices. The screen viewed by the user on the display device is superimposed with the video 51 output from the navigation device, DVD playback device, etc. on the display device, the OSD 52 displayed superimposed on the video 51, and the touch panel sensor 53 provided on the display device. Configured as a thing. On the OSD 52, the OSD / touch panel controller 54 displays button graphics 52a and 52b at the position instructed based on the drawing instruction from the system controller 55.

  When the user touches a desired button graphic 52 a or 52 b on the OSD 52 from the touch panel sensor 53, the coordinate data of the touch position is sent from the touch panel sensor 53 to the OSD / touch panel controller 54. The OSD / touch panel controller 54 identifies the touched button graphic 52a or 52b by comparing the coordinate data with the display positions of the button graphics 52a and 52b, and notifies the system controller 55 of it. Upon receiving this notification, the system controller 55 gives a necessary instruction so that an operation corresponding to the touched button graphic 52a or 52b is performed.

  As an in-vehicle device equipped with such a touch panel, a device that can be operated by the touch panel is also known (see, for example, Patent Document 1). In this apparatus, a control program including a function for performing display for operating a device to be retrofitted is stored in a vehicle-mounted device having a touch panel using a device such as a personal computer, and is retrofitted by the control program. The device can be operated with the touch panel of the in-vehicle device.

  In addition, as another example in which a newly added device can be controlled using the display of the in-vehicle device as in this example, a dedicated touch panel for the added device is used for the display of the in-vehicle device. A device that is attached is also known (see, for example, Patent Document 2).

JP 2000-344027 A JP 2005-202528 A

  However, according to the touch panel mounting device of FIG. 5 described above, as shown in FIG. 6, the external device 60 is connected to the touch panel mounting device 50, and the system controller 61 of the external device 60 is connected to the touch panel mounting device 50. Even if the image data of the button graphics 51a and 51b for operating the external device 60 is sent and displayed as the video 51, when the button graphic 51a or 51b is touched, the touch panel mounting device 50 does what it does. I can't recognize what it means. Even if coordinate data of the touch position is sent from the touch panel sensor 53, the OSD / touch panel controller 54 does not grasp the display position of the button graphics 51a and 51b, so that either of the button graphics 51a or 51b is touched. This is because it cannot be specified whether or not. Therefore, even if the external device 60 is an optional product of the touch panel mounting device 50, the external device 60 cannot be operated with the touch panel 53. For this reason, the operability of the external device 60 cannot be improved.

  In addition, according to the technology for retrofitting a device to the in-vehicle device having the touch panel described above, a function of displaying a button graphic for operating the retrofitted device by using an input device such as a personal computer. It is necessary to set the control program to be included in the in-vehicle device using a personal computer or the like. Therefore, it takes time until an after-applied device can be operated, and a setting operation using a personal computer or the like is complicated.

  Furthermore, according to the technique of mounting a dedicated touch panel on the above-described additional device to the in-vehicle device, it is necessary to mount the touch panel, so that it takes time before the additional device can be operated. Further, attaching a touch panel to the display of the in-vehicle device may impair the beauty.

  An object of the present invention is to easily operate an external device using the display and the touch panel of the touch panel mounting device when an external device is connected to the touch panel mounting device in view of the problems of the prior art. It is to provide technology that enables

  To achieve this object, a touch panel mounting device according to the first invention includes a display unit that can be used by an external device that can be connected to or built in the touch panel mounting device, a touch panel sensor provided on the display unit, Storage means for storing screen information including information on each screen that can be displayed on the display unit by the external device and including information on the display position of each operation graphic on each screen, and connected or built-in Screen notification receiving means for receiving notification of the screen displayed on the display unit from the external device, and a display position based on the screen information of each operation graphic on the screen notified from the external device; Recognizing means for recognizing an operated graphic based on a touch position output by the touch panel sensor; and Characterized by comprising a graphic notification means for notifying the recognized operating graphic Ri to the external device.

  Here, a car navigation device corresponds to the touch panel mounting device, for example. The screen information may include information regarding the function of each operation graphic. In this case, each operation graphic can be identified by its function. As the operation graphic, for example, an operation button graphic is applicable. The operation of the operation graphic corresponds to, for example, an operation of touching the operation graphic or an operation of touching the operation graphic twice within a predetermined time. As the external device, for example, a CD changer or a hands-free telephone is applicable.

  In this configuration, when the external device is connected to or built in the touch panel mounting device and receives a notification of the screen displayed on the display unit of the touch panel mounting device from the external device, the user operates the operation graphic on the displayed screen. By operating, it becomes possible to operate the external device. That is, the display position of the operation graphic on the currently displayed screen is included in the screen information of the screen stored in the storage means. When the user touches any of the operation graphics on the displayed screen via the touch panel sensor, the operation is performed based on the display position of each operation graphic on the displayed screen and the touch position from the touch panel sensor. The operation graphic is recognized and notified to the external device. Upon receiving this notification, the external device performs an operation corresponding to the notified operation graphic. According to this, the user can operate the external device immediately by using the display unit and the touch panel sensor simply by connecting or incorporating the external device to the touch panel mounting device.

  The touch panel mounting device according to a second aspect of the present invention is the touch panel mounting device according to the first aspect, wherein the operation graphic is displayed on the display unit as a display element of the on-screen display at each indicated display position. Based on the display position and the touch position output by the touch panel sensor, the identification means for identifying the operation graphic on which the operation has been performed is provided, and the recognition means notifies the identification means from the external device. For the received screen, the operation graphic at each display position included in the corresponding screen information is displayed as a transparent one, and the operation graphic on which the operation has been performed is specified, thereby using the function of the specifying means. Then, the operated graphic for operation is recognized. Here, as the specifying means, for example, a means using a button function realized by using a predetermined application program for controlling the graphical user interface is applicable.

  An external device according to a third aspect of the present invention is an external device that is connected to or built in a predetermined touch panel mounting device and can display a necessary screen on a display unit of the touch panel mounting device. A screen notification means for notifying the touch panel mounting apparatus of the screen displayed on the display unit of the mounting apparatus, and after the notification by the screen notification means, of the operation graphic on the notified screen that is recognized as operated A graphic notification receiving means for receiving a notification from the touch panel mounted device, and when the graphic notification receiving means receives a notification of an operation graphic, an operation corresponding to the operation graphic is performed.

  A method for operating an external device according to a fourth aspect of the present invention relates to a method for operating a predetermined external device using a display unit included in the predetermined touch panel mounting device and a touch panel sensor provided thereon. This method includes storing information on each screen that can be displayed by the external device on the display unit, the screen information including information on the display position of each operation graphic on each screen in the storage unit of the touch panel mounting device. A step of connecting or incorporating an external device in the touch panel mounting device, a step of causing the external device to display a necessary screen on the display unit, and a screen displayed by the external device in the display step on the touch panel mounting device. The step of notifying, the step of acquiring the display position of each operation graphic on the screen notified in the notification step by the touch panel mounting device, and the step of acquiring the touch panel mounting device in the acquisition step Based on the display position of the operation graphic and the touch position output from the touch panel sensor, the operated operation graphic is recognized. A step in which the touch panel mounting device notifies the external device of the operation graphic recognized in the recognition step, and a step in which the external device performs an operation corresponding to the operation graphic notified in the notification step. It is characterized by comprising.

  According to the present invention, in the touch panel mounting device, information relating to each screen that can be displayed by the external device on the display unit, and screen information including information relating to the display position of each operation graphic on each screen is stored. When a notification of a screen being displayed is received from an external device, a storage unit is provided, and an operation is performed based on the display position of each operation graphic on the screen based on the screen information and the touch position from the touch panel sensor. Since the operation graphic is recognized and notified to the external device, the user can immediately connect the external device to the touch-panel-equipped device or simply use the display unit and the touch panel sensor to connect the external device. Can be operated.

  In addition, the operation graphic is displayed on the display unit of the touch panel mounted device as a display element of the on-screen display at each indicated position, and the display position of each operation graphic and the touch position from the touch panel sensor are displayed. Based on this, there is provided a specifying means for identifying the operation graphic that has been operated, and this function is used to recognize the operation graphic that has been operated, so that the existing application program that controls the graphical user interface The operated graphic for operation can be recognized using.

  In addition, in the external device, the screen being displayed on the display unit of the touch panel mounting device is notified to the touch panel mounting device, and then, the operation graphic on the notified screen is notified from the touch panel mounting device that it is recognized that it has been operated. When received, since the operation corresponding to the operation graphic is performed, the user can use the display unit and the touch panel sensor immediately by connecting or incorporating the external device to the touch panel mounting device. Can be operated.

  FIG. 1 is a block diagram showing a configuration of an in-vehicle system according to an embodiment of the present invention. This system includes a touch panel mounting device 10 and an external device 16 connected thereto. The external device 16 is an optional device of the touch panel mounting device 10. The touch panel mounting device 10 includes internal devices such as a navigation device and a DVD playback device, and includes a display that can be used by the external device 16.

  On the display of the touch panel mounting device 10, the video 11 and the OSD (on-screen display) 12 are displayed by the internal device or the external device 16. The display of the touch panel mounting device 10 is provided with a touch panel sensor 13 through which the user can touch button graphics 12a and 12b displayed on the OSD 12. The touch panel sensor 13 has a function of outputting coordinate data of a touched position.

  The touch panel mounting apparatus 10 controls each part of the touch panel mounting apparatus 10 and the OSD / touch panel controller 14 that displays the button graphics 12a and 12b as display elements in the OSD 12 and specifies the touched button graphics 12a or 12b. A system controller 15 is provided. Based on an instruction from the system controller 15, the OSD / touch panel controller 14 displays the button graphics 12a and 12b as display elements of the OSD 12 at each indicated display position, and the display positions of the button graphics 12a and 12b and the touch panel. Based on the touch position output by the sensor 13, the touched button graphic 12 a or 12 b is identified and notified to the system controller 15.

  The external device 16 includes a system controller 17 that controls each unit. The system controller 17 has a function of causing the touch panel mounting device 10 to display a screen including button graphics 11a and 11b as an image 11 on the display. Moreover, it has a function to communicate with the system controller 15 of the touch panel mounting apparatus 10. The system controller 17 can notify the system controller 15 which screen is currently displayed as the video 11.

  In the nonvolatile memory included in the system controller 15, screens corresponding to the respective screens that can be displayed as images 11 on the display of the touch panel mounting device 10 by the external device 16 as an optional device in advance in the manufacturing stage of the touch panel mounting device 10. Information is stored. This storage is made in advance when the touch panel mounting apparatus 10 is manufactured, for example. This screen information includes information on the display position of each button graphic on each screen and the function assigned to it. Each screen is distinguished by the number and name attached to it. Each button graphic is distinguished by the function and name assigned to it.

  The system controller 15 has a function of performing communication with the system controller 17 of the external device 16. The system controller 15 displays transparent button graphics 12a and 12b at the display positions of the button graphics 11a and 11b on the screen based on information from the system controller 17 indicating which screen is displayed as the video image 11. In this way, the OSD / touch panel controller 14 can be instructed. When the OSD / touch panel controller 14 receives a notification that the button graphic 12a or 12b has been touched, it notifies the system controller 17 accordingly.

  FIG. 3 is a flowchart showing a part of processing by the system controller 17 of the external device 16. When the process is started, the system controller 17 first transfers the image data of the screen to be displayed to the touch panel mounted device 10 and draws it as the video 11 in step 31. This screen includes display of button graphics 11a and 11b that are touched to operate the external device 16 by the user.

  Next, in step 32, the drawn screen is notified to the system controller 15 of the touch panel mounting device 10. By this notification, the transparent button graphics 12a and 12b corresponding to the button graphics 11a and 11b are displayed on the OSD 12 in the OSD 12, and when any of the button graphics is touched, the system controller 15 notifies that effect. Will be.

  Next, in step 33, the system controller 15 waits for notification that the button graphic 11a or 11b has been touched. When the notification that the button graphic 11a or 11b is touched is received, the process proceeds to step 34 so that the operation for executing the function assigned to the button graphic 11a or 11b that is notified as touched is performed. Instruct each part. Thereby, the process of FIG. 3 is completed.

  When it is necessary to change the screen displayed on the display of the touch panel mounted device 10 in accordance with the execution of this function, the process of FIG. 3 is performed again in the same manner. The touch of the figure is detected, and the function corresponding to the touched button figure is executed.

  FIG. 4 is a flowchart showing a part of processing by the system controller 15 and the OSD / touch panel controller 14 of the touch panel mounting apparatus 10. When the process is started, the system controller 15 first waits for notification of a screen that the external device 16 has rendered as the video 11 on the display of the touch panel mounting device 10 in step 41. This notification is made from the system controller 17 of the external device 16 in step 32 of FIG.

  When this notification is received, the process proceeds to step 42, and the screen information of the notified screen is read from the nonvolatile memory, and the corresponding button graphic is displayed on the OSD / touch panel controller 14 based on the screen information. To instruct. This instruction includes the display position of each button graphic specified in the read screen information. Upon receiving this notification, the OSD / touch panel controller 14 causes the OSD 12 to display transparent button graphics 12a and 12b at each indicated display position.

  Next, the OSD / touch panel controller 14 waits for notification of coordinate data from the touch panel sensor 13 in step 43. When the touch panel sensor 13 is touched by the user, the coordinate data of the touch position is notified to the OSD / touch panel controller 14. Upon receiving the notification of the coordinate data, the OSD / touch panel controller 14 determines whether any of the button graphics 12a or 12b is touched based on the coordinate data and the display positions of the button graphics 12a and 12b. . If it is determined that none of them has been touched, the process returns to step 43 and further waits for notification of coordinate data.

  If it is determined that either button graphic 12a or 12b has been touched, the process proceeds to step 45 to notify the external device system controller 15 that the touched button graphic 12a or 12b has been touched. The system controller 15 transfers this notification to the system controller 17 of the external device 16. This notification is received by the system controller 17 of the external device 16 in step 33 of FIG. Thereby, the process of FIG. 4 is completed.

  Note that the button function of the existing application program that controls the graphical user interface is used to display the transparent button graphics 12a and 12b by the OSD / touch panel controller 14 and to determine whether any of them is touched. Can do. In addition, regardless of such a function, the display positions of the button graphics 12a and 12b and the touch position from the touch panel sensor 13 are compared, and the touch position is included within a predetermined range of the display positions of the button graphics 12a or 12b. Whether or not the button graphic 12a or 12b is touched may be determined based on whether or not it is touched.

  According to this embodiment, since the external device 16 as an optional device of the touch panel mounting device 10 can be operated by the touch panel of the touch panel mounting device 10, a great merit can be given to the user. By repeating the processes of FIGS. 3 and 4, all operations of the external device 16 can be performed through the screen displayed on the touch panel mounting device 10, so that the operability of the external device 16 can be improved. At this time, there is no need to set a button for the touch panel mounting device 10 using an input device such as a personal computer or to attach a touch panel dedicated to the external device 16 in the touch panel mounting device 10 as in the past.

  FIG. 2 is a block diagram showing a configuration of an in-vehicle system according to another embodiment of the present invention. In this case, the external device 16 is built in the touch panel mounting device 10. The other points are the same as those of the embodiment shown in FIG. 1, and the operation is the same as that shown in FIGS. According to the present embodiment, when developing a new touch panel mounting device 10 that incorporates an existing product as the external device 16, the external device 16 is mounted as a touch panel as screen information stored in the nonvolatile memory of the system controller 15. The function corresponding to each screen that can be displayed on the display of the device 10 is used, and the system controller 15 and the system controller 16 include the function of the external device 16 only by preparing means for communicating with each other and means for executing the received notification. Since all functions can be operated with the touch panel of the touch panel mounting device 10, the development amount can be suppressed.

  Note that the present invention is not limited to the above-described embodiment, and can be implemented with appropriate modifications. For example, in the above description, the operation of touching the button graphic is described as the operation of the operation graphic. However, the present invention is not limited to this, and the operation of touching the button graphic twice within a predetermined time or dragging the button graphic. It may be an operation. In such a case, instead of notifying the touched button, the external device 16 may be notified of the operated button and the type and content of the operation.

It is a block diagram which shows the structure of the vehicle-mounted system which concerns on one Embodiment of this invention. It is a block diagram which shows the structure of the vehicle-mounted system which concerns on another embodiment of this invention. It is a flowchart which shows a part of process by the system controller of the external apparatus in the system of FIG. 2 is a flowchart showing a part of processing by a system controller and an OSD / touch panel controller of a touch panel mounting apparatus in the system of FIG. 1. It is a block diagram which shows an example of the conventional touch panel mounting apparatus. It is a block diagram for showing the problem in the conventional touch panel mounting apparatus.

Explanation of symbols

  11, 51: video, 11a, 11b: button graphic, 12, 52: OSD (on-screen display), 12a, 12b: transparent button graphic, 13, 53: touch panel sensor, 14, 54: OSD / touch panel controller, 15, 55: System controller, 16, 60: External device, 17, 61: System controller, 51a, 51b, 52a, 52b: Button graphic.

Claims (4)

A display unit that can be used by an external device that can be connected to or incorporated in the touch panel mounted device;
A touch panel sensor provided on the display unit;
Storage means for storing screen information including information on each screen that can be displayed on the display unit by the external device and including information on a display position of each operation graphic on each screen;
Screen notification receiving means for receiving notification of a screen displayed on the display unit from the connected or built-in external device;
Recognizing means for recognizing the operated operation graphic based on the display position based on the screen information of each operation graphic on the screen notified from the external device and the touch position output by the touch panel sensor;
A touch panel mounting apparatus, comprising: a graphic notifying means for notifying the external device of an operation graphic recognized by the recognizing means. The operation graphic is displayed on the display unit as a display element of the on-screen display at each instructed display position, and based on the display position of each operation graphic and the touch position output by the touch panel sensor. , Equipped with a specific means for identifying the operation graphic on which the operation was performed,
The recognizing means causes the specifying means to display the operation graphic at each display position included in the corresponding screen information as transparent for the screen notified from the external device, and the operation is performed. 2. The touch panel mounting device according to claim 1, wherein by specifying an operation graphic, the operated operation graphic is recognized by using a function of the specifying means. An external device that is connected to or built in a predetermined touch panel mounting device and can display a necessary screen on the display unit of the touch panel mounting device,
Screen notification means for notifying the touch panel mounting device of a screen displayed on the display unit of the touch panel mounting device;
After the notification by the screen notification means, comprising graphic notification receiving means for receiving notifications of the recognized operation figures among the operation graphics on the notified screen from the touch panel mounted device,
An external device characterized in that when the graphic notification receiving means receives a notification of an operation graphic, an operation corresponding to the operation graphic is performed. A method of operating a predetermined external device using a display unit provided on a predetermined touch panel mounting device and a touch panel sensor provided thereon,
Storing information on each screen that can be displayed by the external device on the display unit, the screen information including information on the display position of each operation graphic on each screen in the storage means of the touch panel mounting device;
Connecting or incorporating an external device into the touch panel mounted device;
An external device displaying a necessary screen on the display unit;
A step in which the external device notifies the touch panel mounted device of the screen displayed in the display step;
A step of acquiring a display position of each operation graphic on the screen notified in the notification step by the touch panel mounting device based on the screen information;
The touch panel mounting device recognizes the operated operation graphic based on the display position of each operation graphic acquired in the acquisition step and the touch position output by the touch panel sensor;
A process in which the touch panel mounting device notifies the external device of the operation graphic recognized in the recognition step;
And a step of performing an operation corresponding to the operation graphic notified in the notification step.

Images