JP2012018587A - Image display system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To obtain a response sound with an excellent response to an input operation of a touch panel type display 220.SOLUTION: In an image display system, a portable terminal 10 creates image data for executing navigation for a vehicle, transmits the image data to an on-board display device 200, and also transmits response area data to the on-board display device 200 when a display screen is changed. When an input operation of a touch panel type display 220 is performed and the input position is included in the response area based on input coordinate data and the response area data, the on-board display device 200 generates a response sound from a speaker 240.

Description

  The present invention provides an image display operation device provided with a touch panel display that a user performs an input operation while viewing a screen display, and an image display operation device that is communicable with the image display operation device, and transmits image data of an image displayed on the touch panel display. The present invention relates to an image display system including an image transmission device.

  Conventionally, a portable navigation terminal that executes navigation suitable for vehicle travel guidance has been proposed in Patent Document 1. In recent years, portable navigation terminals have become highly sophisticated.

  On the other hand, recent vehicles are equipped with in-vehicle navigation devices. Therefore, if the vehicle occupant has a portable navigation terminal having a vehicle navigation function, the in-vehicle navigation device is not always necessary. However, since the display screen of the mobile navigation terminal is narrower than the display screen of the in-vehicle navigation device, some users feel that the visibility is poor.

JP 2002-277274 A

  Therefore, the inventor of the present application provides a touch panel type display device that does not have a navigation function on the vehicle side instead of the in-vehicle navigation device, and connects the display device and the mobile terminal to perform navigation using the display device. I thought about a system to be executed. In this system, control processing for performing navigation is performed on the mobile terminal side, and image display and operation input are performed on the display device side. Therefore, it is not necessary to mount an in-vehicle navigation device on the vehicle, and the cost of the vehicle can be reduced. In addition, a display device mounted on a vehicle can have a larger screen than a portable terminal, and can maintain the same level of visibility as a conventional in-vehicle navigation device.

  However, this system has a problem that an operation response sound is poor in response to an operation input to the touch panel. This is due to the following reason. When an operation input is performed on the touch panel, the display device transmits coordinate data representing the input position to the mobile terminal. Based on the received coordinate data, the mobile terminal determines whether the coordinates are included in the region where the reaction sound is to be generated. To the display device. For this reason, after the operation input, a signal for generating a reaction sound is exchanged between the display device and the mobile terminal, and the timing at which the reaction sound is actually generated from the display device with respect to the operation input timing. It will be late. Therefore, there is a possibility of misunderstanding that the display device is out of order. In addition, there is a possibility that the touch panel is pressed hard and damaged.

  The present invention has been made to cope with the above-described problem, and an object thereof is to obtain a response sound with a good response to an input operation to a touch panel.

  In order to achieve the above object, the present invention is characterized in that a touch panel display and a speaker for generating a reaction sound are provided, and an image is displayed on the touch panel display based on received image data. An image display operation device that transmits input position data that represents an input position that has been input to the display, and an image display operation device that is communicably connected to the image display operation device and that displays image data on the touch panel display. An image display system including an image transmission device that transmits to the device, receives input position data of the touch panel display, and performs processing according to the input position data. A reaction sound should be generated in the display image of the touch panel display. Reaction sound region data transmission means for transmitting reaction sound region data in which a reaction sound region is set to the image display operation device is provided, and the image display operation device is operated to input to the touch panel display based on the reaction sound region data. When the input position thus entered is in the reaction sound region, there is provided reaction sound control means for generating a reaction sound by the speaker.

  In the present invention, an image display operation device and an image transmission device provided separately from the image display operation device are provided, and communication is possible between the image display operation device and the image transmission device. . The image display operation device includes a touch panel display in which a display and an operation input position detector are combined, and a speaker for generating a reaction sound, and receives image data transmitted from the image transmission device. Display an image on the touch panel display. In addition, the image display operation device transmits input position data representing an input position input to the touch panel display to the image transmission device.

  The image transmission device transmits image data of an image to be displayed on the touch panel display to the image display operation device, receives input position data transmitted from the image display operation device, and performs processing according to the input position data. .

  In such an image display system, the image display operation device serves as a graphical user interface, and the image transmission device serves as a brain unit that performs control processing according to the user's operation. In the image display operation device, it is preferable to generate a reaction sound indicating that an operation input to the touch panel display is accepted. However, in this case, in the image transmission device that performs control processing according to the operation, it is determined whether the operation input position is in the reaction sound region where the reaction sound should be generated, and based on the determination result, the reaction sound command signal Is transmitted to the image display operation device, the timing at which the reaction sound is actually emitted from the speaker of the image display operation device is delayed.

  Therefore, in the present invention, reaction sound area data transmission means and reaction sound control means are provided so that the sound generation timing of the reaction sound is not delayed. The reaction sound area data transmission means is provided in the image transmission apparatus and transmits reaction sound area data in which a reaction sound area in which a reaction sound in the display image of the touch panel display is to be generated is set to the image display operation apparatus. The reaction sound control means is provided in the image display operation device, and generates a reaction sound with a speaker when an input position input to the touch panel display based on the reaction sound area data enters the reaction sound area. Accordingly, since the reaction sound area data in which the reaction sound area is set in advance can be transmitted to the image display operation device before the user inputs an operation to the touch panel display, the reaction sound is controlled by the image transmission device. There is no need to do it.

  For this reason, a response sound is generated with good response to the user's operation on the touch panel display. Therefore, the user can comfortably perform operation input. Moreover, there is no misunderstanding that the touch panel display is out of order, and there is no possibility of damaging the touch panel display by pressing it firmly.

  Another feature of the present invention resides in that the image display operation device is a touch panel type in-vehicle display device provided in a vehicle interior, and the image transmission device is a portable terminal.

  ADVANTAGE OF THE INVENTION According to this invention, the image displayed with a portable terminal can be displayed with a vehicle-mounted display apparatus. Therefore, since the display screen of the touch panel display device can be enlarged, the video provided by the mobile terminal can be viewed on a large screen in the vehicle interior, and the visibility is improved. Further, it is possible to perform an operation input using a wide display screen, and furthermore, a response sound with respect to the operation input is generated with a good response, so that the operability is very good.

  Another feature of the present invention is that the portable terminal can execute navigation for a vehicle.

  According to the present invention, it is possible to receive a vehicle travel guide on a large screen by providing an image display operation device having a communication function with a portable terminal without mounting a navigation device on the vehicle. For this reason, cost reduction of a vehicle can be achieved.

1 is a schematic configuration diagram of an image display system according to an embodiment of the present invention. It is a perspective view of the vehicle interior in which the in-vehicle display device is installed. It is a front view of a portable terminal and a vehicle-mounted display apparatus. It is a flowchart showing the vehicle-mounted display control routine which concerns on embodiment. It is a flowchart showing the comparison routine for comparing with embodiment. It is explanatory drawing which showed the reaction area in a map display screen. It is explanatory drawing which showed the reaction area in a menu display screen. It is explanatory drawing which showed the reaction area in the map display screen which concerns on a modification.

  Hereinafter, an image display system according to an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a schematic configuration diagram of a vehicle image display system according to the embodiment.

  This image display system includes a mobile terminal 10 and an in-vehicle display device 200. The portable terminal 10 is a portable information terminal that stores various application programs and provides various kinds of information to the user by executing the application program. In the present embodiment, the mobile terminal 10 stores a navigation program and performs vehicle navigation guidance to the user with images and sounds by executing the navigation program. Note that the mobile terminal 10 is not limited to one that performs navigation. For example, it may be a mobile web browser or a mobile game machine that executes a game application program. The application program may be downloaded from the outside such as the Internet and executed.

  As shown in FIG. 2, the in-vehicle display device 200 includes a touch panel display 220 incorporated in an instrument panel 400 of the vehicle. The in-vehicle display device 200 does not have a function of executing an application such as navigation by itself. Therefore, the in-vehicle display device 200 is very inexpensive as compared with the conventional in-vehicle navigation device. In the image display system according to the present embodiment, control processing for performing navigation is performed by the mobile terminal 10, and the in-vehicle display device 200 is used to transmit information to the driver and to perform operation input using images and sounds. Functions as a graphical user interface. In the present embodiment, the in-vehicle display device 200 displays the same image as that displayed on the mobile terminal 10.

  The mobile terminal 10 includes an electronic control unit 100 (hereinafter referred to as ECU 100), an external communication unit 20, a GPS unit 30, a touch panel display 40, an outside panel operation unit 50, a speaker 60, and a nonvolatile memory 70. And a terminal side communication unit 80. The ECU 100 includes a microcomputer as a main part, and includes a CPU, a ROM, a RAM, an input / output interface, various drivers, and the like. A navigation program as an application program is stored in the ROM.

  The external communication unit 20 is a wireless communication circuit for connecting to the Internet. For example, the external communication unit 20 may be connected to the Internet via a base station of a mobile phone operator, or directly connected to the Internet. There may be. Thereby, the portable terminal 10 can perform data communication with the information distribution center via the Internet. The GPS unit 30 detects the current position coordinates of the mobile terminal based on radio waves from GPS satellites, and outputs the current position coordinates to the ECU 100.

  The touch panel display 40 includes a display unit 41 that is a thin display using liquid crystal, organic EL, or the like, and an in-panel operation unit 42 for detecting an operation input position on the display screen of the display unit 41. . The display unit 41 displays various images (a road map, various guidance information, various setting information, etc., when navigation is being performed) based on image signals output from the ECU 100. Since the mobile terminal 10 is required to be compact, the screen size (area) of the display unit 41 is smaller than the in-vehicle display device 200 as shown in FIG. However, the screen of the display unit 41 has a high resolution. The screen standard of the display unit 41 in this embodiment is full-wide VGA. Therefore, the number of pixels constituting the screen is 960 × 480 (horizontal × vertical).

  The in-panel operation unit 42 uses a touch pad incorporated in the touch panel display 40. The in-panel operation unit 42 outputs a coordinate signal representing the operation input position on the display screen of the display unit 41 to the ECU 100.

  As shown in FIG. 3, the outside panel operation unit 50 includes a home button 50a, a menu button 50b, a return button 50c, a search button 50d, and a pointer 50e. The configuration of the buttons and pointers of the outside panel operation unit 50 can be arbitrarily set. The outside panel operation unit 50 outputs a button operation signal indicating a button operation and a pointer operation signal indicating a pointer operation to the ECU 100. The speaker 60 is operated by a sound signal output from the ECU 100 to generate a sound guide, an operation reaction sound, and the like.

  The nonvolatile memory 70 is for storing information acquired from the Internet, here, information acquired from the outside, such as navigation information acquired from the information distribution center via the Internet. In the portable terminal 10, a control program for performing navigation and map data are stored in the ROM of the ECU 100, and when actually performing navigation, traffic information, public transportation information, and the like are transmitted from the information distribution center. Obtained and stored in the nonvolatile memory 70. Note that the control program and map data for performing the navigation need not be stored in the ROM of the ECU 100 from the beginning, and may be acquired via the Internet. In this case, the downloaded data is stored in the nonvolatile memory 70.

  The terminal-side communication unit 80 is a communication interface that communicates with the in-vehicle display device 200. In the present embodiment, the mobile terminal 10 and the in-vehicle display device 200 are connected by short-range wireless communication. For example, although Bluetooth is used, a short-range wireless communication method using a wireless LAN such as Wi-Fi can also be adopted.

  Focusing on its function, the ECU 100 includes a control processing unit 110 for executing an application program on the mobile terminal 10 and a linkage control unit 120 that enables the operation of the application to be executed also on the in-vehicle display device 200. In the present embodiment, the control processing unit 110 is a navigation control unit that executes a navigation program.

  The control processing unit 110 includes a vehicle navigation program for executing vehicle navigation suitable for guiding the vehicle to the destination, and a pedestrian suitable for guiding the pedestrian to the destination. Both a pedestrian navigation program for executing navigation are stored, and one of them is selectively executed. In a situation where the user is on the vehicle, the vehicle navigation is selected.

  Vehicle navigation sets and guides a vehicle travel route to a destination based on various road information and traffic information. On the other hand, in pedestrian navigation, a walking route to a destination is set and guided based on sidewalk information or public transportation information. It also provides users with timetable information, transit information, fare information, etc. for public transportation (trains, buses, etc.).

  The cooperation control unit 120 includes an in-vehicle image generation unit 130, a coordinate detection unit 140, an operation detection unit 150, a reaction area storage unit 160, a reaction area output unit 170, a voice output unit 180, and a communication control unit 190. And.

  The communication control unit 190 controls the terminal-side communication unit 80 to establish communication between the mobile terminal 10 and the in-vehicle display device 200. Moreover, the communication control part 190 outputs a communicable signal with respect to the control process part 110, when communication with the portable terminal 10 and the vehicle-mounted display apparatus 200 is established. On the other hand, when communication between the mobile terminal 10 and the in-vehicle display device 200 is not established, a communication impossibility signal is output to the control processing unit 110.

  The in-vehicle image generation unit 130 converts the image data of the image displayed on the display unit 41 of the mobile terminal 10 into image data suitable for screen display on the in-vehicle display device 200. For example, the screen size of the display unit 41 of the mobile terminal 10 is full-wide VGA (960 pixels wide × 480 pixels high), whereas the screen size of the display unit 221 (described later) of the in-vehicle display device 200 is wide VGA ( Consider the case of 800 pixels wide × 480 pixels high). In this case, the display unit 41 of the mobile terminal 10 has 160 pixels more in the horizontal direction than the display unit 221 of the in-vehicle display device 200. Therefore, the in-vehicle image generation unit 130 thins out the image data of the mobile terminal 10 by an average of 160 pixels in the horizontal direction. Further, the in-vehicle image generation unit 130 adjusts the number of pixels in the vertical direction of the image data so as to be displayed on the in-vehicle display device 200 using the aspect ratio of the screen of the mobile terminal 10. In this example, since the screen aspect ratio of the mobile terminal 10 is (480/960), the number of pixels in the vertical direction of the image data is set to 800 × (480/960) = 400 pixels. Accordingly, the in-vehicle image generation unit 130 thins out the image data of the portable terminal 10 by an average of 80 pixels in the vertical direction.

  In this way, image data in which the screen aspect ratio and resolution are adjusted is generated. Therefore, at least one of the vertical direction and the horizontal direction of the screen of the in-vehicle display device 200 can be displayed using the full screen. The in-vehicle image generation unit 130 transmits the generated image data to the in-vehicle display device 200 via the terminal side communication unit 80.

  When the screen size of the in-vehicle display 200 is larger than the screen size of the mobile terminal 10, interpolation pixels may be inserted on average. The in-vehicle image generation unit 130 stores an image conversion program corresponding to a plurality of types of screen size standards, and by executing the image conversion program corresponding to the screen size standards of the in-vehicle display device 200, the mobile terminal 10 image data are converted to generate image data for the in-vehicle display device 200. The screen size of the in-vehicle display 200 is recognized by the communication control unit 190 and stored in the non-volatile memory 70 at the time of the first pairing operation between the mobile terminal 10 and the in-vehicle display device 200. Alternatively, the user may input and set the screen size of the in-vehicle display device 200 using the in-panel operation unit 42.

  The coordinate detection unit 140 receives the coordinate data output from the in-vehicle display device 200. The coordinate data is data representing the position coordinates that are input to the in-panel operation unit 222 (described later) of the in-vehicle display device 200. When coordinate data is input, the coordinate detection unit 140 converts the coordinate data into coordinate data on the display screen of the mobile terminal 10 and outputs the coordinate data to the control processing unit 110.

  The operation detection unit 150 inputs operation data output from the in-vehicle display device 200. The operation data is operation button data and operation pointer data input by an operation unit 230 (described later) of the in-vehicle display device 200. The operation detection unit outputs the input operation data to the control processing unit 110.

  The reaction area storage unit 160 is coordinate data (referred to as reaction area data) representing a region (referred to as a reaction area) that generates a reaction sound when an operation input is performed on the screen of the touch panel display 40 of the mobile terminal 10. ) Is stored. In the present embodiment, the reaction area data is stored in the ROM, but may be configured to be stored in the nonvolatile memory 70.

  In the image display system of the present embodiment, when the user inputs an operation to the touch panel display 40, 220 of the mobile terminal 10 or the in-vehicle display device 200, a reaction sound for notifying the user that the operation has been received is generated. generate. For example, as shown in FIG. 6, the reaction area can be set to be the same as the display area (the part painted in gray) of the button icon A displayed on the display screen S of the touch panel display 40 or 220. The reaction area can also be set in an area other than the button icon.

  In addition, since the reaction area varies depending on the type of display screen (map display guidance screen, destination setting screen, search screen, menu selection screen, etc.), reaction area data is displayed for each type of display screen. It is stored in association with the type of screen. For example, on the menu selection screen, as shown in FIG. 7, the display area (the portion painted in gray) of the menu selection icon A displayed on the display screen S is set as the reaction area.

  The reaction area output unit 170 extracts reaction area data corresponding to the display screen from the reaction area storage unit 160 every time the type of the display screen is changed. Then, the extracted reaction area data is transmitted to the in-vehicle display device 200 via the terminal side communication unit 80. As described above, when the display screen size (pixel configuration) is different between the mobile terminal 10 and the in-vehicle display device 200, the in-vehicle image generation unit 130 converts the image data of the mobile terminal 10 into the in-vehicle display device 200. However, when such image data conversion is involved, the reaction area output unit 170 also converts the reaction area data into coordinate data in the in-vehicle display device 200 and outputs the coordinate data.

  The voice output unit 180 inputs voice data related to voice guidance performed by the control processing unit 110 from the control processing unit 110, and transmits the voice data to the in-vehicle display device 200 via the terminal side communication unit 80.

  Next, the in-vehicle display device 200 will be described. The in-vehicle display device 200 includes an electronic control unit 210 (hereinafter referred to as ECU 210), a touch panel display 220, an outside panel operation unit 230, a speaker 240, and an in-vehicle side communication unit 250. The ECU 210 serves as a main control unit as a graphical user interface for navigation performed by the mobile terminal 10, and includes a CPU, a ROM, a RAM, an input / output interface, various drivers, and the like.

  The touch panel display 220 includes a display unit 221 that is a thin display using liquid crystal, organic EL, or the like, and an in-panel operation unit 222 for detecting an operation input position on the display screen of the display unit 221. . The display unit 221 displays various images (such as a road map, various guidance information, and various setting information when navigation is being performed) by the image signal output from the ECU 210. The screen size (area) of the display unit 221 is larger than that of the mobile terminal 10. The screen standard of the display unit 221 is wide VGA (800 pixels × 400 pixels) which has a lower resolution than the mobile terminal 10. Although the screen size (area) and screen standard of the display unit 221 can be arbitrarily set, the screen size (area) is larger than that of the mobile terminal 10.

  The in-panel operation unit 222 uses a touch pad incorporated in the touch panel display 220. The in-panel operation unit 222 outputs a coordinate signal indicating an operation input position on the display screen of the display unit 221 to the ECU 210.

  As shown in FIG. 3, the outside panel operation unit 230 includes a home button 230a, a menu button 230b, a return button 230c, a search button 230d, and a pointer 230e. The configuration of the buttons and pointers of the outside panel operation unit 230 can be arbitrarily set. The outside panel operation unit 230 outputs a button operation signal indicating a button operation and a pointer operation signal indicating a pointer operation to the ECU 210.

  The speaker 240 is operated by a sound signal output from the ECU 210 and generates a sound guide, an operation reaction sound, and the like. Note that the speaker 240 is not limited to the one built in the in-vehicle display device 200, and can also be used as an audio speaker provided in a vehicle interior such as a door.

  The in-vehicle side communication unit 250 is a communication interface that performs near field communication with the terminal side communication unit 80 of the mobile terminal 10. The ECU 210 controls the in-vehicle side communication unit 250 to input image data, reaction area data, and voice data from the mobile terminal 10, and coordinate data representing the position coordinates input to the in-panel operation unit 222, and the panel Operation data (operation button data, operation pointer data) of the outer operation unit 230 is output.

  When the ECU 210 pays attention to its function, the communication control unit 211, the display control unit 212, the coordinate output unit 213, the operation output unit 214, the reaction area storage unit 215, the reaction sound control unit 216, and the voice control unit. 217.

  The communication control unit 211 controls the in-vehicle side communication unit 250 to establish communication with the terminal side communication unit 80 of the mobile terminal 10. The display control unit 212 displays an image on the screen of the display unit 221 according to the image data transmitted from the mobile terminal 10. The coordinate output unit 213 converts the coordinate signal representing the operation input position on the display surface output from the in-panel operation unit 222 into coordinate data, and transmits the coordinate data to the mobile terminal 10 via the in-vehicle communication unit 250. The coordinate data is also output to the reaction sound control unit 216.

  The reaction area storage unit 215 stores the reaction area data transmitted from the mobile terminal 10. This reaction area data is transmitted from the mobile terminal 10 every time the type of the display screen is changed. Each time reaction area data is transmitted, the reaction area storage unit 215 updates (rewrites) the transmitted latest reaction area data.

  Based on the coordinate data output from the coordinate output unit 213 and the reaction area data stored in the reaction area storage unit 215, the reaction sound control unit 216 determines that the operation input position to the touch panel display 220 is within the reaction area. It is determined whether or not. When the operation input position is in the reaction area, a driving signal for generating a reaction sound is output to the speaker 240. Accordingly, a reaction sound is generated from the speaker 240. On the other hand, when the operation input position is not within the reaction area, the drive signal is not output to the speaker 240.

  The operation output unit 214 converts the operation signal output from the outside panel operation unit 230 into operation data and transmits the operation data to the mobile terminal 10 via the in-vehicle communication unit 250. The voice control unit 217 drives and controls the speaker 240 according to the voice data transmitted from the mobile terminal 10. Therefore, voice guidance is performed by the speaker 240.

  Next, processing executed by the cooperation control unit 120 of the mobile terminal 10 and the ECU 210 of the in-vehicle display device 200 will be described using a flowchart. FIG. 4 shows an in-vehicle display control routine executed by the cooperation control unit 120 and the ECU 210. The left side of the drawing represents a process executed by the ECU 210 of the in-vehicle display device 200, and the right side of the drawing represents a process executed by the cooperation control unit 120 of the mobile terminal 10. This in-vehicle display control routine is activated when the user operates the mobile terminal 10 and selects navigation execution, and is repeated at a predetermined short cycle.

  The in-vehicle display control routine is executed in a state where communication is established between the mobile terminal 10 and the in-vehicle display device 200, and is not executed in a state where communication is not established. The mobile terminal 10 has a selection function between a vertical display mode in which the display screen is displayed vertically and a horizontal display mode in which the display screen is displayed horizontally. When communication is established between the two, the horizontal display mode is automatically selected as shown in FIG. Further, while the in-vehicle display control routine is being executed, in the control processing unit 110 of the mobile terminal 10, the navigation for the vehicle is executed in parallel therewith.

  When the in-vehicle display control routine is activated, the cooperation control unit 120 generates image data of a screen to be displayed on the in-vehicle display device 200 in step S11. This process is a process of converting image data of an image displayed on the display unit 41 of the mobile terminal 10 into image data suitable for display on the in-vehicle display device 200, and is performed by the in-vehicle image generation unit 130. Is done. In this example, since the standard of the screen size of the in-vehicle display device 200 is wide VGA, image processing for converting full-wide VGA image data that is the screen size of the display unit 41 of the mobile terminal 10 into wide-VGA image data is performed. Do. Subsequently, in step S <b> 12, image data of an image to be displayed on the in-vehicle display device 200 is transmitted from the terminal side communication unit 80.

  Then, cooperation control part 120 transmits voice data for voice guidance performed with in-vehicle display device 200 from terminal side communication part 80 in Step S13. This process is performed by the voice output unit 180, and when it is not time to perform voice guidance, the process of step S13 is skipped.

  Then, cooperation control part 120 judges whether the kind of display screen was changed in Step S14. If it is determined that the type of the display screen has been changed (S14: Yes), reaction area data for one screen corresponding to the display screen is extracted from the reaction area storage unit 160 in step S15. Subsequently, in step S <b> 16, the extracted reaction area data for one screen is transmitted from the terminal-side communication unit 80. When the in-vehicle display control routine is activated, the cooperation control unit 120 determines “Yes” in step S14, and extracts and transmits the reaction area data on the initial screen.

  On the other hand, if it is determined in step S14 that the type of the display screen has not been changed (S14: No), the processes in steps S15 and S16 are skipped. In addition, the process of step S14-S16 is a process performed by the reaction area output part 170. FIG.

  Then, cooperation control part 120 judges whether input data was received in Step S17. This input data represents coordinate data representing the position coordinates input to the in-panel operation unit 222 of the in-vehicle display device 200 and the operation data of the outside panel operation unit 230. When the input control data is received via the terminal-side communication unit 80, the cooperation control unit 120 outputs the input data to the control processing unit 110.

  In this case, if the input data is coordinate data representing the position coordinates input to the in-panel operation unit 222, the coordinate detection unit 140 converts the coordinate data into coordinate data on the display screen of the mobile terminal 10 and performs control processing. Output to the unit 110. If the input data is operation button data or operation pointer data of the outside panel operation unit 230, the operation detection unit 150 outputs the operation data to the control processing unit 110. Thereby, the control processing unit 110 regards the operation input from the in-vehicle display device 200 as the operation input on the mobile terminal 10, and proceeds with the navigation control process according to the operation input.

  When the input data is not received in step S17 (S17: No), the cooperation control unit 120 skips the process of step S18 and ends the in-vehicle display control routine once. The in-vehicle display control routine is repeatedly executed at a very short cycle. Therefore, in the mobile terminal 10, navigation information executed by the control processing unit 110 is transmitted to the in-vehicle display device 200, and the navigation control process is advanced according to the operation input transmitted from the in-vehicle display device 200.

  Next, processing on the in-vehicle display device 200 side will be described. As shown on the left side of FIG. 4, when the in-vehicle display control routine is activated, the ECU 210 displays an image on the screen of the display unit 221 according to the image data transmitted from the mobile terminal 10 in step S21. Subsequently, in step S22, the speaker 240 is driven and controlled in accordance with the audio data transmitted from the mobile terminal 10. If no audio data is transmitted, the process of step S22 is skipped.

  Thereby, in the vehicle-mounted display apparatus 200, the image displayed on the portable terminal 10 is enlarged and displayed, and voice guidance similar to that of the portable terminal 10 is performed. The process of step S21 is a process executed by the display control unit 212, and the process of step S22 is a process executed by the voice control unit 217.

  Subsequently, ECU 210 determines in step S23 whether or not reaction area data has been received. As described above, the reaction area data is transmitted from the mobile terminal 10 every time the type of the display screen is changed. When the ECU 210 receives the reaction area data (S23: Yes), the reaction area data is stored in the reaction area storage unit 215 in step S24. On the other hand, when the reaction area data is not received (S23: No), the process of step S24 is skipped.

  Subsequently, in step S25, the ECU 210 determines whether or not an operation input has been performed on the in-vehicle display device 200. When an operation input is performed by the in-panel operation unit 222 or the out-panel operation unit 230, the determination in step S25 is “Yes”, and the input data is carried via the in-vehicle communication unit 250 in step S26. Transmit to the terminal 10. If the operation is input to the in-panel operation unit 222, the coordinate detection unit 140 transmits coordinate data representing the operation input position on the display screen. If the operation is input to the outside panel operation unit 230, the operation detection unit 150 transmits operation button data or operation pointer data.

  Subsequently, in step S27, the ECU 210 determines whether or not the operation input is an input in the reaction area. That is, it is determined whether or not the operation input is performed by the in-panel operation unit 222 and the operation input position is within the reaction area. In this case, the reaction sound control unit 216 determines the operation input position to the touch panel display 220 based on the coordinate data output from the coordinate output unit 213 and the reaction area data stored in the reaction area storage unit 215. Determine if you are in the reaction area.

  When the reaction sound control unit 216 determines that the operation input position is within the reaction area (S27: Yes), the reaction sound control unit 216 outputs a drive signal for generating a reaction sound to the speaker 240 in step S28. As a result, a reaction sound (for example, a beep) is emitted from the speaker 240. On the other hand, if it is determined that the operation input position does not fall within the reaction area (S27: No), the process in step S28 is skipped and the in-vehicle display control routine is temporarily ended. The in-vehicle display control routine is repeatedly executed at a very short cycle.

  Therefore, in the in-vehicle display device 200, the image display and voice guidance performed on the mobile terminal 10 are simultaneously performed by the in-vehicle display control routine. Further, the mobile terminal 10 treats the operation input performed on the in-vehicle display device 200 in the same manner as the operation input performed on the mobile terminal 10 and performs processing for the operation input. Moreover, regarding the reaction sound with respect to the operation input performed with the vehicle-mounted display apparatus 200, before operation input is performed (every time a display screen is changed), reaction area data is transmitted from the portable terminal 10 to the vehicle-mounted display apparatus 200, Reaction sound control is performed on the in-vehicle display device 200 side based on the operation input position and the reaction area. For this reason, the timing at which the reaction sound is generated is not delayed.

  Here, the reason why the generation of the reaction sound is delayed when the reaction sound control is performed by the mobile terminal 10 will be described. FIG. 5 is a flowchart showing a comparison process (referred to as a comparison routine) when the reaction sound control is performed by the mobile terminal 10. In FIG. 5, the same steps as those in the in-vehicle display control routine of FIG. 4 are denoted by the same step symbols, and detailed description thereof is omitted.

  In this comparison routine, in the in-vehicle display device 200, the processes of steps S23, S24, and S27 are removed, and instead, the process of step S41 is added. On the other hand, on the mobile terminal 10 side, the processes of steps S14 to S16 are omitted, and the processes of steps S31 and S32 are added instead.

  In this comparison routine, when the user inputs an operation to the in-vehicle display device 200, operation input data is transmitted from the in-vehicle display device 200 to the mobile terminal 10 (S25, S26). When receiving the input data, the portable terminal 10 outputs the input data to the control processing unit 110 (S17, S18). Thereby, the control processing unit 110 advances the navigation control process in accordance with the operation input from the in-vehicle display device 200. Subsequently, in step S31, the mobile terminal 10 determines whether or not the operation input is an input in the reaction area. That is, it is determined whether or not the operation input is performed by the in-panel operation unit 222 and the operation input position is within the reaction area. When the mobile terminal 10 determines that the operation input position is within the reaction area based on the coordinate data transmitted from the in-vehicle display device 200 and the reaction area data stored in the mobile terminal 10 (S31). : Yes), in step S32, a reaction sound command is transmitted to the in-vehicle display device 200. On the other hand, if it is determined that the operation input position is not within the reaction area (S31: No), the process of step S32 is skipped.

  In the in-vehicle display device 200, in step S41, it is determined at a predetermined cycle whether or not a reaction sound command has been received. When a reaction sound command is received from the mobile terminal 10, a reaction sound generation drive signal is output to the speaker 240 and a reaction sound is generated from the speaker 240 in step S 28.

  Therefore, in this comparison routine, the process from the operation input of the in-panel operation unit 222 of the in-vehicle display device 200 until the reaction sound is actually generated from the speaker 240 is performed along the thick arrow in FIG. Become. Therefore, this processing includes transmission / reception processing between the in-vehicle display device 200 and the mobile terminal 10. For this reason, the timing at which the reaction sound is generated is delayed with respect to the operation input. On the other hand, in the in-vehicle display control routine of the present embodiment, the processing is performed along the thick line arrow in FIG. 4, so that transmission / reception processing for reaction sound control after operation input is not necessary. As a result, the timing at which a reaction sound is generated with respect to the operation input is not delayed.

  According to the image display system in the present embodiment described above, even if the vehicle navigation device is not mounted on the vehicle, by providing the vehicle display device 200 having a communication function, the vehicle traveling guide can be displayed on a large screen that is not different from the conventional one. Can receive. For this reason, the cost of the vehicle can be reduced while ensuring the visibility of navigation.

  In addition, a reaction sound can be generated with a good response to an operation input to the touch panel display 220. In addition, since operation input can be performed using the touch panel display 220, a wider operation area can be ensured compared to the mobile terminal 10. As a result, the user can comfortably perform operation input. Also, since the response of the reaction sound is good, there is no misunderstanding that the touch panel display 220 is out of order, and there is no possibility that the touch panel display 220 will be pressed hard and damaged.

  In addition, when the owner of the mobile terminal 10 is away from the vehicle, communication is not established between the mobile terminal 10 and the in-vehicle display device 200, so the cooperation control unit 120 performs navigation with the in-vehicle display device 200. Control for Therefore, it is possible to suppress power consumption necessary for it. Moreover, since the operation | movement of the vehicle-mounted display apparatus 200 stops, power consumption can be suppressed by that much.

  The image display system of the present embodiment has been described above, but the present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the object of the present invention.

  For example, in the present embodiment, since the image data is generated so that the display screen of the in-vehicle display device 200 is the same as the screen aspect ratio of the mobile terminal 10, the screen aspect ratio between the mobile terminal 10 and the in-vehicle display device 200 is Are different, a non-display area is formed on the on-vehicle display device 200 screen. For example, the screen size of the display unit 41 of the mobile terminal 10 is full-wide VGA (960 pixels wide × 480 pixels high), and the screen size of the display unit 221 of the in-vehicle display device 200 is wide VGA (800 pixels wide × 480 pixels high). In this case, a non-display area of horizontal 800 pixels × vertical 80 pixels is formed on the display screen of the in-vehicle display device 200 by adjusting the screen aspect ratio. Therefore, as shown in FIG. 8, a configuration in which the non-display area X is moved to the end of the display screen (the lower end in this example) and the button icon A is moved to the non-display area X may be employed. In this case, the vehicle image generation unit 130 may change the coordinate position of the button icon A when generating image data. The reaction area data stored in the reaction area storage unit 160 may be set to data representing the coordinate position of the button icon A provided in the non-display area X. According to this, the non-display area X can be used effectively, and an image such as a displayed map is easy to see.

  Further, the button icon layout may be freely changed in the display area. Further, since the in-vehicle display device 200 has a wider operation area than the mobile terminal 10, the number of button icons may be increased. Thereby, operability can be further improved.

  In the present embodiment, the in-vehicle image data is generated so that the screen aspect ratio is the same between the mobile terminal 10 and the in-vehicle display device 200, but the screen aspect ratio is not necessarily matched.

  Moreover, although this embodiment demonstrated the image display system which performs navigation for vehicles with the portable terminal 10 and the vehicle-mounted display apparatus 200, it is not restricted to what performs navigation for vehicles. For example, an image display system that executes a web browser application stored in the mobile terminal 10 and performs an Internet search from the mobile terminal 10 and the in-vehicle display device 200 may be used.

  In the present embodiment, the image display system in the vehicle has been described. However, the image display operation device in the present invention is not limited to the display device mounted in the vehicle, and is, for example, installed in a building. It may be portable or portable. Further, the image transmission apparatus according to the present invention is not limited to the portable terminal.

  In the present embodiment, the short-range wireless communication is performed between the mobile terminal 10 and the in-vehicle display device 200. However, the connection cable 300 (shown by a broken line in FIG. 1) is connected between the mobile terminal 10 and the in-vehicle display device 200. It is also possible to perform wired communication by connecting in a box. In this case, for example, USB connection, HDMI connection, or the like can be employed.

  Moreover, in this embodiment, although the structure which transmits reaction area data whenever the kind of display screen is changed is employ | adopted, if the timing which transmits reaction area data is before a user performs operation input, Anytime. For example, reaction area data for all types of display screens may be transmitted to the in-vehicle display device 200 at the start of the in-vehicle display control routine. In this case, reaction area data for all types of display screens is stored in the reaction area storage unit 215, and the reaction sound control unit 216 may refer to the reaction area data for the screen being displayed.

  The mobile terminal 10 in the present embodiment corresponds to the image transmission device of the present invention, and the in-vehicle display device 200 in the present embodiment corresponds to the image display operation device of the present invention. In addition, the reaction area storage unit 160 and the reaction area output unit 170 in the present embodiment correspond to the reaction sound region data transmission unit of the present invention. In addition, the reaction area storage unit 215 and the reaction sound control unit 216 in the present embodiment correspond to the reaction sound control means of the present invention.

  DESCRIPTION OF SYMBOLS 10 ... Portable terminal, 20 ... External communication part, 40, 220 ... Touch panel type display, 41, 221 ... Display part, 42, 222 ... In-panel operation part, 50, 230 ... Outside panel operation part, 60, 240 ... Speaker, DESCRIPTION OF SYMBOLS 70 ... Non-volatile memory, 80 ... Terminal side communication part, 100, 210 ... Electronic control unit (ECU), 110 ... Control processing part, 120 ... Cooperation control part, 130 ... In-vehicle image generation part, 140 ... Coordinate detection part, DESCRIPTION OF SYMBOLS 150 ... Operation detection part, 160 ... Reaction area memory | storage part, 170 ... Reaction area output part, 180 ... Audio | voice output part, 190, 211 ... Communication control part, 200 ... Car-mounted display apparatus, 212 ... Display control part, 213 ... Coordinate output Part 214, operation output part, 215 ... reaction area storage part, 216 ... reaction sound control part, 300 ... connection cable, 400 ... instrument panel.

Claims (3)

A touch panel display and a speaker for generating a reaction sound are provided, and an image is displayed on the touch panel display based on the received image data, and input position data representing an input position operated on the touch panel display is displayed. An image display operating device for transmission;
The image display operation device is communicably connected, and transmits image data of an image to be displayed on the touch panel display to the image display operation device, receives input position data of the touch panel display, and receives the input position. An image display system including an image transmission device that performs processing according to data,
The image transmission device includes reaction sound region data transmission means for transmitting reaction sound region data in which a reaction sound region to generate a reaction sound in the display image of the touch panel display is set to the image display operation device,
The image display operation device includes reaction sound control means for generating a reaction sound with the speaker when an input position input to the touch panel display based on the reaction sound area data enters the reaction sound area. An image display system characterized by that. The image display operation device is a touch panel type in-vehicle display device provided in a vehicle interior,
The image display system according to claim 1, wherein the image transmission device is a portable terminal.   The image display system according to claim 2, wherein the portable terminal is capable of performing navigation for a vehicle.

Images